-- Logs begin at Wed 2021-11-17 02:45:24 UTC, end at Wed 2021-11-17 04:11:58 UTC. -- Nov 17 03:16:43.894511 dv-cinder-818037-2-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Nov 17 03:16:43.902042 dv-cinder-818037-2-iscsi devstack@n-api.service[100956]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Nov 17 03:16:43.904054 dv-cinder-818037-2-iscsi devstack@n-api.service[100956]: *** Starting uWSGI 2.0.18-debian (64bit) on [Wed Nov 17 03:16:43 2021] *** Nov 17 03:16:43.904054 dv-cinder-818037-2-iscsi devstack@n-api.service[100956]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Nov 17 03:16:43.904054 dv-cinder-818037-2-iscsi devstack@n-api.service[100956]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Nov 17 03:16:43.904054 dv-cinder-818037-2-iscsi devstack@n-api.service[100956]: nodename: dv-cinder-818037-2-iscsi Nov 17 03:16:43.904054 dv-cinder-818037-2-iscsi devstack@n-api.service[100956]: machine: x86_64 Nov 17 03:16:43.904054 dv-cinder-818037-2-iscsi devstack@n-api.service[100956]: clock source: unix Nov 17 03:16:43.904054 dv-cinder-818037-2-iscsi devstack@n-api.service[100956]: pcre jit disabled Nov 17 03:16:43.904499 dv-cinder-818037-2-iscsi devstack@n-api.service[100956]: detected number of CPU cores: 4 Nov 17 03:16:43.904499 dv-cinder-818037-2-iscsi devstack@n-api.service[100956]: current working directory: / Nov 17 03:16:43.904499 dv-cinder-818037-2-iscsi devstack@n-api.service[100956]: detected binary path: /usr/bin/uwsgi-core Nov 17 03:16:43.904499 dv-cinder-818037-2-iscsi devstack@n-api.service[100956]: your processes number limit is 47680 Nov 17 03:16:43.904499 dv-cinder-818037-2-iscsi devstack@n-api.service[100956]: your memory page size is 4096 bytes Nov 17 03:16:43.904499 dv-cinder-818037-2-iscsi devstack@n-api.service[100956]: detected max file descriptor number: 2048 Nov 17 03:16:43.904499 dv-cinder-818037-2-iscsi devstack@n-api.service[100956]: lock engine: pthread robust mutexes Nov 17 03:16:43.904499 dv-cinder-818037-2-iscsi devstack@n-api.service[100956]: thunder lock: enabled Nov 17 03:16:43.904499 dv-cinder-818037-2-iscsi devstack@n-api.service[100956]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Nov 17 03:16:43.904499 dv-cinder-818037-2-iscsi devstack@n-api.service[100956]: Python version: 3.8.10 (default, Sep 28 2021, 16:10:42) [GCC 9.3.0] Nov 17 03:16:43.949684 dv-cinder-818037-2-iscsi devstack@n-api.service[100956]: Python main interpreter initialized at 0x564d535119c0 Nov 17 03:16:43.949684 dv-cinder-818037-2-iscsi devstack@n-api.service[100956]: python threads support enabled Nov 17 03:16:43.949684 dv-cinder-818037-2-iscsi devstack@n-api.service[100956]: your server socket listen backlog is limited to 100 connections Nov 17 03:16:43.949684 dv-cinder-818037-2-iscsi devstack@n-api.service[100956]: your mercy for graceful operations on workers is 90 seconds Nov 17 03:16:43.950089 dv-cinder-818037-2-iscsi devstack@n-api.service[100956]: mapped 403077 bytes (393 KB) for 2 cores Nov 17 03:16:43.950089 dv-cinder-818037-2-iscsi devstack@n-api.service[100956]: *** Operational MODE: preforking *** Nov 17 03:16:43.950399 dv-cinder-818037-2-iscsi devstack@n-api.service[100956]: *** uWSGI is running in multiple interpreter mode *** Nov 17 03:16:43.950399 dv-cinder-818037-2-iscsi devstack@n-api.service[100956]: spawned uWSGI master process (pid: 100956) Nov 17 03:16:43.950622 dv-cinder-818037-2-iscsi systemd[1]: Started Devstack devstack@n-api.service. Nov 17 03:16:43.951203 dv-cinder-818037-2-iscsi devstack@n-api.service[100956]: spawned uWSGI worker 1 (pid: 100957, cores: 1) Nov 17 03:16:43.951540 dv-cinder-818037-2-iscsi devstack@n-api.service[100956]: spawned uWSGI worker 2 (pid: 100958, cores: 1) Nov 17 03:16:43.952813 dv-cinder-818037-2-iscsi devstack@n-api.service[100956]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Nov 17 03:16:45.522199 dv-cinder-818037-2-iscsi devstack@n-api.service[100958]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Nov 17 03:16:45.522199 dv-cinder-818037-2-iscsi devstack@n-api.service[100958]: from cryptography.utils import int_from_bytes Nov 17 03:16:45.522944 dv-cinder-818037-2-iscsi devstack@n-api.service[100958]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Nov 17 03:16:45.522944 dv-cinder-818037-2-iscsi devstack@n-api.service[100958]: from cryptography.utils import int_from_bytes Nov 17 03:16:45.523226 dv-cinder-818037-2-iscsi devstack@n-api.service[100957]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Nov 17 03:16:45.523226 dv-cinder-818037-2-iscsi devstack@n-api.service[100957]: from cryptography.utils import int_from_bytes Nov 17 03:16:45.523684 dv-cinder-818037-2-iscsi devstack@n-api.service[100957]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Nov 17 03:16:45.523684 dv-cinder-818037-2-iscsi devstack@n-api.service[100957]: from cryptography.utils import int_from_bytes Nov 17 03:16:47.961432 dv-cinder-818037-2-iscsi devstack@n-api.service[100958]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=100958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Nov 17 03:16:47.962035 dv-cinder-818037-2-iscsi devstack@n-api.service[100958]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=100958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Nov 17 03:16:47.962122 dv-cinder-818037-2-iscsi devstack@n-api.service[100958]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=100958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Nov 17 03:16:47.962496 dv-cinder-818037-2-iscsi devstack@n-api.service[100958]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=100958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Nov 17 03:16:47.962746 dv-cinder-818037-2-iscsi devstack@n-api.service[100958]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=100958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Nov 17 03:16:47.963132 dv-cinder-818037-2-iscsi devstack@n-api.service[100958]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=100958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 17 03:16:47.963452 dv-cinder-818037-2-iscsi devstack@n-api.service[100958]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=100958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 17 03:16:47.963765 dv-cinder-818037-2-iscsi devstack@n-api.service[100958]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=100958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 17 03:16:47.964080 dv-cinder-818037-2-iscsi devstack@n-api.service[100958]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=100958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 17 03:16:47.964400 dv-cinder-818037-2-iscsi devstack@n-api.service[100957]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=100957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Nov 17 03:16:47.964849 dv-cinder-818037-2-iscsi devstack@n-api.service[100958]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=100958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 17 03:16:47.964951 dv-cinder-818037-2-iscsi devstack@n-api.service[100957]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=100957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Nov 17 03:16:47.965035 dv-cinder-818037-2-iscsi devstack@n-api.service[100958]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=100958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 17 03:16:47.965035 dv-cinder-818037-2-iscsi devstack@n-api.service[100958]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=100958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 17 03:16:47.965170 dv-cinder-818037-2-iscsi devstack@n-api.service[100957]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=100957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Nov 17 03:16:47.965327 dv-cinder-818037-2-iscsi devstack@n-api.service[100958]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=100958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 17 03:16:47.965525 dv-cinder-818037-2-iscsi devstack@n-api.service[100957]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=100957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Nov 17 03:16:47.965640 dv-cinder-818037-2-iscsi devstack@n-api.service[100958]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=100958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 17 03:16:47.965765 dv-cinder-818037-2-iscsi devstack@n-api.service[100957]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=100957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Nov 17 03:16:47.965866 dv-cinder-818037-2-iscsi devstack@n-api.service[100958]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=100958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 17 03:16:47.966191 dv-cinder-818037-2-iscsi devstack@n-api.service[100958]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=100958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 17 03:16:47.966318 dv-cinder-818037-2-iscsi devstack@n-api.service[100957]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=100957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 17 03:16:47.966489 dv-cinder-818037-2-iscsi devstack@n-api.service[100958]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-818037-2-iscsi {{(pid=100958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 17 03:16:47.966599 dv-cinder-818037-2-iscsi devstack@n-api.service[100957]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=100957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 17 03:16:47.966828 dv-cinder-818037-2-iscsi devstack@n-api.service[100958]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=100958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 17 03:16:47.966917 dv-cinder-818037-2-iscsi devstack@n-api.service[100957]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=100957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 17 03:16:47.967127 dv-cinder-818037-2-iscsi devstack@n-api.service[100958]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=100958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 17 03:16:47.967223 dv-cinder-818037-2-iscsi devstack@n-api.service[100957]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=100957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 17 03:16:47.967433 dv-cinder-818037-2-iscsi devstack@n-api.service[100958]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=100958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 17 03:16:47.967528 dv-cinder-818037-2-iscsi devstack@n-api.service[100957]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=100957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 17 03:16:47.967747 dv-cinder-818037-2-iscsi devstack@n-api.service[100958]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=100958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 17 03:16:47.967846 dv-cinder-818037-2-iscsi devstack@n-api.service[100957]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=100957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 17 03:16:47.968045 dv-cinder-818037-2-iscsi devstack@n-api.service[100958]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=100958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 17 03:16:47.968142 dv-cinder-818037-2-iscsi devstack@n-api.service[100957]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=100957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 17 03:16:47.968366 dv-cinder-818037-2-iscsi devstack@n-api.service[100958]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=100958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 17 03:16:47.968462 dv-cinder-818037-2-iscsi devstack@n-api.service[100957]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=100957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 17 03:16:47.968677 dv-cinder-818037-2-iscsi devstack@n-api.service[100958]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=100958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 17 03:16:47.968764 dv-cinder-818037-2-iscsi devstack@n-api.service[100957]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=100957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 17 03:16:47.969020 dv-cinder-818037-2-iscsi devstack@n-api.service[100957]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=100957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 17 03:16:47.969190 dv-cinder-818037-2-iscsi devstack@n-api.service[100958]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=100958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 17 03:16:47.969343 dv-cinder-818037-2-iscsi devstack@n-api.service[100957]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=100957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 17 03:16:47.970360 dv-cinder-818037-2-iscsi devstack@n-api.service[100958]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=100958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 17 03:16:47.970455 dv-cinder-818037-2-iscsi devstack@n-api.service[100957]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-818037-2-iscsi {{(pid=100957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 17 03:16:47.970537 dv-cinder-818037-2-iscsi devstack@n-api.service[100958]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=100958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 17 03:16:47.970614 dv-cinder-818037-2-iscsi devstack@n-api.service[100957]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=100957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 17 03:16:47.970682 dv-cinder-818037-2-iscsi devstack@n-api.service[100958]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=100958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 17 03:16:47.970748 dv-cinder-818037-2-iscsi devstack@n-api.service[100957]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=100957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 17 03:16:47.970812 dv-cinder-818037-2-iscsi devstack@n-api.service[100958]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=100958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 17 03:16:47.970884 dv-cinder-818037-2-iscsi devstack@n-api.service[100957]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=100957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 17 03:16:47.970957 dv-cinder-818037-2-iscsi devstack@n-api.service[100958]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=100958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 17 03:16:47.971036 dv-cinder-818037-2-iscsi devstack@n-api.service[100957]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=100957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 17 03:16:47.971108 dv-cinder-818037-2-iscsi devstack@n-api.service[100958]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=100958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 17 03:16:47.971180 dv-cinder-818037-2-iscsi devstack@n-api.service[100957]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=100957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 17 03:16:47.971438 dv-cinder-818037-2-iscsi devstack@n-api.service[100958]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=100958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 17 03:16:47.971527 dv-cinder-818037-2-iscsi devstack@n-api.service[100957]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=100957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 17 03:16:47.971743 dv-cinder-818037-2-iscsi devstack@n-api.service[100958]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=100958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 17 03:16:47.971845 dv-cinder-818037-2-iscsi devstack@n-api.service[100957]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=100957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 17 03:16:47.972078 dv-cinder-818037-2-iscsi devstack@n-api.service[100958]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=100958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 17 03:16:47.972275 dv-cinder-818037-2-iscsi devstack@n-api.service[100957]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=100957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 17 03:16:47.972381 dv-cinder-818037-2-iscsi devstack@n-api.service[100958]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=100958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 17 03:16:47.972617 dv-cinder-818037-2-iscsi devstack@n-api.service[100957]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=100957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 17 03:16:47.972959 dv-cinder-818037-2-iscsi devstack@n-api.service[100957]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=100957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 17 03:16:47.973291 dv-cinder-818037-2-iscsi devstack@n-api.service[100957]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=100957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 17 03:16:47.973635 dv-cinder-818037-2-iscsi devstack@n-api.service[100957]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=100957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 17 03:16:47.973860 dv-cinder-818037-2-iscsi devstack@n-api.service[100958]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-818037-2-iscsi {{(pid=100958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 17 03:16:47.973998 dv-cinder-818037-2-iscsi devstack@n-api.service[100957]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=100957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 17 03:16:47.974189 dv-cinder-818037-2-iscsi devstack@n-api.service[100958]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=100958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 17 03:16:47.974317 dv-cinder-818037-2-iscsi devstack@n-api.service[100957]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=100957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 17 03:16:47.974512 dv-cinder-818037-2-iscsi devstack@n-api.service[100958]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=100958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 17 03:16:47.974637 dv-cinder-818037-2-iscsi devstack@n-api.service[100957]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=100957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 17 03:16:47.974833 dv-cinder-818037-2-iscsi devstack@n-api.service[100958]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=100958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 17 03:16:47.974972 dv-cinder-818037-2-iscsi devstack@n-api.service[100957]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=100957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 17 03:16:47.975460 dv-cinder-818037-2-iscsi devstack@n-api.service[100958]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=100958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 17 03:16:47.975584 dv-cinder-818037-2-iscsi devstack@n-api.service[100957]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=100957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 17 03:16:47.975710 dv-cinder-818037-2-iscsi devstack@n-api.service[100958]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=100958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 17 03:16:47.975840 dv-cinder-818037-2-iscsi devstack@n-api.service[100957]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=100957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 17 03:16:47.975968 dv-cinder-818037-2-iscsi devstack@n-api.service[100958]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=100958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 17 03:16:47.976182 dv-cinder-818037-2-iscsi devstack@n-api.service[100958]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=100958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 17 03:16:47.976306 dv-cinder-818037-2-iscsi devstack@n-api.service[100957]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-818037-2-iscsi {{(pid=100957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 17 03:16:47.976435 dv-cinder-818037-2-iscsi devstack@n-api.service[100958]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=100958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 17 03:16:47.976564 dv-cinder-818037-2-iscsi devstack@n-api.service[100957]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=100957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 17 03:16:47.976757 dv-cinder-818037-2-iscsi devstack@n-api.service[100958]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=100958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 17 03:16:47.976900 dv-cinder-818037-2-iscsi devstack@n-api.service[100957]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=100957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 17 03:16:47.977109 dv-cinder-818037-2-iscsi devstack@n-api.service[100958]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=100958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 17 03:16:47.977253 dv-cinder-818037-2-iscsi devstack@n-api.service[100957]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=100957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 17 03:16:47.977429 dv-cinder-818037-2-iscsi devstack@n-api.service[100958]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=100958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 17 03:16:47.977563 dv-cinder-818037-2-iscsi devstack@n-api.service[100957]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=100957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 17 03:16:47.977752 dv-cinder-818037-2-iscsi devstack@n-api.service[100958]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=100958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 17 03:16:47.977887 dv-cinder-818037-2-iscsi devstack@n-api.service[100957]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=100957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 17 03:16:47.978071 dv-cinder-818037-2-iscsi devstack@n-api.service[100958]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=100958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 17 03:16:47.978206 dv-cinder-818037-2-iscsi devstack@n-api.service[100957]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=100957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 17 03:16:47.978379 dv-cinder-818037-2-iscsi devstack@n-api.service[100958]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=100958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 17 03:16:47.978512 dv-cinder-818037-2-iscsi devstack@n-api.service[100957]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=100957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 17 03:16:47.978687 dv-cinder-818037-2-iscsi devstack@n-api.service[100958]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=100958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 17 03:16:47.978819 dv-cinder-818037-2-iscsi devstack@n-api.service[100957]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=100957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 17 03:16:47.978998 dv-cinder-818037-2-iscsi devstack@n-api.service[100958]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=100958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 17 03:16:47.979141 dv-cinder-818037-2-iscsi devstack@n-api.service[100957]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=100957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 17 03:16:47.979299 dv-cinder-818037-2-iscsi devstack@n-api.service[100958]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=100958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 17 03:16:47.979426 dv-cinder-818037-2-iscsi devstack@n-api.service[100957]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=100957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 17 03:16:47.979614 dv-cinder-818037-2-iscsi devstack@n-api.service[100958]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=100958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 17 03:16:47.979749 dv-cinder-818037-2-iscsi devstack@n-api.service[100957]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=100957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 17 03:16:47.979912 dv-cinder-818037-2-iscsi devstack@n-api.service[100958]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=100958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 17 03:16:47.980045 dv-cinder-818037-2-iscsi devstack@n-api.service[100957]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=100957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 17 03:16:47.980167 dv-cinder-818037-2-iscsi devstack@n-api.service[100958]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=100958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 17 03:16:47.980285 dv-cinder-818037-2-iscsi devstack@n-api.service[100957]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=100957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 17 03:16:47.980460 dv-cinder-818037-2-iscsi devstack@n-api.service[100958]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=100958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 17 03:16:47.980587 dv-cinder-818037-2-iscsi devstack@n-api.service[100957]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=100957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 17 03:16:47.980764 dv-cinder-818037-2-iscsi devstack@n-api.service[100958]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=100958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 17 03:16:47.980914 dv-cinder-818037-2-iscsi devstack@n-api.service[100957]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=100957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 17 03:16:47.981121 dv-cinder-818037-2-iscsi devstack@n-api.service[100958]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=100958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 17 03:16:47.981248 dv-cinder-818037-2-iscsi devstack@n-api.service[100957]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=100957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 17 03:16:47.981441 dv-cinder-818037-2-iscsi devstack@n-api.service[100958]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=100958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 17 03:16:47.981570 dv-cinder-818037-2-iscsi devstack@n-api.service[100957]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=100957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 17 03:16:47.981698 dv-cinder-818037-2-iscsi devstack@n-api.service[100958]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=100958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 17 03:16:47.981821 dv-cinder-818037-2-iscsi devstack@n-api.service[100957]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=100957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 17 03:16:47.981940 dv-cinder-818037-2-iscsi devstack@n-api.service[100958]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=100958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 17 03:16:47.982110 dv-cinder-818037-2-iscsi devstack@n-api.service[100957]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=100957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 17 03:16:47.982247 dv-cinder-818037-2-iscsi devstack@n-api.service[100958]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=100958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 17 03:16:47.982375 dv-cinder-818037-2-iscsi devstack@n-api.service[100957]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=100957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 17 03:16:47.982496 dv-cinder-818037-2-iscsi devstack@n-api.service[100958]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=100958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 17 03:16:47.982651 dv-cinder-818037-2-iscsi devstack@n-api.service[100957]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=100957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 17 03:16:47.982788 dv-cinder-818037-2-iscsi devstack@n-api.service[100958]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=100958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 17 03:16:47.982991 dv-cinder-818037-2-iscsi devstack@n-api.service[100957]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=100957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 17 03:16:47.983118 dv-cinder-818037-2-iscsi devstack@n-api.service[100958]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=100958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 17 03:16:47.983333 dv-cinder-818037-2-iscsi devstack@n-api.service[100957]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=100957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 17 03:16:47.983467 dv-cinder-818037-2-iscsi devstack@n-api.service[100958]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=100958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 17 03:16:47.983641 dv-cinder-818037-2-iscsi devstack@n-api.service[100957]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=100957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 17 03:16:47.983772 dv-cinder-818037-2-iscsi devstack@n-api.service[100958]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=100958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 17 03:16:47.983890 dv-cinder-818037-2-iscsi devstack@n-api.service[100957]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=100957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 17 03:16:47.984030 dv-cinder-818037-2-iscsi devstack@n-api.service[100958]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=100958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 17 03:16:47.984157 dv-cinder-818037-2-iscsi devstack@n-api.service[100957]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=100957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 17 03:16:47.984285 dv-cinder-818037-2-iscsi devstack@n-api.service[100958]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=100958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 17 03:16:47.984410 dv-cinder-818037-2-iscsi devstack@n-api.service[100957]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=100957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 17 03:16:47.984530 dv-cinder-818037-2-iscsi devstack@n-api.service[100958]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=100958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 17 03:16:47.984737 dv-cinder-818037-2-iscsi devstack@n-api.service[100957]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=100957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 17 03:16:47.984902 dv-cinder-818037-2-iscsi devstack@n-api.service[100958]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=100958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 17 03:16:47.985078 dv-cinder-818037-2-iscsi devstack@n-api.service[100957]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=100957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 17 03:16:47.985206 dv-cinder-818037-2-iscsi devstack@n-api.service[100958]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=100958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 17 03:16:47.985391 dv-cinder-818037-2-iscsi devstack@n-api.service[100957]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=100957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 17 03:16:47.985523 dv-cinder-818037-2-iscsi devstack@n-api.service[100958]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=100958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 17 03:16:47.985712 dv-cinder-818037-2-iscsi devstack@n-api.service[100957]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=100957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 17 03:16:47.985856 dv-cinder-818037-2-iscsi devstack@n-api.service[100958]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=100958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 17 03:16:47.985985 dv-cinder-818037-2-iscsi devstack@n-api.service[100957]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=100957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 17 03:16:47.986113 dv-cinder-818037-2-iscsi devstack@n-api.service[100958]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=100958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 17 03:16:47.986307 dv-cinder-818037-2-iscsi devstack@n-api.service[100957]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=100957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 17 03:16:47.986436 dv-cinder-818037-2-iscsi devstack@n-api.service[100958]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=100958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 17 03:16:47.986616 dv-cinder-818037-2-iscsi devstack@n-api.service[100957]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=100957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 17 03:16:47.986744 dv-cinder-818037-2-iscsi devstack@n-api.service[100958]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.11 {{(pid=100958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 17 03:16:47.986928 dv-cinder-818037-2-iscsi devstack@n-api.service[100957]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=100957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 17 03:16:47.987055 dv-cinder-818037-2-iscsi devstack@n-api.service[100958]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.11 {{(pid=100958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 17 03:16:47.987244 dv-cinder-818037-2-iscsi devstack@n-api.service[100957]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=100957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 17 03:16:47.987376 dv-cinder-818037-2-iscsi devstack@n-api.service[100958]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=100958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 17 03:16:47.987568 dv-cinder-818037-2-iscsi devstack@n-api.service[100957]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=100957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 17 03:16:47.987695 dv-cinder-818037-2-iscsi devstack@n-api.service[100958]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=100958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 17 03:16:47.987879 dv-cinder-818037-2-iscsi devstack@n-api.service[100958]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=100958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 17 03:16:47.988004 dv-cinder-818037-2-iscsi devstack@n-api.service[100957]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=100957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 17 03:16:47.988207 dv-cinder-818037-2-iscsi devstack@n-api.service[100958]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=100958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 17 03:16:47.988334 dv-cinder-818037-2-iscsi devstack@n-api.service[100957]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=100957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 17 03:16:47.988519 dv-cinder-818037-2-iscsi devstack@n-api.service[100957]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=100957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 17 03:16:47.988644 dv-cinder-818037-2-iscsi devstack@n-api.service[100958]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=100958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 17 03:16:47.988849 dv-cinder-818037-2-iscsi devstack@n-api.service[100958]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=100958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 17 03:16:47.988989 dv-cinder-818037-2-iscsi devstack@n-api.service[100957]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=100957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 17 03:16:47.989158 dv-cinder-818037-2-iscsi devstack@n-api.service[100958]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=100958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 17 03:16:47.989284 dv-cinder-818037-2-iscsi devstack@n-api.service[100957]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.11 {{(pid=100957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 17 03:16:47.989468 dv-cinder-818037-2-iscsi devstack@n-api.service[100958]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=100958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 17 03:16:47.989595 dv-cinder-818037-2-iscsi devstack@n-api.service[100957]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.11 {{(pid=100957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 17 03:16:47.989769 dv-cinder-818037-2-iscsi devstack@n-api.service[100958]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=100958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 17 03:16:47.989895 dv-cinder-818037-2-iscsi devstack@n-api.service[100957]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=100957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 17 03:16:47.990087 dv-cinder-818037-2-iscsi devstack@n-api.service[100958]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=100958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 17 03:16:47.990214 dv-cinder-818037-2-iscsi devstack@n-api.service[100957]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=100957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 17 03:16:47.990420 dv-cinder-818037-2-iscsi devstack@n-api.service[100958]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=100958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 17 03:16:47.990547 dv-cinder-818037-2-iscsi devstack@n-api.service[100957]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=100957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 17 03:16:47.990722 dv-cinder-818037-2-iscsi devstack@n-api.service[100958]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=100958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 17 03:16:47.990848 dv-cinder-818037-2-iscsi devstack@n-api.service[100957]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=100957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 17 03:16:47.990977 dv-cinder-818037-2-iscsi devstack@n-api.service[100958]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=100958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 17 03:16:47.991106 dv-cinder-818037-2-iscsi devstack@n-api.service[100957]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=100957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 17 03:16:47.991233 dv-cinder-818037-2-iscsi devstack@n-api.service[100958]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=100958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 17 03:16:47.991353 dv-cinder-818037-2-iscsi devstack@n-api.service[100957]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=100957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 17 03:16:47.991537 dv-cinder-818037-2-iscsi devstack@n-api.service[100958]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=100958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 17 03:16:47.991671 dv-cinder-818037-2-iscsi devstack@n-api.service[100957]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=100957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 17 03:16:47.991840 dv-cinder-818037-2-iscsi devstack@n-api.service[100958]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=100958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 17 03:16:47.991972 dv-cinder-818037-2-iscsi devstack@n-api.service[100957]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=100957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 17 03:16:47.992142 dv-cinder-818037-2-iscsi devstack@n-api.service[100958]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=100958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 17 03:16:47.992264 dv-cinder-818037-2-iscsi devstack@n-api.service[100957]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=100957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 17 03:16:47.992446 dv-cinder-818037-2-iscsi devstack@n-api.service[100958]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=100958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 17 03:16:47.992576 dv-cinder-818037-2-iscsi devstack@n-api.service[100957]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=100957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 17 03:16:47.992748 dv-cinder-818037-2-iscsi devstack@n-api.service[100958]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=100958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 17 03:16:47.992935 dv-cinder-818037-2-iscsi devstack@n-api.service[100957]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=100957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 17 03:16:47.993057 dv-cinder-818037-2-iscsi devstack@n-api.service[100958]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=100958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 17 03:16:47.993175 dv-cinder-818037-2-iscsi devstack@n-api.service[100957]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=100957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 17 03:16:47.993353 dv-cinder-818037-2-iscsi devstack@n-api.service[100958]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=100958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 17 03:16:47.993488 dv-cinder-818037-2-iscsi devstack@n-api.service[100957]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=100957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 17 03:16:47.993659 dv-cinder-818037-2-iscsi devstack@n-api.service[100958]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=100958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 17 03:16:47.993793 dv-cinder-818037-2-iscsi devstack@n-api.service[100957]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=100957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 17 03:16:47.993963 dv-cinder-818037-2-iscsi devstack@n-api.service[100958]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=100958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 17 03:16:47.994086 dv-cinder-818037-2-iscsi devstack@n-api.service[100957]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=100957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 17 03:16:47.994265 dv-cinder-818037-2-iscsi devstack@n-api.service[100958]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=100958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 17 03:16:47.994388 dv-cinder-818037-2-iscsi devstack@n-api.service[100957]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=100957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 17 03:16:47.994566 dv-cinder-818037-2-iscsi devstack@n-api.service[100958]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=100958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 17 03:16:47.994697 dv-cinder-818037-2-iscsi devstack@n-api.service[100957]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=100957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 17 03:16:47.994875 dv-cinder-818037-2-iscsi devstack@n-api.service[100957]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=100957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 17 03:16:47.995004 dv-cinder-818037-2-iscsi devstack@n-api.service[100958]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=100958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 17 03:16:47.995174 dv-cinder-818037-2-iscsi devstack@n-api.service[100958]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=100958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 17 03:16:47.995295 dv-cinder-818037-2-iscsi devstack@n-api.service[100957]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=100957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 17 03:16:47.995473 dv-cinder-818037-2-iscsi devstack@n-api.service[100957]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=100957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 17 03:16:47.995596 dv-cinder-818037-2-iscsi devstack@n-api.service[100958]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=100958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 17 03:16:47.995771 dv-cinder-818037-2-iscsi devstack@n-api.service[100958]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=100958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 17 03:16:47.995900 dv-cinder-818037-2-iscsi devstack@n-api.service[100957]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=100957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 17 03:16:47.996079 dv-cinder-818037-2-iscsi devstack@n-api.service[100957]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=100957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 17 03:16:47.996208 dv-cinder-818037-2-iscsi devstack@n-api.service[100958]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=100958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 17 03:16:47.996391 dv-cinder-818037-2-iscsi devstack@n-api.service[100957]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=100957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 17 03:16:47.996522 dv-cinder-818037-2-iscsi devstack@n-api.service[100958]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=100958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 17 03:16:47.996689 dv-cinder-818037-2-iscsi devstack@n-api.service[100958]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=100958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 17 03:16:47.996834 dv-cinder-818037-2-iscsi devstack@n-api.service[100957]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=100957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 17 03:16:47.997015 dv-cinder-818037-2-iscsi devstack@n-api.service[100958]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=100958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 17 03:16:47.997138 dv-cinder-818037-2-iscsi devstack@n-api.service[100957]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=100957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 17 03:16:47.997316 dv-cinder-818037-2-iscsi devstack@n-api.service[100958]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=100958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 17 03:16:47.997440 dv-cinder-818037-2-iscsi devstack@n-api.service[100957]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=100957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 17 03:16:47.997618 dv-cinder-818037-2-iscsi devstack@n-api.service[100958]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=100958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 17 03:16:47.997758 dv-cinder-818037-2-iscsi devstack@n-api.service[100957]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=100957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 17 03:16:47.997922 dv-cinder-818037-2-iscsi devstack@n-api.service[100957]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=100957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 17 03:16:47.998044 dv-cinder-818037-2-iscsi devstack@n-api.service[100958]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=100958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 17 03:16:47.998224 dv-cinder-818037-2-iscsi devstack@n-api.service[100958]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=100958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 17 03:16:47.998354 dv-cinder-818037-2-iscsi devstack@n-api.service[100957]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=100957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 17 03:16:47.998526 dv-cinder-818037-2-iscsi devstack@n-api.service[100958]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=100958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 17 03:16:47.998649 dv-cinder-818037-2-iscsi devstack@n-api.service[100957]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=100957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 17 03:16:47.998842 dv-cinder-818037-2-iscsi devstack@n-api.service[100958]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=100958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 17 03:16:47.998973 dv-cinder-818037-2-iscsi devstack@n-api.service[100957]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=100957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 17 03:16:47.999145 dv-cinder-818037-2-iscsi devstack@n-api.service[100958]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=100958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 17 03:16:47.999269 dv-cinder-818037-2-iscsi devstack@n-api.service[100957]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=100957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 17 03:16:47.999448 dv-cinder-818037-2-iscsi devstack@n-api.service[100958]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=100958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 17 03:16:47.999571 dv-cinder-818037-2-iscsi devstack@n-api.service[100957]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=100957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 17 03:16:47.999746 dv-cinder-818037-2-iscsi devstack@n-api.service[100957]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=100957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 17 03:16:47.999875 dv-cinder-818037-2-iscsi devstack@n-api.service[100958]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=100958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 17 03:16:48.000045 dv-cinder-818037-2-iscsi devstack@n-api.service[100957]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=100957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 17 03:16:48.000170 dv-cinder-818037-2-iscsi devstack@n-api.service[100958]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=100958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 17 03:16:48.000377 dv-cinder-818037-2-iscsi devstack@n-api.service[100958]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=100958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 17 03:16:48.000500 dv-cinder-818037-2-iscsi devstack@n-api.service[100957]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=100957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 17 03:16:48.000641 dv-cinder-818037-2-iscsi devstack@n-api.service[100958]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=100958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 17 03:16:48.000764 dv-cinder-818037-2-iscsi devstack@n-api.service[100957]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=100957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 17 03:16:48.000955 dv-cinder-818037-2-iscsi devstack@n-api.service[100958]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=100958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 17 03:16:48.001077 dv-cinder-818037-2-iscsi devstack@n-api.service[100957]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=100957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 17 03:16:48.001251 dv-cinder-818037-2-iscsi devstack@n-api.service[100958]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=100958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 17 03:16:48.001381 dv-cinder-818037-2-iscsi devstack@n-api.service[100957]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=100957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 17 03:16:48.001565 dv-cinder-818037-2-iscsi devstack@n-api.service[100958]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=100958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 17 03:16:48.001709 dv-cinder-818037-2-iscsi devstack@n-api.service[100957]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=100957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 17 03:16:48.001869 dv-cinder-818037-2-iscsi devstack@n-api.service[100958]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=100958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 17 03:16:48.001996 dv-cinder-818037-2-iscsi devstack@n-api.service[100957]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=100957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 17 03:16:48.002173 dv-cinder-818037-2-iscsi devstack@n-api.service[100958]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=100958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 17 03:16:48.002296 dv-cinder-818037-2-iscsi devstack@n-api.service[100957]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=100957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 17 03:16:48.002472 dv-cinder-818037-2-iscsi devstack@n-api.service[100958]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=100958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 17 03:16:48.002608 dv-cinder-818037-2-iscsi devstack@n-api.service[100957]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=100957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 17 03:16:48.002775 dv-cinder-818037-2-iscsi devstack@n-api.service[100958]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=100958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 17 03:16:48.002906 dv-cinder-818037-2-iscsi devstack@n-api.service[100957]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=100957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 17 03:16:48.003076 dv-cinder-818037-2-iscsi devstack@n-api.service[100958]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=100958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 17 03:16:48.003201 dv-cinder-818037-2-iscsi devstack@n-api.service[100957]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=100957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 17 03:16:48.003380 dv-cinder-818037-2-iscsi devstack@n-api.service[100958]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=100958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 17 03:16:48.003513 dv-cinder-818037-2-iscsi devstack@n-api.service[100957]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=100957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 17 03:16:48.003679 dv-cinder-818037-2-iscsi devstack@n-api.service[100958]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=100958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 17 03:16:48.003868 dv-cinder-818037-2-iscsi devstack@n-api.service[100957]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=100957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 17 03:16:48.004024 dv-cinder-818037-2-iscsi devstack@n-api.service[100958]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=100958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 17 03:16:48.004147 dv-cinder-818037-2-iscsi devstack@n-api.service[100957]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=100957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 17 03:16:48.004324 dv-cinder-818037-2-iscsi devstack@n-api.service[100958]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=100958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 17 03:16:48.004444 dv-cinder-818037-2-iscsi devstack@n-api.service[100957]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=100957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 17 03:16:48.004640 dv-cinder-818037-2-iscsi devstack@n-api.service[100958]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=100958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 17 03:16:48.004763 dv-cinder-818037-2-iscsi devstack@n-api.service[100957]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=100957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 17 03:16:48.004972 dv-cinder-818037-2-iscsi devstack@n-api.service[100958]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=100958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 17 03:16:48.005092 dv-cinder-818037-2-iscsi devstack@n-api.service[100957]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=100957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 17 03:16:48.005277 dv-cinder-818037-2-iscsi devstack@n-api.service[100958]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=100958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 17 03:16:48.005409 dv-cinder-818037-2-iscsi devstack@n-api.service[100957]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=100957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 17 03:16:48.005580 dv-cinder-818037-2-iscsi devstack@n-api.service[100958]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=100958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 17 03:16:48.005702 dv-cinder-818037-2-iscsi devstack@n-api.service[100957]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=100957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 17 03:16:48.005881 dv-cinder-818037-2-iscsi devstack@n-api.service[100958]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=100958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 17 03:16:48.006004 dv-cinder-818037-2-iscsi devstack@n-api.service[100957]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=100957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 17 03:16:48.006199 dv-cinder-818037-2-iscsi devstack@n-api.service[100958]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=100958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 17 03:16:48.006330 dv-cinder-818037-2-iscsi devstack@n-api.service[100957]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=100957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 17 03:16:48.006532 dv-cinder-818037-2-iscsi devstack@n-api.service[100958]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=100958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:16:48.006662 dv-cinder-818037-2-iscsi devstack@n-api.service[100957]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=100957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 17 03:16:48.006832 dv-cinder-818037-2-iscsi devstack@n-api.service[100957]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=100957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 17 03:16:48.006952 dv-cinder-818037-2-iscsi devstack@n-api.service[100958]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=100958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:16:48.007166 dv-cinder-818037-2-iscsi devstack@n-api.service[100957]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=100957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 17 03:16:48.007289 dv-cinder-818037-2-iscsi devstack@n-api.service[100958]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=100958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:16:48.007483 dv-cinder-818037-2-iscsi devstack@n-api.service[100958]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=100958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:16:48.007604 dv-cinder-818037-2-iscsi devstack@n-api.service[100957]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=100957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 17 03:16:48.007794 dv-cinder-818037-2-iscsi devstack@n-api.service[100957]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=100957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 17 03:16:48.007915 dv-cinder-818037-2-iscsi devstack@n-api.service[100958]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=100958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:16:48.008110 dv-cinder-818037-2-iscsi devstack@n-api.service[100957]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=100957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 17 03:16:48.008238 dv-cinder-818037-2-iscsi devstack@n-api.service[100958]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=100958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:16:48.008422 dv-cinder-818037-2-iscsi devstack@n-api.service[100957]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=100957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 17 03:16:48.008546 dv-cinder-818037-2-iscsi devstack@n-api.service[100958]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=100958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:16:48.008728 dv-cinder-818037-2-iscsi devstack@n-api.service[100958]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=100958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:16:48.008904 dv-cinder-818037-2-iscsi devstack@n-api.service[100957]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=100957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 17 03:16:48.009073 dv-cinder-818037-2-iscsi devstack@n-api.service[100958]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=100958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:16:48.009203 dv-cinder-818037-2-iscsi devstack@n-api.service[100957]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=100957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:16:48.009399 dv-cinder-818037-2-iscsi devstack@n-api.service[100958]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=100958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:16:48.009522 dv-cinder-818037-2-iscsi devstack@n-api.service[100957]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=100957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:16:48.009711 dv-cinder-818037-2-iscsi devstack@n-api.service[100958]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=100958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:16:48.009841 dv-cinder-818037-2-iscsi devstack@n-api.service[100957]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=100957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:16:48.010021 dv-cinder-818037-2-iscsi devstack@n-api.service[100958]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=100958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:16:48.010143 dv-cinder-818037-2-iscsi devstack@n-api.service[100957]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=100957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:16:48.010330 dv-cinder-818037-2-iscsi devstack@n-api.service[100958]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=100958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:16:48.010451 dv-cinder-818037-2-iscsi devstack@n-api.service[100957]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=100957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:16:48.010646 dv-cinder-818037-2-iscsi devstack@n-api.service[100958]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=100958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:16:48.010781 dv-cinder-818037-2-iscsi devstack@n-api.service[100957]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=100957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:16:48.010965 dv-cinder-818037-2-iscsi devstack@n-api.service[100958]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=100958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:16:48.011087 dv-cinder-818037-2-iscsi devstack@n-api.service[100957]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=100957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:16:48.011292 dv-cinder-818037-2-iscsi devstack@n-api.service[100958]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=100958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:16:48.011414 dv-cinder-818037-2-iscsi devstack@n-api.service[100957]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=100957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:16:48.011607 dv-cinder-818037-2-iscsi devstack@n-api.service[100958]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=100958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:16:48.011742 dv-cinder-818037-2-iscsi devstack@n-api.service[100957]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=100957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:16:48.011921 dv-cinder-818037-2-iscsi devstack@n-api.service[100958]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=100958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:16:48.012043 dv-cinder-818037-2-iscsi devstack@n-api.service[100957]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=100957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:16:48.012233 dv-cinder-818037-2-iscsi devstack@n-api.service[100957]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=100957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:16:48.012358 dv-cinder-818037-2-iscsi devstack@n-api.service[100958]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=100958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:16:48.012536 dv-cinder-818037-2-iscsi devstack@n-api.service[100958]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=100958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:16:48.012680 dv-cinder-818037-2-iscsi devstack@n-api.service[100957]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=100957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:16:48.012874 dv-cinder-818037-2-iscsi devstack@n-api.service[100958]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=100958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:16:48.013007 dv-cinder-818037-2-iscsi devstack@n-api.service[100957]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=100957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:16:48.013195 dv-cinder-818037-2-iscsi devstack@n-api.service[100957]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=100957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:16:48.013315 dv-cinder-818037-2-iscsi devstack@n-api.service[100958]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=100958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:16:48.013510 dv-cinder-818037-2-iscsi devstack@n-api.service[100958]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=100958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:16:48.013633 dv-cinder-818037-2-iscsi devstack@n-api.service[100957]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=100957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:16:48.013819 dv-cinder-818037-2-iscsi devstack@n-api.service[100958]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=100958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:16:48.013942 dv-cinder-818037-2-iscsi devstack@n-api.service[100957]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=100957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:16:48.014148 dv-cinder-818037-2-iscsi devstack@n-api.service[100957]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=100957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:16:48.014278 dv-cinder-818037-2-iscsi devstack@n-api.service[100958]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=100958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:16:48.014471 dv-cinder-818037-2-iscsi devstack@n-api.service[100957]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=100957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:16:48.014594 dv-cinder-818037-2-iscsi devstack@n-api.service[100958]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=100958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:16:48.014785 dv-cinder-818037-2-iscsi devstack@n-api.service[100958]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=100958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:16:48.014905 dv-cinder-818037-2-iscsi devstack@n-api.service[100957]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=100957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:16:48.015098 dv-cinder-818037-2-iscsi devstack@n-api.service[100957]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=100957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:16:48.015227 dv-cinder-818037-2-iscsi devstack@n-api.service[100958]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=100958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:16:48.015405 dv-cinder-818037-2-iscsi devstack@n-api.service[100958]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=100958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:16:48.015526 dv-cinder-818037-2-iscsi devstack@n-api.service[100957]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=100957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:16:48.015726 dv-cinder-818037-2-iscsi devstack@n-api.service[100958]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=100958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:16:48.015849 dv-cinder-818037-2-iscsi devstack@n-api.service[100957]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=100957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:16:48.016035 dv-cinder-818037-2-iscsi devstack@n-api.service[100958]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=100958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:16:48.016158 dv-cinder-818037-2-iscsi devstack@n-api.service[100957]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=100957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:16:48.016347 dv-cinder-818037-2-iscsi devstack@n-api.service[100958]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=100958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:16:48.016468 dv-cinder-818037-2-iscsi devstack@n-api.service[100957]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=100957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:16:48.016658 dv-cinder-818037-2-iscsi devstack@n-api.service[100958]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=100958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:16:48.016831 dv-cinder-818037-2-iscsi devstack@n-api.service[100957]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=100957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:16:48.017014 dv-cinder-818037-2-iscsi devstack@n-api.service[100958]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=100958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:16:48.017138 dv-cinder-818037-2-iscsi devstack@n-api.service[100957]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=100957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:16:48.017327 dv-cinder-818037-2-iscsi devstack@n-api.service[100958]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=100958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:16:48.017452 dv-cinder-818037-2-iscsi devstack@n-api.service[100957]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=100957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:16:48.017637 dv-cinder-818037-2-iscsi devstack@n-api.service[100958]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=100958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:16:48.017762 dv-cinder-818037-2-iscsi devstack@n-api.service[100957]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=100957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:16:48.017971 dv-cinder-818037-2-iscsi devstack@n-api.service[100957]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=100957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:16:48.018106 dv-cinder-818037-2-iscsi devstack@n-api.service[100958]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=100958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:16:48.018284 dv-cinder-818037-2-iscsi devstack@n-api.service[100958]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=100958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:16:48.018398 dv-cinder-818037-2-iscsi devstack@n-api.service[100957]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=100957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:16:48.018599 dv-cinder-818037-2-iscsi devstack@n-api.service[100958]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=100958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:16:48.018721 dv-cinder-818037-2-iscsi devstack@n-api.service[100957]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=100957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:16:48.018903 dv-cinder-818037-2-iscsi devstack@n-api.service[100958]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=100958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:16:48.019040 dv-cinder-818037-2-iscsi devstack@n-api.service[100957]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=100957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:16:48.019208 dv-cinder-818037-2-iscsi devstack@n-api.service[100958]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=100958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:16:48.019332 dv-cinder-818037-2-iscsi devstack@n-api.service[100957]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=100957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:16:48.019557 dv-cinder-818037-2-iscsi devstack@n-api.service[100958]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=100958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:16:48.019731 dv-cinder-818037-2-iscsi devstack@n-api.service[100957]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=100957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:16:48.019855 dv-cinder-818037-2-iscsi devstack@n-api.service[100958]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=100958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:16:48.020103 dv-cinder-818037-2-iscsi devstack@n-api.service[100957]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=100957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:16:48.020236 dv-cinder-818037-2-iscsi devstack@n-api.service[100958]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=100958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:16:48.020426 dv-cinder-818037-2-iscsi devstack@n-api.service[100957]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=100957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:16:48.020550 dv-cinder-818037-2-iscsi devstack@n-api.service[100958]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=100958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:16:48.020765 dv-cinder-818037-2-iscsi devstack@n-api.service[100958]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=100958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:16:48.020905 dv-cinder-818037-2-iscsi devstack@n-api.service[100957]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=100957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:16:48.021097 dv-cinder-818037-2-iscsi devstack@n-api.service[100958]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=100958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:16:48.021221 dv-cinder-818037-2-iscsi devstack@n-api.service[100957]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=100957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:16:48.021419 dv-cinder-818037-2-iscsi devstack@n-api.service[100957]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=100957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:16:48.021541 dv-cinder-818037-2-iscsi devstack@n-api.service[100958]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=100958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:16:48.021722 dv-cinder-818037-2-iscsi devstack@n-api.service[100958]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=100958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:16:48.021853 dv-cinder-818037-2-iscsi devstack@n-api.service[100957]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=100957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:16:48.022030 dv-cinder-818037-2-iscsi devstack@n-api.service[100957]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=100957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:16:48.022153 dv-cinder-818037-2-iscsi devstack@n-api.service[100958]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=100958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:16:48.022338 dv-cinder-818037-2-iscsi devstack@n-api.service[100958]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=100958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:16:48.022467 dv-cinder-818037-2-iscsi devstack@n-api.service[100957]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=100957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:16:48.022642 dv-cinder-818037-2-iscsi devstack@n-api.service[100958]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=100958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:16:48.022846 dv-cinder-818037-2-iscsi devstack@n-api.service[100957]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=100957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:16:48.022968 dv-cinder-818037-2-iscsi devstack@n-api.service[100957]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=100957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:16:48.023087 dv-cinder-818037-2-iscsi devstack@n-api.service[100958]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=100958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:16:48.023247 dv-cinder-818037-2-iscsi devstack@n-api.service[100958]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=100958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:16:48.023368 dv-cinder-818037-2-iscsi devstack@n-api.service[100957]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=100957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:16:48.023551 dv-cinder-818037-2-iscsi devstack@n-api.service[100958]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=100958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:16:48.023683 dv-cinder-818037-2-iscsi devstack@n-api.service[100957]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=100957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:16:48.023869 dv-cinder-818037-2-iscsi devstack@n-api.service[100957]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=100957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:16:48.023992 dv-cinder-818037-2-iscsi devstack@n-api.service[100958]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=100958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:16:48.024177 dv-cinder-818037-2-iscsi devstack@n-api.service[100958]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=100958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:16:48.024299 dv-cinder-818037-2-iscsi devstack@n-api.service[100957]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=100957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:16:48.024482 dv-cinder-818037-2-iscsi devstack@n-api.service[100958]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=100958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:16:48.024618 dv-cinder-818037-2-iscsi devstack@n-api.service[100957]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=100957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:16:48.024831 dv-cinder-818037-2-iscsi devstack@n-api.service[100957]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=100957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:16:48.024957 dv-cinder-818037-2-iscsi devstack@n-api.service[100958]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=100958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:16:48.025136 dv-cinder-818037-2-iscsi devstack@n-api.service[100958]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=100958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:16:48.025258 dv-cinder-818037-2-iscsi devstack@n-api.service[100957]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=100957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:16:48.025438 dv-cinder-818037-2-iscsi devstack@n-api.service[100958]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=100958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:16:48.025567 dv-cinder-818037-2-iscsi devstack@n-api.service[100957]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=100957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:16:48.025750 dv-cinder-818037-2-iscsi devstack@n-api.service[100957]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=100957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:16:48.025879 dv-cinder-818037-2-iscsi devstack@n-api.service[100958]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=100958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:16:48.026060 dv-cinder-818037-2-iscsi devstack@n-api.service[100958]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=100958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:16:48.026182 dv-cinder-818037-2-iscsi devstack@n-api.service[100957]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=100957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:16:48.026367 dv-cinder-818037-2-iscsi devstack@n-api.service[100957]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=100957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:16:48.026490 dv-cinder-818037-2-iscsi devstack@n-api.service[100958]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=100958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:16:48.026672 dv-cinder-818037-2-iscsi devstack@n-api.service[100958]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=100958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:16:48.026795 dv-cinder-818037-2-iscsi devstack@n-api.service[100957]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=100957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:16:48.026995 dv-cinder-818037-2-iscsi devstack@n-api.service[100958]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=100958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:16:48.027118 dv-cinder-818037-2-iscsi devstack@n-api.service[100957]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=100957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:16:48.027308 dv-cinder-818037-2-iscsi devstack@n-api.service[100957]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=100957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:16:48.027431 dv-cinder-818037-2-iscsi devstack@n-api.service[100958]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=100958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:16:48.027613 dv-cinder-818037-2-iscsi devstack@n-api.service[100958]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=100958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:16:48.027736 dv-cinder-818037-2-iscsi devstack@n-api.service[100957]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=100957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:16:48.027932 dv-cinder-818037-2-iscsi devstack@n-api.service[100957]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=100957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:16:48.028061 dv-cinder-818037-2-iscsi devstack@n-api.service[100958]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=100958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:16:48.028244 dv-cinder-818037-2-iscsi devstack@n-api.service[100957]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=100957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:16:48.028378 dv-cinder-818037-2-iscsi devstack@n-api.service[100958]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=100958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:16:48.028546 dv-cinder-818037-2-iscsi devstack@n-api.service[100958]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=100958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:16:48.028666 dv-cinder-818037-2-iscsi devstack@n-api.service[100957]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=100957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:16:48.028894 dv-cinder-818037-2-iscsi devstack@n-api.service[100957]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=100957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:16:48.029034 dv-cinder-818037-2-iscsi devstack@n-api.service[100958]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=100958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:16:48.029213 dv-cinder-818037-2-iscsi devstack@n-api.service[100957]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=100957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:16:48.029335 dv-cinder-818037-2-iscsi devstack@n-api.service[100958]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=100958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:16:48.029525 dv-cinder-818037-2-iscsi devstack@n-api.service[100958]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=100958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:16:48.029656 dv-cinder-818037-2-iscsi devstack@n-api.service[100957]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=100957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:16:48.029829 dv-cinder-818037-2-iscsi devstack@n-api.service[100958]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=100958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:16:48.029967 dv-cinder-818037-2-iscsi devstack@n-api.service[100957]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=100957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:16:48.030139 dv-cinder-818037-2-iscsi devstack@n-api.service[100958]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=100958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:16:48.030264 dv-cinder-818037-2-iscsi devstack@n-api.service[100957]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=100957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:16:48.030444 dv-cinder-818037-2-iscsi devstack@n-api.service[100958]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=100958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:16:48.030575 dv-cinder-818037-2-iscsi devstack@n-api.service[100957]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=100957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:16:48.030747 dv-cinder-818037-2-iscsi devstack@n-api.service[100958]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=100958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:16:48.030879 dv-cinder-818037-2-iscsi devstack@n-api.service[100957]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=100957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:16:48.031049 dv-cinder-818037-2-iscsi devstack@n-api.service[100958]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=100958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:16:48.031172 dv-cinder-818037-2-iscsi devstack@n-api.service[100957]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=100957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:16:48.031359 dv-cinder-818037-2-iscsi devstack@n-api.service[100958]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=100958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:16:48.031483 dv-cinder-818037-2-iscsi devstack@n-api.service[100957]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=100957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:16:48.031661 dv-cinder-818037-2-iscsi devstack@n-api.service[100958]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=100958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:16:48.031793 dv-cinder-818037-2-iscsi devstack@n-api.service[100957]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=100957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:16:48.031965 dv-cinder-818037-2-iscsi devstack@n-api.service[100958]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=100958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:16:48.032088 dv-cinder-818037-2-iscsi devstack@n-api.service[100957]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=100957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:16:48.032266 dv-cinder-818037-2-iscsi devstack@n-api.service[100958]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=100958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:16:48.032388 dv-cinder-818037-2-iscsi devstack@n-api.service[100957]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=100957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:16:48.032567 dv-cinder-818037-2-iscsi devstack@n-api.service[100958]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=100958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:16:48.032692 dv-cinder-818037-2-iscsi devstack@n-api.service[100957]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=100957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:16:48.032896 dv-cinder-818037-2-iscsi devstack@n-api.service[100958]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=100958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:16:48.033031 dv-cinder-818037-2-iscsi devstack@n-api.service[100957]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=100957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:16:48.033220 dv-cinder-818037-2-iscsi devstack@n-api.service[100958]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=100958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:16:48.033344 dv-cinder-818037-2-iscsi devstack@n-api.service[100957]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=100957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:16:48.033529 dv-cinder-818037-2-iscsi devstack@n-api.service[100958]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=100958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:16:48.033662 dv-cinder-818037-2-iscsi devstack@n-api.service[100957]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=100957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:16:48.033831 dv-cinder-818037-2-iscsi devstack@n-api.service[100958]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=100958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:16:48.033954 dv-cinder-818037-2-iscsi devstack@n-api.service[100957]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=100957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:16:48.034133 dv-cinder-818037-2-iscsi devstack@n-api.service[100958]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=100958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:16:48.034265 dv-cinder-818037-2-iscsi devstack@n-api.service[100957]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=100957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:16:48.034432 dv-cinder-818037-2-iscsi devstack@n-api.service[100958]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=100958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:16:48.034557 dv-cinder-818037-2-iscsi devstack@n-api.service[100957]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=100957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:16:48.034738 dv-cinder-818037-2-iscsi devstack@n-api.service[100957]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=100957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:16:48.034859 dv-cinder-818037-2-iscsi devstack@n-api.service[100958]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=100958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:16:48.035072 dv-cinder-818037-2-iscsi devstack@n-api.service[100957]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=100957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:16:48.035198 dv-cinder-818037-2-iscsi devstack@n-api.service[100958]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=100958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:16:48.035383 dv-cinder-818037-2-iscsi devstack@n-api.service[100957]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=100957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:16:48.035471 dv-cinder-818037-2-iscsi devstack@n-api.service[100958]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=100958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:16:48.035788 dv-cinder-818037-2-iscsi devstack@n-api.service[100958]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=100958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:16:48.035880 dv-cinder-818037-2-iscsi devstack@n-api.service[100957]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=100957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:16:48.036085 dv-cinder-818037-2-iscsi devstack@n-api.service[100958]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=100958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:16:48.036180 dv-cinder-818037-2-iscsi devstack@n-api.service[100957]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=100957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:16:48.036406 dv-cinder-818037-2-iscsi devstack@n-api.service[100958]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=100958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:16:48.036491 dv-cinder-818037-2-iscsi devstack@n-api.service[100957]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=100957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:16:48.036718 dv-cinder-818037-2-iscsi devstack@n-api.service[100958]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=100958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:16:48.036844 dv-cinder-818037-2-iscsi devstack@n-api.service[100957]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=100957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:16:48.037062 dv-cinder-818037-2-iscsi devstack@n-api.service[100958]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=100958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:16:48.037164 dv-cinder-818037-2-iscsi devstack@n-api.service[100957]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=100957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:16:48.037376 dv-cinder-818037-2-iscsi devstack@n-api.service[100958]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=100958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:16:48.037469 dv-cinder-818037-2-iscsi devstack@n-api.service[100957]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=100957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:16:48.037685 dv-cinder-818037-2-iscsi devstack@n-api.service[100958]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=100958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:16:48.037771 dv-cinder-818037-2-iscsi devstack@n-api.service[100957]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=100957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:16:48.037998 dv-cinder-818037-2-iscsi devstack@n-api.service[100958]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=100958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:16:48.038094 dv-cinder-818037-2-iscsi devstack@n-api.service[100957]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=100957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:16:48.038309 dv-cinder-818037-2-iscsi devstack@n-api.service[100958]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=100958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:16:48.038395 dv-cinder-818037-2-iscsi devstack@n-api.service[100957]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=100957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:16:48.038626 dv-cinder-818037-2-iscsi devstack@n-api.service[100958]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=100958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:16:48.038710 dv-cinder-818037-2-iscsi devstack@n-api.service[100957]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=100957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:16:48.038936 dv-cinder-818037-2-iscsi devstack@n-api.service[100958]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=100958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:16:48.039038 dv-cinder-818037-2-iscsi devstack@n-api.service[100957]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=100957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:16:48.039254 dv-cinder-818037-2-iscsi devstack@n-api.service[100958]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=100958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:16:48.039340 dv-cinder-818037-2-iscsi devstack@n-api.service[100957]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=100957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:16:48.039562 dv-cinder-818037-2-iscsi devstack@n-api.service[100958]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=100958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:16:48.039646 dv-cinder-818037-2-iscsi devstack@n-api.service[100957]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=100957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:16:48.039884 dv-cinder-818037-2-iscsi devstack@n-api.service[100958]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=100958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:16:48.039982 dv-cinder-818037-2-iscsi devstack@n-api.service[100957]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=100957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:16:48.040191 dv-cinder-818037-2-iscsi devstack@n-api.service[100958]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=100958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:16:48.040276 dv-cinder-818037-2-iscsi devstack@n-api.service[100957]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=100957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:16:48.040504 dv-cinder-818037-2-iscsi devstack@n-api.service[100957]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=100957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:16:48.040588 dv-cinder-818037-2-iscsi devstack@n-api.service[100958]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=100958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:16:48.040821 dv-cinder-818037-2-iscsi devstack@n-api.service[100958]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=100958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:16:48.040909 dv-cinder-818037-2-iscsi devstack@n-api.service[100957]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=100957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:16:48.041136 dv-cinder-818037-2-iscsi devstack@n-api.service[100958]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=100958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:16:48.041233 dv-cinder-818037-2-iscsi devstack@n-api.service[100957]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=100957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:16:48.041468 dv-cinder-818037-2-iscsi devstack@n-api.service[100957]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=100957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:16:48.041552 dv-cinder-818037-2-iscsi devstack@n-api.service[100958]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=100958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:16:48.041785 dv-cinder-818037-2-iscsi devstack@n-api.service[100957]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=100957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:16:48.041871 dv-cinder-818037-2-iscsi devstack@n-api.service[100958]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=100958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:16:48.042097 dv-cinder-818037-2-iscsi devstack@n-api.service[100958]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=100958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:16:48.042180 dv-cinder-818037-2-iscsi devstack@n-api.service[100957]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=100957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:16:48.042409 dv-cinder-818037-2-iscsi devstack@n-api.service[100957]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=100957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:16:48.042492 dv-cinder-818037-2-iscsi devstack@n-api.service[100958]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=100958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:16:48.042714 dv-cinder-818037-2-iscsi devstack@n-api.service[100958]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=100958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:16:48.042798 dv-cinder-818037-2-iscsi devstack@n-api.service[100957]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=100957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:16:48.043026 dv-cinder-818037-2-iscsi devstack@n-api.service[100958]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=100958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:16:48.043120 dv-cinder-818037-2-iscsi devstack@n-api.service[100957]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=100957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:16:48.043335 dv-cinder-818037-2-iscsi devstack@n-api.service[100958]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=100958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:16:48.043421 dv-cinder-818037-2-iscsi devstack@n-api.service[100957]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=100957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:16:48.043640 dv-cinder-818037-2-iscsi devstack@n-api.service[100957]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=100957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:16:48.043725 dv-cinder-818037-2-iscsi devstack@n-api.service[100958]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=100958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:16:48.043942 dv-cinder-818037-2-iscsi devstack@n-api.service[100958]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=100958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:16:48.044026 dv-cinder-818037-2-iscsi devstack@n-api.service[100957]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=100957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:16:48.044250 dv-cinder-818037-2-iscsi devstack@n-api.service[100958]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=100958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:16:48.044343 dv-cinder-818037-2-iscsi devstack@n-api.service[100957]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=100957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:16:48.044572 dv-cinder-818037-2-iscsi devstack@n-api.service[100958]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=100958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:16:48.044665 dv-cinder-818037-2-iscsi devstack@n-api.service[100957]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=100957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:16:48.044910 dv-cinder-818037-2-iscsi devstack@n-api.service[100958]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=100958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:16:48.045000 dv-cinder-818037-2-iscsi devstack@n-api.service[100957]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=100957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:16:48.045229 dv-cinder-818037-2-iscsi devstack@n-api.service[100958]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=100958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:16:48.045335 dv-cinder-818037-2-iscsi devstack@n-api.service[100957]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=100957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:16:48.045539 dv-cinder-818037-2-iscsi devstack@n-api.service[100958]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=100958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:16:48.045626 dv-cinder-818037-2-iscsi devstack@n-api.service[100957]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=100957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:16:48.045856 dv-cinder-818037-2-iscsi devstack@n-api.service[100957]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=100957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:16:48.045940 dv-cinder-818037-2-iscsi devstack@n-api.service[100958]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=100958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:16:48.046161 dv-cinder-818037-2-iscsi devstack@n-api.service[100958]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=100958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:16:48.046253 dv-cinder-818037-2-iscsi devstack@n-api.service[100957]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=100957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:16:48.046472 dv-cinder-818037-2-iscsi devstack@n-api.service[100957]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=100957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:16:48.046555 dv-cinder-818037-2-iscsi devstack@n-api.service[100958]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=100958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:16:48.046770 dv-cinder-818037-2-iscsi devstack@n-api.service[100958]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=100958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:16:48.046862 dv-cinder-818037-2-iscsi devstack@n-api.service[100957]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=100957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:16:48.047080 dv-cinder-818037-2-iscsi devstack@n-api.service[100958]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=100958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:16:48.047174 dv-cinder-818037-2-iscsi devstack@n-api.service[100957]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=100957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:16:48.047405 dv-cinder-818037-2-iscsi devstack@n-api.service[100958]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=100958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:16:48.047490 dv-cinder-818037-2-iscsi devstack@n-api.service[100957]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=100957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:16:48.047717 dv-cinder-818037-2-iscsi devstack@n-api.service[100957]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=100957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:16:48.047802 dv-cinder-818037-2-iscsi devstack@n-api.service[100958]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=100958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:16:48.048031 dv-cinder-818037-2-iscsi devstack@n-api.service[100958]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=100958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:16:48.048127 dv-cinder-818037-2-iscsi devstack@n-api.service[100957]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=100957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:16:48.048342 dv-cinder-818037-2-iscsi devstack@n-api.service[100958]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=100958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:16:48.048427 dv-cinder-818037-2-iscsi devstack@n-api.service[100957]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=100957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:16:48.048658 dv-cinder-818037-2-iscsi devstack@n-api.service[100958]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=100958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:16:48.048754 dv-cinder-818037-2-iscsi devstack@n-api.service[100957]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=100957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:16:48.049294 dv-cinder-818037-2-iscsi devstack@n-api.service[100958]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=100958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:16:48.049427 dv-cinder-818037-2-iscsi devstack@n-api.service[100957]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=100957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:16:48.049533 dv-cinder-818037-2-iscsi devstack@n-api.service[100958]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=100958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:16:48.049636 dv-cinder-818037-2-iscsi devstack@n-api.service[100957]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=100957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:16:48.049738 dv-cinder-818037-2-iscsi devstack@n-api.service[100958]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=100958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:16:48.049840 dv-cinder-818037-2-iscsi devstack@n-api.service[100957]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=100957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:16:48.049956 dv-cinder-818037-2-iscsi devstack@n-api.service[100958]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=100958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:16:48.050067 dv-cinder-818037-2-iscsi devstack@n-api.service[100957]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=100957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:16:48.050171 dv-cinder-818037-2-iscsi devstack@n-api.service[100958]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=100958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:16:48.050283 dv-cinder-818037-2-iscsi devstack@n-api.service[100957]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=100957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:16:48.050462 dv-cinder-818037-2-iscsi devstack@n-api.service[100958]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=100958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:16:48.050574 dv-cinder-818037-2-iscsi devstack@n-api.service[100957]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=100957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:16:48.050822 dv-cinder-818037-2-iscsi devstack@n-api.service[100958]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=100958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:16:48.051029 dv-cinder-818037-2-iscsi devstack@n-api.service[100957]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=100957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:16:48.051146 dv-cinder-818037-2-iscsi devstack@n-api.service[100958]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=100958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:16:48.051355 dv-cinder-818037-2-iscsi devstack@n-api.service[100957]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=100957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:16:48.051579 dv-cinder-818037-2-iscsi devstack@n-api.service[100958]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=100958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:16:48.051698 dv-cinder-818037-2-iscsi devstack@n-api.service[100957]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=100957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:16:48.051897 dv-cinder-818037-2-iscsi devstack@n-api.service[100958]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=100958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:16:48.052010 dv-cinder-818037-2-iscsi devstack@n-api.service[100957]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=100957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:16:48.052114 dv-cinder-818037-2-iscsi devstack@n-api.service[100958]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=100958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:16:48.052285 dv-cinder-818037-2-iscsi devstack@n-api.service[100957]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=100957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:16:48.052408 dv-cinder-818037-2-iscsi devstack@n-api.service[100958]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=100958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:16:48.052603 dv-cinder-818037-2-iscsi devstack@n-api.service[100957]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=100957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:16:48.052719 dv-cinder-818037-2-iscsi devstack@n-api.service[100958]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=100958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:16:48.052939 dv-cinder-818037-2-iscsi devstack@n-api.service[100957]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=100957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:16:48.053058 dv-cinder-818037-2-iscsi devstack@n-api.service[100958]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=100958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:16:48.053253 dv-cinder-818037-2-iscsi devstack@n-api.service[100957]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=100957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:16:48.053365 dv-cinder-818037-2-iscsi devstack@n-api.service[100958]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=100958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:16:48.053571 dv-cinder-818037-2-iscsi devstack@n-api.service[100957]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=100957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:16:48.053682 dv-cinder-818037-2-iscsi devstack@n-api.service[100958]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=100958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:16:48.053892 dv-cinder-818037-2-iscsi devstack@n-api.service[100957]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=100957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:16:48.054002 dv-cinder-818037-2-iscsi devstack@n-api.service[100958]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=100958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:16:48.054209 dv-cinder-818037-2-iscsi devstack@n-api.service[100957]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=100957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:16:48.054326 dv-cinder-818037-2-iscsi devstack@n-api.service[100958]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=100958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:16:48.054987 dv-cinder-818037-2-iscsi devstack@n-api.service[100957]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=100957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:16:48.055113 dv-cinder-818037-2-iscsi devstack@n-api.service[100958]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=100958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:16:48.055113 dv-cinder-818037-2-iscsi devstack@n-api.service[100958]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=100958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:16:48.055348 dv-cinder-818037-2-iscsi devstack@n-api.service[100957]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=100957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:16:48.055468 dv-cinder-818037-2-iscsi devstack@n-api.service[100958]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=100958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:16:48.055604 dv-cinder-818037-2-iscsi devstack@n-api.service[100957]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=100957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:16:48.055725 dv-cinder-818037-2-iscsi devstack@n-api.service[100958]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=100958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:16:48.055845 dv-cinder-818037-2-iscsi devstack@n-api.service[100957]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=100957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:16:48.055971 dv-cinder-818037-2-iscsi devstack@n-api.service[100958]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=100958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:16:48.056099 dv-cinder-818037-2-iscsi devstack@n-api.service[100957]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=100957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:16:48.056248 dv-cinder-818037-2-iscsi devstack@n-api.service[100958]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=100958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:16:48.056354 dv-cinder-818037-2-iscsi devstack@n-api.service[100957]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=100957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:16:48.056458 dv-cinder-818037-2-iscsi devstack@n-api.service[100958]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=100958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:16:48.056561 dv-cinder-818037-2-iscsi devstack@n-api.service[100957]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=100957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:16:48.056672 dv-cinder-818037-2-iscsi devstack@n-api.service[100958]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=100958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:16:48.056797 dv-cinder-818037-2-iscsi devstack@n-api.service[100957]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=100957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:16:48.056920 dv-cinder-818037-2-iscsi devstack@n-api.service[100958]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=100958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:16:48.057034 dv-cinder-818037-2-iscsi devstack@n-api.service[100957]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=100957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:16:48.057218 dv-cinder-818037-2-iscsi devstack@n-api.service[100958]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=100958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:16:48.057335 dv-cinder-818037-2-iscsi devstack@n-api.service[100957]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=100957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:16:48.057524 dv-cinder-818037-2-iscsi devstack@n-api.service[100958]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=100958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:16:48.057642 dv-cinder-818037-2-iscsi devstack@n-api.service[100957]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=100957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:16:48.057837 dv-cinder-818037-2-iscsi devstack@n-api.service[100958]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=100958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:16:48.057954 dv-cinder-818037-2-iscsi devstack@n-api.service[100957]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=100957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:16:48.058153 dv-cinder-818037-2-iscsi devstack@n-api.service[100958]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=100958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:16:48.058263 dv-cinder-818037-2-iscsi devstack@n-api.service[100957]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=100957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:16:48.058448 dv-cinder-818037-2-iscsi devstack@n-api.service[100958]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=100958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:16:48.058556 dv-cinder-818037-2-iscsi devstack@n-api.service[100957]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=100957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:16:48.059117 dv-cinder-818037-2-iscsi devstack@n-api.service[100958]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=100958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:16:48.059232 dv-cinder-818037-2-iscsi devstack@n-api.service[100957]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=100957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:16:48.059432 dv-cinder-818037-2-iscsi devstack@n-api.service[100958]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=100958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:16:48.059550 dv-cinder-818037-2-iscsi devstack@n-api.service[100957]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=100957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:16:48.059739 dv-cinder-818037-2-iscsi devstack@n-api.service[100957]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=100957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:16:48.059858 dv-cinder-818037-2-iscsi devstack@n-api.service[100958]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=100958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:16:48.060050 dv-cinder-818037-2-iscsi devstack@n-api.service[100957]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=100957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:16:48.060167 dv-cinder-818037-2-iscsi devstack@n-api.service[100958]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=100958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:16:48.060355 dv-cinder-818037-2-iscsi devstack@n-api.service[100958]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=100958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:16:48.060464 dv-cinder-818037-2-iscsi devstack@n-api.service[100957]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=100957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:16:48.060663 dv-cinder-818037-2-iscsi devstack@n-api.service[100958]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=100958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:16:48.060831 dv-cinder-818037-2-iscsi devstack@n-api.service[100957]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=100957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:16:48.060995 dv-cinder-818037-2-iscsi devstack@n-api.service[100958]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=100958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:16:48.061106 dv-cinder-818037-2-iscsi devstack@n-api.service[100957]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=100957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:16:48.061300 dv-cinder-818037-2-iscsi devstack@n-api.service[100958]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=100958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:16:48.061410 dv-cinder-818037-2-iscsi devstack@n-api.service[100957]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=100957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:16:48.061616 dv-cinder-818037-2-iscsi devstack@n-api.service[100958]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=100958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:16:48.061827 dv-cinder-818037-2-iscsi devstack@n-api.service[100957]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=100957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:16:48.061953 dv-cinder-818037-2-iscsi devstack@n-api.service[100958]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=100958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:16:48.062072 dv-cinder-818037-2-iscsi devstack@n-api.service[100957]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=100957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:16:48.062200 dv-cinder-818037-2-iscsi devstack@n-api.service[100958]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=100958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:16:48.062312 dv-cinder-818037-2-iscsi devstack@n-api.service[100957]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=100957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:16:48.062508 dv-cinder-818037-2-iscsi devstack@n-api.service[100958]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=100958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:16:48.062642 dv-cinder-818037-2-iscsi devstack@n-api.service[100957]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=100957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:16:48.062813 dv-cinder-818037-2-iscsi devstack@n-api.service[100958]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=100958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:16:48.062946 dv-cinder-818037-2-iscsi devstack@n-api.service[100957]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=100957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:16:48.063119 dv-cinder-818037-2-iscsi devstack@n-api.service[100958]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=100958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:16:48.063250 dv-cinder-818037-2-iscsi devstack@n-api.service[100957]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=100957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:16:48.063419 dv-cinder-818037-2-iscsi devstack@n-api.service[100958]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=100958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:16:48.063550 dv-cinder-818037-2-iscsi devstack@n-api.service[100957]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=100957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:16:48.063725 dv-cinder-818037-2-iscsi devstack@n-api.service[100958]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=100958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:16:48.063850 dv-cinder-818037-2-iscsi devstack@n-api.service[100957]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=100957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:16:48.064035 dv-cinder-818037-2-iscsi devstack@n-api.service[100957]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=100957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:16:48.064158 dv-cinder-818037-2-iscsi devstack@n-api.service[100958]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=100958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:16:48.064354 dv-cinder-818037-2-iscsi devstack@n-api.service[100957]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=100957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:16:48.064612 dv-cinder-818037-2-iscsi devstack@n-api.service[100958]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=100958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:16:48.064735 dv-cinder-818037-2-iscsi devstack@n-api.service[100957]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=100957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:16:48.064964 dv-cinder-818037-2-iscsi devstack@n-api.service[100958]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=100958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:16:48.065101 dv-cinder-818037-2-iscsi devstack@n-api.service[100957]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=100957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:16:48.065278 dv-cinder-818037-2-iscsi devstack@n-api.service[100958]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=100958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:16:48.065415 dv-cinder-818037-2-iscsi devstack@n-api.service[100957]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=100957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:16:48.065595 dv-cinder-818037-2-iscsi devstack@n-api.service[100958]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=100958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:16:48.065719 dv-cinder-818037-2-iscsi devstack@n-api.service[100957]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=100957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:16:48.065903 dv-cinder-818037-2-iscsi devstack@n-api.service[100957]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=100957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:16:48.066032 dv-cinder-818037-2-iscsi devstack@n-api.service[100958]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=100958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:16:48.066231 dv-cinder-818037-2-iscsi devstack@n-api.service[100958]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=100958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:16:48.066367 dv-cinder-818037-2-iscsi devstack@n-api.service[100957]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=100957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:16:48.066546 dv-cinder-818037-2-iscsi devstack@n-api.service[100957]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=100957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:16:48.066752 dv-cinder-818037-2-iscsi devstack@n-api.service[100958]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=100958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:16:48.066883 dv-cinder-818037-2-iscsi devstack@n-api.service[100957]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=100957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:16:48.067083 dv-cinder-818037-2-iscsi devstack@n-api.service[100958]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=100958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:16:48.067274 dv-cinder-818037-2-iscsi devstack@n-api.service[100957]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=100957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:16:48.067400 dv-cinder-818037-2-iscsi devstack@n-api.service[100958]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=100958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:16:48.067689 dv-cinder-818037-2-iscsi devstack@n-api.service[100958]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=100958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:16:48.067847 dv-cinder-818037-2-iscsi devstack@n-api.service[100957]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=100957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:16:48.067998 dv-cinder-818037-2-iscsi devstack@n-api.service[100958]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=100958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:16:48.068183 dv-cinder-818037-2-iscsi devstack@n-api.service[100957]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=100957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:16:48.068323 dv-cinder-818037-2-iscsi devstack@n-api.service[100958]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=100958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:16:48.068505 dv-cinder-818037-2-iscsi devstack@n-api.service[100957]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=100957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:16:48.068629 dv-cinder-818037-2-iscsi devstack@n-api.service[100958]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=100958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:16:48.068855 dv-cinder-818037-2-iscsi devstack@n-api.service[100957]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=100957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:16:48.068981 dv-cinder-818037-2-iscsi devstack@n-api.service[100958]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=100958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:16:48.069181 dv-cinder-818037-2-iscsi devstack@n-api.service[100957]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=100957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:16:48.069319 dv-cinder-818037-2-iscsi devstack@n-api.service[100958]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=100958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:16:48.069482 dv-cinder-818037-2-iscsi devstack@n-api.service[100958]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=100958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:16:48.069605 dv-cinder-818037-2-iscsi devstack@n-api.service[100957]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=100957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:16:48.069785 dv-cinder-818037-2-iscsi devstack@n-api.service[100958]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=100958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:16:48.069909 dv-cinder-818037-2-iscsi devstack@n-api.service[100957]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=100957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:16:48.070094 dv-cinder-818037-2-iscsi devstack@n-api.service[100958]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=100958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:16:48.070227 dv-cinder-818037-2-iscsi devstack@n-api.service[100957]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=100957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:16:48.070394 dv-cinder-818037-2-iscsi devstack@n-api.service[100958]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=100958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:16:48.070524 dv-cinder-818037-2-iscsi devstack@n-api.service[100957]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=100957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:16:48.070696 dv-cinder-818037-2-iscsi devstack@n-api.service[100958]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=100958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:16:48.070827 dv-cinder-818037-2-iscsi devstack@n-api.service[100957]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=100957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:16:48.071036 dv-cinder-818037-2-iscsi devstack@n-api.service[100958]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=100958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:16:48.071161 dv-cinder-818037-2-iscsi devstack@n-api.service[100957]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=100957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:16:48.071337 dv-cinder-818037-2-iscsi devstack@n-api.service[100958]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=100958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:16:48.071475 dv-cinder-818037-2-iscsi devstack@n-api.service[100957]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=100957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:16:48.071644 dv-cinder-818037-2-iscsi devstack@n-api.service[100957]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=100957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:16:48.071760 dv-cinder-818037-2-iscsi devstack@n-api.service[100958]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=100958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:16:48.071959 dv-cinder-818037-2-iscsi devstack@n-api.service[100958]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=100958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:16:48.072082 dv-cinder-818037-2-iscsi devstack@n-api.service[100957]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=100957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:16:48.072234 dv-cinder-818037-2-iscsi devstack@n-api.service[100958]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=100958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:16:48.072360 dv-cinder-818037-2-iscsi devstack@n-api.service[100957]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=100957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:16:48.072535 dv-cinder-818037-2-iscsi devstack@n-api.service[100958]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=100958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:16:48.072658 dv-cinder-818037-2-iscsi devstack@n-api.service[100957]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=100957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:16:48.072870 dv-cinder-818037-2-iscsi devstack@n-api.service[100957]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=100957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:16:48.073007 dv-cinder-818037-2-iscsi devstack@n-api.service[100958]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=100958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:16:48.073177 dv-cinder-818037-2-iscsi devstack@n-api.service[100958]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=100958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:16:48.073300 dv-cinder-818037-2-iscsi devstack@n-api.service[100957]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=100957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:16:48.073480 dv-cinder-818037-2-iscsi devstack@n-api.service[100958]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=100958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:16:48.073603 dv-cinder-818037-2-iscsi devstack@n-api.service[100957]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=100957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:16:48.073780 dv-cinder-818037-2-iscsi devstack@n-api.service[100958]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=100958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:16:48.073912 dv-cinder-818037-2-iscsi devstack@n-api.service[100957]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=100957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:16:48.074081 dv-cinder-818037-2-iscsi devstack@n-api.service[100958]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=100958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:16:48.074212 dv-cinder-818037-2-iscsi devstack@n-api.service[100957]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=100957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:16:48.074407 dv-cinder-818037-2-iscsi devstack@n-api.service[100957]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=100957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:16:48.074541 dv-cinder-818037-2-iscsi devstack@n-api.service[100958]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=100958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:16:48.074712 dv-cinder-818037-2-iscsi devstack@n-api.service[100958]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=100958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:16:48.074834 dv-cinder-818037-2-iscsi devstack@n-api.service[100957]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=100957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:16:48.075019 dv-cinder-818037-2-iscsi devstack@n-api.service[100957]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=100957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:16:48.075141 dv-cinder-818037-2-iscsi devstack@n-api.service[100958]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=100958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:16:48.075335 dv-cinder-818037-2-iscsi devstack@n-api.service[100957]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=100957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:16:48.075458 dv-cinder-818037-2-iscsi devstack@n-api.service[100958]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=100958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:16:48.075644 dv-cinder-818037-2-iscsi devstack@n-api.service[100957]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=100957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:16:48.075768 dv-cinder-818037-2-iscsi devstack@n-api.service[100958]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=100958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:16:48.075969 dv-cinder-818037-2-iscsi devstack@n-api.service[100958]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=100958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:16:48.076091 dv-cinder-818037-2-iscsi devstack@n-api.service[100957]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=100957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:16:48.076258 dv-cinder-818037-2-iscsi devstack@n-api.service[100958]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=100958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:16:48.076382 dv-cinder-818037-2-iscsi devstack@n-api.service[100957]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=100957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:16:48.076560 dv-cinder-818037-2-iscsi devstack@n-api.service[100957]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=100957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:16:48.076682 dv-cinder-818037-2-iscsi devstack@n-api.service[100958]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=100958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:16:48.076892 dv-cinder-818037-2-iscsi devstack@n-api.service[100958]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=100958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:16:48.077019 dv-cinder-818037-2-iscsi devstack@n-api.service[100957]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=100957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:16:48.077194 dv-cinder-818037-2-iscsi devstack@n-api.service[100958]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=100958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:16:48.077317 dv-cinder-818037-2-iscsi devstack@n-api.service[100957]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=100957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:16:48.077493 dv-cinder-818037-2-iscsi devstack@n-api.service[100958]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=100958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:16:48.077626 dv-cinder-818037-2-iscsi devstack@n-api.service[100957]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=100957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:16:48.077801 dv-cinder-818037-2-iscsi devstack@n-api.service[100958]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=100958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:16:48.077931 dv-cinder-818037-2-iscsi devstack@n-api.service[100957]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=100957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:16:48.078110 dv-cinder-818037-2-iscsi devstack@n-api.service[100958]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=100958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:16:48.078240 dv-cinder-818037-2-iscsi devstack@n-api.service[100957]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=100957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:16:48.078413 dv-cinder-818037-2-iscsi devstack@n-api.service[100958]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=100958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:16:48.078545 dv-cinder-818037-2-iscsi devstack@n-api.service[100957]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=100957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:16:48.078720 dv-cinder-818037-2-iscsi devstack@n-api.service[100958]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=100958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:16:48.078842 dv-cinder-818037-2-iscsi devstack@n-api.service[100957]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=100957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:16:48.079026 dv-cinder-818037-2-iscsi devstack@n-api.service[100958]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=100958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:16:48.079150 dv-cinder-818037-2-iscsi devstack@n-api.service[100957]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=100957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:16:48.079332 dv-cinder-818037-2-iscsi devstack@n-api.service[100958]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=100958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:16:48.079464 dv-cinder-818037-2-iscsi devstack@n-api.service[100957]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=100957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:16:48.079640 dv-cinder-818037-2-iscsi devstack@n-api.service[100958]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=100958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:16:48.079765 dv-cinder-818037-2-iscsi devstack@n-api.service[100957]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=100957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:16:48.079939 dv-cinder-818037-2-iscsi devstack@n-api.service[100958]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=100958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:16:48.080062 dv-cinder-818037-2-iscsi devstack@n-api.service[100957]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=100957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:16:48.080438 dv-cinder-818037-2-iscsi devstack@n-api.service[100958]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=100958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:16:48.080574 dv-cinder-818037-2-iscsi devstack@n-api.service[100957]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=100957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:16:48.080680 dv-cinder-818037-2-iscsi devstack@n-api.service[100958]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=100958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:16:48.080807 dv-cinder-818037-2-iscsi devstack@n-api.service[100957]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=100957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:16:48.080931 dv-cinder-818037-2-iscsi devstack@n-api.service[100958]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=100958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:16:48.081051 dv-cinder-818037-2-iscsi devstack@n-api.service[100957]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=100957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:16:48.081184 dv-cinder-818037-2-iscsi devstack@n-api.service[100958]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=100958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:16:48.081306 dv-cinder-818037-2-iscsi devstack@n-api.service[100957]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=100957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:16:48.081433 dv-cinder-818037-2-iscsi devstack@n-api.service[100958]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=100958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:16:48.081552 dv-cinder-818037-2-iscsi devstack@n-api.service[100957]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=100957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:16:48.081720 dv-cinder-818037-2-iscsi devstack@n-api.service[100958]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=100958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:16:48.081868 dv-cinder-818037-2-iscsi devstack@n-api.service[100957]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=100957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:16:48.082245 dv-cinder-818037-2-iscsi devstack@n-api.service[100957]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=100957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:16:48.082394 dv-cinder-818037-2-iscsi devstack@n-api.service[100958]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=100958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:16:48.082646 dv-cinder-818037-2-iscsi devstack@n-api.service[100957]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=100957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:16:48.082796 dv-cinder-818037-2-iscsi devstack@n-api.service[100957]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=100957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:16:48.082922 dv-cinder-818037-2-iscsi devstack@n-api.service[100958]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=100958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:16:48.083043 dv-cinder-818037-2-iscsi devstack@n-api.service[100957]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=100957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:16:48.083173 dv-cinder-818037-2-iscsi devstack@n-api.service[100958]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=100958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:16:48.083349 dv-cinder-818037-2-iscsi devstack@n-api.service[100957]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=100957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:16:48.083621 dv-cinder-818037-2-iscsi devstack@n-api.service[100958]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=100958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:16:48.083753 dv-cinder-818037-2-iscsi devstack@n-api.service[100957]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=100957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:16:48.083961 dv-cinder-818037-2-iscsi devstack@n-api.service[100957]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=100957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:16:48.084084 dv-cinder-818037-2-iscsi devstack@n-api.service[100958]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=100958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:16:48.084276 dv-cinder-818037-2-iscsi devstack@n-api.service[100957]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=100957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:16:48.084540 dv-cinder-818037-2-iscsi devstack@n-api.service[100958]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=100958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:16:48.084665 dv-cinder-818037-2-iscsi devstack@n-api.service[100957]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=100957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:16:48.084902 dv-cinder-818037-2-iscsi devstack@n-api.service[100957]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=100957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:16:48.085027 dv-cinder-818037-2-iscsi devstack@n-api.service[100958]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=100958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:16:48.085219 dv-cinder-818037-2-iscsi devstack@n-api.service[100957]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=100957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:16:48.085346 dv-cinder-818037-2-iscsi devstack@n-api.service[100958]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=100958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:16:48.085533 dv-cinder-818037-2-iscsi devstack@n-api.service[100957]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=100957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:16:48.085658 dv-cinder-818037-2-iscsi devstack@n-api.service[100958]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=100958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:16:48.085839 dv-cinder-818037-2-iscsi devstack@n-api.service[100957]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=100957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:16:48.085964 dv-cinder-818037-2-iscsi devstack@n-api.service[100958]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=100958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:16:48.086155 dv-cinder-818037-2-iscsi devstack@n-api.service[100958]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=100958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:16:48.086278 dv-cinder-818037-2-iscsi devstack@n-api.service[100957]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=100957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:16:48.086448 dv-cinder-818037-2-iscsi devstack@n-api.service[100957]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=100957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:16:48.086577 dv-cinder-818037-2-iscsi devstack@n-api.service[100958]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=100958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:16:48.086765 dv-cinder-818037-2-iscsi devstack@n-api.service[100957]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=100957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:16:48.086890 dv-cinder-818037-2-iscsi devstack@n-api.service[100958]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=100958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:16:48.087077 dv-cinder-818037-2-iscsi devstack@n-api.service[100958]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=100958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:16:48.087200 dv-cinder-818037-2-iscsi devstack@n-api.service[100957]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=100957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:16:48.087380 dv-cinder-818037-2-iscsi devstack@n-api.service[100957]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=100957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:16:48.087502 dv-cinder-818037-2-iscsi devstack@n-api.service[100958]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=100958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:16:48.087679 dv-cinder-818037-2-iscsi devstack@n-api.service[100958]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=100958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:16:48.087802 dv-cinder-818037-2-iscsi devstack@n-api.service[100957]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=100957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:16:48.087987 dv-cinder-818037-2-iscsi devstack@n-api.service[100958]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=100958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:16:48.088120 dv-cinder-818037-2-iscsi devstack@n-api.service[100957]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=100957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:16:48.088291 dv-cinder-818037-2-iscsi devstack@n-api.service[100958]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=100958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:16:48.088415 dv-cinder-818037-2-iscsi devstack@n-api.service[100957]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=100957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:16:48.088591 dv-cinder-818037-2-iscsi devstack@n-api.service[100957]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=100957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:16:48.088722 dv-cinder-818037-2-iscsi devstack@n-api.service[100958]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=100958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:16:48.088903 dv-cinder-818037-2-iscsi devstack@n-api.service[100958]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=100958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:16:48.089024 dv-cinder-818037-2-iscsi devstack@n-api.service[100957]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=100957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:16:48.089223 dv-cinder-818037-2-iscsi devstack@n-api.service[100958]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=100958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:16:48.089348 dv-cinder-818037-2-iscsi devstack@n-api.service[100957]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=100957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:16:48.089538 dv-cinder-818037-2-iscsi devstack@n-api.service[100958]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=100958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:16:48.089671 dv-cinder-818037-2-iscsi devstack@n-api.service[100957]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=100957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:16:48.089842 dv-cinder-818037-2-iscsi devstack@n-api.service[100958]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=100958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:16:48.089966 dv-cinder-818037-2-iscsi devstack@n-api.service[100957]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=100957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:16:48.090151 dv-cinder-818037-2-iscsi devstack@n-api.service[100958]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=100958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:16:48.090275 dv-cinder-818037-2-iscsi devstack@n-api.service[100957]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=100957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:16:48.090452 dv-cinder-818037-2-iscsi devstack@n-api.service[100957]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=100957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:16:48.090588 dv-cinder-818037-2-iscsi devstack@n-api.service[100958]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=100958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:16:48.090755 dv-cinder-818037-2-iscsi devstack@n-api.service[100958]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=100958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:16:48.090876 dv-cinder-818037-2-iscsi devstack@n-api.service[100957]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=100957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:16:48.091057 dv-cinder-818037-2-iscsi devstack@n-api.service[100958]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=100958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:16:48.091180 dv-cinder-818037-2-iscsi devstack@n-api.service[100957]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=100957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:16:48.091365 dv-cinder-818037-2-iscsi devstack@n-api.service[100958]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=100958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:16:48.091501 dv-cinder-818037-2-iscsi devstack@n-api.service[100957]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=100957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:16:48.091665 dv-cinder-818037-2-iscsi devstack@n-api.service[100958]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=100958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:16:48.091789 dv-cinder-818037-2-iscsi devstack@n-api.service[100957]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=100957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:16:48.091965 dv-cinder-818037-2-iscsi devstack@n-api.service[100958]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=100958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:16:48.092082 dv-cinder-818037-2-iscsi devstack@n-api.service[100957]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=100957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:16:48.092291 dv-cinder-818037-2-iscsi devstack@n-api.service[100958]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=100958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:16:48.092424 dv-cinder-818037-2-iscsi devstack@n-api.service[100957]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=100957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:16:48.092544 dv-cinder-818037-2-iscsi devstack@n-api.service[100958]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=100958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:16:48.092664 dv-cinder-818037-2-iscsi devstack@n-api.service[100957]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=100957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:16:48.092867 dv-cinder-818037-2-iscsi devstack@n-api.service[100958]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=100958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:16:48.092994 dv-cinder-818037-2-iscsi devstack@n-api.service[100957]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=100957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:16:48.093184 dv-cinder-818037-2-iscsi devstack@n-api.service[100957]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=100957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:16:48.093307 dv-cinder-818037-2-iscsi devstack@n-api.service[100958]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=100958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:16:48.093488 dv-cinder-818037-2-iscsi devstack@n-api.service[100958]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=100958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:16:48.093610 dv-cinder-818037-2-iscsi devstack@n-api.service[100957]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=100957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:16:48.093791 dv-cinder-818037-2-iscsi devstack@n-api.service[100957]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=100957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:16:48.093912 dv-cinder-818037-2-iscsi devstack@n-api.service[100958]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=100958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:16:48.094088 dv-cinder-818037-2-iscsi devstack@n-api.service[100958]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=100958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:16:48.094219 dv-cinder-818037-2-iscsi devstack@n-api.service[100957]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=100957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:16:48.094391 dv-cinder-818037-2-iscsi devstack@n-api.service[100957]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=100957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:16:48.094514 dv-cinder-818037-2-iscsi devstack@n-api.service[100958]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=100958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:16:48.094698 dv-cinder-818037-2-iscsi devstack@n-api.service[100957]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=100957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:16:48.094822 dv-cinder-818037-2-iscsi devstack@n-api.service[100958]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=100958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:16:48.095005 dv-cinder-818037-2-iscsi devstack@n-api.service[100957]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=100957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:16:48.095137 dv-cinder-818037-2-iscsi devstack@n-api.service[100958]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=100958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:16:48.095331 dv-cinder-818037-2-iscsi devstack@n-api.service[100957]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=100957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:16:48.095456 dv-cinder-818037-2-iscsi devstack@n-api.service[100958]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=100958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:16:48.095644 dv-cinder-818037-2-iscsi devstack@n-api.service[100958]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=100958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:16:48.095774 dv-cinder-818037-2-iscsi devstack@n-api.service[100957]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=100957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:16:48.095948 dv-cinder-818037-2-iscsi devstack@n-api.service[100957]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=100957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:16:48.096071 dv-cinder-818037-2-iscsi devstack@n-api.service[100958]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=100958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:16:48.096256 dv-cinder-818037-2-iscsi devstack@n-api.service[100957]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=100957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:16:48.096387 dv-cinder-818037-2-iscsi devstack@n-api.service[100958]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=100958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:16:48.096560 dv-cinder-818037-2-iscsi devstack@n-api.service[100958]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=100958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:16:48.096691 dv-cinder-818037-2-iscsi devstack@n-api.service[100957]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=100957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:16:48.096892 dv-cinder-818037-2-iscsi devstack@n-api.service[100958]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=100958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:16:48.097017 dv-cinder-818037-2-iscsi devstack@n-api.service[100957]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=100957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:16:48.097203 dv-cinder-818037-2-iscsi devstack@n-api.service[100958]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=100958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:16:48.097327 dv-cinder-818037-2-iscsi devstack@n-api.service[100957]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=100957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:16:48.097648 dv-cinder-818037-2-iscsi devstack@n-api.service[100958]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=100958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:16:48.097861 dv-cinder-818037-2-iscsi devstack@n-api.service[100958]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=100958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:16:48.097967 dv-cinder-818037-2-iscsi devstack@n-api.service[100957]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=100957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:16:48.098220 dv-cinder-818037-2-iscsi devstack@n-api.service[100958]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=100958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:16:48.098344 dv-cinder-818037-2-iscsi devstack@n-api.service[100957]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=100957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:16:48.098538 dv-cinder-818037-2-iscsi devstack@n-api.service[100958]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=100958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:16:48.098662 dv-cinder-818037-2-iscsi devstack@n-api.service[100957]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=100957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:16:48.098842 dv-cinder-818037-2-iscsi devstack@n-api.service[100958]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=100958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:16:48.098968 dv-cinder-818037-2-iscsi devstack@n-api.service[100957]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=100957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:16:48.099145 dv-cinder-818037-2-iscsi devstack@n-api.service[100958]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=100958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:16:48.099272 dv-cinder-818037-2-iscsi devstack@n-api.service[100957]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=100957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:16:48.099472 dv-cinder-818037-2-iscsi devstack@n-api.service[100957]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=100957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:16:48.099594 dv-cinder-818037-2-iscsi devstack@n-api.service[100958]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=100958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:16:48.099773 dv-cinder-818037-2-iscsi devstack@n-api.service[100958]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=100958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:16:48.099931 dv-cinder-818037-2-iscsi devstack@n-api.service[100957]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=100957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:16:48.100080 dv-cinder-818037-2-iscsi devstack@n-api.service[100958]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=100958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:16:48.100212 dv-cinder-818037-2-iscsi devstack@n-api.service[100957]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=100957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:16:48.100397 dv-cinder-818037-2-iscsi devstack@n-api.service[100957]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=100957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:16:48.100532 dv-cinder-818037-2-iscsi devstack@n-api.service[100958]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=100958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:16:48.100714 dv-cinder-818037-2-iscsi devstack@n-api.service[100957]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=100957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:16:48.100896 dv-cinder-818037-2-iscsi devstack@n-api.service[100958]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=100958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:16:48.101060 dv-cinder-818037-2-iscsi devstack@n-api.service[100957]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=100957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:16:48.101193 dv-cinder-818037-2-iscsi devstack@n-api.service[100958]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=100958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:16:48.101358 dv-cinder-818037-2-iscsi devstack@n-api.service[100958]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=100958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:16:48.101489 dv-cinder-818037-2-iscsi devstack@n-api.service[100957]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=100957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:16:48.101663 dv-cinder-818037-2-iscsi devstack@n-api.service[100957]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=100957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:16:48.101786 dv-cinder-818037-2-iscsi devstack@n-api.service[100958]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=100958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:16:48.101964 dv-cinder-818037-2-iscsi devstack@n-api.service[100958]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=100958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:16:48.102092 dv-cinder-818037-2-iscsi devstack@n-api.service[100957]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=100957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:16:48.102271 dv-cinder-818037-2-iscsi devstack@n-api.service[100958]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=100958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:16:48.102418 dv-cinder-818037-2-iscsi devstack@n-api.service[100957]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=100957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:16:48.102577 dv-cinder-818037-2-iscsi devstack@n-api.service[100958]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=100958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:16:48.102701 dv-cinder-818037-2-iscsi devstack@n-api.service[100957]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=100957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:16:48.102884 dv-cinder-818037-2-iscsi devstack@n-api.service[100958]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=100958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:16:48.103008 dv-cinder-818037-2-iscsi devstack@n-api.service[100957]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=100957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:16:48.103192 dv-cinder-818037-2-iscsi devstack@n-api.service[100958]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=100958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:16:48.103324 dv-cinder-818037-2-iscsi devstack@n-api.service[100957]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=100957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:16:48.103499 dv-cinder-818037-2-iscsi devstack@n-api.service[100958]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=100958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:16:48.103623 dv-cinder-818037-2-iscsi devstack@n-api.service[100957]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=100957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:16:48.103805 dv-cinder-818037-2-iscsi devstack@n-api.service[100958]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=100958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:16:48.103928 dv-cinder-818037-2-iscsi devstack@n-api.service[100957]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=100957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:16:48.104109 dv-cinder-818037-2-iscsi devstack@n-api.service[100958]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=100958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:16:48.104233 dv-cinder-818037-2-iscsi devstack@n-api.service[100957]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=100957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:16:48.104419 dv-cinder-818037-2-iscsi devstack@n-api.service[100957]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=100957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:16:48.104548 dv-cinder-818037-2-iscsi devstack@n-api.service[100958]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=100958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:16:48.104719 dv-cinder-818037-2-iscsi devstack@n-api.service[100958]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=100958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:16:48.104861 dv-cinder-818037-2-iscsi devstack@n-api.service[100957]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=100957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:16:48.105066 dv-cinder-818037-2-iscsi devstack@n-api.service[100958]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=100958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:16:48.105189 dv-cinder-818037-2-iscsi devstack@n-api.service[100957]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=100957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:16:48.105347 dv-cinder-818037-2-iscsi devstack@n-api.service[100958]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=100958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:16:48.105478 dv-cinder-818037-2-iscsi devstack@n-api.service[100957]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=100957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:16:48.105650 dv-cinder-818037-2-iscsi devstack@n-api.service[100958]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=100958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:16:48.105780 dv-cinder-818037-2-iscsi devstack@n-api.service[100957]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=100957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:16:48.105960 dv-cinder-818037-2-iscsi devstack@n-api.service[100957]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=100957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:16:48.106082 dv-cinder-818037-2-iscsi devstack@n-api.service[100958]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=100958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:16:48.106262 dv-cinder-818037-2-iscsi devstack@n-api.service[100958]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=100958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:16:48.106384 dv-cinder-818037-2-iscsi devstack@n-api.service[100957]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=100957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:16:48.106563 dv-cinder-818037-2-iscsi devstack@n-api.service[100958]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=100958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:16:48.106687 dv-cinder-818037-2-iscsi devstack@n-api.service[100957]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=100957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:16:48.106870 dv-cinder-818037-2-iscsi devstack@n-api.service[100958]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=100958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:16:48.107002 dv-cinder-818037-2-iscsi devstack@n-api.service[100957]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=100957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:16:48.107170 dv-cinder-818037-2-iscsi devstack@n-api.service[100958]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=100958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:16:48.107301 dv-cinder-818037-2-iscsi devstack@n-api.service[100957]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=100957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:16:48.107478 dv-cinder-818037-2-iscsi devstack@n-api.service[100958]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=100958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:16:48.107610 dv-cinder-818037-2-iscsi devstack@n-api.service[100957]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=100957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:16:48.107778 dv-cinder-818037-2-iscsi devstack@n-api.service[100958]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=100958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:16:48.107902 dv-cinder-818037-2-iscsi devstack@n-api.service[100957]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=100957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:16:48.108082 dv-cinder-818037-2-iscsi devstack@n-api.service[100957]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=100957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:16:48.108204 dv-cinder-818037-2-iscsi devstack@n-api.service[100958]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=100958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:16:48.108413 dv-cinder-818037-2-iscsi devstack@n-api.service[100957]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=100957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:16:48.108550 dv-cinder-818037-2-iscsi devstack@n-api.service[100958]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=100958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:16:48.108729 dv-cinder-818037-2-iscsi devstack@n-api.service[100957]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=100957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:16:48.108880 dv-cinder-818037-2-iscsi devstack@n-api.service[100958]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=100958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:16:48.109065 dv-cinder-818037-2-iscsi devstack@n-api.service[100957]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=100957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:16:48.109189 dv-cinder-818037-2-iscsi devstack@n-api.service[100958]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=100958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:16:48.109384 dv-cinder-818037-2-iscsi devstack@n-api.service[100957]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=100957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:16:48.109520 dv-cinder-818037-2-iscsi devstack@n-api.service[100958]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=100958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:16:48.109689 dv-cinder-818037-2-iscsi devstack@n-api.service[100958]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=100958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:16:48.109811 dv-cinder-818037-2-iscsi devstack@n-api.service[100957]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=100957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:16:48.110000 dv-cinder-818037-2-iscsi devstack@n-api.service[100958]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=100958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:16:48.110133 dv-cinder-818037-2-iscsi devstack@n-api.service[100957]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=100957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:16:48.110308 dv-cinder-818037-2-iscsi devstack@n-api.service[100957]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=100957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:16:48.110444 dv-cinder-818037-2-iscsi devstack@n-api.service[100958]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=100958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:16:48.110603 dv-cinder-818037-2-iscsi devstack@n-api.service[100958]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=100958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:16:48.110725 dv-cinder-818037-2-iscsi devstack@n-api.service[100957]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=100957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:16:48.111024 dv-cinder-818037-2-iscsi devstack@n-api.service[100958]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=100958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:16:48.111149 dv-cinder-818037-2-iscsi devstack@n-api.service[100957]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=100957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:16:48.111337 dv-cinder-818037-2-iscsi devstack@n-api.service[100958]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=100958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:16:48.111468 dv-cinder-818037-2-iscsi devstack@n-api.service[100957]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=100957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:16:48.111642 dv-cinder-818037-2-iscsi devstack@n-api.service[100957]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=100957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:16:48.111771 dv-cinder-818037-2-iscsi devstack@n-api.service[100958]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=100958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:16:48.111947 dv-cinder-818037-2-iscsi devstack@n-api.service[100958]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=100958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:16:48.112068 dv-cinder-818037-2-iscsi devstack@n-api.service[100957]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=100957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:16:48.112250 dv-cinder-818037-2-iscsi devstack@n-api.service[100958]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=100958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:16:48.112374 dv-cinder-818037-2-iscsi devstack@n-api.service[100957]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=100957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:16:48.112550 dv-cinder-818037-2-iscsi devstack@n-api.service[100958]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=100958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:16:48.112672 dv-cinder-818037-2-iscsi devstack@n-api.service[100957]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=100957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:16:48.112879 dv-cinder-818037-2-iscsi devstack@n-api.service[100958]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=100958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:16:48.113004 dv-cinder-818037-2-iscsi devstack@n-api.service[100957]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=100957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:16:48.113316 dv-cinder-818037-2-iscsi devstack@n-api.service[100957]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=100957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:16:48.113443 dv-cinder-818037-2-iscsi devstack@n-api.service[100958]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=100958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:16:48.113736 dv-cinder-818037-2-iscsi devstack@n-api.service[100958]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=100958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:16:48.113866 dv-cinder-818037-2-iscsi devstack@n-api.service[100957]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=100957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:16:48.114045 dv-cinder-818037-2-iscsi devstack@n-api.service[100958]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=100958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:16:48.114192 dv-cinder-818037-2-iscsi devstack@n-api.service[100957]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=100957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:16:48.114357 dv-cinder-818037-2-iscsi devstack@n-api.service[100957]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=100957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:16:48.114480 dv-cinder-818037-2-iscsi devstack@n-api.service[100958]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=100958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:16:48.114672 dv-cinder-818037-2-iscsi devstack@n-api.service[100957]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=100957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:16:48.114794 dv-cinder-818037-2-iscsi devstack@n-api.service[100958]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=100958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:16:48.114972 dv-cinder-818037-2-iscsi devstack@n-api.service[100958]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=100958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:16:48.115107 dv-cinder-818037-2-iscsi devstack@n-api.service[100957]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=100957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:16:48.115274 dv-cinder-818037-2-iscsi devstack@n-api.service[100957]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=100957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:16:48.115396 dv-cinder-818037-2-iscsi devstack@n-api.service[100958]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=100958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:16:48.115587 dv-cinder-818037-2-iscsi devstack@n-api.service[100957]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=100957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:16:48.115717 dv-cinder-818037-2-iscsi devstack@n-api.service[100958]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=100958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:16:48.115915 dv-cinder-818037-2-iscsi devstack@n-api.service[100957]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=100957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:16:48.116052 dv-cinder-818037-2-iscsi devstack@n-api.service[100958]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=100958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:16:48.116229 dv-cinder-818037-2-iscsi devstack@n-api.service[100957]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=100957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:16:48.116357 dv-cinder-818037-2-iscsi devstack@n-api.service[100958]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=100958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:16:48.116542 dv-cinder-818037-2-iscsi devstack@n-api.service[100957]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=100957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:16:48.116704 dv-cinder-818037-2-iscsi devstack@n-api.service[100958]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=100958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:16:48.116861 dv-cinder-818037-2-iscsi devstack@n-api.service[100957]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=100957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:16:48.117043 dv-cinder-818037-2-iscsi devstack@n-api.service[100958]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=100958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:16:48.117188 dv-cinder-818037-2-iscsi devstack@n-api.service[100957]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=100957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:16:48.117352 dv-cinder-818037-2-iscsi devstack@n-api.service[100958]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=100958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:16:48.117505 dv-cinder-818037-2-iscsi devstack@n-api.service[100957]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=100957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:16:48.117676 dv-cinder-818037-2-iscsi devstack@n-api.service[100958]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=100958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:16:48.117833 dv-cinder-818037-2-iscsi devstack@n-api.service[100957]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=100957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:16:48.117999 dv-cinder-818037-2-iscsi devstack@n-api.service[100958]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=100958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:16:48.118254 dv-cinder-818037-2-iscsi devstack@n-api.service[100957]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=100957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:16:48.118402 dv-cinder-818037-2-iscsi devstack@n-api.service[100958]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=100958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:16:48.118573 dv-cinder-818037-2-iscsi devstack@n-api.service[100957]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=100957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:16:48.118705 dv-cinder-818037-2-iscsi devstack@n-api.service[100958]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=100958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:16:48.118882 dv-cinder-818037-2-iscsi devstack@n-api.service[100957]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=100957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:16:48.119007 dv-cinder-818037-2-iscsi devstack@n-api.service[100958]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=100958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:16:48.119199 dv-cinder-818037-2-iscsi devstack@n-api.service[100958]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=100958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:16:48.119320 dv-cinder-818037-2-iscsi devstack@n-api.service[100957]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=100957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:16:48.119523 dv-cinder-818037-2-iscsi devstack@n-api.service[100958]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=100958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:16:48.119646 dv-cinder-818037-2-iscsi devstack@n-api.service[100957]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=100957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:16:48.119850 dv-cinder-818037-2-iscsi devstack@n-api.service[100958]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=100958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:16:48.119974 dv-cinder-818037-2-iscsi devstack@n-api.service[100957]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=100957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:16:48.120160 dv-cinder-818037-2-iscsi devstack@n-api.service[100958]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=100958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:16:48.120285 dv-cinder-818037-2-iscsi devstack@n-api.service[100957]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=100957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:16:48.120472 dv-cinder-818037-2-iscsi devstack@n-api.service[100958]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=100958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:16:48.120598 dv-cinder-818037-2-iscsi devstack@n-api.service[100957]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=100957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:16:48.120789 dv-cinder-818037-2-iscsi devstack@n-api.service[100958]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=100958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:16:48.120916 dv-cinder-818037-2-iscsi devstack@n-api.service[100957]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=100957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:16:48.121120 dv-cinder-818037-2-iscsi devstack@n-api.service[100958]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=100958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:16:48.121244 dv-cinder-818037-2-iscsi devstack@n-api.service[100957]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=100957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:16:48.121433 dv-cinder-818037-2-iscsi devstack@n-api.service[100958]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=100958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:16:48.121559 dv-cinder-818037-2-iscsi devstack@n-api.service[100957]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=100957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:16:48.121744 dv-cinder-818037-2-iscsi devstack@n-api.service[100958]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=100958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:16:48.121869 dv-cinder-818037-2-iscsi devstack@n-api.service[100957]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=100957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:16:48.122065 dv-cinder-818037-2-iscsi devstack@n-api.service[100958]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=100958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:16:48.122189 dv-cinder-818037-2-iscsi devstack@n-api.service[100957]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=100957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:16:48.122391 dv-cinder-818037-2-iscsi devstack@n-api.service[100957]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=100957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:16:48.122546 dv-cinder-818037-2-iscsi devstack@n-api.service[100958]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=100958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:16:48.122708 dv-cinder-818037-2-iscsi devstack@n-api.service[100957]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=100957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:16:48.122832 dv-cinder-818037-2-iscsi devstack@n-api.service[100958]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=100958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:16:48.123028 dv-cinder-818037-2-iscsi devstack@n-api.service[100957]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=100957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:16:48.123151 dv-cinder-818037-2-iscsi devstack@n-api.service[100958]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=100958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:16:48.123338 dv-cinder-818037-2-iscsi devstack@n-api.service[100957]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=100957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:16:48.123470 dv-cinder-818037-2-iscsi devstack@n-api.service[100958]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=100958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:16:48.123670 dv-cinder-818037-2-iscsi devstack@n-api.service[100957]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=100957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:16:48.123794 dv-cinder-818037-2-iscsi devstack@n-api.service[100958]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=100958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:16:48.123978 dv-cinder-818037-2-iscsi devstack@n-api.service[100958]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=100958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:16:48.124125 dv-cinder-818037-2-iscsi devstack@n-api.service[100957]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=100957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:16:48.124281 dv-cinder-818037-2-iscsi devstack@n-api.service[100958]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=100958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:16:48.124413 dv-cinder-818037-2-iscsi devstack@n-api.service[100957]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=100957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:16:48.124594 dv-cinder-818037-2-iscsi devstack@n-api.service[100958]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=100958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:16:48.124727 dv-cinder-818037-2-iscsi devstack@n-api.service[100957]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=100957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:16:48.124924 dv-cinder-818037-2-iscsi devstack@n-api.service[100958]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=100958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:16:48.125049 dv-cinder-818037-2-iscsi devstack@n-api.service[100957]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=100957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:16:48.125230 dv-cinder-818037-2-iscsi devstack@n-api.service[100958]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=100958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:16:48.125362 dv-cinder-818037-2-iscsi devstack@n-api.service[100957]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=100957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:16:48.125552 dv-cinder-818037-2-iscsi devstack@n-api.service[100958]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=100958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:16:48.125685 dv-cinder-818037-2-iscsi devstack@n-api.service[100957]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=100957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:16:48.125854 dv-cinder-818037-2-iscsi devstack@n-api.service[100958]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=100958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:16:48.125979 dv-cinder-818037-2-iscsi devstack@n-api.service[100957]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=100957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:16:48.126163 dv-cinder-818037-2-iscsi devstack@n-api.service[100958]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=100958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:16:48.126287 dv-cinder-818037-2-iscsi devstack@n-api.service[100957]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=100957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:16:48.126469 dv-cinder-818037-2-iscsi devstack@n-api.service[100958]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=100958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:16:48.126644 dv-cinder-818037-2-iscsi devstack@n-api.service[100957]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=100957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:16:48.126767 dv-cinder-818037-2-iscsi devstack@n-api.service[100958]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=100958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:16:48.126888 dv-cinder-818037-2-iscsi devstack@n-api.service[100957]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=100957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:16:48.127064 dv-cinder-818037-2-iscsi devstack@n-api.service[100958]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=100958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:16:48.127195 dv-cinder-818037-2-iscsi devstack@n-api.service[100957]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=100957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:16:48.127367 dv-cinder-818037-2-iscsi devstack@n-api.service[100958]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=100958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:16:48.127491 dv-cinder-818037-2-iscsi devstack@n-api.service[100957]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=100957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:16:48.127685 dv-cinder-818037-2-iscsi devstack@n-api.service[100958]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=100958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:16:48.127814 dv-cinder-818037-2-iscsi devstack@n-api.service[100957]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=100957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:16:48.127987 dv-cinder-818037-2-iscsi devstack@n-api.service[100958]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=100958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:16:48.128111 dv-cinder-818037-2-iscsi devstack@n-api.service[100957]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=100957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:16:48.128307 dv-cinder-818037-2-iscsi devstack@n-api.service[100958]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=100958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:16:48.128431 dv-cinder-818037-2-iscsi devstack@n-api.service[100957]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=100957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:16:48.128619 dv-cinder-818037-2-iscsi devstack@n-api.service[100958]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=100958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:16:48.128759 dv-cinder-818037-2-iscsi devstack@n-api.service[100957]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=100957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:16:48.128990 dv-cinder-818037-2-iscsi devstack@n-api.service[100958]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=100958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:16:48.129114 dv-cinder-818037-2-iscsi devstack@n-api.service[100957]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=100957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:16:48.129333 dv-cinder-818037-2-iscsi devstack@n-api.service[100957]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=100957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:16:48.129511 dv-cinder-818037-2-iscsi devstack@n-api.service[100958]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=100958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:16:48.129644 dv-cinder-818037-2-iscsi devstack@n-api.service[100957]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=100957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:16:48.129765 dv-cinder-818037-2-iscsi devstack@n-api.service[100958]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=100958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:16:48.129875 dv-cinder-818037-2-iscsi devstack@n-api.service[100957]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=100957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:16:48.129993 dv-cinder-818037-2-iscsi devstack@n-api.service[100958]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=100958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:16:48.130191 dv-cinder-818037-2-iscsi devstack@n-api.service[100957]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=100957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:16:48.130316 dv-cinder-818037-2-iscsi devstack@n-api.service[100958]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=100958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:16:48.130489 dv-cinder-818037-2-iscsi devstack@n-api.service[100958]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=100958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:16:48.130620 dv-cinder-818037-2-iscsi devstack@n-api.service[100957]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=100957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:16:48.130794 dv-cinder-818037-2-iscsi devstack@n-api.service[100958]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=100958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:16:48.130929 dv-cinder-818037-2-iscsi devstack@n-api.service[100957]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=100957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:16:48.131097 dv-cinder-818037-2-iscsi devstack@n-api.service[100958]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=100958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:16:48.131222 dv-cinder-818037-2-iscsi devstack@n-api.service[100957]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=100957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:16:48.131425 dv-cinder-818037-2-iscsi devstack@n-api.service[100957]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=100957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:16:48.131556 dv-cinder-818037-2-iscsi devstack@n-api.service[100958]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=100958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:16:48.131729 dv-cinder-818037-2-iscsi devstack@n-api.service[100958]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=100958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:16:48.131859 dv-cinder-818037-2-iscsi devstack@n-api.service[100957]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=100957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:16:48.132046 dv-cinder-818037-2-iscsi devstack@n-api.service[100957]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=100957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:16:48.132168 dv-cinder-818037-2-iscsi devstack@n-api.service[100958]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=100958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:16:48.132371 dv-cinder-818037-2-iscsi devstack@n-api.service[100958]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=100958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:16:48.132487 dv-cinder-818037-2-iscsi devstack@n-api.service[100957]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=100957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:16:48.132683 dv-cinder-818037-2-iscsi devstack@n-api.service[100957]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=100957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:16:48.132837 dv-cinder-818037-2-iscsi devstack@n-api.service[100958]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=100958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:16:48.133017 dv-cinder-818037-2-iscsi devstack@n-api.service[100958]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=100958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:16:48.133138 dv-cinder-818037-2-iscsi devstack@n-api.service[100957]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=100957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:16:48.133324 dv-cinder-818037-2-iscsi devstack@n-api.service[100957]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=100957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:16:48.133445 dv-cinder-818037-2-iscsi devstack@n-api.service[100958]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=100958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:16:48.133633 dv-cinder-818037-2-iscsi devstack@n-api.service[100957]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=100957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:16:48.133765 dv-cinder-818037-2-iscsi devstack@n-api.service[100958]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=100958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:16:48.133962 dv-cinder-818037-2-iscsi devstack@n-api.service[100958]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=100958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:16:48.134088 dv-cinder-818037-2-iscsi devstack@n-api.service[100957]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=100957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:16:48.134283 dv-cinder-818037-2-iscsi devstack@n-api.service[100958]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=100958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:16:48.134407 dv-cinder-818037-2-iscsi devstack@n-api.service[100957]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=100957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:16:48.134606 dv-cinder-818037-2-iscsi devstack@n-api.service[100957]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=100957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:16:48.134729 dv-cinder-818037-2-iscsi devstack@n-api.service[100958]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=100958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:16:48.134906 dv-cinder-818037-2-iscsi devstack@n-api.service[100958]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=100958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:16:48.135028 dv-cinder-818037-2-iscsi devstack@n-api.service[100957]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=100957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:16:48.135211 dv-cinder-818037-2-iscsi devstack@n-api.service[100958]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=100958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:16:48.135330 dv-cinder-818037-2-iscsi devstack@n-api.service[100957]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=100957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:16:48.135521 dv-cinder-818037-2-iscsi devstack@n-api.service[100958]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=100958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:16:48.135645 dv-cinder-818037-2-iscsi devstack@n-api.service[100957]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=100957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:16:48.135822 dv-cinder-818037-2-iscsi devstack@n-api.service[100958]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=100958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:16:48.135954 dv-cinder-818037-2-iscsi devstack@n-api.service[100957]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=100957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:16:48.136126 dv-cinder-818037-2-iscsi devstack@n-api.service[100958]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=100958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:16:48.136242 dv-cinder-818037-2-iscsi devstack@n-api.service[100957]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=100957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:16:48.136428 dv-cinder-818037-2-iscsi devstack@n-api.service[100958]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=100958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:16:48.136559 dv-cinder-818037-2-iscsi devstack@n-api.service[100957]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=100957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:16:48.136737 dv-cinder-818037-2-iscsi devstack@n-api.service[100958]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=100958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:16:48.136977 dv-cinder-818037-2-iscsi devstack@n-api.service[100957]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=100957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:16:48.137102 dv-cinder-818037-2-iscsi devstack@n-api.service[100958]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=100958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:16:48.137324 dv-cinder-818037-2-iscsi devstack@n-api.service[100957]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=100957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:16:48.137457 dv-cinder-818037-2-iscsi devstack@n-api.service[100958]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=100958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:16:48.137640 dv-cinder-818037-2-iscsi devstack@n-api.service[100957]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=100957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:16:48.137763 dv-cinder-818037-2-iscsi devstack@n-api.service[100958]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=100958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:16:48.137951 dv-cinder-818037-2-iscsi devstack@n-api.service[100957]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=100957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:16:48.138074 dv-cinder-818037-2-iscsi devstack@n-api.service[100958]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=100958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:16:48.138262 dv-cinder-818037-2-iscsi devstack@n-api.service[100958]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=100958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:16:48.138384 dv-cinder-818037-2-iscsi devstack@n-api.service[100957]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=100957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:16:48.138573 dv-cinder-818037-2-iscsi devstack@n-api.service[100957]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=100957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:16:48.138694 dv-cinder-818037-2-iscsi devstack@n-api.service[100958]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=100958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:16:48.138883 dv-cinder-818037-2-iscsi devstack@n-api.service[100958]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=100958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:16:48.139004 dv-cinder-818037-2-iscsi devstack@n-api.service[100957]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=100957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:16:48.139189 dv-cinder-818037-2-iscsi devstack@n-api.service[100957]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=100957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:16:48.139312 dv-cinder-818037-2-iscsi devstack@n-api.service[100958]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=100958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:16:48.139492 dv-cinder-818037-2-iscsi devstack@n-api.service[100958]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=100958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:16:48.139615 dv-cinder-818037-2-iscsi devstack@n-api.service[100957]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=100957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:16:48.139793 dv-cinder-818037-2-iscsi devstack@n-api.service[100958]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=100958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:16:48.139924 dv-cinder-818037-2-iscsi devstack@n-api.service[100957]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=100957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:16:48.140097 dv-cinder-818037-2-iscsi devstack@n-api.service[100957]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=100957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:16:48.140220 dv-cinder-818037-2-iscsi devstack@n-api.service[100958]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=100958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:16:48.140404 dv-cinder-818037-2-iscsi devstack@n-api.service[100957]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=100957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:16:48.140529 dv-cinder-818037-2-iscsi devstack@n-api.service[100958]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=100958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:16:48.140851 dv-cinder-818037-2-iscsi devstack@n-api.service[100957]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=100957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:16:48.140984 dv-cinder-818037-2-iscsi devstack@n-api.service[100958]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=100958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:16:48.141118 dv-cinder-818037-2-iscsi devstack@n-api.service[100957]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=100957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:16:48.141248 dv-cinder-818037-2-iscsi devstack@n-api.service[100958]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=100958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:16:48.141376 dv-cinder-818037-2-iscsi devstack@n-api.service[100957]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=100957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:16:48.141496 dv-cinder-818037-2-iscsi devstack@n-api.service[100958]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=100958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:16:48.141683 dv-cinder-818037-2-iscsi devstack@n-api.service[100957]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=100957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:16:48.141815 dv-cinder-818037-2-iscsi devstack@n-api.service[100958]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=100958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:16:48.141993 dv-cinder-818037-2-iscsi devstack@n-api.service[100958]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=100958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:16:48.142114 dv-cinder-818037-2-iscsi devstack@n-api.service[100957]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=100957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:16:48.142299 dv-cinder-818037-2-iscsi devstack@n-api.service[100957]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=100957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:16:48.142421 dv-cinder-818037-2-iscsi devstack@n-api.service[100958]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=100958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:16:48.142610 dv-cinder-818037-2-iscsi devstack@n-api.service[100957]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=100957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:16:48.142747 dv-cinder-818037-2-iscsi devstack@n-api.service[100958]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=100958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:16:48.142919 dv-cinder-818037-2-iscsi devstack@n-api.service[100958]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=100958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:16:48.143042 dv-cinder-818037-2-iscsi devstack@n-api.service[100957]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=100957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:16:48.143235 dv-cinder-818037-2-iscsi devstack@n-api.service[100958]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=100958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:16:48.143357 dv-cinder-818037-2-iscsi devstack@n-api.service[100957]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=100957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:16:48.143550 dv-cinder-818037-2-iscsi devstack@n-api.service[100958]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=100958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:16:48.143683 dv-cinder-818037-2-iscsi devstack@n-api.service[100957]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=100957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:16:48.143863 dv-cinder-818037-2-iscsi devstack@n-api.service[100958]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=100958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:16:48.143985 dv-cinder-818037-2-iscsi devstack@n-api.service[100957]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=100957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:16:48.144177 dv-cinder-818037-2-iscsi devstack@n-api.service[100958]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=100958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:16:48.144303 dv-cinder-818037-2-iscsi devstack@n-api.service[100957]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=100957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:16:48.144567 dv-cinder-818037-2-iscsi devstack@n-api.service[100958]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=100958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:16:48.144822 dv-cinder-818037-2-iscsi devstack@n-api.service[100957]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=100957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:16:48.144979 dv-cinder-818037-2-iscsi devstack@n-api.service[100958]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=100958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:16:48.145195 dv-cinder-818037-2-iscsi devstack@n-api.service[100957]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=100957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:16:48.145343 dv-cinder-818037-2-iscsi devstack@n-api.service[100958]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=100958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:16:48.145499 dv-cinder-818037-2-iscsi devstack@n-api.service[100958]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=100958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:16:48.145641 dv-cinder-818037-2-iscsi devstack@n-api.service[100957]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=100957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:16:48.145816 dv-cinder-818037-2-iscsi devstack@n-api.service[100958]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=100958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:16:48.146059 dv-cinder-818037-2-iscsi devstack@n-api.service[100957]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=100957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:16:48.146357 dv-cinder-818037-2-iscsi devstack@n-api.service[100958]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=100958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:16:48.146480 dv-cinder-818037-2-iscsi devstack@n-api.service[100957]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=100957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:16:48.146683 dv-cinder-818037-2-iscsi devstack@n-api.service[100958]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=100958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:16:48.146937 dv-cinder-818037-2-iscsi devstack@n-api.service[100957]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=100957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:16:48.147061 dv-cinder-818037-2-iscsi devstack@n-api.service[100958]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=100958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:16:48.147265 dv-cinder-818037-2-iscsi devstack@n-api.service[100957]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=100957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:16:48.147416 dv-cinder-818037-2-iscsi devstack@n-api.service[100958]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=100958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:16:48.147589 dv-cinder-818037-2-iscsi devstack@n-api.service[100958]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=100958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:16:48.147711 dv-cinder-818037-2-iscsi devstack@n-api.service[100957]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=100957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:16:48.147902 dv-cinder-818037-2-iscsi devstack@n-api.service[100958]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=100958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:16:48.148026 dv-cinder-818037-2-iscsi devstack@n-api.service[100957]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=100957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:16:48.148215 dv-cinder-818037-2-iscsi devstack@n-api.service[100958]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=100958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:16:48.148346 dv-cinder-818037-2-iscsi devstack@n-api.service[100957]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=100957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:16:48.148526 dv-cinder-818037-2-iscsi devstack@n-api.service[100958]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=100958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:16:48.148658 dv-cinder-818037-2-iscsi devstack@n-api.service[100957]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=100957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:16:48.148859 dv-cinder-818037-2-iscsi devstack@n-api.service[100958]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=100958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:16:48.148985 dv-cinder-818037-2-iscsi devstack@n-api.service[100957]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=100957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:16:48.149171 dv-cinder-818037-2-iscsi devstack@n-api.service[100958]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=100958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:16:48.149294 dv-cinder-818037-2-iscsi devstack@n-api.service[100957]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=100957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:16:48.149480 dv-cinder-818037-2-iscsi devstack@n-api.service[100958]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=100958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:16:48.149618 dv-cinder-818037-2-iscsi devstack@n-api.service[100957]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=100957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:16:48.149807 dv-cinder-818037-2-iscsi devstack@n-api.service[100958]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=100958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:16:48.150024 dv-cinder-818037-2-iscsi devstack@n-api.service[100957]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=100957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:16:48.150155 dv-cinder-818037-2-iscsi devstack@n-api.service[100958]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=100958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:16:48.150361 dv-cinder-818037-2-iscsi devstack@n-api.service[100957]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=100957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:16:48.150528 dv-cinder-818037-2-iscsi devstack@n-api.service[100958]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=100958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:16:48.150685 dv-cinder-818037-2-iscsi devstack@n-api.service[100957]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=100957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:16:48.150810 dv-cinder-818037-2-iscsi devstack@n-api.service[100958]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=100958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:16:48.151057 dv-cinder-818037-2-iscsi devstack@n-api.service[100958]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=100958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:16:48.151181 dv-cinder-818037-2-iscsi devstack@n-api.service[100957]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=100957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:16:48.151376 dv-cinder-818037-2-iscsi devstack@n-api.service[100958]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=100958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:16:48.151693 dv-cinder-818037-2-iscsi devstack@n-api.service[100958]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=100958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:16:48.151824 dv-cinder-818037-2-iscsi devstack@n-api.service[100957]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=100957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:16:48.152009 dv-cinder-818037-2-iscsi devstack@n-api.service[100958]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=100958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:16:48.152288 dv-cinder-818037-2-iscsi devstack@n-api.service[100957]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=100957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:16:48.152412 dv-cinder-818037-2-iscsi devstack@n-api.service[100958]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=100958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:16:48.152669 dv-cinder-818037-2-iscsi devstack@n-api.service[100958]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=100958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:16:48.152930 dv-cinder-818037-2-iscsi devstack@n-api.service[100957]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=100957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:16:48.153055 dv-cinder-818037-2-iscsi devstack@n-api.service[100958]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=100958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:16:48.153177 dv-cinder-818037-2-iscsi devstack@n-api.service[100957]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=100957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:16:48.153297 dv-cinder-818037-2-iscsi devstack@n-api.service[100958]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=100958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:16:48.153417 dv-cinder-818037-2-iscsi devstack@n-api.service[100957]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=100957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:16:48.153599 dv-cinder-818037-2-iscsi devstack@n-api.service[100958]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=100958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:16:48.153733 dv-cinder-818037-2-iscsi devstack@n-api.service[100957]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=100957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:16:48.153910 dv-cinder-818037-2-iscsi devstack@n-api.service[100958]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=100958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:16:48.154034 dv-cinder-818037-2-iscsi devstack@n-api.service[100957]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=100957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:16:48.154218 dv-cinder-818037-2-iscsi devstack@n-api.service[100958]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=100958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:16:48.154342 dv-cinder-818037-2-iscsi devstack@n-api.service[100957]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=100957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:16:48.154532 dv-cinder-818037-2-iscsi devstack@n-api.service[100958]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=100958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:16:48.154665 dv-cinder-818037-2-iscsi devstack@n-api.service[100957]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=100957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:16:48.154845 dv-cinder-818037-2-iscsi devstack@n-api.service[100958]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=100958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:16:48.154969 dv-cinder-818037-2-iscsi devstack@n-api.service[100957]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=100957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:16:48.155158 dv-cinder-818037-2-iscsi devstack@n-api.service[100958]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=100958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:16:48.155282 dv-cinder-818037-2-iscsi devstack@n-api.service[100957]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=100957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:16:48.155468 dv-cinder-818037-2-iscsi devstack@n-api.service[100958]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=100958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:16:48.155593 dv-cinder-818037-2-iscsi devstack@n-api.service[100957]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=100957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:16:48.155776 dv-cinder-818037-2-iscsi devstack@n-api.service[100958]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=100958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:16:48.155900 dv-cinder-818037-2-iscsi devstack@n-api.service[100957]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=100957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:16:48.156091 dv-cinder-818037-2-iscsi devstack@n-api.service[100958]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=100958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:16:48.156215 dv-cinder-818037-2-iscsi devstack@n-api.service[100957]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=100957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:16:48.156406 dv-cinder-818037-2-iscsi devstack@n-api.service[100958]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=100958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:16:48.156530 dv-cinder-818037-2-iscsi devstack@n-api.service[100957]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=100957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:16:48.156728 dv-cinder-818037-2-iscsi devstack@n-api.service[100958]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=100958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:16:48.156884 dv-cinder-818037-2-iscsi devstack@n-api.service[100957]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=100957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:16:48.157093 dv-cinder-818037-2-iscsi devstack@n-api.service[100958]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=100958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:16:48.157349 dv-cinder-818037-2-iscsi devstack@n-api.service[100957]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=100957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:16:48.157475 dv-cinder-818037-2-iscsi devstack@n-api.service[100958]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=100958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:16:48.157669 dv-cinder-818037-2-iscsi devstack@n-api.service[100957]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=100957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:16:48.157794 dv-cinder-818037-2-iscsi devstack@n-api.service[100958]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=100958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:16:48.157997 dv-cinder-818037-2-iscsi devstack@n-api.service[100957]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=100957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:16:48.158124 dv-cinder-818037-2-iscsi devstack@n-api.service[100958]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=100958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:16:48.158306 dv-cinder-818037-2-iscsi devstack@n-api.service[100958]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=100958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:16:48.158438 dv-cinder-818037-2-iscsi devstack@n-api.service[100957]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=100957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:16:48.158631 dv-cinder-818037-2-iscsi devstack@n-api.service[100957]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=100957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:16:48.158822 dv-cinder-818037-2-iscsi devstack@n-api.service[100958]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=100958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:16:48.158946 dv-cinder-818037-2-iscsi devstack@n-api.service[100957]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=100957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:16:48.159141 dv-cinder-818037-2-iscsi devstack@n-api.service[100958]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=100958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:16:48.159273 dv-cinder-818037-2-iscsi devstack@n-api.service[100957]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=100957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:16:48.159475 dv-cinder-818037-2-iscsi devstack@n-api.service[100958]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=100958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:16:48.159600 dv-cinder-818037-2-iscsi devstack@n-api.service[100957]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=100957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:16:48.159803 dv-cinder-818037-2-iscsi devstack@n-api.service[100958]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=100958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:16:48.159927 dv-cinder-818037-2-iscsi devstack@n-api.service[100957]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=100957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:16:48.160147 dv-cinder-818037-2-iscsi devstack@n-api.service[100958]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=100958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:16:48.160271 dv-cinder-818037-2-iscsi devstack@n-api.service[100957]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=100957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:16:48.160516 dv-cinder-818037-2-iscsi devstack@n-api.service[100957]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=100957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:16:48.160639 dv-cinder-818037-2-iscsi devstack@n-api.service[100958]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=100958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:16:48.160863 dv-cinder-818037-2-iscsi devstack@n-api.service[100957]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=100957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:16:48.160992 dv-cinder-818037-2-iscsi devstack@n-api.service[100958]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=100958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:16:48.161190 dv-cinder-818037-2-iscsi devstack@n-api.service[100957]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=100957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:16:48.161316 dv-cinder-818037-2-iscsi devstack@n-api.service[100958]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=100958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:16:48.161524 dv-cinder-818037-2-iscsi devstack@n-api.service[100957]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=100957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:16:48.161650 dv-cinder-818037-2-iscsi devstack@n-api.service[100958]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=100958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:16:48.161857 dv-cinder-818037-2-iscsi devstack@n-api.service[100958]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=100958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:16:48.162025 dv-cinder-818037-2-iscsi devstack@n-api.service[100957]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=100957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:16:48.162164 dv-cinder-818037-2-iscsi devstack@n-api.service[100958]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=100958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:16:48.162359 dv-cinder-818037-2-iscsi devstack@n-api.service[100957]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=100957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:16:48.162484 dv-cinder-818037-2-iscsi devstack@n-api.service[100958]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=100958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:16:48.162682 dv-cinder-818037-2-iscsi devstack@n-api.service[100957]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=100957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:16:48.162814 dv-cinder-818037-2-iscsi devstack@n-api.service[100958]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=100958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:16:48.163055 dv-cinder-818037-2-iscsi devstack@n-api.service[100958]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=100958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:16:48.163238 dv-cinder-818037-2-iscsi devstack@n-api.service[100957]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=100957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:16:48.163369 dv-cinder-818037-2-iscsi devstack@n-api.service[100958]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=100958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:16:48.163654 dv-cinder-818037-2-iscsi devstack@n-api.service[100958]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=100958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:16:48.163777 dv-cinder-818037-2-iscsi devstack@n-api.service[100957]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=100957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:16:48.163977 dv-cinder-818037-2-iscsi devstack@n-api.service[100958]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=100958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:16:48.164227 dv-cinder-818037-2-iscsi devstack@n-api.service[100957]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=100957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:16:48.164359 dv-cinder-818037-2-iscsi devstack@n-api.service[100958]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=100958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:16:48.164554 dv-cinder-818037-2-iscsi devstack@n-api.service[100957]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=100957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:16:48.164826 dv-cinder-818037-2-iscsi devstack@n-api.service[100958]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=100958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:16:48.164952 dv-cinder-818037-2-iscsi devstack@n-api.service[100957]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=100957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:16:48.165178 dv-cinder-818037-2-iscsi devstack@n-api.service[100958]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=100958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:16:48.165319 dv-cinder-818037-2-iscsi devstack@n-api.service[100957]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=100957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:16:48.165494 dv-cinder-818037-2-iscsi devstack@n-api.service[100958]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=100958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:16:48.165617 dv-cinder-818037-2-iscsi devstack@n-api.service[100957]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=100957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:16:48.165819 dv-cinder-818037-2-iscsi devstack@n-api.service[100958]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=100958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:16:48.165943 dv-cinder-818037-2-iscsi devstack@n-api.service[100957]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=100957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:16:48.166144 dv-cinder-818037-2-iscsi devstack@n-api.service[100958]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=100958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:16:48.166277 dv-cinder-818037-2-iscsi devstack@n-api.service[100957]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=100957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:16:48.166461 dv-cinder-818037-2-iscsi devstack@n-api.service[100958]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=100958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:16:48.166579 dv-cinder-818037-2-iscsi devstack@n-api.service[100957]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=100957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:16:48.166767 dv-cinder-818037-2-iscsi devstack@n-api.service[100958]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=100958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:16:48.166893 dv-cinder-818037-2-iscsi devstack@n-api.service[100957]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=100957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:16:48.167095 dv-cinder-818037-2-iscsi devstack@n-api.service[100958]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=100958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:16:48.167228 dv-cinder-818037-2-iscsi devstack@n-api.service[100957]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=100957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:16:48.167401 dv-cinder-818037-2-iscsi devstack@n-api.service[100958]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=100958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:16:48.167532 dv-cinder-818037-2-iscsi devstack@n-api.service[100957]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=100957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:16:48.167703 dv-cinder-818037-2-iscsi devstack@n-api.service[100958]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=100958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:16:48.167829 dv-cinder-818037-2-iscsi devstack@n-api.service[100957]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=100957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:16:48.168016 dv-cinder-818037-2-iscsi devstack@n-api.service[100958]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=100958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:16:48.168141 dv-cinder-818037-2-iscsi devstack@n-api.service[100957]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=100957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:16:48.168325 dv-cinder-818037-2-iscsi devstack@n-api.service[100958]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=100958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:16:48.168449 dv-cinder-818037-2-iscsi devstack@n-api.service[100957]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=100957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:16:48.168625 dv-cinder-818037-2-iscsi devstack@n-api.service[100958]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=100958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:16:48.168750 dv-cinder-818037-2-iscsi devstack@n-api.service[100957]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=100957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:16:48.169028 dv-cinder-818037-2-iscsi devstack@n-api.service[100958]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=100958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:16:48.169161 dv-cinder-818037-2-iscsi devstack@n-api.service[100957]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=100957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:16:48.169339 dv-cinder-818037-2-iscsi devstack@n-api.service[100958]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=100958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:16:48.169464 dv-cinder-818037-2-iscsi devstack@n-api.service[100957]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=100957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:16:48.169648 dv-cinder-818037-2-iscsi devstack@n-api.service[100958]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=100958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:16:48.169773 dv-cinder-818037-2-iscsi devstack@n-api.service[100957]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=100957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:16:48.169950 dv-cinder-818037-2-iscsi devstack@n-api.service[100958]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=100958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:16:48.170176 dv-cinder-818037-2-iscsi devstack@n-api.service[100957]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=100957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:16:48.170300 dv-cinder-818037-2-iscsi devstack@n-api.service[100958]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=100958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:16:48.170534 dv-cinder-818037-2-iscsi devstack@n-api.service[100957]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=100957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:16:48.170662 dv-cinder-818037-2-iscsi devstack@n-api.service[100958]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=100958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:16:48.170853 dv-cinder-818037-2-iscsi devstack@n-api.service[100958]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=100958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:16:48.170976 dv-cinder-818037-2-iscsi devstack@n-api.service[100957]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=100957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:16:48.171154 dv-cinder-818037-2-iscsi devstack@n-api.service[100958]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=100958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:16:48.171279 dv-cinder-818037-2-iscsi devstack@n-api.service[100957]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=100957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:16:48.171458 dv-cinder-818037-2-iscsi devstack@n-api.service[100958]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=100958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:16:48.171581 dv-cinder-818037-2-iscsi devstack@n-api.service[100957]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=100957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:16:48.171761 dv-cinder-818037-2-iscsi devstack@n-api.service[100958]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=100958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:16:48.171887 dv-cinder-818037-2-iscsi devstack@n-api.service[100957]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=100957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:16:48.172070 dv-cinder-818037-2-iscsi devstack@n-api.service[100958]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=100958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:16:48.172194 dv-cinder-818037-2-iscsi devstack@n-api.service[100957]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=100957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:16:48.172372 dv-cinder-818037-2-iscsi devstack@n-api.service[100958]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=100958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:16:48.172496 dv-cinder-818037-2-iscsi devstack@n-api.service[100957]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=100957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:16:48.172676 dv-cinder-818037-2-iscsi devstack@n-api.service[100958]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=100958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:16:48.172824 dv-cinder-818037-2-iscsi devstack@n-api.service[100957]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=100957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:16:48.173003 dv-cinder-818037-2-iscsi devstack@n-api.service[100958]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=100958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:16:48.173127 dv-cinder-818037-2-iscsi devstack@n-api.service[100957]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=100957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:16:48.173307 dv-cinder-818037-2-iscsi devstack@n-api.service[100958]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=100958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:16:48.173431 dv-cinder-818037-2-iscsi devstack@n-api.service[100957]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=100957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:16:48.173616 dv-cinder-818037-2-iscsi devstack@n-api.service[100958]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=100958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:16:48.173734 dv-cinder-818037-2-iscsi devstack@n-api.service[100957]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=100957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:16:48.173916 dv-cinder-818037-2-iscsi devstack@n-api.service[100958]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=100958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:16:48.174042 dv-cinder-818037-2-iscsi devstack@n-api.service[100957]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=100957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:16:48.174221 dv-cinder-818037-2-iscsi devstack@n-api.service[100957]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=100957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:16:48.174352 dv-cinder-818037-2-iscsi devstack@n-api.service[100958]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=100958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:16:48.174526 dv-cinder-818037-2-iscsi devstack@n-api.service[100958]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=100958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:16:48.174648 dv-cinder-818037-2-iscsi devstack@n-api.service[100957]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=100957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:16:48.174833 dv-cinder-818037-2-iscsi devstack@n-api.service[100958]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=100958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:16:48.174957 dv-cinder-818037-2-iscsi devstack@n-api.service[100957]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=100957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:16:48.175134 dv-cinder-818037-2-iscsi devstack@n-api.service[100957]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=100957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:16:48.175267 dv-cinder-818037-2-iscsi devstack@n-api.service[100958]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=100958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:16:48.175437 dv-cinder-818037-2-iscsi devstack@n-api.service[100958]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=100958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:16:48.175559 dv-cinder-818037-2-iscsi devstack@n-api.service[100957]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=100957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:16:48.175792 dv-cinder-818037-2-iscsi devstack@n-api.service[100958]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=100958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:16:48.175972 dv-cinder-818037-2-iscsi devstack@n-api.service[100957]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=100957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:16:48.176117 dv-cinder-818037-2-iscsi devstack@n-api.service[100958]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=100958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:16:48.176309 dv-cinder-818037-2-iscsi devstack@n-api.service[100957]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=100957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:16:48.176435 dv-cinder-818037-2-iscsi devstack@n-api.service[100958]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=100958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:16:48.176620 dv-cinder-818037-2-iscsi devstack@n-api.service[100957]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=100957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:16:48.176745 dv-cinder-818037-2-iscsi devstack@n-api.service[100958]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=100958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:16:48.176957 dv-cinder-818037-2-iscsi devstack@n-api.service[100957]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=100957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:16:48.177082 dv-cinder-818037-2-iscsi devstack@n-api.service[100958]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=100958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:16:48.177274 dv-cinder-818037-2-iscsi devstack@n-api.service[100957]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=100957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:16:48.177400 dv-cinder-818037-2-iscsi devstack@n-api.service[100958]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=100958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:16:48.177596 dv-cinder-818037-2-iscsi devstack@n-api.service[100957]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=100957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:16:48.177719 dv-cinder-818037-2-iscsi devstack@n-api.service[100958]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=100958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:16:48.177906 dv-cinder-818037-2-iscsi devstack@n-api.service[100957]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=100957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:16:48.178045 dv-cinder-818037-2-iscsi devstack@n-api.service[100958]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=100958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:16:48.178217 dv-cinder-818037-2-iscsi devstack@n-api.service[100957]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=100957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:16:48.178349 dv-cinder-818037-2-iscsi devstack@n-api.service[100958]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=100958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:16:48.178528 dv-cinder-818037-2-iscsi devstack@n-api.service[100957]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=100957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:16:48.178652 dv-cinder-818037-2-iscsi devstack@n-api.service[100958]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=100958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:16:48.178836 dv-cinder-818037-2-iscsi devstack@n-api.service[100957]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=100957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:16:48.178977 dv-cinder-818037-2-iscsi devstack@n-api.service[100958]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=100958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:16:48.179154 dv-cinder-818037-2-iscsi devstack@n-api.service[100957]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=100957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:16:48.179380 dv-cinder-818037-2-iscsi devstack@n-api.service[100958]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=100958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:16:48.179512 dv-cinder-818037-2-iscsi devstack@n-api.service[100957]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=100957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:16:48.179765 dv-cinder-818037-2-iscsi devstack@n-api.service[100958]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=100958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:16:48.179889 dv-cinder-818037-2-iscsi devstack@n-api.service[100957]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=100957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:16:48.180072 dv-cinder-818037-2-iscsi devstack@n-api.service[100957]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=100957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:16:48.180195 dv-cinder-818037-2-iscsi devstack@n-api.service[100958]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=100958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:16:48.180388 dv-cinder-818037-2-iscsi devstack@n-api.service[100957]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=100957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:16:48.180519 dv-cinder-818037-2-iscsi devstack@n-api.service[100958]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=100958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:16:48.180702 dv-cinder-818037-2-iscsi devstack@n-api.service[100957]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=100957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:16:48.180843 dv-cinder-818037-2-iscsi devstack@n-api.service[100958]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=100958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:16:48.181054 dv-cinder-818037-2-iscsi devstack@n-api.service[100958]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=100958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:16:48.181177 dv-cinder-818037-2-iscsi devstack@n-api.service[100957]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=100957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:16:48.181358 dv-cinder-818037-2-iscsi devstack@n-api.service[100958]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=100958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:16:48.181491 dv-cinder-818037-2-iscsi devstack@n-api.service[100957]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=100957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:16:48.181661 dv-cinder-818037-2-iscsi devstack@n-api.service[100958]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=100958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:16:48.182069 dv-cinder-818037-2-iscsi devstack@n-api.service[100957]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=100957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:16:48.182069 dv-cinder-818037-2-iscsi devstack@n-api.service[100957]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=100957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:16:48.182327 dv-cinder-818037-2-iscsi devstack@n-api.service[100958]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=100958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:16:48.182450 dv-cinder-818037-2-iscsi devstack@n-api.service[100957]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=100957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:16:48.182574 dv-cinder-818037-2-iscsi devstack@n-api.service[100958]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=100958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:16:48.182574 dv-cinder-818037-2-iscsi devstack@n-api.service[100958]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=100958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:16:48.182817 dv-cinder-818037-2-iscsi devstack@n-api.service[100957]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=100957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:16:48.182938 dv-cinder-818037-2-iscsi devstack@n-api.service[100958]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=100958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:16:48.183057 dv-cinder-818037-2-iscsi devstack@n-api.service[100957]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=100957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:16:48.183184 dv-cinder-818037-2-iscsi devstack@n-api.service[100958]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=100958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:16:48.183304 dv-cinder-818037-2-iscsi devstack@n-api.service[100957]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=100957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:16:48.183430 dv-cinder-818037-2-iscsi devstack@n-api.service[100958]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=100958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:16:48.183561 dv-cinder-818037-2-iscsi devstack@n-api.service[100957]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=100957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:16:48.183737 dv-cinder-818037-2-iscsi devstack@n-api.service[100958]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=100958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:16:48.184211 dv-cinder-818037-2-iscsi devstack@n-api.service[100957]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=100957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:16:48.184408 dv-cinder-818037-2-iscsi devstack@n-api.service[100958]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=100958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:16:48.184532 dv-cinder-818037-2-iscsi devstack@n-api.service[100957]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=100957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:16:48.184716 dv-cinder-818037-2-iscsi devstack@n-api.service[100958]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=100958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:16:48.184895 dv-cinder-818037-2-iscsi devstack@n-api.service[100957]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=100957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:16:48.185052 dv-cinder-818037-2-iscsi devstack@n-api.service[100958]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=100958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:16:48.185331 dv-cinder-818037-2-iscsi devstack@n-api.service[100957]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=100957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:16:48.185456 dv-cinder-818037-2-iscsi devstack@n-api.service[100958]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=100958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:16:48.185694 dv-cinder-818037-2-iscsi devstack@n-api.service[100958]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=100958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:16:48.185826 dv-cinder-818037-2-iscsi devstack@n-api.service[100957]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=100957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:16:48.186011 dv-cinder-818037-2-iscsi devstack@n-api.service[100958]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=100958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:16:48.186137 dv-cinder-818037-2-iscsi devstack@n-api.service[100957]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=100957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:16:48.186324 dv-cinder-818037-2-iscsi devstack@n-api.service[100958]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=100958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:16:48.186449 dv-cinder-818037-2-iscsi devstack@n-api.service[100957]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=100957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:16:48.186637 dv-cinder-818037-2-iscsi devstack@n-api.service[100958]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=100958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:16:48.186770 dv-cinder-818037-2-iscsi devstack@n-api.service[100957]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=100957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:16:48.186948 dv-cinder-818037-2-iscsi devstack@n-api.service[100958]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=100958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:16:48.187072 dv-cinder-818037-2-iscsi devstack@n-api.service[100957]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=100957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:16:48.187260 dv-cinder-818037-2-iscsi devstack@n-api.service[100958]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=100958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:16:48.187384 dv-cinder-818037-2-iscsi devstack@n-api.service[100957]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=100957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:16:48.187567 dv-cinder-818037-2-iscsi devstack@n-api.service[100958]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=100958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:16:48.187700 dv-cinder-818037-2-iscsi devstack@n-api.service[100957]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=100957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:16:48.187873 dv-cinder-818037-2-iscsi devstack@n-api.service[100958]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=100958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:16:48.187998 dv-cinder-818037-2-iscsi devstack@n-api.service[100957]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=100957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:16:48.188185 dv-cinder-818037-2-iscsi devstack@n-api.service[100958]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=100958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:16:48.188310 dv-cinder-818037-2-iscsi devstack@n-api.service[100957]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=100957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:16:48.188517 dv-cinder-818037-2-iscsi devstack@n-api.service[100958]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=100958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:16:48.188644 dv-cinder-818037-2-iscsi devstack@n-api.service[100957]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=100957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:16:48.188849 dv-cinder-818037-2-iscsi devstack@n-api.service[100958]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=100958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:16:48.188976 dv-cinder-818037-2-iscsi devstack@n-api.service[100957]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=100957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:16:48.189155 dv-cinder-818037-2-iscsi devstack@n-api.service[100958]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=100958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:16:48.189279 dv-cinder-818037-2-iscsi devstack@n-api.service[100957]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=100957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:16:48.189467 dv-cinder-818037-2-iscsi devstack@n-api.service[100957]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=100957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:16:48.189591 dv-cinder-818037-2-iscsi devstack@n-api.service[100958]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=100958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:16:48.189786 dv-cinder-818037-2-iscsi devstack@n-api.service[100957]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=100957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:16:48.189919 dv-cinder-818037-2-iscsi devstack@n-api.service[100958]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=100958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:16:48.190102 dv-cinder-818037-2-iscsi devstack@n-api.service[100957]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=100957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:16:48.190234 dv-cinder-818037-2-iscsi devstack@n-api.service[100958]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=100958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:16:48.190430 dv-cinder-818037-2-iscsi devstack@n-api.service[100957]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=100957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:16:48.190554 dv-cinder-818037-2-iscsi devstack@n-api.service[100958]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=100958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:16:48.190717 dv-cinder-818037-2-iscsi devstack@n-api.service[100957]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=100957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:16:48.190842 dv-cinder-818037-2-iscsi devstack@n-api.service[100958]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=100958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:16:48.191063 dv-cinder-818037-2-iscsi devstack@n-api.service[100957]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=100957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:16:48.191222 dv-cinder-818037-2-iscsi devstack@n-api.service[100958]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=100958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:16:48.191416 dv-cinder-818037-2-iscsi devstack@n-api.service[100957]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=100957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:16:48.191540 dv-cinder-818037-2-iscsi devstack@n-api.service[100958]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=100958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:16:48.191741 dv-cinder-818037-2-iscsi devstack@n-api.service[100958]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=100958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:16:48.191869 dv-cinder-818037-2-iscsi devstack@n-api.service[100957]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=100957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:16:48.192058 dv-cinder-818037-2-iscsi devstack@n-api.service[100957]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=100957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:16:48.192189 dv-cinder-818037-2-iscsi devstack@n-api.service[100958]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=100958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:16:48.192365 dv-cinder-818037-2-iscsi devstack@n-api.service[100958]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=100958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:16:48.192495 dv-cinder-818037-2-iscsi devstack@n-api.service[100957]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=100957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:16:48.192678 dv-cinder-818037-2-iscsi devstack@n-api.service[100957]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=100957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:16:48.192824 dv-cinder-818037-2-iscsi devstack@n-api.service[100958]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=100958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:16:48.193019 dv-cinder-818037-2-iscsi devstack@n-api.service[100957]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=100957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:16:48.193154 dv-cinder-818037-2-iscsi devstack@n-api.service[100958]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=100958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:16:48.193333 dv-cinder-818037-2-iscsi devstack@n-api.service[100957]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=100957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:16:48.193458 dv-cinder-818037-2-iscsi devstack@n-api.service[100958]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=100958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:16:48.193647 dv-cinder-818037-2-iscsi devstack@n-api.service[100957]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=100957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:16:48.193771 dv-cinder-818037-2-iscsi devstack@n-api.service[100958]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=100958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:16:48.193961 dv-cinder-818037-2-iscsi devstack@n-api.service[100958]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=100958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:16:48.194098 dv-cinder-818037-2-iscsi devstack@n-api.service[100957]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=100957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:16:48.194268 dv-cinder-818037-2-iscsi devstack@n-api.service[100958]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=100958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:16:48.194400 dv-cinder-818037-2-iscsi devstack@n-api.service[100957]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=100957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:16:48.194578 dv-cinder-818037-2-iscsi devstack@n-api.service[100958]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=100958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:16:48.194703 dv-cinder-818037-2-iscsi devstack@n-api.service[100957]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=100957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:16:48.194887 dv-cinder-818037-2-iscsi devstack@n-api.service[100958]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=100958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:16:48.195020 dv-cinder-818037-2-iscsi devstack@n-api.service[100957]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=100957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:16:48.195223 dv-cinder-818037-2-iscsi devstack@n-api.service[100958]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=100958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:16:48.195348 dv-cinder-818037-2-iscsi devstack@n-api.service[100957]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=100957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:16:48.195536 dv-cinder-818037-2-iscsi devstack@n-api.service[100958]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=100958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:16:48.195668 dv-cinder-818037-2-iscsi devstack@n-api.service[100957]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=100957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:16:48.195859 dv-cinder-818037-2-iscsi devstack@n-api.service[100958]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=100958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:16:48.195984 dv-cinder-818037-2-iscsi devstack@n-api.service[100957]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=100957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:16:48.196168 dv-cinder-818037-2-iscsi devstack@n-api.service[100958]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=100958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:16:48.196292 dv-cinder-818037-2-iscsi devstack@n-api.service[100957]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=100957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:16:48.196490 dv-cinder-818037-2-iscsi devstack@n-api.service[100958]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=100958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:16:48.196621 dv-cinder-818037-2-iscsi devstack@n-api.service[100957]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=100957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:16:48.196811 dv-cinder-818037-2-iscsi devstack@n-api.service[100958]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=100958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:16:48.196939 dv-cinder-818037-2-iscsi devstack@n-api.service[100957]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=100957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:16:48.197138 dv-cinder-818037-2-iscsi devstack@n-api.service[100958]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=100958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:16:48.197263 dv-cinder-818037-2-iscsi devstack@n-api.service[100957]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=100957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:16:48.197461 dv-cinder-818037-2-iscsi devstack@n-api.service[100958]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=100958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:16:48.197601 dv-cinder-818037-2-iscsi devstack@n-api.service[100957]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=100957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:16:48.197777 dv-cinder-818037-2-iscsi devstack@n-api.service[100958]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=100958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:16:48.197902 dv-cinder-818037-2-iscsi devstack@n-api.service[100957]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=100957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:16:48.198086 dv-cinder-818037-2-iscsi devstack@n-api.service[100958]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=100958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:16:48.198212 dv-cinder-818037-2-iscsi devstack@n-api.service[100957]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=100957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:16:48.198419 dv-cinder-818037-2-iscsi devstack@n-api.service[100957]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=100957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:16:48.198550 dv-cinder-818037-2-iscsi devstack@n-api.service[100958]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=100958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:16:48.198725 dv-cinder-818037-2-iscsi devstack@n-api.service[100958]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=100958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:16:48.198848 dv-cinder-818037-2-iscsi devstack@n-api.service[100957]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=100957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:16:48.199035 dv-cinder-818037-2-iscsi devstack@n-api.service[100958]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=100958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:16:48.199166 dv-cinder-818037-2-iscsi devstack@n-api.service[100957]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=100957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:16:48.199345 dv-cinder-818037-2-iscsi devstack@n-api.service[100958]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=100958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:16:48.199482 dv-cinder-818037-2-iscsi devstack@n-api.service[100957]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=100957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:16:48.199655 dv-cinder-818037-2-iscsi devstack@n-api.service[100958]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=100958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:16:48.199780 dv-cinder-818037-2-iscsi devstack@n-api.service[100957]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=100957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:16:48.199961 dv-cinder-818037-2-iscsi devstack@n-api.service[100958]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=100958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:16:48.200087 dv-cinder-818037-2-iscsi devstack@n-api.service[100957]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=100957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:16:48.200270 dv-cinder-818037-2-iscsi devstack@n-api.service[100958]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=100958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:16:48.200396 dv-cinder-818037-2-iscsi devstack@n-api.service[100957]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=100957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:16:48.200580 dv-cinder-818037-2-iscsi devstack@n-api.service[100957]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=100957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:16:48.200702 dv-cinder-818037-2-iscsi devstack@n-api.service[100958]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 2 {{(pid=100958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:16:48.200933 dv-cinder-818037-2-iscsi devstack@n-api.service[100958]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=100958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:16:48.201051 dv-cinder-818037-2-iscsi devstack@n-api.service[100957]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=100957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:16:48.201237 dv-cinder-818037-2-iscsi devstack@n-api.service[100958]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=100958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:16:48.201371 dv-cinder-818037-2-iscsi devstack@n-api.service[100957]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=100957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:16:48.201560 dv-cinder-818037-2-iscsi devstack@n-api.service[100958]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=100958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:16:48.201693 dv-cinder-818037-2-iscsi devstack@n-api.service[100957]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=100957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:16:48.201871 dv-cinder-818037-2-iscsi devstack@n-api.service[100957]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=100957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:16:48.202002 dv-cinder-818037-2-iscsi devstack@n-api.service[100958]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=100958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:16:48.202188 dv-cinder-818037-2-iscsi devstack@n-api.service[100958]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=100958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:16:48.202312 dv-cinder-818037-2-iscsi devstack@n-api.service[100957]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=100957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:16:48.202501 dv-cinder-818037-2-iscsi devstack@n-api.service[100957]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=100957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:16:48.202631 dv-cinder-818037-2-iscsi devstack@n-api.service[100958]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=100958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:16:48.202804 dv-cinder-818037-2-iscsi devstack@n-api.service[100958]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=100958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:16:48.202940 dv-cinder-818037-2-iscsi devstack@n-api.service[100957]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=100957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:16:48.203132 dv-cinder-818037-2-iscsi devstack@n-api.service[100958]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=100958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:16:48.203256 dv-cinder-818037-2-iscsi devstack@n-api.service[100957]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=100957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:16:48.203443 dv-cinder-818037-2-iscsi devstack@n-api.service[100958]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=100958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:16:48.203571 dv-cinder-818037-2-iscsi devstack@n-api.service[100957]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=100957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:16:48.203756 dv-cinder-818037-2-iscsi devstack@n-api.service[100957]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=100957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:16:48.203889 dv-cinder-818037-2-iscsi devstack@n-api.service[100958]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=100958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:16:48.204060 dv-cinder-818037-2-iscsi devstack@n-api.service[100958]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=100958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:16:48.204183 dv-cinder-818037-2-iscsi devstack@n-api.service[100957]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=100957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:16:48.204374 dv-cinder-818037-2-iscsi devstack@n-api.service[100958]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=100958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:16:48.204506 dv-cinder-818037-2-iscsi devstack@n-api.service[100957]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=100957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:16:48.204691 dv-cinder-818037-2-iscsi devstack@n-api.service[100958]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=100958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:16:48.204854 dv-cinder-818037-2-iscsi devstack@n-api.service[100957]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=100957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:16:48.205028 dv-cinder-818037-2-iscsi devstack@n-api.service[100957]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=100957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:16:48.205150 dv-cinder-818037-2-iscsi devstack@n-api.service[100958]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=100958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:16:48.205346 dv-cinder-818037-2-iscsi devstack@n-api.service[100957]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=100957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:16:48.205473 dv-cinder-818037-2-iscsi devstack@n-api.service[100958]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=100958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:16:48.205660 dv-cinder-818037-2-iscsi devstack@n-api.service[100957]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=100957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:16:48.205798 dv-cinder-818037-2-iscsi devstack@n-api.service[100958]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=100958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:16:48.205977 dv-cinder-818037-2-iscsi devstack@n-api.service[100957]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=100957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:16:48.206102 dv-cinder-818037-2-iscsi devstack@n-api.service[100958]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=100958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:16:48.206292 dv-cinder-818037-2-iscsi devstack@n-api.service[100957]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 2 {{(pid=100957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:16:48.206416 dv-cinder-818037-2-iscsi devstack@n-api.service[100958]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=100958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:16:48.206632 dv-cinder-818037-2-iscsi devstack@n-api.service[100957]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=100957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:16:48.206760 dv-cinder-818037-2-iscsi devstack@n-api.service[100958]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=100958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:16:48.206995 dv-cinder-818037-2-iscsi devstack@n-api.service[100957]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=100957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:16:48.207153 dv-cinder-818037-2-iscsi devstack@n-api.service[100958]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=100958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:16:48.207328 dv-cinder-818037-2-iscsi devstack@n-api.service[100957]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=100957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:16:48.207483 dv-cinder-818037-2-iscsi devstack@n-api.service[100958]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=100958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:16:48.207650 dv-cinder-818037-2-iscsi devstack@n-api.service[100957]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=100957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:16:48.207798 dv-cinder-818037-2-iscsi devstack@n-api.service[100958]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=100958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:16:48.207975 dv-cinder-818037-2-iscsi devstack@n-api.service[100957]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=100957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:16:48.208101 dv-cinder-818037-2-iscsi devstack@n-api.service[100958]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=100958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:16:48.208300 dv-cinder-818037-2-iscsi devstack@n-api.service[100957]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=100957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:16:48.208430 dv-cinder-818037-2-iscsi devstack@n-api.service[100958]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=100958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:16:48.208615 dv-cinder-818037-2-iscsi devstack@n-api.service[100957]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=100957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:16:48.208749 dv-cinder-818037-2-iscsi devstack@n-api.service[100958]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=100958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:16:48.208947 dv-cinder-818037-2-iscsi devstack@n-api.service[100958]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=100958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Nov 17 03:16:48.209082 dv-cinder-818037-2-iscsi devstack@n-api.service[100957]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=100957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:16:48.209279 dv-cinder-818037-2-iscsi devstack@n-api.service[100957]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=100957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:16:48.209600 dv-cinder-818037-2-iscsi devstack@n-api.service[100957]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=100957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:16:48.209912 dv-cinder-818037-2-iscsi devstack@n-api.service[100957]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=100957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:16:48.210226 dv-cinder-818037-2-iscsi devstack@n-api.service[100957]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=100957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:16:48.210545 dv-cinder-818037-2-iscsi devstack@n-api.service[100957]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=100957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:16:48.210866 dv-cinder-818037-2-iscsi devstack@n-api.service[100957]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=100957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:16:48.211198 dv-cinder-818037-2-iscsi devstack@n-api.service[100957]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=100957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:16:48.211579 dv-cinder-818037-2-iscsi devstack@n-api.service[100957]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=100957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:16:48.211864 dv-cinder-818037-2-iscsi devstack@n-api.service[100957]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=100957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:16:48.212196 dv-cinder-818037-2-iscsi devstack@n-api.service[100957]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=100957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:16:48.212546 dv-cinder-818037-2-iscsi devstack@n-api.service[100957]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=100957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:16:48.212889 dv-cinder-818037-2-iscsi devstack@n-api.service[100957]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=100957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:16:48.213241 dv-cinder-818037-2-iscsi devstack@n-api.service[100957]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=100957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:16:48.213573 dv-cinder-818037-2-iscsi devstack@n-api.service[100957]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=100957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:16:48.213894 dv-cinder-818037-2-iscsi devstack@n-api.service[100957]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=100957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:16:48.214211 dv-cinder-818037-2-iscsi devstack@n-api.service[100957]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=100957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:16:48.214567 dv-cinder-818037-2-iscsi devstack@n-api.service[100957]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=100957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:16:48.214761 dv-cinder-818037-2-iscsi devstack@n-api.service[100957]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=100957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Nov 17 03:16:48.232484 dv-cinder-818037-2-iscsi devstack@n-api.service[100958]: DEBUG oslo_db.sqlalchemy.engines [None req-2a29ad94-0b4d-4248-a074-dbccea3f7ea4 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=100958) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Nov 17 03:16:48.237335 dv-cinder-818037-2-iscsi devstack@n-api.service[100957]: DEBUG oslo_db.sqlalchemy.engines [None req-ee01a6d7-082f-4252-be54-3a2259048ebf None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=100957) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Nov 17 03:16:48.299770 dv-cinder-818037-2-iscsi devstack@n-api.service[100958]: DEBUG nova.context [None req-2a29ad94-0b4d-4248-a074-dbccea3f7ea4 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),8d6d2374-cf51-40eb-9f65-96e5f5e4c457(cell1) {{(pid=100958) load_cells /opt/stack/nova/nova/context.py:464}} Nov 17 03:16:48.304376 dv-cinder-818037-2-iscsi devstack@n-api.service[100958]: DEBUG oslo_concurrency.lockutils [None req-2a29ad94-0b4d-4248-a074-dbccea3f7ea4 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:16:48.305760 dv-cinder-818037-2-iscsi devstack@n-api.service[100957]: DEBUG nova.context [None req-ee01a6d7-082f-4252-be54-3a2259048ebf None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),8d6d2374-cf51-40eb-9f65-96e5f5e4c457(cell1) {{(pid=100957) load_cells /opt/stack/nova/nova/context.py:464}} Nov 17 03:16:48.306001 dv-cinder-818037-2-iscsi devstack@n-api.service[100958]: DEBUG oslo_concurrency.lockutils [None req-2a29ad94-0b4d-4248-a074-dbccea3f7ea4 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=100958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:16:48.306830 dv-cinder-818037-2-iscsi devstack@n-api.service[100958]: DEBUG oslo_concurrency.lockutils [None req-2a29ad94-0b4d-4248-a074-dbccea3f7ea4 None None] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:16:48.308747 dv-cinder-818037-2-iscsi devstack@n-api.service[100958]: DEBUG oslo_concurrency.lockutils [None req-2a29ad94-0b4d-4248-a074-dbccea3f7ea4 None None] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=100958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:16:48.310362 dv-cinder-818037-2-iscsi devstack@n-api.service[100957]: DEBUG oslo_concurrency.lockutils [None req-ee01a6d7-082f-4252-be54-3a2259048ebf None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:16:48.311953 dv-cinder-818037-2-iscsi devstack@n-api.service[100957]: DEBUG oslo_concurrency.lockutils [None req-ee01a6d7-082f-4252-be54-3a2259048ebf None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=100957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:16:48.312817 dv-cinder-818037-2-iscsi devstack@n-api.service[100957]: DEBUG oslo_concurrency.lockutils [None req-ee01a6d7-082f-4252-be54-3a2259048ebf None None] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:16:48.314753 dv-cinder-818037-2-iscsi devstack@n-api.service[100957]: DEBUG oslo_concurrency.lockutils [None req-ee01a6d7-082f-4252-be54-3a2259048ebf None None] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=100957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:16:48.320093 dv-cinder-818037-2-iscsi devstack@n-api.service[100958]: DEBUG oslo_db.sqlalchemy.engines [None req-2a29ad94-0b4d-4248-a074-dbccea3f7ea4 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=100958) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Nov 17 03:16:48.324815 dv-cinder-818037-2-iscsi devstack@n-api.service[100958]: DEBUG oslo_db.sqlalchemy.engines [None req-2a29ad94-0b4d-4248-a074-dbccea3f7ea4 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=100958) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Nov 17 03:16:48.328701 dv-cinder-818037-2-iscsi devstack@n-api.service[100957]: DEBUG oslo_db.sqlalchemy.engines [None req-ee01a6d7-082f-4252-be54-3a2259048ebf None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=100957) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Nov 17 03:16:48.333521 dv-cinder-818037-2-iscsi devstack@n-api.service[100957]: DEBUG oslo_db.sqlalchemy.engines [None req-ee01a6d7-082f-4252-be54-3a2259048ebf None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=100957) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Nov 17 03:16:48.583632 dv-cinder-818037-2-iscsi devstack@n-api.service[100958]: DEBUG oslo_db.sqlalchemy.engines [None req-2a29ad94-0b4d-4248-a074-dbccea3f7ea4 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=100958) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Nov 17 03:16:48.590867 dv-cinder-818037-2-iscsi devstack@n-api.service[100957]: DEBUG oslo_db.sqlalchemy.engines [None req-ee01a6d7-082f-4252-be54-3a2259048ebf None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=100957) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Nov 17 03:16:48.926256 dv-cinder-818037-2-iscsi devstack@n-api.service[100958]: WARNING keystonemiddleware.auth_token [None req-2a29ad94-0b4d-4248-a074-dbccea3f7ea4 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Nov 17 03:16:48.932514 dv-cinder-818037-2-iscsi devstack@n-api.service[100957]: WARNING keystonemiddleware.auth_token [None req-ee01a6d7-082f-4252-be54-3a2259048ebf None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Nov 17 03:16:48.932650 dv-cinder-818037-2-iscsi devstack@n-api.service[100958]: WARNING keystonemiddleware.auth_token [None req-2a29ad94-0b4d-4248-a074-dbccea3f7ea4 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Nov 17 03:16:48.939423 dv-cinder-818037-2-iscsi devstack@n-api.service[100957]: WARNING keystonemiddleware.auth_token [None req-ee01a6d7-082f-4252-be54-3a2259048ebf None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Nov 17 03:16:49.150932 dv-cinder-818037-2-iscsi devstack@n-api.service[100958]: WARNING keystonemiddleware.auth_token [None req-2a29ad94-0b4d-4248-a074-dbccea3f7ea4 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Nov 17 03:16:49.156103 dv-cinder-818037-2-iscsi devstack@n-api.service[100958]: WARNING keystonemiddleware.auth_token [None req-2a29ad94-0b4d-4248-a074-dbccea3f7ea4 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Nov 17 03:16:49.161506 dv-cinder-818037-2-iscsi devstack@n-api.service[100958]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x564d535119c0 pid: 100958 (default app) Nov 17 03:16:49.162305 dv-cinder-818037-2-iscsi devstack@n-api.service[100957]: WARNING keystonemiddleware.auth_token [None req-ee01a6d7-082f-4252-be54-3a2259048ebf None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Nov 17 03:16:49.163559 dv-cinder-818037-2-iscsi devstack@n-api.service[100958]: DEBUG nova.api.openstack.wsgi [None req-2a29ad94-0b4d-4248-a074-dbccea3f7ea4 None None] Calling method '>' {{(pid=100958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:16:49.164733 dv-cinder-818037-2-iscsi devstack@n-api.service[100958]: INFO nova.api.openstack.requestlog [None req-2a29ad94-0b4d-4248-a074-dbccea3f7ea4 None None] 10.222.0.11 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.001719 Nov 17 03:16:49.165172 dv-cinder-818037-2-iscsi devstack@n-api.service[100958]: [pid: 100958|app: 0|req: 1/1] 10.222.0.11 () {50 vars in 788 bytes} [Wed Nov 17 03:16:49 2021] GET /compute/v2.1/ => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 17 03:16:49.167523 dv-cinder-818037-2-iscsi devstack@n-api.service[100957]: WARNING keystonemiddleware.auth_token [None req-ee01a6d7-082f-4252-be54-3a2259048ebf None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Nov 17 03:16:49.172819 dv-cinder-818037-2-iscsi devstack@n-api.service[100957]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x564d535119c0 pid: 100957 (default app) Nov 17 03:18:09.941283 dv-cinder-818037-2-iscsi devstack@n-api.service[100958]: DEBUG nova.api.openstack.wsgi [None req-2a29ad94-0b4d-4248-a074-dbccea3f7ea4 None None] Calling method '>' {{(pid=100958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:18:09.942297 dv-cinder-818037-2-iscsi devstack@n-api.service[100958]: INFO nova.api.openstack.requestlog [None req-2a29ad94-0b4d-4248-a074-dbccea3f7ea4 None None] 10.222.0.11 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001495 Nov 17 03:18:09.942702 dv-cinder-818037-2-iscsi devstack@n-api.service[100958]: [pid: 100958|app: 0|req: 2/2] 10.222.0.11 () {54 vars in 930 bytes} [Wed Nov 17 03:18:09 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 17 03:18:10.513190 dv-cinder-818037-2-iscsi devstack@n-api.service[100957]: DEBUG nova.api.openstack.wsgi [None req-87cd9fc8-d01c-4abd-87f0-97043faa01a3 admin admin] Calling method '>' {{(pid=100957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:18:10.542659 dv-cinder-818037-2-iscsi devstack@n-api.service[100957]: INFO nova.api.openstack.requestlog [None req-87cd9fc8-d01c-4abd-87f0-97043faa01a3 admin admin] 10.222.0.11 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 0.592736 Nov 17 03:18:10.553049 dv-cinder-818037-2-iscsi devstack@n-api.service[100957]: [pid: 100957|app: 0|req: 1/3] 10.222.0.11 () {60 vars in 1291 bytes} [Wed Nov 17 03:18:09 2021] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 595 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:18:12.976653 dv-cinder-818037-2-iscsi devstack@n-api.service[100958]: DEBUG nova.api.openstack.wsgi [None req-2a29ad94-0b4d-4248-a074-dbccea3f7ea4 None None] Calling method '>' {{(pid=100958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:18:12.977688 dv-cinder-818037-2-iscsi devstack@n-api.service[100958]: INFO nova.api.openstack.requestlog [None req-2a29ad94-0b4d-4248-a074-dbccea3f7ea4 None None] 10.222.0.11 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001479 Nov 17 03:18:12.978290 dv-cinder-818037-2-iscsi devstack@n-api.service[100958]: [pid: 100958|app: 0|req: 3/4] 10.222.0.11 () {54 vars in 930 bytes} [Wed Nov 17 03:18:12 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 17 03:18:13.039154 dv-cinder-818037-2-iscsi devstack@n-api.service[100957]: DEBUG nova.api.openstack.wsgi [None req-e43547d4-213c-4aee-9c2a-63e2517213c2 admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "ram": 256, "rxtx_factor": 1.0, "vcpus": 1, "name": "cirros256", "id": "c1", "swap": 0, "disk": 1, "os-flavor-access:is_public": true}} {{(pid=100957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 17 03:18:13.057957 dv-cinder-818037-2-iscsi devstack@n-api.service[100957]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-flavor-manage:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 17 03:18:13.057957 dv-cinder-818037-2-iscsi devstack@n-api.service[100957]: warnings.warn(msg) Nov 17 03:18:13.095998 dv-cinder-818037-2-iscsi devstack@n-api.service[100957]: INFO nova.api.openstack.requestlog [None req-e43547d4-213c-4aee-9c2a-63e2517213c2 admin admin] 10.222.0.11 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.110752 Nov 17 03:18:13.104328 dv-cinder-818037-2-iscsi devstack@n-api.service[100957]: [pid: 100957|app: 0|req: 2/5] 10.222.0.11 () {64 vars in 1282 bytes} [Wed Nov 17 03:18:12 2021] POST /compute/v2.1/flavors => generated 407 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 17 03:18:13.484947 dv-cinder-818037-2-iscsi devstack@n-api.service[100958]: DEBUG nova.api.openstack.wsgi [None req-f1fbad1c-87c5-41db-b69a-3443077d98de admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=100958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 17 03:18:13.487422 dv-cinder-818037-2-iscsi devstack@n-api.service[100958]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-flavor-extra-specs:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 17 03:18:13.487422 dv-cinder-818037-2-iscsi devstack@n-api.service[100958]: warnings.warn(msg) Nov 17 03:18:13.536643 dv-cinder-818037-2-iscsi devstack@n-api.service[100958]: INFO nova.api.openstack.requestlog [None req-f1fbad1c-87c5-41db-b69a-3443077d98de admin admin] 10.222.0.11 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.431151 Nov 17 03:18:13.537519 dv-cinder-818037-2-iscsi devstack@n-api.service[100958]: [pid: 100958|app: 0|req: 4/6] 10.222.0.11 () {64 vars in 1335 bytes} [Wed Nov 17 03:18:13 2021] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 17 03:18:15.859221 dv-cinder-818037-2-iscsi devstack@n-api.service[100957]: DEBUG nova.api.openstack.wsgi [None req-e43547d4-213c-4aee-9c2a-63e2517213c2 admin admin] Calling method '>' {{(pid=100957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:18:15.860249 dv-cinder-818037-2-iscsi devstack@n-api.service[100957]: INFO nova.api.openstack.requestlog [None req-e43547d4-213c-4aee-9c2a-63e2517213c2 admin admin] 10.222.0.11 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001503 Nov 17 03:18:15.861215 dv-cinder-818037-2-iscsi devstack@n-api.service[100957]: [pid: 100957|app: 0|req: 3/7] 10.222.0.11 () {54 vars in 930 bytes} [Wed Nov 17 03:18:15 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 17 03:18:15.971401 dv-cinder-818037-2-iscsi devstack@n-api.service[100958]: DEBUG nova.api.openstack.wsgi [None req-5ec5675b-c61c-48bd-8f62-c660bb01c9da admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "rxtx_factor": 1.0, "disk": 5, "vcpus": 1, "ram": 512, "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "name": "ds512M", "id": "d1"}} {{(pid=100958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 17 03:18:15.988947 dv-cinder-818037-2-iscsi devstack@n-api.service[100958]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-flavor-manage:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 17 03:18:15.988947 dv-cinder-818037-2-iscsi devstack@n-api.service[100958]: warnings.warn(msg) Nov 17 03:18:16.010165 dv-cinder-818037-2-iscsi devstack@n-api.service[100958]: INFO nova.api.openstack.requestlog [None req-5ec5675b-c61c-48bd-8f62-c660bb01c9da admin admin] 10.222.0.11 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.141917 Nov 17 03:18:16.020458 dv-cinder-818037-2-iscsi devstack@n-api.service[100958]: [pid: 100958|app: 0|req: 5/8] 10.222.0.11 () {64 vars in 1282 bytes} [Wed Nov 17 03:18:15 2021] POST /compute/v2.1/flavors => generated 404 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 17 03:18:16.026738 dv-cinder-818037-2-iscsi devstack@n-api.service[100957]: DEBUG nova.api.openstack.wsgi [None req-ab868e2a-2c41-42cc-a353-94250a4f1758 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=100957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 17 03:18:16.028529 dv-cinder-818037-2-iscsi devstack@n-api.service[100957]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-flavor-extra-specs:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 17 03:18:16.028529 dv-cinder-818037-2-iscsi devstack@n-api.service[100957]: warnings.warn(msg) Nov 17 03:18:16.069240 dv-cinder-818037-2-iscsi devstack@n-api.service[100957]: INFO nova.api.openstack.requestlog [None req-ab868e2a-2c41-42cc-a353-94250a4f1758 admin admin] 10.222.0.11 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.046643 Nov 17 03:18:16.070637 dv-cinder-818037-2-iscsi devstack@n-api.service[100957]: [pid: 100957|app: 0|req: 4/9] 10.222.0.11 () {64 vars in 1335 bytes} [Wed Nov 17 03:18:16 2021] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:18:18.354261 dv-cinder-818037-2-iscsi devstack@n-api.service[100958]: DEBUG nova.api.openstack.wsgi [None req-5ec5675b-c61c-48bd-8f62-c660bb01c9da admin admin] Calling method '>' {{(pid=100958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:18:18.355469 dv-cinder-818037-2-iscsi devstack@n-api.service[100958]: INFO nova.api.openstack.requestlog [None req-5ec5675b-c61c-48bd-8f62-c660bb01c9da admin admin] 10.222.0.11 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001671 Nov 17 03:18:18.356321 dv-cinder-818037-2-iscsi devstack@n-api.service[100958]: [pid: 100958|app: 0|req: 6/10] 10.222.0.11 () {54 vars in 930 bytes} [Wed Nov 17 03:18:18 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 17 03:18:18.423358 dv-cinder-818037-2-iscsi devstack@n-api.service[100957]: DEBUG nova.api.openstack.wsgi [None req-8cef0623-dfd7-481f-bc72-a74dc8594b7a admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "name": "ds1G", "ram": 1024, "vcpus": 1, "swap": 0, "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "disk": 10, "id": "d2"}} {{(pid=100957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 17 03:18:18.447713 dv-cinder-818037-2-iscsi devstack@n-api.service[100957]: INFO nova.api.openstack.requestlog [None req-8cef0623-dfd7-481f-bc72-a74dc8594b7a admin admin] 10.222.0.11 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.084826 Nov 17 03:18:18.457312 dv-cinder-818037-2-iscsi devstack@n-api.service[100957]: [pid: 100957|app: 0|req: 5/11] 10.222.0.11 () {64 vars in 1282 bytes} [Wed Nov 17 03:18:18 2021] POST /compute/v2.1/flavors => generated 404 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 17 03:18:18.461965 dv-cinder-818037-2-iscsi devstack@n-api.service[100958]: DEBUG nova.api.openstack.wsgi [None req-281aa760-7940-4f42-82e8-08eaf7d4b34c admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=100958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 17 03:18:18.497737 dv-cinder-818037-2-iscsi devstack@n-api.service[100958]: INFO nova.api.openstack.requestlog [None req-281aa760-7940-4f42-82e8-08eaf7d4b34c admin admin] 10.222.0.11 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.039840 Nov 17 03:18:18.498991 dv-cinder-818037-2-iscsi devstack@n-api.service[100958]: [pid: 100958|app: 0|req: 7/12] 10.222.0.11 () {64 vars in 1335 bytes} [Wed Nov 17 03:18:18 2021] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 17 03:18:20.874917 dv-cinder-818037-2-iscsi devstack@n-api.service[100957]: DEBUG nova.api.openstack.wsgi [None req-8cef0623-dfd7-481f-bc72-a74dc8594b7a admin admin] Calling method '>' {{(pid=100957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:18:20.875925 dv-cinder-818037-2-iscsi devstack@n-api.service[100957]: INFO nova.api.openstack.requestlog [None req-8cef0623-dfd7-481f-bc72-a74dc8594b7a admin admin] 10.222.0.11 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001459 Nov 17 03:18:20.876328 dv-cinder-818037-2-iscsi devstack@n-api.service[100957]: [pid: 100957|app: 0|req: 6/13] 10.222.0.11 () {54 vars in 930 bytes} [Wed Nov 17 03:18:20 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 17 03:18:20.937074 dv-cinder-818037-2-iscsi devstack@n-api.service[100958]: DEBUG nova.api.openstack.wsgi [None req-162321af-f1e9-463e-8e47-6a2b7b53ec3b admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 2048, "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 2, "name": "ds2G", "disk": 10, "os-flavor-access:is_public": true, "id": "d3", "rxtx_factor": 1.0}} {{(pid=100958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 17 03:18:20.955940 dv-cinder-818037-2-iscsi devstack@n-api.service[100958]: INFO nova.api.openstack.requestlog [None req-162321af-f1e9-463e-8e47-6a2b7b53ec3b admin admin] 10.222.0.11 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.072811 Nov 17 03:18:20.956487 dv-cinder-818037-2-iscsi devstack@n-api.service[100958]: [pid: 100958|app: 0|req: 8/14] 10.222.0.11 () {64 vars in 1282 bytes} [Wed Nov 17 03:18:20 2021] POST /compute/v2.1/flavors => generated 404 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 17 03:18:20.968842 dv-cinder-818037-2-iscsi devstack@n-api.service[100957]: DEBUG nova.api.openstack.wsgi [None req-7f3c4085-ba4f-4ee4-a1a8-918588a24f5a admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=100957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 17 03:18:20.991811 dv-cinder-818037-2-iscsi devstack@n-api.service[100957]: INFO nova.api.openstack.requestlog [None req-7f3c4085-ba4f-4ee4-a1a8-918588a24f5a admin admin] 10.222.0.11 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.026618 Nov 17 03:18:20.992392 dv-cinder-818037-2-iscsi devstack@n-api.service[100957]: [pid: 100957|app: 0|req: 7/15] 10.222.0.11 () {64 vars in 1335 bytes} [Wed Nov 17 03:18:20 2021] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 17 03:18:23.344362 dv-cinder-818037-2-iscsi devstack@n-api.service[100958]: DEBUG nova.api.openstack.wsgi [None req-162321af-f1e9-463e-8e47-6a2b7b53ec3b admin admin] Calling method '>' {{(pid=100958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:18:23.345424 dv-cinder-818037-2-iscsi devstack@n-api.service[100958]: INFO nova.api.openstack.requestlog [None req-162321af-f1e9-463e-8e47-6a2b7b53ec3b admin admin] 10.222.0.11 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001486 Nov 17 03:18:23.345796 dv-cinder-818037-2-iscsi devstack@n-api.service[100958]: [pid: 100958|app: 0|req: 9/16] 10.222.0.11 () {54 vars in 930 bytes} [Wed Nov 17 03:18:23 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 17 03:18:23.406326 dv-cinder-818037-2-iscsi devstack@n-api.service[100957]: DEBUG nova.api.openstack.wsgi [None req-4e9ebb6f-9566-4b52-a907-9b5e6274d0e6 admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 4, "os-flavor-access:is_public": true, "id": "d4", "name": "ds4G", "rxtx_factor": 1.0, "ram": 4096, "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "disk": 20}} {{(pid=100957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 17 03:18:23.426015 dv-cinder-818037-2-iscsi devstack@n-api.service[100957]: INFO nova.api.openstack.requestlog [None req-4e9ebb6f-9566-4b52-a907-9b5e6274d0e6 admin admin] 10.222.0.11 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.073158 Nov 17 03:18:23.426734 dv-cinder-818037-2-iscsi devstack@n-api.service[100957]: [pid: 100957|app: 0|req: 8/17] 10.222.0.11 () {64 vars in 1282 bytes} [Wed Nov 17 03:18:23 2021] POST /compute/v2.1/flavors => generated 404 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 17 03:18:23.439350 dv-cinder-818037-2-iscsi devstack@n-api.service[100958]: DEBUG nova.api.openstack.wsgi [None req-25161af1-19dd-488a-8ae8-09483d95831d admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=100958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 17 03:18:23.463350 dv-cinder-818037-2-iscsi devstack@n-api.service[100958]: INFO nova.api.openstack.requestlog [None req-25161af1-19dd-488a-8ae8-09483d95831d admin admin] 10.222.0.11 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.027585 Nov 17 03:18:23.464005 dv-cinder-818037-2-iscsi devstack@n-api.service[100958]: [pid: 100958|app: 0|req: 10/18] 10.222.0.11 () {64 vars in 1335 bytes} [Wed Nov 17 03:18:23 2021] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:18:25.791848 dv-cinder-818037-2-iscsi devstack@n-api.service[100957]: DEBUG nova.api.openstack.wsgi [None req-4e9ebb6f-9566-4b52-a907-9b5e6274d0e6 admin admin] Calling method '>' {{(pid=100957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:18:25.792979 dv-cinder-818037-2-iscsi devstack@n-api.service[100957]: INFO nova.api.openstack.requestlog [None req-4e9ebb6f-9566-4b52-a907-9b5e6274d0e6 admin admin] 10.222.0.11 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001800 Nov 17 03:18:25.793455 dv-cinder-818037-2-iscsi devstack@n-api.service[100957]: [pid: 100957|app: 0|req: 9/19] 10.222.0.11 () {54 vars in 930 bytes} [Wed Nov 17 03:18:25 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 17 03:18:25.863001 dv-cinder-818037-2-iscsi devstack@n-api.service[100958]: DEBUG nova.api.openstack.wsgi [None req-cffd1f7d-bef7-47ba-bad1-8943eea96632 admin admin] Calling method '>' {{(pid=100958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:18:25.888564 dv-cinder-818037-2-iscsi devstack@n-api.service[100958]: INFO nova.api.openstack.requestlog [None req-cffd1f7d-bef7-47ba-bad1-8943eea96632 admin admin] 10.222.0.11 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.086044 Nov 17 03:18:25.889176 dv-cinder-818037-2-iscsi devstack@n-api.service[100958]: [pid: 100958|app: 0|req: 11/20] 10.222.0.11 () {60 vars in 1291 bytes} [Wed Nov 17 03:18:25 2021] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 17 03:18:28.209748 dv-cinder-818037-2-iscsi devstack@n-api.service[100957]: DEBUG nova.api.openstack.wsgi [None req-4e9ebb6f-9566-4b52-a907-9b5e6274d0e6 admin admin] Calling method '>' {{(pid=100957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:18:28.211176 dv-cinder-818037-2-iscsi devstack@n-api.service[100957]: INFO nova.api.openstack.requestlog [None req-4e9ebb6f-9566-4b52-a907-9b5e6274d0e6 admin admin] 10.222.0.11 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002203 Nov 17 03:18:28.211751 dv-cinder-818037-2-iscsi devstack@n-api.service[100957]: [pid: 100957|app: 0|req: 10/21] 10.222.0.11 () {54 vars in 930 bytes} [Wed Nov 17 03:18:28 2021] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 17 03:18:28.276387 dv-cinder-818037-2-iscsi devstack@n-api.service[100958]: DEBUG nova.api.openstack.wsgi [None req-083939fc-61d3-4d96-93cd-ebb8bb5a1aef admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 1, "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 512, "os-flavor-access:is_public": true, "swap": 0, "id": "1", "name": "m1.tiny", "rxtx_factor": 1.0, "vcpus": 1}} {{(pid=100958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 17 03:18:28.297492 dv-cinder-818037-2-iscsi devstack@n-api.service[100958]: INFO nova.api.openstack.requestlog [None req-083939fc-61d3-4d96-93cd-ebb8bb5a1aef admin admin] 10.222.0.11 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.078938 Nov 17 03:18:28.298127 dv-cinder-818037-2-iscsi devstack@n-api.service[100958]: [pid: 100958|app: 0|req: 12/22] 10.222.0.11 () {64 vars in 1282 bytes} [Wed Nov 17 03:18:28 2021] POST /compute/v2.1/flavors => generated 402 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 17 03:18:28.311899 dv-cinder-818037-2-iscsi devstack@n-api.service[100957]: DEBUG nova.api.openstack.wsgi [None req-ab7fd2bf-7330-42af-9bed-7b3608162b71 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=100957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 17 03:18:28.337713 dv-cinder-818037-2-iscsi devstack@n-api.service[100957]: INFO nova.api.openstack.requestlog [None req-ab7fd2bf-7330-42af-9bed-7b3608162b71 admin admin] 10.222.0.11 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.030284 Nov 17 03:18:28.338293 dv-cinder-818037-2-iscsi devstack@n-api.service[100957]: [pid: 100957|app: 0|req: 11/23] 10.222.0.11 () {64 vars in 1332 bytes} [Wed Nov 17 03:18:28 2021] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 17 03:18:31.175972 dv-cinder-818037-2-iscsi devstack@n-api.service[100958]: DEBUG nova.api.openstack.wsgi [None req-083939fc-61d3-4d96-93cd-ebb8bb5a1aef admin admin] Calling method '>' {{(pid=100958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:18:31.177040 dv-cinder-818037-2-iscsi devstack@n-api.service[100958]: INFO nova.api.openstack.requestlog [None req-083939fc-61d3-4d96-93cd-ebb8bb5a1aef admin admin] 10.222.0.11 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001505 Nov 17 03:18:31.177602 dv-cinder-818037-2-iscsi devstack@n-api.service[100958]: [pid: 100958|app: 0|req: 13/24] 10.222.0.11 () {54 vars in 930 bytes} [Wed Nov 17 03:18:31 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 17 03:18:31.239111 dv-cinder-818037-2-iscsi devstack@n-api.service[100957]: DEBUG nova.api.openstack.wsgi [None req-a73a63b1-4918-435c-a80a-b66caa39e6c6 admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "2", "swap": 0, "disk": 20, "ram": 2048, "OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 1, "rxtx_factor": 1.0, "name": "m1.small", "os-flavor-access:is_public": true}} {{(pid=100957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 17 03:18:31.258732 dv-cinder-818037-2-iscsi devstack@n-api.service[100957]: INFO nova.api.openstack.requestlog [None req-a73a63b1-4918-435c-a80a-b66caa39e6c6 admin admin] 10.222.0.11 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.074254 Nov 17 03:18:31.259264 dv-cinder-818037-2-iscsi devstack@n-api.service[100957]: [pid: 100957|app: 0|req: 12/25] 10.222.0.11 () {64 vars in 1282 bytes} [Wed Nov 17 03:18:31 2021] POST /compute/v2.1/flavors => generated 405 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 17 03:18:31.271668 dv-cinder-818037-2-iscsi devstack@n-api.service[100958]: DEBUG nova.api.openstack.wsgi [None req-c6872f10-fd46-42f7-9fbe-eaf75f129549 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=100958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 17 03:18:31.296005 dv-cinder-818037-2-iscsi devstack@n-api.service[100958]: INFO nova.api.openstack.requestlog [None req-c6872f10-fd46-42f7-9fbe-eaf75f129549 admin admin] 10.222.0.11 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.028112 Nov 17 03:18:31.296557 dv-cinder-818037-2-iscsi devstack@n-api.service[100958]: [pid: 100958|app: 0|req: 14/26] 10.222.0.11 () {64 vars in 1332 bytes} [Wed Nov 17 03:18:31 2021] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 17 03:18:33.620003 dv-cinder-818037-2-iscsi devstack@n-api.service[100957]: DEBUG nova.api.openstack.wsgi [None req-a73a63b1-4918-435c-a80a-b66caa39e6c6 admin admin] Calling method '>' {{(pid=100957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:18:33.621019 dv-cinder-818037-2-iscsi devstack@n-api.service[100957]: INFO nova.api.openstack.requestlog [None req-a73a63b1-4918-435c-a80a-b66caa39e6c6 admin admin] 10.222.0.11 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001441 Nov 17 03:18:33.621576 dv-cinder-818037-2-iscsi devstack@n-api.service[100957]: [pid: 100957|app: 0|req: 13/27] 10.222.0.11 () {54 vars in 930 bytes} [Wed Nov 17 03:18:33 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 17 03:18:33.682290 dv-cinder-818037-2-iscsi devstack@n-api.service[100958]: DEBUG nova.api.openstack.wsgi [None req-7ff005ea-fa81-4ab0-afe0-32a975375453 admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 2, "ram": 4096, "id": "3", "name": "m1.medium", "swap": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "disk": 40}} {{(pid=100958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 17 03:18:33.702472 dv-cinder-818037-2-iscsi devstack@n-api.service[100958]: INFO nova.api.openstack.requestlog [None req-7ff005ea-fa81-4ab0-afe0-32a975375453 admin admin] 10.222.0.11 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.074042 Nov 17 03:18:33.703036 dv-cinder-818037-2-iscsi devstack@n-api.service[100958]: [pid: 100958|app: 0|req: 15/28] 10.222.0.11 () {64 vars in 1282 bytes} [Wed Nov 17 03:18:33 2021] POST /compute/v2.1/flavors => generated 406 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 17 03:18:33.715949 dv-cinder-818037-2-iscsi devstack@n-api.service[100957]: DEBUG nova.api.openstack.wsgi [None req-d66fd588-61be-4c6f-be92-d13471bc0af2 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=100957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 17 03:18:33.743853 dv-cinder-818037-2-iscsi devstack@n-api.service[100957]: INFO nova.api.openstack.requestlog [None req-d66fd588-61be-4c6f-be92-d13471bc0af2 admin admin] 10.222.0.11 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.031143 Nov 17 03:18:33.744593 dv-cinder-818037-2-iscsi devstack@n-api.service[100957]: [pid: 100957|app: 0|req: 14/29] 10.222.0.11 () {64 vars in 1332 bytes} [Wed Nov 17 03:18:33 2021] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:18:36.065874 dv-cinder-818037-2-iscsi devstack@n-api.service[100958]: DEBUG nova.api.openstack.wsgi [None req-7ff005ea-fa81-4ab0-afe0-32a975375453 admin admin] Calling method '>' {{(pid=100958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:18:36.067509 dv-cinder-818037-2-iscsi devstack@n-api.service[100958]: INFO nova.api.openstack.requestlog [None req-7ff005ea-fa81-4ab0-afe0-32a975375453 admin admin] 10.222.0.11 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002292 Nov 17 03:18:36.068224 dv-cinder-818037-2-iscsi devstack@n-api.service[100958]: [pid: 100958|app: 0|req: 16/30] 10.222.0.11 () {54 vars in 930 bytes} [Wed Nov 17 03:18:36 2021] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 17 03:18:36.142159 dv-cinder-818037-2-iscsi devstack@n-api.service[100957]: DEBUG nova.api.openstack.wsgi [None req-50b17eac-79d4-4b0f-af73-3e9c1254f225 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.large", "os-flavor-access:is_public": true, "disk": 80, "vcpus": 4, "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "ram": 8192, "id": "4"}} {{(pid=100957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 17 03:18:36.162899 dv-cinder-818037-2-iscsi devstack@n-api.service[100957]: INFO nova.api.openstack.requestlog [None req-50b17eac-79d4-4b0f-af73-3e9c1254f225 admin admin] 10.222.0.11 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.086219 Nov 17 03:18:36.162899 dv-cinder-818037-2-iscsi devstack@n-api.service[100957]: [pid: 100957|app: 0|req: 15/31] 10.222.0.11 () {64 vars in 1282 bytes} [Wed Nov 17 03:18:36 2021] POST /compute/v2.1/flavors => generated 405 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 17 03:18:36.174992 dv-cinder-818037-2-iscsi devstack@n-api.service[100958]: DEBUG nova.api.openstack.wsgi [None req-8e5d4c96-2d63-461f-96a3-9a386a26f4e3 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=100958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 17 03:18:36.198718 dv-cinder-818037-2-iscsi devstack@n-api.service[100958]: INFO nova.api.openstack.requestlog [None req-8e5d4c96-2d63-461f-96a3-9a386a26f4e3 admin admin] 10.222.0.11 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.027841 Nov 17 03:18:36.199580 dv-cinder-818037-2-iscsi devstack@n-api.service[100958]: [pid: 100958|app: 0|req: 17/32] 10.222.0.11 () {64 vars in 1332 bytes} [Wed Nov 17 03:18:36 2021] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:18:38.520714 dv-cinder-818037-2-iscsi devstack@n-api.service[100957]: DEBUG nova.api.openstack.wsgi [None req-50b17eac-79d4-4b0f-af73-3e9c1254f225 admin admin] Calling method '>' {{(pid=100957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:18:38.521929 dv-cinder-818037-2-iscsi devstack@n-api.service[100957]: INFO nova.api.openstack.requestlog [None req-50b17eac-79d4-4b0f-af73-3e9c1254f225 admin admin] 10.222.0.11 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001575 Nov 17 03:18:38.522397 dv-cinder-818037-2-iscsi devstack@n-api.service[100957]: [pid: 100957|app: 0|req: 16/33] 10.222.0.11 () {54 vars in 930 bytes} [Wed Nov 17 03:18:38 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 17 03:18:38.584281 dv-cinder-818037-2-iscsi devstack@n-api.service[100958]: DEBUG nova.api.openstack.wsgi [None req-54c8e19a-8b2b-453f-aabb-b6a288eceb21 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.xlarge", "OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 8, "ram": 16384, "swap": 0, "id": "5", "rxtx_factor": 1.0, "disk": 160, "os-flavor-access:is_public": true}} {{(pid=100958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 17 03:18:38.605988 dv-cinder-818037-2-iscsi devstack@n-api.service[100958]: INFO nova.api.openstack.requestlog [None req-54c8e19a-8b2b-453f-aabb-b6a288eceb21 admin admin] 10.222.0.11 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.076752 Nov 17 03:18:38.606547 dv-cinder-818037-2-iscsi devstack@n-api.service[100958]: [pid: 100958|app: 0|req: 18/34] 10.222.0.11 () {64 vars in 1282 bytes} [Wed Nov 17 03:18:38 2021] POST /compute/v2.1/flavors => generated 408 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 17 03:18:38.619357 dv-cinder-818037-2-iscsi devstack@n-api.service[100957]: DEBUG nova.api.openstack.wsgi [None req-42d79b63-a0ec-43d1-a86d-511777aebd59 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=100957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 17 03:18:38.645791 dv-cinder-818037-2-iscsi devstack@n-api.service[100957]: INFO nova.api.openstack.requestlog [None req-42d79b63-a0ec-43d1-a86d-511777aebd59 admin admin] 10.222.0.11 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.030397 Nov 17 03:18:38.646383 dv-cinder-818037-2-iscsi devstack@n-api.service[100957]: [pid: 100957|app: 0|req: 17/35] 10.222.0.11 () {64 vars in 1332 bytes} [Wed Nov 17 03:18:38 2021] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 17 03:19:16.818689 dv-cinder-818037-2-iscsi devstack@n-api.service[100958]: DEBUG nova.api.openstack.wsgi [None req-54c8e19a-8b2b-453f-aabb-b6a288eceb21 admin admin] Calling method '>' {{(pid=100958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:19:16.819691 dv-cinder-818037-2-iscsi devstack@n-api.service[100958]: INFO nova.api.openstack.requestlog [None req-54c8e19a-8b2b-453f-aabb-b6a288eceb21 admin admin] 10.222.0.11 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001449 Nov 17 03:19:16.820092 dv-cinder-818037-2-iscsi devstack@n-api.service[100958]: [pid: 100958|app: 0|req: 19/36] 10.222.0.11 () {54 vars in 930 bytes} [Wed Nov 17 03:19:16 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 17 03:19:16.883992 dv-cinder-818037-2-iscsi devstack@n-api.service[100957]: DEBUG nova.api.openstack.wsgi [None req-90045a2e-2556-447a-8b03-0c80e2e5c89d admin admin] Calling method '>' {{(pid=100957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:19:16.901797 dv-cinder-818037-2-iscsi devstack@n-api.service[100957]: INFO nova.api.openstack.requestlog [None req-90045a2e-2556-447a-8b03-0c80e2e5c89d admin admin] 10.222.0.11 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.074649 Nov 17 03:19:16.902352 dv-cinder-818037-2-iscsi devstack@n-api.service[100957]: [pid: 100957|app: 0|req: 18/37] 10.222.0.11 () {60 vars in 1291 bytes} [Wed Nov 17 03:19:16 2021] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 17 03:19:18.411924 dv-cinder-818037-2-iscsi devstack@n-api.service[100958]: DEBUG nova.api.openstack.wsgi [None req-54c8e19a-8b2b-453f-aabb-b6a288eceb21 admin admin] Calling method '>' {{(pid=100958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:19:18.413067 dv-cinder-818037-2-iscsi devstack@n-api.service[100958]: INFO nova.api.openstack.requestlog [None req-54c8e19a-8b2b-453f-aabb-b6a288eceb21 admin admin] 10.222.0.11 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001525 Nov 17 03:19:18.413474 dv-cinder-818037-2-iscsi devstack@n-api.service[100958]: [pid: 100958|app: 0|req: 20/38] 10.222.0.11 () {56 vars in 1074 bytes} [Wed Nov 17 03:19:18 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 17 03:19:18.627325 dv-cinder-818037-2-iscsi devstack@n-api.service[100957]: DEBUG nova.api.openstack.wsgi [None req-97e7afc6-b238-46e8-83a8-3ef927b9e2f9 admin admin] Calling method '>' {{(pid=100957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:19:18.633221 dv-cinder-818037-2-iscsi devstack@n-api.service[100957]: INFO nova.api.openstack.wsgi [None req-97e7afc6-b238-46e8-83a8-3ef927b9e2f9 admin admin] HTTP exception thrown: Flavor 42 could not be found. Nov 17 03:19:18.633789 dv-cinder-818037-2-iscsi devstack@n-api.service[100957]: DEBUG nova.api.openstack.wsgi [None req-97e7afc6-b238-46e8-83a8-3ef927b9e2f9 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=100957) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 17 03:19:18.634585 dv-cinder-818037-2-iscsi devstack@n-api.service[100957]: INFO nova.api.openstack.requestlog [None req-97e7afc6-b238-46e8-83a8-3ef927b9e2f9 admin admin] 10.222.0.11 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.078871 Nov 17 03:19:18.635105 dv-cinder-818037-2-iscsi devstack@n-api.service[100957]: [pid: 100957|app: 0|req: 19/39] 10.222.0.11 () {60 vars in 1190 bytes} [Wed Nov 17 03:19:18 2021] GET /compute/v2.1/flavors/42 => generated 75 bytes in 80 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Nov 17 03:19:18.650418 dv-cinder-818037-2-iscsi devstack@n-api.service[100958]: DEBUG nova.api.openstack.wsgi [None req-85adb81e-0647-4c47-ad6b-707a8b1a1add admin admin] Calling method '>' {{(pid=100958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:19:18.673512 dv-cinder-818037-2-iscsi devstack@n-api.service[100958]: INFO nova.api.openstack.requestlog [None req-85adb81e-0647-4c47-ad6b-707a8b1a1add admin admin] 10.222.0.11 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.028892 Nov 17 03:19:18.674052 dv-cinder-818037-2-iscsi devstack@n-api.service[100958]: [pid: 100958|app: 0|req: 21/40] 10.222.0.11 () {60 vars in 1210 bytes} [Wed Nov 17 03:19:18 2021] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 17 03:19:18.689575 dv-cinder-818037-2-iscsi devstack@n-api.service[100957]: DEBUG nova.api.openstack.wsgi [None req-268c1e02-8d05-41fc-bd47-679c57607081 admin admin] Calling method '>' {{(pid=100957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:19:18.711117 dv-cinder-818037-2-iscsi devstack@n-api.service[100957]: INFO nova.api.openstack.requestlog [None req-268c1e02-8d05-41fc-bd47-679c57607081 admin admin] 10.222.0.11 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.026616 Nov 17 03:19:18.711657 dv-cinder-818037-2-iscsi devstack@n-api.service[100957]: [pid: 100957|app: 0|req: 20/41] 10.222.0.11 () {60 vars in 1210 bytes} [Wed Nov 17 03:19:18 2021] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 17 03:19:18.721911 dv-cinder-818037-2-iscsi devstack@n-api.service[100958]: DEBUG nova.api.openstack.wsgi [None req-ac7245e2-3cb1-47e0-ac1e-134333dd1e14 admin admin] Calling method '>' {{(pid=100958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:19:18.727585 dv-cinder-818037-2-iscsi devstack@n-api.service[100958]: INFO nova.api.openstack.wsgi [None req-ac7245e2-3cb1-47e0-ac1e-134333dd1e14 admin admin] HTTP exception thrown: Flavor 42 could not be found. Nov 17 03:19:18.728159 dv-cinder-818037-2-iscsi devstack@n-api.service[100958]: DEBUG nova.api.openstack.wsgi [None req-ac7245e2-3cb1-47e0-ac1e-134333dd1e14 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=100958) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 17 03:19:18.728987 dv-cinder-818037-2-iscsi devstack@n-api.service[100958]: INFO nova.api.openstack.requestlog [None req-ac7245e2-3cb1-47e0-ac1e-134333dd1e14 admin admin] 10.222.0.11 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.011055 Nov 17 03:19:18.729490 dv-cinder-818037-2-iscsi devstack@n-api.service[100958]: [pid: 100958|app: 0|req: 22/42] 10.222.0.11 () {60 vars in 1190 bytes} [Wed Nov 17 03:19:18 2021] GET /compute/v2.1/flavors/42 => generated 75 bytes in 12 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Nov 17 03:19:20.116113 dv-cinder-818037-2-iscsi devstack@n-api.service[100957]: DEBUG nova.api.openstack.wsgi [None req-268c1e02-8d05-41fc-bd47-679c57607081 admin admin] Calling method '>' {{(pid=100957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:19:20.117151 dv-cinder-818037-2-iscsi devstack@n-api.service[100957]: INFO nova.api.openstack.requestlog [None req-268c1e02-8d05-41fc-bd47-679c57607081 admin admin] 10.222.0.11 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001453 Nov 17 03:19:20.117544 dv-cinder-818037-2-iscsi devstack@n-api.service[100957]: [pid: 100957|app: 0|req: 21/43] 10.222.0.11 () {56 vars in 1074 bytes} [Wed Nov 17 03:19:20 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 17 03:19:20.334559 dv-cinder-818037-2-iscsi devstack@n-api.service[100958]: DEBUG nova.api.openstack.wsgi [None req-200e6e4f-1baf-458a-b957-024c88eb8e11 admin admin] Calling method '>' {{(pid=100958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:19:20.340584 dv-cinder-818037-2-iscsi devstack@n-api.service[100958]: INFO nova.api.openstack.wsgi [None req-200e6e4f-1baf-458a-b957-024c88eb8e11 admin admin] HTTP exception thrown: Flavor 84 could not be found. Nov 17 03:19:20.341183 dv-cinder-818037-2-iscsi devstack@n-api.service[100958]: DEBUG nova.api.openstack.wsgi [None req-200e6e4f-1baf-458a-b957-024c88eb8e11 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=100958) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 17 03:19:20.341968 dv-cinder-818037-2-iscsi devstack@n-api.service[100958]: INFO nova.api.openstack.requestlog [None req-200e6e4f-1baf-458a-b957-024c88eb8e11 admin admin] 10.222.0.11 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.081551 Nov 17 03:19:20.342476 dv-cinder-818037-2-iscsi devstack@n-api.service[100958]: [pid: 100958|app: 0|req: 23/44] 10.222.0.11 () {60 vars in 1190 bytes} [Wed Nov 17 03:19:20 2021] GET /compute/v2.1/flavors/84 => generated 75 bytes in 83 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Nov 17 03:19:20.352799 dv-cinder-818037-2-iscsi devstack@n-api.service[100957]: DEBUG nova.api.openstack.wsgi [None req-3a2d6294-1edc-4582-857f-908e327a9f97 admin admin] Calling method '>' {{(pid=100957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:19:20.366937 dv-cinder-818037-2-iscsi devstack@n-api.service[100957]: INFO nova.api.openstack.requestlog [None req-3a2d6294-1edc-4582-857f-908e327a9f97 admin admin] 10.222.0.11 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.017801 Nov 17 03:19:20.367501 dv-cinder-818037-2-iscsi devstack@n-api.service[100957]: [pid: 100957|app: 0|req: 22/45] 10.222.0.11 () {60 vars in 1210 bytes} [Wed Nov 17 03:19:20 2021] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 17 03:19:20.379612 dv-cinder-818037-2-iscsi devstack@n-api.service[100958]: DEBUG nova.api.openstack.wsgi [None req-ab2d6dcf-c2cd-439b-a021-cf95c3948b18 admin admin] Calling method '>' {{(pid=100958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:19:20.401534 dv-cinder-818037-2-iscsi devstack@n-api.service[100958]: INFO nova.api.openstack.requestlog [None req-ab2d6dcf-c2cd-439b-a021-cf95c3948b18 admin admin] 10.222.0.11 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.027437 Nov 17 03:19:20.402096 dv-cinder-818037-2-iscsi devstack@n-api.service[100958]: [pid: 100958|app: 0|req: 24/46] 10.222.0.11 () {60 vars in 1210 bytes} [Wed Nov 17 03:19:20 2021] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 17 03:19:20.412358 dv-cinder-818037-2-iscsi devstack@n-api.service[100957]: DEBUG nova.api.openstack.wsgi [None req-706172c3-cef5-4942-9386-7bc192ae9486 admin admin] Calling method '>' {{(pid=100957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:19:20.417745 dv-cinder-818037-2-iscsi devstack@n-api.service[100957]: INFO nova.api.openstack.wsgi [None req-706172c3-cef5-4942-9386-7bc192ae9486 admin admin] HTTP exception thrown: Flavor 84 could not be found. Nov 17 03:19:20.418290 dv-cinder-818037-2-iscsi devstack@n-api.service[100957]: DEBUG nova.api.openstack.wsgi [None req-706172c3-cef5-4942-9386-7bc192ae9486 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=100957) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 17 03:19:20.419064 dv-cinder-818037-2-iscsi devstack@n-api.service[100957]: INFO nova.api.openstack.requestlog [None req-706172c3-cef5-4942-9386-7bc192ae9486 admin admin] 10.222.0.11 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.010337 Nov 17 03:19:20.419553 dv-cinder-818037-2-iscsi devstack@n-api.service[100957]: [pid: 100957|app: 0|req: 23/47] 10.222.0.11 () {60 vars in 1190 bytes} [Wed Nov 17 03:19:20 2021] GET /compute/v2.1/flavors/84 => generated 75 bytes in 11 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Nov 17 03:19:21.791913 dv-cinder-818037-2-iscsi devstack@n-api.service[100958]: DEBUG nova.api.openstack.wsgi [None req-ab2d6dcf-c2cd-439b-a021-cf95c3948b18 admin admin] Calling method '>' {{(pid=100958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:19:21.793544 dv-cinder-818037-2-iscsi devstack@n-api.service[100958]: INFO nova.api.openstack.requestlog [None req-ab2d6dcf-c2cd-439b-a021-cf95c3948b18 admin admin] 10.222.0.11 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002238 Nov 17 03:19:21.794129 dv-cinder-818037-2-iscsi devstack@n-api.service[100958]: [pid: 100958|app: 0|req: 25/48] 10.222.0.11 () {56 vars in 1074 bytes} [Wed Nov 17 03:19:21 2021] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 17 03:19:21.987662 dv-cinder-818037-2-iscsi devstack@n-api.service[100957]: DEBUG nova.api.openstack.wsgi [None req-c9e2d888-6e62-44f8-8d57-b9dea4e579c6 admin admin] Calling method '>' {{(pid=100957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:19:21.993441 dv-cinder-818037-2-iscsi devstack@n-api.service[100957]: INFO nova.api.openstack.wsgi [None req-c9e2d888-6e62-44f8-8d57-b9dea4e579c6 admin admin] HTTP exception thrown: Flavor 451 could not be found. Nov 17 03:19:21.993911 dv-cinder-818037-2-iscsi devstack@n-api.service[100957]: DEBUG nova.api.openstack.wsgi [None req-c9e2d888-6e62-44f8-8d57-b9dea4e579c6 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=100957) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 17 03:19:21.994680 dv-cinder-818037-2-iscsi devstack@n-api.service[100957]: INFO nova.api.openstack.requestlog [None req-c9e2d888-6e62-44f8-8d57-b9dea4e579c6 admin admin] 10.222.0.11 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.064071 Nov 17 03:19:21.995178 dv-cinder-818037-2-iscsi devstack@n-api.service[100957]: [pid: 100957|app: 0|req: 24/49] 10.222.0.11 () {60 vars in 1193 bytes} [Wed Nov 17 03:19:21 2021] GET /compute/v2.1/flavors/451 => generated 76 bytes in 65 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Nov 17 03:19:22.007735 dv-cinder-818037-2-iscsi devstack@n-api.service[100958]: DEBUG nova.api.openstack.wsgi [None req-4ae8b85f-1696-4133-bae8-d56713561142 admin admin] Calling method '>' {{(pid=100958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:19:22.024469 dv-cinder-818037-2-iscsi devstack@n-api.service[100958]: INFO nova.api.openstack.requestlog [None req-4ae8b85f-1696-4133-bae8-d56713561142 admin admin] 10.222.0.11 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.022530 Nov 17 03:19:22.025065 dv-cinder-818037-2-iscsi devstack@n-api.service[100958]: [pid: 100958|app: 0|req: 26/50] 10.222.0.11 () {60 vars in 1210 bytes} [Wed Nov 17 03:19:22 2021] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 24 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 17 03:19:22.041461 dv-cinder-818037-2-iscsi devstack@n-api.service[100957]: DEBUG nova.api.openstack.wsgi [None req-292ec9c4-c111-4aef-a78b-15b1135dc9b7 admin admin] Calling method '>' {{(pid=100957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:19:22.056897 dv-cinder-818037-2-iscsi devstack@n-api.service[100957]: INFO nova.api.openstack.requestlog [None req-292ec9c4-c111-4aef-a78b-15b1135dc9b7 admin admin] 10.222.0.11 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.021699 Nov 17 03:19:22.057742 dv-cinder-818037-2-iscsi devstack@n-api.service[100957]: [pid: 100957|app: 0|req: 25/51] 10.222.0.11 () {60 vars in 1210 bytes} [Wed Nov 17 03:19:22 2021] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 23 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 17 03:19:22.070799 dv-cinder-818037-2-iscsi devstack@n-api.service[100958]: DEBUG nova.api.openstack.wsgi [None req-e728c1cd-d812-4535-927a-2328967c501d admin admin] Calling method '>' {{(pid=100958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:19:22.079606 dv-cinder-818037-2-iscsi devstack@n-api.service[100958]: INFO nova.api.openstack.wsgi [None req-e728c1cd-d812-4535-927a-2328967c501d admin admin] HTTP exception thrown: Flavor 451 could not be found. Nov 17 03:19:22.080165 dv-cinder-818037-2-iscsi devstack@n-api.service[100958]: DEBUG nova.api.openstack.wsgi [None req-e728c1cd-d812-4535-927a-2328967c501d admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=100958) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 17 03:19:22.080973 dv-cinder-818037-2-iscsi devstack@n-api.service[100958]: INFO nova.api.openstack.requestlog [None req-e728c1cd-d812-4535-927a-2328967c501d admin admin] 10.222.0.11 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.016003 Nov 17 03:19:22.081465 dv-cinder-818037-2-iscsi devstack@n-api.service[100958]: [pid: 100958|app: 0|req: 27/52] 10.222.0.11 () {60 vars in 1193 bytes} [Wed Nov 17 03:19:22 2021] GET /compute/v2.1/flavors/451 => generated 76 bytes in 18 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Nov 17 03:19:23.477339 dv-cinder-818037-2-iscsi devstack@n-api.service[100957]: DEBUG nova.api.openstack.wsgi [None req-292ec9c4-c111-4aef-a78b-15b1135dc9b7 admin admin] Calling method '>' {{(pid=100957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:19:23.478335 dv-cinder-818037-2-iscsi devstack@n-api.service[100957]: INFO nova.api.openstack.requestlog [None req-292ec9c4-c111-4aef-a78b-15b1135dc9b7 admin admin] 10.222.0.11 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001503 Nov 17 03:19:23.478733 dv-cinder-818037-2-iscsi devstack@n-api.service[100957]: [pid: 100957|app: 0|req: 26/53] 10.222.0.11 () {56 vars in 1074 bytes} [Wed Nov 17 03:19:23 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 17 03:19:23.674834 dv-cinder-818037-2-iscsi devstack@n-api.service[100958]: DEBUG nova.api.openstack.wsgi [None req-8d7f1330-8577-42a1-b754-4f0ad5974445 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=100958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 17 03:19:23.696512 dv-cinder-818037-2-iscsi devstack@n-api.service[100958]: INFO nova.api.openstack.requestlog [None req-8d7f1330-8577-42a1-b754-4f0ad5974445 admin admin] 10.222.0.11 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.90 time: 0.080816 Nov 17 03:19:23.697067 dv-cinder-818037-2-iscsi devstack@n-api.service[100958]: [pid: 100958|app: 0|req: 28/54] 10.222.0.11 () {64 vars in 1235 bytes} [Wed Nov 17 03:19:23 2021] POST /compute/v2.1/flavors => generated 404 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 17 03:19:25.069529 dv-cinder-818037-2-iscsi devstack@n-api.service[100957]: DEBUG nova.api.openstack.wsgi [None req-292ec9c4-c111-4aef-a78b-15b1135dc9b7 admin admin] Calling method '>' {{(pid=100957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:19:25.070518 dv-cinder-818037-2-iscsi devstack@n-api.service[100957]: INFO nova.api.openstack.requestlog [None req-292ec9c4-c111-4aef-a78b-15b1135dc9b7 admin admin] 10.222.0.11 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001457 Nov 17 03:19:25.070916 dv-cinder-818037-2-iscsi devstack@n-api.service[100957]: [pid: 100957|app: 0|req: 27/55] 10.222.0.11 () {56 vars in 1074 bytes} [Wed Nov 17 03:19:25 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 17 03:19:25.276905 dv-cinder-818037-2-iscsi devstack@n-api.service[100958]: DEBUG nova.api.openstack.wsgi [None req-99b9dfe7-8cc5-4e1a-af74-2edd5152512e admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=100958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 17 03:19:25.299680 dv-cinder-818037-2-iscsi devstack@n-api.service[100958]: INFO nova.api.openstack.requestlog [None req-99b9dfe7-8cc5-4e1a-af74-2edd5152512e admin admin] 10.222.0.11 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.90 time: 0.088996 Nov 17 03:19:25.300235 dv-cinder-818037-2-iscsi devstack@n-api.service[100958]: [pid: 100958|app: 0|req: 29/56] 10.222.0.11 () {64 vars in 1235 bytes} [Wed Nov 17 03:19:25 2021] POST /compute/v2.1/flavors => generated 405 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 17 03:19:26.681140 dv-cinder-818037-2-iscsi devstack@n-api.service[100957]: DEBUG nova.api.openstack.wsgi [None req-292ec9c4-c111-4aef-a78b-15b1135dc9b7 admin admin] Calling method '>' {{(pid=100957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:19:26.682386 dv-cinder-818037-2-iscsi devstack@n-api.service[100957]: INFO nova.api.openstack.requestlog [None req-292ec9c4-c111-4aef-a78b-15b1135dc9b7 admin admin] 10.222.0.11 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002038 Nov 17 03:19:26.683392 dv-cinder-818037-2-iscsi devstack@n-api.service[100957]: [pid: 100957|app: 0|req: 28/57] 10.222.0.11 () {56 vars in 1074 bytes} [Wed Nov 17 03:19:26 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 17 03:19:26.886993 dv-cinder-818037-2-iscsi devstack@n-api.service[100958]: DEBUG nova.api.openstack.wsgi [None req-abc0c9b3-32a9-4d62-a159-2401ec035f72 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=100958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 17 03:19:26.913885 dv-cinder-818037-2-iscsi devstack@n-api.service[100958]: INFO nova.api.openstack.requestlog [None req-abc0c9b3-32a9-4d62-a159-2401ec035f72 admin admin] 10.222.0.11 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.90 time: 0.092823 Nov 17 03:19:26.914414 dv-cinder-818037-2-iscsi devstack@n-api.service[100958]: [pid: 100958|app: 0|req: 30/58] 10.222.0.11 () {64 vars in 1235 bytes} [Wed Nov 17 03:19:26 2021] POST /compute/v2.1/flavors => generated 407 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 17 03:19:28.285311 dv-cinder-818037-2-iscsi devstack@n-api.service[100957]: DEBUG nova.api.openstack.wsgi [None req-292ec9c4-c111-4aef-a78b-15b1135dc9b7 admin admin] Calling method '>' {{(pid=100957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:19:28.286334 dv-cinder-818037-2-iscsi devstack@n-api.service[100957]: INFO nova.api.openstack.requestlog [None req-292ec9c4-c111-4aef-a78b-15b1135dc9b7 admin admin] 10.222.0.11 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001477 Nov 17 03:19:28.286725 dv-cinder-818037-2-iscsi devstack@n-api.service[100957]: [pid: 100957|app: 0|req: 29/59] 10.222.0.11 () {56 vars in 1074 bytes} [Wed Nov 17 03:19:28 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 17 03:19:28.486093 dv-cinder-818037-2-iscsi devstack@n-api.service[100958]: DEBUG nova.api.openstack.wsgi [None req-52c9e4c7-9563-4024-87fe-41dce0aaecb1 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=100958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 17 03:19:28.507576 dv-cinder-818037-2-iscsi devstack@n-api.service[100958]: INFO nova.api.openstack.requestlog [None req-52c9e4c7-9563-4024-87fe-41dce0aaecb1 admin admin] 10.222.0.11 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.90 time: 0.084369 Nov 17 03:19:28.508101 dv-cinder-818037-2-iscsi devstack@n-api.service[100958]: [pid: 100958|app: 0|req: 31/60] 10.222.0.11 () {64 vars in 1235 bytes} [Wed Nov 17 03:19:28 2021] POST /compute/v2.1/flavors => generated 409 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 17 03:19:29.880730 dv-cinder-818037-2-iscsi devstack@n-api.service[100957]: DEBUG nova.api.openstack.wsgi [None req-292ec9c4-c111-4aef-a78b-15b1135dc9b7 admin admin] Calling method '>' {{(pid=100957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:19:29.881761 dv-cinder-818037-2-iscsi devstack@n-api.service[100957]: INFO nova.api.openstack.requestlog [None req-292ec9c4-c111-4aef-a78b-15b1135dc9b7 admin admin] 10.222.0.11 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001458 Nov 17 03:19:29.882152 dv-cinder-818037-2-iscsi devstack@n-api.service[100957]: [pid: 100957|app: 0|req: 30/61] 10.222.0.11 () {56 vars in 1074 bytes} [Wed Nov 17 03:19:29 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 17 03:19:30.078912 dv-cinder-818037-2-iscsi devstack@n-api.service[100958]: DEBUG nova.api.openstack.wsgi [None req-d6052d7c-dfea-4e2d-bbea-50a8efebfd51 admin admin] Calling method '>' {{(pid=100958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:19:30.099339 dv-cinder-818037-2-iscsi devstack@n-api.service[100958]: INFO nova.api.openstack.requestlog [None req-d6052d7c-dfea-4e2d-bbea-50a8efebfd51 admin admin] 10.222.0.11 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.90 time: 0.081545 Nov 17 03:19:30.099805 dv-cinder-818037-2-iscsi devstack@n-api.service[100958]: [pid: 100958|app: 0|req: 32/62] 10.222.0.11 () {60 vars in 1202 bytes} [Wed Nov 17 03:19:30 2021] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 17 03:20:16.561703 dv-cinder-818037-2-iscsi devstack@n-api.service[100957]: DEBUG nova.api.openstack.wsgi [None req-292ec9c4-c111-4aef-a78b-15b1135dc9b7 admin admin] Calling method '>' {{(pid=100957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:20:16.562690 dv-cinder-818037-2-iscsi devstack@n-api.service[100957]: INFO nova.api.openstack.requestlog [None req-292ec9c4-c111-4aef-a78b-15b1135dc9b7 admin admin] 10.222.0.11 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001441 Nov 17 03:20:16.563092 dv-cinder-818037-2-iscsi devstack@n-api.service[100957]: [pid: 100957|app: 0|req: 31/63] 10.222.0.11 () {54 vars in 930 bytes} [Wed Nov 17 03:20:16 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 17 03:20:16.623233 dv-cinder-818037-2-iscsi devstack@n-api.service[100958]: DEBUG nova.api.openstack.wsgi [None req-a4d923e6-64c7-4edf-a355-06b101737f42 admin admin] Calling method '>' {{(pid=100958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:20:16.642214 dv-cinder-818037-2-iscsi devstack@n-api.service[100958]: INFO nova.api.openstack.requestlog [None req-a4d923e6-64c7-4edf-a355-06b101737f42 admin admin] 10.222.0.11 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5791 microversion: 2.61 time: 0.072561 Nov 17 03:20:16.642748 dv-cinder-818037-2-iscsi devstack@n-api.service[100958]: [pid: 100958|app: 0|req: 33/64] 10.222.0.11 () {60 vars in 1291 bytes} [Wed Nov 17 03:20:16 2021] GET /compute/v2.1/flavors/detail?is_public=True => generated 5791 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 17 03:20:16.667761 dv-cinder-818037-2-iscsi devstack@n-api.service[100957]: DEBUG nova.api.openstack.wsgi [None req-7a2bc021-efc0-4adf-8910-12c125422887 admin admin] Calling method '>' {{(pid=100957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:20:16.679405 dv-cinder-818037-2-iscsi devstack@n-api.service[100957]: INFO nova.api.openstack.requestlog [None req-7a2bc021-efc0-4adf-8910-12c125422887 admin admin] 10.222.0.11 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.017445 Nov 17 03:20:16.679950 dv-cinder-818037-2-iscsi devstack@n-api.service[100957]: [pid: 100957|app: 0|req: 32/65] 10.222.0.11 () {60 vars in 1282 bytes} [Wed Nov 17 03:20:16 2021] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:20:16.692043 dv-cinder-818037-2-iscsi devstack@n-api.service[100958]: DEBUG nova.api.openstack.wsgi [None req-4f1a1e07-5c1f-46ca-8597-d99bdae8e90b admin admin] Calling method '>' {{(pid=100958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:20:16.700823 dv-cinder-818037-2-iscsi devstack@n-api.service[100958]: INFO nova.api.openstack.requestlog [None req-4f1a1e07-5c1f-46ca-8597-d99bdae8e90b admin admin] 10.222.0.11 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.012309 Nov 17 03:20:16.701364 dv-cinder-818037-2-iscsi devstack@n-api.service[100958]: [pid: 100958|app: 0|req: 34/66] 10.222.0.11 () {60 vars in 1285 bytes} [Wed Nov 17 03:20:16 2021] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:20:16.713319 dv-cinder-818037-2-iscsi devstack@n-api.service[100957]: DEBUG nova.api.openstack.wsgi [None req-41ef1f52-0f40-4bdf-8036-899f8ff0aef8 admin admin] Calling method '>' {{(pid=100957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:20:16.720974 dv-cinder-818037-2-iscsi devstack@n-api.service[100957]: INFO nova.api.openstack.requestlog [None req-41ef1f52-0f40-4bdf-8036-899f8ff0aef8 admin admin] 10.222.0.11 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011180 Nov 17 03:20:16.721546 dv-cinder-818037-2-iscsi devstack@n-api.service[100957]: [pid: 100957|app: 0|req: 33/67] 10.222.0.11 () {60 vars in 1285 bytes} [Wed Nov 17 03:20:16 2021] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:20:16.734217 dv-cinder-818037-2-iscsi devstack@n-api.service[100958]: DEBUG nova.api.openstack.wsgi [None req-99c3a274-3b1a-4ee4-8404-da8a705228c8 admin admin] Calling method '>' {{(pid=100958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:20:16.742386 dv-cinder-818037-2-iscsi devstack@n-api.service[100958]: INFO nova.api.openstack.requestlog [None req-99c3a274-3b1a-4ee4-8404-da8a705228c8 admin admin] 10.222.0.11 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011708 Nov 17 03:20:16.742896 dv-cinder-818037-2-iscsi devstack@n-api.service[100958]: [pid: 100958|app: 0|req: 35/68] 10.222.0.11 () {60 vars in 1282 bytes} [Wed Nov 17 03:20:16 2021] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:21:39.364153 dv-cinder-818037-2-iscsi devstack@n-api.service[100957]: DEBUG nova.api.openstack.wsgi [None req-e406fdd9-eb7c-4193-a11a-65845b53bbed tempest-verify_tempest_config-694066523 tempest-verify_tempest_config-694066523-project] Calling method '>' {{(pid=100957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:21:39.367480 dv-cinder-818037-2-iscsi devstack@n-api.service[100957]: INFO nova.api.openstack.requestlog [None req-e406fdd9-eb7c-4193-a11a-65845b53bbed tempest-verify_tempest_config-694066523 tempest-verify_tempest_config-694066523-project] 10.222.0.11 "GET /compute/v2.1/extensions" status: 200 len: 22700 microversion: 2.1 time: 0.119091 Nov 17 03:21:39.368477 dv-cinder-818037-2-iscsi devstack@n-api.service[100957]: [pid: 100957|app: 0|req: 34/69] 10.222.0.11 () {58 vars in 1133 bytes} [Wed Nov 17 03:21:39 2021] GET /compute/v2.1/extensions => generated 22700 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 17 03:23:07.511732 dv-cinder-818037-2-iscsi devstack@n-api.service[100958]: DEBUG nova.api.openstack.wsgi [None req-99c3a274-3b1a-4ee4-8404-da8a705228c8 admin admin] Calling method '>' {{(pid=100958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:23:07.512738 dv-cinder-818037-2-iscsi devstack@n-api.service[100958]: INFO nova.api.openstack.requestlog [None req-99c3a274-3b1a-4ee4-8404-da8a705228c8 admin admin] 10.222.0.11 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001486 Nov 17 03:23:07.513160 dv-cinder-818037-2-iscsi devstack@n-api.service[100958]: [pid: 100958|app: 0|req: 36/70] 10.222.0.11 () {56 vars in 1074 bytes} [Wed Nov 17 03:23:07 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 17 03:23:07.776131 dv-cinder-818037-2-iscsi devstack@n-api.service[100957]: DEBUG nova.api.openstack.wsgi [None req-2d7b6392-8c56-4c41-8d05-17ca5ab6c30d admin admin] Calling method '>' {{(pid=100957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:23:07.777671 dv-cinder-818037-2-iscsi devstack@n-api.service[100957]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-services:list failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 17 03:23:07.777671 dv-cinder-818037-2-iscsi devstack@n-api.service[100957]: warnings.warn(msg) Nov 17 03:23:07.779952 dv-cinder-818037-2-iscsi devstack@n-api.service[100957]: DEBUG oslo_concurrency.lockutils [None req-2d7b6392-8c56-4c41-8d05-17ca5ab6c30d admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:23:07.780576 dv-cinder-818037-2-iscsi devstack@n-api.service[100957]: DEBUG oslo_concurrency.lockutils [None req-2d7b6392-8c56-4c41-8d05-17ca5ab6c30d admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:23:07.781748 dv-cinder-818037-2-iscsi devstack@n-api.service[100957]: DEBUG oslo_concurrency.lockutils [None req-2d7b6392-8c56-4c41-8d05-17ca5ab6c30d admin admin] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:23:07.782300 dv-cinder-818037-2-iscsi devstack@n-api.service[100957]: DEBUG oslo_concurrency.lockutils [None req-2d7b6392-8c56-4c41-8d05-17ca5ab6c30d admin admin] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:23:07.817838 dv-cinder-818037-2-iscsi devstack@n-api.service[100957]: INFO nova.api.openstack.requestlog [None req-2d7b6392-8c56-4c41-8d05-17ca5ab6c30d admin admin] 10.222.0.11 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.90 time: 0.164590 Nov 17 03:23:07.818395 dv-cinder-818037-2-iscsi devstack@n-api.service[100957]: [pid: 100957|app: 0|req: 35/71] 10.222.0.11 () {60 vars in 1193 bytes} [Wed Nov 17 03:23:07 2021] GET /compute/v2.1/os-services => generated 791 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 17 03:23:09.271162 dv-cinder-818037-2-iscsi devstack@n-api.service[100958]: DEBUG nova.api.openstack.wsgi [None req-99c3a274-3b1a-4ee4-8404-da8a705228c8 admin admin] Calling method '>' {{(pid=100958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:23:09.272160 dv-cinder-818037-2-iscsi devstack@n-api.service[100958]: INFO nova.api.openstack.requestlog [None req-99c3a274-3b1a-4ee4-8404-da8a705228c8 admin admin] 10.222.0.11 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001455 Nov 17 03:23:09.272556 dv-cinder-818037-2-iscsi devstack@n-api.service[100958]: [pid: 100958|app: 0|req: 37/72] 10.222.0.11 () {56 vars in 1074 bytes} [Wed Nov 17 03:23:09 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 17 03:23:09.466174 dv-cinder-818037-2-iscsi devstack@n-api.service[100957]: DEBUG nova.api.openstack.wsgi [None req-55afedad-7e19-46c4-acb7-cdfbb1a127a6 admin admin] Calling method '>' {{(pid=100957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:23:09.467344 dv-cinder-818037-2-iscsi devstack@n-api.service[100957]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-services:list failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 17 03:23:09.467344 dv-cinder-818037-2-iscsi devstack@n-api.service[100957]: warnings.warn(msg) Nov 17 03:23:09.468891 dv-cinder-818037-2-iscsi devstack@n-api.service[100957]: DEBUG oslo_concurrency.lockutils [None req-55afedad-7e19-46c4-acb7-cdfbb1a127a6 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:23:09.469329 dv-cinder-818037-2-iscsi devstack@n-api.service[100957]: DEBUG oslo_concurrency.lockutils [None req-55afedad-7e19-46c4-acb7-cdfbb1a127a6 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:23:09.470164 dv-cinder-818037-2-iscsi devstack@n-api.service[100957]: DEBUG oslo_concurrency.lockutils [None req-55afedad-7e19-46c4-acb7-cdfbb1a127a6 admin admin] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:23:09.470586 dv-cinder-818037-2-iscsi devstack@n-api.service[100957]: DEBUG oslo_concurrency.lockutils [None req-55afedad-7e19-46c4-acb7-cdfbb1a127a6 admin admin] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:23:09.489086 dv-cinder-818037-2-iscsi devstack@n-api.service[100957]: INFO nova.api.openstack.requestlog [None req-55afedad-7e19-46c4-acb7-cdfbb1a127a6 admin admin] 10.222.0.11 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.90 time: 0.076217 Nov 17 03:23:09.489649 dv-cinder-818037-2-iscsi devstack@n-api.service[100957]: [pid: 100957|app: 0|req: 36/73] 10.222.0.11 () {60 vars in 1193 bytes} [Wed Nov 17 03:23:09 2021] GET /compute/v2.1/os-services => generated 791 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 17 03:23:21.315442 dv-cinder-818037-2-iscsi devstack@n-api.service[100958]: DEBUG nova.api.openstack.wsgi [None req-99c3a274-3b1a-4ee4-8404-da8a705228c8 admin admin] Calling method '>' {{(pid=100958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:23:21.316477 dv-cinder-818037-2-iscsi devstack@n-api.service[100958]: INFO nova.api.openstack.requestlog [None req-99c3a274-3b1a-4ee4-8404-da8a705228c8 admin admin] 10.222.0.11 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001492 Nov 17 03:23:21.316867 dv-cinder-818037-2-iscsi devstack@n-api.service[100958]: [pid: 100958|app: 0|req: 38/74] 10.222.0.11 () {56 vars in 1074 bytes} [Wed Nov 17 03:23:21 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 17 03:23:21.523347 dv-cinder-818037-2-iscsi devstack@n-api.service[100957]: DEBUG nova.api.openstack.wsgi [None req-e0ecb088-07dc-47c8-a82c-9de3a9e1c304 admin admin] Calling method '>' {{(pid=100957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:23:21.524510 dv-cinder-818037-2-iscsi devstack@n-api.service[100957]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-services:list failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 17 03:23:21.524510 dv-cinder-818037-2-iscsi devstack@n-api.service[100957]: warnings.warn(msg) Nov 17 03:23:21.526047 dv-cinder-818037-2-iscsi devstack@n-api.service[100957]: DEBUG oslo_concurrency.lockutils [None req-e0ecb088-07dc-47c8-a82c-9de3a9e1c304 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:23:21.526480 dv-cinder-818037-2-iscsi devstack@n-api.service[100957]: DEBUG oslo_concurrency.lockutils [None req-e0ecb088-07dc-47c8-a82c-9de3a9e1c304 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:23:21.527272 dv-cinder-818037-2-iscsi devstack@n-api.service[100957]: DEBUG oslo_concurrency.lockutils [None req-e0ecb088-07dc-47c8-a82c-9de3a9e1c304 admin admin] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:23:21.527692 dv-cinder-818037-2-iscsi devstack@n-api.service[100957]: DEBUG oslo_concurrency.lockutils [None req-e0ecb088-07dc-47c8-a82c-9de3a9e1c304 admin admin] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:23:21.551836 dv-cinder-818037-2-iscsi devstack@n-api.service[100957]: INFO nova.api.openstack.requestlog [None req-e0ecb088-07dc-47c8-a82c-9de3a9e1c304 admin admin] 10.222.0.11 "GET /compute/v2.1/os-services" status: 200 len: 1035 microversion: 2.90 time: 0.088038 Nov 17 03:23:21.552393 dv-cinder-818037-2-iscsi devstack@n-api.service[100957]: [pid: 100957|app: 0|req: 37/75] 10.222.0.11 () {60 vars in 1193 bytes} [Wed Nov 17 03:23:21 2021] GET /compute/v2.1/os-services => generated 1035 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 17 03:23:22.945472 dv-cinder-818037-2-iscsi devstack@n-api.service[100958]: DEBUG nova.api.openstack.wsgi [None req-99c3a274-3b1a-4ee4-8404-da8a705228c8 admin admin] Calling method '>' {{(pid=100958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:23:22.946465 dv-cinder-818037-2-iscsi devstack@n-api.service[100958]: INFO nova.api.openstack.requestlog [None req-99c3a274-3b1a-4ee4-8404-da8a705228c8 admin admin] 10.222.0.11 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001462 Nov 17 03:23:22.946864 dv-cinder-818037-2-iscsi devstack@n-api.service[100958]: [pid: 100958|app: 0|req: 39/76] 10.222.0.11 () {56 vars in 1074 bytes} [Wed Nov 17 03:23:22 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 17 03:23:23.148058 dv-cinder-818037-2-iscsi devstack@n-api.service[100957]: DEBUG nova.api.openstack.wsgi [None req-227fc902-d2c8-4532-b97a-467f32e42b72 admin admin] Calling method '>' {{(pid=100957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:23:23.149276 dv-cinder-818037-2-iscsi devstack@n-api.service[100957]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-services:list failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 17 03:23:23.149276 dv-cinder-818037-2-iscsi devstack@n-api.service[100957]: warnings.warn(msg) Nov 17 03:23:23.150739 dv-cinder-818037-2-iscsi devstack@n-api.service[100957]: DEBUG oslo_concurrency.lockutils [None req-227fc902-d2c8-4532-b97a-467f32e42b72 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:23:23.151199 dv-cinder-818037-2-iscsi devstack@n-api.service[100957]: DEBUG oslo_concurrency.lockutils [None req-227fc902-d2c8-4532-b97a-467f32e42b72 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:23:23.151974 dv-cinder-818037-2-iscsi devstack@n-api.service[100957]: DEBUG oslo_concurrency.lockutils [None req-227fc902-d2c8-4532-b97a-467f32e42b72 admin admin] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:23:23.152385 dv-cinder-818037-2-iscsi devstack@n-api.service[100957]: DEBUG oslo_concurrency.lockutils [None req-227fc902-d2c8-4532-b97a-467f32e42b72 admin admin] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:23:23.176345 dv-cinder-818037-2-iscsi devstack@n-api.service[100957]: INFO nova.api.openstack.requestlog [None req-227fc902-d2c8-4532-b97a-467f32e42b72 admin admin] 10.222.0.11 "GET /compute/v2.1/os-services" status: 200 len: 1035 microversion: 2.90 time: 0.090933 Nov 17 03:23:23.177075 dv-cinder-818037-2-iscsi devstack@n-api.service[100957]: [pid: 100957|app: 0|req: 38/77] 10.222.0.11 () {60 vars in 1193 bytes} [Wed Nov 17 03:23:23 2021] GET /compute/v2.1/os-services => generated 1035 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 17 03:24:20.017136 dv-cinder-818037-2-iscsi systemd[1]: Stopping Devstack devstack@n-api.service... Nov 17 03:24:20.017727 dv-cinder-818037-2-iscsi devstack@n-api.service[100956]: Wed Nov 17 03:24:20 2021 - graceful shutdown triggered... Nov 17 03:24:20.018172 dv-cinder-818037-2-iscsi devstack@n-api.service[100957]: Gracefully killing worker 1 (pid: 100957)... Nov 17 03:24:20.018532 dv-cinder-818037-2-iscsi devstack@n-api.service[100958]: Gracefully killing worker 2 (pid: 100958)... Nov 17 03:24:21.018778 dv-cinder-818037-2-iscsi devstack@n-api.service[100956]: worker 1 buried after 1 seconds Nov 17 03:24:21.018778 dv-cinder-818037-2-iscsi devstack@n-api.service[100956]: worker 2 buried after 1 seconds Nov 17 03:24:21.018778 dv-cinder-818037-2-iscsi devstack@n-api.service[100956]: goodbye to uWSGI. Nov 17 03:24:21.021297 dv-cinder-818037-2-iscsi systemd[1]: devstack@n-api.service: Succeeded. Nov 17 03:24:21.022263 dv-cinder-818037-2-iscsi systemd[1]: Stopped Devstack devstack@n-api.service. Nov 17 03:24:21.026759 dv-cinder-818037-2-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Nov 17 03:24:21.041784 dv-cinder-818037-2-iscsi devstack@n-api.service[115903]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Nov 17 03:24:21.045096 dv-cinder-818037-2-iscsi devstack@n-api.service[115903]: *** Starting uWSGI 2.0.18-debian (64bit) on [Wed Nov 17 03:24:21 2021] *** Nov 17 03:24:21.045260 dv-cinder-818037-2-iscsi devstack@n-api.service[115903]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Nov 17 03:24:21.045505 dv-cinder-818037-2-iscsi devstack@n-api.service[115903]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Nov 17 03:24:21.045770 dv-cinder-818037-2-iscsi devstack@n-api.service[115903]: nodename: dv-cinder-818037-2-iscsi Nov 17 03:24:21.045885 dv-cinder-818037-2-iscsi devstack@n-api.service[115903]: machine: x86_64 Nov 17 03:24:21.045995 dv-cinder-818037-2-iscsi devstack@n-api.service[115903]: clock source: unix Nov 17 03:24:21.046098 dv-cinder-818037-2-iscsi devstack@n-api.service[115903]: pcre jit disabled Nov 17 03:24:21.046191 dv-cinder-818037-2-iscsi devstack@n-api.service[115903]: detected number of CPU cores: 4 Nov 17 03:24:21.046283 dv-cinder-818037-2-iscsi devstack@n-api.service[115903]: current working directory: / Nov 17 03:24:21.046380 dv-cinder-818037-2-iscsi devstack@n-api.service[115903]: detected binary path: /usr/bin/uwsgi-core Nov 17 03:24:21.046501 dv-cinder-818037-2-iscsi devstack@n-api.service[115903]: your processes number limit is 47680 Nov 17 03:24:21.046618 dv-cinder-818037-2-iscsi devstack@n-api.service[115903]: your memory page size is 4096 bytes Nov 17 03:24:21.046730 dv-cinder-818037-2-iscsi devstack@n-api.service[115903]: detected max file descriptor number: 2048 Nov 17 03:24:21.046842 dv-cinder-818037-2-iscsi devstack@n-api.service[115903]: lock engine: pthread robust mutexes Nov 17 03:24:21.047112 dv-cinder-818037-2-iscsi devstack@n-api.service[115903]: thunder lock: enabled Nov 17 03:24:21.047415 dv-cinder-818037-2-iscsi devstack@n-api.service[115903]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Nov 17 03:24:21.047667 dv-cinder-818037-2-iscsi devstack@n-api.service[115903]: Python version: 3.8.10 (default, Sep 28 2021, 16:10:42) [GCC 9.3.0] Nov 17 03:24:21.092909 dv-cinder-818037-2-iscsi devstack@n-api.service[115903]: Python main interpreter initialized at 0x555fa0c869c0 Nov 17 03:24:21.092909 dv-cinder-818037-2-iscsi devstack@n-api.service[115903]: python threads support enabled Nov 17 03:24:21.092909 dv-cinder-818037-2-iscsi devstack@n-api.service[115903]: your server socket listen backlog is limited to 100 connections Nov 17 03:24:21.092909 dv-cinder-818037-2-iscsi devstack@n-api.service[115903]: your mercy for graceful operations on workers is 90 seconds Nov 17 03:24:21.093385 dv-cinder-818037-2-iscsi devstack@n-api.service[115903]: mapped 403077 bytes (393 KB) for 2 cores Nov 17 03:24:21.093385 dv-cinder-818037-2-iscsi devstack@n-api.service[115903]: *** Operational MODE: preforking *** Nov 17 03:24:21.093651 dv-cinder-818037-2-iscsi devstack@n-api.service[115903]: *** uWSGI is running in multiple interpreter mode *** Nov 17 03:24:21.093651 dv-cinder-818037-2-iscsi devstack@n-api.service[115903]: spawned uWSGI master process (pid: 115903) Nov 17 03:24:21.093832 dv-cinder-818037-2-iscsi systemd[1]: Started Devstack devstack@n-api.service. Nov 17 03:24:21.094748 dv-cinder-818037-2-iscsi devstack@n-api.service[115903]: spawned uWSGI worker 1 (pid: 115916, cores: 1) Nov 17 03:24:21.094860 dv-cinder-818037-2-iscsi devstack@n-api.service[115903]: spawned uWSGI worker 2 (pid: 115917, cores: 1) Nov 17 03:24:21.094941 dv-cinder-818037-2-iscsi devstack@n-api.service[115903]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Nov 17 03:24:22.854916 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Nov 17 03:24:22.854916 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: from cryptography.utils import int_from_bytes Nov 17 03:24:22.855536 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Nov 17 03:24:22.855536 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: from cryptography.utils import int_from_bytes Nov 17 03:24:22.867784 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Nov 17 03:24:22.867784 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: from cryptography.utils import int_from_bytes Nov 17 03:24:22.868423 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Nov 17 03:24:22.868423 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: from cryptography.utils import int_from_bytes Nov 17 03:24:25.180821 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=115917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Nov 17 03:24:25.181427 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=115917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Nov 17 03:24:25.181735 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=115917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Nov 17 03:24:25.181932 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=115917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Nov 17 03:24:25.182187 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=115917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Nov 17 03:24:25.182587 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=115917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 17 03:24:25.183286 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=115917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 17 03:24:25.183646 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=115917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 17 03:24:25.184006 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=115917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 17 03:24:25.184348 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=115917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 17 03:24:25.184666 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=115917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 17 03:24:25.185052 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=115917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 17 03:24:25.185379 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=115917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 17 03:24:25.185717 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=115917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 17 03:24:25.185967 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=115917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 17 03:24:25.186272 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=115917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 17 03:24:25.186604 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-818037-2-iscsi {{(pid=115917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 17 03:24:25.186962 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=115917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 17 03:24:25.187278 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=115917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 17 03:24:25.187591 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=115917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 17 03:24:25.187889 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=115917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 17 03:24:25.188233 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=115917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 17 03:24:25.188556 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=115917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 17 03:24:25.188905 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=115917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 17 03:24:25.189388 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=115917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 17 03:24:25.190841 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=115917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 17 03:24:25.190841 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=115917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 17 03:24:25.190841 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=115917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 17 03:24:25.191132 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=115917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 17 03:24:25.191388 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=115917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 17 03:24:25.191707 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=115917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 17 03:24:25.192033 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=115917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 17 03:24:25.192351 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=115917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 17 03:24:25.192686 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=115917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 17 03:24:25.193036 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=115917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 17 03:24:25.193427 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-818037-2-iscsi {{(pid=115917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 17 03:24:25.193789 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=115917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 17 03:24:25.194128 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=115917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 17 03:24:25.194394 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=115917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 17 03:24:25.194813 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=115917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 17 03:24:25.195154 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=115917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 17 03:24:25.195447 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=115917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 17 03:24:25.195781 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=115917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 17 03:24:25.196123 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=115917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 17 03:24:25.196441 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=115917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 17 03:24:25.196763 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=115917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 17 03:24:25.197129 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=115917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 17 03:24:25.197441 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=115917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 17 03:24:25.197757 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=115917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 17 03:24:25.198060 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=115917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 17 03:24:25.198408 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=115917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 17 03:24:25.198711 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=115917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 17 03:24:25.199037 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=115917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 17 03:24:25.199373 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=115917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 17 03:24:25.199686 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=115917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 17 03:24:25.199927 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=115917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 17 03:24:25.200260 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=115917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 17 03:24:25.200589 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=115917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 17 03:24:25.200936 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=115917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 17 03:24:25.201275 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=115917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 17 03:24:25.201523 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=115917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 17 03:24:25.201762 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=115917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 17 03:24:25.202103 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=115917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 17 03:24:25.202475 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=115917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 17 03:24:25.202727 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=115917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 17 03:24:25.203062 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=115917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 17 03:24:25.203373 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=115917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 17 03:24:25.203686 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=115917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 17 03:24:25.204032 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=115917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 17 03:24:25.204310 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=115917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 17 03:24:25.204624 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=115917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 17 03:24:25.204961 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=115917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 17 03:24:25.205286 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=115917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 17 03:24:25.205608 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=115917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 17 03:24:25.205938 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=115917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 17 03:24:25.206238 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=115917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 17 03:24:25.206583 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=115917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 17 03:24:25.207025 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.11 {{(pid=115917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 17 03:24:25.207210 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.11 {{(pid=115917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 17 03:24:25.207539 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=115917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 17 03:24:25.207883 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=115917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 17 03:24:25.208209 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=115917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 17 03:24:25.208519 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=115917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 17 03:24:25.208868 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=115917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 17 03:24:25.209181 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=115917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 17 03:24:25.209496 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=115917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 17 03:24:25.209807 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=115917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 17 03:24:25.210122 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=115917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 17 03:24:25.210448 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=115917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 17 03:24:25.210781 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=115917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 17 03:24:25.211090 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=115917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 17 03:24:25.211344 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=115917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 17 03:24:25.211650 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=115917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 17 03:24:25.211964 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=115917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 17 03:24:25.212283 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=115917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 17 03:24:25.212592 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=115917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 17 03:24:25.212933 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=115917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 17 03:24:25.213246 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=115917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 17 03:24:25.213549 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=115917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 17 03:24:25.213860 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=115917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 17 03:24:25.214172 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=115917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 17 03:24:25.214484 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=115917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 17 03:24:25.214797 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=115917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 17 03:24:25.215243 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=115917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 17 03:24:25.215562 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=115917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 17 03:24:25.215881 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=115917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 17 03:24:25.216200 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=115917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 17 03:24:25.216499 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=115917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 17 03:24:25.216866 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=115917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 17 03:24:25.217179 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=115917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 17 03:24:25.217508 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=115917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 17 03:24:25.217805 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=115917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 17 03:24:25.218117 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=115917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 17 03:24:25.218432 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=115917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 17 03:24:25.218755 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=115917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 17 03:24:25.219073 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=115917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 17 03:24:25.219379 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=115917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 17 03:24:25.219707 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=115917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 17 03:24:25.220019 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=115917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 17 03:24:25.220332 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=115917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 17 03:24:25.220652 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=115917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 17 03:24:25.220992 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=115917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 17 03:24:25.221306 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=115917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 17 03:24:25.221628 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=115917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 17 03:24:25.221943 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=115917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 17 03:24:25.222246 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=115917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 17 03:24:25.222567 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=115917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 17 03:24:25.222880 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=115917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 17 03:24:25.223214 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=115917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 17 03:24:25.223486 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=115917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 17 03:24:25.223790 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=115917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 17 03:24:25.224096 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=115917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 17 03:24:25.224405 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=115917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 17 03:24:25.224709 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=115917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 17 03:24:25.225032 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=115917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 17 03:24:25.225414 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=115917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 17 03:24:25.225659 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=115917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 17 03:24:25.225976 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=115917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 17 03:24:25.226293 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=115917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 17 03:24:25.227532 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=115917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 17 03:24:25.227532 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=115917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 17 03:24:25.227532 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=115917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 17 03:24:25.227532 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=115917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:24:25.228242 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=115917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:24:25.228242 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=115917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:24:25.228544 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=115917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:24:25.228874 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=115917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:24:25.229183 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=115917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:24:25.229502 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=115917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:24:25.229818 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=115917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:24:25.230138 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=115917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:24:25.230469 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=115917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:24:25.230810 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=115917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:24:25.231126 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=115917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:24:25.231594 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=115917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:24:25.231924 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=115917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:24:25.232301 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=115917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:24:25.232581 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=115917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:24:25.232926 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=115917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:24:25.233251 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=115917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:24:25.233577 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=115917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:24:25.233890 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=115917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:24:25.234213 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=115917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:24:25.234546 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=115917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:24:25.234874 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=115917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:24:25.235188 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=115917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:24:25.235534 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=115917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:24:25.235998 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=115917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:24:25.236207 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=115917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:24:25.236540 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=115917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:24:25.236894 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=115917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:24:25.237212 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=115917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:24:25.237534 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=115917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:24:25.237854 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=115917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:24:25.238175 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=115917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:24:25.238516 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=115917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:24:25.238884 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=115917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:24:25.239146 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=115917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:24:25.239481 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=115917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:24:25.239813 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=115917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:24:25.240128 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=115917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:24:25.240490 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=115917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:24:25.240743 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=115917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:24:25.241079 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=115917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:24:25.241394 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=115917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:24:25.241703 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=115917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:24:25.242031 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=115917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:24:25.242416 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=115917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:24:25.242673 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=115917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:24:25.243014 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=115917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:24:25.243327 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=115917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:24:25.243663 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=115917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:24:25.243964 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=115917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:24:25.244267 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=115917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:24:25.244587 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=115917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:24:25.244928 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=115917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:24:25.245244 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=115917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:24:25.245574 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=115917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:24:25.245894 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=115917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:24:25.246509 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=115917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:24:25.246851 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=115917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:24:25.247176 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=115917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:24:25.250293 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=115917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:24:25.250293 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=115917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:24:25.250763 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=115916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Nov 17 03:24:25.251270 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=115917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:24:25.251434 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=115916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Nov 17 03:24:25.251598 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=115917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:24:25.251598 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=115917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:24:25.251878 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=115916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Nov 17 03:24:25.252034 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=115917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:24:25.252187 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=115916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Nov 17 03:24:25.252341 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=115917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:24:25.252506 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=115916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Nov 17 03:24:25.252731 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=115917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:24:25.253077 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=115916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 17 03:24:25.253257 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=115917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:24:25.253410 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=115916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 17 03:24:25.253555 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=115917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:24:25.253725 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=115916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 17 03:24:25.253943 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=115917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:24:25.254102 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=115916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 17 03:24:25.254257 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=115917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:24:25.254408 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=115916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 17 03:24:25.254559 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=115917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:24:25.254730 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=115916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 17 03:24:25.254890 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=115917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:24:25.255050 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=115916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 17 03:24:25.255213 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=115917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:24:25.255357 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=115916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 17 03:24:25.255508 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=115917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:24:25.255659 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=115916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 17 03:24:25.255852 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=115917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:24:25.256018 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=115916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 17 03:24:25.256162 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=115917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:24:25.256426 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=115916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 17 03:24:25.256575 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=115917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:24:25.256719 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-818037-2-iscsi {{(pid=115916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 17 03:24:25.256909 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=115917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:24:25.257057 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=115916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 17 03:24:25.257202 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=115917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:24:25.257442 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=115916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 17 03:24:25.257598 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=115917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:24:25.257743 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=115916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 17 03:24:25.257898 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=115917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:24:25.258051 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=115916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 17 03:24:25.258194 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=115917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:24:25.258337 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=115916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 17 03:24:25.258494 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=115917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:24:25.258494 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=115917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:24:25.258776 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=115916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 17 03:24:25.258921 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=115917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:24:25.259065 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=115916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 17 03:24:25.259219 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=115917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:24:25.259370 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=115916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 17 03:24:25.259580 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=115917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:24:25.259740 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=115916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 17 03:24:25.259885 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=115917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:24:25.260036 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=115916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 17 03:24:25.260490 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=115917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:24:25.260655 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=115916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 17 03:24:25.260909 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=115917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:24:25.261070 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=115916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 17 03:24:25.261215 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=115917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:24:25.261377 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=115916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 17 03:24:25.261519 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=115917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:24:25.261663 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=115916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 17 03:24:25.261849 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=115917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:24:25.262007 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=115916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 17 03:24:25.262152 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=115917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:24:25.262295 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=115916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 17 03:24:25.262438 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=115917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:24:25.262601 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=115916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 17 03:24:25.262782 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=115917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:24:25.263005 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=115916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 17 03:24:25.263155 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=115917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:24:25.263852 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-818037-2-iscsi {{(pid=115916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 17 03:24:25.263937 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=115917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:24:25.264025 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=115916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 17 03:24:25.264108 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=115917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:24:25.264191 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=115916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 17 03:24:25.264263 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=115917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:24:25.264332 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=115916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 17 03:24:25.264411 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=115917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:24:25.264411 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=115917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:24:25.264538 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=115916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 17 03:24:25.264607 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=115917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:24:25.264686 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=115916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 17 03:24:25.264764 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=115917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:24:25.264897 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=115916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 17 03:24:25.264978 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=115917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:24:25.265056 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=115916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 17 03:24:25.265139 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=115917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:24:25.265209 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=115916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 17 03:24:25.265291 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=115917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:24:25.265369 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=115916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 17 03:24:25.265440 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=115917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:24:25.265509 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=115916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 17 03:24:25.265577 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=115917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:24:25.265577 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=115917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:24:25.265722 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=115916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 17 03:24:25.265801 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=115917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:24:25.265886 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=115916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 17 03:24:25.265971 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=115917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:24:25.266066 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=115916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 17 03:24:25.266151 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=115917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:24:25.266244 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=115916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 17 03:24:25.266335 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=115917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:24:25.266418 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=115916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 17 03:24:25.266501 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=115917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:24:25.266582 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=115916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 17 03:24:25.266663 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=115917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:24:25.266759 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=115916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 17 03:24:25.266849 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=115917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:24:25.266931 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=115916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 17 03:24:25.267089 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=115917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:24:25.267188 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=115916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 17 03:24:25.267286 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=115917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:24:25.267380 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=115916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 17 03:24:25.267476 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=115917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:24:25.267560 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=115916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 17 03:24:25.267649 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=115917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:24:25.267738 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=115916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 17 03:24:25.267821 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=115917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:24:25.267901 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=115916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 17 03:24:25.267991 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=115917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:24:25.268074 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=115916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 17 03:24:25.268168 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=115917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:24:25.268252 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=115916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 17 03:24:25.268252 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=115916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 17 03:24:25.268422 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=115917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:24:25.268512 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=115916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 17 03:24:25.268595 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=115917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:24:25.268682 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=115916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 17 03:24:25.268766 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=115917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:24:25.268875 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=115916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 17 03:24:25.268957 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=115917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:24:25.269137 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=115916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 17 03:24:25.269249 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=115917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:24:25.269524 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=115916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 17 03:24:25.269703 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=115917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:24:25.269857 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=115916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 17 03:24:25.269999 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=115917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:24:25.270148 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=115916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 17 03:24:25.270296 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=115917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:24:25.270440 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=115916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 17 03:24:25.270587 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=115917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:24:25.270736 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=115916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 17 03:24:25.270877 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=115917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:24:25.271015 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=115916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 17 03:24:25.271161 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=115917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:24:25.271302 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=115916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 17 03:24:25.271456 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=115917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:24:25.271606 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=115916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 17 03:24:25.271754 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=115917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:24:25.271894 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=115916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 17 03:24:25.272041 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=115917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:24:25.272188 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=115916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 17 03:24:25.272334 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=115917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:24:25.272530 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=115916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 17 03:24:25.272678 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=115917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:24:25.272853 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=115917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:24:25.272998 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.11 {{(pid=115916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 17 03:24:25.273154 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=115917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:24:25.273312 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.11 {{(pid=115916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 17 03:24:25.273472 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=115917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:24:25.273621 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=115916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 17 03:24:25.273768 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=115917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:24:25.273908 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=115916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 17 03:24:25.274049 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=115917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:24:25.274205 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=115916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 17 03:24:25.274345 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=115917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:24:25.274493 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=115916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 17 03:24:25.274643 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=115917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:24:25.274790 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=115916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 17 03:24:25.274930 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=115917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:24:25.275089 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=115916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 17 03:24:25.276994 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=115917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:24:25.277918 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=115916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 17 03:24:25.278082 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=115917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:24:25.278230 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=115916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 17 03:24:25.278387 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=115917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:24:25.278536 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=115916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 17 03:24:25.278686 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=115917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:24:25.278829 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=115916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 17 03:24:25.278979 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=115917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:24:25.279132 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=115916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 17 03:24:25.279297 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=115917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:24:25.279447 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=115916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 17 03:24:25.279587 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=115917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:24:25.279744 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=115916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 17 03:24:25.279894 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=115917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:24:25.280060 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=115916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 17 03:24:25.280214 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=115917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:24:25.280361 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=115916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 17 03:24:25.280502 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=115917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:24:25.280648 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=115916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 17 03:24:25.280809 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=115917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:24:25.280968 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=115916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 17 03:24:25.281117 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=115917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:24:25.281266 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=115916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 17 03:24:25.281266 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=115916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 17 03:24:25.281551 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=115917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:24:25.281700 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=115916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 17 03:24:25.281850 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=115917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:24:25.282228 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=115916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 17 03:24:25.284112 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=115917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:24:25.284284 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=115916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 17 03:24:25.284433 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=115917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:24:25.284585 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=115916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 17 03:24:25.284737 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=115917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:24:25.284915 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=115916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 17 03:24:25.285059 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=115917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:24:25.285210 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=115916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 17 03:24:25.285384 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=115917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:24:25.285599 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=115916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 17 03:24:25.285752 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=115917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:24:25.285901 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=115916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 17 03:24:25.286050 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=115917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:24:25.286193 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=115916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 17 03:24:25.286347 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=115917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:24:25.286495 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=115916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 17 03:24:25.286643 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=115917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:24:25.286783 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=115916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 17 03:24:25.286932 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=115917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:24:25.287073 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=115916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 17 03:24:25.287227 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=115917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:24:25.287368 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=115916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 17 03:24:25.287518 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=115917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:24:25.287665 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=115916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 17 03:24:25.287805 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=115917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:24:25.287945 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=115916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 17 03:24:25.288105 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=115917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:24:25.288256 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=115916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 17 03:24:25.288467 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=115917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:24:25.288621 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=115916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 17 03:24:25.288770 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=115917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:24:25.288946 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=115916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 17 03:24:25.289087 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=115917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:24:25.289235 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=115916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 17 03:24:25.289376 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=115917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:24:25.289543 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=115916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 17 03:24:25.289684 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=115917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:24:25.289824 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=115916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 17 03:24:25.289963 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=115917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:24:25.290119 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=115916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 17 03:24:25.290119 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=115916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 17 03:24:25.290395 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=115917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:24:25.290537 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=115916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 17 03:24:25.291749 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=115917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:24:25.292083 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=115916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 17 03:24:25.292252 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=115917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:24:25.292396 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=115916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 17 03:24:25.292565 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=115917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:24:25.292714 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=115916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 17 03:24:25.292930 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=115917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:24:25.293113 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=115916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 17 03:24:25.293263 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=115917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:24:25.293405 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=115916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 17 03:24:25.293546 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=115917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:24:25.293693 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=115916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 17 03:24:25.293833 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=115917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:24:25.294056 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=115916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 17 03:24:25.294211 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=115917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:24:25.294351 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=115916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 17 03:24:25.294500 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=115917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:24:25.294649 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=115916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 17 03:24:25.294791 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=115917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:24:25.294939 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=115916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 17 03:24:25.295087 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=115917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:24:25.295228 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=115916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 17 03:24:25.295368 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=115917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:24:25.296219 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=115916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 17 03:24:25.296692 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=115917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:24:25.296867 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=115916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 17 03:24:25.297014 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=115917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:24:25.297160 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=115916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 17 03:24:25.297308 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=115917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:24:25.297460 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=115916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 17 03:24:25.297601 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=115917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:24:25.297749 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=115916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 17 03:24:25.297897 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=115917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:24:25.298052 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=115916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 17 03:24:25.298199 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=115917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:24:25.298352 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=115916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 17 03:24:25.298492 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=115917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:24:25.298642 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=115916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 17 03:24:25.298782 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=115917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:24:25.298931 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=115916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 17 03:24:25.299087 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=115917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:24:25.299235 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=115916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:24:25.299384 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=115917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:24:25.299525 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=115916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:24:25.299672 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=115917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:24:25.299819 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=115916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:24:25.299958 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=115917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:24:25.299958 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=115917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:24:25.300238 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=115916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:24:25.300378 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=115917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:24:25.300541 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=115916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:24:25.300683 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=115917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:24:25.301173 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=115916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:24:25.301323 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=115917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:24:25.301463 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=115916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:24:25.301612 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=115917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:24:25.301754 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=115916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:24:25.301895 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=115917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:24:25.302034 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=115916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:24:25.302183 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=115917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:24:25.302323 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=115916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:24:25.302471 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=115917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:24:25.302622 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=115916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:24:25.302762 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=115917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:24:25.302912 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=115916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:24:25.303051 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=115917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:24:25.303198 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=115916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:24:25.303352 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=115917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:24:25.303494 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=115916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:24:25.303633 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=115917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:24:25.303781 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=115916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:24:25.303920 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=115917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:24:25.304070 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=115916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:24:25.304217 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=115917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:24:25.304366 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=115916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:24:25.304517 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=115917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:24:25.304664 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=115916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:24:25.304832 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=115917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:24:25.304992 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=115916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:24:25.305134 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=115917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:24:25.305276 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=115916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:24:25.305423 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=115917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:24:25.305562 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=115916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:24:25.305801 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=115917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:24:25.305956 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=115916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:24:25.306099 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=115917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:24:25.306239 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=115916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:24:25.306379 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=115917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:24:25.306537 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=115916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:24:25.306685 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=115917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:24:25.306838 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=115916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:24:25.306979 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=115917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:24:25.307127 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=115916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:24:25.307127 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=115916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:24:25.307127 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=115916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:24:25.307525 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=115917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:24:25.308034 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=115916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:24:25.308201 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=115917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:24:25.308957 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=115916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:24:25.309124 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=115917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:24:25.309374 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=115916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:24:25.309616 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=115917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:24:25.309838 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=115916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:24:25.310070 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=115917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:24:25.310310 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=115916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:24:25.310538 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=115917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:24:25.310771 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=115916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:24:25.310958 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=115917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:24:25.311503 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=115916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:24:25.311766 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=115917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:24:25.312007 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=115916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:24:25.312243 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=115917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:24:25.312487 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=115916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:24:25.312764 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=115917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:24:25.313057 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=115916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:24:25.313223 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=115917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:24:25.313376 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=115916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:24:25.313593 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=115917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:24:25.313842 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=115916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:24:25.314080 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=115917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:24:25.314329 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=115916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:24:25.314571 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=115917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:24:25.314827 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=115916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:24:25.315034 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=115917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:24:25.315302 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=115916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:24:25.315562 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=115917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:24:25.315856 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=115916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:24:25.316120 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=115917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:24:25.316288 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=115916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:24:25.316445 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=115917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:24:25.316604 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=115916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:24:25.316752 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=115917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:24:25.316950 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=115916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:24:25.317193 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=115917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:24:25.317447 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=115916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:24:25.317699 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=115917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:24:25.317957 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=115916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:24:25.318205 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=115917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:24:25.318460 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=115916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:24:25.318639 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=115917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:24:25.318788 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=115916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:24:25.318944 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=115917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:24:25.318944 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=115917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:24:25.319239 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=115916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:24:25.319386 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=115917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:24:25.319532 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=115916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:24:25.319679 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=115917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:24:25.319839 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=115916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:24:25.319993 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=115917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:24:25.320148 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=115916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:24:25.320294 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=115917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:24:25.320449 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=115916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:24:25.320615 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=115917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:24:25.320813 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=115916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:24:25.320969 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=115917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:24:25.320969 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=115917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:24:25.321495 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=115916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:24:25.321495 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=115916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:24:25.321495 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=115916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:24:25.321495 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=115916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:24:25.322143 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=115917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:24:25.322290 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=115916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:24:25.322435 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=115917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:24:25.322588 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=115916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:24:25.322761 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=115917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:24:25.322910 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=115916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:24:25.323055 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=115917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:24:25.323201 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=115916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:24:25.323348 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=115917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:24:25.323348 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=115917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:24:25.323647 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=115916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:24:25.324414 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=115917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:24:25.324576 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=115916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:24:25.324735 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=115917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:24:25.324735 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=115917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:24:25.325080 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=115916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:24:25.325080 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=115916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:24:25.325080 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=115916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:24:25.325505 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=115917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:24:25.325652 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=115916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:24:25.325798 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=115917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:24:25.325798 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=115917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:24:25.326076 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=115916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:24:25.326351 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=115917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:24:25.326351 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=115917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:24:25.326823 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=115916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:24:25.326980 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=115917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:24:25.327147 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=115916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:24:25.327310 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=115917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:24:25.327464 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=115916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:24:25.327627 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=115917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:24:25.327863 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=115916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:24:25.328017 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=115917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:24:25.328173 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=115916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:24:25.328327 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=115917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:24:25.328482 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=115916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:24:25.328482 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=115916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:24:25.328842 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=115917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:24:25.329010 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=115916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:24:25.329166 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=115917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:24:25.329322 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=115916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:24:25.329488 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=115917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:24:25.329644 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=115916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:24:25.329798 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=115917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:24:25.329945 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=115916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:24:25.330097 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=115917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:24:25.330247 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=115916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:24:25.330412 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=115917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:24:25.330561 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=115916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:24:25.330713 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=115917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:24:25.330861 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=115916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:24:25.331014 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=115917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:24:25.331173 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=115916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:24:25.331354 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=115917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:24:25.331851 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=115916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:24:25.332005 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=115917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:24:25.332200 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=115916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:24:25.332348 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=115917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:24:25.332501 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=115916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:24:25.332673 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=115917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:24:25.332960 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=115916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:24:25.333125 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=115917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:24:25.333280 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=115916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:24:25.333428 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=115917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:24:25.333428 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=115917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:24:25.333715 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=115916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:24:25.333863 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=115917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:24:25.334021 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=115916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:24:25.334168 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=115917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:24:25.334168 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=115917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:24:25.334464 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=115916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:24:25.334619 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=115917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:24:25.334768 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=115916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:24:25.334914 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=115917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:24:25.335066 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=115916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:24:25.335222 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=115917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:24:25.335378 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=115916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:24:25.335525 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=115917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:24:25.335677 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=115916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:24:25.335870 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=115917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:24:25.336034 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=115916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:24:25.336189 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=115917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:24:25.336189 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=115917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:24:25.336605 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=115916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:24:25.336758 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=115917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:24:25.336956 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=115916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:24:25.337102 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=115917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:24:25.337259 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=115916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:24:25.337420 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=115917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:24:25.337576 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=115916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:24:25.337722 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=115917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:24:25.337876 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=115916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:24:25.338034 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=115917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:24:25.338229 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=115916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:24:25.338387 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=115917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:24:25.338541 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=115916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:24:25.338687 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=115917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:24:25.338840 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=115916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:24:25.338993 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=115917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:24:25.339148 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=115916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:24:25.339296 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=115917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:24:25.339442 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=115916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:24:25.339595 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=115917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:24:25.339750 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=115916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:24:25.339935 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=115917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:24:25.340074 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=115916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:24:25.340174 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=115917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:24:25.340267 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=115916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:24:25.340350 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=115917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:24:25.340431 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=115916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:24:25.340431 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=115916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:24:25.340585 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=115917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:24:25.340664 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=115916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:24:25.340743 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=115917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:24:25.340846 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=115916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:24:25.340932 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=115917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:24:25.341023 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=115916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:24:25.341109 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=115917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:24:25.341198 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=115916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:24:25.341281 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=115917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:24:25.341370 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=115916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:24:25.341460 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=115917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:24:25.341566 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=115916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:24:25.341809 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=115917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:24:25.341928 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=115916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:24:25.342014 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=115917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:24:25.342104 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=115916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:24:25.342188 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=115917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:24:25.342278 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=115916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:24:25.342363 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=115917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:24:25.342440 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=115916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:24:25.342519 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=115917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:24:25.342608 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=115916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:24:25.342698 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=115917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:24:25.342797 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=115916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:24:25.342882 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=115917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:24:25.342986 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=115916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:24:25.343077 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=115917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:24:25.343167 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=115916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:24:25.343264 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=115917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:24:25.343347 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=115916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:24:25.343430 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=115917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:24:25.343519 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=115916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:24:25.343603 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=115917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:24:25.343684 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=115916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:24:25.343775 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=115917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:24:25.343867 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=115916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:24:25.343960 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=115917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:24:25.344050 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=115916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:24:25.344133 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=115917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:24:25.344221 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=115916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:24:25.344221 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=115916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:24:25.344386 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=115917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:24:25.344477 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=115916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:24:25.344566 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=115917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:24:25.344566 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=115917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:24:25.344715 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=115916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:24:25.344834 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=115917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:24:25.344920 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=115916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:24:25.345015 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=115917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:24:25.345099 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=115916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:24:25.345181 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=115917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:24:25.345270 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=115916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:24:25.345270 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=115916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:24:25.345427 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=115917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:24:25.345629 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=115916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:24:25.345718 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=115917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:24:25.345810 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=115916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:24:25.345903 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=115917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:24:25.345987 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=115916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:24:25.346068 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=115917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:24:25.346157 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=115916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:24:25.346247 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=115917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:24:25.346337 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=115916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:24:25.346434 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=115917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:24:25.346527 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=115916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:24:25.346625 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=115917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:24:25.346716 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=115916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:24:25.346805 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=115917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:24:25.346888 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=115916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:24:25.346982 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=115917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:24:25.347074 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=115916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:24:25.347163 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=115917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:24:25.347245 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=115916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:24:25.347334 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=115917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:24:25.347424 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=115916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:24:25.347515 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=115917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:24:25.347600 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=115916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:24:25.347672 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=115917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:24:25.347741 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=115916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:24:25.347817 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=115917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:24:25.347901 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=115916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:24:25.347982 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=115917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:24:25.348066 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=115916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:24:25.348147 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=115917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:24:25.348228 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=115916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:24:25.348315 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=115917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:24:25.348410 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=115916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:24:25.348500 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=115917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:24:25.348589 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=115916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:24:25.348589 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=115916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:24:25.348746 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=115917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:24:25.348846 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=115916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:24:25.349643 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=115917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:24:25.349750 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=115916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:24:25.349836 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=115917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:24:25.349927 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=115916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:24:25.350011 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=115917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:24:25.350185 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=115916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:24:25.350273 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=115917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:24:25.350356 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=115916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:24:25.350438 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=115917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:24:25.350527 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=115916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:24:25.350618 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=115917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:24:25.350709 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=115916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:24:25.350794 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=115917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:24:25.350885 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=115916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:24:25.350971 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=115917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:24:25.351086 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=115916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:24:25.351175 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=115917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:24:25.351257 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=115916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:24:25.351329 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=115917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:24:25.351400 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=115916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:24:25.351477 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=115917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:24:25.351549 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=115916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:24:25.351625 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=115917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:24:25.351708 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=115916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:24:25.351803 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=115917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:24:25.351948 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=115916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:24:25.352039 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=115917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:24:25.352388 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=115917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:24:25.352480 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=115916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:24:25.352564 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=115916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:24:25.352649 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=115917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:24:25.352880 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=115916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:24:25.353139 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=115917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:24:25.353246 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=115916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:24:25.353455 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=115917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:24:25.353548 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=115916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:24:25.353787 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=115917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:24:25.353885 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=115916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:24:25.354111 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=115917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:24:25.354208 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=115916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:24:25.354428 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=115916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:24:25.354525 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=115917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:24:25.354755 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=115916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:24:25.354846 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=115917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:24:25.355067 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=115917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:24:25.355358 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=115916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:24:25.355464 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=115917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:24:25.355739 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=115916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:24:25.355840 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=115917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:24:25.356076 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=115916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:24:25.356166 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=115917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:24:25.356414 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=115916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:24:25.356519 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=115917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:24:25.356749 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=115916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:24:25.356857 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=115917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:24:25.357103 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=115916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:24:25.357205 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=115917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:24:25.357448 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=115916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:24:25.357541 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=115917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:24:25.357792 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=115916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:24:25.357881 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=115917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:24:25.358123 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=115916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:24:25.358218 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=115917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:24:25.358443 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=115916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:24:25.358542 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=115917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:24:25.358765 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=115917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:24:25.358854 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=115916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:24:25.359083 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=115916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:24:25.359205 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=115917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:24:25.359401 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=115916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:24:25.359504 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=115917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:24:25.359725 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=115916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:24:25.359819 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=115917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:24:25.360041 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=115916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:24:25.360146 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=115917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:24:25.360356 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=115916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:24:25.360461 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=115917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:24:25.360671 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=115917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:24:25.360760 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=115916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:24:25.361012 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=115917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:24:25.361117 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=115916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:24:25.361335 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=115917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:24:25.361433 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=115916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:24:25.361646 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=115916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:24:25.361736 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=115917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:24:25.361954 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=115917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:24:25.362073 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=115916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:24:25.362317 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=115917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:24:25.362427 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=115916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:24:25.362602 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=115916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:24:25.362704 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=115917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:24:25.362911 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=115917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:24:25.363081 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=115916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:24:25.363221 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=115917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:24:25.363409 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=115916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:24:25.363532 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=115917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:24:25.363861 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=115917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:24:25.364172 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=115917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:24:25.364501 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=115917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:24:25.364842 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=115917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:24:25.365161 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=115917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:24:25.365276 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=115916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:24:25.365476 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=115917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:24:25.365575 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=115916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:24:25.365788 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=115917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:24:25.366032 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=115916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:24:25.366129 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=115917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:24:25.366378 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=115916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:24:25.366483 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=115917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:24:25.366713 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=115916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:24:25.366811 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=115917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:24:25.367045 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=115916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:24:25.367140 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=115917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:24:25.367381 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=115917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:24:25.367484 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=115916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:24:25.367725 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=115916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:24:25.367841 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=115917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:24:25.368131 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=115916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:24:25.368243 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=115917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:24:25.368445 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=115916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:24:25.368549 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=115917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:24:25.368816 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=115917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:24:25.369145 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=115917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:24:25.369438 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=115916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:24:25.369559 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=115917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:24:25.369775 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=115916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:24:25.369869 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=115917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:24:25.370097 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=115917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:24:25.370188 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=115916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:24:25.370423 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=115917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:24:25.370530 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=115916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:24:25.370741 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=115916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:24:25.370833 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=115917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:24:25.371059 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=115917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:24:25.371198 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=115916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:24:25.371457 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=115917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:24:25.371560 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=115916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:24:25.371783 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=115917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:24:25.371876 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=115916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:24:25.372107 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=115917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:24:25.372222 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=115916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:24:25.372450 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=115916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:24:25.372682 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=115917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:24:25.372825 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=115916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:24:25.373099 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=115917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:24:25.373204 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=115916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:24:25.373423 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=115917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:24:25.373539 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=115916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:24:25.373744 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=115917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:24:25.374221 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=115916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:24:25.374221 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=115916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:24:25.374407 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=115917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:24:25.374496 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=115916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:24:25.374583 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=115917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:24:25.374665 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=115916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:24:25.374738 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=115917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:24:25.374971 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=115916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:24:25.375068 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=115917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:24:25.375275 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=115916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:24:25.375370 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=115917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:24:25.375586 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=115916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:24:25.375689 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=115917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:24:25.375900 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=115917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:24:25.376000 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=115916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:24:25.376239 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=115917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:24:25.376342 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=115916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:24:25.376570 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=115917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:24:25.376664 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=115916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:24:25.376930 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=115917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:24:25.377026 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=115916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:24:25.377245 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=115916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:24:25.377347 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=115917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:24:25.377554 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=115916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:24:25.377688 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=115917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:24:25.377880 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=115916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:24:25.378022 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=115917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:24:25.378185 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=115916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:24:25.378325 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=115917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:24:25.379047 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=115916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:24:25.379212 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=115917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:24:25.379356 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=115916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:24:25.379557 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=115917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:24:25.379702 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=115916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:24:25.379840 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=115917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:24:25.379979 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=115916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:24:25.380116 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=115917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:24:25.380246 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=115916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:24:25.380388 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=115917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:24:25.380519 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=115916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:24:25.380648 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=115917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:24:25.380821 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=115916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:24:25.380955 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=115917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:24:25.381098 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=115916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:24:25.381237 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=115917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:24:25.381367 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=115916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:24:25.381504 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=115917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:24:25.381634 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=115916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:24:25.381763 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=115917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:24:25.381901 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=115916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:24:25.382022 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=115917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:24:25.382141 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=115916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:24:25.382344 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=115917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:24:25.382501 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=115916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:24:25.382760 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=115917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:24:25.382904 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=115916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:24:25.383044 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=115917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:24:25.383189 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=115916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:24:25.383319 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=115917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:24:25.383463 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=115916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:24:25.383600 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=115917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:24:25.383731 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=115916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:24:25.383858 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=115917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:24:25.383985 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=115916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:24:25.384112 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=115917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:24:25.384255 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=115916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:24:25.384384 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=115917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:24:25.384511 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=115916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:24:25.384646 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=115917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:24:25.384800 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=115916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:24:25.384943 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=115917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:24:25.385083 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=115916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:24:25.385211 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=115916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:24:25.385337 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=115917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:24:25.385465 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=115916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:24:25.385593 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=115917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:24:25.385731 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=115916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:24:25.385885 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=115917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:24:25.386053 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=115916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:24:25.386217 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=115917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:24:25.386381 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=115916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:24:25.386547 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=115917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:24:25.386689 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=115916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:24:25.386899 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=115917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:24:25.387040 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=115916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:24:25.387224 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=115917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:24:25.387356 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=115916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:24:25.387557 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=115917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:24:25.387699 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=115916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:24:25.387875 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=115917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:24:25.388052 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=115916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:24:25.388193 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=115917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:24:25.388360 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=115916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:24:25.388492 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=115917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:24:25.388727 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=115916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:24:25.388921 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=115917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:24:25.389052 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=115916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:24:25.389184 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=115917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:24:25.389372 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=115916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:24:25.389514 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=115917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:24:25.389697 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=115916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:24:25.389829 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=115917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:24:25.390016 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=115916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:24:25.390148 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=115917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:24:25.390338 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=115916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:24:25.390479 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=115917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:24:25.390657 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=115916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:24:25.390790 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=115917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:24:25.390996 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=115916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:24:25.391188 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=115917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:24:25.391321 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=115916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:24:25.391549 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=115917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:24:25.391688 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=115916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:24:25.391872 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=115917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:24:25.392011 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=115916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:24:25.392177 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=115916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:24:25.392327 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=115917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:24:25.392470 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=115916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:24:25.392601 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=115917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:24:25.392890 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=115916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:24:25.393037 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=115917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:24:25.393167 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=115916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:24:25.393289 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=115917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:24:25.393425 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=115916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:24:25.393545 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=115917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:24:25.393749 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=115916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:24:25.393889 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=115917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:24:25.394062 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=115917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:24:25.394203 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=115916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:24:25.394382 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=115917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:24:25.394514 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=115916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:24:25.394688 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=115916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:24:25.394819 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=115917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:24:25.394995 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=115917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:24:25.395136 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=115916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:24:25.395304 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=115917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:24:25.395435 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=115916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:24:25.395614 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=115916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:24:25.395745 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=115917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:24:25.395927 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=115917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:24:25.396066 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=115916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:24:25.396271 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=115916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:24:25.396403 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=115917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:24:25.396532 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=115916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:24:25.396667 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=115917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:24:25.396856 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=115917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:24:25.396988 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=115916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:24:25.397182 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=115916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:24:25.397314 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=115917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:24:25.397491 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=115917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:24:25.397628 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=115916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:24:25.397805 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=115916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:24:25.397937 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=115917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:24:25.398112 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=115917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:24:25.398242 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=115916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:24:25.398422 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=115916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:24:25.398553 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=115917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:24:25.398730 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=115917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:24:25.398861 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=115916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:24:25.399034 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=115916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:24:25.399172 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=115917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:24:25.399340 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=115917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:24:25.399471 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=115916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:24:25.399654 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=115917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:24:25.399786 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=115916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:24:25.399952 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=115916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:24:25.400093 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=115917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:24:25.400260 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=115917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:24:25.400471 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=115916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:24:25.400604 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=115916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:24:25.400740 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=115917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:24:25.400977 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=115916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:24:25.401107 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=115917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:24:25.401235 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=115916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:24:25.401449 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=115917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:24:25.401581 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=115917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:24:25.401715 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=115916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:24:25.401912 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=115916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:24:25.402042 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=115917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:24:25.402220 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=115917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:24:25.402429 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=115916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:24:25.402696 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=115917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:24:25.402845 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=115916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:24:25.403120 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=115917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:24:25.403248 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=115916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:24:25.403377 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=115917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:24:25.403504 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=115916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:24:25.403641 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=115917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:24:25.403763 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=115916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:24:25.403922 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=115917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:24:25.404048 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=115916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:24:25.404355 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=115917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:24:25.404515 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=115916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:24:25.404614 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=115917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:24:25.404712 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=115916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:24:25.405050 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=115916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:24:25.405160 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=115917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:24:25.405352 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=115916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:24:25.405452 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=115917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:24:25.405670 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=115916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:24:25.405778 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=115917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:24:25.406034 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=115916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:24:25.406285 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=115917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:24:25.406437 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=115916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:24:25.406642 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=115916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:24:25.406784 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=115917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:24:25.407003 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=115916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:24:25.407299 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=115917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:24:25.407436 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=115916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:24:25.407575 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=115917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:24:25.407704 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=115916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:24:25.407833 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=115917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:24:25.407970 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=115916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:24:25.408099 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=115917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:24:25.408242 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=115916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:24:25.408372 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=115917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:24:25.408499 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=115916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:24:25.408628 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=115917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:24:25.408844 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=115916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:24:25.409000 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=115917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:24:25.409267 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=115916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:24:25.409400 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=115917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:24:25.409584 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=115916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:24:25.409724 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=115917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:24:25.409892 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=115916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:24:25.410033 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=115917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:24:25.410229 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=115917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:24:25.410360 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=115916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:24:25.410545 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=115917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:24:25.410686 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=115916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:24:25.410862 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=115917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:24:25.410996 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=115916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:24:25.411177 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=115917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:24:25.411311 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=115916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:24:25.411493 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=115917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:24:25.411625 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=115916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:24:25.411808 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=115917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:24:25.411959 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=115916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:24:25.412155 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=115917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:24:25.412288 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=115916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:24:25.412495 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=115916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:24:25.412632 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=115917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:24:25.412761 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=115916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:24:25.412918 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=115917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:24:25.413209 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=115916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:24:25.413351 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=115917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:24:25.413489 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=115916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:24:25.413626 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=115917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:24:25.413767 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=115916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:24:25.413906 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=115917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:24:25.414038 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=115916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:24:25.414175 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=115917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:24:25.414304 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=115916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:24:25.414433 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=115917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:24:25.414619 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=115916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:24:25.414768 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=115917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:24:25.414950 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=115916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:24:25.415077 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=115917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:24:25.415267 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=115916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:24:25.415414 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=115917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:24:25.415591 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=115916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:24:25.415725 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=115917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:24:25.415901 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=115917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:24:25.416033 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=115916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:24:25.416315 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=115916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:24:25.416446 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=115917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:24:25.416628 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=115916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:24:25.416761 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=115917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:24:25.416977 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=115917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:24:25.417134 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=115916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:24:25.417307 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=115916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:24:25.417448 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=115917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:24:25.417617 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=115916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:24:25.417832 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=115917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:24:25.417993 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=115916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:24:25.418155 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=115917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:24:25.418295 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=115916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:24:25.418440 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=115917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:24:25.418578 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=115916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:24:25.418699 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=115917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:24:25.418887 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=115916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:24:25.419020 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=115917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:24:25.419218 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=115916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:24:25.419358 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=115917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:24:25.419532 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=115916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:24:25.419673 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=115917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:24:25.419851 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=115916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:24:25.419984 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=115917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:24:25.420166 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=115916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:24:25.420308 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=115917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:24:25.420480 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=115916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:24:25.420613 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=115917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:24:25.420801 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=115916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:24:25.420949 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=115917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:24:25.421118 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=115916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:24:25.421260 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=115917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:24:25.421444 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=115916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:24:25.421577 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=115917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:24:25.421753 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=115916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:24:25.421885 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=115917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:24:25.422077 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=115916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:24:25.422212 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=115917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:24:25.422392 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=115916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:24:25.422534 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=115917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:24:25.422717 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=115916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:24:25.422854 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=115917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:24:25.423055 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=115916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:24:25.423345 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=115917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:24:25.423489 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=115916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:24:25.423620 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=115917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:24:25.423757 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=115916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:24:25.423902 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=115917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:24:25.424039 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=115916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:24:25.424170 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=115917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:24:25.424305 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=115916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:24:25.424441 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=115917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:24:25.424576 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=115916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:24:25.424714 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=115917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:24:25.424959 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=115916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:24:25.425090 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=115917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:24:25.425230 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=115916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:24:25.425361 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=115917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:24:25.425497 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=115916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:24:25.425679 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=115917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:24:25.425819 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=115916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:24:25.425948 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=115917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:24:25.426132 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=115916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:24:25.426276 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=115917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:24:25.426465 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=115917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:24:25.426610 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=115916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:24:25.426776 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=115916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:24:25.426906 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=115917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:24:25.427088 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=115917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:24:25.427226 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=115916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:24:25.427407 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 2 {{(pid=115917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:24:25.427548 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=115916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:24:25.427735 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=115916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:24:25.427866 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=115917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:24:25.428045 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=115917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:24:25.428176 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=115916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:24:25.428372 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=115916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:24:25.428512 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=115917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:24:25.428680 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=115916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:24:25.428840 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=115917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:24:25.429012 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=115916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:24:25.429153 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=115917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:24:25.429326 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=115916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:24:25.429453 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=115917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:24:25.429634 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=115916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:24:25.429776 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=115917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:24:25.429940 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=115916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:24:25.430073 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=115917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:24:25.430248 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=115916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:24:25.430383 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=115917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:24:25.430560 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=115916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:24:25.430700 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=115917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:24:25.430865 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=115916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:24:25.431008 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=115917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:24:25.431173 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=115916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:24:25.431307 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=115917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:24:25.431476 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=115916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:24:25.431616 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=115917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:24:25.431802 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=115916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:24:25.431945 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=115917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:24:25.432107 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=115916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:24:25.432241 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=115917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:24:25.432432 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=115916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:24:25.432574 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=115917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:24:25.433131 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=115916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:24:25.433503 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=115917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:24:25.433787 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=115916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:24:25.433923 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=115917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:24:25.434075 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=115916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:24:25.434259 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=115917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:24:25.434396 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=115916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:24:25.434526 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=115917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:24:25.434664 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=115916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:24:25.434795 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=115917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:24:25.434924 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=115916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:24:25.435053 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=115917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:24:25.435192 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=115916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:24:25.435313 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=115917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:24:25.435432 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=115916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:24:25.435552 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=115917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:24:25.435671 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=115916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:24:25.435984 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=115917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:24:25.436140 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=115916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:24:25.436272 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=115917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Nov 17 03:24:25.436401 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=115916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:24:25.436577 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=115916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:24:25.436930 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=115916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:24:25.437253 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=115916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:24:25.437575 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=115916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:24:25.437898 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=115916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:24:25.438218 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=115916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:24:25.438538 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=115916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:24:25.438858 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=115916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:24:25.439173 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=115916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:24:25.439493 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=115916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:24:25.439812 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=115916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:24:25.440130 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=115916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:24:25.440686 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=115916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:24:25.441045 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=115916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:24:25.441368 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=115916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:24:25.441684 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=115916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:24:25.441999 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=115916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:24:25.442318 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=115916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:24:25.442636 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=115916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:24:25.442952 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=115916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:24:25.443269 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=115916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:24:25.443582 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=115916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:24:25.443893 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=115916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:24:25.444224 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=115916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:24:25.444551 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=115916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:24:25.444905 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=115916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:24:25.445246 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=115916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:24:25.445567 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=115916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:24:25.445886 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=115916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:24:25.446204 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=115916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:24:25.446517 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=115916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:24:25.446876 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=115916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:24:25.447192 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=115916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:24:25.447499 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=115916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:24:25.447813 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=115916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:24:25.448131 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=115916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:24:25.448447 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=115916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:24:25.448762 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=115916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:24:25.449098 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=115916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:24:25.449508 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=115916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:24:25.449818 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=115916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:24:25.450133 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=115916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:24:25.450443 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=115916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:24:25.450760 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=115916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:24:25.451075 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=115916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:24:25.451401 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=115916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:24:25.451736 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=115916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:24:25.452056 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=115916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:24:25.452372 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=115916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:24:25.452740 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=115916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:24:25.453028 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=115916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:24:25.453549 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=115916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:24:25.453865 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=115916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:24:25.454199 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=115916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:24:25.454527 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=115916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:24:25.454863 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=115916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:24:25.455186 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=115916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:24:25.455504 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=115916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:24:25.455830 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=115916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:24:25.456155 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=115916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:24:25.456453 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=115916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:24:25.456759 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=115916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:24:25.457107 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=115916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:24:25.457400 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=115916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:24:25.457723 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=115916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:24:25.458037 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=115916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:24:25.458345 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=115916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:24:25.458670 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=115916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:24:25.458981 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=115916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:24:25.459532 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=115916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:24:25.459882 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=115916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:24:25.460003 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_db.sqlalchemy.engines [None req-51597b0d-dc65-4c33-985c-1967bf7b987b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=115917) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Nov 17 03:24:25.460198 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=115916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:24:25.460522 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=115916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:24:25.460882 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=115916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:24:25.461201 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=115916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:24:25.461516 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=115916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:24:25.461835 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=115916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:24:25.462143 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=115916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:24:25.462450 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=115916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:24:25.462765 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=115916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:24:25.463076 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=115916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:24:25.463383 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=115916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:24:25.463691 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=115916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:24:25.464008 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=115916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:24:25.464350 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=115916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:24:25.464622 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=115916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:24:25.465065 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=115916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:24:25.465387 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=115916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:24:25.465710 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=115916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:24:25.466021 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=115916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:24:25.466327 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=115916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:24:25.466634 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=115916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:24:25.466948 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=115916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:24:25.467253 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=115916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:24:25.467556 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=115916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:24:25.467864 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=115916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:24:25.468168 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=115916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:24:25.468481 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=115916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:24:25.468831 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=115916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:24:25.469143 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=115916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:24:25.469445 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=115916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:24:25.469759 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=115916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:24:25.470064 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=115916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:24:25.470432 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=115916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:24:25.470700 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=115916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:24:25.470997 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=115916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:24:25.471300 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=115916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:24:25.471602 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=115916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:24:25.471920 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=115916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:24:25.472232 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=115916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:24:25.472554 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=115916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:24:25.472888 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=115916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:24:25.473202 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=115916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:24:25.473551 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=115916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:24:25.473866 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=115916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:24:25.474448 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=115916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:24:25.474796 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=115916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:24:25.475123 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=115916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:24:25.475471 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=115916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:24:25.475814 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=115916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:24:25.476123 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=115916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:24:25.476433 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=115916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:24:25.476739 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=115916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:24:25.477088 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=115916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:24:25.477403 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=115916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:24:25.477718 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=115916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:24:25.478031 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=115916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:24:25.478342 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=115916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:24:25.478653 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=115916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:24:25.478965 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=115916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:24:25.479275 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=115916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:24:25.479584 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=115916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:24:25.479895 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=115916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:24:25.480234 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=115916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:24:25.480603 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=115916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:24:25.480951 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=115916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:24:25.481274 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=115916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:24:25.481593 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=115916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:24:25.481906 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=115916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:24:25.482219 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=115916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:24:25.482529 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=115916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:24:25.482838 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=115916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:24:25.483155 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=115916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:24:25.483487 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=115916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:24:25.483801 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=115916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:24:25.484111 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=115916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:24:25.484557 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=115916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:24:25.484878 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=115916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:24:25.485202 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=115916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:24:25.485521 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=115916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:24:25.485838 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=115916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:24:25.486156 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=115916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:24:25.486480 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=115916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:24:25.486793 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=115916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:24:25.487117 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=115916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:24:25.487428 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=115916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:24:25.487759 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=115916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:24:25.488098 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=115916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:24:25.488426 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=115916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:24:25.488752 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=115916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:24:25.489084 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=115916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:24:25.489391 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=115916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:24:25.489696 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=115916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:24:25.490006 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=115916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:24:25.490347 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=115916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:24:25.490664 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=115916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:24:25.490988 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=115916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:24:25.491316 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=115916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:24:25.491622 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=115916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:24:25.491933 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=115916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:24:25.492256 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=115916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:24:25.492579 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=115916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:24:25.492935 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=115916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:24:25.493250 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=115916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:24:25.493584 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=115916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:24:25.493895 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=115916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:24:25.494211 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=115916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:24:25.494674 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=115916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:24:25.494831 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=115916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:24:25.495138 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=115916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:24:25.495451 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=115916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:24:25.495763 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 2 {{(pid=115916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:24:25.496096 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=115916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:24:25.496474 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=115916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:24:25.496755 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=115916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:24:25.497100 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=115916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:24:25.497425 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=115916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:24:25.497744 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=115916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:24:25.498060 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=115916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:24:25.498390 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=115916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:24:25.498705 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=115916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:24:25.499029 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=115916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:24:25.499368 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=115916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:24:25.499707 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=115916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:24:25.500066 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=115916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:24:25.500318 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=115916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:24:25.500646 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=115916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:24:25.500998 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=115916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:24:25.501327 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=115916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:24:25.501735 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=115916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:24:25.502006 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=115916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:24:25.502321 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=115916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:24:25.502669 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=115916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:24:25.503000 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=115916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:24:25.503318 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=115916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:24:25.503636 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=115916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:24:25.503943 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=115916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 17 03:24:25.504189 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=115916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Nov 17 03:24:25.527899 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_db.sqlalchemy.engines [None req-43f84c45-17f6-440c-9f47-22a1cd838f5e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=115916) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Nov 17 03:24:25.622778 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.context [None req-51597b0d-dc65-4c33-985c-1967bf7b987b None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),8d6d2374-cf51-40eb-9f65-96e5f5e4c457(cell1) {{(pid=115917) load_cells /opt/stack/nova/nova/context.py:464}} Nov 17 03:24:25.627491 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-51597b0d-dc65-4c33-985c-1967bf7b987b None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:24:25.629158 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-51597b0d-dc65-4c33-985c-1967bf7b987b None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:24:25.630035 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-51597b0d-dc65-4c33-985c-1967bf7b987b None None] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:24:25.632059 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-51597b0d-dc65-4c33-985c-1967bf7b987b None None] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:24:25.643718 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_db.sqlalchemy.engines [None req-51597b0d-dc65-4c33-985c-1967bf7b987b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=115917) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Nov 17 03:24:25.644587 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_db.sqlalchemy.engines [None req-51597b0d-dc65-4c33-985c-1967bf7b987b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=115917) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Nov 17 03:24:25.690096 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.context [None req-43f84c45-17f6-440c-9f47-22a1cd838f5e None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),8d6d2374-cf51-40eb-9f65-96e5f5e4c457(cell1) {{(pid=115916) load_cells /opt/stack/nova/nova/context.py:464}} Nov 17 03:24:25.694590 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-43f84c45-17f6-440c-9f47-22a1cd838f5e None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:24:25.696172 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-43f84c45-17f6-440c-9f47-22a1cd838f5e None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:24:25.697011 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-43f84c45-17f6-440c-9f47-22a1cd838f5e None None] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:24:25.698958 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-43f84c45-17f6-440c-9f47-22a1cd838f5e None None] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:24:25.710195 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_db.sqlalchemy.engines [None req-43f84c45-17f6-440c-9f47-22a1cd838f5e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=115916) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Nov 17 03:24:25.710933 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_db.sqlalchemy.engines [None req-43f84c45-17f6-440c-9f47-22a1cd838f5e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=115916) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Nov 17 03:24:25.805648 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_db.sqlalchemy.engines [None req-51597b0d-dc65-4c33-985c-1967bf7b987b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=115917) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Nov 17 03:24:25.869469 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_db.sqlalchemy.engines [None req-43f84c45-17f6-440c-9f47-22a1cd838f5e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=115916) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Nov 17 03:24:26.134439 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: WARNING keystonemiddleware.auth_token [None req-51597b0d-dc65-4c33-985c-1967bf7b987b None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Nov 17 03:24:26.141846 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: WARNING keystonemiddleware.auth_token [None req-51597b0d-dc65-4c33-985c-1967bf7b987b None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Nov 17 03:24:26.196961 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: WARNING keystonemiddleware.auth_token [None req-43f84c45-17f6-440c-9f47-22a1cd838f5e None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Nov 17 03:24:26.203761 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: WARNING keystonemiddleware.auth_token [None req-43f84c45-17f6-440c-9f47-22a1cd838f5e None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Nov 17 03:24:26.487730 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: WARNING keystonemiddleware.auth_token [None req-51597b0d-dc65-4c33-985c-1967bf7b987b None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Nov 17 03:24:26.493245 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: WARNING keystonemiddleware.auth_token [None req-51597b0d-dc65-4c33-985c-1967bf7b987b None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Nov 17 03:24:26.498908 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x555fa0c869c0 pid: 115917 (default app) Nov 17 03:24:26.546249 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: WARNING keystonemiddleware.auth_token [None req-43f84c45-17f6-440c-9f47-22a1cd838f5e None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Nov 17 03:24:26.551476 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: WARNING keystonemiddleware.auth_token [None req-43f84c45-17f6-440c-9f47-22a1cd838f5e None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Nov 17 03:24:26.556855 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x555fa0c869c0 pid: 115916 (default app) Nov 17 03:25:00.152156 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-dd21af2d-8f9a-4f64-afe4-94b409524c6a tempest-VolumesGetTestJSON-170842905 tempest-VolumesGetTestJSON-170842905-project] Action: 'create', calling method: .version_select at 0x7f9e1eff3d30>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-68069792", "metadata": {"Type": "work"}}} {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 17 03:25:00.707626 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-f9e062a8-4a29-482d-8ab3-c85fa016684d tempest-VolumesSnapshotsTestJSON-1717954301 tempest-VolumesSnapshotsTestJSON-1717954301-project] Action: 'create', calling method: .version_select at 0x7f9e1eff3d30>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-1756349446"}} {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 17 03:25:02.223762 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-dd21af2d-8f9a-4f64-afe4-94b409524c6a tempest-VolumesGetTestJSON-170842905 tempest-VolumesGetTestJSON-170842905-project] 10.222.0.11 "POST /compute/v2.1/os-volumes" status: 200 len: 351 microversion: 2.1 time: 3.348328 Nov 17 03:25:02.224544 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 1/1] 10.222.0.11 () {60 vars in 1155 bytes} [Wed Nov 17 03:24:58 2021] POST /compute/v2.1/os-volumes => generated 351 bytes in 3351 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Nov 17 03:25:02.301622 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-9cae2888-46ff-4273-aa51-7bf6418ed68a tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1541281208", "imageRef": "7281a37a-6b99-49c1-881a-41604d06bae1", "flavorRef": "452", "networks": [{"uuid": "35db41f0-fe89-4e18-9f58-e0afb8774292"}]}} {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 17 03:25:02.365662 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-f9e062a8-4a29-482d-8ab3-c85fa016684d tempest-VolumesSnapshotsTestJSON-1717954301 tempest-VolumesSnapshotsTestJSON-1717954301-project] 10.222.0.11 "POST /compute/v2.1/os-volumes" status: 200 len: 345 microversion: 2.1 time: 2.887607 Nov 17 03:25:02.367879 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 1/2] 10.222.0.11 () {60 vars in 1154 bytes} [Wed Nov 17 03:24:59 2021] POST /compute/v2.1/os-volumes => generated 345 bytes in 2893 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Nov 17 03:25:02.378256 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-98cd1c31-94c4-498e-8957-1bfb7df33185 tempest-VolumesGetTestJSON-170842905 tempest-VolumesGetTestJSON-170842905-project] Calling method '.version_select at 0x7f9e1ee438b0>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:25:02.485686 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-98cd1c31-94c4-498e-8957-1bfb7df33185 tempest-VolumesGetTestJSON-170842905 tempest-VolumesGetTestJSON-170842905-project] 10.222.0.11 "GET /compute/v2.1/os-volumes/073b4f9b-687b-4aa9-acf0-9805d177e50e" status: 200 len: 351 microversion: 2.1 time: 0.115437 Nov 17 03:25:02.486281 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 2/3] 10.222.0.11 () {58 vars in 1244 bytes} [Wed Nov 17 03:25:02 2021] GET /compute/v2.1/os-volumes/073b4f9b-687b-4aa9-acf0-9805d177e50e => generated 351 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 17 03:25:02.494355 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-76ccfb85-4a2d-4048-9d1a-5aa90fb009cd tempest-VolumesSnapshotsTestJSON-1717954301 tempest-VolumesSnapshotsTestJSON-1717954301-project] Calling method '.version_select at 0x7f9e1ee43dc0>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:25:02.517939 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.network.neutron [None req-9cae2888-46ff-4273-aa51-7bf6418ed68a tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] validate_networks() for [('35db41f0-fe89-4e18-9f58-e0afb8774292', None, None, None, None, None)] {{(pid=115917) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Nov 17 03:25:02.671237 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-76ccfb85-4a2d-4048-9d1a-5aa90fb009cd tempest-VolumesSnapshotsTestJSON-1717954301 tempest-VolumesSnapshotsTestJSON-1717954301-project] 10.222.0.11 "GET /compute/v2.1/os-volumes/5ee3939f-d7ab-4760-a84c-b61cdedad1b7" status: 200 len: 345 microversion: 2.1 time: 0.183803 Nov 17 03:25:02.671899 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 3/4] 10.222.0.11 () {58 vars in 1244 bytes} [Wed Nov 17 03:25:02 2021] GET /compute/v2.1/os-volumes/5ee3939f-d7ab-4760-a84c-b61cdedad1b7 => generated 345 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 17 03:25:03.067645 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-814429f4-9485-4ae2-85c2-49013a754507 tempest-DeleteServersTestJSON-1805612840 tempest-DeleteServersTestJSON-1805612840-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1257588081", "imageRef": "7281a37a-6b99-49c1-881a-41604d06bae1", "flavorRef": "452", "networks": [{"uuid": "14c1d1d7-42c0-4da0-93ab-2c6f90ac2395"}]}} {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 17 03:25:03.266839 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.network.neutron [None req-814429f4-9485-4ae2-85c2-49013a754507 tempest-DeleteServersTestJSON-1805612840 tempest-DeleteServersTestJSON-1805612840-project] validate_networks() for [('14c1d1d7-42c0-4da0-93ab-2c6f90ac2395', None, None, None, None, None)] {{(pid=115916) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Nov 17 03:25:04.173633 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.virt.hardware [None req-9cae2888-46ff-4273-aa51-7bf6418ed68a tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] Flavor limits 0:0:0 {{(pid=115917) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 17 03:25:04.174314 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.virt.hardware [None req-9cae2888-46ff-4273-aa51-7bf6418ed68a tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] Image limits 0:0:0 {{(pid=115917) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 17 03:25:04.175033 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.virt.hardware [None req-9cae2888-46ff-4273-aa51-7bf6418ed68a tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] Flavor pref 0:0:0 {{(pid=115917) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 17 03:25:04.175621 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.virt.hardware [None req-9cae2888-46ff-4273-aa51-7bf6418ed68a tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] Image pref 0:0:0 {{(pid=115917) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 17 03:25:04.176197 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.virt.hardware [None req-9cae2888-46ff-4273-aa51-7bf6418ed68a tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=115917) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 17 03:25:04.192218 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-9cae2888-46ff-4273-aa51-7bf6418ed68a tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:25:04.193392 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-9cae2888-46ff-4273-aa51-7bf6418ed68a tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:25:04.194427 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-9cae2888-46ff-4273-aa51-7bf6418ed68a tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:25:04.195126 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-9cae2888-46ff-4273-aa51-7bf6418ed68a tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:25:04.266787 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.quota [None req-9cae2888-46ff-4273-aa51-7bf6418ed68a tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] Getting quotas for project dfc480343d4d493bb4295b055e274df5. Resources: {'instances', 'ram', 'cores'} {{(pid=115917) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 17 03:25:04.285224 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.quota [None req-9cae2888-46ff-4273-aa51-7bf6418ed68a tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] Getting quotas for user 6d4e8ac9538f42c9b637bd9e086668b3 and project dfc480343d4d493bb4295b055e274df5. Resources: {'instances', 'ram', 'cores'} {{(pid=115917) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 17 03:25:04.313879 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-9cae2888-46ff-4273-aa51-7bf6418ed68a tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] Going to run 1 instances... {{(pid=115917) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 17 03:25:04.318334 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-9cae2888-46ff-4273-aa51-7bf6418ed68a tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] [instance: 61d387ba-e928-4e5f-a79c-4f757643903c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='7281a37a-6b99-49c1-881a-41604d06bae1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=115917) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 17 03:25:04.386324 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.virt.hardware [None req-814429f4-9485-4ae2-85c2-49013a754507 tempest-DeleteServersTestJSON-1805612840 tempest-DeleteServersTestJSON-1805612840-project] Flavor limits 0:0:0 {{(pid=115916) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 17 03:25:04.387715 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.virt.hardware [None req-814429f4-9485-4ae2-85c2-49013a754507 tempest-DeleteServersTestJSON-1805612840 tempest-DeleteServersTestJSON-1805612840-project] Image limits 0:0:0 {{(pid=115916) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 17 03:25:04.388399 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.virt.hardware [None req-814429f4-9485-4ae2-85c2-49013a754507 tempest-DeleteServersTestJSON-1805612840 tempest-DeleteServersTestJSON-1805612840-project] Flavor pref 0:0:0 {{(pid=115916) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 17 03:25:04.388890 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.virt.hardware [None req-814429f4-9485-4ae2-85c2-49013a754507 tempest-DeleteServersTestJSON-1805612840 tempest-DeleteServersTestJSON-1805612840-project] Image pref 0:0:0 {{(pid=115916) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 17 03:25:04.389482 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.virt.hardware [None req-814429f4-9485-4ae2-85c2-49013a754507 tempest-DeleteServersTestJSON-1805612840 tempest-DeleteServersTestJSON-1805612840-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=115916) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 17 03:25:04.422089 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-814429f4-9485-4ae2-85c2-49013a754507 tempest-DeleteServersTestJSON-1805612840 tempest-DeleteServersTestJSON-1805612840-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:25:04.423031 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-814429f4-9485-4ae2-85c2-49013a754507 tempest-DeleteServersTestJSON-1805612840 tempest-DeleteServersTestJSON-1805612840-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:25:04.424711 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-814429f4-9485-4ae2-85c2-49013a754507 tempest-DeleteServersTestJSON-1805612840 tempest-DeleteServersTestJSON-1805612840-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:25:04.425468 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-814429f4-9485-4ae2-85c2-49013a754507 tempest-DeleteServersTestJSON-1805612840 tempest-DeleteServersTestJSON-1805612840-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:25:04.456607 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-9cae2888-46ff-4273-aa51-7bf6418ed68a tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] 10.222.0.11 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.223731 Nov 17 03:25:04.460852 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.quota [None req-814429f4-9485-4ae2-85c2-49013a754507 tempest-DeleteServersTestJSON-1805612840 tempest-DeleteServersTestJSON-1805612840-project] Getting quotas for project 37560cd5b14f43cd85ee2a3ff2716c33. Resources: {'instances', 'ram', 'cores'} {{(pid=115916) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 17 03:25:04.473045 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 2/5] 10.222.0.11 () {60 vars in 1146 bytes} [Wed Nov 17 03:25:02 2021] POST /compute/v2.1/servers => generated 380 bytes in 2243 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 17 03:25:04.473396 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.quota [None req-814429f4-9485-4ae2-85c2-49013a754507 tempest-DeleteServersTestJSON-1805612840 tempest-DeleteServersTestJSON-1805612840-project] Getting quotas for user 65322b3497864a64870eadab1ff7d490 and project 37560cd5b14f43cd85ee2a3ff2716c33. Resources: {'instances', 'ram', 'cores'} {{(pid=115916) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 17 03:25:04.479204 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-21c22463-34af-42f8-a79b-586523f2cae5 tempest-VolumesGetTestJSON-170842905 tempest-VolumesGetTestJSON-170842905-project] Calling method '.version_select at 0x7f9e1e565040>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:25:04.503431 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-814429f4-9485-4ae2-85c2-49013a754507 tempest-DeleteServersTestJSON-1805612840 tempest-DeleteServersTestJSON-1805612840-project] Going to run 1 instances... {{(pid=115916) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 17 03:25:04.516206 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-814429f4-9485-4ae2-85c2-49013a754507 tempest-DeleteServersTestJSON-1805612840 tempest-DeleteServersTestJSON-1805612840-project] [instance: eaeb6520-bd1e-495e-9ada-744682cbc122] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='7281a37a-6b99-49c1-881a-41604d06bae1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=115916) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 17 03:25:04.586083 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-21c22463-34af-42f8-a79b-586523f2cae5 tempest-VolumesGetTestJSON-170842905 tempest-VolumesGetTestJSON-170842905-project] 10.222.0.11 "GET /compute/v2.1/os-volumes/073b4f9b-687b-4aa9-acf0-9805d177e50e" status: 200 len: 352 microversion: 2.1 time: 0.116877 Nov 17 03:25:04.586920 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 3/6] 10.222.0.11 () {58 vars in 1244 bytes} [Wed Nov 17 03:25:04 2021] GET /compute/v2.1/os-volumes/073b4f9b-687b-4aa9-acf0-9805d177e50e => generated 352 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 17 03:25:04.598584 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-9017e870-8cac-4c26-8c82-af8e204f1696 tempest-VolumesSnapshotsTestJSON-1717954301 tempest-VolumesSnapshotsTestJSON-1717954301-project] Calling method '.version_select at 0x7f9e1e565ca0>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:25:04.693121 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-814429f4-9485-4ae2-85c2-49013a754507 tempest-DeleteServersTestJSON-1805612840 tempest-DeleteServersTestJSON-1805612840-project] 10.222.0.11 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.764196 Nov 17 03:25:04.697403 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 4/7] 10.222.0.11 () {60 vars in 1146 bytes} [Wed Nov 17 03:25:02 2021] POST /compute/v2.1/servers => generated 380 bytes in 1772 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 17 03:25:04.716245 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-9017e870-8cac-4c26-8c82-af8e204f1696 tempest-VolumesSnapshotsTestJSON-1717954301 tempest-VolumesSnapshotsTestJSON-1717954301-project] 10.222.0.11 "GET /compute/v2.1/os-volumes/5ee3939f-d7ab-4760-a84c-b61cdedad1b7" status: 200 len: 346 microversion: 2.1 time: 0.121072 Nov 17 03:25:04.716849 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 4/8] 10.222.0.11 () {58 vars in 1244 bytes} [Wed Nov 17 03:25:04 2021] GET /compute/v2.1/os-volumes/5ee3939f-d7ab-4760-a84c-b61cdedad1b7 => generated 346 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 17 03:25:04.721376 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-2bbd1b1d-c79b-42d0-948d-f67fe0070aa3 tempest-VolumesGetTestJSON-170842905 tempest-VolumesGetTestJSON-170842905-project] Calling method '.version_select at 0x7f9e1e5651f0>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:25:04.733288 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-c846f1da-e26d-44d2-8f3e-35fb99971dce tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:25:04.733934 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-c846f1da-e26d-44d2-8f3e-35fb99971dce tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] [instance: 61d387ba-e928-4e5f-a79c-4f757643903c] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:25:04.830303 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-2bbd1b1d-c79b-42d0-948d-f67fe0070aa3 tempest-VolumesGetTestJSON-170842905 tempest-VolumesGetTestJSON-170842905-project] 10.222.0.11 "GET /compute/v2.1/os-volumes/073b4f9b-687b-4aa9-acf0-9805d177e50e" status: 200 len: 352 microversion: 2.1 time: 0.112137 Nov 17 03:25:04.830972 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 5/9] 10.222.0.11 () {58 vars in 1244 bytes} [Wed Nov 17 03:25:04 2021] GET /compute/v2.1/os-volumes/073b4f9b-687b-4aa9-acf0-9805d177e50e => generated 352 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 17 03:25:04.848018 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-100c0bf0-4503-4429-9510-f5d767f46da1 tempest-DeleteServersTestJSON-1805612840 tempest-DeleteServersTestJSON-1805612840-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:25:04.861746 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-100c0bf0-4503-4429-9510-f5d767f46da1 tempest-DeleteServersTestJSON-1805612840 tempest-DeleteServersTestJSON-1805612840-project] [instance: eaeb6520-bd1e-495e-9ada-744682cbc122] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:25:05.031322 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-c846f1da-e26d-44d2-8f3e-35fb99971dce tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d4e8ac9538f42c9b637bd9e086668b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfc480343d4d493bb4295b055e274df5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:25:05.060091 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-c846f1da-e26d-44d2-8f3e-35fb99971dce tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] 10.222.0.11 "GET /compute/v2.1/servers/61d387ba-e928-4e5f-a79c-4f757643903c" status: 200 len: 1218 microversion: 2.1 time: 0.360712 Nov 17 03:25:05.072341 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 5/10] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:25:04 2021] GET /compute/v2.1/servers/61d387ba-e928-4e5f-a79c-4f757643903c => generated 1218 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:25:05.084486 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-8a461a33-5609-46db-aa45-229dc9364d02 tempest-VolumesSnapshotsTestJSON-1717954301 tempest-VolumesSnapshotsTestJSON-1717954301-project] Action: 'create', calling method: .version_select at 0x7f9e1dcfea60>, body: {"snapshot": {"volume_id": "5ee3939f-d7ab-4760-a84c-b61cdedad1b7", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-648506559"}} {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 17 03:25:05.177773 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-100c0bf0-4503-4429-9510-f5d767f46da1 tempest-DeleteServersTestJSON-1805612840 tempest-DeleteServersTestJSON-1805612840-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65322b3497864a64870eadab1ff7d490', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37560cd5b14f43cd85ee2a3ff2716c33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:25:05.224299 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-100c0bf0-4503-4429-9510-f5d767f46da1 tempest-DeleteServersTestJSON-1805612840 tempest-DeleteServersTestJSON-1805612840-project] 10.222.0.11 "GET /compute/v2.1/servers/eaeb6520-bd1e-495e-9ada-744682cbc122" status: 200 len: 1215 microversion: 2.1 time: 0.369059 Nov 17 03:25:05.225635 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 6/11] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:25:04 2021] GET /compute/v2.1/servers/eaeb6520-bd1e-495e-9ada-744682cbc122 => generated 1215 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:25:05.233782 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-51167cf9-748f-4738-bc18-6f854434753e tempest-VolumesGetTestJSON-170842905 tempest-VolumesGetTestJSON-170842905-project] Calling method '.version_select at 0x7f9e1dcf7b80>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:25:05.447643 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-51167cf9-748f-4738-bc18-6f854434753e tempest-VolumesGetTestJSON-170842905 tempest-VolumesGetTestJSON-170842905-project] 10.222.0.11 "DELETE /compute/v2.1/os-volumes/073b4f9b-687b-4aa9-acf0-9805d177e50e" status: 202 len: 0 microversion: 2.1 time: 0.219427 Nov 17 03:25:05.448594 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 7/12] 10.222.0.11 () {58 vars in 1247 bytes} [Wed Nov 17 03:25:05 2021] DELETE /compute/v2.1/os-volumes/073b4f9b-687b-4aa9-acf0-9805d177e50e => generated 0 bytes in 222 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 17 03:25:05.465138 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-3dd9c9a4-f714-462e-bde1-9d2ef253f25c tempest-VolumesGetTestJSON-170842905 tempest-VolumesGetTestJSON-170842905-project] Calling method '.version_select at 0x7f9e1dcf7f70>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:25:05.513979 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-8a461a33-5609-46db-aa45-229dc9364d02 tempest-VolumesSnapshotsTestJSON-1717954301 tempest-VolumesSnapshotsTestJSON-1717954301-project] 10.222.0.11 "POST /compute/v2.1/os-snapshots" status: 200 len: 286 microversion: 2.1 time: 0.439797 Nov 17 03:25:05.514982 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 6/13] 10.222.0.11 () {60 vars in 1161 bytes} [Wed Nov 17 03:25:05 2021] POST /compute/v2.1/os-snapshots => generated 286 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 17 03:25:05.524110 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-43a15728-5f5a-4b76-b5a7-c337cc8343e5 tempest-VolumesSnapshotsTestJSON-1717954301 tempest-VolumesSnapshotsTestJSON-1717954301-project] Calling method '.version_select at 0x7f9e1dd0ee50>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:25:05.634014 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-3dd9c9a4-f714-462e-bde1-9d2ef253f25c tempest-VolumesGetTestJSON-170842905 tempest-VolumesGetTestJSON-170842905-project] 10.222.0.11 "GET /compute/v2.1/os-volumes/073b4f9b-687b-4aa9-acf0-9805d177e50e" status: 200 len: 351 microversion: 2.1 time: 0.180750 Nov 17 03:25:05.635668 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 8/14] 10.222.0.11 () {58 vars in 1244 bytes} [Wed Nov 17 03:25:05 2021] GET /compute/v2.1/os-volumes/073b4f9b-687b-4aa9-acf0-9805d177e50e => generated 351 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 17 03:25:05.793768 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-43a15728-5f5a-4b76-b5a7-c337cc8343e5 tempest-VolumesSnapshotsTestJSON-1717954301 tempest-VolumesSnapshotsTestJSON-1717954301-project] 10.222.0.11 "GET /compute/v2.1/os-snapshots/bcf20607-5aa6-4d4d-af2c-3475be8b35ca" status: 200 len: 286 microversion: 2.1 time: 0.273099 Nov 17 03:25:05.794365 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 7/15] 10.222.0.11 () {58 vars in 1250 bytes} [Wed Nov 17 03:25:05 2021] GET /compute/v2.1/os-snapshots/bcf20607-5aa6-4d4d-af2c-3475be8b35ca => generated 286 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 17 03:25:05.807205 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-cc428dfc-5956-4fd0-b059-1f7a3cff94cf tempest-VolumesSnapshotsTestJSON-1717954301 tempest-VolumesSnapshotsTestJSON-1717954301-project] Calling method '.version_select at 0x7f9e1dd15dc0>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:25:05.924290 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-cc428dfc-5956-4fd0-b059-1f7a3cff94cf tempest-VolumesSnapshotsTestJSON-1717954301 tempest-VolumesSnapshotsTestJSON-1717954301-project] 10.222.0.11 "GET /compute/v2.1/os-snapshots" status: 200 len: 289 microversion: 2.1 time: 0.123576 Nov 17 03:25:05.925005 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 9/16] 10.222.0.11 () {58 vars in 1139 bytes} [Wed Nov 17 03:25:05 2021] GET /compute/v2.1/os-snapshots => generated 289 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 17 03:25:05.938715 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-f949ecdd-a7ba-48c9-bc5c-e272b82ee57f tempest-VolumesSnapshotsTestJSON-1717954301 tempest-VolumesSnapshotsTestJSON-1717954301-project] Calling method '.version_select at 0x7f9e1dd0ed30>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:25:06.009275 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-f949ecdd-a7ba-48c9-bc5c-e272b82ee57f tempest-VolumesSnapshotsTestJSON-1717954301 tempest-VolumesSnapshotsTestJSON-1717954301-project] 10.222.0.11 "GET /compute/v2.1/os-snapshots/bcf20607-5aa6-4d4d-af2c-3475be8b35ca" status: 200 len: 286 microversion: 2.1 time: 0.077268 Nov 17 03:25:06.010490 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 8/17] 10.222.0.11 () {58 vars in 1250 bytes} [Wed Nov 17 03:25:05 2021] GET /compute/v2.1/os-snapshots/bcf20607-5aa6-4d4d-af2c-3475be8b35ca => generated 286 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 17 03:25:06.088451 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-e863b4b7-cdb9-4dcb-87a6-7616495ff06f tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:25:06.089323 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-e863b4b7-cdb9-4dcb-87a6-7616495ff06f tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] [instance: 61d387ba-e928-4e5f-a79c-4f757643903c] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:25:06.243599 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-bb0b87ce-3f82-42e3-a2da-f1e4e11f5060 tempest-DeleteServersTestJSON-1805612840 tempest-DeleteServersTestJSON-1805612840-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:25:06.244696 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-bb0b87ce-3f82-42e3-a2da-f1e4e11f5060 tempest-DeleteServersTestJSON-1805612840 tempest-DeleteServersTestJSON-1805612840-project] [instance: eaeb6520-bd1e-495e-9ada-744682cbc122] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:25:06.344842 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-e863b4b7-cdb9-4dcb-87a6-7616495ff06f tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d4e8ac9538f42c9b637bd9e086668b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfc480343d4d493bb4295b055e274df5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:25:06.358715 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-e863b4b7-cdb9-4dcb-87a6-7616495ff06f tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] 10.222.0.11 "GET /compute/v2.1/servers/61d387ba-e928-4e5f-a79c-4f757643903c" status: 200 len: 1218 microversion: 2.1 time: 0.270386 Nov 17 03:25:06.361519 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 10/18] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:25:06 2021] GET /compute/v2.1/servers/61d387ba-e928-4e5f-a79c-4f757643903c => generated 1218 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:25:06.414015 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-bb0b87ce-3f82-42e3-a2da-f1e4e11f5060 tempest-DeleteServersTestJSON-1805612840 tempest-DeleteServersTestJSON-1805612840-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65322b3497864a64870eadab1ff7d490', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37560cd5b14f43cd85ee2a3ff2716c33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:25:06.426279 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-bb0b87ce-3f82-42e3-a2da-f1e4e11f5060 tempest-DeleteServersTestJSON-1805612840 tempest-DeleteServersTestJSON-1805612840-project] 10.222.0.11 "GET /compute/v2.1/servers/eaeb6520-bd1e-495e-9ada-744682cbc122" status: 200 len: 1215 microversion: 2.1 time: 0.185715 Nov 17 03:25:06.427350 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 9/19] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:25:06 2021] GET /compute/v2.1/servers/eaeb6520-bd1e-495e-9ada-744682cbc122 => generated 1215 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:25:06.647273 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-125a4336-2155-405d-b066-f1d3fdc2b986 tempest-VolumesGetTestJSON-170842905 tempest-VolumesGetTestJSON-170842905-project] Calling method '.version_select at 0x7f9e1dd21670>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:25:06.707009 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.wsgi [None req-125a4336-2155-405d-b066-f1d3fdc2b986 tempest-VolumesGetTestJSON-170842905 tempest-VolumesGetTestJSON-170842905-project] HTTP exception thrown: Volume 073b4f9b-687b-4aa9-acf0-9805d177e50e could not be found. Nov 17 03:25:06.707658 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-125a4336-2155-405d-b066-f1d3fdc2b986 tempest-VolumesGetTestJSON-170842905 tempest-VolumesGetTestJSON-170842905-project] Returning 404 to user: Volume 073b4f9b-687b-4aa9-acf0-9805d177e50e could not be found. {{(pid=115917) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 17 03:25:06.708928 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-125a4336-2155-405d-b066-f1d3fdc2b986 tempest-VolumesGetTestJSON-170842905 tempest-VolumesGetTestJSON-170842905-project] 10.222.0.11 "GET /compute/v2.1/os-volumes/073b4f9b-687b-4aa9-acf0-9805d177e50e" status: 404 len: 109 microversion: 2.1 time: 0.065854 Nov 17 03:25:06.709988 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 11/20] 10.222.0.11 () {58 vars in 1244 bytes} [Wed Nov 17 03:25:06 2021] GET /compute/v2.1/os-volumes/073b4f9b-687b-4aa9-acf0-9805d177e50e => generated 109 bytes in 67 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 17 03:25:07.022423 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-61303c1d-ded1-474d-97ec-1e6f286ac193 tempest-VolumesSnapshotsTestJSON-1717954301 tempest-VolumesSnapshotsTestJSON-1717954301-project] Calling method '.version_select at 0x7f9e1dd1e820>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:25:07.108230 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-61303c1d-ded1-474d-97ec-1e6f286ac193 tempest-VolumesSnapshotsTestJSON-1717954301 tempest-VolumesSnapshotsTestJSON-1717954301-project] 10.222.0.11 "GET /compute/v2.1/os-snapshots/bcf20607-5aa6-4d4d-af2c-3475be8b35ca" status: 200 len: 286 microversion: 2.1 time: 0.089972 Nov 17 03:25:07.115133 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 10/21] 10.222.0.11 () {58 vars in 1250 bytes} [Wed Nov 17 03:25:07 2021] GET /compute/v2.1/os-snapshots/bcf20607-5aa6-4d4d-af2c-3475be8b35ca => generated 286 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 17 03:25:07.382025 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-b4acec38-7d2f-4ee4-9fbb-7e9db9c2198a tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:25:07.383605 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-b4acec38-7d2f-4ee4-9fbb-7e9db9c2198a tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] [instance: 61d387ba-e928-4e5f-a79c-4f757643903c] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:25:07.416272 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-b4acec38-7d2f-4ee4-9fbb-7e9db9c2198a tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:25:07.417464 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-b4acec38-7d2f-4ee4-9fbb-7e9db9c2198a tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:25:07.420499 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-b4acec38-7d2f-4ee4-9fbb-7e9db9c2198a tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:25:07.420970 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-b4acec38-7d2f-4ee4-9fbb-7e9db9c2198a tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:25:07.449663 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-7f6c70b4-c5a0-490a-90c3-c4e3f9935546 tempest-DeleteServersTestJSON-1805612840 tempest-DeleteServersTestJSON-1805612840-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:25:07.450798 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-7f6c70b4-c5a0-490a-90c3-c4e3f9935546 tempest-DeleteServersTestJSON-1805612840 tempest-DeleteServersTestJSON-1805612840-project] [instance: eaeb6520-bd1e-495e-9ada-744682cbc122] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:25:07.463843 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-7f6c70b4-c5a0-490a-90c3-c4e3f9935546 tempest-DeleteServersTestJSON-1805612840 tempest-DeleteServersTestJSON-1805612840-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:25:07.467038 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-7f6c70b4-c5a0-490a-90c3-c4e3f9935546 tempest-DeleteServersTestJSON-1805612840 tempest-DeleteServersTestJSON-1805612840-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:25:07.469036 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-7f6c70b4-c5a0-490a-90c3-c4e3f9935546 tempest-DeleteServersTestJSON-1805612840 tempest-DeleteServersTestJSON-1805612840-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:25:07.472114 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-7f6c70b4-c5a0-490a-90c3-c4e3f9935546 tempest-DeleteServersTestJSON-1805612840 tempest-DeleteServersTestJSON-1805612840-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:25:07.785682 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-b4acec38-7d2f-4ee4-9fbb-7e9db9c2198a tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d4e8ac9538f42c9b637bd9e086668b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfc480343d4d493bb4295b055e274df5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:25:07.803801 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-b4acec38-7d2f-4ee4-9fbb-7e9db9c2198a tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] 10.222.0.11 "GET /compute/v2.1/servers/61d387ba-e928-4e5f-a79c-4f757643903c" status: 200 len: 1222 microversion: 2.1 time: 0.429234 Nov 17 03:25:07.805072 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 12/22] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:25:07 2021] GET /compute/v2.1/servers/61d387ba-e928-4e5f-a79c-4f757643903c => generated 1222 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:25:07.884139 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-7f6c70b4-c5a0-490a-90c3-c4e3f9935546 tempest-DeleteServersTestJSON-1805612840 tempest-DeleteServersTestJSON-1805612840-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65322b3497864a64870eadab1ff7d490', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37560cd5b14f43cd85ee2a3ff2716c33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:25:07.911840 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-7f6c70b4-c5a0-490a-90c3-c4e3f9935546 tempest-DeleteServersTestJSON-1805612840 tempest-DeleteServersTestJSON-1805612840-project] 10.222.0.11 "GET /compute/v2.1/servers/eaeb6520-bd1e-495e-9ada-744682cbc122" status: 200 len: 1219 microversion: 2.1 time: 0.467208 Nov 17 03:25:07.920837 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 11/23] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:25:07 2021] GET /compute/v2.1/servers/eaeb6520-bd1e-495e-9ada-744682cbc122 => generated 1219 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 17 03:25:08.124701 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-501c416c-93fa-41fd-8f4d-16189b1075c1 tempest-VolumesSnapshotsTestJSON-1717954301 tempest-VolumesSnapshotsTestJSON-1717954301-project] Calling method '.version_select at 0x7f9e1dc99820>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:25:08.163769 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-501c416c-93fa-41fd-8f4d-16189b1075c1 tempest-VolumesSnapshotsTestJSON-1717954301 tempest-VolumesSnapshotsTestJSON-1717954301-project] 10.222.0.11 "GET /compute/v2.1/os-snapshots/bcf20607-5aa6-4d4d-af2c-3475be8b35ca" status: 200 len: 286 microversion: 2.1 time: 0.042743 Nov 17 03:25:08.165593 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 13/24] 10.222.0.11 () {58 vars in 1250 bytes} [Wed Nov 17 03:25:08 2021] GET /compute/v2.1/os-snapshots/bcf20607-5aa6-4d4d-af2c-3475be8b35ca => generated 286 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 17 03:25:08.833504 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-415d58e9-1d8d-4e7b-861b-04aca97961d2 tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:25:08.834475 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-415d58e9-1d8d-4e7b-861b-04aca97961d2 tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] [instance: 61d387ba-e928-4e5f-a79c-4f757643903c] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:25:08.842550 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-415d58e9-1d8d-4e7b-861b-04aca97961d2 tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:25:08.843111 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-415d58e9-1d8d-4e7b-861b-04aca97961d2 tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:25:08.848556 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-415d58e9-1d8d-4e7b-861b-04aca97961d2 tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:25:08.850160 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-415d58e9-1d8d-4e7b-861b-04aca97961d2 tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:25:08.937920 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-73ecdf36-9620-430e-abcc-f7cb5ad8e168 tempest-DeleteServersTestJSON-1805612840 tempest-DeleteServersTestJSON-1805612840-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:25:08.938964 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-73ecdf36-9620-430e-abcc-f7cb5ad8e168 tempest-DeleteServersTestJSON-1805612840 tempest-DeleteServersTestJSON-1805612840-project] [instance: eaeb6520-bd1e-495e-9ada-744682cbc122] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:25:08.952594 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-73ecdf36-9620-430e-abcc-f7cb5ad8e168 tempest-DeleteServersTestJSON-1805612840 tempest-DeleteServersTestJSON-1805612840-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:25:08.955244 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-73ecdf36-9620-430e-abcc-f7cb5ad8e168 tempest-DeleteServersTestJSON-1805612840 tempest-DeleteServersTestJSON-1805612840-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:25:08.956657 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-73ecdf36-9620-430e-abcc-f7cb5ad8e168 tempest-DeleteServersTestJSON-1805612840 tempest-DeleteServersTestJSON-1805612840-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:25:08.958598 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-73ecdf36-9620-430e-abcc-f7cb5ad8e168 tempest-DeleteServersTestJSON-1805612840 tempest-DeleteServersTestJSON-1805612840-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:25:09.008829 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-415d58e9-1d8d-4e7b-861b-04aca97961d2 tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d4e8ac9538f42c9b637bd9e086668b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfc480343d4d493bb4295b055e274df5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:25:09.018519 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-415d58e9-1d8d-4e7b-861b-04aca97961d2 tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] 10.222.0.11 "GET /compute/v2.1/servers/61d387ba-e928-4e5f-a79c-4f757643903c" status: 200 len: 1222 microversion: 2.1 time: 0.194722 Nov 17 03:25:09.019714 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 12/25] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:25:08 2021] GET /compute/v2.1/servers/61d387ba-e928-4e5f-a79c-4f757643903c => generated 1222 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:25:09.131392 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-73ecdf36-9620-430e-abcc-f7cb5ad8e168 tempest-DeleteServersTestJSON-1805612840 tempest-DeleteServersTestJSON-1805612840-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65322b3497864a64870eadab1ff7d490', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37560cd5b14f43cd85ee2a3ff2716c33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:25:09.142809 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-73ecdf36-9620-430e-abcc-f7cb5ad8e168 tempest-DeleteServersTestJSON-1805612840 tempest-DeleteServersTestJSON-1805612840-project] 10.222.0.11 "GET /compute/v2.1/servers/eaeb6520-bd1e-495e-9ada-744682cbc122" status: 200 len: 1219 microversion: 2.1 time: 0.209028 Nov 17 03:25:09.145023 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 14/26] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:25:08 2021] GET /compute/v2.1/servers/eaeb6520-bd1e-495e-9ada-744682cbc122 => generated 1219 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:25:09.176589 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-818b7550-3df6-4ffc-b547-47595ed63f08 tempest-VolumesSnapshotsTestJSON-1717954301 tempest-VolumesSnapshotsTestJSON-1717954301-project] Calling method '.version_select at 0x7f9e1dd15ee0>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:25:09.211741 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-818b7550-3df6-4ffc-b547-47595ed63f08 tempest-VolumesSnapshotsTestJSON-1717954301 tempest-VolumesSnapshotsTestJSON-1717954301-project] 10.222.0.11 "GET /compute/v2.1/os-snapshots/bcf20607-5aa6-4d4d-af2c-3475be8b35ca" status: 200 len: 286 microversion: 2.1 time: 0.038705 Nov 17 03:25:09.225152 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 15/27] 10.222.0.11 () {58 vars in 1250 bytes} [Wed Nov 17 03:25:09 2021] GET /compute/v2.1/os-snapshots/bcf20607-5aa6-4d4d-af2c-3475be8b35ca => generated 286 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 17 03:25:09.662718 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-b56db97d-5f7d-4645-9171-7531dcf0d02a tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Action: 'create', calling method: .version_select at 0x7f9e1f7d3430>, body: {"keypair": {"name": "tempest-keypair-411984522"}} {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 17 03:25:09.716413 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.quota [None req-b56db97d-5f7d-4645-9171-7531dcf0d02a tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Getting quotas for project 0ebb970305844dccacf48a7d8d47ecf4. Resources: {'key_pairs'} {{(pid=115916) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 17 03:25:09.736711 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.quota [None req-b56db97d-5f7d-4645-9171-7531dcf0d02a tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Getting quotas for user 37f21d6d15cf40a586edda211219fd08 and project 0ebb970305844dccacf48a7d8d47ecf4. Resources: {'key_pairs'} {{(pid=115916) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 17 03:25:10.044550 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-b0d3b3fa-83fd-49dc-931c-c4a4a4a5abdb tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:25:10.046660 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-b0d3b3fa-83fd-49dc-931c-c4a4a4a5abdb tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] [instance: 61d387ba-e928-4e5f-a79c-4f757643903c] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:25:10.069478 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-b0d3b3fa-83fd-49dc-931c-c4a4a4a5abdb tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:25:10.069942 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-b0d3b3fa-83fd-49dc-931c-c4a4a4a5abdb tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:25:10.084913 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-b0d3b3fa-83fd-49dc-931c-c4a4a4a5abdb tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:25:10.085400 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-b0d3b3fa-83fd-49dc-931c-c4a4a4a5abdb tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:25:10.377923 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-b0d3b3fa-83fd-49dc-931c-c4a4a4a5abdb tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d4e8ac9538f42c9b637bd9e086668b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfc480343d4d493bb4295b055e274df5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:25:10.391588 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-b0d3b3fa-83fd-49dc-931c-c4a4a4a5abdb tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] 10.222.0.11 "GET /compute/v2.1/servers/61d387ba-e928-4e5f-a79c-4f757643903c" status: 200 len: 1270 microversion: 2.1 time: 0.358235 Nov 17 03:25:10.393800 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 16/28] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:25:10 2021] GET /compute/v2.1/servers/61d387ba-e928-4e5f-a79c-4f757643903c => generated 1270 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 17 03:25:10.407837 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-5e132301-bea3-49d7-a08f-ea9ca42c0cfd tempest-DeleteServersTestJSON-1805612840 tempest-DeleteServersTestJSON-1805612840-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:25:10.410158 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-5e132301-bea3-49d7-a08f-ea9ca42c0cfd tempest-DeleteServersTestJSON-1805612840 tempest-DeleteServersTestJSON-1805612840-project] [instance: eaeb6520-bd1e-495e-9ada-744682cbc122] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:25:10.426676 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-5e132301-bea3-49d7-a08f-ea9ca42c0cfd tempest-DeleteServersTestJSON-1805612840 tempest-DeleteServersTestJSON-1805612840-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:25:10.427394 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-5e132301-bea3-49d7-a08f-ea9ca42c0cfd tempest-DeleteServersTestJSON-1805612840 tempest-DeleteServersTestJSON-1805612840-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:25:10.429417 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-5e132301-bea3-49d7-a08f-ea9ca42c0cfd tempest-DeleteServersTestJSON-1805612840 tempest-DeleteServersTestJSON-1805612840-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:25:10.430199 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-5e132301-bea3-49d7-a08f-ea9ca42c0cfd tempest-DeleteServersTestJSON-1805612840 tempest-DeleteServersTestJSON-1805612840-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:25:10.503983 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.quota [None req-b56db97d-5f7d-4645-9171-7531dcf0d02a tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Getting quotas for project 0ebb970305844dccacf48a7d8d47ecf4. Resources: {'key_pairs'} {{(pid=115916) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 17 03:25:10.516969 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.quota [None req-b56db97d-5f7d-4645-9171-7531dcf0d02a tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Getting quotas for user 37f21d6d15cf40a586edda211219fd08 and project 0ebb970305844dccacf48a7d8d47ecf4. Resources: {'key_pairs'} {{(pid=115916) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 17 03:25:10.552172 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-b56db97d-5f7d-4645-9171-7531dcf0d02a tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] 10.222.0.11 "POST /compute/v2.1/os-keypairs" status: 201 len: 2315 microversion: 2.20 time: 1.406432 Nov 17 03:25:10.561147 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 13/29] 10.222.0.11 () {62 vars in 1198 bytes} [Wed Nov 17 03:25:09 2021] POST /compute/v2.1/os-keypairs => generated 2315 bytes in 1414 msecs (HTTP/1.1 201) 9 headers in 365 bytes (1 switches on core 0) Nov 17 03:25:10.566488 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-ff8153be-00f7-47cf-9fd9-108e773b18b1 tempest-VolumesSnapshotsTestJSON-1717954301 tempest-VolumesSnapshotsTestJSON-1717954301-project] Calling method '.version_select at 0x7f9e1dcfea60>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:25:10.664763 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-ff8153be-00f7-47cf-9fd9-108e773b18b1 tempest-VolumesSnapshotsTestJSON-1717954301 tempest-VolumesSnapshotsTestJSON-1717954301-project] 10.222.0.11 "GET /compute/v2.1/os-snapshots/bcf20607-5aa6-4d4d-af2c-3475be8b35ca" status: 200 len: 287 microversion: 2.1 time: 0.108005 Nov 17 03:25:10.665597 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 14/30] 10.222.0.11 () {58 vars in 1250 bytes} [Wed Nov 17 03:25:10 2021] GET /compute/v2.1/os-snapshots/bcf20607-5aa6-4d4d-af2c-3475be8b35ca => generated 287 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 17 03:25:10.751028 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-5e132301-bea3-49d7-a08f-ea9ca42c0cfd tempest-DeleteServersTestJSON-1805612840 tempest-DeleteServersTestJSON-1805612840-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65322b3497864a64870eadab1ff7d490', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37560cd5b14f43cd85ee2a3ff2716c33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:25:10.765268 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-5e132301-bea3-49d7-a08f-ea9ca42c0cfd tempest-DeleteServersTestJSON-1805612840 tempest-DeleteServersTestJSON-1805612840-project] 10.222.0.11 "GET /compute/v2.1/servers/eaeb6520-bd1e-495e-9ada-744682cbc122" status: 200 len: 1211 microversion: 2.1 time: 0.367263 Nov 17 03:25:10.765884 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 17/31] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:25:10 2021] GET /compute/v2.1/servers/eaeb6520-bd1e-495e-9ada-744682cbc122 => generated 1211 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:25:10.803231 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-88bfbdbc-5c55-49f4-a046-2a6bbae7fe37 tempest-VolumesSnapshotsTestJSON-1717954301 tempest-VolumesSnapshotsTestJSON-1717954301-project] Calling method '.version_select at 0x7f9e1dc6a550>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:25:11.027347 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-88bfbdbc-5c55-49f4-a046-2a6bbae7fe37 tempest-VolumesSnapshotsTestJSON-1717954301 tempest-VolumesSnapshotsTestJSON-1717954301-project] 10.222.0.11 "DELETE /compute/v2.1/os-snapshots/bcf20607-5aa6-4d4d-af2c-3475be8b35ca" status: 202 len: 0 microversion: 2.1 time: 0.244899 Nov 17 03:25:11.028287 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 18/32] 10.222.0.11 () {58 vars in 1253 bytes} [Wed Nov 17 03:25:10 2021] DELETE /compute/v2.1/os-snapshots/bcf20607-5aa6-4d4d-af2c-3475be8b35ca => generated 0 bytes in 262 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 17 03:25:11.039103 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-f4b98656-953d-4514-9f86-4ffc11098bf6 tempest-VolumesSnapshotsTestJSON-1717954301 tempest-VolumesSnapshotsTestJSON-1717954301-project] Calling method '.version_select at 0x7f9e1dc6ac10>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:25:11.113139 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-ae3a30f8-d6dd-4ddd-9cbd-c40bb0608a73 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-597112551", "imageRef": "7281a37a-6b99-49c1-881a-41604d06bae1", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "244a5c52-90e3-4132-9390-5236213cfe8d"}]}} {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 17 03:25:11.128534 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-f4b98656-953d-4514-9f86-4ffc11098bf6 tempest-VolumesSnapshotsTestJSON-1717954301 tempest-VolumesSnapshotsTestJSON-1717954301-project] 10.222.0.11 "GET /compute/v2.1/os-snapshots/bcf20607-5aa6-4d4d-af2c-3475be8b35ca" status: 200 len: 286 microversion: 2.1 time: 0.095514 Nov 17 03:25:11.130177 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 19/33] 10.222.0.11 () {58 vars in 1250 bytes} [Wed Nov 17 03:25:11 2021] GET /compute/v2.1/os-snapshots/bcf20607-5aa6-4d4d-af2c-3475be8b35ca => generated 286 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 17 03:25:11.215168 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.network.neutron [None req-ae3a30f8-d6dd-4ddd-9cbd-c40bb0608a73 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] validate_networks() for [('244a5c52-90e3-4132-9390-5236213cfe8d', None, None, None, None, None)] {{(pid=115916) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Nov 17 03:25:11.413765 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-4df33f71-4e64-4094-8f5c-d62648325076 tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:25:11.416182 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-4df33f71-4e64-4094-8f5c-d62648325076 tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] [instance: 61d387ba-e928-4e5f-a79c-4f757643903c] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:25:11.429821 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-4df33f71-4e64-4094-8f5c-d62648325076 tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:25:11.430575 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-4df33f71-4e64-4094-8f5c-d62648325076 tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:25:11.432296 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-4df33f71-4e64-4094-8f5c-d62648325076 tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:25:11.448684 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-4df33f71-4e64-4094-8f5c-d62648325076 tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:25:11.723782 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-4df33f71-4e64-4094-8f5c-d62648325076 tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d4e8ac9538f42c9b637bd9e086668b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfc480343d4d493bb4295b055e274df5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:25:11.732268 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-4df33f71-4e64-4094-8f5c-d62648325076 tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] 10.222.0.11 "GET /compute/v2.1/servers/61d387ba-e928-4e5f-a79c-4f757643903c" status: 200 len: 1276 microversion: 2.1 time: 0.324392 Nov 17 03:25:11.740228 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 20/34] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:25:11 2021] GET /compute/v2.1/servers/61d387ba-e928-4e5f-a79c-4f757643903c => generated 1276 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:25:11.783269 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-e22aed57-a1e1-4b45-8aeb-cca6ed2036b8 tempest-DeleteServersTestJSON-1805612840 tempest-DeleteServersTestJSON-1805612840-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:25:11.783933 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-e22aed57-a1e1-4b45-8aeb-cca6ed2036b8 tempest-DeleteServersTestJSON-1805612840 tempest-DeleteServersTestJSON-1805612840-project] [instance: eaeb6520-bd1e-495e-9ada-744682cbc122] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:25:11.794566 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-e22aed57-a1e1-4b45-8aeb-cca6ed2036b8 tempest-DeleteServersTestJSON-1805612840 tempest-DeleteServersTestJSON-1805612840-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:25:11.798678 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-e22aed57-a1e1-4b45-8aeb-cca6ed2036b8 tempest-DeleteServersTestJSON-1805612840 tempest-DeleteServersTestJSON-1805612840-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:25:11.800007 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-e22aed57-a1e1-4b45-8aeb-cca6ed2036b8 tempest-DeleteServersTestJSON-1805612840 tempest-DeleteServersTestJSON-1805612840-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:25:11.801126 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-e22aed57-a1e1-4b45-8aeb-cca6ed2036b8 tempest-DeleteServersTestJSON-1805612840 tempest-DeleteServersTestJSON-1805612840-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:25:12.181913 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-e22aed57-a1e1-4b45-8aeb-cca6ed2036b8 tempest-DeleteServersTestJSON-1805612840 tempest-DeleteServersTestJSON-1805612840-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65322b3497864a64870eadab1ff7d490', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37560cd5b14f43cd85ee2a3ff2716c33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:25:12.195991 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-e22aed57-a1e1-4b45-8aeb-cca6ed2036b8 tempest-DeleteServersTestJSON-1805612840 tempest-DeleteServersTestJSON-1805612840-project] 10.222.0.11 "GET /compute/v2.1/servers/eaeb6520-bd1e-495e-9ada-744682cbc122" status: 200 len: 1273 microversion: 2.1 time: 0.416412 Nov 17 03:25:12.219915 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 21/35] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:25:11 2021] GET /compute/v2.1/servers/eaeb6520-bd1e-495e-9ada-744682cbc122 => generated 1273 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 17 03:25:12.238377 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-3f25b7b3-3359-43b9-82b4-f64acf0610c5 tempest-VolumesSnapshotsTestJSON-1717954301 tempest-VolumesSnapshotsTestJSON-1717954301-project] Calling method '.version_select at 0x7f9e1dc721f0>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:25:12.429163 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.wsgi [None req-3f25b7b3-3359-43b9-82b4-f64acf0610c5 tempest-VolumesSnapshotsTestJSON-1717954301 tempest-VolumesSnapshotsTestJSON-1717954301-project] HTTP exception thrown: Snapshot bcf20607-5aa6-4d4d-af2c-3475be8b35ca could not be found. Nov 17 03:25:12.429781 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-3f25b7b3-3359-43b9-82b4-f64acf0610c5 tempest-VolumesSnapshotsTestJSON-1717954301 tempest-VolumesSnapshotsTestJSON-1717954301-project] Returning 404 to user: Snapshot bcf20607-5aa6-4d4d-af2c-3475be8b35ca could not be found. {{(pid=115917) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 17 03:25:12.430635 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-3f25b7b3-3359-43b9-82b4-f64acf0610c5 tempest-VolumesSnapshotsTestJSON-1717954301 tempest-VolumesSnapshotsTestJSON-1717954301-project] 10.222.0.11 "GET /compute/v2.1/os-snapshots/bcf20607-5aa6-4d4d-af2c-3475be8b35ca" status: 404 len: 111 microversion: 2.1 time: 0.209068 Nov 17 03:25:12.431504 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 22/36] 10.222.0.11 () {58 vars in 1250 bytes} [Wed Nov 17 03:25:12 2021] GET /compute/v2.1/os-snapshots/bcf20607-5aa6-4d4d-af2c-3475be8b35ca => generated 111 bytes in 211 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 17 03:25:12.440242 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-36121aff-96bc-4cb4-b84d-9f737c7639ee tempest-VolumesSnapshotsTestJSON-1717954301 tempest-VolumesSnapshotsTestJSON-1717954301-project] Calling method '.version_select at 0x7f9e1dc6a310>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:25:12.751287 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-36121aff-96bc-4cb4-b84d-9f737c7639ee tempest-VolumesSnapshotsTestJSON-1717954301 tempest-VolumesSnapshotsTestJSON-1717954301-project] 10.222.0.11 "DELETE /compute/v2.1/os-volumes/5ee3939f-d7ab-4760-a84c-b61cdedad1b7" status: 202 len: 0 microversion: 2.1 time: 0.315148 Nov 17 03:25:12.752318 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 23/37] 10.222.0.11 () {58 vars in 1247 bytes} [Wed Nov 17 03:25:12 2021] DELETE /compute/v2.1/os-volumes/5ee3939f-d7ab-4760-a84c-b61cdedad1b7 => generated 0 bytes in 317 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 17 03:25:12.759345 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-d2438a59-403a-43e6-9cca-a1506d95122c tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:25:12.760080 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-d2438a59-403a-43e6-9cca-a1506d95122c tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] [instance: 61d387ba-e928-4e5f-a79c-4f757643903c] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:25:12.788410 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-d2438a59-403a-43e6-9cca-a1506d95122c tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:25:12.790211 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-d2438a59-403a-43e6-9cca-a1506d95122c tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:25:12.792406 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-d2438a59-403a-43e6-9cca-a1506d95122c tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:25:12.794827 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-d2438a59-403a-43e6-9cca-a1506d95122c tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:25:13.452042 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.virt.hardware [None req-ae3a30f8-d6dd-4ddd-9cbd-c40bb0608a73 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Flavor limits 0:0:0 {{(pid=115916) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 17 03:25:13.452554 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.virt.hardware [None req-ae3a30f8-d6dd-4ddd-9cbd-c40bb0608a73 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Image limits 0:0:0 {{(pid=115916) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 17 03:25:13.453309 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.virt.hardware [None req-ae3a30f8-d6dd-4ddd-9cbd-c40bb0608a73 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Flavor pref 0:0:0 {{(pid=115916) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 17 03:25:13.453720 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.virt.hardware [None req-ae3a30f8-d6dd-4ddd-9cbd-c40bb0608a73 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Image pref 0:0:0 {{(pid=115916) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 17 03:25:13.454353 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.virt.hardware [None req-ae3a30f8-d6dd-4ddd-9cbd-c40bb0608a73 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=115916) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 17 03:25:13.468103 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-ae3a30f8-d6dd-4ddd-9cbd-c40bb0608a73 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:25:13.469066 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-ae3a30f8-d6dd-4ddd-9cbd-c40bb0608a73 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:25:13.470573 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-ae3a30f8-d6dd-4ddd-9cbd-c40bb0608a73 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:25:13.471808 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-ae3a30f8-d6dd-4ddd-9cbd-c40bb0608a73 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:25:13.503416 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-d2438a59-403a-43e6-9cca-a1506d95122c tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d4e8ac9538f42c9b637bd9e086668b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfc480343d4d493bb4295b055e274df5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:25:13.516968 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-d2438a59-403a-43e6-9cca-a1506d95122c tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] 10.222.0.11 "GET /compute/v2.1/servers/61d387ba-e928-4e5f-a79c-4f757643903c" status: 200 len: 1276 microversion: 2.1 time: 0.757208 Nov 17 03:25:13.527618 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 24/38] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:25:12 2021] GET /compute/v2.1/servers/61d387ba-e928-4e5f-a79c-4f757643903c => generated 1276 bytes in 774 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:25:13.529668 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.quota [None req-ae3a30f8-d6dd-4ddd-9cbd-c40bb0608a73 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Getting quotas for project 9a58e89ceeea4a9c8a72a1de4bcaf2d5. Resources: {'instances', 'ram', 'cores'} {{(pid=115916) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 17 03:25:13.542699 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.quota [None req-ae3a30f8-d6dd-4ddd-9cbd-c40bb0608a73 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Getting quotas for user 9f046401c6a04f6495ebe0821120bd72 and project 9a58e89ceeea4a9c8a72a1de4bcaf2d5. Resources: {'instances', 'ram', 'cores'} {{(pid=115916) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 17 03:25:13.544930 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-c7c636d7-a846-4229-9f51-629fc49b5def tempest-VolumesSnapshotsTestJSON-1717954301 tempest-VolumesSnapshotsTestJSON-1717954301-project] Calling method '.version_select at 0x7f9e1dc72700>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:25:13.600208 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-ae3a30f8-d6dd-4ddd-9cbd-c40bb0608a73 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Going to run 1 instances... {{(pid=115916) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 17 03:25:13.612188 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-ae3a30f8-d6dd-4ddd-9cbd-c40bb0608a73 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] [instance: a49437df-3059-4528-8328-2f3471d5fb45] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='7281a37a-6b99-49c1-881a-41604d06bae1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=115916) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 17 03:25:13.614141 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.wsgi [None req-c7c636d7-a846-4229-9f51-629fc49b5def tempest-VolumesSnapshotsTestJSON-1717954301 tempest-VolumesSnapshotsTestJSON-1717954301-project] HTTP exception thrown: Volume 5ee3939f-d7ab-4760-a84c-b61cdedad1b7 could not be found. Nov 17 03:25:13.614753 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-c7c636d7-a846-4229-9f51-629fc49b5def tempest-VolumesSnapshotsTestJSON-1717954301 tempest-VolumesSnapshotsTestJSON-1717954301-project] Returning 404 to user: Volume 5ee3939f-d7ab-4760-a84c-b61cdedad1b7 could not be found. {{(pid=115917) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 17 03:25:13.615578 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-c7c636d7-a846-4229-9f51-629fc49b5def tempest-VolumesSnapshotsTestJSON-1717954301 tempest-VolumesSnapshotsTestJSON-1717954301-project] 10.222.0.11 "GET /compute/v2.1/os-volumes/5ee3939f-d7ab-4760-a84c-b61cdedad1b7" status: 404 len: 109 microversion: 2.1 time: 0.085337 Nov 17 03:25:13.616127 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 25/39] 10.222.0.11 () {58 vars in 1244 bytes} [Wed Nov 17 03:25:13 2021] GET /compute/v2.1/os-volumes/5ee3939f-d7ab-4760-a84c-b61cdedad1b7 => generated 109 bytes in 88 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 17 03:25:13.624730 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-1ae2fe63-be17-4107-937a-8ba5ab242384 tempest-DeleteServersTestJSON-1805612840 tempest-DeleteServersTestJSON-1805612840-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:25:13.625580 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-1ae2fe63-be17-4107-937a-8ba5ab242384 tempest-DeleteServersTestJSON-1805612840 tempest-DeleteServersTestJSON-1805612840-project] [instance: eaeb6520-bd1e-495e-9ada-744682cbc122] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:25:13.666979 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-1ae2fe63-be17-4107-937a-8ba5ab242384 tempest-DeleteServersTestJSON-1805612840 tempest-DeleteServersTestJSON-1805612840-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:25:13.667850 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-1ae2fe63-be17-4107-937a-8ba5ab242384 tempest-DeleteServersTestJSON-1805612840 tempest-DeleteServersTestJSON-1805612840-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:25:13.669109 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-1ae2fe63-be17-4107-937a-8ba5ab242384 tempest-DeleteServersTestJSON-1805612840 tempest-DeleteServersTestJSON-1805612840-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:25:13.673987 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-1ae2fe63-be17-4107-937a-8ba5ab242384 tempest-DeleteServersTestJSON-1805612840 tempest-DeleteServersTestJSON-1805612840-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:25:13.874689 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-ae3a30f8-d6dd-4ddd-9cbd-c40bb0608a73 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] 10.222.0.11 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 3.206721 Nov 17 03:25:13.890058 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 15/40] 10.222.0.11 () {60 vars in 1146 bytes} [Wed Nov 17 03:25:10 2021] POST /compute/v2.1/servers => generated 383 bytes in 3223 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 17 03:25:13.921161 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-90c7973d-badb-4a0a-bd40-d51ab3b9d172 tempest-VolumesSnapshotsTestJSON-1717954301 tempest-VolumesSnapshotsTestJSON-1717954301-project] Calling method '.version_select at 0x7f9e1dc45160>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:25:13.981249 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-1ae2fe63-be17-4107-937a-8ba5ab242384 tempest-DeleteServersTestJSON-1805612840 tempest-DeleteServersTestJSON-1805612840-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65322b3497864a64870eadab1ff7d490', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37560cd5b14f43cd85ee2a3ff2716c33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:25:13.992391 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-1ae2fe63-be17-4107-937a-8ba5ab242384 tempest-DeleteServersTestJSON-1805612840 tempest-DeleteServersTestJSON-1805612840-project] 10.222.0.11 "GET /compute/v2.1/servers/eaeb6520-bd1e-495e-9ada-744682cbc122" status: 200 len: 1273 microversion: 2.1 time: 0.368851 Nov 17 03:25:13.993903 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 26/41] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:25:13 2021] GET /compute/v2.1/servers/eaeb6520-bd1e-495e-9ada-744682cbc122 => generated 1273 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:25:13.997601 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.wsgi [None req-90c7973d-badb-4a0a-bd40-d51ab3b9d172 tempest-VolumesSnapshotsTestJSON-1717954301 tempest-VolumesSnapshotsTestJSON-1717954301-project] HTTP exception thrown: Volume 5ee3939f-d7ab-4760-a84c-b61cdedad1b7 could not be found. Nov 17 03:25:13.998313 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-90c7973d-badb-4a0a-bd40-d51ab3b9d172 tempest-VolumesSnapshotsTestJSON-1717954301 tempest-VolumesSnapshotsTestJSON-1717954301-project] Returning 404 to user: Volume 5ee3939f-d7ab-4760-a84c-b61cdedad1b7 could not be found. {{(pid=115916) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 17 03:25:13.999148 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-90c7973d-badb-4a0a-bd40-d51ab3b9d172 tempest-VolumesSnapshotsTestJSON-1717954301 tempest-VolumesSnapshotsTestJSON-1717954301-project] 10.222.0.11 "DELETE /compute/v2.1/os-volumes/5ee3939f-d7ab-4760-a84c-b61cdedad1b7" status: 404 len: 109 microversion: 2.1 time: 0.107794 Nov 17 03:25:14.001421 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 16/42] 10.222.0.11 () {58 vars in 1247 bytes} [Wed Nov 17 03:25:13 2021] DELETE /compute/v2.1/os-volumes/5ee3939f-d7ab-4760-a84c-b61cdedad1b7 => generated 109 bytes in 110 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 17 03:25:14.016838 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-7d8ee712-a908-4166-89a6-ab04fc814a87 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:25:14.017305 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-7d8ee712-a908-4166-89a6-ab04fc814a87 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] [instance: a49437df-3059-4528-8328-2f3471d5fb45] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:25:14.026242 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-51280f71-4e3b-47ce-9158-c9bd25d741af tempest-VolumesSnapshotsTestJSON-1717954301 tempest-VolumesSnapshotsTestJSON-1717954301-project] Calling method '.version_select at 0x7f9e1dcb5af0>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:25:14.444101 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.wsgi [None req-51280f71-4e3b-47ce-9158-c9bd25d741af tempest-VolumesSnapshotsTestJSON-1717954301 tempest-VolumesSnapshotsTestJSON-1717954301-project] HTTP exception thrown: Volume 5ee3939f-d7ab-4760-a84c-b61cdedad1b7 could not be found. Nov 17 03:25:14.444713 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-51280f71-4e3b-47ce-9158-c9bd25d741af tempest-VolumesSnapshotsTestJSON-1717954301 tempest-VolumesSnapshotsTestJSON-1717954301-project] Returning 404 to user: Volume 5ee3939f-d7ab-4760-a84c-b61cdedad1b7 could not be found. {{(pid=115916) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 17 03:25:14.445703 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-51280f71-4e3b-47ce-9158-c9bd25d741af tempest-VolumesSnapshotsTestJSON-1717954301 tempest-VolumesSnapshotsTestJSON-1717954301-project] 10.222.0.11 "GET /compute/v2.1/os-volumes/5ee3939f-d7ab-4760-a84c-b61cdedad1b7" status: 404 len: 109 microversion: 2.1 time: 0.441834 Nov 17 03:25:14.446542 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 17/43] 10.222.0.11 () {58 vars in 1244 bytes} [Wed Nov 17 03:25:14 2021] GET /compute/v2.1/os-volumes/5ee3939f-d7ab-4760-a84c-b61cdedad1b7 => generated 109 bytes in 443 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 17 03:25:14.535010 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-1ca3e24a-afd2-411c-be26-a430c7667436 tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:25:14.536725 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-1ca3e24a-afd2-411c-be26-a430c7667436 tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] [instance: 61d387ba-e928-4e5f-a79c-4f757643903c] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:25:14.548993 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-1ca3e24a-afd2-411c-be26-a430c7667436 tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:25:14.556160 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-1ca3e24a-afd2-411c-be26-a430c7667436 tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:25:14.565941 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-1ca3e24a-afd2-411c-be26-a430c7667436 tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:25:14.566876 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-1ca3e24a-afd2-411c-be26-a430c7667436 tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:25:15.128902 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-7d8ee712-a908-4166-89a6-ab04fc814a87 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f046401c6a04f6495ebe0821120bd72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a58e89ceeea4a9c8a72a1de4bcaf2d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:25:15.141967 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-7d8ee712-a908-4166-89a6-ab04fc814a87 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] 10.222.0.11 "GET /compute/v2.1/servers/a49437df-3059-4528-8328-2f3471d5fb45" status: 200 len: 1221 microversion: 2.1 time: 1.142606 Nov 17 03:25:15.142585 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 27/44] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:25:13 2021] GET /compute/v2.1/servers/a49437df-3059-4528-8328-2f3471d5fb45 => generated 1221 bytes in 1148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:25:15.147304 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-80a4ad42-7dac-4f14-ac16-9e7bdb262d89 tempest-DeleteServersTestJSON-1805612840 tempest-DeleteServersTestJSON-1805612840-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:25:15.147911 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-80a4ad42-7dac-4f14-ac16-9e7bdb262d89 tempest-DeleteServersTestJSON-1805612840 tempest-DeleteServersTestJSON-1805612840-project] [instance: eaeb6520-bd1e-495e-9ada-744682cbc122] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:25:15.162688 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-80a4ad42-7dac-4f14-ac16-9e7bdb262d89 tempest-DeleteServersTestJSON-1805612840 tempest-DeleteServersTestJSON-1805612840-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:25:15.165463 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-80a4ad42-7dac-4f14-ac16-9e7bdb262d89 tempest-DeleteServersTestJSON-1805612840 tempest-DeleteServersTestJSON-1805612840-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:25:15.166580 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-80a4ad42-7dac-4f14-ac16-9e7bdb262d89 tempest-DeleteServersTestJSON-1805612840 tempest-DeleteServersTestJSON-1805612840-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:25:15.167177 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-80a4ad42-7dac-4f14-ac16-9e7bdb262d89 tempest-DeleteServersTestJSON-1805612840 tempest-DeleteServersTestJSON-1805612840-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:25:15.291357 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-1ca3e24a-afd2-411c-be26-a430c7667436 tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d4e8ac9538f42c9b637bd9e086668b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfc480343d4d493bb4295b055e274df5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:25:15.304506 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-1ca3e24a-afd2-411c-be26-a430c7667436 tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] 10.222.0.11 "GET /compute/v2.1/servers/61d387ba-e928-4e5f-a79c-4f757643903c" status: 200 len: 1276 microversion: 2.1 time: 0.773364 Nov 17 03:25:15.321738 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 18/45] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:25:14 2021] GET /compute/v2.1/servers/61d387ba-e928-4e5f-a79c-4f757643903c => generated 1276 bytes in 790 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:25:15.473974 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-80a4ad42-7dac-4f14-ac16-9e7bdb262d89 tempest-DeleteServersTestJSON-1805612840 tempest-DeleteServersTestJSON-1805612840-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65322b3497864a64870eadab1ff7d490', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37560cd5b14f43cd85ee2a3ff2716c33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:25:15.475075 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-5d101095-ae48-48d8-9cda-16b5cd8a5537 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-448276639", "imageRef": "7281a37a-6b99-49c1-881a-41604d06bae1", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "244a5c52-90e3-4132-9390-5236213cfe8d"}]}} {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 17 03:25:15.482279 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-80a4ad42-7dac-4f14-ac16-9e7bdb262d89 tempest-DeleteServersTestJSON-1805612840 tempest-DeleteServersTestJSON-1805612840-project] 10.222.0.11 "GET /compute/v2.1/servers/eaeb6520-bd1e-495e-9ada-744682cbc122" status: 200 len: 1273 microversion: 2.1 time: 0.338655 Nov 17 03:25:15.486907 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 28/46] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:25:15 2021] GET /compute/v2.1/servers/eaeb6520-bd1e-495e-9ada-744682cbc122 => generated 1273 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:25:15.576581 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.network.neutron [None req-5d101095-ae48-48d8-9cda-16b5cd8a5537 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] validate_networks() for [('244a5c52-90e3-4132-9390-5236213cfe8d', None, None, None, None, None)] {{(pid=115916) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Nov 17 03:25:16.341074 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-1b94f1ff-223f-47bd-b1ee-08777d7f8820 tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:25:16.342430 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-1b94f1ff-223f-47bd-b1ee-08777d7f8820 tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] [instance: 61d387ba-e928-4e5f-a79c-4f757643903c] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:25:16.349194 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-1b94f1ff-223f-47bd-b1ee-08777d7f8820 tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:25:16.350051 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-1b94f1ff-223f-47bd-b1ee-08777d7f8820 tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:25:16.351238 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-1b94f1ff-223f-47bd-b1ee-08777d7f8820 tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:25:16.351801 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-1b94f1ff-223f-47bd-b1ee-08777d7f8820 tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:25:16.657667 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.virt.hardware [None req-5d101095-ae48-48d8-9cda-16b5cd8a5537 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Flavor limits 0:0:0 {{(pid=115916) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 17 03:25:16.658662 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.virt.hardware [None req-5d101095-ae48-48d8-9cda-16b5cd8a5537 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Image limits 0:0:0 {{(pid=115916) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 17 03:25:16.659625 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.virt.hardware [None req-5d101095-ae48-48d8-9cda-16b5cd8a5537 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Flavor pref 0:0:0 {{(pid=115916) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 17 03:25:16.660241 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.virt.hardware [None req-5d101095-ae48-48d8-9cda-16b5cd8a5537 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Image pref 0:0:0 {{(pid=115916) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 17 03:25:16.661538 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.virt.hardware [None req-5d101095-ae48-48d8-9cda-16b5cd8a5537 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=115916) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 17 03:25:16.676724 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-5d101095-ae48-48d8-9cda-16b5cd8a5537 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:25:16.678655 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-5d101095-ae48-48d8-9cda-16b5cd8a5537 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:25:16.680137 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-5d101095-ae48-48d8-9cda-16b5cd8a5537 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:25:16.681130 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-5d101095-ae48-48d8-9cda-16b5cd8a5537 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:25:16.728684 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.quota [None req-5d101095-ae48-48d8-9cda-16b5cd8a5537 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Getting quotas for project 9a58e89ceeea4a9c8a72a1de4bcaf2d5. Resources: {'instances', 'ram', 'cores'} {{(pid=115916) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 17 03:25:16.734303 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.quota [None req-5d101095-ae48-48d8-9cda-16b5cd8a5537 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Getting quotas for user 9f046401c6a04f6495ebe0821120bd72 and project 9a58e89ceeea4a9c8a72a1de4bcaf2d5. Resources: {'instances', 'ram', 'cores'} {{(pid=115916) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 17 03:25:16.748533 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-5d101095-ae48-48d8-9cda-16b5cd8a5537 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Going to run 1 instances... {{(pid=115916) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 17 03:25:16.754507 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-1b94f1ff-223f-47bd-b1ee-08777d7f8820 tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d4e8ac9538f42c9b637bd9e086668b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfc480343d4d493bb4295b055e274df5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:25:16.757098 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-5d101095-ae48-48d8-9cda-16b5cd8a5537 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] [instance: 6dc785d7-bc95-4fee-8206-c2fd3b930e4f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='7281a37a-6b99-49c1-881a-41604d06bae1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=115916) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 17 03:25:16.758808 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-1b94f1ff-223f-47bd-b1ee-08777d7f8820 tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] 10.222.0.11 "GET /compute/v2.1/servers/61d387ba-e928-4e5f-a79c-4f757643903c" status: 200 len: 1318 microversion: 2.1 time: 0.422674 Nov 17 03:25:16.771878 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 29/47] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:25:16 2021] GET /compute/v2.1/servers/61d387ba-e928-4e5f-a79c-4f757643903c => generated 1318 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:25:16.779978 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-bb469832-b1e4-4b34-89cb-a4322f160bf1 tempest-DeleteServersTestJSON-1805612840 tempest-DeleteServersTestJSON-1805612840-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:25:16.780609 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-bb469832-b1e4-4b34-89cb-a4322f160bf1 tempest-DeleteServersTestJSON-1805612840 tempest-DeleteServersTestJSON-1805612840-project] [instance: eaeb6520-bd1e-495e-9ada-744682cbc122] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:25:16.794784 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-bb469832-b1e4-4b34-89cb-a4322f160bf1 tempest-DeleteServersTestJSON-1805612840 tempest-DeleteServersTestJSON-1805612840-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:25:16.795263 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-bb469832-b1e4-4b34-89cb-a4322f160bf1 tempest-DeleteServersTestJSON-1805612840 tempest-DeleteServersTestJSON-1805612840-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:25:16.796876 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-bb469832-b1e4-4b34-89cb-a4322f160bf1 tempest-DeleteServersTestJSON-1805612840 tempest-DeleteServersTestJSON-1805612840-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:25:16.797607 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-bb469832-b1e4-4b34-89cb-a4322f160bf1 tempest-DeleteServersTestJSON-1805612840 tempest-DeleteServersTestJSON-1805612840-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:25:16.823911 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-5d101095-ae48-48d8-9cda-16b5cd8a5537 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] 10.222.0.11 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 1.352785 Nov 17 03:25:16.824621 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 19/48] 10.222.0.11 () {60 vars in 1146 bytes} [Wed Nov 17 03:25:15 2021] POST /compute/v2.1/servers => generated 383 bytes in 1354 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 17 03:25:16.849194 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-9bc890a2-d4fe-473c-9e20-321013e55c08 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1979283497", "imageRef": "7281a37a-6b99-49c1-881a-41604d06bae1", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "29f627af-401c-4e3c-a948-adbabbfe7a22"}], "security_groups": [{"name": "tempest-securitygroup--1009916760"}], "key_name": "tempest-keypair-411984522", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 17 03:25:17.070026 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-bb469832-b1e4-4b34-89cb-a4322f160bf1 tempest-DeleteServersTestJSON-1805612840 tempest-DeleteServersTestJSON-1805612840-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65322b3497864a64870eadab1ff7d490', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37560cd5b14f43cd85ee2a3ff2716c33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:25:17.079811 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-bb469832-b1e4-4b34-89cb-a4322f160bf1 tempest-DeleteServersTestJSON-1805612840 tempest-DeleteServersTestJSON-1805612840-project] 10.222.0.11 "GET /compute/v2.1/servers/eaeb6520-bd1e-495e-9ada-744682cbc122" status: 200 len: 1315 microversion: 2.1 time: 0.306601 Nov 17 03:25:17.080641 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 30/49] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:25:16 2021] GET /compute/v2.1/servers/eaeb6520-bd1e-495e-9ada-744682cbc122 => generated 1315 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:25:17.087143 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-05d78f82-47e7-4d45-8cf2-7e1baa1302f8 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:25:17.087985 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-05d78f82-47e7-4d45-8cf2-7e1baa1302f8 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] [instance: 6dc785d7-bc95-4fee-8206-c2fd3b930e4f] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:25:17.101589 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.network.neutron [None req-9bc890a2-d4fe-473c-9e20-321013e55c08 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] validate_networks() for [('29f627af-401c-4e3c-a948-adbabbfe7a22', None, None, None, None, None)] {{(pid=115916) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Nov 17 03:25:17.161949 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-05d78f82-47e7-4d45-8cf2-7e1baa1302f8 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f046401c6a04f6495ebe0821120bd72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a58e89ceeea4a9c8a72a1de4bcaf2d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:25:17.169403 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-05d78f82-47e7-4d45-8cf2-7e1baa1302f8 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] 10.222.0.11 "GET /compute/v2.1/servers/6dc785d7-bc95-4fee-8206-c2fd3b930e4f" status: 200 len: 1221 microversion: 2.1 time: 0.086352 Nov 17 03:25:17.179904 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 31/50] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:25:17 2021] GET /compute/v2.1/servers/6dc785d7-bc95-4fee-8206-c2fd3b930e4f => generated 1221 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:25:17.775559 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-1adbb012-640a-44af-ac32-e896cda80b32 tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:25:17.777165 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-1adbb012-640a-44af-ac32-e896cda80b32 tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] [instance: 61d387ba-e928-4e5f-a79c-4f757643903c] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:25:17.784793 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-1adbb012-640a-44af-ac32-e896cda80b32 tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:25:17.785512 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-1adbb012-640a-44af-ac32-e896cda80b32 tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:25:17.793429 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-1adbb012-640a-44af-ac32-e896cda80b32 tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:25:17.794975 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-1adbb012-640a-44af-ac32-e896cda80b32 tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:25:18.013456 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.virt.hardware [None req-9bc890a2-d4fe-473c-9e20-321013e55c08 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Flavor limits 0:0:0 {{(pid=115916) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 17 03:25:18.014802 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.virt.hardware [None req-9bc890a2-d4fe-473c-9e20-321013e55c08 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Image limits 0:0:0 {{(pid=115916) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 17 03:25:18.015419 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.virt.hardware [None req-9bc890a2-d4fe-473c-9e20-321013e55c08 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Flavor pref 0:0:0 {{(pid=115916) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 17 03:25:18.016072 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.virt.hardware [None req-9bc890a2-d4fe-473c-9e20-321013e55c08 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Image pref 0:0:0 {{(pid=115916) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 17 03:25:18.016650 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.virt.hardware [None req-9bc890a2-d4fe-473c-9e20-321013e55c08 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=115916) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 17 03:25:18.039874 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-9bc890a2-d4fe-473c-9e20-321013e55c08 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:25:18.039874 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-9bc890a2-d4fe-473c-9e20-321013e55c08 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:25:18.045240 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-9bc890a2-d4fe-473c-9e20-321013e55c08 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:25:18.045694 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-9bc890a2-d4fe-473c-9e20-321013e55c08 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:25:18.056764 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-1adbb012-640a-44af-ac32-e896cda80b32 tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d4e8ac9538f42c9b637bd9e086668b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfc480343d4d493bb4295b055e274df5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:25:18.070297 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-1adbb012-640a-44af-ac32-e896cda80b32 tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] 10.222.0.11 "GET /compute/v2.1/servers/61d387ba-e928-4e5f-a79c-4f757643903c" status: 200 len: 1318 microversion: 2.1 time: 0.298342 Nov 17 03:25:18.071531 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 32/51] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:25:17 2021] GET /compute/v2.1/servers/61d387ba-e928-4e5f-a79c-4f757643903c => generated 1318 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 17 03:25:18.100293 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-690d3575-3d44-4cd1-b2dd-b6f4076f85f2 tempest-DeleteServersTestJSON-1805612840 tempest-DeleteServersTestJSON-1805612840-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:25:18.101004 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-690d3575-3d44-4cd1-b2dd-b6f4076f85f2 tempest-DeleteServersTestJSON-1805612840 tempest-DeleteServersTestJSON-1805612840-project] [instance: eaeb6520-bd1e-495e-9ada-744682cbc122] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:25:18.106806 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.quota [None req-9bc890a2-d4fe-473c-9e20-321013e55c08 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Getting quotas for project 0ebb970305844dccacf48a7d8d47ecf4. Resources: {'instances', 'ram', 'cores'} {{(pid=115916) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 17 03:25:18.109537 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-690d3575-3d44-4cd1-b2dd-b6f4076f85f2 tempest-DeleteServersTestJSON-1805612840 tempest-DeleteServersTestJSON-1805612840-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:25:18.109990 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-690d3575-3d44-4cd1-b2dd-b6f4076f85f2 tempest-DeleteServersTestJSON-1805612840 tempest-DeleteServersTestJSON-1805612840-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:25:18.110768 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-690d3575-3d44-4cd1-b2dd-b6f4076f85f2 tempest-DeleteServersTestJSON-1805612840 tempest-DeleteServersTestJSON-1805612840-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:25:18.111193 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-690d3575-3d44-4cd1-b2dd-b6f4076f85f2 tempest-DeleteServersTestJSON-1805612840 tempest-DeleteServersTestJSON-1805612840-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:25:18.112573 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.quota [None req-9bc890a2-d4fe-473c-9e20-321013e55c08 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Getting quotas for user 37f21d6d15cf40a586edda211219fd08 and project 0ebb970305844dccacf48a7d8d47ecf4. Resources: {'instances', 'ram', 'cores'} {{(pid=115916) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 17 03:25:18.126005 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-9bc890a2-d4fe-473c-9e20-321013e55c08 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Going to run 1 instances... {{(pid=115916) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 17 03:25:18.128838 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-9bc890a2-d4fe-473c-9e20-321013e55c08 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] [instance: 5d54db85-b991-4890-abaa-952413baa2e7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='7281a37a-6b99-49c1-881a-41604d06bae1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=115916) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 17 03:25:18.218271 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-9bc890a2-d4fe-473c-9e20-321013e55c08 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] 10.222.0.11 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 1.392354 Nov 17 03:25:18.218944 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 20/52] 10.222.0.11 () {62 vars in 1187 bytes} [Wed Nov 17 03:25:16 2021] POST /compute/v2.1/servers => generated 402 bytes in 1394 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Nov 17 03:25:18.226143 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-77d50f48-0e3f-4154-880e-026565280000 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:25:18.237744 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-77d50f48-0e3f-4154-880e-026565280000 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] [instance: 6dc785d7-bc95-4fee-8206-c2fd3b930e4f] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:25:18.246714 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-77d50f48-0e3f-4154-880e-026565280000 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:25:18.249378 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-77d50f48-0e3f-4154-880e-026565280000 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:25:18.250391 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-77d50f48-0e3f-4154-880e-026565280000 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:25:18.250964 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-77d50f48-0e3f-4154-880e-026565280000 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:25:18.395543 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-690d3575-3d44-4cd1-b2dd-b6f4076f85f2 tempest-DeleteServersTestJSON-1805612840 tempest-DeleteServersTestJSON-1805612840-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65322b3497864a64870eadab1ff7d490', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37560cd5b14f43cd85ee2a3ff2716c33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:25:18.416010 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-77d50f48-0e3f-4154-880e-026565280000 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f046401c6a04f6495ebe0821120bd72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a58e89ceeea4a9c8a72a1de4bcaf2d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:25:18.416587 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-690d3575-3d44-4cd1-b2dd-b6f4076f85f2 tempest-DeleteServersTestJSON-1805612840 tempest-DeleteServersTestJSON-1805612840-project] 10.222.0.11 "GET /compute/v2.1/servers/eaeb6520-bd1e-495e-9ada-744682cbc122" status: 200 len: 1315 microversion: 2.1 time: 0.323857 Nov 17 03:25:18.417499 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 33/53] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:25:18 2021] GET /compute/v2.1/servers/eaeb6520-bd1e-495e-9ada-744682cbc122 => generated 1315 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 17 03:25:18.424602 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-787a1c3b-ab22-4714-8681-3e7526480e44 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:25:18.425324 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-787a1c3b-ab22-4714-8681-3e7526480e44 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] [instance: 5d54db85-b991-4890-abaa-952413baa2e7] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:25:18.439016 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-77d50f48-0e3f-4154-880e-026565280000 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] 10.222.0.11 "GET /compute/v2.1/servers/6dc785d7-bc95-4fee-8206-c2fd3b930e4f" status: 200 len: 1225 microversion: 2.1 time: 0.218692 Nov 17 03:25:18.440171 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 21/54] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:25:18 2021] GET /compute/v2.1/servers/6dc785d7-bc95-4fee-8206-c2fd3b930e4f => generated 1225 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:25:18.558164 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-787a1c3b-ab22-4714-8681-3e7526480e44 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37f21d6d15cf40a586edda211219fd08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ebb970305844dccacf48a7d8d47ecf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:25:18.566362 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-787a1c3b-ab22-4714-8681-3e7526480e44 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '37f21d6d15cf40a586edda211219fd08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ebb970305844dccacf48a7d8d47ecf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:25:18.567884 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-787a1c3b-ab22-4714-8681-3e7526480e44 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '37f21d6d15cf40a586edda211219fd08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ebb970305844dccacf48a7d8d47ecf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:25:18.569036 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-787a1c3b-ab22-4714-8681-3e7526480e44 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] 10.222.0.11 "GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7" status: 200 len: 1281 microversion: 2.20 time: 0.149812 Nov 17 03:25:18.571043 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 34/55] 10.222.0.11 () {60 vars in 1276 bytes} [Wed Nov 17 03:25:18 2021] GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7 => generated 1281 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 17 03:25:19.091479 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-7055c9fe-e9ed-4f02-b42a-cdfd5d585075 tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:25:19.092067 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-7055c9fe-e9ed-4f02-b42a-cdfd5d585075 tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] [instance: 61d387ba-e928-4e5f-a79c-4f757643903c] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:25:19.099783 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-7055c9fe-e9ed-4f02-b42a-cdfd5d585075 tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:25:19.099783 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-7055c9fe-e9ed-4f02-b42a-cdfd5d585075 tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:25:19.100327 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-7055c9fe-e9ed-4f02-b42a-cdfd5d585075 tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:25:19.100760 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-7055c9fe-e9ed-4f02-b42a-cdfd5d585075 tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:25:19.377806 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-7055c9fe-e9ed-4f02-b42a-cdfd5d585075 tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d4e8ac9538f42c9b637bd9e086668b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfc480343d4d493bb4295b055e274df5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:25:19.400297 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-7055c9fe-e9ed-4f02-b42a-cdfd5d585075 tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] 10.222.0.11 "GET /compute/v2.1/servers/61d387ba-e928-4e5f-a79c-4f757643903c" status: 200 len: 1318 microversion: 2.1 time: 0.316135 Nov 17 03:25:19.401362 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 22/56] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:25:19 2021] GET /compute/v2.1/servers/61d387ba-e928-4e5f-a79c-4f757643903c => generated 1318 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:25:19.446677 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-3ec5159c-6a71-4515-a3a6-03b77cfe20d2 tempest-DeleteServersTestJSON-1805612840 tempest-DeleteServersTestJSON-1805612840-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:25:19.448104 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-3ec5159c-6a71-4515-a3a6-03b77cfe20d2 tempest-DeleteServersTestJSON-1805612840 tempest-DeleteServersTestJSON-1805612840-project] [instance: eaeb6520-bd1e-495e-9ada-744682cbc122] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:25:19.462166 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-a6436a6d-0545-4acc-9983-0a964b5e421d tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:25:19.463131 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-a6436a6d-0545-4acc-9983-0a964b5e421d tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] [instance: 6dc785d7-bc95-4fee-8206-c2fd3b930e4f] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:25:19.478965 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-3ec5159c-6a71-4515-a3a6-03b77cfe20d2 tempest-DeleteServersTestJSON-1805612840 tempest-DeleteServersTestJSON-1805612840-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:25:19.485875 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-3ec5159c-6a71-4515-a3a6-03b77cfe20d2 tempest-DeleteServersTestJSON-1805612840 tempest-DeleteServersTestJSON-1805612840-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:25:19.486701 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-a6436a6d-0545-4acc-9983-0a964b5e421d tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:25:19.491047 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-a6436a6d-0545-4acc-9983-0a964b5e421d tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:25:19.492309 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-a6436a6d-0545-4acc-9983-0a964b5e421d tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:25:19.492715 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-a6436a6d-0545-4acc-9983-0a964b5e421d tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:25:19.493923 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-3ec5159c-6a71-4515-a3a6-03b77cfe20d2 tempest-DeleteServersTestJSON-1805612840 tempest-DeleteServersTestJSON-1805612840-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:25:19.494494 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-3ec5159c-6a71-4515-a3a6-03b77cfe20d2 tempest-DeleteServersTestJSON-1805612840 tempest-DeleteServersTestJSON-1805612840-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:25:19.681267 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-a6436a6d-0545-4acc-9983-0a964b5e421d tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f046401c6a04f6495ebe0821120bd72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a58e89ceeea4a9c8a72a1de4bcaf2d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:25:19.703245 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-a6436a6d-0545-4acc-9983-0a964b5e421d tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] 10.222.0.11 "GET /compute/v2.1/servers/6dc785d7-bc95-4fee-8206-c2fd3b930e4f" status: 200 len: 1225 microversion: 2.1 time: 0.245866 Nov 17 03:25:19.708457 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 23/57] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:25:19 2021] GET /compute/v2.1/servers/6dc785d7-bc95-4fee-8206-c2fd3b930e4f => generated 1225 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:25:19.728917 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-a0437bf1-7735-4537-8b17-42694361e925 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:25:19.729802 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-a0437bf1-7735-4537-8b17-42694361e925 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] [instance: 5d54db85-b991-4890-abaa-952413baa2e7] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:25:19.739613 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-a0437bf1-7735-4537-8b17-42694361e925 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:25:19.740313 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-a0437bf1-7735-4537-8b17-42694361e925 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:25:19.741358 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-a0437bf1-7735-4537-8b17-42694361e925 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:25:19.741934 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-a0437bf1-7735-4537-8b17-42694361e925 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:25:19.868661 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-3ec5159c-6a71-4515-a3a6-03b77cfe20d2 tempest-DeleteServersTestJSON-1805612840 tempest-DeleteServersTestJSON-1805612840-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65322b3497864a64870eadab1ff7d490', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37560cd5b14f43cd85ee2a3ff2716c33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:25:19.875325 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-a0437bf1-7735-4537-8b17-42694361e925 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37f21d6d15cf40a586edda211219fd08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ebb970305844dccacf48a7d8d47ecf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:25:19.880560 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-3ec5159c-6a71-4515-a3a6-03b77cfe20d2 tempest-DeleteServersTestJSON-1805612840 tempest-DeleteServersTestJSON-1805612840-project] 10.222.0.11 "GET /compute/v2.1/servers/eaeb6520-bd1e-495e-9ada-744682cbc122" status: 200 len: 1315 microversion: 2.1 time: 0.448562 Nov 17 03:25:19.883809 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 35/58] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:25:19 2021] GET /compute/v2.1/servers/eaeb6520-bd1e-495e-9ada-744682cbc122 => generated 1315 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:25:19.887934 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-a0437bf1-7735-4537-8b17-42694361e925 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '37f21d6d15cf40a586edda211219fd08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ebb970305844dccacf48a7d8d47ecf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:25:19.890657 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-a0437bf1-7735-4537-8b17-42694361e925 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '37f21d6d15cf40a586edda211219fd08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ebb970305844dccacf48a7d8d47ecf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:25:19.891800 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-a0437bf1-7735-4537-8b17-42694361e925 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] 10.222.0.11 "GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7" status: 200 len: 1285 microversion: 2.20 time: 0.182251 Nov 17 03:25:19.895331 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 24/59] 10.222.0.11 () {60 vars in 1276 bytes} [Wed Nov 17 03:25:19 2021] GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7 => generated 1285 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 17 03:25:20.419650 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-0d7ed708-dc50-4f29-a451-254852c973b6 tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:25:20.420679 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-0d7ed708-dc50-4f29-a451-254852c973b6 tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] [instance: 61d387ba-e928-4e5f-a79c-4f757643903c] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:25:20.427837 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-0d7ed708-dc50-4f29-a451-254852c973b6 tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:25:20.428600 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-0d7ed708-dc50-4f29-a451-254852c973b6 tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:25:20.429727 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-0d7ed708-dc50-4f29-a451-254852c973b6 tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:25:20.430319 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-0d7ed708-dc50-4f29-a451-254852c973b6 tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:25:20.588333 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-0d7ed708-dc50-4f29-a451-254852c973b6 tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d4e8ac9538f42c9b637bd9e086668b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfc480343d4d493bb4295b055e274df5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:25:20.599865 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-0d7ed708-dc50-4f29-a451-254852c973b6 tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] 10.222.0.11 "GET /compute/v2.1/servers/61d387ba-e928-4e5f-a79c-4f757643903c" status: 200 len: 1318 microversion: 2.1 time: 0.184531 Nov 17 03:25:20.601685 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 36/60] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:25:20 2021] GET /compute/v2.1/servers/61d387ba-e928-4e5f-a79c-4f757643903c => generated 1318 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:25:20.664864 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-f287e98d-8654-4c5f-bc06-7604a467bffc tempest-VolumesTestJSON-1913211934 tempest-VolumesTestJSON-1913211934-project] Calling method '.version_select at 0x7f9e1dc95940>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:25:20.721490 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-2f2f6e3e-9562-4392-96f7-eaef35f63113 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:25:20.722308 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-2f2f6e3e-9562-4392-96f7-eaef35f63113 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] [instance: 6dc785d7-bc95-4fee-8206-c2fd3b930e4f] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:25:20.729459 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-2f2f6e3e-9562-4392-96f7-eaef35f63113 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:25:20.730208 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-2f2f6e3e-9562-4392-96f7-eaef35f63113 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:25:20.731494 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-2f2f6e3e-9562-4392-96f7-eaef35f63113 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:25:20.736420 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-2f2f6e3e-9562-4392-96f7-eaef35f63113 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:25:20.782433 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-f287e98d-8654-4c5f-bc06-7604a467bffc tempest-VolumesTestJSON-1913211934 tempest-VolumesTestJSON-1913211934-project] 10.222.0.11 "GET /compute/v2.1/os-volumes/f23c4b2e-3267-425a-b650-af9352c9bb74" status: 200 len: 351 microversion: 2.1 time: 0.121369 Nov 17 03:25:20.789525 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 25/61] 10.222.0.11 () {58 vars in 1244 bytes} [Wed Nov 17 03:25:20 2021] GET /compute/v2.1/os-volumes/f23c4b2e-3267-425a-b650-af9352c9bb74 => generated 351 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 17 03:25:20.838039 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-2f2f6e3e-9562-4392-96f7-eaef35f63113 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f046401c6a04f6495ebe0821120bd72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a58e89ceeea4a9c8a72a1de4bcaf2d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:25:20.847762 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-2f2f6e3e-9562-4392-96f7-eaef35f63113 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] 10.222.0.11 "GET /compute/v2.1/servers/6dc785d7-bc95-4fee-8206-c2fd3b930e4f" status: 200 len: 1225 microversion: 2.1 time: 0.130714 Nov 17 03:25:20.857437 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 37/62] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:25:20 2021] GET /compute/v2.1/servers/6dc785d7-bc95-4fee-8206-c2fd3b930e4f => generated 1225 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:25:20.900704 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-c99c62b5-b285-4153-bdc9-c9975502c791 tempest-DeleteServersTestJSON-1805612840 tempest-DeleteServersTestJSON-1805612840-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:25:20.901658 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-c99c62b5-b285-4153-bdc9-c9975502c791 tempest-DeleteServersTestJSON-1805612840 tempest-DeleteServersTestJSON-1805612840-project] [instance: eaeb6520-bd1e-495e-9ada-744682cbc122] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:25:20.913322 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-c99c62b5-b285-4153-bdc9-c9975502c791 tempest-DeleteServersTestJSON-1805612840 tempest-DeleteServersTestJSON-1805612840-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:25:20.913776 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-c99c62b5-b285-4153-bdc9-c9975502c791 tempest-DeleteServersTestJSON-1805612840 tempest-DeleteServersTestJSON-1805612840-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:25:20.914576 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-c99c62b5-b285-4153-bdc9-c9975502c791 tempest-DeleteServersTestJSON-1805612840 tempest-DeleteServersTestJSON-1805612840-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:25:20.915015 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-c99c62b5-b285-4153-bdc9-c9975502c791 tempest-DeleteServersTestJSON-1805612840 tempest-DeleteServersTestJSON-1805612840-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:25:20.915267 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-70c81055-1464-4e4f-9d2f-70243d040535 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:25:20.916243 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-70c81055-1464-4e4f-9d2f-70243d040535 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] [instance: 5d54db85-b991-4890-abaa-952413baa2e7] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:25:20.924234 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-70c81055-1464-4e4f-9d2f-70243d040535 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:25:20.925565 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-70c81055-1464-4e4f-9d2f-70243d040535 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:25:20.926863 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-70c81055-1464-4e4f-9d2f-70243d040535 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:25:20.927476 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-70c81055-1464-4e4f-9d2f-70243d040535 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:25:21.050693 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-70c81055-1464-4e4f-9d2f-70243d040535 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37f21d6d15cf40a586edda211219fd08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ebb970305844dccacf48a7d8d47ecf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:25:21.060191 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-70c81055-1464-4e4f-9d2f-70243d040535 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '37f21d6d15cf40a586edda211219fd08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ebb970305844dccacf48a7d8d47ecf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:25:21.065122 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-70c81055-1464-4e4f-9d2f-70243d040535 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '37f21d6d15cf40a586edda211219fd08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ebb970305844dccacf48a7d8d47ecf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:25:21.069031 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-70c81055-1464-4e4f-9d2f-70243d040535 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] 10.222.0.11 "GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7" status: 200 len: 1285 microversion: 2.20 time: 0.159071 Nov 17 03:25:21.085352 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 38/63] 10.222.0.11 () {60 vars in 1276 bytes} [Wed Nov 17 03:25:20 2021] GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7 => generated 1285 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 17 03:25:21.151427 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-c99c62b5-b285-4153-bdc9-c9975502c791 tempest-DeleteServersTestJSON-1805612840 tempest-DeleteServersTestJSON-1805612840-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65322b3497864a64870eadab1ff7d490', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37560cd5b14f43cd85ee2a3ff2716c33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:25:21.159101 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-c99c62b5-b285-4153-bdc9-c9975502c791 tempest-DeleteServersTestJSON-1805612840 tempest-DeleteServersTestJSON-1805612840-project] 10.222.0.11 "GET /compute/v2.1/servers/eaeb6520-bd1e-495e-9ada-744682cbc122" status: 200 len: 1315 microversion: 2.1 time: 0.263096 Nov 17 03:25:21.159688 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 26/64] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:25:20 2021] GET /compute/v2.1/servers/eaeb6520-bd1e-495e-9ada-744682cbc122 => generated 1315 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:25:21.616895 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-d3d52a01-f8ad-4676-b164-5439912f77f7 tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:25:21.629040 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-d3d52a01-f8ad-4676-b164-5439912f77f7 tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] [instance: 61d387ba-e928-4e5f-a79c-4f757643903c] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:25:21.637848 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-d3d52a01-f8ad-4676-b164-5439912f77f7 tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:25:21.638550 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-d3d52a01-f8ad-4676-b164-5439912f77f7 tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:25:21.639633 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-d3d52a01-f8ad-4676-b164-5439912f77f7 tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:25:21.640257 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-d3d52a01-f8ad-4676-b164-5439912f77f7 tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:25:21.804364 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-d3d52a01-f8ad-4676-b164-5439912f77f7 tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d4e8ac9538f42c9b637bd9e086668b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfc480343d4d493bb4295b055e274df5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:25:21.812093 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-d3d52a01-f8ad-4676-b164-5439912f77f7 tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] 10.222.0.11 "GET /compute/v2.1/servers/61d387ba-e928-4e5f-a79c-4f757643903c" status: 200 len: 1318 microversion: 2.1 time: 0.198895 Nov 17 03:25:21.812602 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 39/65] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:25:21 2021] GET /compute/v2.1/servers/61d387ba-e928-4e5f-a79c-4f757643903c => generated 1318 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:25:21.865386 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-c8b547b9-1e4e-4f58-80f9-0e43300a44b5 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:25:21.866004 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-c8b547b9-1e4e-4f58-80f9-0e43300a44b5 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] [instance: 6dc785d7-bc95-4fee-8206-c2fd3b930e4f] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:25:21.872824 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-c8b547b9-1e4e-4f58-80f9-0e43300a44b5 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:25:21.873369 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-c8b547b9-1e4e-4f58-80f9-0e43300a44b5 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:25:21.874291 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-c8b547b9-1e4e-4f58-80f9-0e43300a44b5 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:25:21.874978 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-c8b547b9-1e4e-4f58-80f9-0e43300a44b5 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:25:21.939446 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-c8b547b9-1e4e-4f58-80f9-0e43300a44b5 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f046401c6a04f6495ebe0821120bd72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a58e89ceeea4a9c8a72a1de4bcaf2d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:25:21.948138 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-c8b547b9-1e4e-4f58-80f9-0e43300a44b5 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] 10.222.0.11 "GET /compute/v2.1/servers/6dc785d7-bc95-4fee-8206-c2fd3b930e4f" status: 200 len: 1225 microversion: 2.1 time: 0.086786 Nov 17 03:25:21.949088 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 27/66] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:25:21 2021] GET /compute/v2.1/servers/6dc785d7-bc95-4fee-8206-c2fd3b930e4f => generated 1225 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:25:22.092135 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-4f9807cc-9ba0-433b-9e37-726e3bb7e7b3 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:25:22.092808 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-4f9807cc-9ba0-433b-9e37-726e3bb7e7b3 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] [instance: 5d54db85-b991-4890-abaa-952413baa2e7] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:25:22.099134 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-4f9807cc-9ba0-433b-9e37-726e3bb7e7b3 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:25:22.099633 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-4f9807cc-9ba0-433b-9e37-726e3bb7e7b3 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:25:22.100448 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-4f9807cc-9ba0-433b-9e37-726e3bb7e7b3 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:25:22.100926 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-4f9807cc-9ba0-433b-9e37-726e3bb7e7b3 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:25:22.163585 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-4f9807cc-9ba0-433b-9e37-726e3bb7e7b3 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37f21d6d15cf40a586edda211219fd08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ebb970305844dccacf48a7d8d47ecf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:25:22.171392 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-4f9807cc-9ba0-433b-9e37-726e3bb7e7b3 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '37f21d6d15cf40a586edda211219fd08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ebb970305844dccacf48a7d8d47ecf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:25:22.172974 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-4f9807cc-9ba0-433b-9e37-726e3bb7e7b3 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '37f21d6d15cf40a586edda211219fd08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ebb970305844dccacf48a7d8d47ecf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:25:22.174095 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-4f9807cc-9ba0-433b-9e37-726e3bb7e7b3 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] 10.222.0.11 "GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7" status: 200 len: 1285 microversion: 2.20 time: 0.085782 Nov 17 03:25:22.174676 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 40/67] 10.222.0.11 () {60 vars in 1276 bytes} [Wed Nov 17 03:25:22 2021] GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7 => generated 1285 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 17 03:25:22.175828 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-a7c96a77-211c-46a9-9a42-d7a48e0d4c6c tempest-DeleteServersTestJSON-1805612840 tempest-DeleteServersTestJSON-1805612840-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:25:22.176785 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-a7c96a77-211c-46a9-9a42-d7a48e0d4c6c tempest-DeleteServersTestJSON-1805612840 tempest-DeleteServersTestJSON-1805612840-project] [instance: eaeb6520-bd1e-495e-9ada-744682cbc122] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:25:22.184259 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-a7c96a77-211c-46a9-9a42-d7a48e0d4c6c tempest-DeleteServersTestJSON-1805612840 tempest-DeleteServersTestJSON-1805612840-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:25:22.185213 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-a7c96a77-211c-46a9-9a42-d7a48e0d4c6c tempest-DeleteServersTestJSON-1805612840 tempest-DeleteServersTestJSON-1805612840-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:25:22.186668 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-a7c96a77-211c-46a9-9a42-d7a48e0d4c6c tempest-DeleteServersTestJSON-1805612840 tempest-DeleteServersTestJSON-1805612840-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:25:22.187270 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-a7c96a77-211c-46a9-9a42-d7a48e0d4c6c tempest-DeleteServersTestJSON-1805612840 tempest-DeleteServersTestJSON-1805612840-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:25:22.327508 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-a7c96a77-211c-46a9-9a42-d7a48e0d4c6c tempest-DeleteServersTestJSON-1805612840 tempest-DeleteServersTestJSON-1805612840-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65322b3497864a64870eadab1ff7d490', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37560cd5b14f43cd85ee2a3ff2716c33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:25:22.335196 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-a7c96a77-211c-46a9-9a42-d7a48e0d4c6c tempest-DeleteServersTestJSON-1805612840 tempest-DeleteServersTestJSON-1805612840-project] 10.222.0.11 "GET /compute/v2.1/servers/eaeb6520-bd1e-495e-9ada-744682cbc122" status: 200 len: 1315 microversion: 2.1 time: 0.163191 Nov 17 03:25:22.335995 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 28/68] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:25:22 2021] GET /compute/v2.1/servers/eaeb6520-bd1e-495e-9ada-744682cbc122 => generated 1315 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:25:22.379730 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-76b82490-5390-4ac9-9be7-386b78169160 tempest-VolumesTestJSON-1913211934 tempest-VolumesTestJSON-1913211934-project] Calling method '.version_select at 0x7f9e1dc72280>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:25:22.454046 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-76b82490-5390-4ac9-9be7-386b78169160 tempest-VolumesTestJSON-1913211934 tempest-VolumesTestJSON-1913211934-project] 10.222.0.11 "GET /compute/v2.1/os-volumes/f1f26bae-3948-4e53-abc2-32ec7934869b" status: 200 len: 350 microversion: 2.1 time: 0.080587 Nov 17 03:25:22.454925 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 41/69] 10.222.0.11 () {58 vars in 1244 bytes} [Wed Nov 17 03:25:22 2021] GET /compute/v2.1/os-volumes/f1f26bae-3948-4e53-abc2-32ec7934869b => generated 350 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 17 03:25:22.830433 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-ae4f6fa1-2ed4-4299-927f-8ed475c77a38 tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:25:22.831086 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-ae4f6fa1-2ed4-4299-927f-8ed475c77a38 tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] [instance: 61d387ba-e928-4e5f-a79c-4f757643903c] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:25:22.845458 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-ae4f6fa1-2ed4-4299-927f-8ed475c77a38 tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:25:22.846468 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-ae4f6fa1-2ed4-4299-927f-8ed475c77a38 tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:25:22.848628 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-ae4f6fa1-2ed4-4299-927f-8ed475c77a38 tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:25:22.849469 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-ae4f6fa1-2ed4-4299-927f-8ed475c77a38 tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:25:22.974763 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-0ff9d319-0912-4021-8fcf-5e9ca2d934ff tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:25:22.975611 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-0ff9d319-0912-4021-8fcf-5e9ca2d934ff tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] [instance: 6dc785d7-bc95-4fee-8206-c2fd3b930e4f] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:25:22.983936 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-0ff9d319-0912-4021-8fcf-5e9ca2d934ff tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:25:22.990488 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-0ff9d319-0912-4021-8fcf-5e9ca2d934ff tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:25:22.991671 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-0ff9d319-0912-4021-8fcf-5e9ca2d934ff tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:25:22.992209 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-0ff9d319-0912-4021-8fcf-5e9ca2d934ff tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:25:23.116317 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-0ff9d319-0912-4021-8fcf-5e9ca2d934ff tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f046401c6a04f6495ebe0821120bd72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a58e89ceeea4a9c8a72a1de4bcaf2d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:25:23.126607 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-0ff9d319-0912-4021-8fcf-5e9ca2d934ff tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] 10.222.0.11 "GET /compute/v2.1/servers/6dc785d7-bc95-4fee-8206-c2fd3b930e4f" status: 200 len: 1225 microversion: 2.1 time: 0.164865 Nov 17 03:25:23.130446 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 42/70] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:25:22 2021] GET /compute/v2.1/servers/6dc785d7-bc95-4fee-8206-c2fd3b930e4f => generated 1225 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:25:23.141440 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-ae4f6fa1-2ed4-4299-927f-8ed475c77a38 tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d4e8ac9538f42c9b637bd9e086668b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfc480343d4d493bb4295b055e274df5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:25:23.154708 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-ae4f6fa1-2ed4-4299-927f-8ed475c77a38 tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] 10.222.0.11 "GET /compute/v2.1/servers/61d387ba-e928-4e5f-a79c-4f757643903c" status: 200 len: 1318 microversion: 2.1 time: 0.327939 Nov 17 03:25:23.166352 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 29/71] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:25:22 2021] GET /compute/v2.1/servers/61d387ba-e928-4e5f-a79c-4f757643903c => generated 1318 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:25:23.198311 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-24a5d233-6d4e-4ad6-8d45-91ad7aedb7f0 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:25:23.198593 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-24a5d233-6d4e-4ad6-8d45-91ad7aedb7f0 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] [instance: 5d54db85-b991-4890-abaa-952413baa2e7] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:25:23.205205 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-24a5d233-6d4e-4ad6-8d45-91ad7aedb7f0 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:25:23.205919 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-24a5d233-6d4e-4ad6-8d45-91ad7aedb7f0 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:25:23.207093 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-24a5d233-6d4e-4ad6-8d45-91ad7aedb7f0 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:25:23.207897 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-24a5d233-6d4e-4ad6-8d45-91ad7aedb7f0 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:25:23.288895 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-24a5d233-6d4e-4ad6-8d45-91ad7aedb7f0 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37f21d6d15cf40a586edda211219fd08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ebb970305844dccacf48a7d8d47ecf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:25:23.298506 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-24a5d233-6d4e-4ad6-8d45-91ad7aedb7f0 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '37f21d6d15cf40a586edda211219fd08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ebb970305844dccacf48a7d8d47ecf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:25:23.300603 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-24a5d233-6d4e-4ad6-8d45-91ad7aedb7f0 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '37f21d6d15cf40a586edda211219fd08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ebb970305844dccacf48a7d8d47ecf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:25:23.301770 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-24a5d233-6d4e-4ad6-8d45-91ad7aedb7f0 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] 10.222.0.11 "GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7" status: 200 len: 1285 microversion: 2.20 time: 0.112449 Nov 17 03:25:23.302323 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 43/72] 10.222.0.11 () {60 vars in 1276 bytes} [Wed Nov 17 03:25:23 2021] GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7 => generated 1285 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 17 03:25:23.354289 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-e31fc36a-d4c9-4644-8d9a-d47e2e95733a tempest-DeleteServersTestJSON-1805612840 tempest-DeleteServersTestJSON-1805612840-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:25:23.355370 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-e31fc36a-d4c9-4644-8d9a-d47e2e95733a tempest-DeleteServersTestJSON-1805612840 tempest-DeleteServersTestJSON-1805612840-project] [instance: eaeb6520-bd1e-495e-9ada-744682cbc122] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:25:23.369353 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-e31fc36a-d4c9-4644-8d9a-d47e2e95733a tempest-DeleteServersTestJSON-1805612840 tempest-DeleteServersTestJSON-1805612840-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:25:23.371424 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-e31fc36a-d4c9-4644-8d9a-d47e2e95733a tempest-DeleteServersTestJSON-1805612840 tempest-DeleteServersTestJSON-1805612840-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:25:23.372242 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-e31fc36a-d4c9-4644-8d9a-d47e2e95733a tempest-DeleteServersTestJSON-1805612840 tempest-DeleteServersTestJSON-1805612840-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:25:23.372929 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-e31fc36a-d4c9-4644-8d9a-d47e2e95733a tempest-DeleteServersTestJSON-1805612840 tempest-DeleteServersTestJSON-1805612840-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:25:23.539859 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-e31fc36a-d4c9-4644-8d9a-d47e2e95733a tempest-DeleteServersTestJSON-1805612840 tempest-DeleteServersTestJSON-1805612840-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65322b3497864a64870eadab1ff7d490', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37560cd5b14f43cd85ee2a3ff2716c33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:25:23.560962 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-e31fc36a-d4c9-4644-8d9a-d47e2e95733a tempest-DeleteServersTestJSON-1805612840 tempest-DeleteServersTestJSON-1805612840-project] 10.222.0.11 "GET /compute/v2.1/servers/eaeb6520-bd1e-495e-9ada-744682cbc122" status: 200 len: 1315 microversion: 2.1 time: 0.211873 Nov 17 03:25:23.561733 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 30/73] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:25:23 2021] GET /compute/v2.1/servers/eaeb6520-bd1e-495e-9ada-744682cbc122 => generated 1315 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:25:23.950600 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-99e9f94d-ce7c-40bf-b45c-1f8c1b8344ea tempest-VolumesTestJSON-1913211934 tempest-VolumesTestJSON-1913211934-project] Calling method '.version_select at 0x7f9e1dc72670>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:25:24.000149 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-99e9f94d-ce7c-40bf-b45c-1f8c1b8344ea tempest-VolumesTestJSON-1913211934 tempest-VolumesTestJSON-1913211934-project] 10.222.0.11 "GET /compute/v2.1/os-volumes/1533652e-ec7d-4886-8d87-36583f308378" status: 200 len: 350 microversion: 2.1 time: 0.053393 Nov 17 03:25:24.000943 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 44/74] 10.222.0.11 () {58 vars in 1244 bytes} [Wed Nov 17 03:25:23 2021] GET /compute/v2.1/os-volumes/1533652e-ec7d-4886-8d87-36583f308378 => generated 350 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 17 03:25:24.011834 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-ef3cad8e-9108-49ac-b748-9c7fd076cebd tempest-VolumesTestJSON-1913211934 tempest-VolumesTestJSON-1913211934-project] Calling method '.version_select at 0x7f9e1d3c4a60>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:25:24.129170 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-ef3cad8e-9108-49ac-b748-9c7fd076cebd tempest-VolumesTestJSON-1913211934 tempest-VolumesTestJSON-1913211934-project] 10.222.0.11 "GET /compute/v2.1/os-volumes" status: 200 len: 1034 microversion: 2.1 time: 0.120819 Nov 17 03:25:24.142985 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 31/75] 10.222.0.11 () {58 vars in 1133 bytes} [Wed Nov 17 03:25:24 2021] GET /compute/v2.1/os-volumes => generated 1034 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:25:24.144689 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-442c865c-f0a1-4d8d-9acd-302008751772 tempest-VolumesTestJSON-1913211934 tempest-VolumesTestJSON-1913211934-project] Calling method '.version_select at 0x7f9e1dc5a310>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:25:24.161583 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-387d68dc-0356-4617-a042-d26fe37b41a6 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:25:24.162395 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-387d68dc-0356-4617-a042-d26fe37b41a6 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] [instance: 6dc785d7-bc95-4fee-8206-c2fd3b930e4f] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:25:24.170376 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-387d68dc-0356-4617-a042-d26fe37b41a6 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:25:24.171006 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-387d68dc-0356-4617-a042-d26fe37b41a6 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:25:24.173060 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-387d68dc-0356-4617-a042-d26fe37b41a6 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:25:24.173843 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-387d68dc-0356-4617-a042-d26fe37b41a6 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:25:24.252237 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-387d68dc-0356-4617-a042-d26fe37b41a6 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f046401c6a04f6495ebe0821120bd72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a58e89ceeea4a9c8a72a1de4bcaf2d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:25:24.260501 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-387d68dc-0356-4617-a042-d26fe37b41a6 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] 10.222.0.11 "GET /compute/v2.1/servers/6dc785d7-bc95-4fee-8206-c2fd3b930e4f" status: 200 len: 1225 microversion: 2.1 time: 0.116355 Nov 17 03:25:24.261418 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 32/76] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:25:24 2021] GET /compute/v2.1/servers/6dc785d7-bc95-4fee-8206-c2fd3b930e4f => generated 1225 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:25:24.266827 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-39a99a6a-c2ff-439f-b66b-3ceac0f5ff12 tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:25:24.267665 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-39a99a6a-c2ff-439f-b66b-3ceac0f5ff12 tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] [instance: 61d387ba-e928-4e5f-a79c-4f757643903c] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:25:24.280142 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-39a99a6a-c2ff-439f-b66b-3ceac0f5ff12 tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:25:24.282661 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-39a99a6a-c2ff-439f-b66b-3ceac0f5ff12 tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:25:24.285588 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-39a99a6a-c2ff-439f-b66b-3ceac0f5ff12 tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:25:24.285588 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-39a99a6a-c2ff-439f-b66b-3ceac0f5ff12 tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:25:24.304077 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-442c865c-f0a1-4d8d-9acd-302008751772 tempest-VolumesTestJSON-1913211934 tempest-VolumesTestJSON-1913211934-project] 10.222.0.11 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 693 microversion: 2.1 time: 0.165341 Nov 17 03:25:24.314436 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 45/77] 10.222.0.11 () {58 vars in 1148 bytes} [Wed Nov 17 03:25:24 2021] GET /compute/v2.1/os-volumes?limit=2 => generated 693 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 17 03:25:24.321759 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-d92a3bdb-d2e2-4c0e-b18e-355743eaa56c tempest-VolumesTestJSON-1913211934 tempest-VolumesTestJSON-1913211934-project] Calling method '.version_select at 0x7f9e1dc6a040>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:25:24.473547 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-d92a3bdb-d2e2-4c0e-b18e-355743eaa56c tempest-VolumesTestJSON-1913211934 tempest-VolumesTestJSON-1913211934-project] 10.222.0.11 "GET /compute/v2.1/os-volumes" status: 200 len: 1034 microversion: 2.1 time: 0.148280 Nov 17 03:25:24.473547 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 46/78] 10.222.0.11 () {58 vars in 1133 bytes} [Wed Nov 17 03:25:24 2021] GET /compute/v2.1/os-volumes => generated 1034 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:25:24.473547 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-c87c81dd-2563-4319-9afa-100686dc6d59 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:25:24.473547 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-c87c81dd-2563-4319-9afa-100686dc6d59 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] [instance: 5d54db85-b991-4890-abaa-952413baa2e7] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:25:24.493359 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-c87c81dd-2563-4319-9afa-100686dc6d59 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:25:24.499186 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-c87c81dd-2563-4319-9afa-100686dc6d59 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:25:24.500059 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-c87c81dd-2563-4319-9afa-100686dc6d59 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:25:24.500578 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-c87c81dd-2563-4319-9afa-100686dc6d59 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:25:24.576412 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-39a99a6a-c2ff-439f-b66b-3ceac0f5ff12 tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d4e8ac9538f42c9b637bd9e086668b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfc480343d4d493bb4295b055e274df5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:25:24.584143 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-39a99a6a-c2ff-439f-b66b-3ceac0f5ff12 tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] 10.222.0.11 "GET /compute/v2.1/servers/61d387ba-e928-4e5f-a79c-4f757643903c" status: 200 len: 1318 microversion: 2.1 time: 0.321324 Nov 17 03:25:24.585332 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 33/79] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:25:24 2021] GET /compute/v2.1/servers/61d387ba-e928-4e5f-a79c-4f757643903c => generated 1318 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:25:24.599021 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-483ace01-7cc0-44cc-960e-c7e7d0a73079 tempest-VolumesTestJSON-1913211934 tempest-VolumesTestJSON-1913211934-project] Calling method '.version_select at 0x7f9e1dc95af0>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:25:24.655277 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-c87c81dd-2563-4319-9afa-100686dc6d59 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37f21d6d15cf40a586edda211219fd08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ebb970305844dccacf48a7d8d47ecf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:25:24.677817 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-c87c81dd-2563-4319-9afa-100686dc6d59 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '37f21d6d15cf40a586edda211219fd08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ebb970305844dccacf48a7d8d47ecf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:25:24.680672 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-c87c81dd-2563-4319-9afa-100686dc6d59 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '37f21d6d15cf40a586edda211219fd08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ebb970305844dccacf48a7d8d47ecf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:25:24.684953 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-c87c81dd-2563-4319-9afa-100686dc6d59 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] 10.222.0.11 "GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7" status: 200 len: 1285 microversion: 2.20 time: 0.219000 Nov 17 03:25:24.695948 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 47/80] 10.222.0.11 () {60 vars in 1276 bytes} [Wed Nov 17 03:25:24 2021] GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7 => generated 1285 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 17 03:25:24.703729 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-fb52cf91-265c-4d2f-bb69-56600e0c9d51 tempest-DeleteServersTestJSON-1805612840 tempest-DeleteServersTestJSON-1805612840-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:25:24.704336 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-fb52cf91-265c-4d2f-bb69-56600e0c9d51 tempest-DeleteServersTestJSON-1805612840 tempest-DeleteServersTestJSON-1805612840-project] [instance: eaeb6520-bd1e-495e-9ada-744682cbc122] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:25:24.718640 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-fb52cf91-265c-4d2f-bb69-56600e0c9d51 tempest-DeleteServersTestJSON-1805612840 tempest-DeleteServersTestJSON-1805612840-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:25:24.725496 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-fb52cf91-265c-4d2f-bb69-56600e0c9d51 tempest-DeleteServersTestJSON-1805612840 tempest-DeleteServersTestJSON-1805612840-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:25:24.726815 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-fb52cf91-265c-4d2f-bb69-56600e0c9d51 tempest-DeleteServersTestJSON-1805612840 tempest-DeleteServersTestJSON-1805612840-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:25:24.727391 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-fb52cf91-265c-4d2f-bb69-56600e0c9d51 tempest-DeleteServersTestJSON-1805612840 tempest-DeleteServersTestJSON-1805612840-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:25:24.854056 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-483ace01-7cc0-44cc-960e-c7e7d0a73079 tempest-VolumesTestJSON-1913211934 tempest-VolumesTestJSON-1913211934-project] 10.222.0.11 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 353 microversion: 2.1 time: 0.257546 Nov 17 03:25:24.854056 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 34/81] 10.222.0.11 () {58 vars in 1166 bytes} [Wed Nov 17 03:25:24 2021] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 353 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 17 03:25:24.870064 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-86145a9f-81cd-4b5b-82cd-7d90ffa93e20 tempest-VolumesTestJSON-1913211934 tempest-VolumesTestJSON-1913211934-project] Calling method '.version_select at 0x7f9e1dc530d0>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:25:25.063200 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-fb52cf91-265c-4d2f-bb69-56600e0c9d51 tempest-DeleteServersTestJSON-1805612840 tempest-DeleteServersTestJSON-1805612840-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65322b3497864a64870eadab1ff7d490', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37560cd5b14f43cd85ee2a3ff2716c33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:25:25.074960 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-fb52cf91-265c-4d2f-bb69-56600e0c9d51 tempest-DeleteServersTestJSON-1805612840 tempest-DeleteServersTestJSON-1805612840-project] 10.222.0.11 "GET /compute/v2.1/servers/eaeb6520-bd1e-495e-9ada-744682cbc122" status: 200 len: 1315 microversion: 2.1 time: 0.382651 Nov 17 03:25:25.078926 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 48/82] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:25:24 2021] GET /compute/v2.1/servers/eaeb6520-bd1e-495e-9ada-744682cbc122 => generated 1315 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:25:25.093698 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-86145a9f-81cd-4b5b-82cd-7d90ffa93e20 tempest-VolumesTestJSON-1913211934 tempest-VolumesTestJSON-1913211934-project] 10.222.0.11 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 693 microversion: 2.1 time: 0.238487 Nov 17 03:25:25.094739 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 35/83] 10.222.0.11 () {58 vars in 1169 bytes} [Wed Nov 17 03:25:24 2021] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 693 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 17 03:25:25.109148 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-e62ac44c-1c4c-49ad-8327-51ff85f2bdfa tempest-VolumesTestJSON-1913211934 tempest-VolumesTestJSON-1913211934-project] Calling method '.version_select at 0x7f9e1dc235e0>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:25:25.246012 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-e62ac44c-1c4c-49ad-8327-51ff85f2bdfa tempest-VolumesTestJSON-1913211934 tempest-VolumesTestJSON-1913211934-project] 10.222.0.11 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1034 microversion: 2.1 time: 0.140716 Nov 17 03:25:25.246592 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 49/84] 10.222.0.11 () {58 vars in 1154 bytes} [Wed Nov 17 03:25:25 2021] GET /compute/v2.1/os-volumes/detail => generated 1034 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:25:25.257599 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-4dfafdc7-27a5-4f8a-ae9e-1a984614c451 tempest-VolumesTestJSON-1913211934 tempest-VolumesTestJSON-1913211934-project] Calling method '.version_select at 0x7f9e1d4141f0>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:25:25.277362 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-a329ae1f-52de-49ac-8739-0ccd86af9a33 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:25:25.277965 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-a329ae1f-52de-49ac-8739-0ccd86af9a33 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] [instance: 6dc785d7-bc95-4fee-8206-c2fd3b930e4f] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:25:25.284908 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-a329ae1f-52de-49ac-8739-0ccd86af9a33 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:25:25.285717 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-a329ae1f-52de-49ac-8739-0ccd86af9a33 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:25:25.286269 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-a329ae1f-52de-49ac-8739-0ccd86af9a33 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:25:25.286762 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-a329ae1f-52de-49ac-8739-0ccd86af9a33 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:25:25.355043 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-a329ae1f-52de-49ac-8739-0ccd86af9a33 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f046401c6a04f6495ebe0821120bd72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a58e89ceeea4a9c8a72a1de4bcaf2d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:25:25.363326 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-a329ae1f-52de-49ac-8739-0ccd86af9a33 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] 10.222.0.11 "GET /compute/v2.1/servers/6dc785d7-bc95-4fee-8206-c2fd3b930e4f" status: 200 len: 1225 microversion: 2.1 time: 0.089579 Nov 17 03:25:25.364654 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 50/85] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:25:25 2021] GET /compute/v2.1/servers/6dc785d7-bc95-4fee-8206-c2fd3b930e4f => generated 1225 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 17 03:25:25.394700 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-4dfafdc7-27a5-4f8a-ae9e-1a984614c451 tempest-VolumesTestJSON-1913211934 tempest-VolumesTestJSON-1913211934-project] 10.222.0.11 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 353 microversion: 2.1 time: 0.140648 Nov 17 03:25:25.395961 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 36/86] 10.222.0.11 () {58 vars in 1187 bytes} [Wed Nov 17 03:25:25 2021] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 353 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 17 03:25:25.409291 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-c90fb9af-3c9d-4e7c-8f11-1c1ab4f011e1 tempest-VolumesTestJSON-1913211934 tempest-VolumesTestJSON-1913211934-project] Calling method '.version_select at 0x7f9e1e565c10>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:25:25.499134 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-c90fb9af-3c9d-4e7c-8f11-1c1ab4f011e1 tempest-VolumesTestJSON-1913211934 tempest-VolumesTestJSON-1913211934-project] 10.222.0.11 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1034 microversion: 2.1 time: 0.093489 Nov 17 03:25:25.499706 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 51/87] 10.222.0.11 () {58 vars in 1154 bytes} [Wed Nov 17 03:25:25 2021] GET /compute/v2.1/os-volumes/detail => generated 1034 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:25:25.607534 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-3b998b04-95e4-4fe6-9c87-4b4637da2cb5 tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:25:25.608656 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-3b998b04-95e4-4fe6-9c87-4b4637da2cb5 tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] [instance: 61d387ba-e928-4e5f-a79c-4f757643903c] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:25:25.620817 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-3b998b04-95e4-4fe6-9c87-4b4637da2cb5 tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:25:25.621468 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-3b998b04-95e4-4fe6-9c87-4b4637da2cb5 tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:25:25.622401 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-3b998b04-95e4-4fe6-9c87-4b4637da2cb5 tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:25:25.622909 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-3b998b04-95e4-4fe6-9c87-4b4637da2cb5 tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:25:25.704444 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-4bb6e821-a8cc-4d22-ade1-b4c3a51ff3a2 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:25:25.705066 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-4bb6e821-a8cc-4d22-ade1-b4c3a51ff3a2 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] [instance: 5d54db85-b991-4890-abaa-952413baa2e7] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:25:25.711612 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-4bb6e821-a8cc-4d22-ade1-b4c3a51ff3a2 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:25:25.712319 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-4bb6e821-a8cc-4d22-ade1-b4c3a51ff3a2 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:25:25.713131 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-4bb6e821-a8cc-4d22-ade1-b4c3a51ff3a2 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:25:25.713560 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-4bb6e821-a8cc-4d22-ade1-b4c3a51ff3a2 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:25:25.785528 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-3b998b04-95e4-4fe6-9c87-4b4637da2cb5 tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d4e8ac9538f42c9b637bd9e086668b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfc480343d4d493bb4295b055e274df5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:25:25.793880 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-3b998b04-95e4-4fe6-9c87-4b4637da2cb5 tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] 10.222.0.11 "GET /compute/v2.1/servers/61d387ba-e928-4e5f-a79c-4f757643903c" status: 200 len: 1318 microversion: 2.1 time: 0.193987 Nov 17 03:25:25.794558 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 37/88] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:25:25 2021] GET /compute/v2.1/servers/61d387ba-e928-4e5f-a79c-4f757643903c => generated 1318 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:25:25.803621 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-4bb6e821-a8cc-4d22-ade1-b4c3a51ff3a2 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37f21d6d15cf40a586edda211219fd08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ebb970305844dccacf48a7d8d47ecf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:25:25.809387 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-4bb6e821-a8cc-4d22-ade1-b4c3a51ff3a2 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '37f21d6d15cf40a586edda211219fd08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ebb970305844dccacf48a7d8d47ecf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:25:25.810880 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-4bb6e821-a8cc-4d22-ade1-b4c3a51ff3a2 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '37f21d6d15cf40a586edda211219fd08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ebb970305844dccacf48a7d8d47ecf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:25:25.811973 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-4bb6e821-a8cc-4d22-ade1-b4c3a51ff3a2 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] 10.222.0.11 "GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7" status: 200 len: 1285 microversion: 2.20 time: 0.112005 Nov 17 03:25:25.812698 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 52/89] 10.222.0.11 () {60 vars in 1276 bytes} [Wed Nov 17 03:25:25 2021] GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7 => generated 1285 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 17 03:25:26.095542 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-5f0bbbe4-5be1-4ae4-9681-ca8bff0b41a8 tempest-DeleteServersTestJSON-1805612840 tempest-DeleteServersTestJSON-1805612840-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:25:26.096167 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-5f0bbbe4-5be1-4ae4-9681-ca8bff0b41a8 tempest-DeleteServersTestJSON-1805612840 tempest-DeleteServersTestJSON-1805612840-project] [instance: eaeb6520-bd1e-495e-9ada-744682cbc122] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:25:26.110209 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-5f0bbbe4-5be1-4ae4-9681-ca8bff0b41a8 tempest-DeleteServersTestJSON-1805612840 tempest-DeleteServersTestJSON-1805612840-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:25:26.110209 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-5f0bbbe4-5be1-4ae4-9681-ca8bff0b41a8 tempest-DeleteServersTestJSON-1805612840 tempest-DeleteServersTestJSON-1805612840-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:25:26.110209 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-5f0bbbe4-5be1-4ae4-9681-ca8bff0b41a8 tempest-DeleteServersTestJSON-1805612840 tempest-DeleteServersTestJSON-1805612840-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:25:26.110209 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-5f0bbbe4-5be1-4ae4-9681-ca8bff0b41a8 tempest-DeleteServersTestJSON-1805612840 tempest-DeleteServersTestJSON-1805612840-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:25:26.327011 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-5f0bbbe4-5be1-4ae4-9681-ca8bff0b41a8 tempest-DeleteServersTestJSON-1805612840 tempest-DeleteServersTestJSON-1805612840-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65322b3497864a64870eadab1ff7d490', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37560cd5b14f43cd85ee2a3ff2716c33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:25:26.336041 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-5f0bbbe4-5be1-4ae4-9681-ca8bff0b41a8 tempest-DeleteServersTestJSON-1805612840 tempest-DeleteServersTestJSON-1805612840-project] 10.222.0.11 "GET /compute/v2.1/servers/eaeb6520-bd1e-495e-9ada-744682cbc122" status: 200 len: 1315 microversion: 2.1 time: 0.244577 Nov 17 03:25:26.338430 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 38/90] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:25:26 2021] GET /compute/v2.1/servers/eaeb6520-bd1e-495e-9ada-744682cbc122 => generated 1315 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:25:26.382547 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-339609a6-6e0b-490e-8496-05a580d6772e tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:25:26.384096 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-339609a6-6e0b-490e-8496-05a580d6772e tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] [instance: 6dc785d7-bc95-4fee-8206-c2fd3b930e4f] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:25:26.391315 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-339609a6-6e0b-490e-8496-05a580d6772e tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:25:26.391774 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-339609a6-6e0b-490e-8496-05a580d6772e tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:25:26.392536 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-339609a6-6e0b-490e-8496-05a580d6772e tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:25:26.393145 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-339609a6-6e0b-490e-8496-05a580d6772e tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:25:26.479474 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-339609a6-6e0b-490e-8496-05a580d6772e tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f046401c6a04f6495ebe0821120bd72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a58e89ceeea4a9c8a72a1de4bcaf2d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:25:26.488586 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-339609a6-6e0b-490e-8496-05a580d6772e tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] 10.222.0.11 "GET /compute/v2.1/servers/6dc785d7-bc95-4fee-8206-c2fd3b930e4f" status: 200 len: 1225 microversion: 2.1 time: 0.110631 Nov 17 03:25:26.489195 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 53/91] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:25:26 2021] GET /compute/v2.1/servers/6dc785d7-bc95-4fee-8206-c2fd3b930e4f => generated 1225 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:25:26.811608 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-2b0c9484-5e74-4ffb-bf95-92fbe76144c2 tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:25:26.812768 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-2b0c9484-5e74-4ffb-bf95-92fbe76144c2 tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] [instance: 61d387ba-e928-4e5f-a79c-4f757643903c] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:25:26.818527 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-2b0c9484-5e74-4ffb-bf95-92fbe76144c2 tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:25:26.819007 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-2b0c9484-5e74-4ffb-bf95-92fbe76144c2 tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:25:26.819988 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-2b0c9484-5e74-4ffb-bf95-92fbe76144c2 tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:25:26.820432 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-2b0c9484-5e74-4ffb-bf95-92fbe76144c2 tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:25:26.831273 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-39a68e0b-8c40-43fa-97ff-7638df428346 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:25:26.832236 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-39a68e0b-8c40-43fa-97ff-7638df428346 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] [instance: 5d54db85-b991-4890-abaa-952413baa2e7] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:25:26.838435 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-39a68e0b-8c40-43fa-97ff-7638df428346 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:25:26.838980 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-39a68e0b-8c40-43fa-97ff-7638df428346 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:25:26.840008 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-39a68e0b-8c40-43fa-97ff-7638df428346 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:25:26.840401 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-39a68e0b-8c40-43fa-97ff-7638df428346 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:25:26.909220 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-39a68e0b-8c40-43fa-97ff-7638df428346 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37f21d6d15cf40a586edda211219fd08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ebb970305844dccacf48a7d8d47ecf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:25:26.920586 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-39a68e0b-8c40-43fa-97ff-7638df428346 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '37f21d6d15cf40a586edda211219fd08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ebb970305844dccacf48a7d8d47ecf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:25:26.922125 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-39a68e0b-8c40-43fa-97ff-7638df428346 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '37f21d6d15cf40a586edda211219fd08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ebb970305844dccacf48a7d8d47ecf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:25:26.923304 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-39a68e0b-8c40-43fa-97ff-7638df428346 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] 10.222.0.11 "GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7" status: 200 len: 1285 microversion: 2.20 time: 0.097303 Nov 17 03:25:26.923851 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 54/92] 10.222.0.11 () {60 vars in 1276 bytes} [Wed Nov 17 03:25:26 2021] GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7 => generated 1285 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 17 03:25:26.966170 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-2b0c9484-5e74-4ffb-bf95-92fbe76144c2 tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d4e8ac9538f42c9b637bd9e086668b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfc480343d4d493bb4295b055e274df5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:25:26.974471 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-2b0c9484-5e74-4ffb-bf95-92fbe76144c2 tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] 10.222.0.11 "GET /compute/v2.1/servers/61d387ba-e928-4e5f-a79c-4f757643903c" status: 200 len: 1318 microversion: 2.1 time: 0.166923 Nov 17 03:25:26.975223 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 39/93] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:25:26 2021] GET /compute/v2.1/servers/61d387ba-e928-4e5f-a79c-4f757643903c => generated 1318 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:25:27.357113 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-bcfdd73b-2525-4863-9f2b-e5fbab36a79d tempest-DeleteServersTestJSON-1805612840 tempest-DeleteServersTestJSON-1805612840-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:25:27.357611 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-bcfdd73b-2525-4863-9f2b-e5fbab36a79d tempest-DeleteServersTestJSON-1805612840 tempest-DeleteServersTestJSON-1805612840-project] [instance: eaeb6520-bd1e-495e-9ada-744682cbc122] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:25:27.363928 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-bcfdd73b-2525-4863-9f2b-e5fbab36a79d tempest-DeleteServersTestJSON-1805612840 tempest-DeleteServersTestJSON-1805612840-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:25:27.364340 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-bcfdd73b-2525-4863-9f2b-e5fbab36a79d tempest-DeleteServersTestJSON-1805612840 tempest-DeleteServersTestJSON-1805612840-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:25:27.365130 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-bcfdd73b-2525-4863-9f2b-e5fbab36a79d tempest-DeleteServersTestJSON-1805612840 tempest-DeleteServersTestJSON-1805612840-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:25:27.365552 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-bcfdd73b-2525-4863-9f2b-e5fbab36a79d tempest-DeleteServersTestJSON-1805612840 tempest-DeleteServersTestJSON-1805612840-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:25:27.496946 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-bcfdd73b-2525-4863-9f2b-e5fbab36a79d tempest-DeleteServersTestJSON-1805612840 tempest-DeleteServersTestJSON-1805612840-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65322b3497864a64870eadab1ff7d490', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37560cd5b14f43cd85ee2a3ff2716c33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:25:27.504812 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-bcfdd73b-2525-4863-9f2b-e5fbab36a79d tempest-DeleteServersTestJSON-1805612840 tempest-DeleteServersTestJSON-1805612840-project] 10.222.0.11 "GET /compute/v2.1/servers/eaeb6520-bd1e-495e-9ada-744682cbc122" status: 200 len: 1315 microversion: 2.1 time: 0.151494 Nov 17 03:25:27.505619 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 55/94] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:25:27 2021] GET /compute/v2.1/servers/eaeb6520-bd1e-495e-9ada-744682cbc122 => generated 1315 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:25:27.507245 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-308b47fb-fef3-4715-bbad-2af989c905c5 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:25:27.507957 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-308b47fb-fef3-4715-bbad-2af989c905c5 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] [instance: 6dc785d7-bc95-4fee-8206-c2fd3b930e4f] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:25:27.514510 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-308b47fb-fef3-4715-bbad-2af989c905c5 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:25:27.514949 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-308b47fb-fef3-4715-bbad-2af989c905c5 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:25:27.515715 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-308b47fb-fef3-4715-bbad-2af989c905c5 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:25:27.516138 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-308b47fb-fef3-4715-bbad-2af989c905c5 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:25:27.580167 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-308b47fb-fef3-4715-bbad-2af989c905c5 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f046401c6a04f6495ebe0821120bd72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a58e89ceeea4a9c8a72a1de4bcaf2d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:25:27.590162 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-308b47fb-fef3-4715-bbad-2af989c905c5 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] 10.222.0.11 "GET /compute/v2.1/servers/6dc785d7-bc95-4fee-8206-c2fd3b930e4f" status: 200 len: 1225 microversion: 2.1 time: 0.086369 Nov 17 03:25:27.590765 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 40/95] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:25:27 2021] GET /compute/v2.1/servers/6dc785d7-bc95-4fee-8206-c2fd3b930e4f => generated 1225 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:25:27.946809 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-e7cf61b6-e109-4be0-a5db-b5496f4eaf44 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:25:27.947666 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-e7cf61b6-e109-4be0-a5db-b5496f4eaf44 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] [instance: 5d54db85-b991-4890-abaa-952413baa2e7] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:25:27.955085 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-e7cf61b6-e109-4be0-a5db-b5496f4eaf44 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:25:27.955524 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-e7cf61b6-e109-4be0-a5db-b5496f4eaf44 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:25:27.956285 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-e7cf61b6-e109-4be0-a5db-b5496f4eaf44 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:25:27.956733 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-e7cf61b6-e109-4be0-a5db-b5496f4eaf44 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:25:27.991334 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-f6cfb971-1afb-4be9-a4ae-9111ee74f4ca tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:25:27.991940 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-f6cfb971-1afb-4be9-a4ae-9111ee74f4ca tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] [instance: 61d387ba-e928-4e5f-a79c-4f757643903c] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:25:27.998503 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-f6cfb971-1afb-4be9-a4ae-9111ee74f4ca tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:25:27.998954 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-f6cfb971-1afb-4be9-a4ae-9111ee74f4ca tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:25:27.999738 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-f6cfb971-1afb-4be9-a4ae-9111ee74f4ca tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:25:28.000192 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-f6cfb971-1afb-4be9-a4ae-9111ee74f4ca tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:25:28.016487 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-e7cf61b6-e109-4be0-a5db-b5496f4eaf44 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37f21d6d15cf40a586edda211219fd08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ebb970305844dccacf48a7d8d47ecf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:25:28.025175 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-e7cf61b6-e109-4be0-a5db-b5496f4eaf44 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '37f21d6d15cf40a586edda211219fd08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ebb970305844dccacf48a7d8d47ecf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:25:28.026726 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-e7cf61b6-e109-4be0-a5db-b5496f4eaf44 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '37f21d6d15cf40a586edda211219fd08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ebb970305844dccacf48a7d8d47ecf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:25:28.028117 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-e7cf61b6-e109-4be0-a5db-b5496f4eaf44 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] 10.222.0.11 "GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7" status: 200 len: 1285 microversion: 2.20 time: 0.087719 Nov 17 03:25:28.028661 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 56/96] 10.222.0.11 () {60 vars in 1276 bytes} [Wed Nov 17 03:25:27 2021] GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7 => generated 1285 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 17 03:25:28.153355 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-f6cfb971-1afb-4be9-a4ae-9111ee74f4ca tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d4e8ac9538f42c9b637bd9e086668b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfc480343d4d493bb4295b055e274df5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:25:28.160726 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-f6cfb971-1afb-4be9-a4ae-9111ee74f4ca tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] 10.222.0.11 "GET /compute/v2.1/servers/61d387ba-e928-4e5f-a79c-4f757643903c" status: 200 len: 1318 microversion: 2.1 time: 0.173095 Nov 17 03:25:28.161351 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 41/97] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:25:27 2021] GET /compute/v2.1/servers/61d387ba-e928-4e5f-a79c-4f757643903c => generated 1318 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:25:28.521488 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-831214be-3f39-4a93-9c38-20f78337a695 tempest-DeleteServersTestJSON-1805612840 tempest-DeleteServersTestJSON-1805612840-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:25:28.522117 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-831214be-3f39-4a93-9c38-20f78337a695 tempest-DeleteServersTestJSON-1805612840 tempest-DeleteServersTestJSON-1805612840-project] [instance: eaeb6520-bd1e-495e-9ada-744682cbc122] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:25:28.528557 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-831214be-3f39-4a93-9c38-20f78337a695 tempest-DeleteServersTestJSON-1805612840 tempest-DeleteServersTestJSON-1805612840-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:25:28.529044 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-831214be-3f39-4a93-9c38-20f78337a695 tempest-DeleteServersTestJSON-1805612840 tempest-DeleteServersTestJSON-1805612840-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:25:28.529970 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-831214be-3f39-4a93-9c38-20f78337a695 tempest-DeleteServersTestJSON-1805612840 tempest-DeleteServersTestJSON-1805612840-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:25:28.530402 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-831214be-3f39-4a93-9c38-20f78337a695 tempest-DeleteServersTestJSON-1805612840 tempest-DeleteServersTestJSON-1805612840-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:25:28.607266 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-861c4e04-c790-474e-8a5c-582be84033bc tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:25:28.607968 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-861c4e04-c790-474e-8a5c-582be84033bc tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] [instance: 6dc785d7-bc95-4fee-8206-c2fd3b930e4f] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:25:28.615747 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-861c4e04-c790-474e-8a5c-582be84033bc tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:25:28.616542 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-861c4e04-c790-474e-8a5c-582be84033bc tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:25:28.617373 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-861c4e04-c790-474e-8a5c-582be84033bc tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:25:28.617996 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-861c4e04-c790-474e-8a5c-582be84033bc tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:25:28.681332 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-861c4e04-c790-474e-8a5c-582be84033bc tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f046401c6a04f6495ebe0821120bd72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a58e89ceeea4a9c8a72a1de4bcaf2d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:25:28.691312 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-861c4e04-c790-474e-8a5c-582be84033bc tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] 10.222.0.11 "GET /compute/v2.1/servers/6dc785d7-bc95-4fee-8206-c2fd3b930e4f" status: 200 len: 1217 microversion: 2.1 time: 0.088098 Nov 17 03:25:28.692268 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 42/98] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:25:28 2021] GET /compute/v2.1/servers/6dc785d7-bc95-4fee-8206-c2fd3b930e4f => generated 1217 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 17 03:25:29.046711 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-a8e0eb6f-13fa-40f1-834d-06899ff5e512 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:25:29.047253 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-a8e0eb6f-13fa-40f1-834d-06899ff5e512 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] [instance: 5d54db85-b991-4890-abaa-952413baa2e7] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:25:29.054062 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-a8e0eb6f-13fa-40f1-834d-06899ff5e512 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:25:29.054452 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-a8e0eb6f-13fa-40f1-834d-06899ff5e512 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:25:29.055526 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-a8e0eb6f-13fa-40f1-834d-06899ff5e512 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:25:29.055969 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-a8e0eb6f-13fa-40f1-834d-06899ff5e512 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:25:29.133760 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-a8e0eb6f-13fa-40f1-834d-06899ff5e512 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37f21d6d15cf40a586edda211219fd08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ebb970305844dccacf48a7d8d47ecf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:25:29.142715 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-a8e0eb6f-13fa-40f1-834d-06899ff5e512 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '37f21d6d15cf40a586edda211219fd08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ebb970305844dccacf48a7d8d47ecf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:25:29.144213 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-a8e0eb6f-13fa-40f1-834d-06899ff5e512 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '37f21d6d15cf40a586edda211219fd08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ebb970305844dccacf48a7d8d47ecf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:25:29.145467 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-a8e0eb6f-13fa-40f1-834d-06899ff5e512 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] 10.222.0.11 "GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7" status: 200 len: 1277 microversion: 2.20 time: 0.103350 Nov 17 03:25:29.146631 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 43/99] 10.222.0.11 () {60 vars in 1276 bytes} [Wed Nov 17 03:25:29 2021] GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7 => generated 1277 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 17 03:25:29.180806 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-17ddf2d6-e675-4362-a0e1-9c6ec0c01864 tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:25:29.182193 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-17ddf2d6-e675-4362-a0e1-9c6ec0c01864 tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] [instance: 61d387ba-e928-4e5f-a79c-4f757643903c] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:25:29.192167 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-17ddf2d6-e675-4362-a0e1-9c6ec0c01864 tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:25:29.193160 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-17ddf2d6-e675-4362-a0e1-9c6ec0c01864 tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:25:29.194593 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-17ddf2d6-e675-4362-a0e1-9c6ec0c01864 tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:25:29.195178 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-17ddf2d6-e675-4362-a0e1-9c6ec0c01864 tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:25:29.246944 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-831214be-3f39-4a93-9c38-20f78337a695 tempest-DeleteServersTestJSON-1805612840 tempest-DeleteServersTestJSON-1805612840-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65322b3497864a64870eadab1ff7d490', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37560cd5b14f43cd85ee2a3ff2716c33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:25:29.261672 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-831214be-3f39-4a93-9c38-20f78337a695 tempest-DeleteServersTestJSON-1805612840 tempest-DeleteServersTestJSON-1805612840-project] 10.222.0.11 "GET /compute/v2.1/servers/eaeb6520-bd1e-495e-9ada-744682cbc122" status: 200 len: 1315 microversion: 2.1 time: 0.743422 Nov 17 03:25:29.262160 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 57/100] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:25:28 2021] GET /compute/v2.1/servers/eaeb6520-bd1e-495e-9ada-744682cbc122 => generated 1315 bytes in 745 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:25:29.708404 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-2468087b-41f1-4e36-a01a-0013320b2145 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:25:29.709731 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-2468087b-41f1-4e36-a01a-0013320b2145 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] [instance: 6dc785d7-bc95-4fee-8206-c2fd3b930e4f] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:25:29.721063 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-2468087b-41f1-4e36-a01a-0013320b2145 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:25:29.721938 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-2468087b-41f1-4e36-a01a-0013320b2145 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:25:29.723268 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-2468087b-41f1-4e36-a01a-0013320b2145 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:25:29.725921 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-2468087b-41f1-4e36-a01a-0013320b2145 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:25:29.760156 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-17ddf2d6-e675-4362-a0e1-9c6ec0c01864 tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d4e8ac9538f42c9b637bd9e086668b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfc480343d4d493bb4295b055e274df5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:25:29.777489 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-17ddf2d6-e675-4362-a0e1-9c6ec0c01864 tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] 10.222.0.11 "GET /compute/v2.1/servers/61d387ba-e928-4e5f-a79c-4f757643903c" status: 200 len: 1318 microversion: 2.1 time: 0.602978 Nov 17 03:25:29.783570 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 44/101] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:25:29 2021] GET /compute/v2.1/servers/61d387ba-e928-4e5f-a79c-4f757643903c => generated 1318 bytes in 610 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 17 03:25:30.004721 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-2468087b-41f1-4e36-a01a-0013320b2145 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f046401c6a04f6495ebe0821120bd72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a58e89ceeea4a9c8a72a1de4bcaf2d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:25:30.021404 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-2468087b-41f1-4e36-a01a-0013320b2145 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] 10.222.0.11 "GET /compute/v2.1/servers/6dc785d7-bc95-4fee-8206-c2fd3b930e4f" status: 200 len: 1279 microversion: 2.1 time: 0.308206 Nov 17 03:25:30.025485 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 58/102] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:25:29 2021] GET /compute/v2.1/servers/6dc785d7-bc95-4fee-8206-c2fd3b930e4f => generated 1279 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 17 03:25:30.166082 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-b46e10f7-275f-4d5e-bc86-a767ba1893ac tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:25:30.166864 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-b46e10f7-275f-4d5e-bc86-a767ba1893ac tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] [instance: 5d54db85-b991-4890-abaa-952413baa2e7] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:25:30.172961 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-b46e10f7-275f-4d5e-bc86-a767ba1893ac tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:25:30.173457 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-b46e10f7-275f-4d5e-bc86-a767ba1893ac tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:25:30.174237 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-b46e10f7-275f-4d5e-bc86-a767ba1893ac tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:25:30.174799 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-b46e10f7-275f-4d5e-bc86-a767ba1893ac tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:25:30.241050 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-b46e10f7-275f-4d5e-bc86-a767ba1893ac tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37f21d6d15cf40a586edda211219fd08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ebb970305844dccacf48a7d8d47ecf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:25:30.249837 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-b46e10f7-275f-4d5e-bc86-a767ba1893ac tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '37f21d6d15cf40a586edda211219fd08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ebb970305844dccacf48a7d8d47ecf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:25:30.251359 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-b46e10f7-275f-4d5e-bc86-a767ba1893ac tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '37f21d6d15cf40a586edda211219fd08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ebb970305844dccacf48a7d8d47ecf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:25:30.252422 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-b46e10f7-275f-4d5e-bc86-a767ba1893ac tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] 10.222.0.11 "GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7" status: 200 len: 1341 microversion: 2.20 time: 0.090501 Nov 17 03:25:30.253151 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 45/103] 10.222.0.11 () {60 vars in 1276 bytes} [Wed Nov 17 03:25:30 2021] GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7 => generated 1341 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 17 03:25:30.281873 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-b7f15845-d5ff-475d-9584-74322a6e80ca tempest-DeleteServersTestJSON-1805612840 tempest-DeleteServersTestJSON-1805612840-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:25:30.282947 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-b7f15845-d5ff-475d-9584-74322a6e80ca tempest-DeleteServersTestJSON-1805612840 tempest-DeleteServersTestJSON-1805612840-project] [instance: eaeb6520-bd1e-495e-9ada-744682cbc122] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:25:30.290070 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-b7f15845-d5ff-475d-9584-74322a6e80ca tempest-DeleteServersTestJSON-1805612840 tempest-DeleteServersTestJSON-1805612840-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:25:30.290507 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-b7f15845-d5ff-475d-9584-74322a6e80ca tempest-DeleteServersTestJSON-1805612840 tempest-DeleteServersTestJSON-1805612840-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:25:30.291446 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-b7f15845-d5ff-475d-9584-74322a6e80ca tempest-DeleteServersTestJSON-1805612840 tempest-DeleteServersTestJSON-1805612840-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:25:30.292013 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-b7f15845-d5ff-475d-9584-74322a6e80ca tempest-DeleteServersTestJSON-1805612840 tempest-DeleteServersTestJSON-1805612840-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:25:30.575269 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [req-caf76ff0-4688-4afb-a906-b1201a002969 req-dc5c396b-64fb-4616-b996-efad62e60963 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "eaeb6520-bd1e-495e-9ada-744682cbc122", "tag": "62a0417d-dfab-44cc-97c9-23c9da049bdf"}]} {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 17 03:25:30.577475 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 17 03:25:30.577475 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: warnings.warn(msg) Nov 17 03:25:30.587300 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [req-caf76ff0-4688-4afb-a906-b1201a002969 req-dc5c396b-64fb-4616-b996-efad62e60963 service nova] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:25:30.587724 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [req-caf76ff0-4688-4afb-a906-b1201a002969 req-dc5c396b-64fb-4616-b996-efad62e60963 service nova] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:25:30.608389 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.compute.server_external_events [req-caf76ff0-4688-4afb-a906-b1201a002969 req-dc5c396b-64fb-4616-b996-efad62e60963 service nova] Creating event network-changed:62a0417d-dfab-44cc-97c9-23c9da049bdf for instance eaeb6520-bd1e-495e-9ada-744682cbc122 on hv-cinder-81803 Nov 17 03:25:30.608959 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [req-caf76ff0-4688-4afb-a906-b1201a002969 req-dc5c396b-64fb-4616-b996-efad62e60963 service nova] Acquired lock "compute-rpcapi-router" {{(pid=115916) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Nov 17 03:25:30.610125 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-807c5170-79df-4fb6-b1ae-84762d58772a None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:25:30.610679 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-807c5170-79df-4fb6-b1ae-84762d58772a None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:25:30.612446 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-807c5170-79df-4fb6-b1ae-84762d58772a None None] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:25:30.612931 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-807c5170-79df-4fb6-b1ae-84762d58772a None None] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:25:30.622596 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.compute.rpcapi [None req-807c5170-79df-4fb6-b1ae-84762d58772a None None] Automatically selected compute RPC version 6.0 from minimum service version 60 Nov 17 03:25:30.623491 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-807c5170-79df-4fb6-b1ae-84762d58772a None None] Releasing lock "compute-rpcapi-router" {{(pid=115916) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Nov 17 03:25:30.650923 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-b7f15845-d5ff-475d-9584-74322a6e80ca tempest-DeleteServersTestJSON-1805612840 tempest-DeleteServersTestJSON-1805612840-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65322b3497864a64870eadab1ff7d490', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37560cd5b14f43cd85ee2a3ff2716c33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:25:30.652252 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-807c5170-79df-4fb6-b1ae-84762d58772a None None] 10.222.0.11 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.142051 Nov 17 03:25:30.653245 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 46/104] 10.222.0.11 () {64 vars in 1317 bytes} [Wed Nov 17 03:25:30 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 17 03:25:30.660364 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-b7f15845-d5ff-475d-9584-74322a6e80ca tempest-DeleteServersTestJSON-1805612840 tempest-DeleteServersTestJSON-1805612840-project] 10.222.0.11 "GET /compute/v2.1/servers/eaeb6520-bd1e-495e-9ada-744682cbc122" status: 200 len: 1315 microversion: 2.1 time: 0.384002 Nov 17 03:25:30.661269 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 59/105] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:25:30 2021] GET /compute/v2.1/servers/eaeb6520-bd1e-495e-9ada-744682cbc122 => generated 1315 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:25:30.801178 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-f07ac648-d9fe-485c-b195-9c45305fedfd tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:25:30.801796 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-f07ac648-d9fe-485c-b195-9c45305fedfd tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] [instance: 61d387ba-e928-4e5f-a79c-4f757643903c] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:25:30.808227 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-f07ac648-d9fe-485c-b195-9c45305fedfd tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:25:30.808726 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-f07ac648-d9fe-485c-b195-9c45305fedfd tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:25:30.809522 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-f07ac648-d9fe-485c-b195-9c45305fedfd tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:25:30.809944 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-f07ac648-d9fe-485c-b195-9c45305fedfd tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:25:30.942077 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-f07ac648-d9fe-485c-b195-9c45305fedfd tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d4e8ac9538f42c9b637bd9e086668b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfc480343d4d493bb4295b055e274df5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:25:30.950067 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-f07ac648-d9fe-485c-b195-9c45305fedfd tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] 10.222.0.11 "GET /compute/v2.1/servers/61d387ba-e928-4e5f-a79c-4f757643903c" status: 200 len: 1318 microversion: 2.1 time: 0.153167 Nov 17 03:25:30.950635 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 47/106] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:25:30 2021] GET /compute/v2.1/servers/61d387ba-e928-4e5f-a79c-4f757643903c => generated 1318 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:25:31.033152 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-d67b70ca-2770-413b-9ffe-272870dafaed tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:25:31.033856 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-d67b70ca-2770-413b-9ffe-272870dafaed tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] [instance: 6dc785d7-bc95-4fee-8206-c2fd3b930e4f] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:25:31.040548 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-d67b70ca-2770-413b-9ffe-272870dafaed tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:25:31.041066 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-d67b70ca-2770-413b-9ffe-272870dafaed tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:25:31.041909 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-d67b70ca-2770-413b-9ffe-272870dafaed tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:25:31.042385 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-d67b70ca-2770-413b-9ffe-272870dafaed tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:25:31.182083 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-d67b70ca-2770-413b-9ffe-272870dafaed tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f046401c6a04f6495ebe0821120bd72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a58e89ceeea4a9c8a72a1de4bcaf2d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:25:31.190625 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-d67b70ca-2770-413b-9ffe-272870dafaed tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] 10.222.0.11 "GET /compute/v2.1/servers/6dc785d7-bc95-4fee-8206-c2fd3b930e4f" status: 200 len: 1321 microversion: 2.1 time: 0.161511 Nov 17 03:25:31.191197 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 60/107] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:25:31 2021] GET /compute/v2.1/servers/6dc785d7-bc95-4fee-8206-c2fd3b930e4f => generated 1321 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:25:31.275620 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-20ec012d-0a35-4623-85a4-9d44d3b772b0 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:25:31.276628 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-20ec012d-0a35-4623-85a4-9d44d3b772b0 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] [instance: 5d54db85-b991-4890-abaa-952413baa2e7] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:25:31.283441 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-20ec012d-0a35-4623-85a4-9d44d3b772b0 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:25:31.283890 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-20ec012d-0a35-4623-85a4-9d44d3b772b0 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:25:31.284666 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-20ec012d-0a35-4623-85a4-9d44d3b772b0 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:25:31.285130 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-20ec012d-0a35-4623-85a4-9d44d3b772b0 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:25:31.348690 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-20ec012d-0a35-4623-85a4-9d44d3b772b0 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37f21d6d15cf40a586edda211219fd08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ebb970305844dccacf48a7d8d47ecf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:25:31.358964 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-20ec012d-0a35-4623-85a4-9d44d3b772b0 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '37f21d6d15cf40a586edda211219fd08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ebb970305844dccacf48a7d8d47ecf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:25:31.360458 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-20ec012d-0a35-4623-85a4-9d44d3b772b0 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '37f21d6d15cf40a586edda211219fd08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ebb970305844dccacf48a7d8d47ecf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:25:31.361608 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-20ec012d-0a35-4623-85a4-9d44d3b772b0 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] 10.222.0.11 "GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7" status: 200 len: 1341 microversion: 2.20 time: 0.092272 Nov 17 03:25:31.362172 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 48/108] 10.222.0.11 () {60 vars in 1276 bytes} [Wed Nov 17 03:25:31 2021] GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7 => generated 1341 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 17 03:25:31.677355 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-81badd2b-a619-43f0-88a4-fc0187cee7ba tempest-DeleteServersTestJSON-1805612840 tempest-DeleteServersTestJSON-1805612840-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:25:31.677869 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-81badd2b-a619-43f0-88a4-fc0187cee7ba tempest-DeleteServersTestJSON-1805612840 tempest-DeleteServersTestJSON-1805612840-project] [instance: eaeb6520-bd1e-495e-9ada-744682cbc122] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:25:31.684423 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-81badd2b-a619-43f0-88a4-fc0187cee7ba tempest-DeleteServersTestJSON-1805612840 tempest-DeleteServersTestJSON-1805612840-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:25:31.684957 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-81badd2b-a619-43f0-88a4-fc0187cee7ba tempest-DeleteServersTestJSON-1805612840 tempest-DeleteServersTestJSON-1805612840-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:25:31.685663 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-81badd2b-a619-43f0-88a4-fc0187cee7ba tempest-DeleteServersTestJSON-1805612840 tempest-DeleteServersTestJSON-1805612840-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:25:31.686089 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-81badd2b-a619-43f0-88a4-fc0187cee7ba tempest-DeleteServersTestJSON-1805612840 tempest-DeleteServersTestJSON-1805612840-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:25:31.830021 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-81badd2b-a619-43f0-88a4-fc0187cee7ba tempest-DeleteServersTestJSON-1805612840 tempest-DeleteServersTestJSON-1805612840-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65322b3497864a64870eadab1ff7d490', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37560cd5b14f43cd85ee2a3ff2716c33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:25:31.837661 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-81badd2b-a619-43f0-88a4-fc0187cee7ba tempest-DeleteServersTestJSON-1805612840 tempest-DeleteServersTestJSON-1805612840-project] 10.222.0.11 "GET /compute/v2.1/servers/eaeb6520-bd1e-495e-9ada-744682cbc122" status: 200 len: 1315 microversion: 2.1 time: 0.164372 Nov 17 03:25:31.838224 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 61/109] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:25:31 2021] GET /compute/v2.1/servers/eaeb6520-bd1e-495e-9ada-744682cbc122 => generated 1315 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:25:31.970894 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-09f32be7-45a4-4cc2-9206-30f2872fc05b tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:25:31.971735 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-09f32be7-45a4-4cc2-9206-30f2872fc05b tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] [instance: 61d387ba-e928-4e5f-a79c-4f757643903c] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:25:31.982089 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-09f32be7-45a4-4cc2-9206-30f2872fc05b tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:25:31.982860 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-09f32be7-45a4-4cc2-9206-30f2872fc05b tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:25:31.984117 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-09f32be7-45a4-4cc2-9206-30f2872fc05b tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:25:31.984833 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-09f32be7-45a4-4cc2-9206-30f2872fc05b tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:25:32.123597 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-09f32be7-45a4-4cc2-9206-30f2872fc05b tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d4e8ac9538f42c9b637bd9e086668b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfc480343d4d493bb4295b055e274df5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:25:32.131031 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-09f32be7-45a4-4cc2-9206-30f2872fc05b tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] 10.222.0.11 "GET /compute/v2.1/servers/61d387ba-e928-4e5f-a79c-4f757643903c" status: 200 len: 1318 microversion: 2.1 time: 0.166493 Nov 17 03:25:32.131602 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 49/110] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:25:31 2021] GET /compute/v2.1/servers/61d387ba-e928-4e5f-a79c-4f757643903c => generated 1318 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:25:32.211444 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-cebfd286-5251-4890-978a-3966203b6991 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:25:32.212043 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-cebfd286-5251-4890-978a-3966203b6991 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] [instance: 6dc785d7-bc95-4fee-8206-c2fd3b930e4f] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:25:32.218417 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-cebfd286-5251-4890-978a-3966203b6991 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:25:32.218925 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-cebfd286-5251-4890-978a-3966203b6991 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:25:32.219705 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-cebfd286-5251-4890-978a-3966203b6991 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:25:32.220128 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-cebfd286-5251-4890-978a-3966203b6991 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:25:32.362705 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-cebfd286-5251-4890-978a-3966203b6991 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f046401c6a04f6495ebe0821120bd72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a58e89ceeea4a9c8a72a1de4bcaf2d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:25:32.370427 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-cebfd286-5251-4890-978a-3966203b6991 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] 10.222.0.11 "GET /compute/v2.1/servers/6dc785d7-bc95-4fee-8206-c2fd3b930e4f" status: 200 len: 1321 microversion: 2.1 time: 0.162696 Nov 17 03:25:32.370989 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 62/111] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:25:32 2021] GET /compute/v2.1/servers/6dc785d7-bc95-4fee-8206-c2fd3b930e4f => generated 1321 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:25:32.379343 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-c7d71a21-d018-4ffb-aa17-7d978379f34a tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:25:32.379953 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-c7d71a21-d018-4ffb-aa17-7d978379f34a tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] [instance: 5d54db85-b991-4890-abaa-952413baa2e7] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:25:32.386308 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-c7d71a21-d018-4ffb-aa17-7d978379f34a tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:25:32.386759 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-c7d71a21-d018-4ffb-aa17-7d978379f34a tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:25:32.388091 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-c7d71a21-d018-4ffb-aa17-7d978379f34a tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:25:32.388533 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-c7d71a21-d018-4ffb-aa17-7d978379f34a tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:25:32.453154 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-c7d71a21-d018-4ffb-aa17-7d978379f34a tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37f21d6d15cf40a586edda211219fd08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ebb970305844dccacf48a7d8d47ecf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:25:32.461086 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-c7d71a21-d018-4ffb-aa17-7d978379f34a tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '37f21d6d15cf40a586edda211219fd08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ebb970305844dccacf48a7d8d47ecf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:25:32.462576 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-c7d71a21-d018-4ffb-aa17-7d978379f34a tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '37f21d6d15cf40a586edda211219fd08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ebb970305844dccacf48a7d8d47ecf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:25:32.463670 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-c7d71a21-d018-4ffb-aa17-7d978379f34a tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] 10.222.0.11 "GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7" status: 200 len: 1341 microversion: 2.20 time: 0.088053 Nov 17 03:25:32.464229 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 50/112] 10.222.0.11 () {60 vars in 1276 bytes} [Wed Nov 17 03:25:32 2021] GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7 => generated 1341 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 17 03:25:32.685905 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [req-d3cc6d3d-8eac-403d-baec-bf3c1a15b8a0 req-5800923f-f003-4a28-8c5a-6c8e20e23713 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "61d387ba-e928-4e5f-a79c-4f757643903c", "tag": "32f6ed0a-f65a-4a5d-8a00-f2d1292ed32c"}]} {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 17 03:25:32.688153 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 17 03:25:32.688153 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: warnings.warn(msg) Nov 17 03:25:32.697935 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [req-d3cc6d3d-8eac-403d-baec-bf3c1a15b8a0 req-5800923f-f003-4a28-8c5a-6c8e20e23713 service nova] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:25:32.699604 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [req-d3cc6d3d-8eac-403d-baec-bf3c1a15b8a0 req-5800923f-f003-4a28-8c5a-6c8e20e23713 service nova] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:25:32.723723 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.compute.server_external_events [req-d3cc6d3d-8eac-403d-baec-bf3c1a15b8a0 req-5800923f-f003-4a28-8c5a-6c8e20e23713 service nova] Creating event network-changed:32f6ed0a-f65a-4a5d-8a00-f2d1292ed32c for instance 61d387ba-e928-4e5f-a79c-4f757643903c on hv-cinder-81803 Nov 17 03:25:32.724262 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [req-d3cc6d3d-8eac-403d-baec-bf3c1a15b8a0 req-5800923f-f003-4a28-8c5a-6c8e20e23713 service nova] Acquired lock "compute-rpcapi-router" {{(pid=115917) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Nov 17 03:25:32.725515 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-dd0a7d50-fe24-4e9e-9909-72417832d04f None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:25:32.725977 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-dd0a7d50-fe24-4e9e-9909-72417832d04f None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:25:32.726844 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-dd0a7d50-fe24-4e9e-9909-72417832d04f None None] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:25:32.727215 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-dd0a7d50-fe24-4e9e-9909-72417832d04f None None] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:25:32.740811 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.compute.rpcapi [None req-dd0a7d50-fe24-4e9e-9909-72417832d04f None None] Automatically selected compute RPC version 6.0 from minimum service version 60 Nov 17 03:25:32.741847 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-dd0a7d50-fe24-4e9e-9909-72417832d04f None None] Releasing lock "compute-rpcapi-router" {{(pid=115917) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Nov 17 03:25:32.776883 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-dd0a7d50-fe24-4e9e-9909-72417832d04f None None] 10.222.0.11 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.097172 Nov 17 03:25:32.777625 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 63/113] 10.222.0.11 () {64 vars in 1317 bytes} [Wed Nov 17 03:25:32 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 17 03:25:32.854260 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-022ecf4a-8cf6-4dae-a3a1-95a5b4dd1dd0 tempest-DeleteServersTestJSON-1805612840 tempest-DeleteServersTestJSON-1805612840-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:25:32.855490 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-022ecf4a-8cf6-4dae-a3a1-95a5b4dd1dd0 tempest-DeleteServersTestJSON-1805612840 tempest-DeleteServersTestJSON-1805612840-project] [instance: eaeb6520-bd1e-495e-9ada-744682cbc122] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:25:32.863512 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-022ecf4a-8cf6-4dae-a3a1-95a5b4dd1dd0 tempest-DeleteServersTestJSON-1805612840 tempest-DeleteServersTestJSON-1805612840-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:25:32.864328 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-022ecf4a-8cf6-4dae-a3a1-95a5b4dd1dd0 tempest-DeleteServersTestJSON-1805612840 tempest-DeleteServersTestJSON-1805612840-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:25:32.865268 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-022ecf4a-8cf6-4dae-a3a1-95a5b4dd1dd0 tempest-DeleteServersTestJSON-1805612840 tempest-DeleteServersTestJSON-1805612840-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:25:32.865899 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-022ecf4a-8cf6-4dae-a3a1-95a5b4dd1dd0 tempest-DeleteServersTestJSON-1805612840 tempest-DeleteServersTestJSON-1805612840-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:25:33.153685 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-ee244b2e-bc63-4dec-acd1-56b86e7cfc04 tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:25:33.155393 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-ee244b2e-bc63-4dec-acd1-56b86e7cfc04 tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] [instance: 61d387ba-e928-4e5f-a79c-4f757643903c] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:25:33.166335 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-ee244b2e-bc63-4dec-acd1-56b86e7cfc04 tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:25:33.168441 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-ee244b2e-bc63-4dec-acd1-56b86e7cfc04 tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:25:33.169582 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-ee244b2e-bc63-4dec-acd1-56b86e7cfc04 tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:25:33.170997 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-ee244b2e-bc63-4dec-acd1-56b86e7cfc04 tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:25:33.534843 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-022ecf4a-8cf6-4dae-a3a1-95a5b4dd1dd0 tempest-DeleteServersTestJSON-1805612840 tempest-DeleteServersTestJSON-1805612840-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65322b3497864a64870eadab1ff7d490', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37560cd5b14f43cd85ee2a3ff2716c33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:25:33.542636 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-022ecf4a-8cf6-4dae-a3a1-95a5b4dd1dd0 tempest-DeleteServersTestJSON-1805612840 tempest-DeleteServersTestJSON-1805612840-project] 10.222.0.11 "GET /compute/v2.1/servers/eaeb6520-bd1e-495e-9ada-744682cbc122" status: 200 len: 1315 microversion: 2.1 time: 0.692379 Nov 17 03:25:33.543543 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 51/114] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:25:32 2021] GET /compute/v2.1/servers/eaeb6520-bd1e-495e-9ada-744682cbc122 => generated 1315 bytes in 694 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:25:33.550810 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-71c1619e-3aa3-4154-ab9d-58579c0dd19c tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:25:33.551683 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-71c1619e-3aa3-4154-ab9d-58579c0dd19c tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] [instance: 6dc785d7-bc95-4fee-8206-c2fd3b930e4f] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:25:33.561053 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-71c1619e-3aa3-4154-ab9d-58579c0dd19c tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:25:33.562748 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-71c1619e-3aa3-4154-ab9d-58579c0dd19c tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:25:33.564649 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-71c1619e-3aa3-4154-ab9d-58579c0dd19c tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:25:33.565331 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-71c1619e-3aa3-4154-ab9d-58579c0dd19c tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:25:33.675872 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-ee244b2e-bc63-4dec-acd1-56b86e7cfc04 tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d4e8ac9538f42c9b637bd9e086668b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfc480343d4d493bb4295b055e274df5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:25:33.687565 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-ee244b2e-bc63-4dec-acd1-56b86e7cfc04 tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] 10.222.0.11 "GET /compute/v2.1/servers/61d387ba-e928-4e5f-a79c-4f757643903c" status: 200 len: 1318 microversion: 2.1 time: 0.542048 Nov 17 03:25:33.689626 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 64/115] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:25:33 2021] GET /compute/v2.1/servers/61d387ba-e928-4e5f-a79c-4f757643903c => generated 1318 bytes in 547 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 17 03:25:33.695867 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-dce8f952-b23b-44e8-aeae-5482309356f6 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:25:33.696533 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-dce8f952-b23b-44e8-aeae-5482309356f6 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] [instance: 5d54db85-b991-4890-abaa-952413baa2e7] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:25:33.709394 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-dce8f952-b23b-44e8-aeae-5482309356f6 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:25:33.710195 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-dce8f952-b23b-44e8-aeae-5482309356f6 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:25:33.711145 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-dce8f952-b23b-44e8-aeae-5482309356f6 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:25:33.711710 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-dce8f952-b23b-44e8-aeae-5482309356f6 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:25:33.821413 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-dce8f952-b23b-44e8-aeae-5482309356f6 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37f21d6d15cf40a586edda211219fd08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ebb970305844dccacf48a7d8d47ecf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:25:33.837846 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-dce8f952-b23b-44e8-aeae-5482309356f6 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '37f21d6d15cf40a586edda211219fd08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ebb970305844dccacf48a7d8d47ecf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:25:33.840567 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-dce8f952-b23b-44e8-aeae-5482309356f6 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '37f21d6d15cf40a586edda211219fd08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ebb970305844dccacf48a7d8d47ecf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:25:33.842976 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-dce8f952-b23b-44e8-aeae-5482309356f6 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] 10.222.0.11 "GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7" status: 200 len: 1339 microversion: 2.20 time: 0.151521 Nov 17 03:25:33.843848 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 65/116] 10.222.0.11 () {60 vars in 1276 bytes} [Wed Nov 17 03:25:33 2021] GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7 => generated 1339 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 17 03:25:33.961501 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-71c1619e-3aa3-4154-ab9d-58579c0dd19c tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f046401c6a04f6495ebe0821120bd72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a58e89ceeea4a9c8a72a1de4bcaf2d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:25:33.978481 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-71c1619e-3aa3-4154-ab9d-58579c0dd19c tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] 10.222.0.11 "GET /compute/v2.1/servers/6dc785d7-bc95-4fee-8206-c2fd3b930e4f" status: 200 len: 1321 microversion: 2.1 time: 0.433381 Nov 17 03:25:33.980267 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 52/117] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:25:33 2021] GET /compute/v2.1/servers/6dc785d7-bc95-4fee-8206-c2fd3b930e4f => generated 1321 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:25:34.562081 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-7b2417a2-7dc5-4407-806b-c461cd859307 tempest-DeleteServersTestJSON-1805612840 tempest-DeleteServersTestJSON-1805612840-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:25:34.562820 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-7b2417a2-7dc5-4407-806b-c461cd859307 tempest-DeleteServersTestJSON-1805612840 tempest-DeleteServersTestJSON-1805612840-project] [instance: eaeb6520-bd1e-495e-9ada-744682cbc122] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:25:34.570755 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-7b2417a2-7dc5-4407-806b-c461cd859307 tempest-DeleteServersTestJSON-1805612840 tempest-DeleteServersTestJSON-1805612840-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:25:34.574534 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-7b2417a2-7dc5-4407-806b-c461cd859307 tempest-DeleteServersTestJSON-1805612840 tempest-DeleteServersTestJSON-1805612840-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:25:34.575825 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-7b2417a2-7dc5-4407-806b-c461cd859307 tempest-DeleteServersTestJSON-1805612840 tempest-DeleteServersTestJSON-1805612840-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:25:34.577470 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-7b2417a2-7dc5-4407-806b-c461cd859307 tempest-DeleteServersTestJSON-1805612840 tempest-DeleteServersTestJSON-1805612840-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:25:34.602298 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [req-b0db1bd2-0ab7-4f38-a69c-7ae4ded83c8f req-faadf73e-6b38-46b3-aa52-d75b74709737 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a49437df-3059-4528-8328-2f3471d5fb45", "tag": "f5a50f15-2a7b-434f-8c53-dafbe11047db"}]} {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 17 03:25:34.604199 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 17 03:25:34.604199 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: warnings.warn(msg) Nov 17 03:25:34.613032 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [req-b0db1bd2-0ab7-4f38-a69c-7ae4ded83c8f req-faadf73e-6b38-46b3-aa52-d75b74709737 service nova] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:25:34.615550 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [req-b0db1bd2-0ab7-4f38-a69c-7ae4ded83c8f req-faadf73e-6b38-46b3-aa52-d75b74709737 service nova] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:25:34.632195 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.compute.server_external_events [req-b0db1bd2-0ab7-4f38-a69c-7ae4ded83c8f req-faadf73e-6b38-46b3-aa52-d75b74709737 service nova] Creating event network-changed:f5a50f15-2a7b-434f-8c53-dafbe11047db for instance a49437df-3059-4528-8328-2f3471d5fb45 on hv-cinder-81803 Nov 17 03:25:34.638191 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [req-b0db1bd2-0ab7-4f38-a69c-7ae4ded83c8f req-faadf73e-6b38-46b3-aa52-d75b74709737 service nova] 10.222.0.11 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.113188 Nov 17 03:25:34.639537 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 66/118] 10.222.0.11 () {64 vars in 1317 bytes} [Wed Nov 17 03:25:34 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 17 03:25:34.712738 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-35a749e5-91c6-4e68-bfe7-77a6fa3cf37f tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:25:34.715590 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-35a749e5-91c6-4e68-bfe7-77a6fa3cf37f tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] [instance: 61d387ba-e928-4e5f-a79c-4f757643903c] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:25:34.740578 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-35a749e5-91c6-4e68-bfe7-77a6fa3cf37f tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:25:34.740578 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-35a749e5-91c6-4e68-bfe7-77a6fa3cf37f tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:25:34.740578 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-35a749e5-91c6-4e68-bfe7-77a6fa3cf37f tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:25:34.740578 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-35a749e5-91c6-4e68-bfe7-77a6fa3cf37f tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:25:34.783755 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-7b2417a2-7dc5-4407-806b-c461cd859307 tempest-DeleteServersTestJSON-1805612840 tempest-DeleteServersTestJSON-1805612840-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65322b3497864a64870eadab1ff7d490', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37560cd5b14f43cd85ee2a3ff2716c33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:25:34.804867 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-7b2417a2-7dc5-4407-806b-c461cd859307 tempest-DeleteServersTestJSON-1805612840 tempest-DeleteServersTestJSON-1805612840-project] 10.222.0.11 "GET /compute/v2.1/servers/eaeb6520-bd1e-495e-9ada-744682cbc122" status: 200 len: 1315 microversion: 2.1 time: 0.237932 Nov 17 03:25:34.821000 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 53/119] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:25:34 2021] GET /compute/v2.1/servers/eaeb6520-bd1e-495e-9ada-744682cbc122 => generated 1315 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:25:34.863734 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-d3797aa4-3314-41e0-b6b3-99ef4f48af2d tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:25:34.864629 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-d3797aa4-3314-41e0-b6b3-99ef4f48af2d tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] [instance: 5d54db85-b991-4890-abaa-952413baa2e7] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:25:34.871286 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-d3797aa4-3314-41e0-b6b3-99ef4f48af2d tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:25:34.871783 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-d3797aa4-3314-41e0-b6b3-99ef4f48af2d tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:25:34.873722 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-d3797aa4-3314-41e0-b6b3-99ef4f48af2d tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:25:34.874501 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-d3797aa4-3314-41e0-b6b3-99ef4f48af2d tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:25:34.982999 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-35a749e5-91c6-4e68-bfe7-77a6fa3cf37f tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d4e8ac9538f42c9b637bd9e086668b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfc480343d4d493bb4295b055e274df5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:25:34.990458 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-35a749e5-91c6-4e68-bfe7-77a6fa3cf37f tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] 10.222.0.11 "GET /compute/v2.1/servers/61d387ba-e928-4e5f-a79c-4f757643903c" status: 200 len: 1318 microversion: 2.1 time: 0.286479 Nov 17 03:25:34.991569 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 67/120] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:25:34 2021] GET /compute/v2.1/servers/61d387ba-e928-4e5f-a79c-4f757643903c => generated 1318 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:25:34.995943 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [req-0dc4f046-8f37-4ad5-ac22-cd820ba19c85 req-35ac3ee9-edd8-4930-8b42-5fffe7bc57b3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6dc785d7-bc95-4fee-8206-c2fd3b930e4f", "tag": "3bae275b-d629-47b7-b478-95973e33b83e"}]} {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 17 03:25:34.997571 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 17 03:25:34.997571 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: warnings.warn(msg) Nov 17 03:25:35.004276 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [req-0dc4f046-8f37-4ad5-ac22-cd820ba19c85 req-35ac3ee9-edd8-4930-8b42-5fffe7bc57b3 service nova] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:25:35.004703 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [req-0dc4f046-8f37-4ad5-ac22-cd820ba19c85 req-35ac3ee9-edd8-4930-8b42-5fffe7bc57b3 service nova] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:25:35.015077 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.compute.server_external_events [req-0dc4f046-8f37-4ad5-ac22-cd820ba19c85 req-35ac3ee9-edd8-4930-8b42-5fffe7bc57b3 service nova] Creating event network-changed:3bae275b-d629-47b7-b478-95973e33b83e for instance 6dc785d7-bc95-4fee-8206-c2fd3b930e4f on hv-cinder-81803 Nov 17 03:25:35.019617 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [req-0dc4f046-8f37-4ad5-ac22-cd820ba19c85 req-35ac3ee9-edd8-4930-8b42-5fffe7bc57b3 service nova] 10.222.0.11 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.026963 Nov 17 03:25:35.020191 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 68/121] 10.222.0.11 () {64 vars in 1317 bytes} [Wed Nov 17 03:25:34 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 17 03:25:35.025021 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-df2e353a-538a-45aa-8e7e-b80e9bcbdded tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:25:35.025706 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-df2e353a-538a-45aa-8e7e-b80e9bcbdded tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] [instance: 6dc785d7-bc95-4fee-8206-c2fd3b930e4f] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:25:35.031534 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-df2e353a-538a-45aa-8e7e-b80e9bcbdded tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:25:35.032026 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-df2e353a-538a-45aa-8e7e-b80e9bcbdded tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:25:35.032803 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-df2e353a-538a-45aa-8e7e-b80e9bcbdded tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:25:35.033239 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-df2e353a-538a-45aa-8e7e-b80e9bcbdded tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:25:35.036302 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-d3797aa4-3314-41e0-b6b3-99ef4f48af2d tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37f21d6d15cf40a586edda211219fd08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ebb970305844dccacf48a7d8d47ecf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:25:35.045741 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-d3797aa4-3314-41e0-b6b3-99ef4f48af2d tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '37f21d6d15cf40a586edda211219fd08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ebb970305844dccacf48a7d8d47ecf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:25:35.047227 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-d3797aa4-3314-41e0-b6b3-99ef4f48af2d tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '37f21d6d15cf40a586edda211219fd08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ebb970305844dccacf48a7d8d47ecf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:25:35.048338 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-d3797aa4-3314-41e0-b6b3-99ef4f48af2d tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] 10.222.0.11 "GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7" status: 200 len: 1407 microversion: 2.20 time: 0.189595 Nov 17 03:25:35.049000 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 54/122] 10.222.0.11 () {60 vars in 1276 bytes} [Wed Nov 17 03:25:34 2021] GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7 => generated 1407 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 17 03:25:35.167833 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-df2e353a-538a-45aa-8e7e-b80e9bcbdded tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f046401c6a04f6495ebe0821120bd72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a58e89ceeea4a9c8a72a1de4bcaf2d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:25:35.175604 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-df2e353a-538a-45aa-8e7e-b80e9bcbdded tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] 10.222.0.11 "GET /compute/v2.1/servers/6dc785d7-bc95-4fee-8206-c2fd3b930e4f" status: 200 len: 1321 microversion: 2.1 time: 0.154194 Nov 17 03:25:35.176196 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 69/123] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:25:35 2021] GET /compute/v2.1/servers/6dc785d7-bc95-4fee-8206-c2fd3b930e4f => generated 1321 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:25:35.825840 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-fd11ac04-a3e3-4c40-81e6-2dca82cb62c6 tempest-DeleteServersTestJSON-1805612840 tempest-DeleteServersTestJSON-1805612840-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:25:35.826462 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-fd11ac04-a3e3-4c40-81e6-2dca82cb62c6 tempest-DeleteServersTestJSON-1805612840 tempest-DeleteServersTestJSON-1805612840-project] [instance: eaeb6520-bd1e-495e-9ada-744682cbc122] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:25:35.832897 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-fd11ac04-a3e3-4c40-81e6-2dca82cb62c6 tempest-DeleteServersTestJSON-1805612840 tempest-DeleteServersTestJSON-1805612840-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:25:35.833342 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-fd11ac04-a3e3-4c40-81e6-2dca82cb62c6 tempest-DeleteServersTestJSON-1805612840 tempest-DeleteServersTestJSON-1805612840-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:25:35.834103 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-fd11ac04-a3e3-4c40-81e6-2dca82cb62c6 tempest-DeleteServersTestJSON-1805612840 tempest-DeleteServersTestJSON-1805612840-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:25:35.834527 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-fd11ac04-a3e3-4c40-81e6-2dca82cb62c6 tempest-DeleteServersTestJSON-1805612840 tempest-DeleteServersTestJSON-1805612840-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:25:35.973921 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-fd11ac04-a3e3-4c40-81e6-2dca82cb62c6 tempest-DeleteServersTestJSON-1805612840 tempest-DeleteServersTestJSON-1805612840-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65322b3497864a64870eadab1ff7d490', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37560cd5b14f43cd85ee2a3ff2716c33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:25:35.981986 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-fd11ac04-a3e3-4c40-81e6-2dca82cb62c6 tempest-DeleteServersTestJSON-1805612840 tempest-DeleteServersTestJSON-1805612840-project] 10.222.0.11 "GET /compute/v2.1/servers/eaeb6520-bd1e-495e-9ada-744682cbc122" status: 200 len: 1315 microversion: 2.1 time: 0.159690 Nov 17 03:25:35.982548 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 55/124] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:25:35 2021] GET /compute/v2.1/servers/eaeb6520-bd1e-495e-9ada-744682cbc122 => generated 1315 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:25:36.007074 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-3e026c26-7b68-4e3e-aaa6-5d970d44cef8 tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:25:36.007677 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-3e026c26-7b68-4e3e-aaa6-5d970d44cef8 tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] [instance: 61d387ba-e928-4e5f-a79c-4f757643903c] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:25:36.013954 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-3e026c26-7b68-4e3e-aaa6-5d970d44cef8 tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:25:36.014404 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-3e026c26-7b68-4e3e-aaa6-5d970d44cef8 tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:25:36.015208 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-3e026c26-7b68-4e3e-aaa6-5d970d44cef8 tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:25:36.015624 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-3e026c26-7b68-4e3e-aaa6-5d970d44cef8 tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:25:36.066731 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-361a52af-aa95-40a2-b842-1653b5e15e51 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:25:36.067329 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-361a52af-aa95-40a2-b842-1653b5e15e51 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] [instance: 5d54db85-b991-4890-abaa-952413baa2e7] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:25:36.073574 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-361a52af-aa95-40a2-b842-1653b5e15e51 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:25:36.074024 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-361a52af-aa95-40a2-b842-1653b5e15e51 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:25:36.074789 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-361a52af-aa95-40a2-b842-1653b5e15e51 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:25:36.075314 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-361a52af-aa95-40a2-b842-1653b5e15e51 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:25:36.155040 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-3e026c26-7b68-4e3e-aaa6-5d970d44cef8 tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d4e8ac9538f42c9b637bd9e086668b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfc480343d4d493bb4295b055e274df5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:25:36.162548 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-3e026c26-7b68-4e3e-aaa6-5d970d44cef8 tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] 10.222.0.11 "GET /compute/v2.1/servers/61d387ba-e928-4e5f-a79c-4f757643903c" status: 200 len: 1318 microversion: 2.1 time: 0.159070 Nov 17 03:25:36.164912 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 70/125] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:25:36 2021] GET /compute/v2.1/servers/61d387ba-e928-4e5f-a79c-4f757643903c => generated 1318 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:25:36.193068 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-20e7089f-af36-418e-8701-3692ecb8cdeb tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:25:36.193690 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-20e7089f-af36-418e-8701-3692ecb8cdeb tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] [instance: 6dc785d7-bc95-4fee-8206-c2fd3b930e4f] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:25:36.199852 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-20e7089f-af36-418e-8701-3692ecb8cdeb tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:25:36.200324 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-20e7089f-af36-418e-8701-3692ecb8cdeb tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:25:36.201261 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-20e7089f-af36-418e-8701-3692ecb8cdeb tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:25:36.201690 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-20e7089f-af36-418e-8701-3692ecb8cdeb tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:25:36.207552 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-361a52af-aa95-40a2-b842-1653b5e15e51 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37f21d6d15cf40a586edda211219fd08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ebb970305844dccacf48a7d8d47ecf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:25:36.215235 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-361a52af-aa95-40a2-b842-1653b5e15e51 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '37f21d6d15cf40a586edda211219fd08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ebb970305844dccacf48a7d8d47ecf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:25:36.218959 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-361a52af-aa95-40a2-b842-1653b5e15e51 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '37f21d6d15cf40a586edda211219fd08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ebb970305844dccacf48a7d8d47ecf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:25:36.220395 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-361a52af-aa95-40a2-b842-1653b5e15e51 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] 10.222.0.11 "GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7" status: 200 len: 1407 microversion: 2.20 time: 0.157549 Nov 17 03:25:36.220971 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 56/126] 10.222.0.11 () {60 vars in 1276 bytes} [Wed Nov 17 03:25:36 2021] GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7 => generated 1407 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 17 03:25:36.343841 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-20e7089f-af36-418e-8701-3692ecb8cdeb tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f046401c6a04f6495ebe0821120bd72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a58e89ceeea4a9c8a72a1de4bcaf2d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:25:36.351691 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-20e7089f-af36-418e-8701-3692ecb8cdeb tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] 10.222.0.11 "GET /compute/v2.1/servers/6dc785d7-bc95-4fee-8206-c2fd3b930e4f" status: 200 len: 1321 microversion: 2.1 time: 0.162465 Nov 17 03:25:36.352359 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 71/127] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:25:36 2021] GET /compute/v2.1/servers/6dc785d7-bc95-4fee-8206-c2fd3b930e4f => generated 1321 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:25:37.002932 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-459d6bba-5ac3-4f8e-b6c1-9e01292618bf tempest-DeleteServersTestJSON-1805612840 tempest-DeleteServersTestJSON-1805612840-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:25:37.003923 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-459d6bba-5ac3-4f8e-b6c1-9e01292618bf tempest-DeleteServersTestJSON-1805612840 tempest-DeleteServersTestJSON-1805612840-project] [instance: eaeb6520-bd1e-495e-9ada-744682cbc122] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:25:37.014444 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-459d6bba-5ac3-4f8e-b6c1-9e01292618bf tempest-DeleteServersTestJSON-1805612840 tempest-DeleteServersTestJSON-1805612840-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:25:37.015185 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-459d6bba-5ac3-4f8e-b6c1-9e01292618bf tempest-DeleteServersTestJSON-1805612840 tempest-DeleteServersTestJSON-1805612840-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:25:37.016464 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-459d6bba-5ac3-4f8e-b6c1-9e01292618bf tempest-DeleteServersTestJSON-1805612840 tempest-DeleteServersTestJSON-1805612840-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:25:37.017194 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-459d6bba-5ac3-4f8e-b6c1-9e01292618bf tempest-DeleteServersTestJSON-1805612840 tempest-DeleteServersTestJSON-1805612840-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:25:37.180458 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-22437cea-a191-4374-a43c-9a6895ef9888 tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:25:37.181099 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-22437cea-a191-4374-a43c-9a6895ef9888 tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] [instance: 61d387ba-e928-4e5f-a79c-4f757643903c] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:25:37.189353 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-22437cea-a191-4374-a43c-9a6895ef9888 tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:25:37.189796 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-22437cea-a191-4374-a43c-9a6895ef9888 tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:25:37.191043 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-22437cea-a191-4374-a43c-9a6895ef9888 tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:25:37.191471 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-22437cea-a191-4374-a43c-9a6895ef9888 tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:25:37.329028 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-22437cea-a191-4374-a43c-9a6895ef9888 tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d4e8ac9538f42c9b637bd9e086668b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfc480343d4d493bb4295b055e274df5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:25:37.336723 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-22437cea-a191-4374-a43c-9a6895ef9888 tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] 10.222.0.11 "GET /compute/v2.1/servers/61d387ba-e928-4e5f-a79c-4f757643903c" status: 200 len: 1318 microversion: 2.1 time: 0.160307 Nov 17 03:25:37.336893 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-459d6bba-5ac3-4f8e-b6c1-9e01292618bf tempest-DeleteServersTestJSON-1805612840 tempest-DeleteServersTestJSON-1805612840-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65322b3497864a64870eadab1ff7d490', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37560cd5b14f43cd85ee2a3ff2716c33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:25:37.337372 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 72/128] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:25:37 2021] GET /compute/v2.1/servers/61d387ba-e928-4e5f-a79c-4f757643903c => generated 1318 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:25:37.342069 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-b7720c02-27db-4bc5-8bec-6f0b89df9ea4 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:25:37.342647 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-b7720c02-27db-4bc5-8bec-6f0b89df9ea4 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] [instance: 5d54db85-b991-4890-abaa-952413baa2e7] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:25:37.345820 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-459d6bba-5ac3-4f8e-b6c1-9e01292618bf tempest-DeleteServersTestJSON-1805612840 tempest-DeleteServersTestJSON-1805612840-project] 10.222.0.11 "GET /compute/v2.1/servers/eaeb6520-bd1e-495e-9ada-744682cbc122" status: 200 len: 1315 microversion: 2.1 time: 0.349584 Nov 17 03:25:37.346678 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 57/129] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:25:36 2021] GET /compute/v2.1/servers/eaeb6520-bd1e-495e-9ada-744682cbc122 => generated 1315 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:25:37.353853 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-b7720c02-27db-4bc5-8bec-6f0b89df9ea4 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:25:37.354632 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-b7720c02-27db-4bc5-8bec-6f0b89df9ea4 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:25:37.355954 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-b7720c02-27db-4bc5-8bec-6f0b89df9ea4 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:25:37.357084 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-b7720c02-27db-4bc5-8bec-6f0b89df9ea4 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:25:37.371565 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-ac6d7347-7720-463a-acef-509f28981e0c tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:25:37.372169 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-ac6d7347-7720-463a-acef-509f28981e0c tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] [instance: 6dc785d7-bc95-4fee-8206-c2fd3b930e4f] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:25:37.378017 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-ac6d7347-7720-463a-acef-509f28981e0c tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:25:37.378452 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-ac6d7347-7720-463a-acef-509f28981e0c tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:25:37.379215 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-ac6d7347-7720-463a-acef-509f28981e0c tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:25:37.379642 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-ac6d7347-7720-463a-acef-509f28981e0c tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:25:37.633369 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-b7720c02-27db-4bc5-8bec-6f0b89df9ea4 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37f21d6d15cf40a586edda211219fd08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ebb970305844dccacf48a7d8d47ecf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:25:37.645351 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-b7720c02-27db-4bc5-8bec-6f0b89df9ea4 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '37f21d6d15cf40a586edda211219fd08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ebb970305844dccacf48a7d8d47ecf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:25:37.648092 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-b7720c02-27db-4bc5-8bec-6f0b89df9ea4 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '37f21d6d15cf40a586edda211219fd08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ebb970305844dccacf48a7d8d47ecf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:25:37.650855 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-b7720c02-27db-4bc5-8bec-6f0b89df9ea4 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] 10.222.0.11 "GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7" status: 200 len: 1407 microversion: 2.20 time: 0.312573 Nov 17 03:25:37.651680 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 73/130] 10.222.0.11 () {60 vars in 1276 bytes} [Wed Nov 17 03:25:37 2021] GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7 => generated 1407 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 17 03:25:37.694933 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-ac6d7347-7720-463a-acef-509f28981e0c tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f046401c6a04f6495ebe0821120bd72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a58e89ceeea4a9c8a72a1de4bcaf2d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:25:37.703319 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-ac6d7347-7720-463a-acef-509f28981e0c tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] 10.222.0.11 "GET /compute/v2.1/servers/6dc785d7-bc95-4fee-8206-c2fd3b930e4f" status: 200 len: 1321 microversion: 2.1 time: 0.336470 Nov 17 03:25:37.703901 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 58/131] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:25:37 2021] GET /compute/v2.1/servers/6dc785d7-bc95-4fee-8206-c2fd3b930e4f => generated 1321 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:25:38.354713 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-2a2df589-b460-4797-8021-a8ee932e9dc4 tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:25:38.355229 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-2a2df589-b460-4797-8021-a8ee932e9dc4 tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] [instance: 61d387ba-e928-4e5f-a79c-4f757643903c] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:25:38.363545 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-7533eb84-8b8f-42ce-96e0-14b6b0e071b8 tempest-DeleteServersTestJSON-1805612840 tempest-DeleteServersTestJSON-1805612840-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:25:38.364812 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-7533eb84-8b8f-42ce-96e0-14b6b0e071b8 tempest-DeleteServersTestJSON-1805612840 tempest-DeleteServersTestJSON-1805612840-project] [instance: eaeb6520-bd1e-495e-9ada-744682cbc122] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:25:38.377442 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-2a2df589-b460-4797-8021-a8ee932e9dc4 tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:25:38.378273 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-7533eb84-8b8f-42ce-96e0-14b6b0e071b8 tempest-DeleteServersTestJSON-1805612840 tempest-DeleteServersTestJSON-1805612840-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:25:38.378900 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-2a2df589-b460-4797-8021-a8ee932e9dc4 tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:25:38.379717 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-7533eb84-8b8f-42ce-96e0-14b6b0e071b8 tempest-DeleteServersTestJSON-1805612840 tempest-DeleteServersTestJSON-1805612840-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:25:38.381272 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-7533eb84-8b8f-42ce-96e0-14b6b0e071b8 tempest-DeleteServersTestJSON-1805612840 tempest-DeleteServersTestJSON-1805612840-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:25:38.382139 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-2a2df589-b460-4797-8021-a8ee932e9dc4 tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:25:38.382755 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-2a2df589-b460-4797-8021-a8ee932e9dc4 tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:25:38.383385 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-7533eb84-8b8f-42ce-96e0-14b6b0e071b8 tempest-DeleteServersTestJSON-1805612840 tempest-DeleteServersTestJSON-1805612840-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:25:38.687843 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-7533eb84-8b8f-42ce-96e0-14b6b0e071b8 tempest-DeleteServersTestJSON-1805612840 tempest-DeleteServersTestJSON-1805612840-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65322b3497864a64870eadab1ff7d490', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37560cd5b14f43cd85ee2a3ff2716c33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:25:38.696730 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-7533eb84-8b8f-42ce-96e0-14b6b0e071b8 tempest-DeleteServersTestJSON-1805612840 tempest-DeleteServersTestJSON-1805612840-project] 10.222.0.11 "GET /compute/v2.1/servers/eaeb6520-bd1e-495e-9ada-744682cbc122" status: 200 len: 1315 microversion: 2.1 time: 0.336442 Nov 17 03:25:38.700490 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 59/132] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:25:38 2021] GET /compute/v2.1/servers/eaeb6520-bd1e-495e-9ada-744682cbc122 => generated 1315 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 17 03:25:38.706966 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-dab2f5f1-48d7-430a-9c4a-1fadf5b6bc35 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:25:38.708979 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-dab2f5f1-48d7-430a-9c4a-1fadf5b6bc35 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] [instance: 5d54db85-b991-4890-abaa-952413baa2e7] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:25:38.727939 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-dab2f5f1-48d7-430a-9c4a-1fadf5b6bc35 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:25:38.729434 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-dab2f5f1-48d7-430a-9c4a-1fadf5b6bc35 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:25:38.732946 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-dab2f5f1-48d7-430a-9c4a-1fadf5b6bc35 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:25:38.734946 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-dab2f5f1-48d7-430a-9c4a-1fadf5b6bc35 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:25:38.755021 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-2a2df589-b460-4797-8021-a8ee932e9dc4 tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d4e8ac9538f42c9b637bd9e086668b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfc480343d4d493bb4295b055e274df5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:25:38.770694 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-2a2df589-b460-4797-8021-a8ee932e9dc4 tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] 10.222.0.11 "GET /compute/v2.1/servers/61d387ba-e928-4e5f-a79c-4f757643903c" status: 200 len: 1318 microversion: 2.1 time: 0.413572 Nov 17 03:25:38.773253 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 74/133] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:25:38 2021] GET /compute/v2.1/servers/61d387ba-e928-4e5f-a79c-4f757643903c => generated 1318 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 17 03:25:38.796185 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-da992b00-2ddc-49f6-bcc0-35a1d2cf6e37 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:25:38.799307 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-da992b00-2ddc-49f6-bcc0-35a1d2cf6e37 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] [instance: 6dc785d7-bc95-4fee-8206-c2fd3b930e4f] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:25:38.810125 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-da992b00-2ddc-49f6-bcc0-35a1d2cf6e37 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:25:38.811201 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-da992b00-2ddc-49f6-bcc0-35a1d2cf6e37 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:25:38.812198 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-da992b00-2ddc-49f6-bcc0-35a1d2cf6e37 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:25:38.812835 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-da992b00-2ddc-49f6-bcc0-35a1d2cf6e37 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:25:38.932717 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-dab2f5f1-48d7-430a-9c4a-1fadf5b6bc35 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37f21d6d15cf40a586edda211219fd08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ebb970305844dccacf48a7d8d47ecf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:25:38.945257 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-dab2f5f1-48d7-430a-9c4a-1fadf5b6bc35 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '37f21d6d15cf40a586edda211219fd08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ebb970305844dccacf48a7d8d47ecf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:25:38.947554 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-dab2f5f1-48d7-430a-9c4a-1fadf5b6bc35 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '37f21d6d15cf40a586edda211219fd08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ebb970305844dccacf48a7d8d47ecf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:25:38.949099 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-dab2f5f1-48d7-430a-9c4a-1fadf5b6bc35 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] 10.222.0.11 "GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7" status: 200 len: 1407 microversion: 2.20 time: 0.247365 Nov 17 03:25:38.950272 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 60/134] 10.222.0.11 () {60 vars in 1276 bytes} [Wed Nov 17 03:25:38 2021] GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7 => generated 1407 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 17 03:25:39.129539 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-da992b00-2ddc-49f6-bcc0-35a1d2cf6e37 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f046401c6a04f6495ebe0821120bd72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a58e89ceeea4a9c8a72a1de4bcaf2d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:25:39.137633 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-da992b00-2ddc-49f6-bcc0-35a1d2cf6e37 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] 10.222.0.11 "GET /compute/v2.1/servers/6dc785d7-bc95-4fee-8206-c2fd3b930e4f" status: 200 len: 1321 microversion: 2.1 time: 0.363111 Nov 17 03:25:39.138480 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 75/135] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:25:38 2021] GET /compute/v2.1/servers/6dc785d7-bc95-4fee-8206-c2fd3b930e4f => generated 1321 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:25:39.227252 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [req-fce23542-1df2-4f1f-94a9-18b1c9ff119e req-10c66ce3-cdc7-472c-8b74-c8c2bc8f0f73 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5d54db85-b991-4890-abaa-952413baa2e7", "tag": "51f39c10-57ce-4106-ab58-635a3319ff11"}]} {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 17 03:25:39.229086 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 17 03:25:39.229086 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: warnings.warn(msg) Nov 17 03:25:39.236498 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [req-fce23542-1df2-4f1f-94a9-18b1c9ff119e req-10c66ce3-cdc7-472c-8b74-c8c2bc8f0f73 service nova] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:25:39.237290 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [req-fce23542-1df2-4f1f-94a9-18b1c9ff119e req-10c66ce3-cdc7-472c-8b74-c8c2bc8f0f73 service nova] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:25:39.250279 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.compute.server_external_events [req-fce23542-1df2-4f1f-94a9-18b1c9ff119e req-10c66ce3-cdc7-472c-8b74-c8c2bc8f0f73 service nova] Creating event network-changed:51f39c10-57ce-4106-ab58-635a3319ff11 for instance 5d54db85-b991-4890-abaa-952413baa2e7 on hv-cinder-81803 Nov 17 03:25:39.255963 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [req-fce23542-1df2-4f1f-94a9-18b1c9ff119e req-10c66ce3-cdc7-472c-8b74-c8c2bc8f0f73 service nova] 10.222.0.11 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032288 Nov 17 03:25:39.256698 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 61/136] 10.222.0.11 () {64 vars in 1317 bytes} [Wed Nov 17 03:25:39 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 17 03:25:39.716953 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-28ab27b7-f755-4b5f-aa95-5b03bbdcde05 tempest-DeleteServersTestJSON-1805612840 tempest-DeleteServersTestJSON-1805612840-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:25:39.718216 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-28ab27b7-f755-4b5f-aa95-5b03bbdcde05 tempest-DeleteServersTestJSON-1805612840 tempest-DeleteServersTestJSON-1805612840-project] [instance: eaeb6520-bd1e-495e-9ada-744682cbc122] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:25:39.724474 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-28ab27b7-f755-4b5f-aa95-5b03bbdcde05 tempest-DeleteServersTestJSON-1805612840 tempest-DeleteServersTestJSON-1805612840-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:25:39.724941 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-28ab27b7-f755-4b5f-aa95-5b03bbdcde05 tempest-DeleteServersTestJSON-1805612840 tempest-DeleteServersTestJSON-1805612840-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:25:39.726006 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-28ab27b7-f755-4b5f-aa95-5b03bbdcde05 tempest-DeleteServersTestJSON-1805612840 tempest-DeleteServersTestJSON-1805612840-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:25:39.726445 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-28ab27b7-f755-4b5f-aa95-5b03bbdcde05 tempest-DeleteServersTestJSON-1805612840 tempest-DeleteServersTestJSON-1805612840-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:25:39.794363 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-fb2c2c9e-ccb9-4cbb-99af-961001330adf tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:25:39.795289 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-fb2c2c9e-ccb9-4cbb-99af-961001330adf tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] [instance: 61d387ba-e928-4e5f-a79c-4f757643903c] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:25:39.803532 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-fb2c2c9e-ccb9-4cbb-99af-961001330adf tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:25:39.804419 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-fb2c2c9e-ccb9-4cbb-99af-961001330adf tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:25:39.805505 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-fb2c2c9e-ccb9-4cbb-99af-961001330adf tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:25:39.806013 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-fb2c2c9e-ccb9-4cbb-99af-961001330adf tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:25:39.952040 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-28ab27b7-f755-4b5f-aa95-5b03bbdcde05 tempest-DeleteServersTestJSON-1805612840 tempest-DeleteServersTestJSON-1805612840-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65322b3497864a64870eadab1ff7d490', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37560cd5b14f43cd85ee2a3ff2716c33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:25:39.961832 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-28ab27b7-f755-4b5f-aa95-5b03bbdcde05 tempest-DeleteServersTestJSON-1805612840 tempest-DeleteServersTestJSON-1805612840-project] 10.222.0.11 "GET /compute/v2.1/servers/eaeb6520-bd1e-495e-9ada-744682cbc122" status: 200 len: 1315 microversion: 2.1 time: 0.248630 Nov 17 03:25:39.963316 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 76/137] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:25:39 2021] GET /compute/v2.1/servers/eaeb6520-bd1e-495e-9ada-744682cbc122 => generated 1315 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:25:39.977884 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-963ef5cd-534e-469c-b306-1154ca37414b tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:25:39.979926 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-963ef5cd-534e-469c-b306-1154ca37414b tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] [instance: 5d54db85-b991-4890-abaa-952413baa2e7] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:25:39.994227 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-963ef5cd-534e-469c-b306-1154ca37414b tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:25:39.995027 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-963ef5cd-534e-469c-b306-1154ca37414b tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:25:39.996328 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-963ef5cd-534e-469c-b306-1154ca37414b tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:25:40.000088 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-963ef5cd-534e-469c-b306-1154ca37414b tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:25:40.068477 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-fb2c2c9e-ccb9-4cbb-99af-961001330adf tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d4e8ac9538f42c9b637bd9e086668b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfc480343d4d493bb4295b055e274df5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:25:40.078907 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-fb2c2c9e-ccb9-4cbb-99af-961001330adf tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] 10.222.0.11 "GET /compute/v2.1/servers/61d387ba-e928-4e5f-a79c-4f757643903c" status: 200 len: 1318 microversion: 2.1 time: 0.287679 Nov 17 03:25:40.079484 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 62/138] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:25:39 2021] GET /compute/v2.1/servers/61d387ba-e928-4e5f-a79c-4f757643903c => generated 1318 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:25:40.155145 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-b4263817-d918-4aba-b593-375b5a839991 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:25:40.156029 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-b4263817-d918-4aba-b593-375b5a839991 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] [instance: 6dc785d7-bc95-4fee-8206-c2fd3b930e4f] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:25:40.166926 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-b4263817-d918-4aba-b593-375b5a839991 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:25:40.167556 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-b4263817-d918-4aba-b593-375b5a839991 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:25:40.170921 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-b4263817-d918-4aba-b593-375b5a839991 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:25:40.173043 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-b4263817-d918-4aba-b593-375b5a839991 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:25:40.210106 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-963ef5cd-534e-469c-b306-1154ca37414b tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37f21d6d15cf40a586edda211219fd08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ebb970305844dccacf48a7d8d47ecf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:25:40.219740 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-963ef5cd-534e-469c-b306-1154ca37414b tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '37f21d6d15cf40a586edda211219fd08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ebb970305844dccacf48a7d8d47ecf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:25:40.221304 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-963ef5cd-534e-469c-b306-1154ca37414b tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '37f21d6d15cf40a586edda211219fd08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ebb970305844dccacf48a7d8d47ecf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:25:40.222594 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-963ef5cd-534e-469c-b306-1154ca37414b tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] 10.222.0.11 "GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7" status: 200 len: 1407 microversion: 2.20 time: 0.253419 Nov 17 03:25:40.223489 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 77/139] 10.222.0.11 () {60 vars in 1276 bytes} [Wed Nov 17 03:25:39 2021] GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7 => generated 1407 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 17 03:25:40.312734 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-b4263817-d918-4aba-b593-375b5a839991 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f046401c6a04f6495ebe0821120bd72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a58e89ceeea4a9c8a72a1de4bcaf2d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:25:40.321778 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-b4263817-d918-4aba-b593-375b5a839991 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] 10.222.0.11 "GET /compute/v2.1/servers/6dc785d7-bc95-4fee-8206-c2fd3b930e4f" status: 200 len: 1321 microversion: 2.1 time: 0.170958 Nov 17 03:25:40.323332 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 63/140] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:25:40 2021] GET /compute/v2.1/servers/6dc785d7-bc95-4fee-8206-c2fd3b930e4f => generated 1321 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 17 03:25:40.980741 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-1616374f-b89b-429b-91c9-c1c09c38efb2 tempest-DeleteServersTestJSON-1805612840 tempest-DeleteServersTestJSON-1805612840-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:25:40.981658 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-1616374f-b89b-429b-91c9-c1c09c38efb2 tempest-DeleteServersTestJSON-1805612840 tempest-DeleteServersTestJSON-1805612840-project] [instance: eaeb6520-bd1e-495e-9ada-744682cbc122] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:25:40.987214 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-1616374f-b89b-429b-91c9-c1c09c38efb2 tempest-DeleteServersTestJSON-1805612840 tempest-DeleteServersTestJSON-1805612840-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:25:40.987671 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-1616374f-b89b-429b-91c9-c1c09c38efb2 tempest-DeleteServersTestJSON-1805612840 tempest-DeleteServersTestJSON-1805612840-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:25:40.988420 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-1616374f-b89b-429b-91c9-c1c09c38efb2 tempest-DeleteServersTestJSON-1805612840 tempest-DeleteServersTestJSON-1805612840-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:25:40.989048 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-1616374f-b89b-429b-91c9-c1c09c38efb2 tempest-DeleteServersTestJSON-1805612840 tempest-DeleteServersTestJSON-1805612840-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:25:41.095865 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-f64d6ed6-844f-466b-b962-8af92fc70832 tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:25:41.096544 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-f64d6ed6-844f-466b-b962-8af92fc70832 tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] [instance: 61d387ba-e928-4e5f-a79c-4f757643903c] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:25:41.102883 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-f64d6ed6-844f-466b-b962-8af92fc70832 tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:25:41.103339 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-f64d6ed6-844f-466b-b962-8af92fc70832 tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:25:41.104114 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-f64d6ed6-844f-466b-b962-8af92fc70832 tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:25:41.104545 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-f64d6ed6-844f-466b-b962-8af92fc70832 tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:25:41.163560 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-1616374f-b89b-429b-91c9-c1c09c38efb2 tempest-DeleteServersTestJSON-1805612840 tempest-DeleteServersTestJSON-1805612840-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65322b3497864a64870eadab1ff7d490', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37560cd5b14f43cd85ee2a3ff2716c33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:25:41.171707 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-1616374f-b89b-429b-91c9-c1c09c38efb2 tempest-DeleteServersTestJSON-1805612840 tempest-DeleteServersTestJSON-1805612840-project] 10.222.0.11 "GET /compute/v2.1/servers/eaeb6520-bd1e-495e-9ada-744682cbc122" status: 200 len: 1315 microversion: 2.1 time: 0.194771 Nov 17 03:25:41.173229 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 78/141] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:25:40 2021] GET /compute/v2.1/servers/eaeb6520-bd1e-495e-9ada-744682cbc122 => generated 1315 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:25:41.239959 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-ef59aea0-b410-4f9a-af5d-e9744134af41 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:25:41.240838 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-ef59aea0-b410-4f9a-af5d-e9744134af41 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] [instance: 5d54db85-b991-4890-abaa-952413baa2e7] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:25:41.249706 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-ef59aea0-b410-4f9a-af5d-e9744134af41 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:25:41.250400 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-ef59aea0-b410-4f9a-af5d-e9744134af41 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:25:41.251194 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-ef59aea0-b410-4f9a-af5d-e9744134af41 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:25:41.251794 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-ef59aea0-b410-4f9a-af5d-e9744134af41 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:25:41.265885 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-f64d6ed6-844f-466b-b962-8af92fc70832 tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d4e8ac9538f42c9b637bd9e086668b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfc480343d4d493bb4295b055e274df5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:25:41.275533 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-f64d6ed6-844f-466b-b962-8af92fc70832 tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] 10.222.0.11 "GET /compute/v2.1/servers/61d387ba-e928-4e5f-a79c-4f757643903c" status: 200 len: 1318 microversion: 2.1 time: 0.183246 Nov 17 03:25:41.276692 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 64/142] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:25:41 2021] GET /compute/v2.1/servers/61d387ba-e928-4e5f-a79c-4f757643903c => generated 1318 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 17 03:25:41.339815 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-77391adb-17ae-4562-95b1-26e6ea6e39d6 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:25:41.340427 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-77391adb-17ae-4562-95b1-26e6ea6e39d6 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] [instance: 6dc785d7-bc95-4fee-8206-c2fd3b930e4f] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:25:41.346755 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-77391adb-17ae-4562-95b1-26e6ea6e39d6 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:25:41.347390 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-77391adb-17ae-4562-95b1-26e6ea6e39d6 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:25:41.348163 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-77391adb-17ae-4562-95b1-26e6ea6e39d6 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:25:41.348586 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-77391adb-17ae-4562-95b1-26e6ea6e39d6 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:25:41.403929 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-ef59aea0-b410-4f9a-af5d-e9744134af41 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37f21d6d15cf40a586edda211219fd08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ebb970305844dccacf48a7d8d47ecf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:25:41.413299 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-ef59aea0-b410-4f9a-af5d-e9744134af41 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '37f21d6d15cf40a586edda211219fd08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ebb970305844dccacf48a7d8d47ecf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:25:41.417094 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-ef59aea0-b410-4f9a-af5d-e9744134af41 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '37f21d6d15cf40a586edda211219fd08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ebb970305844dccacf48a7d8d47ecf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:25:41.418409 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-ef59aea0-b410-4f9a-af5d-e9744134af41 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] 10.222.0.11 "GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7" status: 200 len: 1407 microversion: 2.20 time: 0.182187 Nov 17 03:25:41.419652 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 79/143] 10.222.0.11 () {60 vars in 1276 bytes} [Wed Nov 17 03:25:41 2021] GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7 => generated 1407 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 17 03:25:41.520297 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-77391adb-17ae-4562-95b1-26e6ea6e39d6 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f046401c6a04f6495ebe0821120bd72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a58e89ceeea4a9c8a72a1de4bcaf2d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:25:41.528005 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-77391adb-17ae-4562-95b1-26e6ea6e39d6 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] 10.222.0.11 "GET /compute/v2.1/servers/6dc785d7-bc95-4fee-8206-c2fd3b930e4f" status: 200 len: 1321 microversion: 2.1 time: 0.192590 Nov 17 03:25:41.529047 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 65/144] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:25:41 2021] GET /compute/v2.1/servers/6dc785d7-bc95-4fee-8206-c2fd3b930e4f => generated 1321 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 17 03:25:42.188319 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-c80eaf8e-66ac-4a81-b2e6-0e7e2ea6a2aa tempest-DeleteServersTestJSON-1805612840 tempest-DeleteServersTestJSON-1805612840-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:25:42.188950 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-c80eaf8e-66ac-4a81-b2e6-0e7e2ea6a2aa tempest-DeleteServersTestJSON-1805612840 tempest-DeleteServersTestJSON-1805612840-project] [instance: eaeb6520-bd1e-495e-9ada-744682cbc122] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:25:42.195366 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-c80eaf8e-66ac-4a81-b2e6-0e7e2ea6a2aa tempest-DeleteServersTestJSON-1805612840 tempest-DeleteServersTestJSON-1805612840-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:25:42.197373 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-c80eaf8e-66ac-4a81-b2e6-0e7e2ea6a2aa tempest-DeleteServersTestJSON-1805612840 tempest-DeleteServersTestJSON-1805612840-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:25:42.198790 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-c80eaf8e-66ac-4a81-b2e6-0e7e2ea6a2aa tempest-DeleteServersTestJSON-1805612840 tempest-DeleteServersTestJSON-1805612840-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:25:42.199361 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-c80eaf8e-66ac-4a81-b2e6-0e7e2ea6a2aa tempest-DeleteServersTestJSON-1805612840 tempest-DeleteServersTestJSON-1805612840-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:25:42.298778 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-b5e9e524-f57b-44e4-94bf-65d7c2ea95e4 tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:25:42.299982 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-b5e9e524-f57b-44e4-94bf-65d7c2ea95e4 tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] [instance: 61d387ba-e928-4e5f-a79c-4f757643903c] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:25:42.316467 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-b5e9e524-f57b-44e4-94bf-65d7c2ea95e4 tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:25:42.317467 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-b5e9e524-f57b-44e4-94bf-65d7c2ea95e4 tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:25:42.318478 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-b5e9e524-f57b-44e4-94bf-65d7c2ea95e4 tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:25:42.319322 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-b5e9e524-f57b-44e4-94bf-65d7c2ea95e4 tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:25:42.480321 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-c80eaf8e-66ac-4a81-b2e6-0e7e2ea6a2aa tempest-DeleteServersTestJSON-1805612840 tempest-DeleteServersTestJSON-1805612840-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65322b3497864a64870eadab1ff7d490', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37560cd5b14f43cd85ee2a3ff2716c33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:25:42.493377 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-c80eaf8e-66ac-4a81-b2e6-0e7e2ea6a2aa tempest-DeleteServersTestJSON-1805612840 tempest-DeleteServersTestJSON-1805612840-project] 10.222.0.11 "GET /compute/v2.1/servers/eaeb6520-bd1e-495e-9ada-744682cbc122" status: 200 len: 1315 microversion: 2.1 time: 0.309503 Nov 17 03:25:42.495303 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 80/145] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:25:42 2021] GET /compute/v2.1/servers/eaeb6520-bd1e-495e-9ada-744682cbc122 => generated 1315 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:25:42.501350 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-c5860168-f52a-42e4-beb5-ddc75f62962d tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:25:42.502526 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-c5860168-f52a-42e4-beb5-ddc75f62962d tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] [instance: 5d54db85-b991-4890-abaa-952413baa2e7] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:25:42.509882 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-b5e9e524-f57b-44e4-94bf-65d7c2ea95e4 tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d4e8ac9538f42c9b637bd9e086668b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfc480343d4d493bb4295b055e274df5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:25:42.512260 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-c5860168-f52a-42e4-beb5-ddc75f62962d tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:25:42.512971 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-c5860168-f52a-42e4-beb5-ddc75f62962d tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:25:42.514425 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-c5860168-f52a-42e4-beb5-ddc75f62962d tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:25:42.514425 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-c5860168-f52a-42e4-beb5-ddc75f62962d tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:25:42.518965 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-b5e9e524-f57b-44e4-94bf-65d7c2ea95e4 tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] 10.222.0.11 "GET /compute/v2.1/servers/61d387ba-e928-4e5f-a79c-4f757643903c" status: 200 len: 1318 microversion: 2.1 time: 0.229521 Nov 17 03:25:42.520103 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 66/146] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:25:42 2021] GET /compute/v2.1/servers/61d387ba-e928-4e5f-a79c-4f757643903c => generated 1318 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:25:42.545157 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-10a8fa9d-8347-44dc-b793-c75cc4139632 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:25:42.546682 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-10a8fa9d-8347-44dc-b793-c75cc4139632 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] [instance: 6dc785d7-bc95-4fee-8206-c2fd3b930e4f] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:25:42.553265 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-10a8fa9d-8347-44dc-b793-c75cc4139632 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:25:42.553783 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-10a8fa9d-8347-44dc-b793-c75cc4139632 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:25:42.554842 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-10a8fa9d-8347-44dc-b793-c75cc4139632 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:25:42.555612 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-10a8fa9d-8347-44dc-b793-c75cc4139632 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:25:42.721886 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-c5860168-f52a-42e4-beb5-ddc75f62962d tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37f21d6d15cf40a586edda211219fd08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ebb970305844dccacf48a7d8d47ecf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:25:42.730413 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-c5860168-f52a-42e4-beb5-ddc75f62962d tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '37f21d6d15cf40a586edda211219fd08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ebb970305844dccacf48a7d8d47ecf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:25:42.731993 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-c5860168-f52a-42e4-beb5-ddc75f62962d tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '37f21d6d15cf40a586edda211219fd08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ebb970305844dccacf48a7d8d47ecf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:25:42.733157 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-c5860168-f52a-42e4-beb5-ddc75f62962d tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] 10.222.0.11 "GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7" status: 200 len: 1407 microversion: 2.20 time: 0.236436 Nov 17 03:25:42.733728 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 81/147] 10.222.0.11 () {60 vars in 1276 bytes} [Wed Nov 17 03:25:42 2021] GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7 => generated 1407 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 17 03:25:42.761266 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-10a8fa9d-8347-44dc-b793-c75cc4139632 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f046401c6a04f6495ebe0821120bd72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a58e89ceeea4a9c8a72a1de4bcaf2d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:25:42.769061 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-10a8fa9d-8347-44dc-b793-c75cc4139632 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] 10.222.0.11 "GET /compute/v2.1/servers/6dc785d7-bc95-4fee-8206-c2fd3b930e4f" status: 200 len: 1321 microversion: 2.1 time: 0.227505 Nov 17 03:25:42.769715 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 67/148] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:25:42 2021] GET /compute/v2.1/servers/6dc785d7-bc95-4fee-8206-c2fd3b930e4f => generated 1321 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:25:43.513282 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-4171790e-be1e-4566-a9fb-39f3488104c7 tempest-DeleteServersTestJSON-1805612840 tempest-DeleteServersTestJSON-1805612840-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:25:43.513844 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-4171790e-be1e-4566-a9fb-39f3488104c7 tempest-DeleteServersTestJSON-1805612840 tempest-DeleteServersTestJSON-1805612840-project] [instance: eaeb6520-bd1e-495e-9ada-744682cbc122] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:25:43.520323 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-4171790e-be1e-4566-a9fb-39f3488104c7 tempest-DeleteServersTestJSON-1805612840 tempest-DeleteServersTestJSON-1805612840-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:25:43.520802 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-4171790e-be1e-4566-a9fb-39f3488104c7 tempest-DeleteServersTestJSON-1805612840 tempest-DeleteServersTestJSON-1805612840-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:25:43.521594 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-4171790e-be1e-4566-a9fb-39f3488104c7 tempest-DeleteServersTestJSON-1805612840 tempest-DeleteServersTestJSON-1805612840-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:25:43.522024 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-4171790e-be1e-4566-a9fb-39f3488104c7 tempest-DeleteServersTestJSON-1805612840 tempest-DeleteServersTestJSON-1805612840-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:25:43.535374 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-3ad143d4-e2e2-4fd7-a10a-12a36d673a77 tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:25:43.535963 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-3ad143d4-e2e2-4fd7-a10a-12a36d673a77 tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] [instance: 61d387ba-e928-4e5f-a79c-4f757643903c] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:25:43.542181 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-3ad143d4-e2e2-4fd7-a10a-12a36d673a77 tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:25:43.542595 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-3ad143d4-e2e2-4fd7-a10a-12a36d673a77 tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:25:43.543391 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-3ad143d4-e2e2-4fd7-a10a-12a36d673a77 tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:25:43.543855 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-3ad143d4-e2e2-4fd7-a10a-12a36d673a77 tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:25:43.656144 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-4171790e-be1e-4566-a9fb-39f3488104c7 tempest-DeleteServersTestJSON-1805612840 tempest-DeleteServersTestJSON-1805612840-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65322b3497864a64870eadab1ff7d490', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37560cd5b14f43cd85ee2a3ff2716c33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:25:43.664063 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-4171790e-be1e-4566-a9fb-39f3488104c7 tempest-DeleteServersTestJSON-1805612840 tempest-DeleteServersTestJSON-1805612840-project] 10.222.0.11 "GET /compute/v2.1/servers/eaeb6520-bd1e-495e-9ada-744682cbc122" status: 200 len: 1315 microversion: 2.1 time: 0.155767 Nov 17 03:25:43.664630 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 82/149] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:25:43 2021] GET /compute/v2.1/servers/eaeb6520-bd1e-495e-9ada-744682cbc122 => generated 1315 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:25:43.674025 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-3ad143d4-e2e2-4fd7-a10a-12a36d673a77 tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d4e8ac9538f42c9b637bd9e086668b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfc480343d4d493bb4295b055e274df5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:25:43.682032 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-3ad143d4-e2e2-4fd7-a10a-12a36d673a77 tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] 10.222.0.11 "GET /compute/v2.1/servers/61d387ba-e928-4e5f-a79c-4f757643903c" status: 200 len: 1318 microversion: 2.1 time: 0.150394 Nov 17 03:25:43.682954 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 68/150] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:25:43 2021] GET /compute/v2.1/servers/61d387ba-e928-4e5f-a79c-4f757643903c => generated 1318 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:25:43.754811 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-c60f1adb-3c1c-44df-aaea-f6edb393630b tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:25:43.756083 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-c60f1adb-3c1c-44df-aaea-f6edb393630b tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] [instance: 5d54db85-b991-4890-abaa-952413baa2e7] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:25:43.766382 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-c60f1adb-3c1c-44df-aaea-f6edb393630b tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:25:43.766983 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-c60f1adb-3c1c-44df-aaea-f6edb393630b tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:25:43.768263 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-c60f1adb-3c1c-44df-aaea-f6edb393630b tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:25:43.769014 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-c60f1adb-3c1c-44df-aaea-f6edb393630b tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:25:43.785791 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-3c612aed-f3d2-4c36-9763-905846c3abf0 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:25:43.786426 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-3c612aed-f3d2-4c36-9763-905846c3abf0 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] [instance: 6dc785d7-bc95-4fee-8206-c2fd3b930e4f] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:25:43.793363 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-3c612aed-f3d2-4c36-9763-905846c3abf0 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:25:43.793819 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-3c612aed-f3d2-4c36-9763-905846c3abf0 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:25:43.795093 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-3c612aed-f3d2-4c36-9763-905846c3abf0 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:25:43.795566 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-3c612aed-f3d2-4c36-9763-905846c3abf0 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:25:43.908105 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-c60f1adb-3c1c-44df-aaea-f6edb393630b tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37f21d6d15cf40a586edda211219fd08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ebb970305844dccacf48a7d8d47ecf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:25:43.916020 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-c60f1adb-3c1c-44df-aaea-f6edb393630b tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '37f21d6d15cf40a586edda211219fd08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ebb970305844dccacf48a7d8d47ecf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:25:43.917556 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-c60f1adb-3c1c-44df-aaea-f6edb393630b tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '37f21d6d15cf40a586edda211219fd08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ebb970305844dccacf48a7d8d47ecf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:25:43.918603 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-c60f1adb-3c1c-44df-aaea-f6edb393630b tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] 10.222.0.11 "GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7" status: 200 len: 1407 microversion: 2.20 time: 0.169914 Nov 17 03:25:43.919390 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 83/151] 10.222.0.11 () {60 vars in 1276 bytes} [Wed Nov 17 03:25:43 2021] GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7 => generated 1407 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 17 03:25:43.927471 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-3c612aed-f3d2-4c36-9763-905846c3abf0 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f046401c6a04f6495ebe0821120bd72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a58e89ceeea4a9c8a72a1de4bcaf2d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:25:43.935244 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-3c612aed-f3d2-4c36-9763-905846c3abf0 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] 10.222.0.11 "GET /compute/v2.1/servers/6dc785d7-bc95-4fee-8206-c2fd3b930e4f" status: 200 len: 1321 microversion: 2.1 time: 0.153090 Nov 17 03:25:43.935797 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 69/152] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:25:43 2021] GET /compute/v2.1/servers/6dc785d7-bc95-4fee-8206-c2fd3b930e4f => generated 1321 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:25:44.681179 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-ea6672d8-cbb1-4b36-9967-ad5d9c68dbaf tempest-DeleteServersTestJSON-1805612840 tempest-DeleteServersTestJSON-1805612840-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:25:44.681799 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-ea6672d8-cbb1-4b36-9967-ad5d9c68dbaf tempest-DeleteServersTestJSON-1805612840 tempest-DeleteServersTestJSON-1805612840-project] [instance: eaeb6520-bd1e-495e-9ada-744682cbc122] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:25:44.688589 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-ea6672d8-cbb1-4b36-9967-ad5d9c68dbaf tempest-DeleteServersTestJSON-1805612840 tempest-DeleteServersTestJSON-1805612840-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:25:44.689071 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-ea6672d8-cbb1-4b36-9967-ad5d9c68dbaf tempest-DeleteServersTestJSON-1805612840 tempest-DeleteServersTestJSON-1805612840-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:25:44.689853 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-ea6672d8-cbb1-4b36-9967-ad5d9c68dbaf tempest-DeleteServersTestJSON-1805612840 tempest-DeleteServersTestJSON-1805612840-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:25:44.690261 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-ea6672d8-cbb1-4b36-9967-ad5d9c68dbaf tempest-DeleteServersTestJSON-1805612840 tempest-DeleteServersTestJSON-1805612840-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:25:44.699103 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-a9c059b4-5cfd-4287-af64-feb3bbf3c7ed tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:25:44.699686 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-a9c059b4-5cfd-4287-af64-feb3bbf3c7ed tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] [instance: 61d387ba-e928-4e5f-a79c-4f757643903c] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:25:44.706150 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-a9c059b4-5cfd-4287-af64-feb3bbf3c7ed tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:25:44.706586 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-a9c059b4-5cfd-4287-af64-feb3bbf3c7ed tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:25:44.707353 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-a9c059b4-5cfd-4287-af64-feb3bbf3c7ed tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:25:44.707774 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-a9c059b4-5cfd-4287-af64-feb3bbf3c7ed tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:25:44.837278 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-ea6672d8-cbb1-4b36-9967-ad5d9c68dbaf tempest-DeleteServersTestJSON-1805612840 tempest-DeleteServersTestJSON-1805612840-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65322b3497864a64870eadab1ff7d490', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37560cd5b14f43cd85ee2a3ff2716c33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:25:44.846494 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-ea6672d8-cbb1-4b36-9967-ad5d9c68dbaf tempest-DeleteServersTestJSON-1805612840 tempest-DeleteServersTestJSON-1805612840-project] 10.222.0.11 "GET /compute/v2.1/servers/eaeb6520-bd1e-495e-9ada-744682cbc122" status: 200 len: 1315 microversion: 2.1 time: 0.169365 Nov 17 03:25:44.847234 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 84/153] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:25:44 2021] GET /compute/v2.1/servers/eaeb6520-bd1e-495e-9ada-744682cbc122 => generated 1315 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:25:44.851337 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-a9c059b4-5cfd-4287-af64-feb3bbf3c7ed tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d4e8ac9538f42c9b637bd9e086668b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfc480343d4d493bb4295b055e274df5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:25:44.859420 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-a9c059b4-5cfd-4287-af64-feb3bbf3c7ed tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] 10.222.0.11 "GET /compute/v2.1/servers/61d387ba-e928-4e5f-a79c-4f757643903c" status: 200 len: 1318 microversion: 2.1 time: 0.163954 Nov 17 03:25:44.860154 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 70/154] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:25:44 2021] GET /compute/v2.1/servers/61d387ba-e928-4e5f-a79c-4f757643903c => generated 1318 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:25:44.938069 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-7e65d731-a19b-4804-abef-bddb6f6f506f tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:25:44.938965 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-7e65d731-a19b-4804-abef-bddb6f6f506f tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] [instance: 5d54db85-b991-4890-abaa-952413baa2e7] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:25:44.946861 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-7e65d731-a19b-4804-abef-bddb6f6f506f tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:25:44.947300 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-7e65d731-a19b-4804-abef-bddb6f6f506f tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:25:44.948057 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-7e65d731-a19b-4804-abef-bddb6f6f506f tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:25:44.948473 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-7e65d731-a19b-4804-abef-bddb6f6f506f tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:25:44.951368 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-c69792f0-8c8d-483a-983d-fd1a162350e7 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:25:44.951971 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-c69792f0-8c8d-483a-983d-fd1a162350e7 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] [instance: 6dc785d7-bc95-4fee-8206-c2fd3b930e4f] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:25:44.958306 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-c69792f0-8c8d-483a-983d-fd1a162350e7 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:25:44.958750 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-c69792f0-8c8d-483a-983d-fd1a162350e7 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:25:44.959532 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-c69792f0-8c8d-483a-983d-fd1a162350e7 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:25:44.959966 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-c69792f0-8c8d-483a-983d-fd1a162350e7 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:25:45.080805 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-7e65d731-a19b-4804-abef-bddb6f6f506f tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37f21d6d15cf40a586edda211219fd08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ebb970305844dccacf48a7d8d47ecf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:25:45.088366 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-c69792f0-8c8d-483a-983d-fd1a162350e7 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f046401c6a04f6495ebe0821120bd72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a58e89ceeea4a9c8a72a1de4bcaf2d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:25:45.089069 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-7e65d731-a19b-4804-abef-bddb6f6f506f tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '37f21d6d15cf40a586edda211219fd08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ebb970305844dccacf48a7d8d47ecf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:25:45.090546 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-7e65d731-a19b-4804-abef-bddb6f6f506f tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '37f21d6d15cf40a586edda211219fd08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ebb970305844dccacf48a7d8d47ecf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:25:45.091652 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-7e65d731-a19b-4804-abef-bddb6f6f506f tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] 10.222.0.11 "GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7" status: 200 len: 1407 microversion: 2.20 time: 0.157790 Nov 17 03:25:45.092215 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 85/155] 10.222.0.11 () {60 vars in 1276 bytes} [Wed Nov 17 03:25:44 2021] GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7 => generated 1407 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 17 03:25:45.095769 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-c69792f0-8c8d-483a-983d-fd1a162350e7 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] 10.222.0.11 "GET /compute/v2.1/servers/6dc785d7-bc95-4fee-8206-c2fd3b930e4f" status: 200 len: 1321 microversion: 2.1 time: 0.148231 Nov 17 03:25:45.096316 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 71/156] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:25:44 2021] GET /compute/v2.1/servers/6dc785d7-bc95-4fee-8206-c2fd3b930e4f => generated 1321 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:25:45.863266 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-835341cf-18b7-4fd6-ae56-514ad65ad13a tempest-DeleteServersTestJSON-1805612840 tempest-DeleteServersTestJSON-1805612840-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:25:45.863865 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-835341cf-18b7-4fd6-ae56-514ad65ad13a tempest-DeleteServersTestJSON-1805612840 tempest-DeleteServersTestJSON-1805612840-project] [instance: eaeb6520-bd1e-495e-9ada-744682cbc122] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:25:45.871479 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-835341cf-18b7-4fd6-ae56-514ad65ad13a tempest-DeleteServersTestJSON-1805612840 tempest-DeleteServersTestJSON-1805612840-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:25:45.871479 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-835341cf-18b7-4fd6-ae56-514ad65ad13a tempest-DeleteServersTestJSON-1805612840 tempest-DeleteServersTestJSON-1805612840-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:25:45.871881 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-835341cf-18b7-4fd6-ae56-514ad65ad13a tempest-DeleteServersTestJSON-1805612840 tempest-DeleteServersTestJSON-1805612840-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:25:45.872108 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-835341cf-18b7-4fd6-ae56-514ad65ad13a tempest-DeleteServersTestJSON-1805612840 tempest-DeleteServersTestJSON-1805612840-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:25:45.877824 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-2d6b9ce4-9021-4e9f-adfa-014f757a74c1 tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:25:45.879100 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-2d6b9ce4-9021-4e9f-adfa-014f757a74c1 tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] [instance: 61d387ba-e928-4e5f-a79c-4f757643903c] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:25:45.886342 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-2d6b9ce4-9021-4e9f-adfa-014f757a74c1 tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:25:45.887499 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-2d6b9ce4-9021-4e9f-adfa-014f757a74c1 tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:25:45.888717 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-2d6b9ce4-9021-4e9f-adfa-014f757a74c1 tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:25:45.889323 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-2d6b9ce4-9021-4e9f-adfa-014f757a74c1 tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:25:46.012459 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-835341cf-18b7-4fd6-ae56-514ad65ad13a tempest-DeleteServersTestJSON-1805612840 tempest-DeleteServersTestJSON-1805612840-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65322b3497864a64870eadab1ff7d490', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37560cd5b14f43cd85ee2a3ff2716c33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:25:46.020365 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-835341cf-18b7-4fd6-ae56-514ad65ad13a tempest-DeleteServersTestJSON-1805612840 tempest-DeleteServersTestJSON-1805612840-project] 10.222.0.11 "GET /compute/v2.1/servers/eaeb6520-bd1e-495e-9ada-744682cbc122" status: 200 len: 1315 microversion: 2.1 time: 0.160709 Nov 17 03:25:46.021196 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 86/157] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:25:45 2021] GET /compute/v2.1/servers/eaeb6520-bd1e-495e-9ada-744682cbc122 => generated 1315 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:25:46.043548 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-2d6b9ce4-9021-4e9f-adfa-014f757a74c1 tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d4e8ac9538f42c9b637bd9e086668b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfc480343d4d493bb4295b055e274df5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:25:46.051093 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-2d6b9ce4-9021-4e9f-adfa-014f757a74c1 tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] 10.222.0.11 "GET /compute/v2.1/servers/61d387ba-e928-4e5f-a79c-4f757643903c" status: 200 len: 1318 microversion: 2.1 time: 0.177379 Nov 17 03:25:46.051801 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 72/158] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:25:45 2021] GET /compute/v2.1/servers/61d387ba-e928-4e5f-a79c-4f757643903c => generated 1318 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:25:46.111116 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-7facefa6-74e9-4ba9-97de-60e968670179 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:25:46.111955 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-7facefa6-74e9-4ba9-97de-60e968670179 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] [instance: 5d54db85-b991-4890-abaa-952413baa2e7] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:25:46.113443 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-28b45069-f7b2-4629-aaa9-d8135a4b7878 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:25:46.114070 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-28b45069-f7b2-4629-aaa9-d8135a4b7878 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] [instance: 6dc785d7-bc95-4fee-8206-c2fd3b930e4f] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:25:46.118427 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-7facefa6-74e9-4ba9-97de-60e968670179 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:25:46.118872 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-7facefa6-74e9-4ba9-97de-60e968670179 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:25:46.119643 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-7facefa6-74e9-4ba9-97de-60e968670179 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:25:46.119750 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-28b45069-f7b2-4629-aaa9-d8135a4b7878 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:25:46.120081 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-7facefa6-74e9-4ba9-97de-60e968670179 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:25:46.120184 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-28b45069-f7b2-4629-aaa9-d8135a4b7878 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:25:46.120971 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-28b45069-f7b2-4629-aaa9-d8135a4b7878 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:25:46.121394 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-28b45069-f7b2-4629-aaa9-d8135a4b7878 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:25:46.262311 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-28b45069-f7b2-4629-aaa9-d8135a4b7878 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f046401c6a04f6495ebe0821120bd72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a58e89ceeea4a9c8a72a1de4bcaf2d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:25:46.270418 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-28b45069-f7b2-4629-aaa9-d8135a4b7878 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] 10.222.0.11 "GET /compute/v2.1/servers/6dc785d7-bc95-4fee-8206-c2fd3b930e4f" status: 200 len: 1321 microversion: 2.1 time: 0.160944 Nov 17 03:25:46.270964 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 73/159] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:25:46 2021] GET /compute/v2.1/servers/6dc785d7-bc95-4fee-8206-c2fd3b930e4f => generated 1321 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:25:46.281406 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-7facefa6-74e9-4ba9-97de-60e968670179 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37f21d6d15cf40a586edda211219fd08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ebb970305844dccacf48a7d8d47ecf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:25:46.295403 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-7facefa6-74e9-4ba9-97de-60e968670179 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '37f21d6d15cf40a586edda211219fd08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ebb970305844dccacf48a7d8d47ecf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:25:46.296909 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-7facefa6-74e9-4ba9-97de-60e968670179 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '37f21d6d15cf40a586edda211219fd08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ebb970305844dccacf48a7d8d47ecf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:25:46.298024 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-7facefa6-74e9-4ba9-97de-60e968670179 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] 10.222.0.11 "GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7" status: 200 len: 1407 microversion: 2.20 time: 0.193157 Nov 17 03:25:46.298723 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 87/160] 10.222.0.11 () {60 vars in 1276 bytes} [Wed Nov 17 03:25:46 2021] GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7 => generated 1407 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 17 03:25:47.037150 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-a3b1dad2-fc85-4112-a704-e3ff9ef2e62a tempest-DeleteServersTestJSON-1805612840 tempest-DeleteServersTestJSON-1805612840-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:25:47.037733 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-a3b1dad2-fc85-4112-a704-e3ff9ef2e62a tempest-DeleteServersTestJSON-1805612840 tempest-DeleteServersTestJSON-1805612840-project] [instance: eaeb6520-bd1e-495e-9ada-744682cbc122] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:25:47.044385 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-a3b1dad2-fc85-4112-a704-e3ff9ef2e62a tempest-DeleteServersTestJSON-1805612840 tempest-DeleteServersTestJSON-1805612840-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:25:47.044834 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-a3b1dad2-fc85-4112-a704-e3ff9ef2e62a tempest-DeleteServersTestJSON-1805612840 tempest-DeleteServersTestJSON-1805612840-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:25:47.045628 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-a3b1dad2-fc85-4112-a704-e3ff9ef2e62a tempest-DeleteServersTestJSON-1805612840 tempest-DeleteServersTestJSON-1805612840-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:25:47.046047 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-a3b1dad2-fc85-4112-a704-e3ff9ef2e62a tempest-DeleteServersTestJSON-1805612840 tempest-DeleteServersTestJSON-1805612840-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:25:47.068873 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-521113d7-f015-4ee3-8833-305370007f18 tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:25:47.069474 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-521113d7-f015-4ee3-8833-305370007f18 tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] [instance: 61d387ba-e928-4e5f-a79c-4f757643903c] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:25:47.078142 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-521113d7-f015-4ee3-8833-305370007f18 tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:25:47.078142 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-521113d7-f015-4ee3-8833-305370007f18 tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:25:47.078911 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-521113d7-f015-4ee3-8833-305370007f18 tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:25:47.079346 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-521113d7-f015-4ee3-8833-305370007f18 tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:25:47.210103 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-521113d7-f015-4ee3-8833-305370007f18 tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d4e8ac9538f42c9b637bd9e086668b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfc480343d4d493bb4295b055e274df5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:25:47.217560 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-521113d7-f015-4ee3-8833-305370007f18 tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] 10.222.0.11 "GET /compute/v2.1/servers/61d387ba-e928-4e5f-a79c-4f757643903c" status: 200 len: 1318 microversion: 2.1 time: 0.152404 Nov 17 03:25:47.218138 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 88/161] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:25:47 2021] GET /compute/v2.1/servers/61d387ba-e928-4e5f-a79c-4f757643903c => generated 1318 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 17 03:25:47.252347 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-a3b1dad2-fc85-4112-a704-e3ff9ef2e62a tempest-DeleteServersTestJSON-1805612840 tempest-DeleteServersTestJSON-1805612840-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65322b3497864a64870eadab1ff7d490', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37560cd5b14f43cd85ee2a3ff2716c33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:25:47.259759 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-a3b1dad2-fc85-4112-a704-e3ff9ef2e62a tempest-DeleteServersTestJSON-1805612840 tempest-DeleteServersTestJSON-1805612840-project] 10.222.0.11 "GET /compute/v2.1/servers/eaeb6520-bd1e-495e-9ada-744682cbc122" status: 200 len: 1315 microversion: 2.1 time: 0.226222 Nov 17 03:25:47.260523 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 74/162] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:25:47 2021] GET /compute/v2.1/servers/eaeb6520-bd1e-495e-9ada-744682cbc122 => generated 1315 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:25:47.287262 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-8b6f0363-b685-492f-a89a-e22c0a7d892a tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:25:47.287905 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-8b6f0363-b685-492f-a89a-e22c0a7d892a tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] [instance: 6dc785d7-bc95-4fee-8206-c2fd3b930e4f] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:25:47.293717 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-8b6f0363-b685-492f-a89a-e22c0a7d892a tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:25:47.294189 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-8b6f0363-b685-492f-a89a-e22c0a7d892a tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:25:47.295248 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-8b6f0363-b685-492f-a89a-e22c0a7d892a tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:25:47.295709 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-8b6f0363-b685-492f-a89a-e22c0a7d892a tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:25:47.317106 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-b8cee3c1-f4b8-4480-91b7-6f5328a3ee65 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:25:47.317707 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-b8cee3c1-f4b8-4480-91b7-6f5328a3ee65 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] [instance: 5d54db85-b991-4890-abaa-952413baa2e7] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:25:47.328237 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-b8cee3c1-f4b8-4480-91b7-6f5328a3ee65 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:25:47.328690 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-b8cee3c1-f4b8-4480-91b7-6f5328a3ee65 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:25:47.329506 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-b8cee3c1-f4b8-4480-91b7-6f5328a3ee65 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:25:47.329932 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-b8cee3c1-f4b8-4480-91b7-6f5328a3ee65 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:25:47.460691 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-8b6f0363-b685-492f-a89a-e22c0a7d892a tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f046401c6a04f6495ebe0821120bd72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a58e89ceeea4a9c8a72a1de4bcaf2d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:25:47.468323 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-8b6f0363-b685-492f-a89a-e22c0a7d892a tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] 10.222.0.11 "GET /compute/v2.1/servers/6dc785d7-bc95-4fee-8206-c2fd3b930e4f" status: 200 len: 1321 microversion: 2.1 time: 0.184735 Nov 17 03:25:47.468922 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 89/163] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:25:47 2021] GET /compute/v2.1/servers/6dc785d7-bc95-4fee-8206-c2fd3b930e4f => generated 1321 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:25:47.486354 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-b8cee3c1-f4b8-4480-91b7-6f5328a3ee65 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37f21d6d15cf40a586edda211219fd08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ebb970305844dccacf48a7d8d47ecf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:25:47.496000 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-b8cee3c1-f4b8-4480-91b7-6f5328a3ee65 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '37f21d6d15cf40a586edda211219fd08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ebb970305844dccacf48a7d8d47ecf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:25:47.497907 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-b8cee3c1-f4b8-4480-91b7-6f5328a3ee65 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '37f21d6d15cf40a586edda211219fd08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ebb970305844dccacf48a7d8d47ecf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:25:47.499126 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-b8cee3c1-f4b8-4480-91b7-6f5328a3ee65 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] 10.222.0.11 "GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7" status: 200 len: 1407 microversion: 2.20 time: 0.185837 Nov 17 03:25:47.499725 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 75/164] 10.222.0.11 () {60 vars in 1276 bytes} [Wed Nov 17 03:25:47 2021] GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7 => generated 1407 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 17 03:25:48.233932 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-02e270d3-6b4c-4a9a-a73c-e5bc64f69e61 tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:25:48.234437 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-02e270d3-6b4c-4a9a-a73c-e5bc64f69e61 tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] [instance: 61d387ba-e928-4e5f-a79c-4f757643903c] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:25:48.240566 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-02e270d3-6b4c-4a9a-a73c-e5bc64f69e61 tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:25:48.241031 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-02e270d3-6b4c-4a9a-a73c-e5bc64f69e61 tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:25:48.241789 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-02e270d3-6b4c-4a9a-a73c-e5bc64f69e61 tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:25:48.242208 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-02e270d3-6b4c-4a9a-a73c-e5bc64f69e61 tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:25:48.287334 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-6f3dd14a-5dcc-430e-b5d7-de79965bad4a tempest-DeleteServersTestJSON-1805612840 tempest-DeleteServersTestJSON-1805612840-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:25:48.288014 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-6f3dd14a-5dcc-430e-b5d7-de79965bad4a tempest-DeleteServersTestJSON-1805612840 tempest-DeleteServersTestJSON-1805612840-project] [instance: eaeb6520-bd1e-495e-9ada-744682cbc122] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:25:48.294605 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-6f3dd14a-5dcc-430e-b5d7-de79965bad4a tempest-DeleteServersTestJSON-1805612840 tempest-DeleteServersTestJSON-1805612840-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:25:48.295287 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-6f3dd14a-5dcc-430e-b5d7-de79965bad4a tempest-DeleteServersTestJSON-1805612840 tempest-DeleteServersTestJSON-1805612840-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:25:48.296192 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-6f3dd14a-5dcc-430e-b5d7-de79965bad4a tempest-DeleteServersTestJSON-1805612840 tempest-DeleteServersTestJSON-1805612840-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:25:48.296843 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-6f3dd14a-5dcc-430e-b5d7-de79965bad4a tempest-DeleteServersTestJSON-1805612840 tempest-DeleteServersTestJSON-1805612840-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:25:48.386138 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-02e270d3-6b4c-4a9a-a73c-e5bc64f69e61 tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d4e8ac9538f42c9b637bd9e086668b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfc480343d4d493bb4295b055e274df5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:25:48.395304 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-02e270d3-6b4c-4a9a-a73c-e5bc64f69e61 tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] 10.222.0.11 "GET /compute/v2.1/servers/61d387ba-e928-4e5f-a79c-4f757643903c" status: 200 len: 1318 microversion: 2.1 time: 0.165150 Nov 17 03:25:48.395883 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 90/165] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:25:48 2021] GET /compute/v2.1/servers/61d387ba-e928-4e5f-a79c-4f757643903c => generated 1318 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:25:48.445952 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-6f3dd14a-5dcc-430e-b5d7-de79965bad4a tempest-DeleteServersTestJSON-1805612840 tempest-DeleteServersTestJSON-1805612840-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65322b3497864a64870eadab1ff7d490', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37560cd5b14f43cd85ee2a3ff2716c33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:25:48.454157 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-6f3dd14a-5dcc-430e-b5d7-de79965bad4a tempest-DeleteServersTestJSON-1805612840 tempest-DeleteServersTestJSON-1805612840-project] 10.222.0.11 "GET /compute/v2.1/servers/eaeb6520-bd1e-495e-9ada-744682cbc122" status: 200 len: 1315 microversion: 2.1 time: 0.181331 Nov 17 03:25:48.454824 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 76/166] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:25:48 2021] GET /compute/v2.1/servers/eaeb6520-bd1e-495e-9ada-744682cbc122 => generated 1315 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:25:48.485170 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-c19d6c9b-ffe7-4edd-8476-fcf0e4b61a0d tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:25:48.485699 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-c19d6c9b-ffe7-4edd-8476-fcf0e4b61a0d tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] [instance: 6dc785d7-bc95-4fee-8206-c2fd3b930e4f] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:25:48.491714 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-c19d6c9b-ffe7-4edd-8476-fcf0e4b61a0d tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:25:48.492159 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-c19d6c9b-ffe7-4edd-8476-fcf0e4b61a0d tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:25:48.493041 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-c19d6c9b-ffe7-4edd-8476-fcf0e4b61a0d tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:25:48.493359 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-c19d6c9b-ffe7-4edd-8476-fcf0e4b61a0d tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:25:48.520094 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-28d4f7b3-c45c-4bc5-a965-ebe9308018c1 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:25:48.520760 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-28d4f7b3-c45c-4bc5-a965-ebe9308018c1 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] [instance: 5d54db85-b991-4890-abaa-952413baa2e7] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:25:48.526881 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-28d4f7b3-c45c-4bc5-a965-ebe9308018c1 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:25:48.527497 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-28d4f7b3-c45c-4bc5-a965-ebe9308018c1 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:25:48.530166 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-28d4f7b3-c45c-4bc5-a965-ebe9308018c1 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:25:48.530916 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-28d4f7b3-c45c-4bc5-a965-ebe9308018c1 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:25:48.646817 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-c19d6c9b-ffe7-4edd-8476-fcf0e4b61a0d tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f046401c6a04f6495ebe0821120bd72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a58e89ceeea4a9c8a72a1de4bcaf2d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:25:48.655294 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-c19d6c9b-ffe7-4edd-8476-fcf0e4b61a0d tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] 10.222.0.11 "GET /compute/v2.1/servers/6dc785d7-bc95-4fee-8206-c2fd3b930e4f" status: 200 len: 1321 microversion: 2.1 time: 0.173840 Nov 17 03:25:48.656161 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 91/167] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:25:48 2021] GET /compute/v2.1/servers/6dc785d7-bc95-4fee-8206-c2fd3b930e4f => generated 1321 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:25:48.685030 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-28d4f7b3-c45c-4bc5-a965-ebe9308018c1 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37f21d6d15cf40a586edda211219fd08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ebb970305844dccacf48a7d8d47ecf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:25:48.697437 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-28d4f7b3-c45c-4bc5-a965-ebe9308018c1 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '37f21d6d15cf40a586edda211219fd08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ebb970305844dccacf48a7d8d47ecf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:25:48.699260 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-28d4f7b3-c45c-4bc5-a965-ebe9308018c1 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '37f21d6d15cf40a586edda211219fd08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ebb970305844dccacf48a7d8d47ecf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:25:48.700652 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-28d4f7b3-c45c-4bc5-a965-ebe9308018c1 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] 10.222.0.11 "GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7" status: 200 len: 1407 microversion: 2.20 time: 0.187135 Nov 17 03:25:48.702045 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 77/168] 10.222.0.11 () {60 vars in 1276 bytes} [Wed Nov 17 03:25:48 2021] GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7 => generated 1407 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 17 03:25:49.413214 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-54fedcdf-bc02-4ad0-8a35-1463aa483630 tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:25:49.413993 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-54fedcdf-bc02-4ad0-8a35-1463aa483630 tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] [instance: 61d387ba-e928-4e5f-a79c-4f757643903c] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:25:49.420459 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-54fedcdf-bc02-4ad0-8a35-1463aa483630 tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:25:49.420955 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-54fedcdf-bc02-4ad0-8a35-1463aa483630 tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:25:49.422284 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-54fedcdf-bc02-4ad0-8a35-1463aa483630 tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:25:49.422284 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-54fedcdf-bc02-4ad0-8a35-1463aa483630 tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:25:49.471993 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-e091264a-5ff1-48ae-844e-2617c3afc000 tempest-DeleteServersTestJSON-1805612840 tempest-DeleteServersTestJSON-1805612840-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:25:49.472686 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-e091264a-5ff1-48ae-844e-2617c3afc000 tempest-DeleteServersTestJSON-1805612840 tempest-DeleteServersTestJSON-1805612840-project] [instance: eaeb6520-bd1e-495e-9ada-744682cbc122] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:25:49.478839 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-e091264a-5ff1-48ae-844e-2617c3afc000 tempest-DeleteServersTestJSON-1805612840 tempest-DeleteServersTestJSON-1805612840-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:25:49.479351 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-e091264a-5ff1-48ae-844e-2617c3afc000 tempest-DeleteServersTestJSON-1805612840 tempest-DeleteServersTestJSON-1805612840-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:25:49.480176 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-e091264a-5ff1-48ae-844e-2617c3afc000 tempest-DeleteServersTestJSON-1805612840 tempest-DeleteServersTestJSON-1805612840-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:25:49.480659 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-e091264a-5ff1-48ae-844e-2617c3afc000 tempest-DeleteServersTestJSON-1805612840 tempest-DeleteServersTestJSON-1805612840-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:25:49.626279 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-54fedcdf-bc02-4ad0-8a35-1463aa483630 tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d4e8ac9538f42c9b637bd9e086668b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfc480343d4d493bb4295b055e274df5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:25:49.630471 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-e091264a-5ff1-48ae-844e-2617c3afc000 tempest-DeleteServersTestJSON-1805612840 tempest-DeleteServersTestJSON-1805612840-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65322b3497864a64870eadab1ff7d490', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37560cd5b14f43cd85ee2a3ff2716c33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:25:49.646311 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-54fedcdf-bc02-4ad0-8a35-1463aa483630 tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] 10.222.0.11 "GET /compute/v2.1/servers/61d387ba-e928-4e5f-a79c-4f757643903c" status: 200 len: 1318 microversion: 2.1 time: 0.237202 Nov 17 03:25:49.646904 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 92/169] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:25:49 2021] GET /compute/v2.1/servers/61d387ba-e928-4e5f-a79c-4f757643903c => generated 1318 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:25:49.651521 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-e091264a-5ff1-48ae-844e-2617c3afc000 tempest-DeleteServersTestJSON-1805612840 tempest-DeleteServersTestJSON-1805612840-project] 10.222.0.11 "GET /compute/v2.1/servers/eaeb6520-bd1e-495e-9ada-744682cbc122" status: 200 len: 1315 microversion: 2.1 time: 0.183757 Nov 17 03:25:49.652119 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 78/170] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:25:49 2021] GET /compute/v2.1/servers/eaeb6520-bd1e-495e-9ada-744682cbc122 => generated 1315 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:25:49.672953 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-91fb6746-153b-4025-9cea-b163401aa555 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:25:49.673718 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-91fb6746-153b-4025-9cea-b163401aa555 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] [instance: 6dc785d7-bc95-4fee-8206-c2fd3b930e4f] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:25:49.681757 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-91fb6746-153b-4025-9cea-b163401aa555 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:25:49.682771 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-91fb6746-153b-4025-9cea-b163401aa555 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:25:49.684096 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-91fb6746-153b-4025-9cea-b163401aa555 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:25:49.684816 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-91fb6746-153b-4025-9cea-b163401aa555 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:25:49.762303 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-f3c0f626-47e9-422f-8491-05b481fdce6d tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:25:49.763028 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-f3c0f626-47e9-422f-8491-05b481fdce6d tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] [instance: 5d54db85-b991-4890-abaa-952413baa2e7] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:25:49.769185 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-f3c0f626-47e9-422f-8491-05b481fdce6d tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:25:49.770012 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-f3c0f626-47e9-422f-8491-05b481fdce6d tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:25:49.770852 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-f3c0f626-47e9-422f-8491-05b481fdce6d tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:25:49.771497 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-f3c0f626-47e9-422f-8491-05b481fdce6d tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:25:49.847982 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-91fb6746-153b-4025-9cea-b163401aa555 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f046401c6a04f6495ebe0821120bd72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a58e89ceeea4a9c8a72a1de4bcaf2d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:25:49.856585 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-91fb6746-153b-4025-9cea-b163401aa555 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] 10.222.0.11 "GET /compute/v2.1/servers/6dc785d7-bc95-4fee-8206-c2fd3b930e4f" status: 200 len: 1321 microversion: 2.1 time: 0.187381 Nov 17 03:25:49.857807 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 93/171] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:25:49 2021] GET /compute/v2.1/servers/6dc785d7-bc95-4fee-8206-c2fd3b930e4f => generated 1321 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:25:49.944910 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-f3c0f626-47e9-422f-8491-05b481fdce6d tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37f21d6d15cf40a586edda211219fd08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ebb970305844dccacf48a7d8d47ecf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:25:49.953082 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-f3c0f626-47e9-422f-8491-05b481fdce6d tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '37f21d6d15cf40a586edda211219fd08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ebb970305844dccacf48a7d8d47ecf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:25:49.954781 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-f3c0f626-47e9-422f-8491-05b481fdce6d tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '37f21d6d15cf40a586edda211219fd08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ebb970305844dccacf48a7d8d47ecf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:25:49.955994 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-f3c0f626-47e9-422f-8491-05b481fdce6d tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] 10.222.0.11 "GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7" status: 200 len: 1407 microversion: 2.20 time: 0.197984 Nov 17 03:25:49.956639 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 79/172] 10.222.0.11 () {60 vars in 1276 bytes} [Wed Nov 17 03:25:49 2021] GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7 => generated 1407 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 17 03:25:50.663361 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-ba4a2029-a305-400b-b803-91817dad26f4 tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:25:50.664621 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-ba4a2029-a305-400b-b803-91817dad26f4 tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] [instance: 61d387ba-e928-4e5f-a79c-4f757643903c] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:25:50.668240 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-19551ba0-aada-4099-afbb-1b3d7ebec2d4 tempest-DeleteServersTestJSON-1805612840 tempest-DeleteServersTestJSON-1805612840-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:25:50.669448 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-19551ba0-aada-4099-afbb-1b3d7ebec2d4 tempest-DeleteServersTestJSON-1805612840 tempest-DeleteServersTestJSON-1805612840-project] [instance: eaeb6520-bd1e-495e-9ada-744682cbc122] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:25:50.671198 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-ba4a2029-a305-400b-b803-91817dad26f4 tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:25:50.671654 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-ba4a2029-a305-400b-b803-91817dad26f4 tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:25:50.672581 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-ba4a2029-a305-400b-b803-91817dad26f4 tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:25:50.673043 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-ba4a2029-a305-400b-b803-91817dad26f4 tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:25:50.676958 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-19551ba0-aada-4099-afbb-1b3d7ebec2d4 tempest-DeleteServersTestJSON-1805612840 tempest-DeleteServersTestJSON-1805612840-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:25:50.677474 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-19551ba0-aada-4099-afbb-1b3d7ebec2d4 tempest-DeleteServersTestJSON-1805612840 tempest-DeleteServersTestJSON-1805612840-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:25:50.678339 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-19551ba0-aada-4099-afbb-1b3d7ebec2d4 tempest-DeleteServersTestJSON-1805612840 tempest-DeleteServersTestJSON-1805612840-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:25:50.678974 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-19551ba0-aada-4099-afbb-1b3d7ebec2d4 tempest-DeleteServersTestJSON-1805612840 tempest-DeleteServersTestJSON-1805612840-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:25:50.828056 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-ba4a2029-a305-400b-b803-91817dad26f4 tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d4e8ac9538f42c9b637bd9e086668b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfc480343d4d493bb4295b055e274df5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:25:50.830713 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-ba4a2029-a305-400b-b803-91817dad26f4 tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] 10.222.0.11 "GET /compute/v2.1/servers/61d387ba-e928-4e5f-a79c-4f757643903c" status: 200 len: 1318 microversion: 2.1 time: 0.171302 Nov 17 03:25:50.831839 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 94/173] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:25:50 2021] GET /compute/v2.1/servers/61d387ba-e928-4e5f-a79c-4f757643903c => generated 1318 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:25:50.841820 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-19551ba0-aada-4099-afbb-1b3d7ebec2d4 tempest-DeleteServersTestJSON-1805612840 tempest-DeleteServersTestJSON-1805612840-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65322b3497864a64870eadab1ff7d490', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37560cd5b14f43cd85ee2a3ff2716c33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:25:50.851039 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-19551ba0-aada-4099-afbb-1b3d7ebec2d4 tempest-DeleteServersTestJSON-1805612840 tempest-DeleteServersTestJSON-1805612840-project] 10.222.0.11 "GET /compute/v2.1/servers/eaeb6520-bd1e-495e-9ada-744682cbc122" status: 200 len: 1315 microversion: 2.1 time: 0.186337 Nov 17 03:25:50.851611 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 80/174] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:25:50 2021] GET /compute/v2.1/servers/eaeb6520-bd1e-495e-9ada-744682cbc122 => generated 1315 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:25:50.873773 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-eeb09b56-ab5c-4fd4-989a-5a5bf2da9589 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:25:50.874585 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-eeb09b56-ab5c-4fd4-989a-5a5bf2da9589 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] [instance: 6dc785d7-bc95-4fee-8206-c2fd3b930e4f] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:25:50.881758 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-eeb09b56-ab5c-4fd4-989a-5a5bf2da9589 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:25:50.882198 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-eeb09b56-ab5c-4fd4-989a-5a5bf2da9589 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:25:50.883011 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-eeb09b56-ab5c-4fd4-989a-5a5bf2da9589 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:25:50.883490 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-eeb09b56-ab5c-4fd4-989a-5a5bf2da9589 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:25:50.974040 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-c8c4993a-ebf3-464c-bc7a-01a07c1f80f1 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:25:50.974943 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-c8c4993a-ebf3-464c-bc7a-01a07c1f80f1 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] [instance: 5d54db85-b991-4890-abaa-952413baa2e7] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:25:50.981230 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-c8c4993a-ebf3-464c-bc7a-01a07c1f80f1 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:25:50.981837 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-c8c4993a-ebf3-464c-bc7a-01a07c1f80f1 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:25:50.983098 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-c8c4993a-ebf3-464c-bc7a-01a07c1f80f1 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:25:50.983907 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-c8c4993a-ebf3-464c-bc7a-01a07c1f80f1 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:25:51.018945 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-eeb09b56-ab5c-4fd4-989a-5a5bf2da9589 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f046401c6a04f6495ebe0821120bd72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a58e89ceeea4a9c8a72a1de4bcaf2d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:25:51.026293 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-eeb09b56-ab5c-4fd4-989a-5a5bf2da9589 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] 10.222.0.11 "GET /compute/v2.1/servers/6dc785d7-bc95-4fee-8206-c2fd3b930e4f" status: 200 len: 1321 microversion: 2.1 time: 0.156500 Nov 17 03:25:51.035448 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 95/175] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:25:50 2021] GET /compute/v2.1/servers/6dc785d7-bc95-4fee-8206-c2fd3b930e4f => generated 1321 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:25:51.119130 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-c8c4993a-ebf3-464c-bc7a-01a07c1f80f1 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37f21d6d15cf40a586edda211219fd08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ebb970305844dccacf48a7d8d47ecf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:25:51.126981 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-c8c4993a-ebf3-464c-bc7a-01a07c1f80f1 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '37f21d6d15cf40a586edda211219fd08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ebb970305844dccacf48a7d8d47ecf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:25:51.128442 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-c8c4993a-ebf3-464c-bc7a-01a07c1f80f1 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '37f21d6d15cf40a586edda211219fd08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ebb970305844dccacf48a7d8d47ecf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:25:51.129559 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-c8c4993a-ebf3-464c-bc7a-01a07c1f80f1 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] 10.222.0.11 "GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7" status: 200 len: 1407 microversion: 2.20 time: 0.159203 Nov 17 03:25:51.130109 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 81/176] 10.222.0.11 () {60 vars in 1276 bytes} [Wed Nov 17 03:25:50 2021] GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7 => generated 1407 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 17 03:25:51.848359 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-52cff428-1d44-48cf-adfd-d0c49efce4f8 tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:25:51.849095 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-52cff428-1d44-48cf-adfd-d0c49efce4f8 tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] [instance: 61d387ba-e928-4e5f-a79c-4f757643903c] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:25:51.855839 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-52cff428-1d44-48cf-adfd-d0c49efce4f8 tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:25:51.856331 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-52cff428-1d44-48cf-adfd-d0c49efce4f8 tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:25:51.857473 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-52cff428-1d44-48cf-adfd-d0c49efce4f8 tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:25:51.857983 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-52cff428-1d44-48cf-adfd-d0c49efce4f8 tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:25:51.869670 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-30f2741f-23df-4435-a401-81d35ff7a143 tempest-DeleteServersTestJSON-1805612840 tempest-DeleteServersTestJSON-1805612840-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:25:51.869670 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-30f2741f-23df-4435-a401-81d35ff7a143 tempest-DeleteServersTestJSON-1805612840 tempest-DeleteServersTestJSON-1805612840-project] [instance: eaeb6520-bd1e-495e-9ada-744682cbc122] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:25:51.875003 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-30f2741f-23df-4435-a401-81d35ff7a143 tempest-DeleteServersTestJSON-1805612840 tempest-DeleteServersTestJSON-1805612840-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:25:51.875444 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-30f2741f-23df-4435-a401-81d35ff7a143 tempest-DeleteServersTestJSON-1805612840 tempest-DeleteServersTestJSON-1805612840-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:25:51.876214 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-30f2741f-23df-4435-a401-81d35ff7a143 tempest-DeleteServersTestJSON-1805612840 tempest-DeleteServersTestJSON-1805612840-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:25:51.876625 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-30f2741f-23df-4435-a401-81d35ff7a143 tempest-DeleteServersTestJSON-1805612840 tempest-DeleteServersTestJSON-1805612840-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:25:51.993481 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-52cff428-1d44-48cf-adfd-d0c49efce4f8 tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d4e8ac9538f42c9b637bd9e086668b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfc480343d4d493bb4295b055e274df5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:25:52.000878 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-52cff428-1d44-48cf-adfd-d0c49efce4f8 tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] 10.222.0.11 "GET /compute/v2.1/servers/61d387ba-e928-4e5f-a79c-4f757643903c" status: 200 len: 1318 microversion: 2.1 time: 0.156705 Nov 17 03:25:52.001442 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 96/177] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:25:51 2021] GET /compute/v2.1/servers/61d387ba-e928-4e5f-a79c-4f757643903c => generated 1318 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:25:52.008496 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-30f2741f-23df-4435-a401-81d35ff7a143 tempest-DeleteServersTestJSON-1805612840 tempest-DeleteServersTestJSON-1805612840-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65322b3497864a64870eadab1ff7d490', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37560cd5b14f43cd85ee2a3ff2716c33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:25:52.015913 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-30f2741f-23df-4435-a401-81d35ff7a143 tempest-DeleteServersTestJSON-1805612840 tempest-DeleteServersTestJSON-1805612840-project] 10.222.0.11 "GET /compute/v2.1/servers/eaeb6520-bd1e-495e-9ada-744682cbc122" status: 200 len: 1315 microversion: 2.1 time: 0.152212 Nov 17 03:25:52.016462 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 82/178] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:25:51 2021] GET /compute/v2.1/servers/eaeb6520-bd1e-495e-9ada-744682cbc122 => generated 1315 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:25:52.042506 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-e06303d8-e1bf-412f-8d3b-788a48197535 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:25:52.043102 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-e06303d8-e1bf-412f-8d3b-788a48197535 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] [instance: 6dc785d7-bc95-4fee-8206-c2fd3b930e4f] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:25:52.048938 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-e06303d8-e1bf-412f-8d3b-788a48197535 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:25:52.049373 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-e06303d8-e1bf-412f-8d3b-788a48197535 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:25:52.050136 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-e06303d8-e1bf-412f-8d3b-788a48197535 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:25:52.050560 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-e06303d8-e1bf-412f-8d3b-788a48197535 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:25:52.147451 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-8f7cd3d8-5d36-419f-82af-c81d42bf31d5 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:25:52.148054 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-8f7cd3d8-5d36-419f-82af-c81d42bf31d5 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] [instance: 5d54db85-b991-4890-abaa-952413baa2e7] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:25:52.154301 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-8f7cd3d8-5d36-419f-82af-c81d42bf31d5 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:25:52.154752 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-8f7cd3d8-5d36-419f-82af-c81d42bf31d5 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:25:52.155531 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-8f7cd3d8-5d36-419f-82af-c81d42bf31d5 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:25:52.155965 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-8f7cd3d8-5d36-419f-82af-c81d42bf31d5 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:25:52.189990 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-e06303d8-e1bf-412f-8d3b-788a48197535 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f046401c6a04f6495ebe0821120bd72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a58e89ceeea4a9c8a72a1de4bcaf2d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:25:52.197586 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-e06303d8-e1bf-412f-8d3b-788a48197535 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] 10.222.0.11 "GET /compute/v2.1/servers/6dc785d7-bc95-4fee-8206-c2fd3b930e4f" status: 200 len: 1321 microversion: 2.1 time: 0.158607 Nov 17 03:25:52.198193 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 97/179] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:25:52 2021] GET /compute/v2.1/servers/6dc785d7-bc95-4fee-8206-c2fd3b930e4f => generated 1321 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:25:52.310336 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-8f7cd3d8-5d36-419f-82af-c81d42bf31d5 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37f21d6d15cf40a586edda211219fd08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ebb970305844dccacf48a7d8d47ecf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:25:52.323309 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-8f7cd3d8-5d36-419f-82af-c81d42bf31d5 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '37f21d6d15cf40a586edda211219fd08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ebb970305844dccacf48a7d8d47ecf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:25:52.325771 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-8f7cd3d8-5d36-419f-82af-c81d42bf31d5 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '37f21d6d15cf40a586edda211219fd08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ebb970305844dccacf48a7d8d47ecf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:25:52.326976 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-8f7cd3d8-5d36-419f-82af-c81d42bf31d5 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] 10.222.0.11 "GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7" status: 200 len: 1407 microversion: 2.20 time: 0.183259 Nov 17 03:25:52.327531 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 83/180] 10.222.0.11 () {60 vars in 1276 bytes} [Wed Nov 17 03:25:52 2021] GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7 => generated 1407 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 17 03:25:53.018011 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-e487cf5e-5ef5-444d-ac78-56de52d04761 tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:25:53.018634 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-e487cf5e-5ef5-444d-ac78-56de52d04761 tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] [instance: 61d387ba-e928-4e5f-a79c-4f757643903c] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:25:53.025090 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-e487cf5e-5ef5-444d-ac78-56de52d04761 tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:25:53.025526 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-e487cf5e-5ef5-444d-ac78-56de52d04761 tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:25:53.026328 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-e487cf5e-5ef5-444d-ac78-56de52d04761 tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:25:53.026848 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-e487cf5e-5ef5-444d-ac78-56de52d04761 tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:25:53.034063 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-ca698b67-6fef-4f20-859f-fe7838718535 tempest-DeleteServersTestJSON-1805612840 tempest-DeleteServersTestJSON-1805612840-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:25:53.034903 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-ca698b67-6fef-4f20-859f-fe7838718535 tempest-DeleteServersTestJSON-1805612840 tempest-DeleteServersTestJSON-1805612840-project] [instance: eaeb6520-bd1e-495e-9ada-744682cbc122] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:25:53.041122 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-ca698b67-6fef-4f20-859f-fe7838718535 tempest-DeleteServersTestJSON-1805612840 tempest-DeleteServersTestJSON-1805612840-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:25:53.041560 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-ca698b67-6fef-4f20-859f-fe7838718535 tempest-DeleteServersTestJSON-1805612840 tempest-DeleteServersTestJSON-1805612840-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:25:53.042332 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-ca698b67-6fef-4f20-859f-fe7838718535 tempest-DeleteServersTestJSON-1805612840 tempest-DeleteServersTestJSON-1805612840-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:25:53.042750 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-ca698b67-6fef-4f20-859f-fe7838718535 tempest-DeleteServersTestJSON-1805612840 tempest-DeleteServersTestJSON-1805612840-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:25:53.175020 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-e487cf5e-5ef5-444d-ac78-56de52d04761 tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d4e8ac9538f42c9b637bd9e086668b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfc480343d4d493bb4295b055e274df5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:25:53.185324 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-e487cf5e-5ef5-444d-ac78-56de52d04761 tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] 10.222.0.11 "GET /compute/v2.1/servers/61d387ba-e928-4e5f-a79c-4f757643903c" status: 200 len: 1318 microversion: 2.1 time: 0.170421 Nov 17 03:25:53.189757 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-ca698b67-6fef-4f20-859f-fe7838718535 tempest-DeleteServersTestJSON-1805612840 tempest-DeleteServersTestJSON-1805612840-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65322b3497864a64870eadab1ff7d490', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37560cd5b14f43cd85ee2a3ff2716c33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:25:53.195398 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 98/181] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:25:53 2021] GET /compute/v2.1/servers/61d387ba-e928-4e5f-a79c-4f757643903c => generated 1318 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:25:53.198013 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-ca698b67-6fef-4f20-859f-fe7838718535 tempest-DeleteServersTestJSON-1805612840 tempest-DeleteServersTestJSON-1805612840-project] 10.222.0.11 "GET /compute/v2.1/servers/eaeb6520-bd1e-495e-9ada-744682cbc122" status: 200 len: 1315 microversion: 2.1 time: 0.168410 Nov 17 03:25:53.198748 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 84/182] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:25:53 2021] GET /compute/v2.1/servers/eaeb6520-bd1e-495e-9ada-744682cbc122 => generated 1315 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:25:53.214477 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-ce91297e-8692-46ce-8497-f83092107f43 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:25:53.215208 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-ce91297e-8692-46ce-8497-f83092107f43 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] [instance: 6dc785d7-bc95-4fee-8206-c2fd3b930e4f] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:25:53.221190 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-ce91297e-8692-46ce-8497-f83092107f43 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:25:53.221703 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-ce91297e-8692-46ce-8497-f83092107f43 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:25:53.222528 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-ce91297e-8692-46ce-8497-f83092107f43 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:25:53.223024 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-ce91297e-8692-46ce-8497-f83092107f43 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:25:53.345427 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-3569cb8b-5e28-4cfa-a1dc-17dab79d317d tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:25:53.346001 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-3569cb8b-5e28-4cfa-a1dc-17dab79d317d tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] [instance: 5d54db85-b991-4890-abaa-952413baa2e7] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:25:53.353441 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-3569cb8b-5e28-4cfa-a1dc-17dab79d317d tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:25:53.353991 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-3569cb8b-5e28-4cfa-a1dc-17dab79d317d tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:25:53.354790 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-3569cb8b-5e28-4cfa-a1dc-17dab79d317d tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:25:53.355211 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-3569cb8b-5e28-4cfa-a1dc-17dab79d317d tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:25:53.364742 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-ce91297e-8692-46ce-8497-f83092107f43 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f046401c6a04f6495ebe0821120bd72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a58e89ceeea4a9c8a72a1de4bcaf2d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:25:53.372927 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-ce91297e-8692-46ce-8497-f83092107f43 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] 10.222.0.11 "GET /compute/v2.1/servers/6dc785d7-bc95-4fee-8206-c2fd3b930e4f" status: 200 len: 1321 microversion: 2.1 time: 0.161889 Nov 17 03:25:53.373886 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 99/183] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:25:53 2021] GET /compute/v2.1/servers/6dc785d7-bc95-4fee-8206-c2fd3b930e4f => generated 1321 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 17 03:25:53.493299 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-3569cb8b-5e28-4cfa-a1dc-17dab79d317d tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37f21d6d15cf40a586edda211219fd08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ebb970305844dccacf48a7d8d47ecf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:25:53.501759 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-3569cb8b-5e28-4cfa-a1dc-17dab79d317d tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '37f21d6d15cf40a586edda211219fd08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ebb970305844dccacf48a7d8d47ecf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:25:53.503281 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-3569cb8b-5e28-4cfa-a1dc-17dab79d317d tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '37f21d6d15cf40a586edda211219fd08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ebb970305844dccacf48a7d8d47ecf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:25:53.504396 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-3569cb8b-5e28-4cfa-a1dc-17dab79d317d tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] 10.222.0.11 "GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7" status: 200 len: 1407 microversion: 2.20 time: 0.163249 Nov 17 03:25:53.504987 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 85/184] 10.222.0.11 () {60 vars in 1276 bytes} [Wed Nov 17 03:25:53 2021] GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7 => generated 1407 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 17 03:25:53.781387 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [req-7a2e1b17-0694-4906-9db9-0f1a02594ed9 req-e91c5cfd-5164-4475-bad0-6c3882ff90f1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "eaeb6520-bd1e-495e-9ada-744682cbc122", "name": "network-vif-plugged", "status": "completed", "tag": "62a0417d-dfab-44cc-97c9-23c9da049bdf"}]} {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 17 03:25:53.783505 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 17 03:25:53.783505 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: warnings.warn(msg) Nov 17 03:25:53.791426 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [req-7a2e1b17-0694-4906-9db9-0f1a02594ed9 req-e91c5cfd-5164-4475-bad0-6c3882ff90f1 service nova] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:25:53.792101 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [req-7a2e1b17-0694-4906-9db9-0f1a02594ed9 req-e91c5cfd-5164-4475-bad0-6c3882ff90f1 service nova] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:25:53.806525 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.compute.server_external_events [req-7a2e1b17-0694-4906-9db9-0f1a02594ed9 req-e91c5cfd-5164-4475-bad0-6c3882ff90f1 service nova] Creating event network-vif-plugged:62a0417d-dfab-44cc-97c9-23c9da049bdf for instance eaeb6520-bd1e-495e-9ada-744682cbc122 on hv-cinder-81803 Nov 17 03:25:53.812692 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [req-7a2e1b17-0694-4906-9db9-0f1a02594ed9 req-e91c5cfd-5164-4475-bad0-6c3882ff90f1 service nova] 10.222.0.11 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.136745 Nov 17 03:25:53.813584 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 100/185] 10.222.0.11 () {64 vars in 1317 bytes} [Wed Nov 17 03:25:53 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 17 03:25:54.204474 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-b0bc7d7d-24c2-46fd-906a-8214da79c16f tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:25:54.205823 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-b0bc7d7d-24c2-46fd-906a-8214da79c16f tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] [instance: 61d387ba-e928-4e5f-a79c-4f757643903c] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:25:54.215557 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-1cdabac1-2229-4571-8f0d-01cd7c1dbb15 tempest-DeleteServersTestJSON-1805612840 tempest-DeleteServersTestJSON-1805612840-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:25:54.216472 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-1cdabac1-2229-4571-8f0d-01cd7c1dbb15 tempest-DeleteServersTestJSON-1805612840 tempest-DeleteServersTestJSON-1805612840-project] [instance: eaeb6520-bd1e-495e-9ada-744682cbc122] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:25:54.221906 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-b0bc7d7d-24c2-46fd-906a-8214da79c16f tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:25:54.223698 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-b0bc7d7d-24c2-46fd-906a-8214da79c16f tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:25:54.225877 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-b0bc7d7d-24c2-46fd-906a-8214da79c16f tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:25:54.227916 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-b0bc7d7d-24c2-46fd-906a-8214da79c16f tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:25:54.232915 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-1cdabac1-2229-4571-8f0d-01cd7c1dbb15 tempest-DeleteServersTestJSON-1805612840 tempest-DeleteServersTestJSON-1805612840-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:25:54.233449 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-1cdabac1-2229-4571-8f0d-01cd7c1dbb15 tempest-DeleteServersTestJSON-1805612840 tempest-DeleteServersTestJSON-1805612840-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:25:54.234240 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-1cdabac1-2229-4571-8f0d-01cd7c1dbb15 tempest-DeleteServersTestJSON-1805612840 tempest-DeleteServersTestJSON-1805612840-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:25:54.234850 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-1cdabac1-2229-4571-8f0d-01cd7c1dbb15 tempest-DeleteServersTestJSON-1805612840 tempest-DeleteServersTestJSON-1805612840-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:25:54.444717 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-b0bc7d7d-24c2-46fd-906a-8214da79c16f tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d4e8ac9538f42c9b637bd9e086668b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfc480343d4d493bb4295b055e274df5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:25:54.454768 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-b0bc7d7d-24c2-46fd-906a-8214da79c16f tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] 10.222.0.11 "GET /compute/v2.1/servers/61d387ba-e928-4e5f-a79c-4f757643903c" status: 200 len: 1318 microversion: 2.1 time: 0.255637 Nov 17 03:25:54.456190 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 86/186] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:25:54 2021] GET /compute/v2.1/servers/61d387ba-e928-4e5f-a79c-4f757643903c => generated 1318 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:25:54.474390 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-0afb84dc-5203-4b1b-a350-489bfb937eb9 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:25:54.475024 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-0afb84dc-5203-4b1b-a350-489bfb937eb9 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] [instance: 6dc785d7-bc95-4fee-8206-c2fd3b930e4f] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:25:54.485256 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-0afb84dc-5203-4b1b-a350-489bfb937eb9 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:25:54.485962 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-0afb84dc-5203-4b1b-a350-489bfb937eb9 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:25:54.489267 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-0afb84dc-5203-4b1b-a350-489bfb937eb9 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:25:54.489751 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-0afb84dc-5203-4b1b-a350-489bfb937eb9 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:25:54.535458 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-1cdabac1-2229-4571-8f0d-01cd7c1dbb15 tempest-DeleteServersTestJSON-1805612840 tempest-DeleteServersTestJSON-1805612840-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65322b3497864a64870eadab1ff7d490', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37560cd5b14f43cd85ee2a3ff2716c33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:25:54.547233 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-1cdabac1-2229-4571-8f0d-01cd7c1dbb15 tempest-DeleteServersTestJSON-1805612840 tempest-DeleteServersTestJSON-1805612840-project] 10.222.0.11 "GET /compute/v2.1/servers/eaeb6520-bd1e-495e-9ada-744682cbc122" status: 200 len: 1315 microversion: 2.1 time: 0.335695 Nov 17 03:25:54.547817 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 101/187] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:25:54 2021] GET /compute/v2.1/servers/eaeb6520-bd1e-495e-9ada-744682cbc122 => generated 1315 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 17 03:25:54.558038 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-f99ac5b0-0632-420a-a730-1471dbfefec1 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:25:54.558641 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-f99ac5b0-0632-420a-a730-1471dbfefec1 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] [instance: 5d54db85-b991-4890-abaa-952413baa2e7] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:25:54.575104 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-f99ac5b0-0632-420a-a730-1471dbfefec1 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:25:54.576033 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-f99ac5b0-0632-420a-a730-1471dbfefec1 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:25:54.576873 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-f99ac5b0-0632-420a-a730-1471dbfefec1 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:25:54.578058 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-f99ac5b0-0632-420a-a730-1471dbfefec1 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:25:54.658189 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-0afb84dc-5203-4b1b-a350-489bfb937eb9 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f046401c6a04f6495ebe0821120bd72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a58e89ceeea4a9c8a72a1de4bcaf2d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:25:54.666138 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-0afb84dc-5203-4b1b-a350-489bfb937eb9 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] 10.222.0.11 "GET /compute/v2.1/servers/6dc785d7-bc95-4fee-8206-c2fd3b930e4f" status: 200 len: 1321 microversion: 2.1 time: 0.208165 Nov 17 03:25:54.666924 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 87/188] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:25:54 2021] GET /compute/v2.1/servers/6dc785d7-bc95-4fee-8206-c2fd3b930e4f => generated 1321 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:25:54.724203 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-f99ac5b0-0632-420a-a730-1471dbfefec1 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37f21d6d15cf40a586edda211219fd08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ebb970305844dccacf48a7d8d47ecf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:25:54.732911 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-f99ac5b0-0632-420a-a730-1471dbfefec1 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '37f21d6d15cf40a586edda211219fd08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ebb970305844dccacf48a7d8d47ecf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:25:54.734407 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-f99ac5b0-0632-420a-a730-1471dbfefec1 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '37f21d6d15cf40a586edda211219fd08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ebb970305844dccacf48a7d8d47ecf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:25:54.735553 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-f99ac5b0-0632-420a-a730-1471dbfefec1 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] 10.222.0.11 "GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7" status: 200 len: 1407 microversion: 2.20 time: 0.186823 Nov 17 03:25:54.736121 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 102/189] 10.222.0.11 () {60 vars in 1276 bytes} [Wed Nov 17 03:25:54 2021] GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7 => generated 1407 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 17 03:25:55.525856 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-1049c6ce-ee0c-436b-a34f-f67648f8a2f8 tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:25:55.526551 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-1049c6ce-ee0c-436b-a34f-f67648f8a2f8 tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] [instance: 61d387ba-e928-4e5f-a79c-4f757643903c] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:25:55.533582 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-1049c6ce-ee0c-436b-a34f-f67648f8a2f8 tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:25:55.534120 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-1049c6ce-ee0c-436b-a34f-f67648f8a2f8 tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:25:55.535057 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-1049c6ce-ee0c-436b-a34f-f67648f8a2f8 tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:25:55.535556 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-1049c6ce-ee0c-436b-a34f-f67648f8a2f8 tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:25:55.564249 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-7f52e68a-5d12-4d25-848f-993d9ec13a5f tempest-DeleteServersTestJSON-1805612840 tempest-DeleteServersTestJSON-1805612840-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:25:55.565721 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-7f52e68a-5d12-4d25-848f-993d9ec13a5f tempest-DeleteServersTestJSON-1805612840 tempest-DeleteServersTestJSON-1805612840-project] [instance: eaeb6520-bd1e-495e-9ada-744682cbc122] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:25:55.572621 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-7f52e68a-5d12-4d25-848f-993d9ec13a5f tempest-DeleteServersTestJSON-1805612840 tempest-DeleteServersTestJSON-1805612840-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:25:55.573182 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-7f52e68a-5d12-4d25-848f-993d9ec13a5f tempest-DeleteServersTestJSON-1805612840 tempest-DeleteServersTestJSON-1805612840-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:25:55.574035 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-7f52e68a-5d12-4d25-848f-993d9ec13a5f tempest-DeleteServersTestJSON-1805612840 tempest-DeleteServersTestJSON-1805612840-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:25:55.574537 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-7f52e68a-5d12-4d25-848f-993d9ec13a5f tempest-DeleteServersTestJSON-1805612840 tempest-DeleteServersTestJSON-1805612840-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:25:55.685424 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-1049c6ce-ee0c-436b-a34f-f67648f8a2f8 tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d4e8ac9538f42c9b637bd9e086668b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfc480343d4d493bb4295b055e274df5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:25:55.692721 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-1049c6ce-ee0c-436b-a34f-f67648f8a2f8 tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] 10.222.0.11 "GET /compute/v2.1/servers/61d387ba-e928-4e5f-a79c-4f757643903c" status: 200 len: 1318 microversion: 2.1 time: 0.170566 Nov 17 03:25:55.693291 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 88/190] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:25:55 2021] GET /compute/v2.1/servers/61d387ba-e928-4e5f-a79c-4f757643903c => generated 1318 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:25:55.697863 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-74ab4968-76fd-4d1e-94a9-ccb5f0cd4628 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:25:55.698425 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-74ab4968-76fd-4d1e-94a9-ccb5f0cd4628 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] [instance: 6dc785d7-bc95-4fee-8206-c2fd3b930e4f] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:25:55.704018 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-74ab4968-76fd-4d1e-94a9-ccb5f0cd4628 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:25:55.704465 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-74ab4968-76fd-4d1e-94a9-ccb5f0cd4628 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:25:55.705261 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-74ab4968-76fd-4d1e-94a9-ccb5f0cd4628 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:25:55.705718 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-74ab4968-76fd-4d1e-94a9-ccb5f0cd4628 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:25:55.713002 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-7f52e68a-5d12-4d25-848f-993d9ec13a5f tempest-DeleteServersTestJSON-1805612840 tempest-DeleteServersTestJSON-1805612840-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65322b3497864a64870eadab1ff7d490', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37560cd5b14f43cd85ee2a3ff2716c33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:25:55.720175 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-7f52e68a-5d12-4d25-848f-993d9ec13a5f tempest-DeleteServersTestJSON-1805612840 tempest-DeleteServersTestJSON-1805612840-project] 10.222.0.11 "GET /compute/v2.1/servers/eaeb6520-bd1e-495e-9ada-744682cbc122" status: 200 len: 1315 microversion: 2.1 time: 0.159924 Nov 17 03:25:55.720949 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 103/191] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:25:55 2021] GET /compute/v2.1/servers/eaeb6520-bd1e-495e-9ada-744682cbc122 => generated 1315 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:25:55.753751 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-adf8b6f5-da39-4fb2-9f83-496e61829eed tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:25:55.754486 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-adf8b6f5-da39-4fb2-9f83-496e61829eed tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] [instance: 5d54db85-b991-4890-abaa-952413baa2e7] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:25:55.761306 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-adf8b6f5-da39-4fb2-9f83-496e61829eed tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:25:55.761741 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-adf8b6f5-da39-4fb2-9f83-496e61829eed tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:25:55.762522 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-adf8b6f5-da39-4fb2-9f83-496e61829eed tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:25:55.762942 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-adf8b6f5-da39-4fb2-9f83-496e61829eed tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:25:55.839457 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-74ab4968-76fd-4d1e-94a9-ccb5f0cd4628 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f046401c6a04f6495ebe0821120bd72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a58e89ceeea4a9c8a72a1de4bcaf2d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:25:55.847090 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-74ab4968-76fd-4d1e-94a9-ccb5f0cd4628 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] 10.222.0.11 "GET /compute/v2.1/servers/6dc785d7-bc95-4fee-8206-c2fd3b930e4f" status: 200 len: 1321 microversion: 2.1 time: 0.152668 Nov 17 03:25:55.847649 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 89/192] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:25:55 2021] GET /compute/v2.1/servers/6dc785d7-bc95-4fee-8206-c2fd3b930e4f => generated 1321 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:25:55.852107 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [req-5521b567-0599-40d1-9044-7dcf28e7e505 req-a58df635-3f2a-44aa-a988-03793a23792d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a49437df-3059-4528-8328-2f3471d5fb45", "name": "network-vif-plugged", "status": "completed", "tag": "f5a50f15-2a7b-434f-8c53-dafbe11047db"}, {"server_uuid": "61d387ba-e928-4e5f-a79c-4f757643903c", "name": "network-vif-plugged", "status": "completed", "tag": "32f6ed0a-f65a-4a5d-8a00-f2d1292ed32c"}]} {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 17 03:25:55.853803 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 17 03:25:55.853803 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: warnings.warn(msg) Nov 17 03:25:55.861905 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [req-5521b567-0599-40d1-9044-7dcf28e7e505 req-a58df635-3f2a-44aa-a988-03793a23792d service nova] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:25:55.862336 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [req-5521b567-0599-40d1-9044-7dcf28e7e505 req-a58df635-3f2a-44aa-a988-03793a23792d service nova] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:25:55.875151 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.compute.server_external_events [req-5521b567-0599-40d1-9044-7dcf28e7e505 req-a58df635-3f2a-44aa-a988-03793a23792d service nova] Creating event network-vif-plugged:f5a50f15-2a7b-434f-8c53-dafbe11047db for instance a49437df-3059-4528-8328-2f3471d5fb45 on hv-cinder-81803 Nov 17 03:25:55.875652 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.compute.server_external_events [req-5521b567-0599-40d1-9044-7dcf28e7e505 req-a58df635-3f2a-44aa-a988-03793a23792d service nova] Creating event network-vif-plugged:32f6ed0a-f65a-4a5d-8a00-f2d1292ed32c for instance 61d387ba-e928-4e5f-a79c-4f757643903c on hv-cinder-81803 Nov 17 03:25:55.882306 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [req-5521b567-0599-40d1-9044-7dcf28e7e505 req-a58df635-3f2a-44aa-a988-03793a23792d service nova] 10.222.0.11 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.033407 Nov 17 03:25:55.882979 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 90/193] 10.222.0.11 () {64 vars in 1317 bytes} [Wed Nov 17 03:25:55 2021] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 17 03:25:55.899592 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-adf8b6f5-da39-4fb2-9f83-496e61829eed tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37f21d6d15cf40a586edda211219fd08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ebb970305844dccacf48a7d8d47ecf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:25:55.907831 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-adf8b6f5-da39-4fb2-9f83-496e61829eed tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '37f21d6d15cf40a586edda211219fd08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ebb970305844dccacf48a7d8d47ecf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:25:55.909335 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-adf8b6f5-da39-4fb2-9f83-496e61829eed tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '37f21d6d15cf40a586edda211219fd08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ebb970305844dccacf48a7d8d47ecf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:25:55.910465 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-adf8b6f5-da39-4fb2-9f83-496e61829eed tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] 10.222.0.11 "GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7" status: 200 len: 1407 microversion: 2.20 time: 0.160501 Nov 17 03:25:55.911026 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 104/194] 10.222.0.11 () {60 vars in 1276 bytes} [Wed Nov 17 03:25:55 2021] GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7 => generated 1407 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 17 03:25:56.712251 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-c9b625bf-76d8-46c1-852a-8fd92f818750 tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:25:56.713037 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-c9b625bf-76d8-46c1-852a-8fd92f818750 tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] [instance: 61d387ba-e928-4e5f-a79c-4f757643903c] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:25:56.720802 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-c9b625bf-76d8-46c1-852a-8fd92f818750 tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:25:56.721252 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-c9b625bf-76d8-46c1-852a-8fd92f818750 tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:25:56.722010 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-c9b625bf-76d8-46c1-852a-8fd92f818750 tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:25:56.722431 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-c9b625bf-76d8-46c1-852a-8fd92f818750 tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:25:56.777830 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-24e78da1-ec20-4bc3-b2ea-453402db6214 tempest-DeleteServersTestJSON-1805612840 tempest-DeleteServersTestJSON-1805612840-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:25:56.778428 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-24e78da1-ec20-4bc3-b2ea-453402db6214 tempest-DeleteServersTestJSON-1805612840 tempest-DeleteServersTestJSON-1805612840-project] [instance: eaeb6520-bd1e-495e-9ada-744682cbc122] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:25:56.784516 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-24e78da1-ec20-4bc3-b2ea-453402db6214 tempest-DeleteServersTestJSON-1805612840 tempest-DeleteServersTestJSON-1805612840-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:25:56.784990 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-24e78da1-ec20-4bc3-b2ea-453402db6214 tempest-DeleteServersTestJSON-1805612840 tempest-DeleteServersTestJSON-1805612840-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:25:56.785749 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-24e78da1-ec20-4bc3-b2ea-453402db6214 tempest-DeleteServersTestJSON-1805612840 tempest-DeleteServersTestJSON-1805612840-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:25:56.786169 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-24e78da1-ec20-4bc3-b2ea-453402db6214 tempest-DeleteServersTestJSON-1805612840 tempest-DeleteServersTestJSON-1805612840-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:25:56.861514 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-c9b625bf-76d8-46c1-852a-8fd92f818750 tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d4e8ac9538f42c9b637bd9e086668b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfc480343d4d493bb4295b055e274df5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:25:56.869082 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-c9b625bf-76d8-46c1-852a-8fd92f818750 tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] 10.222.0.11 "GET /compute/v2.1/servers/61d387ba-e928-4e5f-a79c-4f757643903c" status: 200 len: 1318 microversion: 2.1 time: 0.161695 Nov 17 03:25:56.869626 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 91/195] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:25:56 2021] GET /compute/v2.1/servers/61d387ba-e928-4e5f-a79c-4f757643903c => generated 1318 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:25:56.874112 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-1d9e49b9-6a7c-45bc-87b3-8750be88d03d tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:25:56.874701 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-1d9e49b9-6a7c-45bc-87b3-8750be88d03d tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] [instance: 6dc785d7-bc95-4fee-8206-c2fd3b930e4f] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:25:56.880832 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-1d9e49b9-6a7c-45bc-87b3-8750be88d03d tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:25:56.881310 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-1d9e49b9-6a7c-45bc-87b3-8750be88d03d tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:25:56.882113 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-1d9e49b9-6a7c-45bc-87b3-8750be88d03d tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:25:56.882544 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-1d9e49b9-6a7c-45bc-87b3-8750be88d03d tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:25:56.920520 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-24e78da1-ec20-4bc3-b2ea-453402db6214 tempest-DeleteServersTestJSON-1805612840 tempest-DeleteServersTestJSON-1805612840-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65322b3497864a64870eadab1ff7d490', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37560cd5b14f43cd85ee2a3ff2716c33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:25:56.928932 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-24e78da1-ec20-4bc3-b2ea-453402db6214 tempest-DeleteServersTestJSON-1805612840 tempest-DeleteServersTestJSON-1805612840-project] 10.222.0.11 "GET /compute/v2.1/servers/eaeb6520-bd1e-495e-9ada-744682cbc122" status: 200 len: 1315 microversion: 2.1 time: 0.154694 Nov 17 03:25:56.929517 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 105/196] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:25:56 2021] GET /compute/v2.1/servers/eaeb6520-bd1e-495e-9ada-744682cbc122 => generated 1315 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 17 03:25:56.934268 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-42a549d1-7554-4782-8c74-0b1d8ac0f082 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:25:56.934860 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-42a549d1-7554-4782-8c74-0b1d8ac0f082 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] [instance: 5d54db85-b991-4890-abaa-952413baa2e7] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:25:56.940690 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-42a549d1-7554-4782-8c74-0b1d8ac0f082 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:25:56.941163 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-42a549d1-7554-4782-8c74-0b1d8ac0f082 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:25:56.941927 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-42a549d1-7554-4782-8c74-0b1d8ac0f082 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:25:56.942358 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-42a549d1-7554-4782-8c74-0b1d8ac0f082 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:25:57.011122 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-1d9e49b9-6a7c-45bc-87b3-8750be88d03d tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f046401c6a04f6495ebe0821120bd72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a58e89ceeea4a9c8a72a1de4bcaf2d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:25:57.022900 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-1d9e49b9-6a7c-45bc-87b3-8750be88d03d tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] 10.222.0.11 "GET /compute/v2.1/servers/6dc785d7-bc95-4fee-8206-c2fd3b930e4f" status: 200 len: 1321 microversion: 2.1 time: 0.152258 Nov 17 03:25:57.023562 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 92/197] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:25:56 2021] GET /compute/v2.1/servers/6dc785d7-bc95-4fee-8206-c2fd3b930e4f => generated 1321 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:25:57.073920 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-42a549d1-7554-4782-8c74-0b1d8ac0f082 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37f21d6d15cf40a586edda211219fd08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ebb970305844dccacf48a7d8d47ecf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:25:57.082195 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-42a549d1-7554-4782-8c74-0b1d8ac0f082 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '37f21d6d15cf40a586edda211219fd08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ebb970305844dccacf48a7d8d47ecf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:25:57.083669 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-42a549d1-7554-4782-8c74-0b1d8ac0f082 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '37f21d6d15cf40a586edda211219fd08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ebb970305844dccacf48a7d8d47ecf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:25:57.084745 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-42a549d1-7554-4782-8c74-0b1d8ac0f082 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] 10.222.0.11 "GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7" status: 200 len: 1407 microversion: 2.20 time: 0.154326 Nov 17 03:25:57.085352 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 106/198] 10.222.0.11 () {60 vars in 1276 bytes} [Wed Nov 17 03:25:56 2021] GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7 => generated 1407 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 17 03:25:57.886658 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-921178f6-4662-4b0f-8a5f-0310e24bdca3 tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:25:57.887236 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-921178f6-4662-4b0f-8a5f-0310e24bdca3 tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] [instance: 61d387ba-e928-4e5f-a79c-4f757643903c] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:25:57.893757 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-921178f6-4662-4b0f-8a5f-0310e24bdca3 tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:25:57.894199 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-921178f6-4662-4b0f-8a5f-0310e24bdca3 tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:25:57.894970 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-921178f6-4662-4b0f-8a5f-0310e24bdca3 tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:25:57.895437 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-921178f6-4662-4b0f-8a5f-0310e24bdca3 tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:25:57.945934 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-6a57b4b5-279d-4e63-b300-4c014ed62b90 tempest-DeleteServersTestJSON-1805612840 tempest-DeleteServersTestJSON-1805612840-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:25:57.946489 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-6a57b4b5-279d-4e63-b300-4c014ed62b90 tempest-DeleteServersTestJSON-1805612840 tempest-DeleteServersTestJSON-1805612840-project] [instance: eaeb6520-bd1e-495e-9ada-744682cbc122] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:25:57.953274 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-6a57b4b5-279d-4e63-b300-4c014ed62b90 tempest-DeleteServersTestJSON-1805612840 tempest-DeleteServersTestJSON-1805612840-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:25:57.953715 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-6a57b4b5-279d-4e63-b300-4c014ed62b90 tempest-DeleteServersTestJSON-1805612840 tempest-DeleteServersTestJSON-1805612840-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:25:57.954668 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-6a57b4b5-279d-4e63-b300-4c014ed62b90 tempest-DeleteServersTestJSON-1805612840 tempest-DeleteServersTestJSON-1805612840-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:25:57.955306 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-6a57b4b5-279d-4e63-b300-4c014ed62b90 tempest-DeleteServersTestJSON-1805612840 tempest-DeleteServersTestJSON-1805612840-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:25:58.045742 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-921178f6-4662-4b0f-8a5f-0310e24bdca3 tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d4e8ac9538f42c9b637bd9e086668b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfc480343d4d493bb4295b055e274df5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:25:58.054894 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-921178f6-4662-4b0f-8a5f-0310e24bdca3 tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] 10.222.0.11 "GET /compute/v2.1/servers/61d387ba-e928-4e5f-a79c-4f757643903c" status: 200 len: 1318 microversion: 2.1 time: 0.171927 Nov 17 03:25:58.057934 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 93/199] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:25:57 2021] GET /compute/v2.1/servers/61d387ba-e928-4e5f-a79c-4f757643903c => generated 1318 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:25:58.070343 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-4344f105-bbcb-4b96-b476-2bd6515f0fbc tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:25:58.078015 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-4344f105-bbcb-4b96-b476-2bd6515f0fbc tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] [instance: 6dc785d7-bc95-4fee-8206-c2fd3b930e4f] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:25:58.084471 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-4344f105-bbcb-4b96-b476-2bd6515f0fbc tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:25:58.085175 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-4344f105-bbcb-4b96-b476-2bd6515f0fbc tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:25:58.086162 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-4344f105-bbcb-4b96-b476-2bd6515f0fbc tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:25:58.086745 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-4344f105-bbcb-4b96-b476-2bd6515f0fbc tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:25:58.174353 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-6a57b4b5-279d-4e63-b300-4c014ed62b90 tempest-DeleteServersTestJSON-1805612840 tempest-DeleteServersTestJSON-1805612840-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65322b3497864a64870eadab1ff7d490', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37560cd5b14f43cd85ee2a3ff2716c33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:25:58.184622 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-6a57b4b5-279d-4e63-b300-4c014ed62b90 tempest-DeleteServersTestJSON-1805612840 tempest-DeleteServersTestJSON-1805612840-project] 10.222.0.11 "GET /compute/v2.1/servers/eaeb6520-bd1e-495e-9ada-744682cbc122" status: 200 len: 1315 microversion: 2.1 time: 0.241175 Nov 17 03:25:58.195383 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 107/200] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:25:57 2021] GET /compute/v2.1/servers/eaeb6520-bd1e-495e-9ada-744682cbc122 => generated 1315 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:25:58.206251 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-fcec6806-7e35-441f-b43b-719294f88e56 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:25:58.209941 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-fcec6806-7e35-441f-b43b-719294f88e56 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] [instance: 5d54db85-b991-4890-abaa-952413baa2e7] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:25:58.219364 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-fcec6806-7e35-441f-b43b-719294f88e56 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:25:58.220052 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-fcec6806-7e35-441f-b43b-719294f88e56 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:25:58.221119 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-fcec6806-7e35-441f-b43b-719294f88e56 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:25:58.221557 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-fcec6806-7e35-441f-b43b-719294f88e56 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:25:58.304708 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-4344f105-bbcb-4b96-b476-2bd6515f0fbc tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f046401c6a04f6495ebe0821120bd72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a58e89ceeea4a9c8a72a1de4bcaf2d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:25:58.313982 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-4344f105-bbcb-4b96-b476-2bd6515f0fbc tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] 10.222.0.11 "GET /compute/v2.1/servers/6dc785d7-bc95-4fee-8206-c2fd3b930e4f" status: 200 len: 1321 microversion: 2.1 time: 0.255061 Nov 17 03:25:58.314591 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 94/201] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:25:58 2021] GET /compute/v2.1/servers/6dc785d7-bc95-4fee-8206-c2fd3b930e4f => generated 1321 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:25:58.319097 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [req-bafb5d97-ea64-44c8-bc08-03669f9a9feb req-54bbc221-fc8d-42a8-8301-cc93ab4c3cec service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5d54db85-b991-4890-abaa-952413baa2e7", "name": "network-vif-plugged", "status": "completed", "tag": "51f39c10-57ce-4106-ab58-635a3319ff11"}]} {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 17 03:25:58.320629 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 17 03:25:58.320629 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: warnings.warn(msg) Nov 17 03:25:58.328720 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [req-bafb5d97-ea64-44c8-bc08-03669f9a9feb req-54bbc221-fc8d-42a8-8301-cc93ab4c3cec service nova] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:25:58.329216 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [req-bafb5d97-ea64-44c8-bc08-03669f9a9feb req-54bbc221-fc8d-42a8-8301-cc93ab4c3cec service nova] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:25:58.341224 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.compute.server_external_events [req-bafb5d97-ea64-44c8-bc08-03669f9a9feb req-54bbc221-fc8d-42a8-8301-cc93ab4c3cec service nova] Creating event network-vif-plugged:51f39c10-57ce-4106-ab58-635a3319ff11 for instance 5d54db85-b991-4890-abaa-952413baa2e7 on hv-cinder-81803 Nov 17 03:25:58.347371 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [req-bafb5d97-ea64-44c8-bc08-03669f9a9feb req-54bbc221-fc8d-42a8-8301-cc93ab4c3cec service nova] 10.222.0.11 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031621 Nov 17 03:25:58.347973 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 95/202] 10.222.0.11 () {64 vars in 1317 bytes} [Wed Nov 17 03:25:58 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 17 03:25:58.481518 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-fcec6806-7e35-441f-b43b-719294f88e56 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37f21d6d15cf40a586edda211219fd08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ebb970305844dccacf48a7d8d47ecf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:25:58.489982 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-fcec6806-7e35-441f-b43b-719294f88e56 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '37f21d6d15cf40a586edda211219fd08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ebb970305844dccacf48a7d8d47ecf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:25:58.491484 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-fcec6806-7e35-441f-b43b-719294f88e56 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '37f21d6d15cf40a586edda211219fd08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ebb970305844dccacf48a7d8d47ecf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:25:58.492571 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-fcec6806-7e35-441f-b43b-719294f88e56 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] 10.222.0.11 "GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7" status: 200 len: 1407 microversion: 2.20 time: 0.295669 Nov 17 03:25:58.493168 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 108/203] 10.222.0.11 () {60 vars in 1276 bytes} [Wed Nov 17 03:25:58 2021] GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7 => generated 1407 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 17 03:25:59.074430 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-c4deb6ef-1175-4002-bb5e-1361521267d8 tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:25:59.075117 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-c4deb6ef-1175-4002-bb5e-1361521267d8 tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] [instance: 61d387ba-e928-4e5f-a79c-4f757643903c] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:25:59.081596 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-c4deb6ef-1175-4002-bb5e-1361521267d8 tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:25:59.082045 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-c4deb6ef-1175-4002-bb5e-1361521267d8 tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:25:59.082804 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-c4deb6ef-1175-4002-bb5e-1361521267d8 tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:25:59.083227 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-c4deb6ef-1175-4002-bb5e-1361521267d8 tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:25:59.204309 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-68270909-f71e-4bad-98f5-ffc490e7b94a tempest-DeleteServersTestJSON-1805612840 tempest-DeleteServersTestJSON-1805612840-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:25:59.205876 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-68270909-f71e-4bad-98f5-ffc490e7b94a tempest-DeleteServersTestJSON-1805612840 tempest-DeleteServersTestJSON-1805612840-project] [instance: eaeb6520-bd1e-495e-9ada-744682cbc122] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:25:59.221270 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-c4deb6ef-1175-4002-bb5e-1361521267d8 tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d4e8ac9538f42c9b637bd9e086668b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfc480343d4d493bb4295b055e274df5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:25:59.221916 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-68270909-f71e-4bad-98f5-ffc490e7b94a tempest-DeleteServersTestJSON-1805612840 tempest-DeleteServersTestJSON-1805612840-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:25:59.222362 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-68270909-f71e-4bad-98f5-ffc490e7b94a tempest-DeleteServersTestJSON-1805612840 tempest-DeleteServersTestJSON-1805612840-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:25:59.223168 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-68270909-f71e-4bad-98f5-ffc490e7b94a tempest-DeleteServersTestJSON-1805612840 tempest-DeleteServersTestJSON-1805612840-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:25:59.223597 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-68270909-f71e-4bad-98f5-ffc490e7b94a tempest-DeleteServersTestJSON-1805612840 tempest-DeleteServersTestJSON-1805612840-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:25:59.228574 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-c4deb6ef-1175-4002-bb5e-1361521267d8 tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] 10.222.0.11 "GET /compute/v2.1/servers/61d387ba-e928-4e5f-a79c-4f757643903c" status: 200 len: 1318 microversion: 2.1 time: 0.158086 Nov 17 03:25:59.233421 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 96/204] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:25:59 2021] GET /compute/v2.1/servers/61d387ba-e928-4e5f-a79c-4f757643903c => generated 1318 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:25:59.329618 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-b43acfd7-2574-42a9-8238-aa7f6eae0feb tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:25:59.330227 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-b43acfd7-2574-42a9-8238-aa7f6eae0feb tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] [instance: 6dc785d7-bc95-4fee-8206-c2fd3b930e4f] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:25:59.336326 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-b43acfd7-2574-42a9-8238-aa7f6eae0feb tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:25:59.336804 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-b43acfd7-2574-42a9-8238-aa7f6eae0feb tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:25:59.337574 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-b43acfd7-2574-42a9-8238-aa7f6eae0feb tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:25:59.338005 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-b43acfd7-2574-42a9-8238-aa7f6eae0feb tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:25:59.373162 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-68270909-f71e-4bad-98f5-ffc490e7b94a tempest-DeleteServersTestJSON-1805612840 tempest-DeleteServersTestJSON-1805612840-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65322b3497864a64870eadab1ff7d490', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37560cd5b14f43cd85ee2a3ff2716c33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:25:59.381148 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-68270909-f71e-4bad-98f5-ffc490e7b94a tempest-DeleteServersTestJSON-1805612840 tempest-DeleteServersTestJSON-1805612840-project] 10.222.0.11 "GET /compute/v2.1/servers/eaeb6520-bd1e-495e-9ada-744682cbc122" status: 200 len: 1315 microversion: 2.1 time: 0.182204 Nov 17 03:25:59.381677 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 109/205] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:25:59 2021] GET /compute/v2.1/servers/eaeb6520-bd1e-495e-9ada-744682cbc122 => generated 1315 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 17 03:25:59.471513 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-b43acfd7-2574-42a9-8238-aa7f6eae0feb tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f046401c6a04f6495ebe0821120bd72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a58e89ceeea4a9c8a72a1de4bcaf2d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:25:59.482845 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-b43acfd7-2574-42a9-8238-aa7f6eae0feb tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] 10.222.0.11 "GET /compute/v2.1/servers/6dc785d7-bc95-4fee-8206-c2fd3b930e4f" status: 200 len: 1321 microversion: 2.1 time: 0.156843 Nov 17 03:25:59.483631 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 97/206] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:25:59 2021] GET /compute/v2.1/servers/6dc785d7-bc95-4fee-8206-c2fd3b930e4f => generated 1321 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 17 03:25:59.510495 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-bec04c3f-93a7-455b-a0f0-4de1f5a1117a tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:25:59.511135 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-bec04c3f-93a7-455b-a0f0-4de1f5a1117a tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] [instance: 5d54db85-b991-4890-abaa-952413baa2e7] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:25:59.517541 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-bec04c3f-93a7-455b-a0f0-4de1f5a1117a tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:25:59.517990 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-bec04c3f-93a7-455b-a0f0-4de1f5a1117a tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:25:59.518766 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-bec04c3f-93a7-455b-a0f0-4de1f5a1117a tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:25:59.519197 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-bec04c3f-93a7-455b-a0f0-4de1f5a1117a tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:25:59.657038 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-bec04c3f-93a7-455b-a0f0-4de1f5a1117a tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37f21d6d15cf40a586edda211219fd08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ebb970305844dccacf48a7d8d47ecf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:25:59.665578 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-bec04c3f-93a7-455b-a0f0-4de1f5a1117a tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '37f21d6d15cf40a586edda211219fd08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ebb970305844dccacf48a7d8d47ecf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:25:59.667152 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-bec04c3f-93a7-455b-a0f0-4de1f5a1117a tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '37f21d6d15cf40a586edda211219fd08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ebb970305844dccacf48a7d8d47ecf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:25:59.668635 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-bec04c3f-93a7-455b-a0f0-4de1f5a1117a tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] 10.222.0.11 "GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7" status: 200 len: 1407 microversion: 2.20 time: 0.161724 Nov 17 03:25:59.669269 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 110/207] 10.222.0.11 () {60 vars in 1276 bytes} [Wed Nov 17 03:25:59 2021] GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7 => generated 1407 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 17 03:26:00.249498 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-b4e63b6c-5289-4dbd-9360-26a26f87e4e1 tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:26:00.250174 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-b4e63b6c-5289-4dbd-9360-26a26f87e4e1 tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] [instance: 61d387ba-e928-4e5f-a79c-4f757643903c] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:26:00.256412 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-b4e63b6c-5289-4dbd-9360-26a26f87e4e1 tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:26:00.256866 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-b4e63b6c-5289-4dbd-9360-26a26f87e4e1 tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:26:00.257646 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-b4e63b6c-5289-4dbd-9360-26a26f87e4e1 tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:26:00.258066 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-b4e63b6c-5289-4dbd-9360-26a26f87e4e1 tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:26:00.397465 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-b4e63b6c-5289-4dbd-9360-26a26f87e4e1 tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d4e8ac9538f42c9b637bd9e086668b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfc480343d4d493bb4295b055e274df5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:26:00.398114 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-c555bee6-5052-4138-8f4a-8e051c54255d tempest-DeleteServersTestJSON-1805612840 tempest-DeleteServersTestJSON-1805612840-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:26:00.398716 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-c555bee6-5052-4138-8f4a-8e051c54255d tempest-DeleteServersTestJSON-1805612840 tempest-DeleteServersTestJSON-1805612840-project] [instance: eaeb6520-bd1e-495e-9ada-744682cbc122] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:26:00.404892 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-c555bee6-5052-4138-8f4a-8e051c54255d tempest-DeleteServersTestJSON-1805612840 tempest-DeleteServersTestJSON-1805612840-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:26:00.405341 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-c555bee6-5052-4138-8f4a-8e051c54255d tempest-DeleteServersTestJSON-1805612840 tempest-DeleteServersTestJSON-1805612840-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:26:00.405466 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-b4e63b6c-5289-4dbd-9360-26a26f87e4e1 tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] 10.222.0.11 "GET /compute/v2.1/servers/61d387ba-e928-4e5f-a79c-4f757643903c" status: 200 len: 1318 microversion: 2.1 time: 0.161337 Nov 17 03:26:00.406027 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 98/208] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:26:00 2021] GET /compute/v2.1/servers/61d387ba-e928-4e5f-a79c-4f757643903c => generated 1318 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:26:00.406160 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-c555bee6-5052-4138-8f4a-8e051c54255d tempest-DeleteServersTestJSON-1805612840 tempest-DeleteServersTestJSON-1805612840-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:26:00.406533 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-c555bee6-5052-4138-8f4a-8e051c54255d tempest-DeleteServersTestJSON-1805612840 tempest-DeleteServersTestJSON-1805612840-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:26:00.505296 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-9d8eb650-6c48-41b7-bd0c-5e7690d6c6fb tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:26:00.505892 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-9d8eb650-6c48-41b7-bd0c-5e7690d6c6fb tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] [instance: 6dc785d7-bc95-4fee-8206-c2fd3b930e4f] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:26:00.512246 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-9d8eb650-6c48-41b7-bd0c-5e7690d6c6fb tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:26:00.512686 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-9d8eb650-6c48-41b7-bd0c-5e7690d6c6fb tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:26:00.513880 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-9d8eb650-6c48-41b7-bd0c-5e7690d6c6fb tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:26:00.514292 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-9d8eb650-6c48-41b7-bd0c-5e7690d6c6fb tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:26:00.542108 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-c555bee6-5052-4138-8f4a-8e051c54255d tempest-DeleteServersTestJSON-1805612840 tempest-DeleteServersTestJSON-1805612840-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65322b3497864a64870eadab1ff7d490', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37560cd5b14f43cd85ee2a3ff2716c33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:26:00.549494 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-c555bee6-5052-4138-8f4a-8e051c54255d tempest-DeleteServersTestJSON-1805612840 tempest-DeleteServersTestJSON-1805612840-project] 10.222.0.11 "GET /compute/v2.1/servers/eaeb6520-bd1e-495e-9ada-744682cbc122" status: 200 len: 1315 microversion: 2.1 time: 0.155026 Nov 17 03:26:00.550064 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 111/209] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:26:00 2021] GET /compute/v2.1/servers/eaeb6520-bd1e-495e-9ada-744682cbc122 => generated 1315 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:26:00.653486 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-9d8eb650-6c48-41b7-bd0c-5e7690d6c6fb tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f046401c6a04f6495ebe0821120bd72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a58e89ceeea4a9c8a72a1de4bcaf2d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:26:00.664741 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-9d8eb650-6c48-41b7-bd0c-5e7690d6c6fb tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] 10.222.0.11 "GET /compute/v2.1/servers/6dc785d7-bc95-4fee-8206-c2fd3b930e4f" status: 200 len: 1321 microversion: 2.1 time: 0.162801 Nov 17 03:26:00.665610 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 99/210] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:26:00 2021] GET /compute/v2.1/servers/6dc785d7-bc95-4fee-8206-c2fd3b930e4f => generated 1321 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:26:00.687165 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-d1900dc9-b246-416f-afd6-e36ce332b2a4 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:26:00.687796 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-d1900dc9-b246-416f-afd6-e36ce332b2a4 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] [instance: 5d54db85-b991-4890-abaa-952413baa2e7] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:26:00.694047 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-d1900dc9-b246-416f-afd6-e36ce332b2a4 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:26:00.694482 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-d1900dc9-b246-416f-afd6-e36ce332b2a4 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:26:00.695244 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-d1900dc9-b246-416f-afd6-e36ce332b2a4 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:26:00.695663 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-d1900dc9-b246-416f-afd6-e36ce332b2a4 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:26:00.828035 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-d1900dc9-b246-416f-afd6-e36ce332b2a4 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37f21d6d15cf40a586edda211219fd08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ebb970305844dccacf48a7d8d47ecf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:26:00.838965 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-d1900dc9-b246-416f-afd6-e36ce332b2a4 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '37f21d6d15cf40a586edda211219fd08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ebb970305844dccacf48a7d8d47ecf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:26:00.841459 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-d1900dc9-b246-416f-afd6-e36ce332b2a4 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '37f21d6d15cf40a586edda211219fd08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ebb970305844dccacf48a7d8d47ecf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:26:00.843047 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-d1900dc9-b246-416f-afd6-e36ce332b2a4 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] 10.222.0.11 "GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7" status: 200 len: 1407 microversion: 2.20 time: 0.159493 Nov 17 03:26:00.843797 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 112/211] 10.222.0.11 () {60 vars in 1276 bytes} [Wed Nov 17 03:26:00 2021] GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7 => generated 1407 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 17 03:26:01.415756 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [req-02a88cb4-a772-4447-a7a1-147883f007a9 req-9fcc054e-d004-4d60-8af1-f92b1d485d65 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6dc785d7-bc95-4fee-8206-c2fd3b930e4f", "name": "network-vif-plugged", "status": "completed", "tag": "3bae275b-d629-47b7-b478-95973e33b83e"}]} {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 17 03:26:01.417726 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 17 03:26:01.417726 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: warnings.warn(msg) Nov 17 03:26:01.423433 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-83ace6d6-6bac-414b-9a70-8eb4b011b9ae tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:26:01.424073 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-83ace6d6-6bac-414b-9a70-8eb4b011b9ae tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] [instance: 61d387ba-e928-4e5f-a79c-4f757643903c] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:26:01.425857 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [req-02a88cb4-a772-4447-a7a1-147883f007a9 req-9fcc054e-d004-4d60-8af1-f92b1d485d65 service nova] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:26:01.426329 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [req-02a88cb4-a772-4447-a7a1-147883f007a9 req-9fcc054e-d004-4d60-8af1-f92b1d485d65 service nova] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:26:01.430187 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-83ace6d6-6bac-414b-9a70-8eb4b011b9ae tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:26:01.430626 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-83ace6d6-6bac-414b-9a70-8eb4b011b9ae tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:26:01.431571 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-83ace6d6-6bac-414b-9a70-8eb4b011b9ae tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:26:01.432148 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-83ace6d6-6bac-414b-9a70-8eb4b011b9ae tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:26:01.440347 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.compute.server_external_events [req-02a88cb4-a772-4447-a7a1-147883f007a9 req-9fcc054e-d004-4d60-8af1-f92b1d485d65 service nova] Creating event network-vif-plugged:3bae275b-d629-47b7-b478-95973e33b83e for instance 6dc785d7-bc95-4fee-8206-c2fd3b930e4f on hv-cinder-81803 Nov 17 03:26:01.445479 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [req-02a88cb4-a772-4447-a7a1-147883f007a9 req-9fcc054e-d004-4d60-8af1-f92b1d485d65 service nova] 10.222.0.11 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033634 Nov 17 03:26:01.446290 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 100/212] 10.222.0.11 () {64 vars in 1317 bytes} [Wed Nov 17 03:26:01 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 17 03:26:01.567428 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-074336e5-5f16-40fa-b180-d9b56f053890 tempest-DeleteServersTestJSON-1805612840 tempest-DeleteServersTestJSON-1805612840-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:26:01.568044 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-074336e5-5f16-40fa-b180-d9b56f053890 tempest-DeleteServersTestJSON-1805612840 tempest-DeleteServersTestJSON-1805612840-project] [instance: eaeb6520-bd1e-495e-9ada-744682cbc122] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:26:01.574874 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-074336e5-5f16-40fa-b180-d9b56f053890 tempest-DeleteServersTestJSON-1805612840 tempest-DeleteServersTestJSON-1805612840-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:26:01.575311 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-074336e5-5f16-40fa-b180-d9b56f053890 tempest-DeleteServersTestJSON-1805612840 tempest-DeleteServersTestJSON-1805612840-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:26:01.576438 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-074336e5-5f16-40fa-b180-d9b56f053890 tempest-DeleteServersTestJSON-1805612840 tempest-DeleteServersTestJSON-1805612840-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:26:01.577051 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-074336e5-5f16-40fa-b180-d9b56f053890 tempest-DeleteServersTestJSON-1805612840 tempest-DeleteServersTestJSON-1805612840-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:26:01.714570 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-074336e5-5f16-40fa-b180-d9b56f053890 tempest-DeleteServersTestJSON-1805612840 tempest-DeleteServersTestJSON-1805612840-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65322b3497864a64870eadab1ff7d490', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37560cd5b14f43cd85ee2a3ff2716c33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:26:01.724295 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-074336e5-5f16-40fa-b180-d9b56f053890 tempest-DeleteServersTestJSON-1805612840 tempest-DeleteServersTestJSON-1805612840-project] 10.222.0.11 "GET /compute/v2.1/servers/eaeb6520-bd1e-495e-9ada-744682cbc122" status: 200 len: 1315 microversion: 2.1 time: 0.160978 Nov 17 03:26:01.725031 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 101/213] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:26:01 2021] GET /compute/v2.1/servers/eaeb6520-bd1e-495e-9ada-744682cbc122 => generated 1315 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 17 03:26:01.739696 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-04f983ba-175c-4343-b624-87e553f188c8 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:26:01.740542 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-04f983ba-175c-4343-b624-87e553f188c8 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] [instance: 6dc785d7-bc95-4fee-8206-c2fd3b930e4f] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:26:01.746613 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-04f983ba-175c-4343-b624-87e553f188c8 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:26:01.747061 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-04f983ba-175c-4343-b624-87e553f188c8 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:26:01.748102 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-04f983ba-175c-4343-b624-87e553f188c8 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:26:01.748707 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-04f983ba-175c-4343-b624-87e553f188c8 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:26:01.756175 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-83ace6d6-6bac-414b-9a70-8eb4b011b9ae tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d4e8ac9538f42c9b637bd9e086668b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfc480343d4d493bb4295b055e274df5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:26:01.763725 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-83ace6d6-6bac-414b-9a70-8eb4b011b9ae tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] 10.222.0.11 "GET /compute/v2.1/servers/61d387ba-e928-4e5f-a79c-4f757643903c" status: 200 len: 1318 microversion: 2.1 time: 0.344657 Nov 17 03:26:01.766777 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 113/214] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:26:01 2021] GET /compute/v2.1/servers/61d387ba-e928-4e5f-a79c-4f757643903c => generated 1318 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:26:01.866534 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-398f2dfa-b867-43bf-85f9-b098f9850837 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:26:01.867131 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-398f2dfa-b867-43bf-85f9-b098f9850837 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] [instance: 5d54db85-b991-4890-abaa-952413baa2e7] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:26:01.873903 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-398f2dfa-b867-43bf-85f9-b098f9850837 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:26:01.874267 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-398f2dfa-b867-43bf-85f9-b098f9850837 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:26:01.875042 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-398f2dfa-b867-43bf-85f9-b098f9850837 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:26:01.875516 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-398f2dfa-b867-43bf-85f9-b098f9850837 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:26:01.890932 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-04f983ba-175c-4343-b624-87e553f188c8 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f046401c6a04f6495ebe0821120bd72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a58e89ceeea4a9c8a72a1de4bcaf2d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:26:01.899495 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-04f983ba-175c-4343-b624-87e553f188c8 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] 10.222.0.11 "GET /compute/v2.1/servers/6dc785d7-bc95-4fee-8206-c2fd3b930e4f" status: 200 len: 1321 microversion: 2.1 time: 0.163415 Nov 17 03:26:01.900074 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 102/215] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:26:01 2021] GET /compute/v2.1/servers/6dc785d7-bc95-4fee-8206-c2fd3b930e4f => generated 1321 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:26:02.006575 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-398f2dfa-b867-43bf-85f9-b098f9850837 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37f21d6d15cf40a586edda211219fd08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ebb970305844dccacf48a7d8d47ecf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:26:02.015482 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-398f2dfa-b867-43bf-85f9-b098f9850837 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '37f21d6d15cf40a586edda211219fd08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ebb970305844dccacf48a7d8d47ecf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:26:02.016999 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-398f2dfa-b867-43bf-85f9-b098f9850837 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '37f21d6d15cf40a586edda211219fd08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ebb970305844dccacf48a7d8d47ecf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:26:02.018114 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-398f2dfa-b867-43bf-85f9-b098f9850837 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] 10.222.0.11 "GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7" status: 200 len: 1407 microversion: 2.20 time: 0.155643 Nov 17 03:26:02.018649 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 114/216] 10.222.0.11 () {60 vars in 1276 bytes} [Wed Nov 17 03:26:01 2021] GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7 => generated 1407 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 17 03:26:02.745863 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-bc0a8b85-0937-403e-aff9-6f3b338ffdc0 tempest-DeleteServersTestJSON-1805612840 tempest-DeleteServersTestJSON-1805612840-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:26:02.746707 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-bc0a8b85-0937-403e-aff9-6f3b338ffdc0 tempest-DeleteServersTestJSON-1805612840 tempest-DeleteServersTestJSON-1805612840-project] [instance: eaeb6520-bd1e-495e-9ada-744682cbc122] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:26:02.753527 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-bc0a8b85-0937-403e-aff9-6f3b338ffdc0 tempest-DeleteServersTestJSON-1805612840 tempest-DeleteServersTestJSON-1805612840-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:26:02.753973 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-bc0a8b85-0937-403e-aff9-6f3b338ffdc0 tempest-DeleteServersTestJSON-1805612840 tempest-DeleteServersTestJSON-1805612840-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:26:02.754727 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-bc0a8b85-0937-403e-aff9-6f3b338ffdc0 tempest-DeleteServersTestJSON-1805612840 tempest-DeleteServersTestJSON-1805612840-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:26:02.755153 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-bc0a8b85-0937-403e-aff9-6f3b338ffdc0 tempest-DeleteServersTestJSON-1805612840 tempest-DeleteServersTestJSON-1805612840-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:26:02.781290 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-f1e84bd5-efce-40d6-9052-e2495aa68f83 tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:26:02.781863 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-f1e84bd5-efce-40d6-9052-e2495aa68f83 tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] [instance: 61d387ba-e928-4e5f-a79c-4f757643903c] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:26:02.788395 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-f1e84bd5-efce-40d6-9052-e2495aa68f83 tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:26:02.788865 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-f1e84bd5-efce-40d6-9052-e2495aa68f83 tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:26:02.789634 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-f1e84bd5-efce-40d6-9052-e2495aa68f83 tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:26:02.790059 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-f1e84bd5-efce-40d6-9052-e2495aa68f83 tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:26:02.889672 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-bc0a8b85-0937-403e-aff9-6f3b338ffdc0 tempest-DeleteServersTestJSON-1805612840 tempest-DeleteServersTestJSON-1805612840-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65322b3497864a64870eadab1ff7d490', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37560cd5b14f43cd85ee2a3ff2716c33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:26:02.897314 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-bc0a8b85-0937-403e-aff9-6f3b338ffdc0 tempest-DeleteServersTestJSON-1805612840 tempest-DeleteServersTestJSON-1805612840-project] 10.222.0.11 "GET /compute/v2.1/servers/eaeb6520-bd1e-495e-9ada-744682cbc122" status: 200 len: 1315 microversion: 2.1 time: 0.157985 Nov 17 03:26:02.897892 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 103/217] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:26:02 2021] GET /compute/v2.1/servers/eaeb6520-bd1e-495e-9ada-744682cbc122 => generated 1315 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:26:02.917020 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-4ca7951b-474a-4f89-a2a0-14bb9cb50639 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:26:02.917653 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-4ca7951b-474a-4f89-a2a0-14bb9cb50639 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] [instance: 6dc785d7-bc95-4fee-8206-c2fd3b930e4f] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:26:02.925294 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-f1e84bd5-efce-40d6-9052-e2495aa68f83 tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d4e8ac9538f42c9b637bd9e086668b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfc480343d4d493bb4295b055e274df5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:26:02.929564 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-4ca7951b-474a-4f89-a2a0-14bb9cb50639 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:26:02.929983 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-4ca7951b-474a-4f89-a2a0-14bb9cb50639 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:26:02.931114 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-4ca7951b-474a-4f89-a2a0-14bb9cb50639 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:26:02.931755 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-4ca7951b-474a-4f89-a2a0-14bb9cb50639 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:26:02.937485 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-f1e84bd5-efce-40d6-9052-e2495aa68f83 tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] 10.222.0.11 "GET /compute/v2.1/servers/61d387ba-e928-4e5f-a79c-4f757643903c" status: 200 len: 1318 microversion: 2.1 time: 0.159494 Nov 17 03:26:02.938398 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 115/218] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:26:02 2021] GET /compute/v2.1/servers/61d387ba-e928-4e5f-a79c-4f757643903c => generated 1318 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:26:03.036586 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-7251039f-14d6-493e-b805-a17929e7163d tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:26:03.037208 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-7251039f-14d6-493e-b805-a17929e7163d tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] [instance: 5d54db85-b991-4890-abaa-952413baa2e7] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:26:03.043224 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-7251039f-14d6-493e-b805-a17929e7163d tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:26:03.043665 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-7251039f-14d6-493e-b805-a17929e7163d tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:26:03.044582 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-7251039f-14d6-493e-b805-a17929e7163d tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:26:03.045053 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-7251039f-14d6-493e-b805-a17929e7163d tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:26:03.081299 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-4ca7951b-474a-4f89-a2a0-14bb9cb50639 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f046401c6a04f6495ebe0821120bd72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a58e89ceeea4a9c8a72a1de4bcaf2d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:26:03.089122 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-4ca7951b-474a-4f89-a2a0-14bb9cb50639 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] 10.222.0.11 "GET /compute/v2.1/servers/6dc785d7-bc95-4fee-8206-c2fd3b930e4f" status: 200 len: 1321 microversion: 2.1 time: 0.175845 Nov 17 03:26:03.089857 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 104/219] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:26:02 2021] GET /compute/v2.1/servers/6dc785d7-bc95-4fee-8206-c2fd3b930e4f => generated 1321 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:26:03.183110 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-7251039f-14d6-493e-b805-a17929e7163d tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37f21d6d15cf40a586edda211219fd08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ebb970305844dccacf48a7d8d47ecf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:26:03.192018 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-7251039f-14d6-493e-b805-a17929e7163d tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '37f21d6d15cf40a586edda211219fd08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ebb970305844dccacf48a7d8d47ecf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:26:03.193536 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-7251039f-14d6-493e-b805-a17929e7163d tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '37f21d6d15cf40a586edda211219fd08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ebb970305844dccacf48a7d8d47ecf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:26:03.194631 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-7251039f-14d6-493e-b805-a17929e7163d tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] 10.222.0.11 "GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7" status: 200 len: 1407 microversion: 2.20 time: 0.161738 Nov 17 03:26:03.195191 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 116/220] 10.222.0.11 () {60 vars in 1276 bytes} [Wed Nov 17 03:26:03 2021] GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7 => generated 1407 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 17 03:26:03.917777 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-4c9eb4a6-bd34-4ee7-8154-a7eaaea89a8d tempest-DeleteServersTestJSON-1805612840 tempest-DeleteServersTestJSON-1805612840-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:26:03.918735 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-4c9eb4a6-bd34-4ee7-8154-a7eaaea89a8d tempest-DeleteServersTestJSON-1805612840 tempest-DeleteServersTestJSON-1805612840-project] [instance: eaeb6520-bd1e-495e-9ada-744682cbc122] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:26:03.925649 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-4c9eb4a6-bd34-4ee7-8154-a7eaaea89a8d tempest-DeleteServersTestJSON-1805612840 tempest-DeleteServersTestJSON-1805612840-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:26:03.926095 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-4c9eb4a6-bd34-4ee7-8154-a7eaaea89a8d tempest-DeleteServersTestJSON-1805612840 tempest-DeleteServersTestJSON-1805612840-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:26:03.926925 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-4c9eb4a6-bd34-4ee7-8154-a7eaaea89a8d tempest-DeleteServersTestJSON-1805612840 tempest-DeleteServersTestJSON-1805612840-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:26:03.927413 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-4c9eb4a6-bd34-4ee7-8154-a7eaaea89a8d tempest-DeleteServersTestJSON-1805612840 tempest-DeleteServersTestJSON-1805612840-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:26:03.960039 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-8138f2d1-62e6-46b8-99c1-79ffca7cc9f3 tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:26:03.960586 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-8138f2d1-62e6-46b8-99c1-79ffca7cc9f3 tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] [instance: 61d387ba-e928-4e5f-a79c-4f757643903c] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:26:03.967281 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-8138f2d1-62e6-46b8-99c1-79ffca7cc9f3 tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:26:03.967719 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-8138f2d1-62e6-46b8-99c1-79ffca7cc9f3 tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:26:03.968486 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-8138f2d1-62e6-46b8-99c1-79ffca7cc9f3 tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:26:03.968949 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-8138f2d1-62e6-46b8-99c1-79ffca7cc9f3 tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:26:04.062489 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-4c9eb4a6-bd34-4ee7-8154-a7eaaea89a8d tempest-DeleteServersTestJSON-1805612840 tempest-DeleteServersTestJSON-1805612840-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65322b3497864a64870eadab1ff7d490', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37560cd5b14f43cd85ee2a3ff2716c33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:26:04.070163 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-4c9eb4a6-bd34-4ee7-8154-a7eaaea89a8d tempest-DeleteServersTestJSON-1805612840 tempest-DeleteServersTestJSON-1805612840-project] 10.222.0.11 "GET /compute/v2.1/servers/eaeb6520-bd1e-495e-9ada-744682cbc122" status: 200 len: 1315 microversion: 2.1 time: 0.158821 Nov 17 03:26:04.070768 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 105/221] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:26:03 2021] GET /compute/v2.1/servers/eaeb6520-bd1e-495e-9ada-744682cbc122 => generated 1315 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:26:04.101303 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-8138f2d1-62e6-46b8-99c1-79ffca7cc9f3 tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d4e8ac9538f42c9b637bd9e086668b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfc480343d4d493bb4295b055e274df5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:26:04.105591 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-f0b3840d-518b-47fa-82bc-063aa3982484 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:26:04.106184 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-f0b3840d-518b-47fa-82bc-063aa3982484 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] [instance: 6dc785d7-bc95-4fee-8206-c2fd3b930e4f] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:26:04.108924 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-8138f2d1-62e6-46b8-99c1-79ffca7cc9f3 tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] 10.222.0.11 "GET /compute/v2.1/servers/61d387ba-e928-4e5f-a79c-4f757643903c" status: 200 len: 1318 microversion: 2.1 time: 0.152547 Nov 17 03:26:04.109505 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 117/222] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:26:03 2021] GET /compute/v2.1/servers/61d387ba-e928-4e5f-a79c-4f757643903c => generated 1318 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:26:04.112598 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-f0b3840d-518b-47fa-82bc-063aa3982484 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:26:04.113072 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-f0b3840d-518b-47fa-82bc-063aa3982484 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:26:04.113830 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-f0b3840d-518b-47fa-82bc-063aa3982484 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:26:04.114248 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-f0b3840d-518b-47fa-82bc-063aa3982484 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:26:04.218525 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-c8bc99b7-a8a2-493f-b09d-1275f34fa19f tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:26:04.219248 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-c8bc99b7-a8a2-493f-b09d-1275f34fa19f tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] [instance: 5d54db85-b991-4890-abaa-952413baa2e7] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:26:04.225176 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-c8bc99b7-a8a2-493f-b09d-1275f34fa19f tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:26:04.225728 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-c8bc99b7-a8a2-493f-b09d-1275f34fa19f tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:26:04.226582 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-c8bc99b7-a8a2-493f-b09d-1275f34fa19f tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:26:04.227090 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-c8bc99b7-a8a2-493f-b09d-1275f34fa19f tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:26:04.246500 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-f0b3840d-518b-47fa-82bc-063aa3982484 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f046401c6a04f6495ebe0821120bd72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a58e89ceeea4a9c8a72a1de4bcaf2d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:26:04.254356 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-f0b3840d-518b-47fa-82bc-063aa3982484 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] 10.222.0.11 "GET /compute/v2.1/servers/6dc785d7-bc95-4fee-8206-c2fd3b930e4f" status: 200 len: 1321 microversion: 2.1 time: 0.152388 Nov 17 03:26:04.255119 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 106/223] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:26:04 2021] GET /compute/v2.1/servers/6dc785d7-bc95-4fee-8206-c2fd3b930e4f => generated 1321 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 17 03:26:04.364031 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-c8bc99b7-a8a2-493f-b09d-1275f34fa19f tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37f21d6d15cf40a586edda211219fd08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ebb970305844dccacf48a7d8d47ecf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:26:04.372500 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-c8bc99b7-a8a2-493f-b09d-1275f34fa19f tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '37f21d6d15cf40a586edda211219fd08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ebb970305844dccacf48a7d8d47ecf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:26:04.374012 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-c8bc99b7-a8a2-493f-b09d-1275f34fa19f tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '37f21d6d15cf40a586edda211219fd08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ebb970305844dccacf48a7d8d47ecf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:26:04.375128 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-c8bc99b7-a8a2-493f-b09d-1275f34fa19f tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] 10.222.0.11 "GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7" status: 200 len: 1407 microversion: 2.20 time: 0.160775 Nov 17 03:26:04.375714 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 118/224] 10.222.0.11 () {60 vars in 1276 bytes} [Wed Nov 17 03:26:04 2021] GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7 => generated 1407 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 17 03:26:05.087495 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-d84a4b62-e074-4921-849d-939330d319a5 tempest-DeleteServersTestJSON-1805612840 tempest-DeleteServersTestJSON-1805612840-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:26:05.087998 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-d84a4b62-e074-4921-849d-939330d319a5 tempest-DeleteServersTestJSON-1805612840 tempest-DeleteServersTestJSON-1805612840-project] [instance: eaeb6520-bd1e-495e-9ada-744682cbc122] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:26:05.094509 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-d84a4b62-e074-4921-849d-939330d319a5 tempest-DeleteServersTestJSON-1805612840 tempest-DeleteServersTestJSON-1805612840-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:26:05.094955 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-d84a4b62-e074-4921-849d-939330d319a5 tempest-DeleteServersTestJSON-1805612840 tempest-DeleteServersTestJSON-1805612840-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:26:05.095719 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-d84a4b62-e074-4921-849d-939330d319a5 tempest-DeleteServersTestJSON-1805612840 tempest-DeleteServersTestJSON-1805612840-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:26:05.096142 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-d84a4b62-e074-4921-849d-939330d319a5 tempest-DeleteServersTestJSON-1805612840 tempest-DeleteServersTestJSON-1805612840-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:26:05.125263 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-ee98b61f-f445-4e37-8933-d764286921a6 tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:26:05.125900 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-ee98b61f-f445-4e37-8933-d764286921a6 tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] [instance: 61d387ba-e928-4e5f-a79c-4f757643903c] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:26:05.131881 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-ee98b61f-f445-4e37-8933-d764286921a6 tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:26:05.132326 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-ee98b61f-f445-4e37-8933-d764286921a6 tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:26:05.133112 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-ee98b61f-f445-4e37-8933-d764286921a6 tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:26:05.133536 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-ee98b61f-f445-4e37-8933-d764286921a6 tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:26:05.230791 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-d84a4b62-e074-4921-849d-939330d319a5 tempest-DeleteServersTestJSON-1805612840 tempest-DeleteServersTestJSON-1805612840-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65322b3497864a64870eadab1ff7d490', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37560cd5b14f43cd85ee2a3ff2716c33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:26:05.239347 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-d84a4b62-e074-4921-849d-939330d319a5 tempest-DeleteServersTestJSON-1805612840 tempest-DeleteServersTestJSON-1805612840-project] 10.222.0.11 "GET /compute/v2.1/servers/eaeb6520-bd1e-495e-9ada-744682cbc122" status: 200 len: 1315 microversion: 2.1 time: 0.155537 Nov 17 03:26:05.240541 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 107/225] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:26:05 2021] GET /compute/v2.1/servers/eaeb6520-bd1e-495e-9ada-744682cbc122 => generated 1315 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:26:05.271308 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-0dac54d1-d106-473c-8a73-9568784994b2 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:26:05.271920 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-0dac54d1-d106-473c-8a73-9568784994b2 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] [instance: 6dc785d7-bc95-4fee-8206-c2fd3b930e4f] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:26:05.278266 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-0dac54d1-d106-473c-8a73-9568784994b2 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:26:05.278737 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-0dac54d1-d106-473c-8a73-9568784994b2 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:26:05.279545 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-0dac54d1-d106-473c-8a73-9568784994b2 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:26:05.279941 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-0dac54d1-d106-473c-8a73-9568784994b2 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:26:05.283734 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-ee98b61f-f445-4e37-8933-d764286921a6 tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d4e8ac9538f42c9b637bd9e086668b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfc480343d4d493bb4295b055e274df5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:26:05.291846 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-ee98b61f-f445-4e37-8933-d764286921a6 tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] 10.222.0.11 "GET /compute/v2.1/servers/61d387ba-e928-4e5f-a79c-4f757643903c" status: 200 len: 1318 microversion: 2.1 time: 0.169691 Nov 17 03:26:05.292698 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 119/226] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:26:05 2021] GET /compute/v2.1/servers/61d387ba-e928-4e5f-a79c-4f757643903c => generated 1318 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 17 03:26:05.395289 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-9d4bf3de-170d-4cca-a6a0-b0e5ca198f9b tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:26:05.396149 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-9d4bf3de-170d-4cca-a6a0-b0e5ca198f9b tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] [instance: 5d54db85-b991-4890-abaa-952413baa2e7] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:26:05.402624 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-9d4bf3de-170d-4cca-a6a0-b0e5ca198f9b tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:26:05.403322 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-9d4bf3de-170d-4cca-a6a0-b0e5ca198f9b tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:26:05.404578 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-9d4bf3de-170d-4cca-a6a0-b0e5ca198f9b tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:26:05.405297 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-9d4bf3de-170d-4cca-a6a0-b0e5ca198f9b tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:26:05.457566 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-0dac54d1-d106-473c-8a73-9568784994b2 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f046401c6a04f6495ebe0821120bd72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a58e89ceeea4a9c8a72a1de4bcaf2d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:26:05.474121 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-0dac54d1-d106-473c-8a73-9568784994b2 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] 10.222.0.11 "GET /compute/v2.1/servers/6dc785d7-bc95-4fee-8206-c2fd3b930e4f" status: 200 len: 1321 microversion: 2.1 time: 0.206431 Nov 17 03:26:05.474836 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 108/227] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:26:05 2021] GET /compute/v2.1/servers/6dc785d7-bc95-4fee-8206-c2fd3b930e4f => generated 1321 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 17 03:26:05.601375 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-9d4bf3de-170d-4cca-a6a0-b0e5ca198f9b tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37f21d6d15cf40a586edda211219fd08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ebb970305844dccacf48a7d8d47ecf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:26:05.609866 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-9d4bf3de-170d-4cca-a6a0-b0e5ca198f9b tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '37f21d6d15cf40a586edda211219fd08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ebb970305844dccacf48a7d8d47ecf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:26:05.611618 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-9d4bf3de-170d-4cca-a6a0-b0e5ca198f9b tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '37f21d6d15cf40a586edda211219fd08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ebb970305844dccacf48a7d8d47ecf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:26:05.612890 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-9d4bf3de-170d-4cca-a6a0-b0e5ca198f9b tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] 10.222.0.11 "GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7" status: 200 len: 1407 microversion: 2.20 time: 0.221262 Nov 17 03:26:05.613459 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 120/228] 10.222.0.11 () {60 vars in 1276 bytes} [Wed Nov 17 03:26:05 2021] GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7 => generated 1407 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 17 03:26:06.257372 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-d85cd389-c902-468e-b0fb-07fcfe501626 tempest-DeleteServersTestJSON-1805612840 tempest-DeleteServersTestJSON-1805612840-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:26:06.257985 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-d85cd389-c902-468e-b0fb-07fcfe501626 tempest-DeleteServersTestJSON-1805612840 tempest-DeleteServersTestJSON-1805612840-project] [instance: eaeb6520-bd1e-495e-9ada-744682cbc122] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:26:06.263923 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-d85cd389-c902-468e-b0fb-07fcfe501626 tempest-DeleteServersTestJSON-1805612840 tempest-DeleteServersTestJSON-1805612840-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:26:06.264329 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-d85cd389-c902-468e-b0fb-07fcfe501626 tempest-DeleteServersTestJSON-1805612840 tempest-DeleteServersTestJSON-1805612840-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:26:06.265125 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-d85cd389-c902-468e-b0fb-07fcfe501626 tempest-DeleteServersTestJSON-1805612840 tempest-DeleteServersTestJSON-1805612840-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:26:06.265550 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-d85cd389-c902-468e-b0fb-07fcfe501626 tempest-DeleteServersTestJSON-1805612840 tempest-DeleteServersTestJSON-1805612840-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:26:06.321490 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-8e0b9430-c564-42bc-942c-4325b627a455 tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:26:06.324370 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-8e0b9430-c564-42bc-942c-4325b627a455 tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] [instance: 61d387ba-e928-4e5f-a79c-4f757643903c] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:26:06.332793 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-8e0b9430-c564-42bc-942c-4325b627a455 tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:26:06.333301 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-8e0b9430-c564-42bc-942c-4325b627a455 tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:26:06.334085 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-8e0b9430-c564-42bc-942c-4325b627a455 tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:26:06.334850 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-8e0b9430-c564-42bc-942c-4325b627a455 tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:26:06.415469 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-d85cd389-c902-468e-b0fb-07fcfe501626 tempest-DeleteServersTestJSON-1805612840 tempest-DeleteServersTestJSON-1805612840-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65322b3497864a64870eadab1ff7d490', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37560cd5b14f43cd85ee2a3ff2716c33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:26:06.423656 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-d85cd389-c902-468e-b0fb-07fcfe501626 tempest-DeleteServersTestJSON-1805612840 tempest-DeleteServersTestJSON-1805612840-project] 10.222.0.11 "GET /compute/v2.1/servers/eaeb6520-bd1e-495e-9ada-744682cbc122" status: 200 len: 1502 microversion: 2.1 time: 0.170040 Nov 17 03:26:06.424256 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 109/229] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:26:06 2021] GET /compute/v2.1/servers/eaeb6520-bd1e-495e-9ada-744682cbc122 => generated 1502 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:26:06.492685 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-937dc7d1-c376-4357-84bf-4795105b1943 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:26:06.493467 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-937dc7d1-c376-4357-84bf-4795105b1943 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] [instance: 6dc785d7-bc95-4fee-8206-c2fd3b930e4f] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:26:06.501232 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-937dc7d1-c376-4357-84bf-4795105b1943 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:26:06.501758 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-937dc7d1-c376-4357-84bf-4795105b1943 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:26:06.502724 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-937dc7d1-c376-4357-84bf-4795105b1943 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:26:06.503369 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-937dc7d1-c376-4357-84bf-4795105b1943 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:26:06.560431 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-8e0b9430-c564-42bc-942c-4325b627a455 tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d4e8ac9538f42c9b637bd9e086668b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfc480343d4d493bb4295b055e274df5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:26:06.570983 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-8e0b9430-c564-42bc-942c-4325b627a455 tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] 10.222.0.11 "GET /compute/v2.1/servers/61d387ba-e928-4e5f-a79c-4f757643903c" status: 200 len: 1318 microversion: 2.1 time: 0.264047 Nov 17 03:26:06.571694 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 121/230] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:26:06 2021] GET /compute/v2.1/servers/61d387ba-e928-4e5f-a79c-4f757643903c => generated 1318 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:26:06.634441 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-73380165-9651-471b-a550-9e42eda6d875 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:26:06.635511 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-73380165-9651-471b-a550-9e42eda6d875 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] [instance: 5d54db85-b991-4890-abaa-952413baa2e7] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:26:06.644665 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-73380165-9651-471b-a550-9e42eda6d875 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:26:06.645747 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-73380165-9651-471b-a550-9e42eda6d875 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:26:06.647439 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-73380165-9651-471b-a550-9e42eda6d875 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:26:06.648504 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-73380165-9651-471b-a550-9e42eda6d875 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:26:06.881203 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-73380165-9651-471b-a550-9e42eda6d875 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37f21d6d15cf40a586edda211219fd08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ebb970305844dccacf48a7d8d47ecf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:26:06.882578 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-937dc7d1-c376-4357-84bf-4795105b1943 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f046401c6a04f6495ebe0821120bd72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a58e89ceeea4a9c8a72a1de4bcaf2d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:26:06.892077 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-73380165-9651-471b-a550-9e42eda6d875 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '37f21d6d15cf40a586edda211219fd08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ebb970305844dccacf48a7d8d47ecf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:26:06.892254 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-937dc7d1-c376-4357-84bf-4795105b1943 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] 10.222.0.11 "GET /compute/v2.1/servers/6dc785d7-bc95-4fee-8206-c2fd3b930e4f" status: 200 len: 1321 microversion: 2.1 time: 0.402424 Nov 17 03:26:06.892254 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 110/231] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:26:06 2021] GET /compute/v2.1/servers/6dc785d7-bc95-4fee-8206-c2fd3b930e4f => generated 1321 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:26:06.893985 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-73380165-9651-471b-a550-9e42eda6d875 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '37f21d6d15cf40a586edda211219fd08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ebb970305844dccacf48a7d8d47ecf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:26:06.895110 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-73380165-9651-471b-a550-9e42eda6d875 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] 10.222.0.11 "GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7" status: 200 len: 1407 microversion: 2.20 time: 0.268134 Nov 17 03:26:06.895648 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 122/232] 10.222.0.11 () {60 vars in 1276 bytes} [Wed Nov 17 03:26:06 2021] GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7 => generated 1407 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 17 03:26:07.587524 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-053d309d-3fb2-406a-96d9-5d5adec95daa tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:26:07.588234 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-053d309d-3fb2-406a-96d9-5d5adec95daa tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] [instance: 61d387ba-e928-4e5f-a79c-4f757643903c] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:26:07.594680 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-053d309d-3fb2-406a-96d9-5d5adec95daa tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:26:07.595203 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-053d309d-3fb2-406a-96d9-5d5adec95daa tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:26:07.596037 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-053d309d-3fb2-406a-96d9-5d5adec95daa tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:26:07.596586 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-053d309d-3fb2-406a-96d9-5d5adec95daa tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:26:07.729307 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-053d309d-3fb2-406a-96d9-5d5adec95daa tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d4e8ac9538f42c9b637bd9e086668b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfc480343d4d493bb4295b055e274df5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:26:07.737101 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-053d309d-3fb2-406a-96d9-5d5adec95daa tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] 10.222.0.11 "GET /compute/v2.1/servers/61d387ba-e928-4e5f-a79c-4f757643903c" status: 200 len: 1318 microversion: 2.1 time: 0.153208 Nov 17 03:26:07.737887 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 111/233] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:26:07 2021] GET /compute/v2.1/servers/61d387ba-e928-4e5f-a79c-4f757643903c => generated 1318 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:26:07.908106 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-2c6ad311-4378-4665-b77e-46bc7f5d83fd tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:26:07.909014 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-2c6ad311-4378-4665-b77e-46bc7f5d83fd tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] [instance: 6dc785d7-bc95-4fee-8206-c2fd3b930e4f] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:26:07.915294 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-2c6ad311-4378-4665-b77e-46bc7f5d83fd tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:26:07.915818 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-2c6ad311-4378-4665-b77e-46bc7f5d83fd tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:26:07.916685 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-2c6ad311-4378-4665-b77e-46bc7f5d83fd tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:26:07.917134 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-2c6ad311-4378-4665-b77e-46bc7f5d83fd tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:26:07.919046 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-22da2a69-5585-4713-8463-a2e34e868dd2 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:26:07.919693 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-22da2a69-5585-4713-8463-a2e34e868dd2 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] [instance: 5d54db85-b991-4890-abaa-952413baa2e7] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:26:07.925787 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-22da2a69-5585-4713-8463-a2e34e868dd2 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:26:07.926252 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-22da2a69-5585-4713-8463-a2e34e868dd2 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:26:07.929409 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-22da2a69-5585-4713-8463-a2e34e868dd2 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:26:07.929409 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-22da2a69-5585-4713-8463-a2e34e868dd2 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:26:08.061884 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-22da2a69-5585-4713-8463-a2e34e868dd2 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37f21d6d15cf40a586edda211219fd08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ebb970305844dccacf48a7d8d47ecf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:26:08.070173 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-22da2a69-5585-4713-8463-a2e34e868dd2 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '37f21d6d15cf40a586edda211219fd08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ebb970305844dccacf48a7d8d47ecf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:26:08.071775 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-22da2a69-5585-4713-8463-a2e34e868dd2 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '37f21d6d15cf40a586edda211219fd08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ebb970305844dccacf48a7d8d47ecf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:26:08.073098 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-22da2a69-5585-4713-8463-a2e34e868dd2 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] 10.222.0.11 "GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7" status: 200 len: 1407 microversion: 2.20 time: 0.158981 Nov 17 03:26:08.073680 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 112/234] 10.222.0.11 () {60 vars in 1276 bytes} [Wed Nov 17 03:26:07 2021] GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7 => generated 1407 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 17 03:26:08.112899 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-2c6ad311-4378-4665-b77e-46bc7f5d83fd tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f046401c6a04f6495ebe0821120bd72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a58e89ceeea4a9c8a72a1de4bcaf2d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:26:08.120686 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-2c6ad311-4378-4665-b77e-46bc7f5d83fd tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] 10.222.0.11 "GET /compute/v2.1/servers/6dc785d7-bc95-4fee-8206-c2fd3b930e4f" status: 200 len: 1321 microversion: 2.1 time: 0.216919 Nov 17 03:26:08.121305 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 123/235] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:26:07 2021] GET /compute/v2.1/servers/6dc785d7-bc95-4fee-8206-c2fd3b930e4f => generated 1321 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:26:08.754523 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-5e64d8e6-e374-4b92-8fec-7833e5631741 tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:26:08.755197 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-5e64d8e6-e374-4b92-8fec-7833e5631741 tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] [instance: 61d387ba-e928-4e5f-a79c-4f757643903c] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:26:08.763206 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-5e64d8e6-e374-4b92-8fec-7833e5631741 tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:26:08.763651 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-5e64d8e6-e374-4b92-8fec-7833e5631741 tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:26:08.764430 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-5e64d8e6-e374-4b92-8fec-7833e5631741 tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:26:08.765169 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-5e64d8e6-e374-4b92-8fec-7833e5631741 tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:26:08.913446 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-5e64d8e6-e374-4b92-8fec-7833e5631741 tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d4e8ac9538f42c9b637bd9e086668b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfc480343d4d493bb4295b055e274df5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:26:08.920812 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-5e64d8e6-e374-4b92-8fec-7833e5631741 tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] 10.222.0.11 "GET /compute/v2.1/servers/61d387ba-e928-4e5f-a79c-4f757643903c" status: 200 len: 1318 microversion: 2.1 time: 0.170220 Nov 17 03:26:08.921390 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 113/236] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:26:08 2021] GET /compute/v2.1/servers/61d387ba-e928-4e5f-a79c-4f757643903c => generated 1318 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:26:09.091925 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-e06c847c-e964-40f8-87e9-7251605ff64a tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:26:09.092608 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-e06c847c-e964-40f8-87e9-7251605ff64a tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] [instance: 5d54db85-b991-4890-abaa-952413baa2e7] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:26:09.098604 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-e06c847c-e964-40f8-87e9-7251605ff64a tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:26:09.099050 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-e06c847c-e964-40f8-87e9-7251605ff64a tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:26:09.099831 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-e06c847c-e964-40f8-87e9-7251605ff64a tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:26:09.100261 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-e06c847c-e964-40f8-87e9-7251605ff64a tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:26:09.138991 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-f83fa3c4-c873-4ab2-ab13-828a7e713c7b tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:26:09.139601 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-f83fa3c4-c873-4ab2-ab13-828a7e713c7b tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] [instance: 6dc785d7-bc95-4fee-8206-c2fd3b930e4f] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:26:09.145762 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-f83fa3c4-c873-4ab2-ab13-828a7e713c7b tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:26:09.146204 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-f83fa3c4-c873-4ab2-ab13-828a7e713c7b tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:26:09.146975 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-f83fa3c4-c873-4ab2-ab13-828a7e713c7b tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:26:09.147402 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-f83fa3c4-c873-4ab2-ab13-828a7e713c7b tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:26:09.244347 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-e06c847c-e964-40f8-87e9-7251605ff64a tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37f21d6d15cf40a586edda211219fd08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ebb970305844dccacf48a7d8d47ecf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:26:09.254679 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-e06c847c-e964-40f8-87e9-7251605ff64a tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '37f21d6d15cf40a586edda211219fd08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ebb970305844dccacf48a7d8d47ecf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:26:09.256197 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-e06c847c-e964-40f8-87e9-7251605ff64a tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '37f21d6d15cf40a586edda211219fd08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ebb970305844dccacf48a7d8d47ecf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:26:09.257410 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-e06c847c-e964-40f8-87e9-7251605ff64a tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] 10.222.0.11 "GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7" status: 200 len: 1407 microversion: 2.20 time: 0.169547 Nov 17 03:26:09.257976 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 124/237] 10.222.0.11 () {60 vars in 1276 bytes} [Wed Nov 17 03:26:09 2021] GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7 => generated 1407 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 17 03:26:09.296432 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-f83fa3c4-c873-4ab2-ab13-828a7e713c7b tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f046401c6a04f6495ebe0821120bd72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a58e89ceeea4a9c8a72a1de4bcaf2d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:26:09.303879 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-f83fa3c4-c873-4ab2-ab13-828a7e713c7b tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] 10.222.0.11 "GET /compute/v2.1/servers/6dc785d7-bc95-4fee-8206-c2fd3b930e4f" status: 200 len: 1321 microversion: 2.1 time: 0.168910 Nov 17 03:26:09.304512 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 114/238] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:26:09 2021] GET /compute/v2.1/servers/6dc785d7-bc95-4fee-8206-c2fd3b930e4f => generated 1321 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:26:09.939442 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-f85d9c94-b818-4302-afe8-eb0210023575 tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:26:09.939442 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-f85d9c94-b818-4302-afe8-eb0210023575 tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] [instance: 61d387ba-e928-4e5f-a79c-4f757643903c] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:26:09.945108 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-f85d9c94-b818-4302-afe8-eb0210023575 tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:26:09.945657 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-f85d9c94-b818-4302-afe8-eb0210023575 tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:26:09.946508 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-f85d9c94-b818-4302-afe8-eb0210023575 tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:26:09.947015 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-f85d9c94-b818-4302-afe8-eb0210023575 tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:26:10.032031 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-8d74f727-90dd-46ff-8ecb-b13a84b2469b tempest-DeleteServersTestJSON-1805612840 tempest-DeleteServersTestJSON-1805612840-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "4043ce66-a8c1-4726-9902-a6b19d5752ad"}} {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 17 03:26:10.035349 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-8d74f727-90dd-46ff-8ecb-b13a84b2469b tempest-DeleteServersTestJSON-1805612840 tempest-DeleteServersTestJSON-1805612840-project] [instance: eaeb6520-bd1e-495e-9ada-744682cbc122] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:26:10.043045 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-8d74f727-90dd-46ff-8ecb-b13a84b2469b tempest-DeleteServersTestJSON-1805612840 tempest-DeleteServersTestJSON-1805612840-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:26:10.043725 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-8d74f727-90dd-46ff-8ecb-b13a84b2469b tempest-DeleteServersTestJSON-1805612840 tempest-DeleteServersTestJSON-1805612840-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:26:10.045005 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-8d74f727-90dd-46ff-8ecb-b13a84b2469b tempest-DeleteServersTestJSON-1805612840 tempest-DeleteServersTestJSON-1805612840-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:26:10.045635 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-8d74f727-90dd-46ff-8ecb-b13a84b2469b tempest-DeleteServersTestJSON-1805612840 tempest-DeleteServersTestJSON-1805612840-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:26:10.163302 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-f85d9c94-b818-4302-afe8-eb0210023575 tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d4e8ac9538f42c9b637bd9e086668b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfc480343d4d493bb4295b055e274df5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:26:10.172313 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-f85d9c94-b818-4302-afe8-eb0210023575 tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] 10.222.0.11 "GET /compute/v2.1/servers/61d387ba-e928-4e5f-a79c-4f757643903c" status: 200 len: 1505 microversion: 2.1 time: 0.237941 Nov 17 03:26:10.173242 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 125/239] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:26:09 2021] GET /compute/v2.1/servers/61d387ba-e928-4e5f-a79c-4f757643903c => generated 1505 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:26:10.275949 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-e4651066-c5f5-4e2b-8f7d-9f7f95f8974a tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:26:10.278264 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-e4651066-c5f5-4e2b-8f7d-9f7f95f8974a tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] [instance: 5d54db85-b991-4890-abaa-952413baa2e7] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:26:10.286346 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-e4651066-c5f5-4e2b-8f7d-9f7f95f8974a tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:26:10.286807 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-e4651066-c5f5-4e2b-8f7d-9f7f95f8974a tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:26:10.291051 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-e4651066-c5f5-4e2b-8f7d-9f7f95f8974a tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:26:10.291671 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-e4651066-c5f5-4e2b-8f7d-9f7f95f8974a tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:26:10.529223 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-e4651066-c5f5-4e2b-8f7d-9f7f95f8974a tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37f21d6d15cf40a586edda211219fd08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ebb970305844dccacf48a7d8d47ecf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:26:10.541419 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-e4651066-c5f5-4e2b-8f7d-9f7f95f8974a tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '37f21d6d15cf40a586edda211219fd08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ebb970305844dccacf48a7d8d47ecf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:26:10.543695 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-e4651066-c5f5-4e2b-8f7d-9f7f95f8974a tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '37f21d6d15cf40a586edda211219fd08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ebb970305844dccacf48a7d8d47ecf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:26:10.546018 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-e4651066-c5f5-4e2b-8f7d-9f7f95f8974a tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] 10.222.0.11 "GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7" status: 200 len: 1407 microversion: 2.20 time: 0.273826 Nov 17 03:26:10.556876 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 126/240] 10.222.0.11 () {60 vars in 1276 bytes} [Wed Nov 17 03:26:10 2021] GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7 => generated 1407 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 17 03:26:10.573168 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-47d81b81-0272-4853-80ff-bbef288ba0a9 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:26:10.573168 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-47d81b81-0272-4853-80ff-bbef288ba0a9 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] [instance: 6dc785d7-bc95-4fee-8206-c2fd3b930e4f] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:26:10.573168 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-47d81b81-0272-4853-80ff-bbef288ba0a9 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:26:10.573168 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-47d81b81-0272-4853-80ff-bbef288ba0a9 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:26:10.573591 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-47d81b81-0272-4853-80ff-bbef288ba0a9 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:26:10.573591 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-47d81b81-0272-4853-80ff-bbef288ba0a9 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:26:10.784454 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-47d81b81-0272-4853-80ff-bbef288ba0a9 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f046401c6a04f6495ebe0821120bd72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a58e89ceeea4a9c8a72a1de4bcaf2d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:26:10.792573 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-47d81b81-0272-4853-80ff-bbef288ba0a9 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] 10.222.0.11 "GET /compute/v2.1/servers/6dc785d7-bc95-4fee-8206-c2fd3b930e4f" status: 200 len: 1321 microversion: 2.1 time: 0.233923 Nov 17 03:26:10.794456 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 127/241] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:26:10 2021] GET /compute/v2.1/servers/6dc785d7-bc95-4fee-8206-c2fd3b930e4f => generated 1321 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:26:10.856593 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-8d74f727-90dd-46ff-8ecb-b13a84b2469b tempest-DeleteServersTestJSON-1805612840 tempest-DeleteServersTestJSON-1805612840-project] 10.222.0.11 "POST /compute/v2.1/servers/eaeb6520-bd1e-495e-9ada-744682cbc122/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.828728 Nov 17 03:26:10.857459 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 115/242] 10.222.0.11 () {60 vars in 1322 bytes} [Wed Nov 17 03:26:10 2021] POST /compute/v2.1/servers/eaeb6520-bd1e-495e-9ada-744682cbc122/os-volume_attachments => generated 194 bytes in 830 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 17 03:26:11.564331 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-d60f9d15-b015-49f0-8760-a2810a98a818 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:26:11.564968 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-d60f9d15-b015-49f0-8760-a2810a98a818 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] [instance: 5d54db85-b991-4890-abaa-952413baa2e7] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:26:11.570928 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-d60f9d15-b015-49f0-8760-a2810a98a818 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:26:11.571366 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-d60f9d15-b015-49f0-8760-a2810a98a818 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:26:11.572122 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-d60f9d15-b015-49f0-8760-a2810a98a818 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:26:11.572543 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-d60f9d15-b015-49f0-8760-a2810a98a818 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:26:11.709743 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-a2be6e96-e9af-4ae1-a9e8-449600be9c88 tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "5627f3b7-528c-4703-8867-0d4a68990208"}} {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 17 03:26:11.710909 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-a2be6e96-e9af-4ae1-a9e8-449600be9c88 tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] [instance: 61d387ba-e928-4e5f-a79c-4f757643903c] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:26:11.718331 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-a2be6e96-e9af-4ae1-a9e8-449600be9c88 tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:26:11.719037 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-a2be6e96-e9af-4ae1-a9e8-449600be9c88 tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:26:11.719905 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-a2be6e96-e9af-4ae1-a9e8-449600be9c88 tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:26:11.720350 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-a2be6e96-e9af-4ae1-a9e8-449600be9c88 tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:26:11.881892 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-d60f9d15-b015-49f0-8760-a2810a98a818 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37f21d6d15cf40a586edda211219fd08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ebb970305844dccacf48a7d8d47ecf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:26:11.891846 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-d60f9d15-b015-49f0-8760-a2810a98a818 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '37f21d6d15cf40a586edda211219fd08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ebb970305844dccacf48a7d8d47ecf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:26:11.893719 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-d60f9d15-b015-49f0-8760-a2810a98a818 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '37f21d6d15cf40a586edda211219fd08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ebb970305844dccacf48a7d8d47ecf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:26:11.895091 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-d60f9d15-b015-49f0-8760-a2810a98a818 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] 10.222.0.11 "GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7" status: 200 len: 1600 microversion: 2.20 time: 0.334560 Nov 17 03:26:11.895828 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 128/243] 10.222.0.11 () {60 vars in 1276 bytes} [Wed Nov 17 03:26:11 2021] GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7 => generated 1600 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 17 03:26:11.901068 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-2c443efb-604b-4678-bb70-57d76d15aa2d tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:26:11.901752 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-2c443efb-604b-4678-bb70-57d76d15aa2d tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] [instance: 6dc785d7-bc95-4fee-8206-c2fd3b930e4f] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:26:11.914782 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-2c443efb-604b-4678-bb70-57d76d15aa2d tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:26:11.915258 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-2c443efb-604b-4678-bb70-57d76d15aa2d tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:26:11.916437 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-2c443efb-604b-4678-bb70-57d76d15aa2d tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:26:11.917203 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-2c443efb-604b-4678-bb70-57d76d15aa2d tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:26:12.247624 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-2c443efb-604b-4678-bb70-57d76d15aa2d tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f046401c6a04f6495ebe0821120bd72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a58e89ceeea4a9c8a72a1de4bcaf2d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:26:12.253440 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-a2be6e96-e9af-4ae1-a9e8-449600be9c88 tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] 10.222.0.11 "POST /compute/v2.1/servers/61d387ba-e928-4e5f-a79c-4f757643903c/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.547897 Nov 17 03:26:12.254627 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 116/244] 10.222.0.11 () {60 vars in 1322 bytes} [Wed Nov 17 03:26:11 2021] POST /compute/v2.1/servers/61d387ba-e928-4e5f-a79c-4f757643903c/os-volume_attachments => generated 194 bytes in 550 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 17 03:26:12.262015 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-2f925d66-6c62-412a-a67b-48aecaa31115 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:26:12.263408 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-2c443efb-604b-4678-bb70-57d76d15aa2d tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] 10.222.0.11 "GET /compute/v2.1/servers/6dc785d7-bc95-4fee-8206-c2fd3b930e4f" status: 200 len: 1515 microversion: 2.1 time: 0.363598 Nov 17 03:26:12.263767 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-2f925d66-6c62-412a-a67b-48aecaa31115 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] [instance: 5d54db85-b991-4890-abaa-952413baa2e7] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:26:12.264006 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 129/245] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:26:11 2021] GET /compute/v2.1/servers/6dc785d7-bc95-4fee-8206-c2fd3b930e4f => generated 1515 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:26:12.280927 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-2f925d66-6c62-412a-a67b-48aecaa31115 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:26:12.282197 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-2f925d66-6c62-412a-a67b-48aecaa31115 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:26:12.283758 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-2f925d66-6c62-412a-a67b-48aecaa31115 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:26:12.291620 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-2f925d66-6c62-412a-a67b-48aecaa31115 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:26:12.297001 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-3c14c554-6648-4c43-8481-c3e14df2d2a7 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 17 03:26:12.298395 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-3c14c554-6648-4c43-8481-c3e14df2d2a7 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] [instance: 6dc785d7-bc95-4fee-8206-c2fd3b930e4f] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:26:12.314430 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-3c14c554-6648-4c43-8481-c3e14df2d2a7 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:26:12.315877 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-3c14c554-6648-4c43-8481-c3e14df2d2a7 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:26:12.317876 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-3c14c554-6648-4c43-8481-c3e14df2d2a7 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:26:12.318735 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-3c14c554-6648-4c43-8481-c3e14df2d2a7 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:26:12.414677 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.objects.instance [None req-3c14c554-6648-4c43-8481-c3e14df2d2a7 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lazy-loading 'flavor' on Instance uuid 6dc785d7-bc95-4fee-8206-c2fd3b930e4f {{(pid=115917) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Nov 17 03:26:12.488477 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-2f925d66-6c62-412a-a67b-48aecaa31115 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] 10.222.0.11 "GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7/os-interface" status: 200 len: 285 microversion: 2.20 time: 0.231807 Nov 17 03:26:12.489163 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 117/246] 10.222.0.11 () {60 vars in 1315 bytes} [Wed Nov 17 03:26:12 2021] GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7/os-interface => generated 285 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 17 03:26:12.626666 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-3c14c554-6648-4c43-8481-c3e14df2d2a7 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] 10.222.0.11 "POST /compute/v2.1/servers/6dc785d7-bc95-4fee-8206-c2fd3b930e4f/action" status: 200 len: 32 microversion: 2.1 time: 0.340526 Nov 17 03:26:12.632997 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 130/247] 10.222.0.11 () {60 vars in 1277 bytes} [Wed Nov 17 03:26:12 2021] POST /compute/v2.1/servers/6dc785d7-bc95-4fee-8206-c2fd3b930e4f/action => generated 32 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 17 03:26:12.641738 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-1d1f5846-6922-451c-92d1-5f72932af747 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:26:12.644946 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-1d1f5846-6922-451c-92d1-5f72932af747 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] [instance: 6dc785d7-bc95-4fee-8206-c2fd3b930e4f] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:26:12.669390 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-1d1f5846-6922-451c-92d1-5f72932af747 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:26:12.675900 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-1d1f5846-6922-451c-92d1-5f72932af747 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:26:12.680109 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-1d1f5846-6922-451c-92d1-5f72932af747 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:26:12.681259 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-1d1f5846-6922-451c-92d1-5f72932af747 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:26:13.111155 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-1d1f5846-6922-451c-92d1-5f72932af747 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f046401c6a04f6495ebe0821120bd72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a58e89ceeea4a9c8a72a1de4bcaf2d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:26:13.120432 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-1d1f5846-6922-451c-92d1-5f72932af747 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] 10.222.0.11 "GET /compute/v2.1/servers/6dc785d7-bc95-4fee-8206-c2fd3b930e4f" status: 200 len: 1521 microversion: 2.1 time: 0.485296 Nov 17 03:26:13.133056 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 118/248] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:26:12 2021] GET /compute/v2.1/servers/6dc785d7-bc95-4fee-8206-c2fd3b930e4f => generated 1521 bytes in 499 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:26:14.151631 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-0212d5cd-210a-485a-a26d-26328475907f tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:26:14.153312 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-0212d5cd-210a-485a-a26d-26328475907f tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] [instance: 6dc785d7-bc95-4fee-8206-c2fd3b930e4f] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:26:14.166995 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-0212d5cd-210a-485a-a26d-26328475907f tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:26:14.167457 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-0212d5cd-210a-485a-a26d-26328475907f tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:26:14.168342 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-0212d5cd-210a-485a-a26d-26328475907f tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:26:14.170500 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-0212d5cd-210a-485a-a26d-26328475907f tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:26:14.357028 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-0212d5cd-210a-485a-a26d-26328475907f tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f046401c6a04f6495ebe0821120bd72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a58e89ceeea4a9c8a72a1de4bcaf2d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:26:14.366106 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-0212d5cd-210a-485a-a26d-26328475907f tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] 10.222.0.11 "GET /compute/v2.1/servers/6dc785d7-bc95-4fee-8206-c2fd3b930e4f" status: 200 len: 1521 microversion: 2.1 time: 0.219806 Nov 17 03:26:14.370795 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 131/249] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:26:14 2021] GET /compute/v2.1/servers/6dc785d7-bc95-4fee-8206-c2fd3b930e4f => generated 1521 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:26:14.538963 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-72409b2d-3e24-4e2d-a4a1-6c3f4c283496 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 17 03:26:14.539956 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-72409b2d-3e24-4e2d-a4a1-6c3f4c283496 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] [instance: 5d54db85-b991-4890-abaa-952413baa2e7] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:26:14.555171 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [req-35af83f3-45fb-4b67-8897-b71695c5cf31 req-0634e46a-dbf2-40c7-886d-322f0f9d0da7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5d54db85-b991-4890-abaa-952413baa2e7", "tag": "51f39c10-57ce-4106-ab58-635a3319ff11"}]} {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 17 03:26:14.556799 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 17 03:26:14.556799 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: warnings.warn(msg) Nov 17 03:26:14.560475 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-72409b2d-3e24-4e2d-a4a1-6c3f4c283496 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:26:14.562259 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-72409b2d-3e24-4e2d-a4a1-6c3f4c283496 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:26:14.565959 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-72409b2d-3e24-4e2d-a4a1-6c3f4c283496 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:26:14.568294 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [req-35af83f3-45fb-4b67-8897-b71695c5cf31 req-0634e46a-dbf2-40c7-886d-322f0f9d0da7 service nova] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:26:14.569470 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-72409b2d-3e24-4e2d-a4a1-6c3f4c283496 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:26:14.573556 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [req-35af83f3-45fb-4b67-8897-b71695c5cf31 req-0634e46a-dbf2-40c7-886d-322f0f9d0da7 service nova] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:26:14.604997 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.compute.server_external_events [req-35af83f3-45fb-4b67-8897-b71695c5cf31 req-0634e46a-dbf2-40c7-886d-322f0f9d0da7 service nova] Creating event network-changed:51f39c10-57ce-4106-ab58-635a3319ff11 for instance 5d54db85-b991-4890-abaa-952413baa2e7 on hv-cinder-81803 Nov 17 03:26:14.612897 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [req-35af83f3-45fb-4b67-8897-b71695c5cf31 req-0634e46a-dbf2-40c7-886d-322f0f9d0da7 service nova] 10.222.0.11 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.061836 Nov 17 03:26:14.624409 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 132/250] 10.222.0.11 () {64 vars in 1317 bytes} [Wed Nov 17 03:26:14 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 17 03:26:15.386764 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-3a5c2236-5580-4198-ac72-e68f6d744c8e tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:26:15.387642 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-3a5c2236-5580-4198-ac72-e68f6d744c8e tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] [instance: 6dc785d7-bc95-4fee-8206-c2fd3b930e4f] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:26:15.401932 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-3a5c2236-5580-4198-ac72-e68f6d744c8e tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:26:15.402607 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-3a5c2236-5580-4198-ac72-e68f6d744c8e tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:26:15.403766 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-3a5c2236-5580-4198-ac72-e68f6d744c8e tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:26:15.404435 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-3a5c2236-5580-4198-ac72-e68f6d744c8e tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:26:15.572698 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-3a5c2236-5580-4198-ac72-e68f6d744c8e tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f046401c6a04f6495ebe0821120bd72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a58e89ceeea4a9c8a72a1de4bcaf2d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:26:15.590164 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-3a5c2236-5580-4198-ac72-e68f6d744c8e tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] 10.222.0.11 "GET /compute/v2.1/servers/6dc785d7-bc95-4fee-8206-c2fd3b930e4f" status: 200 len: 1521 microversion: 2.1 time: 0.207785 Nov 17 03:26:15.593124 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 133/251] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:26:15 2021] GET /compute/v2.1/servers/6dc785d7-bc95-4fee-8206-c2fd3b930e4f => generated 1521 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:26:16.610178 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-dfb89710-3d7e-43eb-85e3-4c4733fe4719 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:26:16.610908 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-dfb89710-3d7e-43eb-85e3-4c4733fe4719 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] [instance: 6dc785d7-bc95-4fee-8206-c2fd3b930e4f] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:26:16.617022 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-dfb89710-3d7e-43eb-85e3-4c4733fe4719 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:26:16.617470 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-dfb89710-3d7e-43eb-85e3-4c4733fe4719 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:26:16.618353 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-dfb89710-3d7e-43eb-85e3-4c4733fe4719 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:26:16.619092 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-dfb89710-3d7e-43eb-85e3-4c4733fe4719 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:26:16.821302 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-dfb89710-3d7e-43eb-85e3-4c4733fe4719 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f046401c6a04f6495ebe0821120bd72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a58e89ceeea4a9c8a72a1de4bcaf2d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:26:16.829422 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-dfb89710-3d7e-43eb-85e3-4c4733fe4719 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] 10.222.0.11 "GET /compute/v2.1/servers/6dc785d7-bc95-4fee-8206-c2fd3b930e4f" status: 200 len: 1521 microversion: 2.1 time: 0.223535 Nov 17 03:26:16.830076 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 134/252] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:26:16 2021] GET /compute/v2.1/servers/6dc785d7-bc95-4fee-8206-c2fd3b930e4f => generated 1521 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:26:17.595114 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-72409b2d-3e24-4e2d-a4a1-6c3f4c283496 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] 10.222.0.11 "POST /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7/action" status: 200 len: 14 microversion: 2.20 time: 3.060856 Nov 17 03:26:17.596839 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 119/253] 10.222.0.11 () {62 vars in 1318 bytes} [Wed Nov 17 03:26:14 2021] POST /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7/action => generated 14 bytes in 3064 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:26:17.850611 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-0d8704b9-1a14-46db-bda2-bc49f52ae832 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:26:17.851360 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-0d8704b9-1a14-46db-bda2-bc49f52ae832 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] [instance: 6dc785d7-bc95-4fee-8206-c2fd3b930e4f] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:26:17.858029 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-0d8704b9-1a14-46db-bda2-bc49f52ae832 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:26:17.858474 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-0d8704b9-1a14-46db-bda2-bc49f52ae832 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:26:17.859264 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-0d8704b9-1a14-46db-bda2-bc49f52ae832 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:26:17.859916 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-0d8704b9-1a14-46db-bda2-bc49f52ae832 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:26:18.128091 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-0d8704b9-1a14-46db-bda2-bc49f52ae832 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f046401c6a04f6495ebe0821120bd72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a58e89ceeea4a9c8a72a1de4bcaf2d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:26:18.138071 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-0d8704b9-1a14-46db-bda2-bc49f52ae832 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] 10.222.0.11 "GET /compute/v2.1/servers/6dc785d7-bc95-4fee-8206-c2fd3b930e4f" status: 200 len: 1521 microversion: 2.1 time: 0.288994 Nov 17 03:26:18.141101 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 135/254] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:26:17 2021] GET /compute/v2.1/servers/6dc785d7-bc95-4fee-8206-c2fd3b930e4f => generated 1521 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:26:18.609380 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-1944497b-b33a-4056-9070-cd8b48fa9a16 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 17 03:26:18.610951 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-1944497b-b33a-4056-9070-cd8b48fa9a16 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] [instance: 5d54db85-b991-4890-abaa-952413baa2e7] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:26:18.627483 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-1944497b-b33a-4056-9070-cd8b48fa9a16 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:26:18.627955 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-1944497b-b33a-4056-9070-cd8b48fa9a16 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:26:18.639657 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-1944497b-b33a-4056-9070-cd8b48fa9a16 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:26:18.640275 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-1944497b-b33a-4056-9070-cd8b48fa9a16 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:26:18.816385 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-1944497b-b33a-4056-9070-cd8b48fa9a16 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] 10.222.0.11 "POST /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7/action" status: 200 len: 14 microversion: 2.20 time: 0.212349 Nov 17 03:26:18.819731 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 120/255] 10.222.0.11 () {62 vars in 1318 bytes} [Wed Nov 17 03:26:18 2021] POST /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7/action => generated 14 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:26:19.157606 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-de8d9080-735b-46c4-94f7-93b10808b4d8 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:26:19.159342 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-de8d9080-735b-46c4-94f7-93b10808b4d8 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] [instance: 6dc785d7-bc95-4fee-8206-c2fd3b930e4f] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:26:19.165586 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-de8d9080-735b-46c4-94f7-93b10808b4d8 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:26:19.165965 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-de8d9080-735b-46c4-94f7-93b10808b4d8 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:26:19.166813 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-de8d9080-735b-46c4-94f7-93b10808b4d8 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:26:19.167264 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-de8d9080-735b-46c4-94f7-93b10808b4d8 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:26:19.329711 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-de8d9080-735b-46c4-94f7-93b10808b4d8 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f046401c6a04f6495ebe0821120bd72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a58e89ceeea4a9c8a72a1de4bcaf2d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:26:19.337124 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-de8d9080-735b-46c4-94f7-93b10808b4d8 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] 10.222.0.11 "GET /compute/v2.1/servers/6dc785d7-bc95-4fee-8206-c2fd3b930e4f" status: 200 len: 1521 microversion: 2.1 time: 0.183893 Nov 17 03:26:19.337863 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 136/256] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:26:19 2021] GET /compute/v2.1/servers/6dc785d7-bc95-4fee-8206-c2fd3b930e4f => generated 1521 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:26:19.829247 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-c241d161-45e5-43a3-9309-488de964f6ba tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 17 03:26:19.830539 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-c241d161-45e5-43a3-9309-488de964f6ba tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] [instance: 5d54db85-b991-4890-abaa-952413baa2e7] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:26:19.838584 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-c241d161-45e5-43a3-9309-488de964f6ba tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:26:19.839103 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-c241d161-45e5-43a3-9309-488de964f6ba tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:26:19.840096 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-c241d161-45e5-43a3-9309-488de964f6ba tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:26:19.840654 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-c241d161-45e5-43a3-9309-488de964f6ba tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:26:19.964202 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-c241d161-45e5-43a3-9309-488de964f6ba tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] 10.222.0.11 "POST /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7/action" status: 200 len: 14 microversion: 2.20 time: 0.139835 Nov 17 03:26:19.968335 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 121/257] 10.222.0.11 () {62 vars in 1318 bytes} [Wed Nov 17 03:26:19 2021] POST /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7/action => generated 14 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:26:20.048552 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-bfd518c9-6919-4d6c-988d-a365c060f0ef tempest-DeleteServersTestJSON-1805612840 tempest-DeleteServersTestJSON-1805612840-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:26:20.049089 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-bfd518c9-6919-4d6c-988d-a365c060f0ef tempest-DeleteServersTestJSON-1805612840 tempest-DeleteServersTestJSON-1805612840-project] [instance: eaeb6520-bd1e-495e-9ada-744682cbc122] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:26:20.070851 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-bfd518c9-6919-4d6c-988d-a365c060f0ef tempest-DeleteServersTestJSON-1805612840 tempest-DeleteServersTestJSON-1805612840-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:26:20.071467 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-bfd518c9-6919-4d6c-988d-a365c060f0ef tempest-DeleteServersTestJSON-1805612840 tempest-DeleteServersTestJSON-1805612840-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:26:20.072463 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-bfd518c9-6919-4d6c-988d-a365c060f0ef tempest-DeleteServersTestJSON-1805612840 tempest-DeleteServersTestJSON-1805612840-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:26:20.073064 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-bfd518c9-6919-4d6c-988d-a365c060f0ef tempest-DeleteServersTestJSON-1805612840 tempest-DeleteServersTestJSON-1805612840-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:26:20.102967 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-bfd518c9-6919-4d6c-988d-a365c060f0ef tempest-DeleteServersTestJSON-1805612840 tempest-DeleteServersTestJSON-1805612840-project] [instance: eaeb6520-bd1e-495e-9ada-744682cbc122] Going to try to terminate instance {{(pid=115917) delete /opt/stack/nova/nova/compute/api.py:2614}} Nov 17 03:26:20.219571 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-bfd518c9-6919-4d6c-988d-a365c060f0ef tempest-DeleteServersTestJSON-1805612840 tempest-DeleteServersTestJSON-1805612840-project] 10.222.0.11 "DELETE /compute/v2.1/servers/eaeb6520-bd1e-495e-9ada-744682cbc122" status: 204 len: 0 microversion: 2.1 time: 0.175265 Nov 17 03:26:20.222641 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 137/258] 10.222.0.11 () {58 vars in 1238 bytes} [Wed Nov 17 03:26:20 2021] DELETE /compute/v2.1/servers/eaeb6520-bd1e-495e-9ada-744682cbc122 => generated 0 bytes in 181 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 17 03:26:20.232071 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-b6e35ecd-7f89-4abb-9183-4f843f74cc3c tempest-DeleteServersTestJSON-1805612840 tempest-DeleteServersTestJSON-1805612840-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:26:20.233007 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-b6e35ecd-7f89-4abb-9183-4f843f74cc3c tempest-DeleteServersTestJSON-1805612840 tempest-DeleteServersTestJSON-1805612840-project] [instance: eaeb6520-bd1e-495e-9ada-744682cbc122] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:26:20.241496 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-b6e35ecd-7f89-4abb-9183-4f843f74cc3c tempest-DeleteServersTestJSON-1805612840 tempest-DeleteServersTestJSON-1805612840-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:26:20.241939 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-b6e35ecd-7f89-4abb-9183-4f843f74cc3c tempest-DeleteServersTestJSON-1805612840 tempest-DeleteServersTestJSON-1805612840-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:26:20.242949 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-b6e35ecd-7f89-4abb-9183-4f843f74cc3c tempest-DeleteServersTestJSON-1805612840 tempest-DeleteServersTestJSON-1805612840-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:26:20.243755 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-b6e35ecd-7f89-4abb-9183-4f843f74cc3c tempest-DeleteServersTestJSON-1805612840 tempest-DeleteServersTestJSON-1805612840-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:26:20.361623 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-caeab3fb-92af-4f88-a8c6-0bb4bdbf43a4 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:26:20.362900 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-caeab3fb-92af-4f88-a8c6-0bb4bdbf43a4 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] [instance: 6dc785d7-bc95-4fee-8206-c2fd3b930e4f] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:26:20.369923 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-caeab3fb-92af-4f88-a8c6-0bb4bdbf43a4 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:26:20.370850 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-caeab3fb-92af-4f88-a8c6-0bb4bdbf43a4 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:26:20.373003 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-caeab3fb-92af-4f88-a8c6-0bb4bdbf43a4 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:26:20.374053 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-caeab3fb-92af-4f88-a8c6-0bb4bdbf43a4 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:26:20.481997 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-b6e35ecd-7f89-4abb-9183-4f843f74cc3c tempest-DeleteServersTestJSON-1805612840 tempest-DeleteServersTestJSON-1805612840-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65322b3497864a64870eadab1ff7d490', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37560cd5b14f43cd85ee2a3ff2716c33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:26:20.494007 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-b6e35ecd-7f89-4abb-9183-4f843f74cc3c tempest-DeleteServersTestJSON-1805612840 tempest-DeleteServersTestJSON-1805612840-project] 10.222.0.11 "GET /compute/v2.1/servers/eaeb6520-bd1e-495e-9ada-744682cbc122" status: 200 len: 1554 microversion: 2.1 time: 0.266364 Nov 17 03:26:20.494858 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 122/259] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:26:20 2021] GET /compute/v2.1/servers/eaeb6520-bd1e-495e-9ada-744682cbc122 => generated 1554 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:26:20.546264 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-caeab3fb-92af-4f88-a8c6-0bb4bdbf43a4 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f046401c6a04f6495ebe0821120bd72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a58e89ceeea4a9c8a72a1de4bcaf2d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:26:20.561698 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-caeab3fb-92af-4f88-a8c6-0bb4bdbf43a4 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] 10.222.0.11 "GET /compute/v2.1/servers/6dc785d7-bc95-4fee-8206-c2fd3b930e4f" status: 200 len: 1521 microversion: 2.1 time: 0.203787 Nov 17 03:26:20.562338 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 138/260] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:26:20 2021] GET /compute/v2.1/servers/6dc785d7-bc95-4fee-8206-c2fd3b930e4f => generated 1521 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:26:20.976952 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-bb47ab72-98b8-42d2-86fd-da750bb3508c tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 17 03:26:20.978110 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-bb47ab72-98b8-42d2-86fd-da750bb3508c tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] [instance: 5d54db85-b991-4890-abaa-952413baa2e7] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:26:20.984763 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-bb47ab72-98b8-42d2-86fd-da750bb3508c tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:26:20.985232 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-bb47ab72-98b8-42d2-86fd-da750bb3508c tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:26:20.986052 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-bb47ab72-98b8-42d2-86fd-da750bb3508c tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:26:20.986474 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-bb47ab72-98b8-42d2-86fd-da750bb3508c tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:26:21.105964 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-bb47ab72-98b8-42d2-86fd-da750bb3508c tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] 10.222.0.11 "POST /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7/action" status: 200 len: 14 microversion: 2.20 time: 0.133525 Nov 17 03:26:21.111628 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 123/261] 10.222.0.11 () {62 vars in 1318 bytes} [Wed Nov 17 03:26:20 2021] POST /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7/action => generated 14 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:26:21.514041 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-5a28bd9d-3e9c-4fd9-b913-3d5fa7b9163e tempest-DeleteServersTestJSON-1805612840 tempest-DeleteServersTestJSON-1805612840-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:26:21.514646 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-5a28bd9d-3e9c-4fd9-b913-3d5fa7b9163e tempest-DeleteServersTestJSON-1805612840 tempest-DeleteServersTestJSON-1805612840-project] [instance: eaeb6520-bd1e-495e-9ada-744682cbc122] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:26:21.524153 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-5a28bd9d-3e9c-4fd9-b913-3d5fa7b9163e tempest-DeleteServersTestJSON-1805612840 tempest-DeleteServersTestJSON-1805612840-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:26:21.524604 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-5a28bd9d-3e9c-4fd9-b913-3d5fa7b9163e tempest-DeleteServersTestJSON-1805612840 tempest-DeleteServersTestJSON-1805612840-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:26:21.525909 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-5a28bd9d-3e9c-4fd9-b913-3d5fa7b9163e tempest-DeleteServersTestJSON-1805612840 tempest-DeleteServersTestJSON-1805612840-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:26:21.526561 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-5a28bd9d-3e9c-4fd9-b913-3d5fa7b9163e tempest-DeleteServersTestJSON-1805612840 tempest-DeleteServersTestJSON-1805612840-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:26:21.579472 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-c6165ce3-7038-4d69-aaf6-1bfabe658927 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:26:21.580171 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-c6165ce3-7038-4d69-aaf6-1bfabe658927 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] [instance: 6dc785d7-bc95-4fee-8206-c2fd3b930e4f] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:26:21.588719 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-c6165ce3-7038-4d69-aaf6-1bfabe658927 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:26:21.589180 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-c6165ce3-7038-4d69-aaf6-1bfabe658927 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:26:21.590039 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-c6165ce3-7038-4d69-aaf6-1bfabe658927 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:26:21.590383 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-c6165ce3-7038-4d69-aaf6-1bfabe658927 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:26:21.736845 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-5a28bd9d-3e9c-4fd9-b913-3d5fa7b9163e tempest-DeleteServersTestJSON-1805612840 tempest-DeleteServersTestJSON-1805612840-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65322b3497864a64870eadab1ff7d490', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37560cd5b14f43cd85ee2a3ff2716c33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:26:21.747573 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-c6165ce3-7038-4d69-aaf6-1bfabe658927 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f046401c6a04f6495ebe0821120bd72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a58e89ceeea4a9c8a72a1de4bcaf2d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:26:21.755399 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-5a28bd9d-3e9c-4fd9-b913-3d5fa7b9163e tempest-DeleteServersTestJSON-1805612840 tempest-DeleteServersTestJSON-1805612840-project] 10.222.0.11 "GET /compute/v2.1/servers/eaeb6520-bd1e-495e-9ada-744682cbc122" status: 200 len: 1554 microversion: 2.1 time: 0.245169 Nov 17 03:26:21.756833 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-c6165ce3-7038-4d69-aaf6-1bfabe658927 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] 10.222.0.11 "GET /compute/v2.1/servers/6dc785d7-bc95-4fee-8206-c2fd3b930e4f" status: 200 len: 1521 microversion: 2.1 time: 0.181527 Nov 17 03:26:21.757834 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 124/263] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:26:21 2021] GET /compute/v2.1/servers/6dc785d7-bc95-4fee-8206-c2fd3b930e4f => generated 1521 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 17 03:26:21.765654 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 139/263] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:26:21 2021] GET /compute/v2.1/servers/eaeb6520-bd1e-495e-9ada-744682cbc122 => generated 1554 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:26:22.119476 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-b81cdf69-939c-45a3-be1b-7de586760a9a tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 17 03:26:22.120405 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-b81cdf69-939c-45a3-be1b-7de586760a9a tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] [instance: 5d54db85-b991-4890-abaa-952413baa2e7] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:26:22.129900 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-b81cdf69-939c-45a3-be1b-7de586760a9a tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:26:22.130327 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-b81cdf69-939c-45a3-be1b-7de586760a9a tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:26:22.131199 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-b81cdf69-939c-45a3-be1b-7de586760a9a tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:26:22.131724 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-b81cdf69-939c-45a3-be1b-7de586760a9a tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:26:22.261382 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-b81cdf69-939c-45a3-be1b-7de586760a9a tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] 10.222.0.11 "POST /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7/action" status: 200 len: 14 microversion: 2.20 time: 0.145407 Nov 17 03:26:22.261982 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 125/264] 10.222.0.11 () {62 vars in 1318 bytes} [Wed Nov 17 03:26:22 2021] POST /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7/action => generated 14 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:26:22.774070 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-77c0a861-a6a5-4f5c-b19c-b6b4fd7c8239 tempest-DeleteServersTestJSON-1805612840 tempest-DeleteServersTestJSON-1805612840-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:26:22.774543 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-c5d6e8d7-39ac-4f10-bf29-ac0ab37e098f tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:26:22.774628 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-77c0a861-a6a5-4f5c-b19c-b6b4fd7c8239 tempest-DeleteServersTestJSON-1805612840 tempest-DeleteServersTestJSON-1805612840-project] [instance: eaeb6520-bd1e-495e-9ada-744682cbc122] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:26:22.775179 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-c5d6e8d7-39ac-4f10-bf29-ac0ab37e098f tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] [instance: 6dc785d7-bc95-4fee-8206-c2fd3b930e4f] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:26:22.782008 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-77c0a861-a6a5-4f5c-b19c-b6b4fd7c8239 tempest-DeleteServersTestJSON-1805612840 tempest-DeleteServersTestJSON-1805612840-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:26:22.782672 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-77c0a861-a6a5-4f5c-b19c-b6b4fd7c8239 tempest-DeleteServersTestJSON-1805612840 tempest-DeleteServersTestJSON-1805612840-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:26:22.783331 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-c5d6e8d7-39ac-4f10-bf29-ac0ab37e098f tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:26:22.783605 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-77c0a861-a6a5-4f5c-b19c-b6b4fd7c8239 tempest-DeleteServersTestJSON-1805612840 tempest-DeleteServersTestJSON-1805612840-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:26:22.783710 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-c5d6e8d7-39ac-4f10-bf29-ac0ab37e098f tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:26:22.784185 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-77c0a861-a6a5-4f5c-b19c-b6b4fd7c8239 tempest-DeleteServersTestJSON-1805612840 tempest-DeleteServersTestJSON-1805612840-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:26:22.784614 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-c5d6e8d7-39ac-4f10-bf29-ac0ab37e098f tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:26:22.785180 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-c5d6e8d7-39ac-4f10-bf29-ac0ab37e098f tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:26:22.936363 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-c5d6e8d7-39ac-4f10-bf29-ac0ab37e098f tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f046401c6a04f6495ebe0821120bd72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a58e89ceeea4a9c8a72a1de4bcaf2d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:26:22.939727 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-77c0a861-a6a5-4f5c-b19c-b6b4fd7c8239 tempest-DeleteServersTestJSON-1805612840 tempest-DeleteServersTestJSON-1805612840-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65322b3497864a64870eadab1ff7d490', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37560cd5b14f43cd85ee2a3ff2716c33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:26:22.948366 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-77c0a861-a6a5-4f5c-b19c-b6b4fd7c8239 tempest-DeleteServersTestJSON-1805612840 tempest-DeleteServersTestJSON-1805612840-project] 10.222.0.11 "GET /compute/v2.1/servers/eaeb6520-bd1e-495e-9ada-744682cbc122" status: 200 len: 1554 microversion: 2.1 time: 0.177871 Nov 17 03:26:22.949520 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 140/265] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:26:22 2021] GET /compute/v2.1/servers/eaeb6520-bd1e-495e-9ada-744682cbc122 => generated 1554 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:26:22.953378 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-c5d6e8d7-39ac-4f10-bf29-ac0ab37e098f tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] 10.222.0.11 "GET /compute/v2.1/servers/6dc785d7-bc95-4fee-8206-c2fd3b930e4f" status: 200 len: 1521 microversion: 2.1 time: 0.182686 Nov 17 03:26:22.954538 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 126/266] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:26:22 2021] GET /compute/v2.1/servers/6dc785d7-bc95-4fee-8206-c2fd3b930e4f => generated 1521 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:26:23.273615 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-0c97ee76-c314-4519-85ff-20cb2d950daf tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 17 03:26:23.274795 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-0c97ee76-c314-4519-85ff-20cb2d950daf tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] [instance: 5d54db85-b991-4890-abaa-952413baa2e7] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:26:23.280644 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-0c97ee76-c314-4519-85ff-20cb2d950daf tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:26:23.282509 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-0c97ee76-c314-4519-85ff-20cb2d950daf tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:26:23.283490 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-0c97ee76-c314-4519-85ff-20cb2d950daf tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:26:23.284402 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-0c97ee76-c314-4519-85ff-20cb2d950daf tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:26:23.428636 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-0c97ee76-c314-4519-85ff-20cb2d950daf tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] 10.222.0.11 "POST /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7/action" status: 200 len: 14 microversion: 2.20 time: 0.158361 Nov 17 03:26:23.429386 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 141/267] 10.222.0.11 () {62 vars in 1318 bytes} [Wed Nov 17 03:26:23 2021] POST /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7/action => generated 14 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:26:23.668454 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [req-036b5e1d-1800-498f-98e0-9d448b75b019 req-028e0d52-3051-4af5-9dc9-4b9f3c29977c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "eaeb6520-bd1e-495e-9ada-744682cbc122", "name": "network-vif-deleted", "tag": "62a0417d-dfab-44cc-97c9-23c9da049bdf"}]} {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 17 03:26:23.671043 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 17 03:26:23.671043 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: warnings.warn(msg) Nov 17 03:26:23.680117 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [req-036b5e1d-1800-498f-98e0-9d448b75b019 req-028e0d52-3051-4af5-9dc9-4b9f3c29977c service nova] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:26:23.681211 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [req-036b5e1d-1800-498f-98e0-9d448b75b019 req-028e0d52-3051-4af5-9dc9-4b9f3c29977c service nova] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:26:23.700316 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.compute.server_external_events [req-036b5e1d-1800-498f-98e0-9d448b75b019 req-028e0d52-3051-4af5-9dc9-4b9f3c29977c service nova] Creating event network-vif-deleted:62a0417d-dfab-44cc-97c9-23c9da049bdf for instance eaeb6520-bd1e-495e-9ada-744682cbc122 on hv-cinder-81803 Nov 17 03:26:23.705793 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [req-036b5e1d-1800-498f-98e0-9d448b75b019 req-028e0d52-3051-4af5-9dc9-4b9f3c29977c service nova] 10.222.0.11 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041658 Nov 17 03:26:23.706442 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 127/268] 10.222.0.11 () {64 vars in 1317 bytes} [Wed Nov 17 03:26:23 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 17 03:26:23.966462 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-627f38d4-3b91-416e-8db0-67c04e16262a tempest-DeleteServersTestJSON-1805612840 tempest-DeleteServersTestJSON-1805612840-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:26:23.967204 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-627f38d4-3b91-416e-8db0-67c04e16262a tempest-DeleteServersTestJSON-1805612840 tempest-DeleteServersTestJSON-1805612840-project] [instance: eaeb6520-bd1e-495e-9ada-744682cbc122] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:26:23.976997 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-627f38d4-3b91-416e-8db0-67c04e16262a tempest-DeleteServersTestJSON-1805612840 tempest-DeleteServersTestJSON-1805612840-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:26:23.977577 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-ad03a6a1-7ac2-4c24-9a39-6ecb5bd0562a tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:26:23.977878 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-627f38d4-3b91-416e-8db0-67c04e16262a tempest-DeleteServersTestJSON-1805612840 tempest-DeleteServersTestJSON-1805612840-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:26:23.978765 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-ad03a6a1-7ac2-4c24-9a39-6ecb5bd0562a tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] [instance: 6dc785d7-bc95-4fee-8206-c2fd3b930e4f] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:26:23.979024 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-627f38d4-3b91-416e-8db0-67c04e16262a tempest-DeleteServersTestJSON-1805612840 tempest-DeleteServersTestJSON-1805612840-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:26:23.979834 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-627f38d4-3b91-416e-8db0-67c04e16262a tempest-DeleteServersTestJSON-1805612840 tempest-DeleteServersTestJSON-1805612840-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:26:23.987974 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-ad03a6a1-7ac2-4c24-9a39-6ecb5bd0562a tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:26:23.989195 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-ad03a6a1-7ac2-4c24-9a39-6ecb5bd0562a tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:26:23.990398 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-ad03a6a1-7ac2-4c24-9a39-6ecb5bd0562a tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:26:23.991161 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-ad03a6a1-7ac2-4c24-9a39-6ecb5bd0562a tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:26:24.054485 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-627f38d4-3b91-416e-8db0-67c04e16262a tempest-DeleteServersTestJSON-1805612840 tempest-DeleteServersTestJSON-1805612840-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65322b3497864a64870eadab1ff7d490', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37560cd5b14f43cd85ee2a3ff2716c33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:26:24.069083 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-627f38d4-3b91-416e-8db0-67c04e16262a tempest-DeleteServersTestJSON-1805612840 tempest-DeleteServersTestJSON-1805612840-project] 10.222.0.11 "GET /compute/v2.1/servers/eaeb6520-bd1e-495e-9ada-744682cbc122" status: 200 len: 1346 microversion: 2.1 time: 0.106677 Nov 17 03:26:24.070969 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 142/269] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:26:23 2021] GET /compute/v2.1/servers/eaeb6520-bd1e-495e-9ada-744682cbc122 => generated 1346 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:26:24.153504 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-ad03a6a1-7ac2-4c24-9a39-6ecb5bd0562a tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f046401c6a04f6495ebe0821120bd72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a58e89ceeea4a9c8a72a1de4bcaf2d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:26:24.162343 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-ad03a6a1-7ac2-4c24-9a39-6ecb5bd0562a tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] 10.222.0.11 "GET /compute/v2.1/servers/6dc785d7-bc95-4fee-8206-c2fd3b930e4f" status: 200 len: 1521 microversion: 2.1 time: 0.190434 Nov 17 03:26:24.163534 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 128/270] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:26:23 2021] GET /compute/v2.1/servers/6dc785d7-bc95-4fee-8206-c2fd3b930e4f => generated 1521 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 17 03:26:24.441394 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-b877982c-41b1-4581-af8d-5d0b614030b5 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 17 03:26:24.441907 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-b877982c-41b1-4581-af8d-5d0b614030b5 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] [instance: 5d54db85-b991-4890-abaa-952413baa2e7] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:26:24.458065 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-b877982c-41b1-4581-af8d-5d0b614030b5 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:26:24.458598 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-b877982c-41b1-4581-af8d-5d0b614030b5 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:26:24.459608 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-b877982c-41b1-4581-af8d-5d0b614030b5 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:26:24.460032 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-b877982c-41b1-4581-af8d-5d0b614030b5 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:26:24.581549 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-b877982c-41b1-4581-af8d-5d0b614030b5 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] 10.222.0.11 "POST /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7/action" status: 200 len: 14 microversion: 2.20 time: 0.145025 Nov 17 03:26:24.582571 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 143/271] 10.222.0.11 () {62 vars in 1318 bytes} [Wed Nov 17 03:26:24 2021] POST /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7/action => generated 14 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 17 03:26:25.089563 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-91c211f6-0ad3-442a-9160-e39c45e1d0fc tempest-DeleteServersTestJSON-1805612840 tempest-DeleteServersTestJSON-1805612840-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:26:25.094812 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-91c211f6-0ad3-442a-9160-e39c45e1d0fc tempest-DeleteServersTestJSON-1805612840 tempest-DeleteServersTestJSON-1805612840-project] [instance: eaeb6520-bd1e-495e-9ada-744682cbc122] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:26:25.103656 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-91c211f6-0ad3-442a-9160-e39c45e1d0fc tempest-DeleteServersTestJSON-1805612840 tempest-DeleteServersTestJSON-1805612840-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:26:25.104106 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-91c211f6-0ad3-442a-9160-e39c45e1d0fc tempest-DeleteServersTestJSON-1805612840 tempest-DeleteServersTestJSON-1805612840-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:26:25.104924 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-91c211f6-0ad3-442a-9160-e39c45e1d0fc tempest-DeleteServersTestJSON-1805612840 tempest-DeleteServersTestJSON-1805612840-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:26:25.105352 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-91c211f6-0ad3-442a-9160-e39c45e1d0fc tempest-DeleteServersTestJSON-1805612840 tempest-DeleteServersTestJSON-1805612840-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:26:25.173143 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-91c211f6-0ad3-442a-9160-e39c45e1d0fc tempest-DeleteServersTestJSON-1805612840 tempest-DeleteServersTestJSON-1805612840-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:26:25.174164 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-91c211f6-0ad3-442a-9160-e39c45e1d0fc tempest-DeleteServersTestJSON-1805612840 tempest-DeleteServersTestJSON-1805612840-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:26:25.182962 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-a1942354-59b3-4919-b957-7b254fb1fa26 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:26:25.183668 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-a1942354-59b3-4919-b957-7b254fb1fa26 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] [instance: 6dc785d7-bc95-4fee-8206-c2fd3b930e4f] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:26:25.187688 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.objects.instance [None req-91c211f6-0ad3-442a-9160-e39c45e1d0fc tempest-DeleteServersTestJSON-1805612840 tempest-DeleteServersTestJSON-1805612840-project] Lazy-loading 'fault' on Instance uuid eaeb6520-bd1e-495e-9ada-744682cbc122 {{(pid=115916) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Nov 17 03:26:25.193297 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-a1942354-59b3-4919-b957-7b254fb1fa26 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:26:25.193817 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-a1942354-59b3-4919-b957-7b254fb1fa26 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:26:25.194707 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-a1942354-59b3-4919-b957-7b254fb1fa26 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:26:25.195230 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-a1942354-59b3-4919-b957-7b254fb1fa26 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:26:25.237413 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-91c211f6-0ad3-442a-9160-e39c45e1d0fc tempest-DeleteServersTestJSON-1805612840 tempest-DeleteServersTestJSON-1805612840-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65322b3497864a64870eadab1ff7d490', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37560cd5b14f43cd85ee2a3ff2716c33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:26:25.243917 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-91c211f6-0ad3-442a-9160-e39c45e1d0fc tempest-DeleteServersTestJSON-1805612840 tempest-DeleteServersTestJSON-1805612840-project] 10.222.0.11 "GET /compute/v2.1/servers/eaeb6520-bd1e-495e-9ada-744682cbc122" status: 200 len: 1305 microversion: 2.1 time: 0.159374 Nov 17 03:26:25.245439 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 129/272] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:26:25 2021] GET /compute/v2.1/servers/eaeb6520-bd1e-495e-9ada-744682cbc122 => generated 1305 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:26:25.361742 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-a1942354-59b3-4919-b957-7b254fb1fa26 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f046401c6a04f6495ebe0821120bd72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a58e89ceeea4a9c8a72a1de4bcaf2d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:26:25.369473 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-a1942354-59b3-4919-b957-7b254fb1fa26 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] 10.222.0.11 "GET /compute/v2.1/servers/6dc785d7-bc95-4fee-8206-c2fd3b930e4f" status: 200 len: 1521 microversion: 2.1 time: 0.193176 Nov 17 03:26:25.379565 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 144/273] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:26:25 2021] GET /compute/v2.1/servers/6dc785d7-bc95-4fee-8206-c2fd3b930e4f => generated 1521 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:26:25.592391 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-2b6ac968-f7fa-47b9-8662-59ed55efc4d8 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 17 03:26:25.602061 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-2b6ac968-f7fa-47b9-8662-59ed55efc4d8 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] [instance: 5d54db85-b991-4890-abaa-952413baa2e7] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:26:25.613904 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-2b6ac968-f7fa-47b9-8662-59ed55efc4d8 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:26:25.614595 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-2b6ac968-f7fa-47b9-8662-59ed55efc4d8 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:26:25.615746 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-2b6ac968-f7fa-47b9-8662-59ed55efc4d8 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:26:25.616447 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-2b6ac968-f7fa-47b9-8662-59ed55efc4d8 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:26:25.720729 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-2b6ac968-f7fa-47b9-8662-59ed55efc4d8 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] 10.222.0.11 "POST /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7/action" status: 200 len: 14 microversion: 2.20 time: 0.131913 Nov 17 03:26:25.724238 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 130/274] 10.222.0.11 () {62 vars in 1318 bytes} [Wed Nov 17 03:26:25 2021] POST /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7/action => generated 14 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:26:26.263651 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-07c55ab7-5598-4a6d-849e-3b9887cd7c24 tempest-DeleteServersTestJSON-1805612840 tempest-DeleteServersTestJSON-1805612840-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:26:26.265473 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-07c55ab7-5598-4a6d-849e-3b9887cd7c24 tempest-DeleteServersTestJSON-1805612840 tempest-DeleteServersTestJSON-1805612840-project] [instance: eaeb6520-bd1e-495e-9ada-744682cbc122] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:26:26.275880 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-07c55ab7-5598-4a6d-849e-3b9887cd7c24 tempest-DeleteServersTestJSON-1805612840 tempest-DeleteServersTestJSON-1805612840-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:26:26.277120 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-07c55ab7-5598-4a6d-849e-3b9887cd7c24 tempest-DeleteServersTestJSON-1805612840 tempest-DeleteServersTestJSON-1805612840-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:26:26.278852 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-07c55ab7-5598-4a6d-849e-3b9887cd7c24 tempest-DeleteServersTestJSON-1805612840 tempest-DeleteServersTestJSON-1805612840-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:26:26.279507 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-07c55ab7-5598-4a6d-849e-3b9887cd7c24 tempest-DeleteServersTestJSON-1805612840 tempest-DeleteServersTestJSON-1805612840-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:26:26.305163 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.wsgi [None req-07c55ab7-5598-4a6d-849e-3b9887cd7c24 tempest-DeleteServersTestJSON-1805612840 tempest-DeleteServersTestJSON-1805612840-project] HTTP exception thrown: Instance eaeb6520-bd1e-495e-9ada-744682cbc122 could not be found. Nov 17 03:26:26.306254 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-07c55ab7-5598-4a6d-849e-3b9887cd7c24 tempest-DeleteServersTestJSON-1805612840 tempest-DeleteServersTestJSON-1805612840-project] Returning 404 to user: Instance eaeb6520-bd1e-495e-9ada-744682cbc122 could not be found. {{(pid=115917) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 17 03:26:26.307664 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-07c55ab7-5598-4a6d-849e-3b9887cd7c24 tempest-DeleteServersTestJSON-1805612840 tempest-DeleteServersTestJSON-1805612840-project] 10.222.0.11 "GET /compute/v2.1/servers/eaeb6520-bd1e-495e-9ada-744682cbc122" status: 404 len: 111 microversion: 2.1 time: 0.049720 Nov 17 03:26:26.312750 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 145/275] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:26:26 2021] GET /compute/v2.1/servers/eaeb6520-bd1e-495e-9ada-744682cbc122 => generated 111 bytes in 56 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 17 03:26:26.387992 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-142bb3fa-f3e8-4a27-b981-d7e7c996d89b tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:26:26.391622 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-142bb3fa-f3e8-4a27-b981-d7e7c996d89b tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] [instance: 6dc785d7-bc95-4fee-8206-c2fd3b930e4f] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:26:26.400802 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-142bb3fa-f3e8-4a27-b981-d7e7c996d89b tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:26:26.402463 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-142bb3fa-f3e8-4a27-b981-d7e7c996d89b tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:26:26.403385 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-142bb3fa-f3e8-4a27-b981-d7e7c996d89b tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:26:26.405539 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-142bb3fa-f3e8-4a27-b981-d7e7c996d89b tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:26:26.476291 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-6471c248-2608-465e-95ae-b185e39c57f2 tempest-DeleteServersTestJSON-1805612840 tempest-DeleteServersTestJSON-1805612840-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:26:26.477572 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-6471c248-2608-465e-95ae-b185e39c57f2 tempest-DeleteServersTestJSON-1805612840 tempest-DeleteServersTestJSON-1805612840-project] [instance: eaeb6520-bd1e-495e-9ada-744682cbc122] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:26:26.484763 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-6471c248-2608-465e-95ae-b185e39c57f2 tempest-DeleteServersTestJSON-1805612840 tempest-DeleteServersTestJSON-1805612840-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:26:26.485452 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-6471c248-2608-465e-95ae-b185e39c57f2 tempest-DeleteServersTestJSON-1805612840 tempest-DeleteServersTestJSON-1805612840-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:26:26.486516 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-6471c248-2608-465e-95ae-b185e39c57f2 tempest-DeleteServersTestJSON-1805612840 tempest-DeleteServersTestJSON-1805612840-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:26:26.487149 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-6471c248-2608-465e-95ae-b185e39c57f2 tempest-DeleteServersTestJSON-1805612840 tempest-DeleteServersTestJSON-1805612840-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:26:26.502109 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.wsgi [None req-6471c248-2608-465e-95ae-b185e39c57f2 tempest-DeleteServersTestJSON-1805612840 tempest-DeleteServersTestJSON-1805612840-project] HTTP exception thrown: Instance eaeb6520-bd1e-495e-9ada-744682cbc122 could not be found. Nov 17 03:26:26.502712 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-6471c248-2608-465e-95ae-b185e39c57f2 tempest-DeleteServersTestJSON-1805612840 tempest-DeleteServersTestJSON-1805612840-project] Returning 404 to user: Instance eaeb6520-bd1e-495e-9ada-744682cbc122 could not be found. {{(pid=115917) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 17 03:26:26.503541 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-6471c248-2608-465e-95ae-b185e39c57f2 tempest-DeleteServersTestJSON-1805612840 tempest-DeleteServersTestJSON-1805612840-project] 10.222.0.11 "GET /compute/v2.1/servers/eaeb6520-bd1e-495e-9ada-744682cbc122/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.031109 Nov 17 03:26:26.504919 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 146/276] 10.222.0.11 () {58 vars in 1301 bytes} [Wed Nov 17 03:26:26 2021] GET /compute/v2.1/servers/eaeb6520-bd1e-495e-9ada-744682cbc122/os-volume_attachments => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 17 03:26:26.722956 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-142bb3fa-f3e8-4a27-b981-d7e7c996d89b tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f046401c6a04f6495ebe0821120bd72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a58e89ceeea4a9c8a72a1de4bcaf2d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:26:26.732064 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-69e59cee-55de-4c62-b646-44ec69cf4c40 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 17 03:26:26.733069 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-69e59cee-55de-4c62-b646-44ec69cf4c40 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] [instance: 5d54db85-b991-4890-abaa-952413baa2e7] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:26:26.734958 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-142bb3fa-f3e8-4a27-b981-d7e7c996d89b tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] 10.222.0.11 "GET /compute/v2.1/servers/6dc785d7-bc95-4fee-8206-c2fd3b930e4f" status: 200 len: 1521 microversion: 2.1 time: 0.352225 Nov 17 03:26:26.735862 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 131/277] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:26:26 2021] GET /compute/v2.1/servers/6dc785d7-bc95-4fee-8206-c2fd3b930e4f => generated 1521 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:26:26.750985 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-69e59cee-55de-4c62-b646-44ec69cf4c40 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:26:26.751438 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-69e59cee-55de-4c62-b646-44ec69cf4c40 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:26:26.752314 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-69e59cee-55de-4c62-b646-44ec69cf4c40 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:26:26.752750 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-69e59cee-55de-4c62-b646-44ec69cf4c40 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:26:26.938091 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-69e59cee-55de-4c62-b646-44ec69cf4c40 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] 10.222.0.11 "POST /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7/action" status: 200 len: 14 microversion: 2.20 time: 0.210006 Nov 17 03:26:26.939755 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 147/278] 10.222.0.11 () {62 vars in 1318 bytes} [Wed Nov 17 03:26:26 2021] POST /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7/action => generated 14 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 17 03:26:27.756724 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-07da2367-8409-4091-9d67-951b14f094c0 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:26:27.757585 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-07da2367-8409-4091-9d67-951b14f094c0 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] [instance: 6dc785d7-bc95-4fee-8206-c2fd3b930e4f] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:26:27.769325 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-07da2367-8409-4091-9d67-951b14f094c0 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:26:27.770444 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-07da2367-8409-4091-9d67-951b14f094c0 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:26:27.771904 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-07da2367-8409-4091-9d67-951b14f094c0 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:26:27.772634 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-07da2367-8409-4091-9d67-951b14f094c0 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:26:27.817070 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-267e453e-e26e-4fea-bbdb-2c46d52ebe03 tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1593414591", "imageRef": "7281a37a-6b99-49c1-881a-41604d06bae1", "flavorRef": "452", "networks": [{"uuid": "35db41f0-fe89-4e18-9f58-e0afb8774292"}]}} {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 17 03:26:27.894632 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.network.neutron [None req-267e453e-e26e-4fea-bbdb-2c46d52ebe03 tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] validate_networks() for [('35db41f0-fe89-4e18-9f58-e0afb8774292', None, None, None, None, None)] {{(pid=115917) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Nov 17 03:26:27.949311 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-07da2367-8409-4091-9d67-951b14f094c0 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f046401c6a04f6495ebe0821120bd72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a58e89ceeea4a9c8a72a1de4bcaf2d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:26:27.958797 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-07da2367-8409-4091-9d67-951b14f094c0 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] 10.222.0.11 "GET /compute/v2.1/servers/6dc785d7-bc95-4fee-8206-c2fd3b930e4f" status: 200 len: 1521 microversion: 2.1 time: 0.206624 Nov 17 03:26:27.959576 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 132/279] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:26:27 2021] GET /compute/v2.1/servers/6dc785d7-bc95-4fee-8206-c2fd3b930e4f => generated 1521 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 17 03:26:27.964196 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-7036b1bd-c0e2-4749-a134-a0cd46f66f1f tempest-DeleteServersTestJSON-1805612840 tempest-DeleteServersTestJSON-1805612840-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:26:27.964679 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-7036b1bd-c0e2-4749-a134-a0cd46f66f1f tempest-DeleteServersTestJSON-1805612840 tempest-DeleteServersTestJSON-1805612840-project] [instance: eaeb6520-bd1e-495e-9ada-744682cbc122] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:26:27.971037 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-7036b1bd-c0e2-4749-a134-a0cd46f66f1f tempest-DeleteServersTestJSON-1805612840 tempest-DeleteServersTestJSON-1805612840-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:26:27.971474 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-7036b1bd-c0e2-4749-a134-a0cd46f66f1f tempest-DeleteServersTestJSON-1805612840 tempest-DeleteServersTestJSON-1805612840-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:26:27.972433 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-7036b1bd-c0e2-4749-a134-a0cd46f66f1f tempest-DeleteServersTestJSON-1805612840 tempest-DeleteServersTestJSON-1805612840-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:26:27.973032 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-7036b1bd-c0e2-4749-a134-a0cd46f66f1f tempest-DeleteServersTestJSON-1805612840 tempest-DeleteServersTestJSON-1805612840-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:26:27.988450 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.wsgi [None req-7036b1bd-c0e2-4749-a134-a0cd46f66f1f tempest-DeleteServersTestJSON-1805612840 tempest-DeleteServersTestJSON-1805612840-project] HTTP exception thrown: Instance eaeb6520-bd1e-495e-9ada-744682cbc122 could not be found. Nov 17 03:26:27.989353 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-7036b1bd-c0e2-4749-a134-a0cd46f66f1f tempest-DeleteServersTestJSON-1805612840 tempest-DeleteServersTestJSON-1805612840-project] Returning 404 to user: Instance eaeb6520-bd1e-495e-9ada-744682cbc122 could not be found. {{(pid=115916) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 17 03:26:27.990540 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-7036b1bd-c0e2-4749-a134-a0cd46f66f1f tempest-DeleteServersTestJSON-1805612840 tempest-DeleteServersTestJSON-1805612840-project] 10.222.0.11 "DELETE /compute/v2.1/servers/eaeb6520-bd1e-495e-9ada-744682cbc122" status: 404 len: 111 microversion: 2.1 time: 0.029780 Nov 17 03:26:27.991605 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 133/280] 10.222.0.11 () {58 vars in 1238 bytes} [Wed Nov 17 03:26:27 2021] DELETE /compute/v2.1/servers/eaeb6520-bd1e-495e-9ada-744682cbc122 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 17 03:26:27.997167 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-50f542f1-1442-43c8-94ed-7517fdfdfa0c tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 17 03:26:27.998439 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-50f542f1-1442-43c8-94ed-7517fdfdfa0c tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] [instance: 5d54db85-b991-4890-abaa-952413baa2e7] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:26:28.008110 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-50f542f1-1442-43c8-94ed-7517fdfdfa0c tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:26:28.008724 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-50f542f1-1442-43c8-94ed-7517fdfdfa0c tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:26:28.009685 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-50f542f1-1442-43c8-94ed-7517fdfdfa0c tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:26:28.010116 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-50f542f1-1442-43c8-94ed-7517fdfdfa0c tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:26:28.120197 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-50f542f1-1442-43c8-94ed-7517fdfdfa0c tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] 10.222.0.11 "POST /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7/action" status: 200 len: 6451 microversion: 2.20 time: 0.127214 Nov 17 03:26:28.124054 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 134/281] 10.222.0.11 () {62 vars in 1318 bytes} [Wed Nov 17 03:26:27 2021] POST /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7/action => generated 6451 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 17 03:26:28.126344 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-e5b052b6-8e37-431a-8fa1-18bd27666f9e tempest-DeleteServersTestJSON-1805612840 tempest-DeleteServersTestJSON-1805612840-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:26:28.127047 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-e5b052b6-8e37-431a-8fa1-18bd27666f9e tempest-DeleteServersTestJSON-1805612840 tempest-DeleteServersTestJSON-1805612840-project] [instance: eaeb6520-bd1e-495e-9ada-744682cbc122] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:26:28.133849 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-e5b052b6-8e37-431a-8fa1-18bd27666f9e tempest-DeleteServersTestJSON-1805612840 tempest-DeleteServersTestJSON-1805612840-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:26:28.134294 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-e5b052b6-8e37-431a-8fa1-18bd27666f9e tempest-DeleteServersTestJSON-1805612840 tempest-DeleteServersTestJSON-1805612840-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:26:28.135064 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-e5b052b6-8e37-431a-8fa1-18bd27666f9e tempest-DeleteServersTestJSON-1805612840 tempest-DeleteServersTestJSON-1805612840-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:26:28.135649 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-e5b052b6-8e37-431a-8fa1-18bd27666f9e tempest-DeleteServersTestJSON-1805612840 tempest-DeleteServersTestJSON-1805612840-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:26:28.151162 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.wsgi [None req-e5b052b6-8e37-431a-8fa1-18bd27666f9e tempest-DeleteServersTestJSON-1805612840 tempest-DeleteServersTestJSON-1805612840-project] HTTP exception thrown: Instance eaeb6520-bd1e-495e-9ada-744682cbc122 could not be found. Nov 17 03:26:28.152011 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-e5b052b6-8e37-431a-8fa1-18bd27666f9e tempest-DeleteServersTestJSON-1805612840 tempest-DeleteServersTestJSON-1805612840-project] Returning 404 to user: Instance eaeb6520-bd1e-495e-9ada-744682cbc122 could not be found. {{(pid=115916) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 17 03:26:28.153228 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-e5b052b6-8e37-431a-8fa1-18bd27666f9e tempest-DeleteServersTestJSON-1805612840 tempest-DeleteServersTestJSON-1805612840-project] 10.222.0.11 "GET /compute/v2.1/servers/eaeb6520-bd1e-495e-9ada-744682cbc122" status: 404 len: 111 microversion: 2.1 time: 0.031087 Nov 17 03:26:28.154310 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 135/282] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:26:28 2021] GET /compute/v2.1/servers/eaeb6520-bd1e-495e-9ada-744682cbc122 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 17 03:26:28.383655 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.virt.hardware [None req-267e453e-e26e-4fea-bbdb-2c46d52ebe03 tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] Flavor limits 0:0:0 {{(pid=115917) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 17 03:26:28.384196 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.virt.hardware [None req-267e453e-e26e-4fea-bbdb-2c46d52ebe03 tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] Image limits 0:0:0 {{(pid=115917) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 17 03:26:28.384530 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.virt.hardware [None req-267e453e-e26e-4fea-bbdb-2c46d52ebe03 tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] Flavor pref 0:0:0 {{(pid=115917) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 17 03:26:28.384967 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.virt.hardware [None req-267e453e-e26e-4fea-bbdb-2c46d52ebe03 tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] Image pref 0:0:0 {{(pid=115917) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 17 03:26:28.385588 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.virt.hardware [None req-267e453e-e26e-4fea-bbdb-2c46d52ebe03 tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=115917) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 17 03:26:28.399801 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-267e453e-e26e-4fea-bbdb-2c46d52ebe03 tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:26:28.404790 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-267e453e-e26e-4fea-bbdb-2c46d52ebe03 tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:26:28.406655 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-267e453e-e26e-4fea-bbdb-2c46d52ebe03 tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:26:28.408503 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-267e453e-e26e-4fea-bbdb-2c46d52ebe03 tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:26:28.457874 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.quota [None req-267e453e-e26e-4fea-bbdb-2c46d52ebe03 tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] Getting quotas for project dfc480343d4d493bb4295b055e274df5. Resources: {'instances', 'ram', 'cores'} {{(pid=115917) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 17 03:26:28.474736 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.quota [None req-267e453e-e26e-4fea-bbdb-2c46d52ebe03 tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] Getting quotas for user 6d4e8ac9538f42c9b637bd9e086668b3 and project dfc480343d4d493bb4295b055e274df5. Resources: {'instances', 'ram', 'cores'} {{(pid=115917) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 17 03:26:28.505631 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-267e453e-e26e-4fea-bbdb-2c46d52ebe03 tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] Going to run 1 instances... {{(pid=115917) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 17 03:26:28.512093 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-267e453e-e26e-4fea-bbdb-2c46d52ebe03 tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] [instance: 645ba67f-2582-4a60-b013-84777a71a70d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='7281a37a-6b99-49c1-881a-41604d06bae1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=115917) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 17 03:26:28.603534 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-267e453e-e26e-4fea-bbdb-2c46d52ebe03 tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] 10.222.0.11 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.793293 Nov 17 03:26:28.604182 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 148/283] 10.222.0.11 () {60 vars in 1146 bytes} [Wed Nov 17 03:26:27 2021] POST /compute/v2.1/servers => generated 380 bytes in 795 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Nov 17 03:26:28.616128 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-be195c0c-062f-4d57-8583-e3d8a5f73522 tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:26:28.616839 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-be195c0c-062f-4d57-8583-e3d8a5f73522 tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] [instance: 645ba67f-2582-4a60-b013-84777a71a70d] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:26:28.857446 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-be195c0c-062f-4d57-8583-e3d8a5f73522 tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d4e8ac9538f42c9b637bd9e086668b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfc480343d4d493bb4295b055e274df5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:26:28.866249 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-be195c0c-062f-4d57-8583-e3d8a5f73522 tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] 10.222.0.11 "GET /compute/v2.1/servers/645ba67f-2582-4a60-b013-84777a71a70d" status: 200 len: 1218 microversion: 2.1 time: 0.255412 Nov 17 03:26:28.877182 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 136/284] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:26:28 2021] GET /compute/v2.1/servers/645ba67f-2582-4a60-b013-84777a71a70d => generated 1218 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:26:28.976764 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-280a3b9b-6e0a-464f-b0ce-c2f026800e55 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:26:28.977666 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-280a3b9b-6e0a-464f-b0ce-c2f026800e55 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] [instance: 6dc785d7-bc95-4fee-8206-c2fd3b930e4f] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:26:28.986847 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-280a3b9b-6e0a-464f-b0ce-c2f026800e55 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:26:28.987327 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-280a3b9b-6e0a-464f-b0ce-c2f026800e55 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:26:28.988186 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-280a3b9b-6e0a-464f-b0ce-c2f026800e55 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:26:28.988694 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-280a3b9b-6e0a-464f-b0ce-c2f026800e55 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:26:29.132288 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-08767b81-fa6f-4aa7-a01e-c3bc1dd86073 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 17 03:26:29.133774 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-08767b81-fa6f-4aa7-a01e-c3bc1dd86073 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] [instance: 5d54db85-b991-4890-abaa-952413baa2e7] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:26:29.144378 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-08767b81-fa6f-4aa7-a01e-c3bc1dd86073 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:26:29.146957 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-08767b81-fa6f-4aa7-a01e-c3bc1dd86073 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:26:29.147897 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-08767b81-fa6f-4aa7-a01e-c3bc1dd86073 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:26:29.148622 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-08767b81-fa6f-4aa7-a01e-c3bc1dd86073 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:26:29.225553 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-280a3b9b-6e0a-464f-b0ce-c2f026800e55 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f046401c6a04f6495ebe0821120bd72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a58e89ceeea4a9c8a72a1de4bcaf2d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:26:29.241764 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-280a3b9b-6e0a-464f-b0ce-c2f026800e55 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] 10.222.0.11 "GET /compute/v2.1/servers/6dc785d7-bc95-4fee-8206-c2fd3b930e4f" status: 200 len: 1521 microversion: 2.1 time: 0.269729 Nov 17 03:26:29.242323 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 149/285] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:26:28 2021] GET /compute/v2.1/servers/6dc785d7-bc95-4fee-8206-c2fd3b930e4f => generated 1521 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:26:29.270123 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-08767b81-fa6f-4aa7-a01e-c3bc1dd86073 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] 10.222.0.11 "POST /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7/action" status: 200 len: 12563 microversion: 2.20 time: 0.142128 Nov 17 03:26:29.271852 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 137/286] 10.222.0.11 () {62 vars in 1318 bytes} [Wed Nov 17 03:26:29 2021] POST /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7/action => generated 12563 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 17 03:26:29.883583 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-b1717861-dc51-4025-8e1d-e0b9ed7f030d tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:26:29.884709 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-b1717861-dc51-4025-8e1d-e0b9ed7f030d tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] [instance: 645ba67f-2582-4a60-b013-84777a71a70d] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:26:29.892489 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-b1717861-dc51-4025-8e1d-e0b9ed7f030d tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:26:29.893037 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-b1717861-dc51-4025-8e1d-e0b9ed7f030d tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:26:29.893945 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-b1717861-dc51-4025-8e1d-e0b9ed7f030d tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:26:29.894717 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-b1717861-dc51-4025-8e1d-e0b9ed7f030d tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:26:29.966553 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-b1717861-dc51-4025-8e1d-e0b9ed7f030d tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d4e8ac9538f42c9b637bd9e086668b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfc480343d4d493bb4295b055e274df5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:26:29.973929 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-b1717861-dc51-4025-8e1d-e0b9ed7f030d tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] 10.222.0.11 "GET /compute/v2.1/servers/645ba67f-2582-4a60-b013-84777a71a70d" status: 200 len: 1270 microversion: 2.1 time: 0.094212 Nov 17 03:26:29.974515 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 150/287] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:26:29 2021] GET /compute/v2.1/servers/645ba67f-2582-4a60-b013-84777a71a70d => generated 1270 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:26:30.261027 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-b3080866-41bd-410e-b4ad-80aeaa505c94 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:26:30.262514 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-b3080866-41bd-410e-b4ad-80aeaa505c94 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] [instance: 6dc785d7-bc95-4fee-8206-c2fd3b930e4f] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:26:30.274499 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-b3080866-41bd-410e-b4ad-80aeaa505c94 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:26:30.275271 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-b3080866-41bd-410e-b4ad-80aeaa505c94 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:26:30.276339 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-b3080866-41bd-410e-b4ad-80aeaa505c94 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:26:30.285067 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-931900d6-f3d6-4b3f-b776-0f5851336162 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 17 03:26:30.286758 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-931900d6-f3d6-4b3f-b776-0f5851336162 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] [instance: 5d54db85-b991-4890-abaa-952413baa2e7] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:26:30.293018 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-b3080866-41bd-410e-b4ad-80aeaa505c94 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:26:30.298396 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-931900d6-f3d6-4b3f-b776-0f5851336162 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:26:30.299120 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-931900d6-f3d6-4b3f-b776-0f5851336162 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:26:30.300824 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-931900d6-f3d6-4b3f-b776-0f5851336162 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:26:30.301471 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-931900d6-f3d6-4b3f-b776-0f5851336162 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:26:30.446153 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-931900d6-f3d6-4b3f-b776-0f5851336162 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] 10.222.0.11 "POST /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7/action" status: 200 len: 16365 microversion: 2.20 time: 0.167089 Nov 17 03:26:30.449899 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 151/288] 10.222.0.11 () {62 vars in 1318 bytes} [Wed Nov 17 03:26:30 2021] POST /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7/action => generated 16365 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 17 03:26:30.561726 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-b3080866-41bd-410e-b4ad-80aeaa505c94 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f046401c6a04f6495ebe0821120bd72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a58e89ceeea4a9c8a72a1de4bcaf2d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:26:30.572176 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-b3080866-41bd-410e-b4ad-80aeaa505c94 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] 10.222.0.11 "GET /compute/v2.1/servers/6dc785d7-bc95-4fee-8206-c2fd3b930e4f" status: 200 len: 1521 microversion: 2.1 time: 0.316735 Nov 17 03:26:30.573092 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 138/289] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:26:30 2021] GET /compute/v2.1/servers/6dc785d7-bc95-4fee-8206-c2fd3b930e4f => generated 1521 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 17 03:26:30.993444 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-53f0b3be-d66a-4ece-bb70-80d75795e4ea tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:26:30.994703 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-53f0b3be-d66a-4ece-bb70-80d75795e4ea tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] [instance: 645ba67f-2582-4a60-b013-84777a71a70d] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:26:31.010761 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-53f0b3be-d66a-4ece-bb70-80d75795e4ea tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:26:31.011922 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-53f0b3be-d66a-4ece-bb70-80d75795e4ea tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:26:31.012977 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-53f0b3be-d66a-4ece-bb70-80d75795e4ea tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:26:31.013413 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-53f0b3be-d66a-4ece-bb70-80d75795e4ea tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:26:31.350042 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-53f0b3be-d66a-4ece-bb70-80d75795e4ea tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d4e8ac9538f42c9b637bd9e086668b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfc480343d4d493bb4295b055e274df5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:26:31.365941 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-53f0b3be-d66a-4ece-bb70-80d75795e4ea tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] 10.222.0.11 "GET /compute/v2.1/servers/645ba67f-2582-4a60-b013-84777a71a70d" status: 200 len: 1318 microversion: 2.1 time: 0.375543 Nov 17 03:26:31.378919 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 152/290] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:26:30 2021] GET /compute/v2.1/servers/645ba67f-2582-4a60-b013-84777a71a70d => generated 1318 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:26:31.457551 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-0e75ca8c-a246-4107-84a3-a05fda355267 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 17 03:26:31.459612 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-0e75ca8c-a246-4107-84a3-a05fda355267 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] [instance: 5d54db85-b991-4890-abaa-952413baa2e7] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:26:31.467038 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-0e75ca8c-a246-4107-84a3-a05fda355267 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:26:31.467482 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-0e75ca8c-a246-4107-84a3-a05fda355267 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:26:31.468705 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-0e75ca8c-a246-4107-84a3-a05fda355267 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:26:31.469372 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-0e75ca8c-a246-4107-84a3-a05fda355267 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:26:31.591518 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-9d4480a0-de40-411d-a478-e079ed3d93e1 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:26:31.592147 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-9d4480a0-de40-411d-a478-e079ed3d93e1 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] [instance: 6dc785d7-bc95-4fee-8206-c2fd3b930e4f] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:26:31.599543 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-9d4480a0-de40-411d-a478-e079ed3d93e1 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:26:31.600148 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-9d4480a0-de40-411d-a478-e079ed3d93e1 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:26:31.601250 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-9d4480a0-de40-411d-a478-e079ed3d93e1 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:26:31.601772 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-9d4480a0-de40-411d-a478-e079ed3d93e1 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:26:31.890777 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-9d4480a0-de40-411d-a478-e079ed3d93e1 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f046401c6a04f6495ebe0821120bd72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a58e89ceeea4a9c8a72a1de4bcaf2d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:26:31.905550 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-9d4480a0-de40-411d-a478-e079ed3d93e1 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] 10.222.0.11 "GET /compute/v2.1/servers/6dc785d7-bc95-4fee-8206-c2fd3b930e4f" status: 200 len: 1521 microversion: 2.1 time: 0.320040 Nov 17 03:26:31.916027 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 153/291] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:26:31 2021] GET /compute/v2.1/servers/6dc785d7-bc95-4fee-8206-c2fd3b930e4f => generated 1521 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 17 03:26:31.921003 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [req-e82c5e35-bce1-44cb-a15c-d68abef04659 req-833e688f-3cb0-4a7c-be64-5ec2012eab21 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "645ba67f-2582-4a60-b013-84777a71a70d", "tag": "0ebffcbf-ae21-4111-bfbb-365005048a48"}]} {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 17 03:26:31.922514 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 17 03:26:31.922514 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: warnings.warn(msg) Nov 17 03:26:31.929583 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [req-e82c5e35-bce1-44cb-a15c-d68abef04659 req-833e688f-3cb0-4a7c-be64-5ec2012eab21 service nova] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:26:31.930310 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [req-e82c5e35-bce1-44cb-a15c-d68abef04659 req-833e688f-3cb0-4a7c-be64-5ec2012eab21 service nova] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:26:31.947395 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.compute.server_external_events [req-e82c5e35-bce1-44cb-a15c-d68abef04659 req-833e688f-3cb0-4a7c-be64-5ec2012eab21 service nova] Creating event network-changed:0ebffcbf-ae21-4111-bfbb-365005048a48 for instance 645ba67f-2582-4a60-b013-84777a71a70d on hv-cinder-81803 Nov 17 03:26:31.954049 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [req-e82c5e35-bce1-44cb-a15c-d68abef04659 req-833e688f-3cb0-4a7c-be64-5ec2012eab21 service nova] 10.222.0.11 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036754 Nov 17 03:26:31.954648 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 154/292] 10.222.0.11 () {64 vars in 1317 bytes} [Wed Nov 17 03:26:31 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 17 03:26:32.389243 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-e09ffbfd-40eb-4c0f-8837-275854557aee tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:26:32.390564 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-e09ffbfd-40eb-4c0f-8837-275854557aee tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] [instance: 645ba67f-2582-4a60-b013-84777a71a70d] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:26:32.402670 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-e09ffbfd-40eb-4c0f-8837-275854557aee tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:26:32.403404 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-e09ffbfd-40eb-4c0f-8837-275854557aee tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:26:32.404280 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-e09ffbfd-40eb-4c0f-8837-275854557aee tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:26:32.405220 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-e09ffbfd-40eb-4c0f-8837-275854557aee tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:26:32.543907 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-e09ffbfd-40eb-4c0f-8837-275854557aee tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d4e8ac9538f42c9b637bd9e086668b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfc480343d4d493bb4295b055e274df5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:26:32.551397 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-e09ffbfd-40eb-4c0f-8837-275854557aee tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] 10.222.0.11 "GET /compute/v2.1/servers/645ba67f-2582-4a60-b013-84777a71a70d" status: 200 len: 1318 microversion: 2.1 time: 0.167593 Nov 17 03:26:32.551977 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 155/293] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:26:32 2021] GET /compute/v2.1/servers/645ba67f-2582-4a60-b013-84777a71a70d => generated 1318 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:26:32.922892 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-198a8e7d-1308-409d-92b0-068dfb463069 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:26:32.923829 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-198a8e7d-1308-409d-92b0-068dfb463069 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] [instance: 6dc785d7-bc95-4fee-8206-c2fd3b930e4f] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:26:32.930330 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-198a8e7d-1308-409d-92b0-068dfb463069 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:26:32.930973 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-198a8e7d-1308-409d-92b0-068dfb463069 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:26:32.931839 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-198a8e7d-1308-409d-92b0-068dfb463069 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:26:32.932706 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-198a8e7d-1308-409d-92b0-068dfb463069 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:26:33.069672 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-198a8e7d-1308-409d-92b0-068dfb463069 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f046401c6a04f6495ebe0821120bd72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a58e89ceeea4a9c8a72a1de4bcaf2d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:26:33.077208 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-198a8e7d-1308-409d-92b0-068dfb463069 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] 10.222.0.11 "GET /compute/v2.1/servers/6dc785d7-bc95-4fee-8206-c2fd3b930e4f" status: 200 len: 1521 microversion: 2.1 time: 0.158065 Nov 17 03:26:33.077818 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 156/294] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:26:32 2021] GET /compute/v2.1/servers/6dc785d7-bc95-4fee-8206-c2fd3b930e4f => generated 1521 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 17 03:26:33.568754 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-b52d6976-14ff-40b0-998e-2eb074f705cd tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:26:33.569544 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-b52d6976-14ff-40b0-998e-2eb074f705cd tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] [instance: 645ba67f-2582-4a60-b013-84777a71a70d] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:26:33.578496 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-b52d6976-14ff-40b0-998e-2eb074f705cd tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:26:33.589548 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-b52d6976-14ff-40b0-998e-2eb074f705cd tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:26:33.590625 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-b52d6976-14ff-40b0-998e-2eb074f705cd tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:26:33.591150 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-b52d6976-14ff-40b0-998e-2eb074f705cd tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:26:33.981349 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-b52d6976-14ff-40b0-998e-2eb074f705cd tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d4e8ac9538f42c9b637bd9e086668b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfc480343d4d493bb4295b055e274df5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:26:33.990421 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-b52d6976-14ff-40b0-998e-2eb074f705cd tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] 10.222.0.11 "GET /compute/v2.1/servers/645ba67f-2582-4a60-b013-84777a71a70d" status: 200 len: 1318 microversion: 2.1 time: 0.425402 Nov 17 03:26:34.000731 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 157/295] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:26:33 2021] GET /compute/v2.1/servers/645ba67f-2582-4a60-b013-84777a71a70d => generated 1318 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 17 03:26:34.094477 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-84fed768-e563-4900-85b5-bcc4117410dc tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:26:34.095091 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-84fed768-e563-4900-85b5-bcc4117410dc tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] [instance: 6dc785d7-bc95-4fee-8206-c2fd3b930e4f] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:26:34.101062 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-84fed768-e563-4900-85b5-bcc4117410dc tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:26:34.101517 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-84fed768-e563-4900-85b5-bcc4117410dc tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:26:34.102305 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-84fed768-e563-4900-85b5-bcc4117410dc tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:26:34.102736 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-84fed768-e563-4900-85b5-bcc4117410dc tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:26:34.321172 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-84fed768-e563-4900-85b5-bcc4117410dc tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f046401c6a04f6495ebe0821120bd72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a58e89ceeea4a9c8a72a1de4bcaf2d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:26:34.329481 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-84fed768-e563-4900-85b5-bcc4117410dc tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] 10.222.0.11 "GET /compute/v2.1/servers/6dc785d7-bc95-4fee-8206-c2fd3b930e4f" status: 200 len: 1521 microversion: 2.1 time: 0.238726 Nov 17 03:26:34.330217 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 158/296] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:26:34 2021] GET /compute/v2.1/servers/6dc785d7-bc95-4fee-8206-c2fd3b930e4f => generated 1521 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:26:34.538386 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-0e75ca8c-a246-4107-84a3-a05fda355267 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] 10.222.0.11 "POST /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7/action" status: 200 len: 19342 microversion: 2.20 time: 3.083941 Nov 17 03:26:34.540050 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 139/297] 10.222.0.11 () {62 vars in 1318 bytes} [Wed Nov 17 03:26:31 2021] POST /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7/action => generated 19342 bytes in 3087 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 17 03:26:35.007567 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-dbff53a1-50d6-401e-9081-8c52f7623d19 tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:26:35.008183 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-dbff53a1-50d6-401e-9081-8c52f7623d19 tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] [instance: 645ba67f-2582-4a60-b013-84777a71a70d] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:26:35.018445 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-dbff53a1-50d6-401e-9081-8c52f7623d19 tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:26:35.018919 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-dbff53a1-50d6-401e-9081-8c52f7623d19 tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:26:35.022618 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-dbff53a1-50d6-401e-9081-8c52f7623d19 tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:26:35.023294 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-dbff53a1-50d6-401e-9081-8c52f7623d19 tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:26:35.351362 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-410ea15a-3976-4f5e-9fd0-3efb845de147 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:26:35.351874 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-410ea15a-3976-4f5e-9fd0-3efb845de147 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] [instance: 6dc785d7-bc95-4fee-8206-c2fd3b930e4f] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:26:35.364452 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-410ea15a-3976-4f5e-9fd0-3efb845de147 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:26:35.367121 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-410ea15a-3976-4f5e-9fd0-3efb845de147 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:26:35.368159 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-410ea15a-3976-4f5e-9fd0-3efb845de147 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:26:35.368765 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-410ea15a-3976-4f5e-9fd0-3efb845de147 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:26:35.453861 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-dbff53a1-50d6-401e-9081-8c52f7623d19 tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d4e8ac9538f42c9b637bd9e086668b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfc480343d4d493bb4295b055e274df5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:26:35.462713 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-dbff53a1-50d6-401e-9081-8c52f7623d19 tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] 10.222.0.11 "GET /compute/v2.1/servers/645ba67f-2582-4a60-b013-84777a71a70d" status: 200 len: 1318 microversion: 2.1 time: 0.459098 Nov 17 03:26:35.476407 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 159/298] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:26:35 2021] GET /compute/v2.1/servers/645ba67f-2582-4a60-b013-84777a71a70d => generated 1318 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:26:35.550812 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-16c6f77b-f586-48f4-812c-4773c0d29802 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 17 03:26:35.552033 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-16c6f77b-f586-48f4-812c-4773c0d29802 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] [instance: 5d54db85-b991-4890-abaa-952413baa2e7] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:26:35.563012 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-16c6f77b-f586-48f4-812c-4773c0d29802 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:26:35.563915 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-16c6f77b-f586-48f4-812c-4773c0d29802 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:26:35.564812 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-16c6f77b-f586-48f4-812c-4773c0d29802 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:26:35.565254 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-16c6f77b-f586-48f4-812c-4773c0d29802 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:26:35.652551 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-410ea15a-3976-4f5e-9fd0-3efb845de147 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f046401c6a04f6495ebe0821120bd72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a58e89ceeea4a9c8a72a1de4bcaf2d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:26:35.669167 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-410ea15a-3976-4f5e-9fd0-3efb845de147 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] 10.222.0.11 "GET /compute/v2.1/servers/6dc785d7-bc95-4fee-8206-c2fd3b930e4f" status: 200 len: 1521 microversion: 2.1 time: 0.325713 Nov 17 03:26:35.684799 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 140/299] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:26:35 2021] GET /compute/v2.1/servers/6dc785d7-bc95-4fee-8206-c2fd3b930e4f => generated 1521 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:26:35.707616 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-16c6f77b-f586-48f4-812c-4773c0d29802 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] 10.222.0.11 "POST /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7/action" status: 200 len: 21929 microversion: 2.20 time: 0.157630 Nov 17 03:26:35.709007 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 160/300] 10.222.0.11 () {62 vars in 1318 bytes} [Wed Nov 17 03:26:35 2021] POST /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7/action => generated 21929 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 17 03:26:36.184538 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-88766f6f-5f8a-4af1-996e-df3c618cdbee tempest-AttachVolumeTestJSON-1651611701 tempest-AttachVolumeTestJSON-1651611701-project] Action: 'create', calling method: .version_select at 0x7f9e1d28c430>, body: {"keypair": {"name": "tempest-keypair-1131711317"}} {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 17 03:26:36.199117 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.quota [None req-88766f6f-5f8a-4af1-996e-df3c618cdbee tempest-AttachVolumeTestJSON-1651611701 tempest-AttachVolumeTestJSON-1651611701-project] Getting quotas for project 2bf44d5ada38487eb55a9f4b7d52862d. Resources: {'key_pairs'} {{(pid=115916) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 17 03:26:36.203032 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.quota [None req-88766f6f-5f8a-4af1-996e-df3c618cdbee tempest-AttachVolumeTestJSON-1651611701 tempest-AttachVolumeTestJSON-1651611701-project] Getting quotas for user 1110e625f8f3451aafcdcac96d3e9ae8 and project 2bf44d5ada38487eb55a9f4b7d52862d. Resources: {'key_pairs'} {{(pid=115916) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 17 03:26:36.402451 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.quota [None req-88766f6f-5f8a-4af1-996e-df3c618cdbee tempest-AttachVolumeTestJSON-1651611701 tempest-AttachVolumeTestJSON-1651611701-project] Getting quotas for project 2bf44d5ada38487eb55a9f4b7d52862d. Resources: {'key_pairs'} {{(pid=115916) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 17 03:26:36.420063 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.quota [None req-88766f6f-5f8a-4af1-996e-df3c618cdbee tempest-AttachVolumeTestJSON-1651611701 tempest-AttachVolumeTestJSON-1651611701-project] Getting quotas for user 1110e625f8f3451aafcdcac96d3e9ae8 and project 2bf44d5ada38487eb55a9f4b7d52862d. Resources: {'key_pairs'} {{(pid=115916) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 17 03:26:36.446196 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-88766f6f-5f8a-4af1-996e-df3c618cdbee tempest-AttachVolumeTestJSON-1651611701 tempest-AttachVolumeTestJSON-1651611701-project] 10.222.0.11 "POST /compute/v2.1/os-keypairs" status: 200 len: 2305 microversion: 2.1 time: 0.435810 Nov 17 03:26:36.447606 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 141/301] 10.222.0.11 () {60 vars in 1157 bytes} [Wed Nov 17 03:26:36 2021] POST /compute/v2.1/os-keypairs => generated 2305 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:26:36.487336 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-debef188-50d5-4364-977b-e8c5392cd884 tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:26:36.488568 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-debef188-50d5-4364-977b-e8c5392cd884 tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] [instance: 645ba67f-2582-4a60-b013-84777a71a70d] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:26:36.497768 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-debef188-50d5-4364-977b-e8c5392cd884 tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:26:36.498207 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-debef188-50d5-4364-977b-e8c5392cd884 tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:26:36.499157 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-debef188-50d5-4364-977b-e8c5392cd884 tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:26:36.499923 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-debef188-50d5-4364-977b-e8c5392cd884 tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:26:36.687377 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-5a587b5a-bab1-409c-bbd5-2d18a16cec91 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:26:36.688590 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-5a587b5a-bab1-409c-bbd5-2d18a16cec91 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] [instance: 6dc785d7-bc95-4fee-8206-c2fd3b930e4f] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:26:36.700722 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-5a587b5a-bab1-409c-bbd5-2d18a16cec91 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:26:36.700722 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-5a587b5a-bab1-409c-bbd5-2d18a16cec91 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:26:36.702638 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-5a587b5a-bab1-409c-bbd5-2d18a16cec91 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:26:36.703101 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-5a587b5a-bab1-409c-bbd5-2d18a16cec91 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:26:36.814097 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-debef188-50d5-4364-977b-e8c5392cd884 tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d4e8ac9538f42c9b637bd9e086668b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfc480343d4d493bb4295b055e274df5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:26:36.829703 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-debef188-50d5-4364-977b-e8c5392cd884 tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] 10.222.0.11 "GET /compute/v2.1/servers/645ba67f-2582-4a60-b013-84777a71a70d" status: 200 len: 1318 microversion: 2.1 time: 0.348706 Nov 17 03:26:36.831397 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 161/302] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:26:36 2021] GET /compute/v2.1/servers/645ba67f-2582-4a60-b013-84777a71a70d => generated 1318 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:26:36.842796 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-2ec47ef6-a103-4d0e-9e8a-141d1cfe3282 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 17 03:26:36.843809 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-2ec47ef6-a103-4d0e-9e8a-141d1cfe3282 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] [instance: 5d54db85-b991-4890-abaa-952413baa2e7] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:26:36.851072 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-2ec47ef6-a103-4d0e-9e8a-141d1cfe3282 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:26:36.852485 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-2ec47ef6-a103-4d0e-9e8a-141d1cfe3282 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:26:36.853755 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-2ec47ef6-a103-4d0e-9e8a-141d1cfe3282 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:26:36.854625 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-2ec47ef6-a103-4d0e-9e8a-141d1cfe3282 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:26:36.982131 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-2ec47ef6-a103-4d0e-9e8a-141d1cfe3282 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] 10.222.0.11 "POST /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7/action" status: 200 len: 23145 microversion: 2.20 time: 0.148569 Nov 17 03:26:36.982943 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 162/303] 10.222.0.11 () {62 vars in 1318 bytes} [Wed Nov 17 03:26:36 2021] POST /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7/action => generated 23145 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 17 03:26:37.011864 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-5a587b5a-bab1-409c-bbd5-2d18a16cec91 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f046401c6a04f6495ebe0821120bd72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a58e89ceeea4a9c8a72a1de4bcaf2d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:26:37.022331 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-5a587b5a-bab1-409c-bbd5-2d18a16cec91 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] 10.222.0.11 "GET /compute/v2.1/servers/6dc785d7-bc95-4fee-8206-c2fd3b930e4f" status: 200 len: 1521 microversion: 2.1 time: 0.339997 Nov 17 03:26:37.022922 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 142/304] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:26:36 2021] GET /compute/v2.1/servers/6dc785d7-bc95-4fee-8206-c2fd3b930e4f => generated 1521 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:26:37.848488 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-34a259a9-ea18-4a9e-a10d-2912c0964ba4 tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:26:37.849229 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-34a259a9-ea18-4a9e-a10d-2912c0964ba4 tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] [instance: 645ba67f-2582-4a60-b013-84777a71a70d] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:26:37.859352 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-34a259a9-ea18-4a9e-a10d-2912c0964ba4 tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:26:37.863621 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-34a259a9-ea18-4a9e-a10d-2912c0964ba4 tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:26:37.864712 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-34a259a9-ea18-4a9e-a10d-2912c0964ba4 tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:26:37.866071 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-34a259a9-ea18-4a9e-a10d-2912c0964ba4 tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:26:37.994683 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-58e1e146-7ccf-4ea3-9be9-29eed0139978 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 17 03:26:37.996411 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-58e1e146-7ccf-4ea3-9be9-29eed0139978 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] [instance: 5d54db85-b991-4890-abaa-952413baa2e7] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:26:38.006981 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-58e1e146-7ccf-4ea3-9be9-29eed0139978 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:26:38.014685 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-58e1e146-7ccf-4ea3-9be9-29eed0139978 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:26:38.019491 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-58e1e146-7ccf-4ea3-9be9-29eed0139978 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:26:38.022529 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-58e1e146-7ccf-4ea3-9be9-29eed0139978 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:26:38.175153 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-58e1e146-7ccf-4ea3-9be9-29eed0139978 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] 10.222.0.11 "POST /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7/action" status: 200 len: 24458 microversion: 2.20 time: 0.184613 Nov 17 03:26:38.176532 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 143/305] 10.222.0.11 () {62 vars in 1318 bytes} [Wed Nov 17 03:26:37 2021] POST /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7/action => generated 24458 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 17 03:26:38.182589 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-5c83e918-0d21-41cd-9b65-4e18b614a3d5 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:26:38.184882 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-5c83e918-0d21-41cd-9b65-4e18b614a3d5 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] [instance: 6dc785d7-bc95-4fee-8206-c2fd3b930e4f] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:26:38.204726 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-5c83e918-0d21-41cd-9b65-4e18b614a3d5 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:26:38.205513 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-5c83e918-0d21-41cd-9b65-4e18b614a3d5 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:26:38.206590 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-5c83e918-0d21-41cd-9b65-4e18b614a3d5 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:26:38.207166 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-5c83e918-0d21-41cd-9b65-4e18b614a3d5 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:26:38.547889 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-34a259a9-ea18-4a9e-a10d-2912c0964ba4 tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d4e8ac9538f42c9b637bd9e086668b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfc480343d4d493bb4295b055e274df5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:26:38.560064 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-34a259a9-ea18-4a9e-a10d-2912c0964ba4 tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] 10.222.0.11 "GET /compute/v2.1/servers/645ba67f-2582-4a60-b013-84777a71a70d" status: 200 len: 1318 microversion: 2.1 time: 0.716070 Nov 17 03:26:38.565928 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 163/306] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:26:37 2021] GET /compute/v2.1/servers/645ba67f-2582-4a60-b013-84777a71a70d => generated 1318 bytes in 722 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:26:38.657126 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-5c83e918-0d21-41cd-9b65-4e18b614a3d5 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f046401c6a04f6495ebe0821120bd72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a58e89ceeea4a9c8a72a1de4bcaf2d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:26:38.665059 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-5c83e918-0d21-41cd-9b65-4e18b614a3d5 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] 10.222.0.11 "GET /compute/v2.1/servers/6dc785d7-bc95-4fee-8206-c2fd3b930e4f" status: 200 len: 1521 microversion: 2.1 time: 0.487027 Nov 17 03:26:38.669806 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 144/307] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:26:38 2021] GET /compute/v2.1/servers/6dc785d7-bc95-4fee-8206-c2fd3b930e4f => generated 1521 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:26:38.995437 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-b0218192-7431-47be-a817-16056934f84d tempest-AttachVolumeTestJSON-1651611701 tempest-AttachVolumeTestJSON-1651611701-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1942272866", "imageRef": "7281a37a-6b99-49c1-881a-41604d06bae1", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "1e893e14-8db8-4d97-802f-0f32d0331488"}], "security_groups": [{"name": "tempest-securitygroup--1900879131"}], "key_name": "tempest-keypair-1131711317", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 17 03:26:39.176490 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.network.neutron [None req-b0218192-7431-47be-a817-16056934f84d tempest-AttachVolumeTestJSON-1651611701 tempest-AttachVolumeTestJSON-1651611701-project] validate_networks() for [('1e893e14-8db8-4d97-802f-0f32d0331488', None, None, None, None, None)] {{(pid=115917) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Nov 17 03:26:39.187975 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-c6265ffe-7182-4bcd-a296-6d3ec1ec3bc0 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 17 03:26:39.188987 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-c6265ffe-7182-4bcd-a296-6d3ec1ec3bc0 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] [instance: 5d54db85-b991-4890-abaa-952413baa2e7] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:26:39.198768 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-c6265ffe-7182-4bcd-a296-6d3ec1ec3bc0 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:26:39.207203 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-c6265ffe-7182-4bcd-a296-6d3ec1ec3bc0 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:26:39.208111 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-c6265ffe-7182-4bcd-a296-6d3ec1ec3bc0 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:26:39.208544 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-c6265ffe-7182-4bcd-a296-6d3ec1ec3bc0 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:26:39.343022 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-c6265ffe-7182-4bcd-a296-6d3ec1ec3bc0 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] 10.222.0.11 "POST /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7/action" status: 200 len: 25377 microversion: 2.20 time: 0.158581 Nov 17 03:26:39.349373 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 145/308] 10.222.0.11 () {62 vars in 1318 bytes} [Wed Nov 17 03:26:39 2021] POST /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7/action => generated 25377 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 17 03:26:39.583767 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-6c9313a0-ada3-4bcf-9ad8-21b8b02932b8 tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:26:39.584803 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-6c9313a0-ada3-4bcf-9ad8-21b8b02932b8 tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] [instance: 645ba67f-2582-4a60-b013-84777a71a70d] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:26:39.597170 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-6c9313a0-ada3-4bcf-9ad8-21b8b02932b8 tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:26:39.604987 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-6c9313a0-ada3-4bcf-9ad8-21b8b02932b8 tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:26:39.606332 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-6c9313a0-ada3-4bcf-9ad8-21b8b02932b8 tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:26:39.606983 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-6c9313a0-ada3-4bcf-9ad8-21b8b02932b8 tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:26:39.904192 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-6c9313a0-ada3-4bcf-9ad8-21b8b02932b8 tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d4e8ac9538f42c9b637bd9e086668b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfc480343d4d493bb4295b055e274df5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:26:39.916969 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-6c9313a0-ada3-4bcf-9ad8-21b8b02932b8 tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] 10.222.0.11 "GET /compute/v2.1/servers/645ba67f-2582-4a60-b013-84777a71a70d" status: 200 len: 1318 microversion: 2.1 time: 0.338111 Nov 17 03:26:39.921608 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 146/309] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:26:39 2021] GET /compute/v2.1/servers/645ba67f-2582-4a60-b013-84777a71a70d => generated 1318 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 17 03:26:39.928850 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-229636f8-bf2e-492e-9ebb-f33074243656 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:26:39.941600 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-229636f8-bf2e-492e-9ebb-f33074243656 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] [instance: 6dc785d7-bc95-4fee-8206-c2fd3b930e4f] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:26:39.951694 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-229636f8-bf2e-492e-9ebb-f33074243656 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:26:39.952147 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-229636f8-bf2e-492e-9ebb-f33074243656 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:26:39.953045 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-229636f8-bf2e-492e-9ebb-f33074243656 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:26:39.953761 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-229636f8-bf2e-492e-9ebb-f33074243656 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:26:40.174001 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-229636f8-bf2e-492e-9ebb-f33074243656 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f046401c6a04f6495ebe0821120bd72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a58e89ceeea4a9c8a72a1de4bcaf2d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:26:40.185650 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-229636f8-bf2e-492e-9ebb-f33074243656 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] 10.222.0.11 "GET /compute/v2.1/servers/6dc785d7-bc95-4fee-8206-c2fd3b930e4f" status: 200 len: 1521 microversion: 2.1 time: 0.260626 Nov 17 03:26:40.196906 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 147/310] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:26:39 2021] GET /compute/v2.1/servers/6dc785d7-bc95-4fee-8206-c2fd3b930e4f => generated 1521 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:26:40.267683 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.virt.hardware [None req-b0218192-7431-47be-a817-16056934f84d tempest-AttachVolumeTestJSON-1651611701 tempest-AttachVolumeTestJSON-1651611701-project] Flavor limits 0:0:0 {{(pid=115917) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 17 03:26:40.268685 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.virt.hardware [None req-b0218192-7431-47be-a817-16056934f84d tempest-AttachVolumeTestJSON-1651611701 tempest-AttachVolumeTestJSON-1651611701-project] Image limits 0:0:0 {{(pid=115917) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 17 03:26:40.269250 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.virt.hardware [None req-b0218192-7431-47be-a817-16056934f84d tempest-AttachVolumeTestJSON-1651611701 tempest-AttachVolumeTestJSON-1651611701-project] Flavor pref 0:0:0 {{(pid=115917) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 17 03:26:40.270043 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.virt.hardware [None req-b0218192-7431-47be-a817-16056934f84d tempest-AttachVolumeTestJSON-1651611701 tempest-AttachVolumeTestJSON-1651611701-project] Image pref 0:0:0 {{(pid=115917) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 17 03:26:40.270596 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.virt.hardware [None req-b0218192-7431-47be-a817-16056934f84d tempest-AttachVolumeTestJSON-1651611701 tempest-AttachVolumeTestJSON-1651611701-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=115917) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 17 03:26:40.284469 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-b0218192-7431-47be-a817-16056934f84d tempest-AttachVolumeTestJSON-1651611701 tempest-AttachVolumeTestJSON-1651611701-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:26:40.285102 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-b0218192-7431-47be-a817-16056934f84d tempest-AttachVolumeTestJSON-1651611701 tempest-AttachVolumeTestJSON-1651611701-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:26:40.293694 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-b0218192-7431-47be-a817-16056934f84d tempest-AttachVolumeTestJSON-1651611701 tempest-AttachVolumeTestJSON-1651611701-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:26:40.294321 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-b0218192-7431-47be-a817-16056934f84d tempest-AttachVolumeTestJSON-1651611701 tempest-AttachVolumeTestJSON-1651611701-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:26:40.338533 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.quota [None req-b0218192-7431-47be-a817-16056934f84d tempest-AttachVolumeTestJSON-1651611701 tempest-AttachVolumeTestJSON-1651611701-project] Getting quotas for project 2bf44d5ada38487eb55a9f4b7d52862d. Resources: {'instances', 'ram', 'cores'} {{(pid=115917) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 17 03:26:40.344835 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.quota [None req-b0218192-7431-47be-a817-16056934f84d tempest-AttachVolumeTestJSON-1651611701 tempest-AttachVolumeTestJSON-1651611701-project] Getting quotas for user 1110e625f8f3451aafcdcac96d3e9ae8 and project 2bf44d5ada38487eb55a9f4b7d52862d. Resources: {'instances', 'ram', 'cores'} {{(pid=115917) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 17 03:26:40.357716 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-19813055-2543-4b8d-bb1e-08efcb6a835e tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 17 03:26:40.358709 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-19813055-2543-4b8d-bb1e-08efcb6a835e tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] [instance: 5d54db85-b991-4890-abaa-952413baa2e7] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:26:40.367326 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-b0218192-7431-47be-a817-16056934f84d tempest-AttachVolumeTestJSON-1651611701 tempest-AttachVolumeTestJSON-1651611701-project] Going to run 1 instances... {{(pid=115917) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 17 03:26:40.371416 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-19813055-2543-4b8d-bb1e-08efcb6a835e tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:26:40.374746 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-b0218192-7431-47be-a817-16056934f84d tempest-AttachVolumeTestJSON-1651611701 tempest-AttachVolumeTestJSON-1651611701-project] [instance: 5e11ea9c-f66a-4962-b5ca-b95784624824] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='7281a37a-6b99-49c1-881a-41604d06bae1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=115917) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 17 03:26:40.377965 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-19813055-2543-4b8d-bb1e-08efcb6a835e tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:26:40.379949 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-19813055-2543-4b8d-bb1e-08efcb6a835e tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:26:40.380404 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-19813055-2543-4b8d-bb1e-08efcb6a835e tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:26:40.468426 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-b0218192-7431-47be-a817-16056934f84d tempest-AttachVolumeTestJSON-1651611701 tempest-AttachVolumeTestJSON-1651611701-project] 10.222.0.11 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 1.478021 Nov 17 03:26:40.470118 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 164/311] 10.222.0.11 () {60 vars in 1146 bytes} [Wed Nov 17 03:26:38 2021] POST /compute/v2.1/servers => generated 402 bytes in 1480 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 17 03:26:40.483925 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-452a8d22-ff58-4e50-be86-f9d20b40bfce tempest-AttachVolumeTestJSON-1651611701 tempest-AttachVolumeTestJSON-1651611701-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:26:40.484758 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-452a8d22-ff58-4e50-be86-f9d20b40bfce tempest-AttachVolumeTestJSON-1651611701 tempest-AttachVolumeTestJSON-1651611701-project] [instance: 5e11ea9c-f66a-4962-b5ca-b95784624824] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:26:40.561869 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-452a8d22-ff58-4e50-be86-f9d20b40bfce tempest-AttachVolumeTestJSON-1651611701 tempest-AttachVolumeTestJSON-1651611701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1110e625f8f3451aafcdcac96d3e9ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bf44d5ada38487eb55a9f4b7d52862d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:26:40.572729 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-19813055-2543-4b8d-bb1e-08efcb6a835e tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] 10.222.0.11 "POST /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7/action" status: 200 len: 26276 microversion: 2.20 time: 0.219027 Nov 17 03:26:40.586937 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 148/312] 10.222.0.11 () {62 vars in 1318 bytes} [Wed Nov 17 03:26:40 2021] POST /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7/action => generated 26276 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 17 03:26:40.603635 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-452a8d22-ff58-4e50-be86-f9d20b40bfce tempest-AttachVolumeTestJSON-1651611701 tempest-AttachVolumeTestJSON-1651611701-project] 10.222.0.11 "GET /compute/v2.1/servers/5e11ea9c-f66a-4962-b5ca-b95784624824" status: 200 len: 1238 microversion: 2.1 time: 0.123719 Nov 17 03:26:40.605316 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 165/313] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:26:40 2021] GET /compute/v2.1/servers/5e11ea9c-f66a-4962-b5ca-b95784624824 => generated 1238 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 17 03:26:40.939027 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-46646e47-7ee5-4089-8dce-5bdb8a97de85 tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:26:40.939733 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-46646e47-7ee5-4089-8dce-5bdb8a97de85 tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] [instance: 645ba67f-2582-4a60-b013-84777a71a70d] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:26:40.953082 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-46646e47-7ee5-4089-8dce-5bdb8a97de85 tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:26:40.953532 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-46646e47-7ee5-4089-8dce-5bdb8a97de85 tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:26:40.954324 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-46646e47-7ee5-4089-8dce-5bdb8a97de85 tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:26:40.954758 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-46646e47-7ee5-4089-8dce-5bdb8a97de85 tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:26:41.169007 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-2bd691af-b94e-4572-b410-0493adc39731 tempest-VolumesNegativeTest-1100551557 tempest-VolumesNegativeTest-1100551557-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-2001595718", "imageRef": "7281a37a-6b99-49c1-881a-41604d06bae1", "flavorRef": "452"}} {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 17 03:26:41.257512 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-46646e47-7ee5-4089-8dce-5bdb8a97de85 tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d4e8ac9538f42c9b637bd9e086668b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfc480343d4d493bb4295b055e274df5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:26:41.261669 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.network.neutron [None req-2bd691af-b94e-4572-b410-0493adc39731 tempest-VolumesNegativeTest-1100551557 tempest-VolumesNegativeTest-1100551557-project] validate_networks() for None {{(pid=115917) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Nov 17 03:26:41.265688 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-46646e47-7ee5-4089-8dce-5bdb8a97de85 tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] 10.222.0.11 "GET /compute/v2.1/servers/645ba67f-2582-4a60-b013-84777a71a70d" status: 200 len: 1318 microversion: 2.1 time: 0.330636 Nov 17 03:26:41.267259 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 149/314] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:26:40 2021] GET /compute/v2.1/servers/645ba67f-2582-4a60-b013-84777a71a70d => generated 1318 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:26:41.276919 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-605f7d6f-2c4f-4f97-a4f8-c64fcac9fba0 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:26:41.277554 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-605f7d6f-2c4f-4f97-a4f8-c64fcac9fba0 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] [instance: 6dc785d7-bc95-4fee-8206-c2fd3b930e4f] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:26:41.289992 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-605f7d6f-2c4f-4f97-a4f8-c64fcac9fba0 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:26:41.290533 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-605f7d6f-2c4f-4f97-a4f8-c64fcac9fba0 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:26:41.294328 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-605f7d6f-2c4f-4f97-a4f8-c64fcac9fba0 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:26:41.297256 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-605f7d6f-2c4f-4f97-a4f8-c64fcac9fba0 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:26:41.650560 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-605f7d6f-2c4f-4f97-a4f8-c64fcac9fba0 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f046401c6a04f6495ebe0821120bd72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a58e89ceeea4a9c8a72a1de4bcaf2d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:26:41.658748 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-605f7d6f-2c4f-4f97-a4f8-c64fcac9fba0 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] 10.222.0.11 "GET /compute/v2.1/servers/6dc785d7-bc95-4fee-8206-c2fd3b930e4f" status: 200 len: 1521 microversion: 2.1 time: 0.390426 Nov 17 03:26:41.659447 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 150/315] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:26:41 2021] GET /compute/v2.1/servers/6dc785d7-bc95-4fee-8206-c2fd3b930e4f => generated 1521 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:26:41.663866 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-ca138298-49b8-4879-8869-9f441bdc6ebe tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 17 03:26:41.664808 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-ca138298-49b8-4879-8869-9f441bdc6ebe tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] [instance: 5d54db85-b991-4890-abaa-952413baa2e7] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:26:41.695315 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-ca138298-49b8-4879-8869-9f441bdc6ebe tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:26:41.695768 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-ca138298-49b8-4879-8869-9f441bdc6ebe tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:26:41.696577 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-ca138298-49b8-4879-8869-9f441bdc6ebe tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:26:41.698281 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-ca138298-49b8-4879-8869-9f441bdc6ebe tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:26:41.875867 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-ca138298-49b8-4879-8869-9f441bdc6ebe tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] 10.222.0.11 "POST /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7/action" status: 200 len: 26924 microversion: 2.20 time: 0.215244 Nov 17 03:26:41.881292 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 151/316] 10.222.0.11 () {62 vars in 1318 bytes} [Wed Nov 17 03:26:41 2021] POST /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7/action => generated 26924 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 17 03:26:41.886452 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-dcb27bb7-085b-44e8-9957-28d111f28d34 tempest-AttachVolumeTestJSON-1651611701 tempest-AttachVolumeTestJSON-1651611701-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:26:41.889504 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-dcb27bb7-085b-44e8-9957-28d111f28d34 tempest-AttachVolumeTestJSON-1651611701 tempest-AttachVolumeTestJSON-1651611701-project] [instance: 5e11ea9c-f66a-4962-b5ca-b95784624824] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:26:41.897419 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-dcb27bb7-085b-44e8-9957-28d111f28d34 tempest-AttachVolumeTestJSON-1651611701 tempest-AttachVolumeTestJSON-1651611701-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:26:41.897970 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-dcb27bb7-085b-44e8-9957-28d111f28d34 tempest-AttachVolumeTestJSON-1651611701 tempest-AttachVolumeTestJSON-1651611701-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:26:41.898753 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-dcb27bb7-085b-44e8-9957-28d111f28d34 tempest-AttachVolumeTestJSON-1651611701 tempest-AttachVolumeTestJSON-1651611701-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:26:41.899185 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-dcb27bb7-085b-44e8-9957-28d111f28d34 tempest-AttachVolumeTestJSON-1651611701 tempest-AttachVolumeTestJSON-1651611701-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:26:41.971280 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-dcb27bb7-085b-44e8-9957-28d111f28d34 tempest-AttachVolumeTestJSON-1651611701 tempest-AttachVolumeTestJSON-1651611701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1110e625f8f3451aafcdcac96d3e9ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bf44d5ada38487eb55a9f4b7d52862d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:26:41.985347 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-dcb27bb7-085b-44e8-9957-28d111f28d34 tempest-AttachVolumeTestJSON-1651611701 tempest-AttachVolumeTestJSON-1651611701-project] 10.222.0.11 "GET /compute/v2.1/servers/5e11ea9c-f66a-4962-b5ca-b95784624824" status: 200 len: 1290 microversion: 2.1 time: 0.102220 Nov 17 03:26:41.996923 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 152/317] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:26:41 2021] GET /compute/v2.1/servers/5e11ea9c-f66a-4962-b5ca-b95784624824 => generated 1290 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:26:42.175376 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.virt.hardware [None req-2bd691af-b94e-4572-b410-0493adc39731 tempest-VolumesNegativeTest-1100551557 tempest-VolumesNegativeTest-1100551557-project] Flavor limits 0:0:0 {{(pid=115917) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 17 03:26:42.176825 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.virt.hardware [None req-2bd691af-b94e-4572-b410-0493adc39731 tempest-VolumesNegativeTest-1100551557 tempest-VolumesNegativeTest-1100551557-project] Image limits 0:0:0 {{(pid=115917) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 17 03:26:42.177850 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.virt.hardware [None req-2bd691af-b94e-4572-b410-0493adc39731 tempest-VolumesNegativeTest-1100551557 tempest-VolumesNegativeTest-1100551557-project] Flavor pref 0:0:0 {{(pid=115917) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 17 03:26:42.179062 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.virt.hardware [None req-2bd691af-b94e-4572-b410-0493adc39731 tempest-VolumesNegativeTest-1100551557 tempest-VolumesNegativeTest-1100551557-project] Image pref 0:0:0 {{(pid=115917) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 17 03:26:42.179673 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.virt.hardware [None req-2bd691af-b94e-4572-b410-0493adc39731 tempest-VolumesNegativeTest-1100551557 tempest-VolumesNegativeTest-1100551557-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=115917) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 17 03:26:42.193803 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-2bd691af-b94e-4572-b410-0493adc39731 tempest-VolumesNegativeTest-1100551557 tempest-VolumesNegativeTest-1100551557-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:26:42.194920 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-2bd691af-b94e-4572-b410-0493adc39731 tempest-VolumesNegativeTest-1100551557 tempest-VolumesNegativeTest-1100551557-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:26:42.195980 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-2bd691af-b94e-4572-b410-0493adc39731 tempest-VolumesNegativeTest-1100551557 tempest-VolumesNegativeTest-1100551557-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:26:42.196634 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-2bd691af-b94e-4572-b410-0493adc39731 tempest-VolumesNegativeTest-1100551557 tempest-VolumesNegativeTest-1100551557-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:26:42.217058 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.quota [None req-2bd691af-b94e-4572-b410-0493adc39731 tempest-VolumesNegativeTest-1100551557 tempest-VolumesNegativeTest-1100551557-project] Getting quotas for project 0718c5e9ff9246ecb9100477e30e25eb. Resources: {'instances', 'ram', 'cores'} {{(pid=115917) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 17 03:26:42.225174 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.quota [None req-2bd691af-b94e-4572-b410-0493adc39731 tempest-VolumesNegativeTest-1100551557 tempest-VolumesNegativeTest-1100551557-project] Getting quotas for user 20f76a7333f14ee2ad5223b6f038e271 and project 0718c5e9ff9246ecb9100477e30e25eb. Resources: {'instances', 'ram', 'cores'} {{(pid=115917) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 17 03:26:42.238862 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-2bd691af-b94e-4572-b410-0493adc39731 tempest-VolumesNegativeTest-1100551557 tempest-VolumesNegativeTest-1100551557-project] Going to run 1 instances... {{(pid=115917) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 17 03:26:42.241741 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-2bd691af-b94e-4572-b410-0493adc39731 tempest-VolumesNegativeTest-1100551557 tempest-VolumesNegativeTest-1100551557-project] [instance: 45027e8f-667f-45f3-a5f9-2399d6ea3830] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='7281a37a-6b99-49c1-881a-41604d06bae1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=115917) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 17 03:26:42.285145 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-429303c6-ce56-40ec-b000-299e09c2642f tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:26:42.286555 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-429303c6-ce56-40ec-b000-299e09c2642f tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] [instance: 645ba67f-2582-4a60-b013-84777a71a70d] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:26:42.295993 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-429303c6-ce56-40ec-b000-299e09c2642f tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:26:42.297375 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-429303c6-ce56-40ec-b000-299e09c2642f tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:26:42.298423 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-429303c6-ce56-40ec-b000-299e09c2642f tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:26:42.299105 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-429303c6-ce56-40ec-b000-299e09c2642f tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:26:42.334116 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-2bd691af-b94e-4572-b410-0493adc39731 tempest-VolumesNegativeTest-1100551557 tempest-VolumesNegativeTest-1100551557-project] 10.222.0.11 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.169350 Nov 17 03:26:42.334946 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 166/318] 10.222.0.11 () {60 vars in 1146 bytes} [Wed Nov 17 03:26:41 2021] POST /compute/v2.1/servers => generated 380 bytes in 1171 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 17 03:26:42.345230 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-a4d3afc7-aa54-447e-b936-902a809495a1 tempest-VolumesNegativeTest-1100551557 tempest-VolumesNegativeTest-1100551557-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:26:42.346045 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-a4d3afc7-aa54-447e-b936-902a809495a1 tempest-VolumesNegativeTest-1100551557 tempest-VolumesNegativeTest-1100551557-project] [instance: 45027e8f-667f-45f3-a5f9-2399d6ea3830] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:26:42.537809 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-429303c6-ce56-40ec-b000-299e09c2642f tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d4e8ac9538f42c9b637bd9e086668b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfc480343d4d493bb4295b055e274df5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:26:42.553122 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-429303c6-ce56-40ec-b000-299e09c2642f tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] 10.222.0.11 "GET /compute/v2.1/servers/645ba67f-2582-4a60-b013-84777a71a70d" status: 200 len: 1318 microversion: 2.1 time: 0.273095 Nov 17 03:26:42.558625 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 153/319] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:26:42 2021] GET /compute/v2.1/servers/645ba67f-2582-4a60-b013-84777a71a70d => generated 1318 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:26:42.604247 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-a4d3afc7-aa54-447e-b936-902a809495a1 tempest-VolumesNegativeTest-1100551557 tempest-VolumesNegativeTest-1100551557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20f76a7333f14ee2ad5223b6f038e271', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0718c5e9ff9246ecb9100477e30e25eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:26:42.614922 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-a4d3afc7-aa54-447e-b936-902a809495a1 tempest-VolumesNegativeTest-1100551557 tempest-VolumesNegativeTest-1100551557-project] 10.222.0.11 "GET /compute/v2.1/servers/45027e8f-667f-45f3-a5f9-2399d6ea3830" status: 200 len: 1215 microversion: 2.1 time: 0.272536 Nov 17 03:26:42.617195 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 167/320] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:26:42 2021] GET /compute/v2.1/servers/45027e8f-667f-45f3-a5f9-2399d6ea3830 => generated 1215 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:26:42.686211 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-257d8099-9469-42e1-9e53-50d02f7fbed9 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:26:42.688621 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-257d8099-9469-42e1-9e53-50d02f7fbed9 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] [instance: 6dc785d7-bc95-4fee-8206-c2fd3b930e4f] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:26:42.718727 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-257d8099-9469-42e1-9e53-50d02f7fbed9 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:26:42.721679 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-257d8099-9469-42e1-9e53-50d02f7fbed9 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:26:42.723404 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-257d8099-9469-42e1-9e53-50d02f7fbed9 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:26:42.725585 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-257d8099-9469-42e1-9e53-50d02f7fbed9 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:26:42.889468 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-086af71c-22a4-4cd9-917f-5b667e714fbf tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 17 03:26:42.890838 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-086af71c-22a4-4cd9-917f-5b667e714fbf tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] [instance: 5d54db85-b991-4890-abaa-952413baa2e7] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:26:42.904484 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-086af71c-22a4-4cd9-917f-5b667e714fbf tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:26:42.905661 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-086af71c-22a4-4cd9-917f-5b667e714fbf tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:26:42.911862 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-086af71c-22a4-4cd9-917f-5b667e714fbf tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:26:42.914948 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-086af71c-22a4-4cd9-917f-5b667e714fbf tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:26:43.062013 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-086af71c-22a4-4cd9-917f-5b667e714fbf tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] 10.222.0.11 "POST /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7/action" status: 200 len: 27285 microversion: 2.20 time: 0.177214 Nov 17 03:26:43.064325 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 168/321] 10.222.0.11 () {62 vars in 1318 bytes} [Wed Nov 17 03:26:42 2021] POST /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7/action => generated 27285 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 17 03:26:43.070359 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-3cdad1e4-993e-425a-a45b-3ac999bdbb7a tempest-AttachVolumeTestJSON-1651611701 tempest-AttachVolumeTestJSON-1651611701-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:26:43.071060 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-3cdad1e4-993e-425a-a45b-3ac999bdbb7a tempest-AttachVolumeTestJSON-1651611701 tempest-AttachVolumeTestJSON-1651611701-project] [instance: 5e11ea9c-f66a-4962-b5ca-b95784624824] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:26:43.091981 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-3cdad1e4-993e-425a-a45b-3ac999bdbb7a tempest-AttachVolumeTestJSON-1651611701 tempest-AttachVolumeTestJSON-1651611701-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:26:43.092419 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-3cdad1e4-993e-425a-a45b-3ac999bdbb7a tempest-AttachVolumeTestJSON-1651611701 tempest-AttachVolumeTestJSON-1651611701-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:26:43.096322 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-3cdad1e4-993e-425a-a45b-3ac999bdbb7a tempest-AttachVolumeTestJSON-1651611701 tempest-AttachVolumeTestJSON-1651611701-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:26:43.096762 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-3cdad1e4-993e-425a-a45b-3ac999bdbb7a tempest-AttachVolumeTestJSON-1651611701 tempest-AttachVolumeTestJSON-1651611701-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:26:43.179119 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-257d8099-9469-42e1-9e53-50d02f7fbed9 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f046401c6a04f6495ebe0821120bd72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a58e89ceeea4a9c8a72a1de4bcaf2d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:26:43.190530 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-257d8099-9469-42e1-9e53-50d02f7fbed9 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] 10.222.0.11 "GET /compute/v2.1/servers/6dc785d7-bc95-4fee-8206-c2fd3b930e4f" status: 200 len: 1521 microversion: 2.1 time: 0.516476 Nov 17 03:26:43.191946 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 154/322] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:26:42 2021] GET /compute/v2.1/servers/6dc785d7-bc95-4fee-8206-c2fd3b930e4f => generated 1521 bytes in 518 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:26:43.241584 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-3cdad1e4-993e-425a-a45b-3ac999bdbb7a tempest-AttachVolumeTestJSON-1651611701 tempest-AttachVolumeTestJSON-1651611701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1110e625f8f3451aafcdcac96d3e9ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bf44d5ada38487eb55a9f4b7d52862d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:26:43.253797 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-3cdad1e4-993e-425a-a45b-3ac999bdbb7a tempest-AttachVolumeTestJSON-1651611701 tempest-AttachVolumeTestJSON-1651611701-project] 10.222.0.11 "GET /compute/v2.1/servers/5e11ea9c-f66a-4962-b5ca-b95784624824" status: 200 len: 1296 microversion: 2.1 time: 0.188733 Nov 17 03:26:43.268063 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 169/323] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:26:43 2021] GET /compute/v2.1/servers/5e11ea9c-f66a-4962-b5ca-b95784624824 => generated 1296 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:26:43.575638 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-24e68e11-4a68-4221-bc2c-c46d461dc6fa tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:26:43.576246 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-24e68e11-4a68-4221-bc2c-c46d461dc6fa tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] [instance: 645ba67f-2582-4a60-b013-84777a71a70d] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:26:43.586388 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-24e68e11-4a68-4221-bc2c-c46d461dc6fa tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:26:43.586819 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-24e68e11-4a68-4221-bc2c-c46d461dc6fa tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:26:43.587729 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-24e68e11-4a68-4221-bc2c-c46d461dc6fa tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:26:43.588163 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-24e68e11-4a68-4221-bc2c-c46d461dc6fa tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:26:43.634508 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-2edd64d8-f0a1-49cd-a218-f94ea8c85ddf tempest-VolumesNegativeTest-1100551557 tempest-VolumesNegativeTest-1100551557-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:26:43.635119 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-2edd64d8-f0a1-49cd-a218-f94ea8c85ddf tempest-VolumesNegativeTest-1100551557 tempest-VolumesNegativeTest-1100551557-project] [instance: 45027e8f-667f-45f3-a5f9-2399d6ea3830] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:26:43.644605 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-2edd64d8-f0a1-49cd-a218-f94ea8c85ddf tempest-VolumesNegativeTest-1100551557 tempest-VolumesNegativeTest-1100551557-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:26:43.648596 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-2edd64d8-f0a1-49cd-a218-f94ea8c85ddf tempest-VolumesNegativeTest-1100551557 tempest-VolumesNegativeTest-1100551557-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:26:43.649537 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-2edd64d8-f0a1-49cd-a218-f94ea8c85ddf tempest-VolumesNegativeTest-1100551557 tempest-VolumesNegativeTest-1100551557-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:26:43.657158 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-2edd64d8-f0a1-49cd-a218-f94ea8c85ddf tempest-VolumesNegativeTest-1100551557 tempest-VolumesNegativeTest-1100551557-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:26:43.770093 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-2edd64d8-f0a1-49cd-a218-f94ea8c85ddf tempest-VolumesNegativeTest-1100551557 tempest-VolumesNegativeTest-1100551557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20f76a7333f14ee2ad5223b6f038e271', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0718c5e9ff9246ecb9100477e30e25eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:26:43.780974 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-2edd64d8-f0a1-49cd-a218-f94ea8c85ddf tempest-VolumesNegativeTest-1100551557 tempest-VolumesNegativeTest-1100551557-project] 10.222.0.11 "GET /compute/v2.1/servers/45027e8f-667f-45f3-a5f9-2399d6ea3830" status: 200 len: 1267 microversion: 2.1 time: 0.150011 Nov 17 03:26:43.784957 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 170/324] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:26:43 2021] GET /compute/v2.1/servers/45027e8f-667f-45f3-a5f9-2399d6ea3830 => generated 1267 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 17 03:26:44.013831 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-24e68e11-4a68-4221-bc2c-c46d461dc6fa tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d4e8ac9538f42c9b637bd9e086668b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfc480343d4d493bb4295b055e274df5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:26:44.022927 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-24e68e11-4a68-4221-bc2c-c46d461dc6fa tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] 10.222.0.11 "GET /compute/v2.1/servers/645ba67f-2582-4a60-b013-84777a71a70d" status: 200 len: 1318 microversion: 2.1 time: 0.451125 Nov 17 03:26:44.037603 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 155/325] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:26:43 2021] GET /compute/v2.1/servers/645ba67f-2582-4a60-b013-84777a71a70d => generated 1318 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:26:44.076327 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-3d4e49c2-1d86-424c-92bd-aeb2f715ba70 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 17 03:26:44.082767 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [req-03d2b235-3156-49c1-8329-bfe34bf37253 req-265b3e60-ff71-4224-93de-89fccb8d068f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "645ba67f-2582-4a60-b013-84777a71a70d", "name": "network-vif-plugged", "status": "completed", "tag": "0ebffcbf-ae21-4111-bfbb-365005048a48"}]} {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 17 03:26:44.084467 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 17 03:26:44.084467 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: warnings.warn(msg) Nov 17 03:26:44.085461 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-3d4e49c2-1d86-424c-92bd-aeb2f715ba70 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] [instance: 5d54db85-b991-4890-abaa-952413baa2e7] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:26:44.109134 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-3d4e49c2-1d86-424c-92bd-aeb2f715ba70 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:26:44.110193 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-3d4e49c2-1d86-424c-92bd-aeb2f715ba70 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:26:44.110627 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [req-03d2b235-3156-49c1-8329-bfe34bf37253 req-265b3e60-ff71-4224-93de-89fccb8d068f service nova] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:26:44.111068 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [req-03d2b235-3156-49c1-8329-bfe34bf37253 req-265b3e60-ff71-4224-93de-89fccb8d068f service nova] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:26:44.113633 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-3d4e49c2-1d86-424c-92bd-aeb2f715ba70 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:26:44.114351 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-3d4e49c2-1d86-424c-92bd-aeb2f715ba70 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:26:44.148930 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.compute.server_external_events [req-03d2b235-3156-49c1-8329-bfe34bf37253 req-265b3e60-ff71-4224-93de-89fccb8d068f service nova] Creating event network-vif-plugged:0ebffcbf-ae21-4111-bfbb-365005048a48 for instance 645ba67f-2582-4a60-b013-84777a71a70d on hv-cinder-81803 Nov 17 03:26:44.159749 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [req-03d2b235-3156-49c1-8329-bfe34bf37253 req-265b3e60-ff71-4224-93de-89fccb8d068f service nova] 10.222.0.11 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.081031 Nov 17 03:26:44.160856 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 156/326] 10.222.0.11 () {64 vars in 1317 bytes} [Wed Nov 17 03:26:44 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 17 03:26:44.208293 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-6df3df65-3bf5-4f7b-9be9-95c6447d3a18 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:26:44.209025 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-6df3df65-3bf5-4f7b-9be9-95c6447d3a18 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] [instance: 6dc785d7-bc95-4fee-8206-c2fd3b930e4f] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:26:44.225130 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-6df3df65-3bf5-4f7b-9be9-95c6447d3a18 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:26:44.225571 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-6df3df65-3bf5-4f7b-9be9-95c6447d3a18 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:26:44.226406 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-6df3df65-3bf5-4f7b-9be9-95c6447d3a18 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:26:44.226838 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-6df3df65-3bf5-4f7b-9be9-95c6447d3a18 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:26:44.342508 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-3d4e49c2-1d86-424c-92bd-aeb2f715ba70 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] 10.222.0.11 "POST /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7/action" status: 200 len: 27590 microversion: 2.20 time: 0.267199 Nov 17 03:26:44.347760 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 171/327] 10.222.0.11 () {62 vars in 1318 bytes} [Wed Nov 17 03:26:44 2021] POST /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7/action => generated 27590 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 17 03:26:44.357479 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-6f590eb6-97df-4803-a4c4-b9653f38b82a tempest-AttachVolumeTestJSON-1651611701 tempest-AttachVolumeTestJSON-1651611701-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:26:44.360802 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-6f590eb6-97df-4803-a4c4-b9653f38b82a tempest-AttachVolumeTestJSON-1651611701 tempest-AttachVolumeTestJSON-1651611701-project] [instance: 5e11ea9c-f66a-4962-b5ca-b95784624824] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:26:44.381044 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-6f590eb6-97df-4803-a4c4-b9653f38b82a tempest-AttachVolumeTestJSON-1651611701 tempest-AttachVolumeTestJSON-1651611701-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:26:44.384297 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-6f590eb6-97df-4803-a4c4-b9653f38b82a tempest-AttachVolumeTestJSON-1651611701 tempest-AttachVolumeTestJSON-1651611701-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:26:44.387604 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-6f590eb6-97df-4803-a4c4-b9653f38b82a tempest-AttachVolumeTestJSON-1651611701 tempest-AttachVolumeTestJSON-1651611701-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:26:44.389038 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-6f590eb6-97df-4803-a4c4-b9653f38b82a tempest-AttachVolumeTestJSON-1651611701 tempest-AttachVolumeTestJSON-1651611701-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:26:44.861886 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-6df3df65-3bf5-4f7b-9be9-95c6447d3a18 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f046401c6a04f6495ebe0821120bd72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a58e89ceeea4a9c8a72a1de4bcaf2d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:26:44.875256 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-6df3df65-3bf5-4f7b-9be9-95c6447d3a18 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] 10.222.0.11 "GET /compute/v2.1/servers/6dc785d7-bc95-4fee-8206-c2fd3b930e4f" status: 200 len: 1521 microversion: 2.1 time: 0.670897 Nov 17 03:26:44.876503 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 157/328] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:26:44 2021] GET /compute/v2.1/servers/6dc785d7-bc95-4fee-8206-c2fd3b930e4f => generated 1521 bytes in 673 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 17 03:26:44.881188 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-02490c6a-5198-4a78-b77f-3da0b4ddd8c7 tempest-VolumesNegativeTest-1100551557 tempest-VolumesNegativeTest-1100551557-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:26:44.882063 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-02490c6a-5198-4a78-b77f-3da0b4ddd8c7 tempest-VolumesNegativeTest-1100551557 tempest-VolumesNegativeTest-1100551557-project] [instance: 45027e8f-667f-45f3-a5f9-2399d6ea3830] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:26:44.888266 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-02490c6a-5198-4a78-b77f-3da0b4ddd8c7 tempest-VolumesNegativeTest-1100551557 tempest-VolumesNegativeTest-1100551557-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:26:44.889692 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-02490c6a-5198-4a78-b77f-3da0b4ddd8c7 tempest-VolumesNegativeTest-1100551557 tempest-VolumesNegativeTest-1100551557-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:26:44.891335 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-02490c6a-5198-4a78-b77f-3da0b4ddd8c7 tempest-VolumesNegativeTest-1100551557 tempest-VolumesNegativeTest-1100551557-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:26:44.891966 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-02490c6a-5198-4a78-b77f-3da0b4ddd8c7 tempest-VolumesNegativeTest-1100551557 tempest-VolumesNegativeTest-1100551557-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:26:44.976268 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-02490c6a-5198-4a78-b77f-3da0b4ddd8c7 tempest-VolumesNegativeTest-1100551557 tempest-VolumesNegativeTest-1100551557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20f76a7333f14ee2ad5223b6f038e271', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0718c5e9ff9246ecb9100477e30e25eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:26:44.985894 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-02490c6a-5198-4a78-b77f-3da0b4ddd8c7 tempest-VolumesNegativeTest-1100551557 tempest-VolumesNegativeTest-1100551557-project] 10.222.0.11 "GET /compute/v2.1/servers/45027e8f-667f-45f3-a5f9-2399d6ea3830" status: 200 len: 1273 microversion: 2.1 time: 0.107834 Nov 17 03:26:44.987108 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 158/329] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:26:44 2021] GET /compute/v2.1/servers/45027e8f-667f-45f3-a5f9-2399d6ea3830 => generated 1273 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:26:45.033416 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-6f590eb6-97df-4803-a4c4-b9653f38b82a tempest-AttachVolumeTestJSON-1651611701 tempest-AttachVolumeTestJSON-1651611701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1110e625f8f3451aafcdcac96d3e9ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bf44d5ada38487eb55a9f4b7d52862d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:26:45.043542 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-86df219c-4bad-45be-b339-e749223a5e7a tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:26:45.044155 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-86df219c-4bad-45be-b339-e749223a5e7a tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] [instance: 645ba67f-2582-4a60-b013-84777a71a70d] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:26:45.050191 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-6f590eb6-97df-4803-a4c4-b9653f38b82a tempest-AttachVolumeTestJSON-1651611701 tempest-AttachVolumeTestJSON-1651611701-project] 10.222.0.11 "GET /compute/v2.1/servers/5e11ea9c-f66a-4962-b5ca-b95784624824" status: 200 len: 1364 microversion: 2.1 time: 0.701154 Nov 17 03:26:45.051042 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 172/330] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:26:44 2021] GET /compute/v2.1/servers/5e11ea9c-f66a-4962-b5ca-b95784624824 => generated 1364 bytes in 703 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:26:45.071478 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-86df219c-4bad-45be-b339-e749223a5e7a tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:26:45.071937 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-86df219c-4bad-45be-b339-e749223a5e7a tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:26:45.072969 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-86df219c-4bad-45be-b339-e749223a5e7a tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:26:45.073564 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-86df219c-4bad-45be-b339-e749223a5e7a tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:26:45.205419 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [req-333ca1f0-4b07-4c28-b199-0e8988ba11b3 req-8dbc4b3c-4c79-48ca-a1f3-1d98c88f568c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5e11ea9c-f66a-4962-b5ca-b95784624824", "tag": "ec07edc4-f4b6-4df2-82fd-1001703384ca"}]} {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 17 03:26:45.207220 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 17 03:26:45.207220 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: warnings.warn(msg) Nov 17 03:26:45.223733 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [req-333ca1f0-4b07-4c28-b199-0e8988ba11b3 req-8dbc4b3c-4c79-48ca-a1f3-1d98c88f568c service nova] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:26:45.224167 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [req-333ca1f0-4b07-4c28-b199-0e8988ba11b3 req-8dbc4b3c-4c79-48ca-a1f3-1d98c88f568c service nova] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:26:45.247379 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.compute.server_external_events [req-333ca1f0-4b07-4c28-b199-0e8988ba11b3 req-8dbc4b3c-4c79-48ca-a1f3-1d98c88f568c service nova] Creating event network-changed:ec07edc4-f4b6-4df2-82fd-1001703384ca for instance 5e11ea9c-f66a-4962-b5ca-b95784624824 on hv-cinder-81803 Nov 17 03:26:45.256667 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [req-333ca1f0-4b07-4c28-b199-0e8988ba11b3 req-8dbc4b3c-4c79-48ca-a1f3-1d98c88f568c service nova] 10.222.0.11 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.054898 Nov 17 03:26:45.257596 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 173/331] 10.222.0.11 () {64 vars in 1317 bytes} [Wed Nov 17 03:26:45 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 17 03:26:45.357066 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-1d1c7683-127b-4b85-a72a-ba5f6c066f61 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 17 03:26:45.358981 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-1d1c7683-127b-4b85-a72a-ba5f6c066f61 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] [instance: 5d54db85-b991-4890-abaa-952413baa2e7] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:26:45.369732 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-1d1c7683-127b-4b85-a72a-ba5f6c066f61 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:26:45.370445 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-1d1c7683-127b-4b85-a72a-ba5f6c066f61 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:26:45.371467 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-1d1c7683-127b-4b85-a72a-ba5f6c066f61 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:26:45.372045 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-1d1c7683-127b-4b85-a72a-ba5f6c066f61 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:26:45.587592 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-1d1c7683-127b-4b85-a72a-ba5f6c066f61 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] 10.222.0.11 "POST /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7/action" status: 200 len: 27834 microversion: 2.20 time: 0.234089 Nov 17 03:26:45.589079 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 174/332] 10.222.0.11 () {62 vars in 1318 bytes} [Wed Nov 17 03:26:45 2021] POST /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7/action => generated 27834 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 17 03:26:45.605378 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-86df219c-4bad-45be-b339-e749223a5e7a tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d4e8ac9538f42c9b637bd9e086668b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfc480343d4d493bb4295b055e274df5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:26:45.614302 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-86df219c-4bad-45be-b339-e749223a5e7a tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] 10.222.0.11 "GET /compute/v2.1/servers/645ba67f-2582-4a60-b013-84777a71a70d" status: 200 len: 1318 microversion: 2.1 time: 0.574592 Nov 17 03:26:45.625243 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 159/333] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:26:45 2021] GET /compute/v2.1/servers/645ba67f-2582-4a60-b013-84777a71a70d => generated 1318 bytes in 586 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:26:45.894254 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-6b37b36a-36ae-4461-8e49-b04f5b518a37 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:26:45.895046 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-6b37b36a-36ae-4461-8e49-b04f5b518a37 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] [instance: 6dc785d7-bc95-4fee-8206-c2fd3b930e4f] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:26:45.913139 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-6b37b36a-36ae-4461-8e49-b04f5b518a37 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:26:45.913649 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-6b37b36a-36ae-4461-8e49-b04f5b518a37 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:26:45.914786 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-6b37b36a-36ae-4461-8e49-b04f5b518a37 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:26:45.915594 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-6b37b36a-36ae-4461-8e49-b04f5b518a37 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:26:46.003304 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-5947b726-4d63-41d9-918a-74d58a76f6ad tempest-VolumesNegativeTest-1100551557 tempest-VolumesNegativeTest-1100551557-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:26:46.004539 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-5947b726-4d63-41d9-918a-74d58a76f6ad tempest-VolumesNegativeTest-1100551557 tempest-VolumesNegativeTest-1100551557-project] [instance: 45027e8f-667f-45f3-a5f9-2399d6ea3830] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:26:46.015651 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-5947b726-4d63-41d9-918a-74d58a76f6ad tempest-VolumesNegativeTest-1100551557 tempest-VolumesNegativeTest-1100551557-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:26:46.016105 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-5947b726-4d63-41d9-918a-74d58a76f6ad tempest-VolumesNegativeTest-1100551557 tempest-VolumesNegativeTest-1100551557-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:26:46.016947 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-5947b726-4d63-41d9-918a-74d58a76f6ad tempest-VolumesNegativeTest-1100551557 tempest-VolumesNegativeTest-1100551557-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:26:46.017379 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-5947b726-4d63-41d9-918a-74d58a76f6ad tempest-VolumesNegativeTest-1100551557 tempest-VolumesNegativeTest-1100551557-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:26:46.109462 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-5947b726-4d63-41d9-918a-74d58a76f6ad tempest-VolumesNegativeTest-1100551557 tempest-VolumesNegativeTest-1100551557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20f76a7333f14ee2ad5223b6f038e271', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0718c5e9ff9246ecb9100477e30e25eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:26:46.124423 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-5947b726-4d63-41d9-918a-74d58a76f6ad tempest-VolumesNegativeTest-1100551557 tempest-VolumesNegativeTest-1100551557-project] 10.222.0.11 "GET /compute/v2.1/servers/45027e8f-667f-45f3-a5f9-2399d6ea3830" status: 200 len: 1273 microversion: 2.1 time: 0.121414 Nov 17 03:26:46.125362 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 160/334] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:26:45 2021] GET /compute/v2.1/servers/45027e8f-667f-45f3-a5f9-2399d6ea3830 => generated 1273 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 17 03:26:46.129992 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-d26c7800-a343-44a7-bfd4-cdf25f07305c tempest-AttachVolumeTestJSON-1651611701 tempest-AttachVolumeTestJSON-1651611701-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:26:46.130804 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-d26c7800-a343-44a7-bfd4-cdf25f07305c tempest-AttachVolumeTestJSON-1651611701 tempest-AttachVolumeTestJSON-1651611701-project] [instance: 5e11ea9c-f66a-4962-b5ca-b95784624824] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:26:46.138656 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-d26c7800-a343-44a7-bfd4-cdf25f07305c tempest-AttachVolumeTestJSON-1651611701 tempest-AttachVolumeTestJSON-1651611701-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:26:46.139321 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-d26c7800-a343-44a7-bfd4-cdf25f07305c tempest-AttachVolumeTestJSON-1651611701 tempest-AttachVolumeTestJSON-1651611701-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:26:46.140113 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-d26c7800-a343-44a7-bfd4-cdf25f07305c tempest-AttachVolumeTestJSON-1651611701 tempest-AttachVolumeTestJSON-1651611701-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:26:46.140617 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-d26c7800-a343-44a7-bfd4-cdf25f07305c tempest-AttachVolumeTestJSON-1651611701 tempest-AttachVolumeTestJSON-1651611701-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:26:46.385971 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-6b37b36a-36ae-4461-8e49-b04f5b518a37 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f046401c6a04f6495ebe0821120bd72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a58e89ceeea4a9c8a72a1de4bcaf2d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:26:46.395062 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-6b37b36a-36ae-4461-8e49-b04f5b518a37 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] 10.222.0.11 "GET /compute/v2.1/servers/6dc785d7-bc95-4fee-8206-c2fd3b930e4f" status: 200 len: 1521 microversion: 2.1 time: 0.506101 Nov 17 03:26:46.401186 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-d26c7800-a343-44a7-bfd4-cdf25f07305c tempest-AttachVolumeTestJSON-1651611701 tempest-AttachVolumeTestJSON-1651611701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1110e625f8f3451aafcdcac96d3e9ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bf44d5ada38487eb55a9f4b7d52862d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:26:46.402169 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 175/335] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:26:45 2021] GET /compute/v2.1/servers/6dc785d7-bc95-4fee-8206-c2fd3b930e4f => generated 1521 bytes in 514 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:26:46.414038 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-d26c7800-a343-44a7-bfd4-cdf25f07305c tempest-AttachVolumeTestJSON-1651611701 tempest-AttachVolumeTestJSON-1651611701-project] 10.222.0.11 "GET /compute/v2.1/servers/5e11ea9c-f66a-4962-b5ca-b95784624824" status: 200 len: 1364 microversion: 2.1 time: 0.287414 Nov 17 03:26:46.414818 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 161/336] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:26:46 2021] GET /compute/v2.1/servers/5e11ea9c-f66a-4962-b5ca-b95784624824 => generated 1364 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:26:46.599539 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-69c58fab-5570-42b8-ac94-67f8cfdd67e9 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 17 03:26:46.600608 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-69c58fab-5570-42b8-ac94-67f8cfdd67e9 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] [instance: 5d54db85-b991-4890-abaa-952413baa2e7] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:26:46.618581 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-69c58fab-5570-42b8-ac94-67f8cfdd67e9 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:26:46.619522 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-69c58fab-5570-42b8-ac94-67f8cfdd67e9 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:26:46.620675 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-69c58fab-5570-42b8-ac94-67f8cfdd67e9 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:26:46.621308 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-69c58fab-5570-42b8-ac94-67f8cfdd67e9 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:26:46.638066 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-e669971a-d4a2-4638-b18d-b97224e5d385 tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:26:46.639170 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-e669971a-d4a2-4638-b18d-b97224e5d385 tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] [instance: 645ba67f-2582-4a60-b013-84777a71a70d] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:26:46.653809 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-e669971a-d4a2-4638-b18d-b97224e5d385 tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:26:46.660953 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-e669971a-d4a2-4638-b18d-b97224e5d385 tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:26:46.662072 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-e669971a-d4a2-4638-b18d-b97224e5d385 tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:26:46.662701 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-e669971a-d4a2-4638-b18d-b97224e5d385 tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:26:46.824142 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-69c58fab-5570-42b8-ac94-67f8cfdd67e9 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] 10.222.0.11 "POST /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7/action" status: 200 len: 28058 microversion: 2.20 time: 0.228038 Nov 17 03:26:46.826111 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 176/337] 10.222.0.11 () {62 vars in 1318 bytes} [Wed Nov 17 03:26:46 2021] POST /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7/action => generated 28058 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 17 03:26:46.880882 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-e669971a-d4a2-4638-b18d-b97224e5d385 tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d4e8ac9538f42c9b637bd9e086668b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfc480343d4d493bb4295b055e274df5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:26:46.889701 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-e669971a-d4a2-4638-b18d-b97224e5d385 tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] 10.222.0.11 "GET /compute/v2.1/servers/645ba67f-2582-4a60-b013-84777a71a70d" status: 200 len: 1318 microversion: 2.1 time: 0.255382 Nov 17 03:26:46.890296 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 162/338] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:26:46 2021] GET /compute/v2.1/servers/645ba67f-2582-4a60-b013-84777a71a70d => generated 1318 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:26:47.141700 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-f50e01ab-5569-4226-9312-2489b1654746 tempest-VolumesNegativeTest-1100551557 tempest-VolumesNegativeTest-1100551557-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:26:47.142389 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-f50e01ab-5569-4226-9312-2489b1654746 tempest-VolumesNegativeTest-1100551557 tempest-VolumesNegativeTest-1100551557-project] [instance: 45027e8f-667f-45f3-a5f9-2399d6ea3830] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:26:47.153543 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-f50e01ab-5569-4226-9312-2489b1654746 tempest-VolumesNegativeTest-1100551557 tempest-VolumesNegativeTest-1100551557-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:26:47.154117 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-f50e01ab-5569-4226-9312-2489b1654746 tempest-VolumesNegativeTest-1100551557 tempest-VolumesNegativeTest-1100551557-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:26:47.154932 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-f50e01ab-5569-4226-9312-2489b1654746 tempest-VolumesNegativeTest-1100551557 tempest-VolumesNegativeTest-1100551557-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:26:47.155619 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-f50e01ab-5569-4226-9312-2489b1654746 tempest-VolumesNegativeTest-1100551557 tempest-VolumesNegativeTest-1100551557-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:26:47.387154 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-f50e01ab-5569-4226-9312-2489b1654746 tempest-VolumesNegativeTest-1100551557 tempest-VolumesNegativeTest-1100551557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20f76a7333f14ee2ad5223b6f038e271', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0718c5e9ff9246ecb9100477e30e25eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:26:47.397006 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-f50e01ab-5569-4226-9312-2489b1654746 tempest-VolumesNegativeTest-1100551557 tempest-VolumesNegativeTest-1100551557-project] 10.222.0.11 "GET /compute/v2.1/servers/45027e8f-667f-45f3-a5f9-2399d6ea3830" status: 200 len: 1315 microversion: 2.1 time: 0.259905 Nov 17 03:26:47.397585 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 177/339] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:26:47 2021] GET /compute/v2.1/servers/45027e8f-667f-45f3-a5f9-2399d6ea3830 => generated 1315 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:26:47.412286 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-d4a10128-83d9-48b6-bf9d-0282cb9fb95d tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:26:47.414062 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-d4a10128-83d9-48b6-bf9d-0282cb9fb95d tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] [instance: 6dc785d7-bc95-4fee-8206-c2fd3b930e4f] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:26:47.422330 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-d4a10128-83d9-48b6-bf9d-0282cb9fb95d tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:26:47.422768 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-d4a10128-83d9-48b6-bf9d-0282cb9fb95d tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:26:47.423543 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-d4a10128-83d9-48b6-bf9d-0282cb9fb95d tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:26:47.423949 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-d4a10128-83d9-48b6-bf9d-0282cb9fb95d tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:26:47.431106 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-2d95d393-012f-4018-bdf7-3360422a64dc tempest-AttachVolumeTestJSON-1651611701 tempest-AttachVolumeTestJSON-1651611701-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:26:47.431818 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-2d95d393-012f-4018-bdf7-3360422a64dc tempest-AttachVolumeTestJSON-1651611701 tempest-AttachVolumeTestJSON-1651611701-project] [instance: 5e11ea9c-f66a-4962-b5ca-b95784624824] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:26:47.442234 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-2d95d393-012f-4018-bdf7-3360422a64dc tempest-AttachVolumeTestJSON-1651611701 tempest-AttachVolumeTestJSON-1651611701-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:26:47.443902 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-2d95d393-012f-4018-bdf7-3360422a64dc tempest-AttachVolumeTestJSON-1651611701 tempest-AttachVolumeTestJSON-1651611701-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:26:47.443902 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-2d95d393-012f-4018-bdf7-3360422a64dc tempest-AttachVolumeTestJSON-1651611701 tempest-AttachVolumeTestJSON-1651611701-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:26:47.443902 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-2d95d393-012f-4018-bdf7-3360422a64dc tempest-AttachVolumeTestJSON-1651611701 tempest-AttachVolumeTestJSON-1651611701-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:26:47.722370 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-d4a10128-83d9-48b6-bf9d-0282cb9fb95d tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f046401c6a04f6495ebe0821120bd72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a58e89ceeea4a9c8a72a1de4bcaf2d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:26:47.733775 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-d4a10128-83d9-48b6-bf9d-0282cb9fb95d tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] 10.222.0.11 "GET /compute/v2.1/servers/6dc785d7-bc95-4fee-8206-c2fd3b930e4f" status: 200 len: 1521 microversion: 2.1 time: 0.325596 Nov 17 03:26:47.745042 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 163/340] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:26:47 2021] GET /compute/v2.1/servers/6dc785d7-bc95-4fee-8206-c2fd3b930e4f => generated 1521 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:26:47.785869 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-2d95d393-012f-4018-bdf7-3360422a64dc tempest-AttachVolumeTestJSON-1651611701 tempest-AttachVolumeTestJSON-1651611701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1110e625f8f3451aafcdcac96d3e9ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bf44d5ada38487eb55a9f4b7d52862d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:26:47.796477 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-2d95d393-012f-4018-bdf7-3360422a64dc tempest-AttachVolumeTestJSON-1651611701 tempest-AttachVolumeTestJSON-1651611701-project] 10.222.0.11 "GET /compute/v2.1/servers/5e11ea9c-f66a-4962-b5ca-b95784624824" status: 200 len: 1364 microversion: 2.1 time: 0.367334 Nov 17 03:26:47.797367 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 178/341] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:26:47 2021] GET /compute/v2.1/servers/5e11ea9c-f66a-4962-b5ca-b95784624824 => generated 1364 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:26:47.836989 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-10382487-20f4-483e-b8fc-aa157f9163d6 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 17 03:26:47.838573 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-10382487-20f4-483e-b8fc-aa157f9163d6 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] [instance: 5d54db85-b991-4890-abaa-952413baa2e7] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:26:47.854748 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-10382487-20f4-483e-b8fc-aa157f9163d6 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:26:47.859862 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-10382487-20f4-483e-b8fc-aa157f9163d6 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:26:47.861152 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-10382487-20f4-483e-b8fc-aa157f9163d6 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:26:47.862218 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-10382487-20f4-483e-b8fc-aa157f9163d6 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:26:47.871758 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [req-a449efb3-5e4c-47f9-8eb7-baeb9349f8e3 req-9c578b54-e252-49e5-8667-f3de3d386e8f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "45027e8f-667f-45f3-a5f9-2399d6ea3830", "tag": "56975407-dbfd-44f5-b514-f53c325f17ac"}]} {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 17 03:26:47.873861 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 17 03:26:47.873861 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: warnings.warn(msg) Nov 17 03:26:47.888185 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [req-a449efb3-5e4c-47f9-8eb7-baeb9349f8e3 req-9c578b54-e252-49e5-8667-f3de3d386e8f service nova] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:26:47.900924 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [req-a449efb3-5e4c-47f9-8eb7-baeb9349f8e3 req-9c578b54-e252-49e5-8667-f3de3d386e8f service nova] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:26:47.922404 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.compute.server_external_events [req-a449efb3-5e4c-47f9-8eb7-baeb9349f8e3 req-9c578b54-e252-49e5-8667-f3de3d386e8f service nova] Creating event network-changed:56975407-dbfd-44f5-b514-f53c325f17ac for instance 45027e8f-667f-45f3-a5f9-2399d6ea3830 on hv-cinder-81803 Nov 17 03:26:47.930471 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [req-a449efb3-5e4c-47f9-8eb7-baeb9349f8e3 req-9c578b54-e252-49e5-8667-f3de3d386e8f service nova] 10.222.0.11 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.065605 Nov 17 03:26:47.931099 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 179/342] 10.222.0.11 () {64 vars in 1317 bytes} [Wed Nov 17 03:26:47 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 17 03:26:47.946637 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-a22a3bad-a376-429e-b42b-94367e556c9c tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:26:47.947402 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-a22a3bad-a376-429e-b42b-94367e556c9c tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] [instance: 645ba67f-2582-4a60-b013-84777a71a70d] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:26:47.956077 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-a22a3bad-a376-429e-b42b-94367e556c9c tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:26:47.956523 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-a22a3bad-a376-429e-b42b-94367e556c9c tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:26:47.957337 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-a22a3bad-a376-429e-b42b-94367e556c9c tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:26:47.957777 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-a22a3bad-a376-429e-b42b-94367e556c9c tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:26:48.048656 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-10382487-20f4-483e-b8fc-aa157f9163d6 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] 10.222.0.11 "POST /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7/action" status: 200 len: 28183 microversion: 2.20 time: 0.215391 Nov 17 03:26:48.050234 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 164/343] 10.222.0.11 () {62 vars in 1318 bytes} [Wed Nov 17 03:26:47 2021] POST /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7/action => generated 28183 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 17 03:26:48.325022 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-a22a3bad-a376-429e-b42b-94367e556c9c tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d4e8ac9538f42c9b637bd9e086668b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfc480343d4d493bb4295b055e274df5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:26:48.335551 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-a22a3bad-a376-429e-b42b-94367e556c9c tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] 10.222.0.11 "GET /compute/v2.1/servers/645ba67f-2582-4a60-b013-84777a71a70d" status: 200 len: 1505 microversion: 2.1 time: 0.398177 Nov 17 03:26:48.336969 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 180/344] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:26:47 2021] GET /compute/v2.1/servers/645ba67f-2582-4a60-b013-84777a71a70d => generated 1505 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:26:48.354916 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-4461e5ac-3ab5-4d2b-ac6e-c5a9d9aea130 tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "5627f3b7-528c-4703-8867-0d4a68990208"}} {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 17 03:26:48.356590 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-4461e5ac-3ab5-4d2b-ac6e-c5a9d9aea130 tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] [instance: 645ba67f-2582-4a60-b013-84777a71a70d] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:26:48.363704 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-4461e5ac-3ab5-4d2b-ac6e-c5a9d9aea130 tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:26:48.364488 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-4461e5ac-3ab5-4d2b-ac6e-c5a9d9aea130 tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:26:48.365562 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-4461e5ac-3ab5-4d2b-ac6e-c5a9d9aea130 tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:26:48.366145 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-4461e5ac-3ab5-4d2b-ac6e-c5a9d9aea130 tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:26:48.413818 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-440aac75-debb-4713-8ba7-7a65421ae9e4 tempest-VolumesNegativeTest-1100551557 tempest-VolumesNegativeTest-1100551557-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:26:48.416944 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-440aac75-debb-4713-8ba7-7a65421ae9e4 tempest-VolumesNegativeTest-1100551557 tempest-VolumesNegativeTest-1100551557-project] [instance: 45027e8f-667f-45f3-a5f9-2399d6ea3830] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:26:48.438988 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-440aac75-debb-4713-8ba7-7a65421ae9e4 tempest-VolumesNegativeTest-1100551557 tempest-VolumesNegativeTest-1100551557-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:26:48.439442 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-440aac75-debb-4713-8ba7-7a65421ae9e4 tempest-VolumesNegativeTest-1100551557 tempest-VolumesNegativeTest-1100551557-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:26:48.440235 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-440aac75-debb-4713-8ba7-7a65421ae9e4 tempest-VolumesNegativeTest-1100551557 tempest-VolumesNegativeTest-1100551557-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:26:48.440989 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-440aac75-debb-4713-8ba7-7a65421ae9e4 tempest-VolumesNegativeTest-1100551557 tempest-VolumesNegativeTest-1100551557-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:26:48.511302 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.wsgi [None req-4461e5ac-3ab5-4d2b-ac6e-c5a9d9aea130 tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] HTTP exception thrown: Invalid volume: volume 5627f3b7-528c-4703-8867-0d4a68990208 is already attached to instances: 61d387ba-e928-4e5f-a79c-4f757643903c Nov 17 03:26:48.512917 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-4461e5ac-3ab5-4d2b-ac6e-c5a9d9aea130 tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] Returning 400 to user: Invalid volume: volume 5627f3b7-528c-4703-8867-0d4a68990208 is already attached to instances: 61d387ba-e928-4e5f-a79c-4f757643903c {{(pid=115916) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 17 03:26:48.514788 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-4461e5ac-3ab5-4d2b-ac6e-c5a9d9aea130 tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] 10.222.0.11 "POST /compute/v2.1/servers/645ba67f-2582-4a60-b013-84777a71a70d/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.163837 Nov 17 03:26:48.523394 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 165/345] 10.222.0.11 () {60 vars in 1322 bytes} [Wed Nov 17 03:26:48 2021] POST /compute/v2.1/servers/645ba67f-2582-4a60-b013-84777a71a70d/os-volume_attachments => generated 174 bytes in 173 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Nov 17 03:26:48.618028 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-3ab38332-c811-4453-8510-59bb2312da92 tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:26:48.618621 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-3ab38332-c811-4453-8510-59bb2312da92 tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] [instance: 61d387ba-e928-4e5f-a79c-4f757643903c] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:26:48.626641 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-3ab38332-c811-4453-8510-59bb2312da92 tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:26:48.627184 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-3ab38332-c811-4453-8510-59bb2312da92 tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:26:48.628042 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-3ab38332-c811-4453-8510-59bb2312da92 tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:26:48.628534 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-3ab38332-c811-4453-8510-59bb2312da92 tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:26:48.779744 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-440aac75-debb-4713-8ba7-7a65421ae9e4 tempest-VolumesNegativeTest-1100551557 tempest-VolumesNegativeTest-1100551557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20f76a7333f14ee2ad5223b6f038e271', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0718c5e9ff9246ecb9100477e30e25eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:26:48.797774 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-440aac75-debb-4713-8ba7-7a65421ae9e4 tempest-VolumesNegativeTest-1100551557 tempest-VolumesNegativeTest-1100551557-project] 10.222.0.11 "GET /compute/v2.1/servers/45027e8f-667f-45f3-a5f9-2399d6ea3830" status: 200 len: 1315 microversion: 2.1 time: 0.382710 Nov 17 03:26:48.801640 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 181/346] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:26:48 2021] GET /compute/v2.1/servers/45027e8f-667f-45f3-a5f9-2399d6ea3830 => generated 1315 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:26:48.814728 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-50b0afc8-abc0-4fa5-b800-98c081a47192 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:26:48.820355 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-50b0afc8-abc0-4fa5-b800-98c081a47192 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] [instance: 6dc785d7-bc95-4fee-8206-c2fd3b930e4f] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:26:48.835241 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-50b0afc8-abc0-4fa5-b800-98c081a47192 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:26:48.835810 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-50b0afc8-abc0-4fa5-b800-98c081a47192 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:26:48.836647 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-50b0afc8-abc0-4fa5-b800-98c081a47192 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:26:48.841583 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-50b0afc8-abc0-4fa5-b800-98c081a47192 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:26:48.863424 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.objects.instance [None req-3ab38332-c811-4453-8510-59bb2312da92 tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] Lazy-loading 'services' on Instance uuid 61d387ba-e928-4e5f-a79c-4f757643903c {{(pid=115916) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Nov 17 03:26:49.051182 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-3ab38332-c811-4453-8510-59bb2312da92 tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] 10.222.0.11 "DELETE /compute/v2.1/servers/61d387ba-e928-4e5f-a79c-4f757643903c/os-volume_attachments/5627f3b7-528c-4703-8867-0d4a68990208" status: 202 len: 0 microversion: 2.1 time: 0.436304 Nov 17 03:26:49.063520 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 166/347] 10.222.0.11 () {58 vars in 1415 bytes} [Wed Nov 17 03:26:48 2021] DELETE /compute/v2.1/servers/61d387ba-e928-4e5f-a79c-4f757643903c/os-volume_attachments/5627f3b7-528c-4703-8867-0d4a68990208 => generated 0 bytes in 450 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 17 03:26:49.080697 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-b64b74d1-6b27-4438-883b-c654575568ea tempest-AttachVolumeTestJSON-1651611701 tempest-AttachVolumeTestJSON-1651611701-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:26:49.081985 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-b64b74d1-6b27-4438-883b-c654575568ea tempest-AttachVolumeTestJSON-1651611701 tempest-AttachVolumeTestJSON-1651611701-project] [instance: 5e11ea9c-f66a-4962-b5ca-b95784624824] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:26:49.090768 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-b64b74d1-6b27-4438-883b-c654575568ea tempest-AttachVolumeTestJSON-1651611701 tempest-AttachVolumeTestJSON-1651611701-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:26:49.091625 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-b64b74d1-6b27-4438-883b-c654575568ea tempest-AttachVolumeTestJSON-1651611701 tempest-AttachVolumeTestJSON-1651611701-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:26:49.092826 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-b64b74d1-6b27-4438-883b-c654575568ea tempest-AttachVolumeTestJSON-1651611701 tempest-AttachVolumeTestJSON-1651611701-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:26:49.094338 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-b64b74d1-6b27-4438-883b-c654575568ea tempest-AttachVolumeTestJSON-1651611701 tempest-AttachVolumeTestJSON-1651611701-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:26:49.112067 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-50b0afc8-abc0-4fa5-b800-98c081a47192 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f046401c6a04f6495ebe0821120bd72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a58e89ceeea4a9c8a72a1de4bcaf2d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:26:49.121090 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-50b0afc8-abc0-4fa5-b800-98c081a47192 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] 10.222.0.11 "GET /compute/v2.1/servers/6dc785d7-bc95-4fee-8206-c2fd3b930e4f" status: 200 len: 1521 microversion: 2.1 time: 0.317812 Nov 17 03:26:49.123918 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 182/348] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:26:48 2021] GET /compute/v2.1/servers/6dc785d7-bc95-4fee-8206-c2fd3b930e4f => generated 1521 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:26:49.137515 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-6594f443-8c33-41c5-a97a-ec5b078e40eb tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 17 03:26:49.138560 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-6594f443-8c33-41c5-a97a-ec5b078e40eb tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] [instance: 5d54db85-b991-4890-abaa-952413baa2e7] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:26:49.145960 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-6594f443-8c33-41c5-a97a-ec5b078e40eb tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:26:49.146416 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-6594f443-8c33-41c5-a97a-ec5b078e40eb tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:26:49.147264 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-6594f443-8c33-41c5-a97a-ec5b078e40eb tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:26:49.147628 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-6594f443-8c33-41c5-a97a-ec5b078e40eb tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:26:49.288510 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-6594f443-8c33-41c5-a97a-ec5b078e40eb tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] 10.222.0.11 "POST /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7/action" status: 200 len: 28183 microversion: 2.20 time: 0.163227 Nov 17 03:26:49.289268 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 183/349] 10.222.0.11 () {62 vars in 1318 bytes} [Wed Nov 17 03:26:49 2021] POST /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7/action => generated 28183 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 17 03:26:49.299049 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-f43a690d-f368-4b77-a047-9daa3a8758bc tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:26:49.300123 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-f43a690d-f368-4b77-a047-9daa3a8758bc tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] [instance: 61d387ba-e928-4e5f-a79c-4f757643903c] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:26:49.316604 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-f43a690d-f368-4b77-a047-9daa3a8758bc tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:26:49.317438 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-f43a690d-f368-4b77-a047-9daa3a8758bc tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:26:49.318749 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-f43a690d-f368-4b77-a047-9daa3a8758bc tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:26:49.319363 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-f43a690d-f368-4b77-a047-9daa3a8758bc tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:26:49.361330 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-f43a690d-f368-4b77-a047-9daa3a8758bc tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] 10.222.0.11 "GET /compute/v2.1/servers/61d387ba-e928-4e5f-a79c-4f757643903c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.070856 Nov 17 03:26:49.362516 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 184/350] 10.222.0.11 () {58 vars in 1301 bytes} [Wed Nov 17 03:26:49 2021] GET /compute/v2.1/servers/61d387ba-e928-4e5f-a79c-4f757643903c/os-volume_attachments => generated 197 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 17 03:26:49.581388 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-b64b74d1-6b27-4438-883b-c654575568ea tempest-AttachVolumeTestJSON-1651611701 tempest-AttachVolumeTestJSON-1651611701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1110e625f8f3451aafcdcac96d3e9ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bf44d5ada38487eb55a9f4b7d52862d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:26:49.588904 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-b64b74d1-6b27-4438-883b-c654575568ea tempest-AttachVolumeTestJSON-1651611701 tempest-AttachVolumeTestJSON-1651611701-project] 10.222.0.11 "GET /compute/v2.1/servers/5e11ea9c-f66a-4962-b5ca-b95784624824" status: 200 len: 1364 microversion: 2.1 time: 0.523629 Nov 17 03:26:49.598801 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 167/351] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:26:49 2021] GET /compute/v2.1/servers/5e11ea9c-f66a-4962-b5ca-b95784624824 => generated 1364 bytes in 534 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:26:49.816471 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-b0fbea1b-79d5-4633-98ee-f8829d976a34 tempest-VolumesNegativeTest-1100551557 tempest-VolumesNegativeTest-1100551557-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:26:49.817222 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-b0fbea1b-79d5-4633-98ee-f8829d976a34 tempest-VolumesNegativeTest-1100551557 tempest-VolumesNegativeTest-1100551557-project] [instance: 45027e8f-667f-45f3-a5f9-2399d6ea3830] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:26:49.835485 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-b0fbea1b-79d5-4633-98ee-f8829d976a34 tempest-VolumesNegativeTest-1100551557 tempest-VolumesNegativeTest-1100551557-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:26:49.837047 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-b0fbea1b-79d5-4633-98ee-f8829d976a34 tempest-VolumesNegativeTest-1100551557 tempest-VolumesNegativeTest-1100551557-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:26:49.838374 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-b0fbea1b-79d5-4633-98ee-f8829d976a34 tempest-VolumesNegativeTest-1100551557 tempest-VolumesNegativeTest-1100551557-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:26:49.838944 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-b0fbea1b-79d5-4633-98ee-f8829d976a34 tempest-VolumesNegativeTest-1100551557 tempest-VolumesNegativeTest-1100551557-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:26:49.992147 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-b0fbea1b-79d5-4633-98ee-f8829d976a34 tempest-VolumesNegativeTest-1100551557 tempest-VolumesNegativeTest-1100551557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20f76a7333f14ee2ad5223b6f038e271', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0718c5e9ff9246ecb9100477e30e25eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:26:50.003103 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-b0fbea1b-79d5-4633-98ee-f8829d976a34 tempest-VolumesNegativeTest-1100551557 tempest-VolumesNegativeTest-1100551557-project] 10.222.0.11 "GET /compute/v2.1/servers/45027e8f-667f-45f3-a5f9-2399d6ea3830" status: 200 len: 1315 microversion: 2.1 time: 0.190353 Nov 17 03:26:50.004099 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 185/352] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:26:49 2021] GET /compute/v2.1/servers/45027e8f-667f-45f3-a5f9-2399d6ea3830 => generated 1315 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:26:50.144849 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-d679aa19-46b7-4f4e-945f-e2824064825d tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:26:50.145887 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-d679aa19-46b7-4f4e-945f-e2824064825d tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] [instance: 6dc785d7-bc95-4fee-8206-c2fd3b930e4f] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:26:50.155691 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-d679aa19-46b7-4f4e-945f-e2824064825d tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:26:50.156632 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-d679aa19-46b7-4f4e-945f-e2824064825d tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:26:50.157874 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-d679aa19-46b7-4f4e-945f-e2824064825d tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:26:50.158556 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-d679aa19-46b7-4f4e-945f-e2824064825d tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:26:50.336080 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-ab56ca5a-8ad3-4fdf-bde3-2131d5efee6a tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 17 03:26:50.337851 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-ab56ca5a-8ad3-4fdf-bde3-2131d5efee6a tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] [instance: 5d54db85-b991-4890-abaa-952413baa2e7] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:26:50.382797 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-ab56ca5a-8ad3-4fdf-bde3-2131d5efee6a tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:26:50.383263 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-ab56ca5a-8ad3-4fdf-bde3-2131d5efee6a tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:26:50.384075 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-ab56ca5a-8ad3-4fdf-bde3-2131d5efee6a tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:26:50.384516 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-ab56ca5a-8ad3-4fdf-bde3-2131d5efee6a tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:26:50.583783 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-d679aa19-46b7-4f4e-945f-e2824064825d tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f046401c6a04f6495ebe0821120bd72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a58e89ceeea4a9c8a72a1de4bcaf2d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:26:50.596351 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-d679aa19-46b7-4f4e-945f-e2824064825d tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] 10.222.0.11 "GET /compute/v2.1/servers/6dc785d7-bc95-4fee-8206-c2fd3b930e4f" status: 200 len: 1521 microversion: 2.1 time: 0.456520 Nov 17 03:26:50.597860 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 168/353] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:26:50 2021] GET /compute/v2.1/servers/6dc785d7-bc95-4fee-8206-c2fd3b930e4f => generated 1521 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:26:50.602539 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-ab56ca5a-8ad3-4fdf-bde3-2131d5efee6a tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] 10.222.0.11 "POST /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7/action" status: 200 len: 28472 microversion: 2.20 time: 0.297554 Nov 17 03:26:50.606519 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 186/354] 10.222.0.11 () {62 vars in 1318 bytes} [Wed Nov 17 03:26:50 2021] POST /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7/action => generated 28472 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 17 03:26:50.608849 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-505fc0bf-ab7a-4994-b3e9-2ea4872536c0 tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:26:50.610006 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-505fc0bf-ab7a-4994-b3e9-2ea4872536c0 tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] [instance: 61d387ba-e928-4e5f-a79c-4f757643903c] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:26:50.613665 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-9c2716f0-0d0b-4996-a8a8-359c2046d4d5 tempest-AttachVolumeTestJSON-1651611701 tempest-AttachVolumeTestJSON-1651611701-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:26:50.614390 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-9c2716f0-0d0b-4996-a8a8-359c2046d4d5 tempest-AttachVolumeTestJSON-1651611701 tempest-AttachVolumeTestJSON-1651611701-project] [instance: 5e11ea9c-f66a-4962-b5ca-b95784624824] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:26:50.617348 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-505fc0bf-ab7a-4994-b3e9-2ea4872536c0 tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:26:50.618114 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-505fc0bf-ab7a-4994-b3e9-2ea4872536c0 tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:26:50.619078 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-505fc0bf-ab7a-4994-b3e9-2ea4872536c0 tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:26:50.619494 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-505fc0bf-ab7a-4994-b3e9-2ea4872536c0 tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:26:50.626620 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-9c2716f0-0d0b-4996-a8a8-359c2046d4d5 tempest-AttachVolumeTestJSON-1651611701 tempest-AttachVolumeTestJSON-1651611701-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:26:50.627127 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-9c2716f0-0d0b-4996-a8a8-359c2046d4d5 tempest-AttachVolumeTestJSON-1651611701 tempest-AttachVolumeTestJSON-1651611701-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:26:50.628205 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-9c2716f0-0d0b-4996-a8a8-359c2046d4d5 tempest-AttachVolumeTestJSON-1651611701 tempest-AttachVolumeTestJSON-1651611701-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:26:50.628747 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-9c2716f0-0d0b-4996-a8a8-359c2046d4d5 tempest-AttachVolumeTestJSON-1651611701 tempest-AttachVolumeTestJSON-1651611701-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:26:50.663437 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-505fc0bf-ab7a-4994-b3e9-2ea4872536c0 tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] 10.222.0.11 "GET /compute/v2.1/servers/61d387ba-e928-4e5f-a79c-4f757643903c/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.062634 Nov 17 03:26:50.664124 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 169/355] 10.222.0.11 () {58 vars in 1301 bytes} [Wed Nov 17 03:26:50 2021] GET /compute/v2.1/servers/61d387ba-e928-4e5f-a79c-4f757643903c/os-volume_attachments => generated 25 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 17 03:26:50.883019 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-d31b2379-2747-431d-a85e-03ddf2ea242e tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1533282121", "imageRef": "7281a37a-6b99-49c1-881a-41604d06bae1", "flavorRef": "452", "networks": [{"uuid": "35db41f0-fe89-4e18-9f58-e0afb8774292"}]}} {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 17 03:26:50.937430 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-9c2716f0-0d0b-4996-a8a8-359c2046d4d5 tempest-AttachVolumeTestJSON-1651611701 tempest-AttachVolumeTestJSON-1651611701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1110e625f8f3451aafcdcac96d3e9ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bf44d5ada38487eb55a9f4b7d52862d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:26:50.954090 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-9c2716f0-0d0b-4996-a8a8-359c2046d4d5 tempest-AttachVolumeTestJSON-1651611701 tempest-AttachVolumeTestJSON-1651611701-project] 10.222.0.11 "GET /compute/v2.1/servers/5e11ea9c-f66a-4962-b5ca-b95784624824" status: 200 len: 1364 microversion: 2.1 time: 0.340926 Nov 17 03:26:50.956379 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 187/356] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:26:50 2021] GET /compute/v2.1/servers/5e11ea9c-f66a-4962-b5ca-b95784624824 => generated 1364 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:26:50.969906 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.network.neutron [None req-d31b2379-2747-431d-a85e-03ddf2ea242e tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] validate_networks() for [('35db41f0-fe89-4e18-9f58-e0afb8774292', None, None, None, None, None)] {{(pid=115916) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Nov 17 03:26:51.019554 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-33f0b59d-9645-4eb9-8361-ea92fe8ad1db tempest-VolumesNegativeTest-1100551557 tempest-VolumesNegativeTest-1100551557-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:26:51.020162 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-33f0b59d-9645-4eb9-8361-ea92fe8ad1db tempest-VolumesNegativeTest-1100551557 tempest-VolumesNegativeTest-1100551557-project] [instance: 45027e8f-667f-45f3-a5f9-2399d6ea3830] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:26:51.027659 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-33f0b59d-9645-4eb9-8361-ea92fe8ad1db tempest-VolumesNegativeTest-1100551557 tempest-VolumesNegativeTest-1100551557-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:26:51.028402 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-33f0b59d-9645-4eb9-8361-ea92fe8ad1db tempest-VolumesNegativeTest-1100551557 tempest-VolumesNegativeTest-1100551557-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:26:51.029388 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-33f0b59d-9645-4eb9-8361-ea92fe8ad1db tempest-VolumesNegativeTest-1100551557 tempest-VolumesNegativeTest-1100551557-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:26:51.029973 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-33f0b59d-9645-4eb9-8361-ea92fe8ad1db tempest-VolumesNegativeTest-1100551557 tempest-VolumesNegativeTest-1100551557-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:26:51.296249 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-33f0b59d-9645-4eb9-8361-ea92fe8ad1db tempest-VolumesNegativeTest-1100551557 tempest-VolumesNegativeTest-1100551557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20f76a7333f14ee2ad5223b6f038e271', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0718c5e9ff9246ecb9100477e30e25eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:26:51.309889 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-33f0b59d-9645-4eb9-8361-ea92fe8ad1db tempest-VolumesNegativeTest-1100551557 tempest-VolumesNegativeTest-1100551557-project] 10.222.0.11 "GET /compute/v2.1/servers/45027e8f-667f-45f3-a5f9-2399d6ea3830" status: 200 len: 1315 microversion: 2.1 time: 0.294133 Nov 17 03:26:51.319302 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 188/357] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:26:51 2021] GET /compute/v2.1/servers/45027e8f-667f-45f3-a5f9-2399d6ea3830 => generated 1315 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 17 03:26:51.614495 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-2e8563ad-7292-4b44-bc3d-df08d77a29c7 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:26:51.615581 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-2e8563ad-7292-4b44-bc3d-df08d77a29c7 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] [instance: 6dc785d7-bc95-4fee-8206-c2fd3b930e4f] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:26:51.629168 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-2e8563ad-7292-4b44-bc3d-df08d77a29c7 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:26:51.629631 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-2e8563ad-7292-4b44-bc3d-df08d77a29c7 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:26:51.630477 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-2e8563ad-7292-4b44-bc3d-df08d77a29c7 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:26:51.630943 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-2e8563ad-7292-4b44-bc3d-df08d77a29c7 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:26:51.692676 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.virt.hardware [None req-d31b2379-2747-431d-a85e-03ddf2ea242e tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] Flavor limits 0:0:0 {{(pid=115916) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 17 03:26:51.695609 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.virt.hardware [None req-d31b2379-2747-431d-a85e-03ddf2ea242e tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] Image limits 0:0:0 {{(pid=115916) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 17 03:26:51.696110 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.virt.hardware [None req-d31b2379-2747-431d-a85e-03ddf2ea242e tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] Flavor pref 0:0:0 {{(pid=115916) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 17 03:26:51.696507 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.virt.hardware [None req-d31b2379-2747-431d-a85e-03ddf2ea242e tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] Image pref 0:0:0 {{(pid=115916) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 17 03:26:51.696969 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.virt.hardware [None req-d31b2379-2747-431d-a85e-03ddf2ea242e tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=115916) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 17 03:26:51.709441 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-d31b2379-2747-431d-a85e-03ddf2ea242e tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:26:51.710135 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-d31b2379-2747-431d-a85e-03ddf2ea242e tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:26:51.711535 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-d31b2379-2747-431d-a85e-03ddf2ea242e tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:26:51.712119 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-d31b2379-2747-431d-a85e-03ddf2ea242e tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:26:51.743846 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.quota [None req-d31b2379-2747-431d-a85e-03ddf2ea242e tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] Getting quotas for project dfc480343d4d493bb4295b055e274df5. Resources: {'instances', 'ram', 'cores'} {{(pid=115916) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 17 03:26:51.756799 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.quota [None req-d31b2379-2747-431d-a85e-03ddf2ea242e tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] Getting quotas for user 6d4e8ac9538f42c9b637bd9e086668b3 and project dfc480343d4d493bb4295b055e274df5. Resources: {'instances', 'ram', 'cores'} {{(pid=115916) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 17 03:26:51.776524 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-d31b2379-2747-431d-a85e-03ddf2ea242e tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] Going to run 1 instances... {{(pid=115916) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 17 03:26:51.779117 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-d31b2379-2747-431d-a85e-03ddf2ea242e tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] [instance: 5c1643c5-72d3-4676-85e6-84c5f245c517] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='7281a37a-6b99-49c1-881a-41604d06bae1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=115916) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 17 03:26:51.855155 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-d31b2379-2747-431d-a85e-03ddf2ea242e tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] 10.222.0.11 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.975506 Nov 17 03:26:51.862354 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 170/358] 10.222.0.11 () {60 vars in 1146 bytes} [Wed Nov 17 03:26:50 2021] POST /compute/v2.1/servers => generated 380 bytes in 983 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Nov 17 03:26:51.868701 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-ffc0e677-a2be-4d4f-bd22-25202a2b18d5 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 17 03:26:51.873383 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-ffc0e677-a2be-4d4f-bd22-25202a2b18d5 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] [instance: 5d54db85-b991-4890-abaa-952413baa2e7] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:26:51.897182 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-ffc0e677-a2be-4d4f-bd22-25202a2b18d5 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:26:51.897652 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-ffc0e677-a2be-4d4f-bd22-25202a2b18d5 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:26:51.898435 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-ffc0e677-a2be-4d4f-bd22-25202a2b18d5 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:26:51.898870 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-ffc0e677-a2be-4d4f-bd22-25202a2b18d5 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:26:52.014977 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-ffc0e677-a2be-4d4f-bd22-25202a2b18d5 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] 10.222.0.11 "POST /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7/action" status: 200 len: 28487 microversion: 2.20 time: 0.151177 Nov 17 03:26:52.016023 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 171/359] 10.222.0.11 () {62 vars in 1318 bytes} [Wed Nov 17 03:26:51 2021] POST /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7/action => generated 28487 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 17 03:26:52.021666 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-5e54fb83-bcab-48ac-ae9e-8a4ec9fdfbda tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:26:52.022388 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-5e54fb83-bcab-48ac-ae9e-8a4ec9fdfbda tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] [instance: 5c1643c5-72d3-4676-85e6-84c5f245c517] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:26:52.055530 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-2e8563ad-7292-4b44-bc3d-df08d77a29c7 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f046401c6a04f6495ebe0821120bd72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a58e89ceeea4a9c8a72a1de4bcaf2d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:26:52.077947 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-2e8563ad-7292-4b44-bc3d-df08d77a29c7 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] 10.222.0.11 "GET /compute/v2.1/servers/6dc785d7-bc95-4fee-8206-c2fd3b930e4f" status: 200 len: 1521 microversion: 2.1 time: 0.467196 Nov 17 03:26:52.092222 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 189/360] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:26:51 2021] GET /compute/v2.1/servers/6dc785d7-bc95-4fee-8206-c2fd3b930e4f => generated 1521 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 17 03:26:52.097012 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-f5b3552b-34c4-412d-bb1a-585759b5a657 tempest-AttachVolumeTestJSON-1651611701 tempest-AttachVolumeTestJSON-1651611701-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:26:52.097684 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-f5b3552b-34c4-412d-bb1a-585759b5a657 tempest-AttachVolumeTestJSON-1651611701 tempest-AttachVolumeTestJSON-1651611701-project] [instance: 5e11ea9c-f66a-4962-b5ca-b95784624824] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:26:52.113657 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-f5b3552b-34c4-412d-bb1a-585759b5a657 tempest-AttachVolumeTestJSON-1651611701 tempest-AttachVolumeTestJSON-1651611701-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:26:52.114113 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-f5b3552b-34c4-412d-bb1a-585759b5a657 tempest-AttachVolumeTestJSON-1651611701 tempest-AttachVolumeTestJSON-1651611701-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:26:52.114978 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-f5b3552b-34c4-412d-bb1a-585759b5a657 tempest-AttachVolumeTestJSON-1651611701 tempest-AttachVolumeTestJSON-1651611701-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:26:52.115452 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-f5b3552b-34c4-412d-bb1a-585759b5a657 tempest-AttachVolumeTestJSON-1651611701 tempest-AttachVolumeTestJSON-1651611701-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:26:52.183449 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-5e54fb83-bcab-48ac-ae9e-8a4ec9fdfbda tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d4e8ac9538f42c9b637bd9e086668b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfc480343d4d493bb4295b055e274df5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:26:52.193939 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-5e54fb83-bcab-48ac-ae9e-8a4ec9fdfbda tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] 10.222.0.11 "GET /compute/v2.1/servers/5c1643c5-72d3-4676-85e6-84c5f245c517" status: 200 len: 1218 microversion: 2.1 time: 0.176031 Nov 17 03:26:52.194538 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 172/361] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:26:52 2021] GET /compute/v2.1/servers/5c1643c5-72d3-4676-85e6-84c5f245c517 => generated 1218 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:26:52.327909 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-5319afbd-9f57-49f3-b450-b2d31e5baed6 tempest-VolumesNegativeTest-1100551557 tempest-VolumesNegativeTest-1100551557-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:26:52.328524 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-5319afbd-9f57-49f3-b450-b2d31e5baed6 tempest-VolumesNegativeTest-1100551557 tempest-VolumesNegativeTest-1100551557-project] [instance: 45027e8f-667f-45f3-a5f9-2399d6ea3830] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:26:52.336440 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-5319afbd-9f57-49f3-b450-b2d31e5baed6 tempest-VolumesNegativeTest-1100551557 tempest-VolumesNegativeTest-1100551557-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:26:52.336927 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-5319afbd-9f57-49f3-b450-b2d31e5baed6 tempest-VolumesNegativeTest-1100551557 tempest-VolumesNegativeTest-1100551557-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:26:52.356894 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-5319afbd-9f57-49f3-b450-b2d31e5baed6 tempest-VolumesNegativeTest-1100551557 tempest-VolumesNegativeTest-1100551557-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:26:52.362872 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-5319afbd-9f57-49f3-b450-b2d31e5baed6 tempest-VolumesNegativeTest-1100551557 tempest-VolumesNegativeTest-1100551557-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:26:52.664297 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-f5b3552b-34c4-412d-bb1a-585759b5a657 tempest-AttachVolumeTestJSON-1651611701 tempest-AttachVolumeTestJSON-1651611701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1110e625f8f3451aafcdcac96d3e9ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bf44d5ada38487eb55a9f4b7d52862d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:26:52.676119 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-5319afbd-9f57-49f3-b450-b2d31e5baed6 tempest-VolumesNegativeTest-1100551557 tempest-VolumesNegativeTest-1100551557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20f76a7333f14ee2ad5223b6f038e271', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0718c5e9ff9246ecb9100477e30e25eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:26:52.685219 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-f5b3552b-34c4-412d-bb1a-585759b5a657 tempest-AttachVolumeTestJSON-1651611701 tempest-AttachVolumeTestJSON-1651611701-project] 10.222.0.11 "GET /compute/v2.1/servers/5e11ea9c-f66a-4962-b5ca-b95784624824" status: 200 len: 1364 microversion: 2.1 time: 0.591672 Nov 17 03:26:52.687843 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-5319afbd-9f57-49f3-b450-b2d31e5baed6 tempest-VolumesNegativeTest-1100551557 tempest-VolumesNegativeTest-1100551557-project] 10.222.0.11 "GET /compute/v2.1/servers/45027e8f-667f-45f3-a5f9-2399d6ea3830" status: 200 len: 1315 microversion: 2.1 time: 0.363919 Nov 17 03:26:52.688015 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 190/362] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:26:52 2021] GET /compute/v2.1/servers/5e11ea9c-f66a-4962-b5ca-b95784624824 => generated 1364 bytes in 595 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:26:52.709892 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 173/363] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:26:52 2021] GET /compute/v2.1/servers/45027e8f-667f-45f3-a5f9-2399d6ea3830 => generated 1315 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:26:53.028445 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-0f3eed70-f153-4352-9511-7f9ac2f147b9 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 17 03:26:53.029483 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-0f3eed70-f153-4352-9511-7f9ac2f147b9 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] [instance: 5d54db85-b991-4890-abaa-952413baa2e7] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:26:53.035551 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-0f3eed70-f153-4352-9511-7f9ac2f147b9 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:26:53.036227 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-0f3eed70-f153-4352-9511-7f9ac2f147b9 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:26:53.037355 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-0f3eed70-f153-4352-9511-7f9ac2f147b9 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:26:53.037943 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-0f3eed70-f153-4352-9511-7f9ac2f147b9 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:26:53.102700 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-a5697601-3b17-4ca7-a6ec-2f012959bc2d tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:26:53.103710 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-a5697601-3b17-4ca7-a6ec-2f012959bc2d tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] [instance: 6dc785d7-bc95-4fee-8206-c2fd3b930e4f] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:26:53.122114 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-a5697601-3b17-4ca7-a6ec-2f012959bc2d tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:26:53.123909 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-a5697601-3b17-4ca7-a6ec-2f012959bc2d tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:26:53.124716 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-a5697601-3b17-4ca7-a6ec-2f012959bc2d tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:26:53.125161 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-a5697601-3b17-4ca7-a6ec-2f012959bc2d tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:26:53.229457 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-0f3eed70-f153-4352-9511-7f9ac2f147b9 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] 10.222.0.11 "POST /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7/action" status: 200 len: 28640 microversion: 2.20 time: 0.205350 Nov 17 03:26:53.234110 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 191/364] 10.222.0.11 () {62 vars in 1318 bytes} [Wed Nov 17 03:26:53 2021] POST /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7/action => generated 28640 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 17 03:26:53.239376 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-e5eaab25-fe37-43e1-b1d5-9eed63bdcbbd tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:26:53.243465 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-e5eaab25-fe37-43e1-b1d5-9eed63bdcbbd tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] [instance: 5c1643c5-72d3-4676-85e6-84c5f245c517] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:26:53.260330 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-e5eaab25-fe37-43e1-b1d5-9eed63bdcbbd tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:26:53.263145 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-e5eaab25-fe37-43e1-b1d5-9eed63bdcbbd tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:26:53.264186 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-e5eaab25-fe37-43e1-b1d5-9eed63bdcbbd tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:26:53.264768 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-e5eaab25-fe37-43e1-b1d5-9eed63bdcbbd tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:26:53.372985 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-a5697601-3b17-4ca7-a6ec-2f012959bc2d tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f046401c6a04f6495ebe0821120bd72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a58e89ceeea4a9c8a72a1de4bcaf2d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:26:53.384462 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-a5697601-3b17-4ca7-a6ec-2f012959bc2d tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] 10.222.0.11 "GET /compute/v2.1/servers/6dc785d7-bc95-4fee-8206-c2fd3b930e4f" status: 200 len: 1521 microversion: 2.1 time: 0.292670 Nov 17 03:26:53.385712 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 174/365] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:26:53 2021] GET /compute/v2.1/servers/6dc785d7-bc95-4fee-8206-c2fd3b930e4f => generated 1521 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:26:53.403742 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-e5eaab25-fe37-43e1-b1d5-9eed63bdcbbd tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d4e8ac9538f42c9b637bd9e086668b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfc480343d4d493bb4295b055e274df5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:26:53.421922 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-e5eaab25-fe37-43e1-b1d5-9eed63bdcbbd tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] 10.222.0.11 "GET /compute/v2.1/servers/5c1643c5-72d3-4676-85e6-84c5f245c517" status: 200 len: 1270 microversion: 2.1 time: 0.186350 Nov 17 03:26:53.422918 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 192/366] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:26:53 2021] GET /compute/v2.1/servers/5c1643c5-72d3-4676-85e6-84c5f245c517 => generated 1270 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:26:53.703324 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-88b60955-0713-468b-8445-84e5a9caae89 tempest-AttachVolumeTestJSON-1651611701 tempest-AttachVolumeTestJSON-1651611701-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:26:53.704166 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-88b60955-0713-468b-8445-84e5a9caae89 tempest-AttachVolumeTestJSON-1651611701 tempest-AttachVolumeTestJSON-1651611701-project] [instance: 5e11ea9c-f66a-4962-b5ca-b95784624824] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:26:53.714372 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-26953f9d-2b7c-4c99-b5a6-6cd755b91ace tempest-VolumesNegativeTest-1100551557 tempest-VolumesNegativeTest-1100551557-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:26:53.715109 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-26953f9d-2b7c-4c99-b5a6-6cd755b91ace tempest-VolumesNegativeTest-1100551557 tempest-VolumesNegativeTest-1100551557-project] [instance: 45027e8f-667f-45f3-a5f9-2399d6ea3830] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:26:53.716608 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-88b60955-0713-468b-8445-84e5a9caae89 tempest-AttachVolumeTestJSON-1651611701 tempest-AttachVolumeTestJSON-1651611701-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:26:53.717654 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-88b60955-0713-468b-8445-84e5a9caae89 tempest-AttachVolumeTestJSON-1651611701 tempest-AttachVolumeTestJSON-1651611701-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:26:53.718643 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-88b60955-0713-468b-8445-84e5a9caae89 tempest-AttachVolumeTestJSON-1651611701 tempest-AttachVolumeTestJSON-1651611701-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:26:53.722745 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-88b60955-0713-468b-8445-84e5a9caae89 tempest-AttachVolumeTestJSON-1651611701 tempest-AttachVolumeTestJSON-1651611701-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:26:53.727238 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-26953f9d-2b7c-4c99-b5a6-6cd755b91ace tempest-VolumesNegativeTest-1100551557 tempest-VolumesNegativeTest-1100551557-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:26:53.727716 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-26953f9d-2b7c-4c99-b5a6-6cd755b91ace tempest-VolumesNegativeTest-1100551557 tempest-VolumesNegativeTest-1100551557-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:26:53.728525 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-26953f9d-2b7c-4c99-b5a6-6cd755b91ace tempest-VolumesNegativeTest-1100551557 tempest-VolumesNegativeTest-1100551557-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:26:53.729242 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-26953f9d-2b7c-4c99-b5a6-6cd755b91ace tempest-VolumesNegativeTest-1100551557 tempest-VolumesNegativeTest-1100551557-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:26:54.196186 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-88b60955-0713-468b-8445-84e5a9caae89 tempest-AttachVolumeTestJSON-1651611701 tempest-AttachVolumeTestJSON-1651611701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1110e625f8f3451aafcdcac96d3e9ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bf44d5ada38487eb55a9f4b7d52862d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:26:54.206264 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-88b60955-0713-468b-8445-84e5a9caae89 tempest-AttachVolumeTestJSON-1651611701 tempest-AttachVolumeTestJSON-1651611701-project] 10.222.0.11 "GET /compute/v2.1/servers/5e11ea9c-f66a-4962-b5ca-b95784624824" status: 200 len: 1364 microversion: 2.1 time: 0.506689 Nov 17 03:26:54.207469 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 175/367] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:26:53 2021] GET /compute/v2.1/servers/5e11ea9c-f66a-4962-b5ca-b95784624824 => generated 1364 bytes in 508 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:26:54.335009 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-26953f9d-2b7c-4c99-b5a6-6cd755b91ace tempest-VolumesNegativeTest-1100551557 tempest-VolumesNegativeTest-1100551557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20f76a7333f14ee2ad5223b6f038e271', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0718c5e9ff9246ecb9100477e30e25eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:26:54.346599 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-26953f9d-2b7c-4c99-b5a6-6cd755b91ace tempest-VolumesNegativeTest-1100551557 tempest-VolumesNegativeTest-1100551557-project] 10.222.0.11 "GET /compute/v2.1/servers/45027e8f-667f-45f3-a5f9-2399d6ea3830" status: 200 len: 1315 microversion: 2.1 time: 0.636332 Nov 17 03:26:54.349329 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 193/368] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:26:53 2021] GET /compute/v2.1/servers/45027e8f-667f-45f3-a5f9-2399d6ea3830 => generated 1315 bytes in 639 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 17 03:26:54.357717 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [req-102b34e0-1796-4f60-8528-b7c91d80278f req-da154189-a20e-424a-82d4-0cd593fa1434 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5e11ea9c-f66a-4962-b5ca-b95784624824", "name": "network-vif-plugged", "status": "completed", "tag": "ec07edc4-f4b6-4df2-82fd-1001703384ca"}]} {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 17 03:26:54.360152 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 17 03:26:54.360152 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: warnings.warn(msg) Nov 17 03:26:54.369775 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [req-102b34e0-1796-4f60-8528-b7c91d80278f req-da154189-a20e-424a-82d4-0cd593fa1434 service nova] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:26:54.370548 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [req-102b34e0-1796-4f60-8528-b7c91d80278f req-da154189-a20e-424a-82d4-0cd593fa1434 service nova] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:26:54.386422 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.compute.server_external_events [req-102b34e0-1796-4f60-8528-b7c91d80278f req-da154189-a20e-424a-82d4-0cd593fa1434 service nova] Creating event network-vif-plugged:ec07edc4-f4b6-4df2-82fd-1001703384ca for instance 5e11ea9c-f66a-4962-b5ca-b95784624824 on hv-cinder-81803 Nov 17 03:26:54.394575 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [req-102b34e0-1796-4f60-8528-b7c91d80278f req-da154189-a20e-424a-82d4-0cd593fa1434 service nova] 10.222.0.11 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043676 Nov 17 03:26:54.395737 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 194/369] 10.222.0.11 () {64 vars in 1317 bytes} [Wed Nov 17 03:26:54 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 17 03:26:54.404468 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-c382c9d2-2b99-4172-b175-4b4469a1940c tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 17 03:26:54.405597 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-c382c9d2-2b99-4172-b175-4b4469a1940c tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] [instance: 5d54db85-b991-4890-abaa-952413baa2e7] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:26:54.412036 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-c382c9d2-2b99-4172-b175-4b4469a1940c tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:26:54.412481 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-c382c9d2-2b99-4172-b175-4b4469a1940c tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:26:54.413356 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-c382c9d2-2b99-4172-b175-4b4469a1940c tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:26:54.413732 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-c382c9d2-2b99-4172-b175-4b4469a1940c tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:26:54.447655 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-ea0fb4e5-e8de-4c80-b451-03985fb3ccd8 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Action: 'create', calling method: .version_select at 0x7f9e1d1b1c10>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-1852819525"}} {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 17 03:26:54.469857 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.quota [None req-ea0fb4e5-e8de-4c80-b451-03985fb3ccd8 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Getting quotas for project fef02a1dd77946a2ac0e0414b557435f. Resources: {'key_pairs'} {{(pid=115916) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 17 03:26:54.475060 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.quota [None req-ea0fb4e5-e8de-4c80-b451-03985fb3ccd8 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Getting quotas for user 80763e09d44c475ea2425b22874e9612 and project fef02a1dd77946a2ac0e0414b557435f. Resources: {'key_pairs'} {{(pid=115916) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 17 03:26:54.544836 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-c382c9d2-2b99-4172-b175-4b4469a1940c tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] 10.222.0.11 "POST /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7/action" status: 200 len: 28640 microversion: 2.20 time: 0.146757 Nov 17 03:26:54.545855 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 195/370] 10.222.0.11 () {62 vars in 1318 bytes} [Wed Nov 17 03:26:54 2021] POST /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7/action => generated 28640 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 17 03:26:54.553259 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-78474aeb-dcd3-41ca-bcfe-c406855a2a5c tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:26:54.554395 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-78474aeb-dcd3-41ca-bcfe-c406855a2a5c tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] [instance: 6dc785d7-bc95-4fee-8206-c2fd3b930e4f] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:26:54.562523 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-78474aeb-dcd3-41ca-bcfe-c406855a2a5c tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:26:54.563280 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-78474aeb-dcd3-41ca-bcfe-c406855a2a5c tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:26:54.564301 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-78474aeb-dcd3-41ca-bcfe-c406855a2a5c tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:26:54.564967 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-78474aeb-dcd3-41ca-bcfe-c406855a2a5c tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:26:54.592429 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.quota [None req-ea0fb4e5-e8de-4c80-b451-03985fb3ccd8 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Getting quotas for project fef02a1dd77946a2ac0e0414b557435f. Resources: {'key_pairs'} {{(pid=115916) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 17 03:26:54.598285 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.quota [None req-ea0fb4e5-e8de-4c80-b451-03985fb3ccd8 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Getting quotas for user 80763e09d44c475ea2425b22874e9612 and project fef02a1dd77946a2ac0e0414b557435f. Resources: {'key_pairs'} {{(pid=115916) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 17 03:26:54.617832 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-ea0fb4e5-e8de-4c80-b451-03985fb3ccd8 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] 10.222.0.11 "POST /compute/v2.1/os-keypairs" status: 200 len: 2319 microversion: 2.1 time: 0.409021 Nov 17 03:26:54.618372 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 176/371] 10.222.0.11 () {60 vars in 1157 bytes} [Wed Nov 17 03:26:54 2021] POST /compute/v2.1/os-keypairs => generated 2319 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:26:54.622813 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-524e251a-161e-4fdb-a27b-0ec9163d3cba tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:26:54.623549 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-524e251a-161e-4fdb-a27b-0ec9163d3cba tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] [instance: 5c1643c5-72d3-4676-85e6-84c5f245c517] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:26:54.629808 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-524e251a-161e-4fdb-a27b-0ec9163d3cba tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:26:54.631540 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-524e251a-161e-4fdb-a27b-0ec9163d3cba tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:26:54.632331 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-524e251a-161e-4fdb-a27b-0ec9163d3cba tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:26:54.632754 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-524e251a-161e-4fdb-a27b-0ec9163d3cba tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:26:54.723536 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-524e251a-161e-4fdb-a27b-0ec9163d3cba tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d4e8ac9538f42c9b637bd9e086668b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfc480343d4d493bb4295b055e274df5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:26:54.733310 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-524e251a-161e-4fdb-a27b-0ec9163d3cba tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] 10.222.0.11 "GET /compute/v2.1/servers/5c1643c5-72d3-4676-85e6-84c5f245c517" status: 200 len: 1276 microversion: 2.1 time: 0.113685 Nov 17 03:26:54.734224 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 177/372] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:26:54 2021] GET /compute/v2.1/servers/5c1643c5-72d3-4676-85e6-84c5f245c517 => generated 1276 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:26:54.896210 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-78474aeb-dcd3-41ca-bcfe-c406855a2a5c tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f046401c6a04f6495ebe0821120bd72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a58e89ceeea4a9c8a72a1de4bcaf2d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:26:54.904969 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-78474aeb-dcd3-41ca-bcfe-c406855a2a5c tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] 10.222.0.11 "GET /compute/v2.1/servers/6dc785d7-bc95-4fee-8206-c2fd3b930e4f" status: 200 len: 1521 microversion: 2.1 time: 0.357559 Nov 17 03:26:54.905563 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 196/373] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:26:54 2021] GET /compute/v2.1/servers/6dc785d7-bc95-4fee-8206-c2fd3b930e4f => generated 1521 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:26:55.225435 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-54e0f7da-41be-4328-a5b1-d68e9d3bc3c6 tempest-AttachVolumeTestJSON-1651611701 tempest-AttachVolumeTestJSON-1651611701-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:26:55.226514 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-54e0f7da-41be-4328-a5b1-d68e9d3bc3c6 tempest-AttachVolumeTestJSON-1651611701 tempest-AttachVolumeTestJSON-1651611701-project] [instance: 5e11ea9c-f66a-4962-b5ca-b95784624824] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:26:55.234756 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-54e0f7da-41be-4328-a5b1-d68e9d3bc3c6 tempest-AttachVolumeTestJSON-1651611701 tempest-AttachVolumeTestJSON-1651611701-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:26:55.235649 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-54e0f7da-41be-4328-a5b1-d68e9d3bc3c6 tempest-AttachVolumeTestJSON-1651611701 tempest-AttachVolumeTestJSON-1651611701-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:26:55.236454 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-54e0f7da-41be-4328-a5b1-d68e9d3bc3c6 tempest-AttachVolumeTestJSON-1651611701 tempest-AttachVolumeTestJSON-1651611701-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:26:55.236927 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-54e0f7da-41be-4328-a5b1-d68e9d3bc3c6 tempest-AttachVolumeTestJSON-1651611701 tempest-AttachVolumeTestJSON-1651611701-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:26:55.365836 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-523f6100-290b-43f1-91d9-953af7389357 tempest-VolumesNegativeTest-1100551557 tempest-VolumesNegativeTest-1100551557-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:26:55.366512 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-523f6100-290b-43f1-91d9-953af7389357 tempest-VolumesNegativeTest-1100551557 tempest-VolumesNegativeTest-1100551557-project] [instance: 45027e8f-667f-45f3-a5f9-2399d6ea3830] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:26:55.373104 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-523f6100-290b-43f1-91d9-953af7389357 tempest-VolumesNegativeTest-1100551557 tempest-VolumesNegativeTest-1100551557-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:26:55.373887 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-523f6100-290b-43f1-91d9-953af7389357 tempest-VolumesNegativeTest-1100551557 tempest-VolumesNegativeTest-1100551557-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:26:55.374902 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-523f6100-290b-43f1-91d9-953af7389357 tempest-VolumesNegativeTest-1100551557 tempest-VolumesNegativeTest-1100551557-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:26:55.375537 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-523f6100-290b-43f1-91d9-953af7389357 tempest-VolumesNegativeTest-1100551557 tempest-VolumesNegativeTest-1100551557-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:26:55.413792 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-54e0f7da-41be-4328-a5b1-d68e9d3bc3c6 tempest-AttachVolumeTestJSON-1651611701 tempest-AttachVolumeTestJSON-1651611701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1110e625f8f3451aafcdcac96d3e9ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bf44d5ada38487eb55a9f4b7d52862d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:26:55.422531 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-54e0f7da-41be-4328-a5b1-d68e9d3bc3c6 tempest-AttachVolumeTestJSON-1651611701 tempest-AttachVolumeTestJSON-1651611701-project] 10.222.0.11 "GET /compute/v2.1/servers/5e11ea9c-f66a-4962-b5ca-b95784624824" status: 200 len: 1364 microversion: 2.1 time: 0.201579 Nov 17 03:26:55.432413 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 178/374] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:26:55 2021] GET /compute/v2.1/servers/5e11ea9c-f66a-4962-b5ca-b95784624824 => generated 1364 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:26:55.558036 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-ab48a410-7dfa-4a96-8582-83d0455d511d tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 17 03:26:55.558802 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-ab48a410-7dfa-4a96-8582-83d0455d511d tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] [instance: 5d54db85-b991-4890-abaa-952413baa2e7] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:26:55.565394 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-ab48a410-7dfa-4a96-8582-83d0455d511d tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:26:55.566155 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-ab48a410-7dfa-4a96-8582-83d0455d511d tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:26:55.567089 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-ab48a410-7dfa-4a96-8582-83d0455d511d tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:26:55.567659 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-ab48a410-7dfa-4a96-8582-83d0455d511d tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:26:55.676502 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-ab48a410-7dfa-4a96-8582-83d0455d511d tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] 10.222.0.11 "POST /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7/action" status: 200 len: 28640 microversion: 2.20 time: 0.122633 Nov 17 03:26:55.680567 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 179/375] 10.222.0.11 () {62 vars in 1318 bytes} [Wed Nov 17 03:26:55 2021] POST /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7/action => generated 28640 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 17 03:26:55.756149 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-a1b6c0d1-e385-40ae-9553-32da569552c5 tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:26:55.757575 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-a1b6c0d1-e385-40ae-9553-32da569552c5 tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] [instance: 5c1643c5-72d3-4676-85e6-84c5f245c517] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:26:55.758669 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-523f6100-290b-43f1-91d9-953af7389357 tempest-VolumesNegativeTest-1100551557 tempest-VolumesNegativeTest-1100551557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20f76a7333f14ee2ad5223b6f038e271', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0718c5e9ff9246ecb9100477e30e25eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:26:55.767375 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-a1b6c0d1-e385-40ae-9553-32da569552c5 tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:26:55.768149 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-a1b6c0d1-e385-40ae-9553-32da569552c5 tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:26:55.768729 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-523f6100-290b-43f1-91d9-953af7389357 tempest-VolumesNegativeTest-1100551557 tempest-VolumesNegativeTest-1100551557-project] 10.222.0.11 "GET /compute/v2.1/servers/45027e8f-667f-45f3-a5f9-2399d6ea3830" status: 200 len: 1315 microversion: 2.1 time: 0.406727 Nov 17 03:26:55.769413 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-a1b6c0d1-e385-40ae-9553-32da569552c5 tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:26:55.769711 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 197/376] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:26:55 2021] GET /compute/v2.1/servers/45027e8f-667f-45f3-a5f9-2399d6ea3830 => generated 1315 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 17 03:26:55.770428 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-a1b6c0d1-e385-40ae-9553-32da569552c5 tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:26:55.925555 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-cd7d0713-5144-49c4-9912-7035c0a9d8e7 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:26:55.927283 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-cd7d0713-5144-49c4-9912-7035c0a9d8e7 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] [instance: 6dc785d7-bc95-4fee-8206-c2fd3b930e4f] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:26:55.942276 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-a1b6c0d1-e385-40ae-9553-32da569552c5 tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d4e8ac9538f42c9b637bd9e086668b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfc480343d4d493bb4295b055e274df5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:26:55.943956 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-cd7d0713-5144-49c4-9912-7035c0a9d8e7 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:26:55.944419 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-cd7d0713-5144-49c4-9912-7035c0a9d8e7 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:26:55.945245 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-cd7d0713-5144-49c4-9912-7035c0a9d8e7 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:26:55.945762 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-cd7d0713-5144-49c4-9912-7035c0a9d8e7 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:26:55.953059 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-a1b6c0d1-e385-40ae-9553-32da569552c5 tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] 10.222.0.11 "GET /compute/v2.1/servers/5c1643c5-72d3-4676-85e6-84c5f245c517" status: 200 len: 1318 microversion: 2.1 time: 0.204680 Nov 17 03:26:55.954012 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 180/377] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:26:55 2021] GET /compute/v2.1/servers/5c1643c5-72d3-4676-85e6-84c5f245c517 => generated 1318 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:26:56.269903 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-cd7d0713-5144-49c4-9912-7035c0a9d8e7 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f046401c6a04f6495ebe0821120bd72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a58e89ceeea4a9c8a72a1de4bcaf2d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:26:56.283914 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-cd7d0713-5144-49c4-9912-7035c0a9d8e7 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] 10.222.0.11 "GET /compute/v2.1/servers/6dc785d7-bc95-4fee-8206-c2fd3b930e4f" status: 200 len: 1521 microversion: 2.1 time: 0.365211 Nov 17 03:26:56.289999 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 198/378] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:26:55 2021] GET /compute/v2.1/servers/6dc785d7-bc95-4fee-8206-c2fd3b930e4f => generated 1521 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:26:56.417173 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [req-cec373a6-23a1-4ee4-ba91-6d4e9d746972 req-38734648-005c-4ecc-83fa-9ae054edb7b3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "45027e8f-667f-45f3-a5f9-2399d6ea3830", "name": "network-vif-plugged", "status": "completed", "tag": "56975407-dbfd-44f5-b514-f53c325f17ac"}]} {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 17 03:26:56.420346 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 17 03:26:56.420346 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: warnings.warn(msg) Nov 17 03:26:56.436001 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [req-0296e788-2390-4521-bece-76fa09da50fb req-a2ff84e2-8fc9-4f2a-8cb0-3f8e40bfec27 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5c1643c5-72d3-4676-85e6-84c5f245c517", "tag": "cffd3e2c-1775-45b1-b1e1-1bc7ee24953e"}]} {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 17 03:26:56.437574 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 17 03:26:56.437574 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: warnings.warn(msg) Nov 17 03:26:56.443083 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [req-cec373a6-23a1-4ee4-ba91-6d4e9d746972 req-38734648-005c-4ecc-83fa-9ae054edb7b3 service nova] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:26:56.443531 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [req-cec373a6-23a1-4ee4-ba91-6d4e9d746972 req-38734648-005c-4ecc-83fa-9ae054edb7b3 service nova] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:26:56.450792 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [req-0296e788-2390-4521-bece-76fa09da50fb req-a2ff84e2-8fc9-4f2a-8cb0-3f8e40bfec27 service nova] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:26:56.451247 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [req-0296e788-2390-4521-bece-76fa09da50fb req-a2ff84e2-8fc9-4f2a-8cb0-3f8e40bfec27 service nova] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:26:56.465033 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.compute.server_external_events [req-cec373a6-23a1-4ee4-ba91-6d4e9d746972 req-38734648-005c-4ecc-83fa-9ae054edb7b3 service nova] Creating event network-vif-plugged:56975407-dbfd-44f5-b514-f53c325f17ac for instance 45027e8f-667f-45f3-a5f9-2399d6ea3830 on hv-cinder-81803 Nov 17 03:26:56.475086 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.compute.server_external_events [req-0296e788-2390-4521-bece-76fa09da50fb req-a2ff84e2-8fc9-4f2a-8cb0-3f8e40bfec27 service nova] Creating event network-changed:cffd3e2c-1775-45b1-b1e1-1bc7ee24953e for instance 5c1643c5-72d3-4676-85e6-84c5f245c517 on hv-cinder-81803 Nov 17 03:26:56.476258 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [req-cec373a6-23a1-4ee4-ba91-6d4e9d746972 req-38734648-005c-4ecc-83fa-9ae054edb7b3 service nova] 10.222.0.11 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.062583 Nov 17 03:26:56.477282 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 181/379] 10.222.0.11 () {64 vars in 1317 bytes} [Wed Nov 17 03:26:56 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 17 03:26:56.483645 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [req-0296e788-2390-4521-bece-76fa09da50fb req-a2ff84e2-8fc9-4f2a-8cb0-3f8e40bfec27 service nova] 10.222.0.11 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.051839 Nov 17 03:26:56.483921 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-46f73ad6-1388-47c0-aaae-7266d7de3ded tempest-AttachVolumeTestJSON-1651611701 tempest-AttachVolumeTestJSON-1651611701-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:26:56.484677 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-46f73ad6-1388-47c0-aaae-7266d7de3ded tempest-AttachVolumeTestJSON-1651611701 tempest-AttachVolumeTestJSON-1651611701-project] [instance: 5e11ea9c-f66a-4962-b5ca-b95784624824] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:26:56.485005 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 199/380] 10.222.0.11 () {64 vars in 1317 bytes} [Wed Nov 17 03:26:56 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 17 03:26:56.495158 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-46f73ad6-1388-47c0-aaae-7266d7de3ded tempest-AttachVolumeTestJSON-1651611701 tempest-AttachVolumeTestJSON-1651611701-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:26:56.495616 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-46f73ad6-1388-47c0-aaae-7266d7de3ded tempest-AttachVolumeTestJSON-1651611701 tempest-AttachVolumeTestJSON-1651611701-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:26:56.496719 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-46f73ad6-1388-47c0-aaae-7266d7de3ded tempest-AttachVolumeTestJSON-1651611701 tempest-AttachVolumeTestJSON-1651611701-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:26:56.497380 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-46f73ad6-1388-47c0-aaae-7266d7de3ded tempest-AttachVolumeTestJSON-1651611701 tempest-AttachVolumeTestJSON-1651611701-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:26:56.689215 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-de6929ac-21bd-4d4f-a0f4-ce21c1cdd83f tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 17 03:26:56.690740 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-de6929ac-21bd-4d4f-a0f4-ce21c1cdd83f tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] [instance: 5d54db85-b991-4890-abaa-952413baa2e7] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:26:56.701606 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-de6929ac-21bd-4d4f-a0f4-ce21c1cdd83f tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:26:56.702057 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-de6929ac-21bd-4d4f-a0f4-ce21c1cdd83f tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:26:56.702864 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-de6929ac-21bd-4d4f-a0f4-ce21c1cdd83f tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:26:56.703298 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-de6929ac-21bd-4d4f-a0f4-ce21c1cdd83f tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:26:56.784398 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-46f73ad6-1388-47c0-aaae-7266d7de3ded tempest-AttachVolumeTestJSON-1651611701 tempest-AttachVolumeTestJSON-1651611701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1110e625f8f3451aafcdcac96d3e9ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bf44d5ada38487eb55a9f4b7d52862d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:26:56.793825 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-46f73ad6-1388-47c0-aaae-7266d7de3ded tempest-AttachVolumeTestJSON-1651611701 tempest-AttachVolumeTestJSON-1651611701-project] 10.222.0.11 "GET /compute/v2.1/servers/5e11ea9c-f66a-4962-b5ca-b95784624824" status: 200 len: 1364 microversion: 2.1 time: 0.314929 Nov 17 03:26:56.794882 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 182/381] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:26:56 2021] GET /compute/v2.1/servers/5e11ea9c-f66a-4962-b5ca-b95784624824 => generated 1364 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:26:56.799522 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-dd3dbb15-271c-4d19-a273-435d1499cdcf tempest-VolumesNegativeTest-1100551557 tempest-VolumesNegativeTest-1100551557-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:26:56.800797 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-dd3dbb15-271c-4d19-a273-435d1499cdcf tempest-VolumesNegativeTest-1100551557 tempest-VolumesNegativeTest-1100551557-project] [instance: 45027e8f-667f-45f3-a5f9-2399d6ea3830] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:26:56.807522 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-dd3dbb15-271c-4d19-a273-435d1499cdcf tempest-VolumesNegativeTest-1100551557 tempest-VolumesNegativeTest-1100551557-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:26:56.808216 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-dd3dbb15-271c-4d19-a273-435d1499cdcf tempest-VolumesNegativeTest-1100551557 tempest-VolumesNegativeTest-1100551557-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:26:56.812892 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-dd3dbb15-271c-4d19-a273-435d1499cdcf tempest-VolumesNegativeTest-1100551557 tempest-VolumesNegativeTest-1100551557-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:26:56.813748 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-dd3dbb15-271c-4d19-a273-435d1499cdcf tempest-VolumesNegativeTest-1100551557 tempest-VolumesNegativeTest-1100551557-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:26:56.938968 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-de6929ac-21bd-4d4f-a0f4-ce21c1cdd83f tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] 10.222.0.11 "POST /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7/action" status: 200 len: 28640 microversion: 2.20 time: 0.251208 Nov 17 03:26:56.950872 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 200/382] 10.222.0.11 () {62 vars in 1318 bytes} [Wed Nov 17 03:26:56 2021] POST /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7/action => generated 28640 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 17 03:26:56.972491 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-7ed89fd2-d24a-4067-8a0a-6cd633f942a9 tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:26:56.973342 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-7ed89fd2-d24a-4067-8a0a-6cd633f942a9 tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] [instance: 5c1643c5-72d3-4676-85e6-84c5f245c517] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:26:56.980046 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-7ed89fd2-d24a-4067-8a0a-6cd633f942a9 tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:26:56.980663 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-7ed89fd2-d24a-4067-8a0a-6cd633f942a9 tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:26:56.981782 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-7ed89fd2-d24a-4067-8a0a-6cd633f942a9 tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:26:56.986716 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-7ed89fd2-d24a-4067-8a0a-6cd633f942a9 tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:26:57.018915 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-dd3dbb15-271c-4d19-a273-435d1499cdcf tempest-VolumesNegativeTest-1100551557 tempest-VolumesNegativeTest-1100551557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20f76a7333f14ee2ad5223b6f038e271', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0718c5e9ff9246ecb9100477e30e25eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:26:57.028454 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-dd3dbb15-271c-4d19-a273-435d1499cdcf tempest-VolumesNegativeTest-1100551557 tempest-VolumesNegativeTest-1100551557-project] 10.222.0.11 "GET /compute/v2.1/servers/45027e8f-667f-45f3-a5f9-2399d6ea3830" status: 200 len: 1315 microversion: 2.1 time: 0.232250 Nov 17 03:26:57.029067 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 183/383] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:26:56 2021] GET /compute/v2.1/servers/45027e8f-667f-45f3-a5f9-2399d6ea3830 => generated 1315 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:26:57.303167 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-aadc96a8-678e-4db8-9906-f46cada80c0c tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:26:57.304216 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-aadc96a8-678e-4db8-9906-f46cada80c0c tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] [instance: 6dc785d7-bc95-4fee-8206-c2fd3b930e4f] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:26:57.311513 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-aadc96a8-678e-4db8-9906-f46cada80c0c tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:26:57.311922 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-aadc96a8-678e-4db8-9906-f46cada80c0c tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:26:57.313117 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-aadc96a8-678e-4db8-9906-f46cada80c0c tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:26:57.313731 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-aadc96a8-678e-4db8-9906-f46cada80c0c tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:26:57.338719 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-7ed89fd2-d24a-4067-8a0a-6cd633f942a9 tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d4e8ac9538f42c9b637bd9e086668b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfc480343d4d493bb4295b055e274df5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:26:57.349489 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-7ed89fd2-d24a-4067-8a0a-6cd633f942a9 tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] 10.222.0.11 "GET /compute/v2.1/servers/5c1643c5-72d3-4676-85e6-84c5f245c517" status: 200 len: 1318 microversion: 2.1 time: 0.382699 Nov 17 03:26:57.357485 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 201/384] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:26:56 2021] GET /compute/v2.1/servers/5c1643c5-72d3-4676-85e6-84c5f245c517 => generated 1318 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 17 03:26:57.458132 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-aadc96a8-678e-4db8-9906-f46cada80c0c tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f046401c6a04f6495ebe0821120bd72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a58e89ceeea4a9c8a72a1de4bcaf2d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:26:57.466680 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-aadc96a8-678e-4db8-9906-f46cada80c0c tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] 10.222.0.11 "GET /compute/v2.1/servers/6dc785d7-bc95-4fee-8206-c2fd3b930e4f" status: 200 len: 1521 microversion: 2.1 time: 0.167250 Nov 17 03:26:57.467531 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 184/385] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:26:57 2021] GET /compute/v2.1/servers/6dc785d7-bc95-4fee-8206-c2fd3b930e4f => generated 1521 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 17 03:26:57.812753 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-1c6393e4-6b47-41b0-90ab-a0da9323d1b2 tempest-AttachVolumeTestJSON-1651611701 tempest-AttachVolumeTestJSON-1651611701-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:26:57.813421 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-1c6393e4-6b47-41b0-90ab-a0da9323d1b2 tempest-AttachVolumeTestJSON-1651611701 tempest-AttachVolumeTestJSON-1651611701-project] [instance: 5e11ea9c-f66a-4962-b5ca-b95784624824] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:26:57.820452 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-1c6393e4-6b47-41b0-90ab-a0da9323d1b2 tempest-AttachVolumeTestJSON-1651611701 tempest-AttachVolumeTestJSON-1651611701-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:26:57.821002 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-1c6393e4-6b47-41b0-90ab-a0da9323d1b2 tempest-AttachVolumeTestJSON-1651611701 tempest-AttachVolumeTestJSON-1651611701-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:26:57.821941 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-1c6393e4-6b47-41b0-90ab-a0da9323d1b2 tempest-AttachVolumeTestJSON-1651611701 tempest-AttachVolumeTestJSON-1651611701-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:26:57.822445 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-1c6393e4-6b47-41b0-90ab-a0da9323d1b2 tempest-AttachVolumeTestJSON-1651611701 tempest-AttachVolumeTestJSON-1651611701-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:26:57.958742 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-e48374ef-3e67-4fd4-a921-4b78deb81bf1 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 17 03:26:57.959713 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-e48374ef-3e67-4fd4-a921-4b78deb81bf1 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] [instance: 5d54db85-b991-4890-abaa-952413baa2e7] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:26:57.964142 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-1c6393e4-6b47-41b0-90ab-a0da9323d1b2 tempest-AttachVolumeTestJSON-1651611701 tempest-AttachVolumeTestJSON-1651611701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1110e625f8f3451aafcdcac96d3e9ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bf44d5ada38487eb55a9f4b7d52862d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:26:57.966317 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-e48374ef-3e67-4fd4-a921-4b78deb81bf1 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:26:57.966761 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-e48374ef-3e67-4fd4-a921-4b78deb81bf1 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:26:57.967720 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-e48374ef-3e67-4fd4-a921-4b78deb81bf1 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:26:57.968427 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-e48374ef-3e67-4fd4-a921-4b78deb81bf1 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:26:57.972529 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-1c6393e4-6b47-41b0-90ab-a0da9323d1b2 tempest-AttachVolumeTestJSON-1651611701 tempest-AttachVolumeTestJSON-1651611701-project] 10.222.0.11 "GET /compute/v2.1/servers/5e11ea9c-f66a-4962-b5ca-b95784624824" status: 200 len: 1551 microversion: 2.1 time: 0.164434 Nov 17 03:26:57.973145 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 202/386] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:26:57 2021] GET /compute/v2.1/servers/5e11ea9c-f66a-4962-b5ca-b95784624824 => generated 1551 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:26:57.989689 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-d0678deb-55ff-4cc1-9b22-2b231d5d18b9 tempest-AttachVolumeTestJSON-1651611701 tempest-AttachVolumeTestJSON-1651611701-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:26:57.990176 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-d0678deb-55ff-4cc1-9b22-2b231d5d18b9 tempest-AttachVolumeTestJSON-1651611701 tempest-AttachVolumeTestJSON-1651611701-project] [instance: 5e11ea9c-f66a-4962-b5ca-b95784624824] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:26:57.996393 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-d0678deb-55ff-4cc1-9b22-2b231d5d18b9 tempest-AttachVolumeTestJSON-1651611701 tempest-AttachVolumeTestJSON-1651611701-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:26:57.996870 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-d0678deb-55ff-4cc1-9b22-2b231d5d18b9 tempest-AttachVolumeTestJSON-1651611701 tempest-AttachVolumeTestJSON-1651611701-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:26:57.997673 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-d0678deb-55ff-4cc1-9b22-2b231d5d18b9 tempest-AttachVolumeTestJSON-1651611701 tempest-AttachVolumeTestJSON-1651611701-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:26:57.998452 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-d0678deb-55ff-4cc1-9b22-2b231d5d18b9 tempest-AttachVolumeTestJSON-1651611701 tempest-AttachVolumeTestJSON-1651611701-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:26:58.087662 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-d0678deb-55ff-4cc1-9b22-2b231d5d18b9 tempest-AttachVolumeTestJSON-1651611701 tempest-AttachVolumeTestJSON-1651611701-project] 10.222.0.11 "GET /compute/v2.1/servers/5e11ea9c-f66a-4962-b5ca-b95784624824/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.101556 Nov 17 03:26:58.088251 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 203/387] 10.222.0.11 () {58 vars in 1274 bytes} [Wed Nov 17 03:26:57 2021] GET /compute/v2.1/servers/5e11ea9c-f66a-4962-b5ca-b95784624824/os-interface => generated 285 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 17 03:26:58.093821 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-8cb3b487-65f6-44c8-a0d8-40bd497a36ec tempest-VolumesNegativeTest-1100551557 tempest-VolumesNegativeTest-1100551557-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:26:58.094615 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-8cb3b487-65f6-44c8-a0d8-40bd497a36ec tempest-VolumesNegativeTest-1100551557 tempest-VolumesNegativeTest-1100551557-project] [instance: 45027e8f-667f-45f3-a5f9-2399d6ea3830] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:26:58.101092 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-8cb3b487-65f6-44c8-a0d8-40bd497a36ec tempest-VolumesNegativeTest-1100551557 tempest-VolumesNegativeTest-1100551557-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:26:58.101720 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-8cb3b487-65f6-44c8-a0d8-40bd497a36ec tempest-VolumesNegativeTest-1100551557 tempest-VolumesNegativeTest-1100551557-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:26:58.102523 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-8cb3b487-65f6-44c8-a0d8-40bd497a36ec tempest-VolumesNegativeTest-1100551557 tempest-VolumesNegativeTest-1100551557-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:26:58.102987 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-8cb3b487-65f6-44c8-a0d8-40bd497a36ec tempest-VolumesNegativeTest-1100551557 tempest-VolumesNegativeTest-1100551557-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:26:58.348201 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-e48374ef-3e67-4fd4-a921-4b78deb81bf1 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] 10.222.0.11 "POST /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7/action" status: 200 len: 28640 microversion: 2.20 time: 0.393103 Nov 17 03:26:58.349749 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 185/388] 10.222.0.11 () {62 vars in 1318 bytes} [Wed Nov 17 03:26:57 2021] POST /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7/action => generated 28640 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 17 03:26:58.367021 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-0392991a-0efe-41b2-af01-87641461b967 tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:26:58.367760 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-0392991a-0efe-41b2-af01-87641461b967 tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] [instance: 5c1643c5-72d3-4676-85e6-84c5f245c517] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:26:58.375638 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-0392991a-0efe-41b2-af01-87641461b967 tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:26:58.376091 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-0392991a-0efe-41b2-af01-87641461b967 tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:26:58.377008 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-0392991a-0efe-41b2-af01-87641461b967 tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:26:58.377439 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-0392991a-0efe-41b2-af01-87641461b967 tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:26:58.520414 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-8cb3b487-65f6-44c8-a0d8-40bd497a36ec tempest-VolumesNegativeTest-1100551557 tempest-VolumesNegativeTest-1100551557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20f76a7333f14ee2ad5223b6f038e271', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0718c5e9ff9246ecb9100477e30e25eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:26:58.531995 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-0392991a-0efe-41b2-af01-87641461b967 tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d4e8ac9538f42c9b637bd9e086668b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfc480343d4d493bb4295b055e274df5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:26:58.532190 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-8cb3b487-65f6-44c8-a0d8-40bd497a36ec tempest-VolumesNegativeTest-1100551557 tempest-VolumesNegativeTest-1100551557-project] 10.222.0.11 "GET /compute/v2.1/servers/45027e8f-667f-45f3-a5f9-2399d6ea3830" status: 200 len: 1315 microversion: 2.1 time: 0.442031 Nov 17 03:26:58.532807 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 204/389] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:26:58 2021] GET /compute/v2.1/servers/45027e8f-667f-45f3-a5f9-2399d6ea3830 => generated 1315 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:26:58.537341 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-49f1d987-f275-4103-b6b0-4e195eb8a1bd tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:26:58.538519 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-49f1d987-f275-4103-b6b0-4e195eb8a1bd tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] [instance: 6dc785d7-bc95-4fee-8206-c2fd3b930e4f] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:26:58.542945 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-0392991a-0efe-41b2-af01-87641461b967 tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] 10.222.0.11 "GET /compute/v2.1/servers/5c1643c5-72d3-4676-85e6-84c5f245c517" status: 200 len: 1318 microversion: 2.1 time: 0.179808 Nov 17 03:26:58.543657 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 186/390] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:26:58 2021] GET /compute/v2.1/servers/5c1643c5-72d3-4676-85e6-84c5f245c517 => generated 1318 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:26:58.546367 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-49f1d987-f275-4103-b6b0-4e195eb8a1bd tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:26:58.547403 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-49f1d987-f275-4103-b6b0-4e195eb8a1bd tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:26:58.551221 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-49f1d987-f275-4103-b6b0-4e195eb8a1bd tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:26:58.551942 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-49f1d987-f275-4103-b6b0-4e195eb8a1bd tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:26:59.295986 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-49f1d987-f275-4103-b6b0-4e195eb8a1bd tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f046401c6a04f6495ebe0821120bd72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a58e89ceeea4a9c8a72a1de4bcaf2d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:26:59.303939 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-49f1d987-f275-4103-b6b0-4e195eb8a1bd tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] 10.222.0.11 "GET /compute/v2.1/servers/6dc785d7-bc95-4fee-8206-c2fd3b930e4f" status: 200 len: 1521 microversion: 2.1 time: 0.769879 Nov 17 03:26:59.304557 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 205/391] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:26:58 2021] GET /compute/v2.1/servers/6dc785d7-bc95-4fee-8206-c2fd3b930e4f => generated 1521 bytes in 771 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:26:59.360297 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-4d705e40-b9db-42d8-ad55-e1968c75ded4 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 17 03:26:59.361216 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-4d705e40-b9db-42d8-ad55-e1968c75ded4 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] [instance: 5d54db85-b991-4890-abaa-952413baa2e7] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:26:59.368154 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-4d705e40-b9db-42d8-ad55-e1968c75ded4 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:26:59.369065 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-4d705e40-b9db-42d8-ad55-e1968c75ded4 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:26:59.370167 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-4d705e40-b9db-42d8-ad55-e1968c75ded4 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:26:59.370662 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-4d705e40-b9db-42d8-ad55-e1968c75ded4 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:26:59.551066 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-8a661600-5dd9-4990-99d0-eca1f6890f02 tempest-VolumesNegativeTest-1100551557 tempest-VolumesNegativeTest-1100551557-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:26:59.551666 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-8a661600-5dd9-4990-99d0-eca1f6890f02 tempest-VolumesNegativeTest-1100551557 tempest-VolumesNegativeTest-1100551557-project] [instance: 45027e8f-667f-45f3-a5f9-2399d6ea3830] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:26:59.559624 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-8a661600-5dd9-4990-99d0-eca1f6890f02 tempest-VolumesNegativeTest-1100551557 tempest-VolumesNegativeTest-1100551557-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:26:59.560065 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-8a661600-5dd9-4990-99d0-eca1f6890f02 tempest-VolumesNegativeTest-1100551557 tempest-VolumesNegativeTest-1100551557-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:26:59.561305 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-8a661600-5dd9-4990-99d0-eca1f6890f02 tempest-VolumesNegativeTest-1100551557 tempest-VolumesNegativeTest-1100551557-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:26:59.561953 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-8a661600-5dd9-4990-99d0-eca1f6890f02 tempest-VolumesNegativeTest-1100551557 tempest-VolumesNegativeTest-1100551557-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:26:59.617804 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-4d705e40-b9db-42d8-ad55-e1968c75ded4 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] 10.222.0.11 "POST /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7/action" status: 200 len: 28655 microversion: 2.20 time: 0.261149 Nov 17 03:26:59.618890 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 187/392] 10.222.0.11 () {62 vars in 1318 bytes} [Wed Nov 17 03:26:59 2021] POST /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7/action => generated 28655 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 17 03:26:59.624973 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-8a7d31a5-a087-43ad-9c30-752d7bae1e14 tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:26:59.625678 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-8a7d31a5-a087-43ad-9c30-752d7bae1e14 tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] [instance: 5c1643c5-72d3-4676-85e6-84c5f245c517] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:26:59.633579 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-8a7d31a5-a087-43ad-9c30-752d7bae1e14 tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:26:59.634028 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-8a7d31a5-a087-43ad-9c30-752d7bae1e14 tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:26:59.634819 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-8a7d31a5-a087-43ad-9c30-752d7bae1e14 tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:26:59.635258 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-8a7d31a5-a087-43ad-9c30-752d7bae1e14 tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:26:59.780623 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-8a7d31a5-a087-43ad-9c30-752d7bae1e14 tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d4e8ac9538f42c9b637bd9e086668b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfc480343d4d493bb4295b055e274df5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:26:59.788731 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-8a7d31a5-a087-43ad-9c30-752d7bae1e14 tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] 10.222.0.11 "GET /compute/v2.1/servers/5c1643c5-72d3-4676-85e6-84c5f245c517" status: 200 len: 1318 microversion: 2.1 time: 0.167845 Nov 17 03:26:59.789320 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 188/393] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:26:59 2021] GET /compute/v2.1/servers/5c1643c5-72d3-4676-85e6-84c5f245c517 => generated 1318 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:26:59.878351 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-8a661600-5dd9-4990-99d0-eca1f6890f02 tempest-VolumesNegativeTest-1100551557 tempest-VolumesNegativeTest-1100551557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20f76a7333f14ee2ad5223b6f038e271', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0718c5e9ff9246ecb9100477e30e25eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:26:59.885829 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-8a661600-5dd9-4990-99d0-eca1f6890f02 tempest-VolumesNegativeTest-1100551557 tempest-VolumesNegativeTest-1100551557-project] 10.222.0.11 "GET /compute/v2.1/servers/45027e8f-667f-45f3-a5f9-2399d6ea3830" status: 200 len: 1315 microversion: 2.1 time: 0.339781 Nov 17 03:26:59.886618 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 206/394] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:26:59 2021] GET /compute/v2.1/servers/45027e8f-667f-45f3-a5f9-2399d6ea3830 => generated 1315 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:27:00.015011 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-5102843e-21ba-43b5-96e4-24c3394bc289 tempest-AttachVolumeTestJSON-1651611701 tempest-AttachVolumeTestJSON-1651611701-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 17 03:27:00.016204 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-5102843e-21ba-43b5-96e4-24c3394bc289 tempest-AttachVolumeTestJSON-1651611701 tempest-AttachVolumeTestJSON-1651611701-project] [instance: 5e11ea9c-f66a-4962-b5ca-b95784624824] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:27:00.017191 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [req-b57aebb8-e86a-4dd4-a23f-0c4b836fd3d3 req-2b918d81-a640-440e-a8f2-35def02b6fa9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5e11ea9c-f66a-4962-b5ca-b95784624824", "tag": "ec07edc4-f4b6-4df2-82fd-1001703384ca"}]} {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 17 03:27:00.019425 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 17 03:27:00.019425 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: warnings.warn(msg) Nov 17 03:27:00.023566 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-5102843e-21ba-43b5-96e4-24c3394bc289 tempest-AttachVolumeTestJSON-1651611701 tempest-AttachVolumeTestJSON-1651611701-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:27:00.024221 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-5102843e-21ba-43b5-96e4-24c3394bc289 tempest-AttachVolumeTestJSON-1651611701 tempest-AttachVolumeTestJSON-1651611701-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:27:00.025175 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-5102843e-21ba-43b5-96e4-24c3394bc289 tempest-AttachVolumeTestJSON-1651611701 tempest-AttachVolumeTestJSON-1651611701-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:27:00.025751 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-5102843e-21ba-43b5-96e4-24c3394bc289 tempest-AttachVolumeTestJSON-1651611701 tempest-AttachVolumeTestJSON-1651611701-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:27:00.032827 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [req-b57aebb8-e86a-4dd4-a23f-0c4b836fd3d3 req-2b918d81-a640-440e-a8f2-35def02b6fa9 service nova] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:27:00.033533 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [req-b57aebb8-e86a-4dd4-a23f-0c4b836fd3d3 req-2b918d81-a640-440e-a8f2-35def02b6fa9 service nova] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:27:00.047594 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.compute.server_external_events [req-b57aebb8-e86a-4dd4-a23f-0c4b836fd3d3 req-2b918d81-a640-440e-a8f2-35def02b6fa9 service nova] Creating event network-changed:ec07edc4-f4b6-4df2-82fd-1001703384ca for instance 5e11ea9c-f66a-4962-b5ca-b95784624824 on hv-cinder-81803 Nov 17 03:27:00.067745 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [req-b57aebb8-e86a-4dd4-a23f-0c4b836fd3d3 req-2b918d81-a640-440e-a8f2-35def02b6fa9 service nova] 10.222.0.11 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.054478 Nov 17 03:27:00.068860 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 207/395] 10.222.0.11 () {64 vars in 1317 bytes} [Wed Nov 17 03:27:00 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 17 03:27:00.248001 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-5102843e-21ba-43b5-96e4-24c3394bc289 tempest-AttachVolumeTestJSON-1651611701 tempest-AttachVolumeTestJSON-1651611701-project] 10.222.0.11 "POST /compute/v2.1/servers/5e11ea9c-f66a-4962-b5ca-b95784624824/action" status: 200 len: 14 microversion: 2.1 time: 0.236531 Nov 17 03:27:00.248611 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 189/396] 10.222.0.11 () {60 vars in 1277 bytes} [Wed Nov 17 03:27:00 2021] POST /compute/v2.1/servers/5e11ea9c-f66a-4962-b5ca-b95784624824/action => generated 14 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 17 03:27:00.323757 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-76b393ee-531e-4ab1-9613-8ed349cbf013 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:27:00.324452 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-76b393ee-531e-4ab1-9613-8ed349cbf013 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] [instance: 6dc785d7-bc95-4fee-8206-c2fd3b930e4f] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:27:00.331268 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-76b393ee-531e-4ab1-9613-8ed349cbf013 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:27:00.331704 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-76b393ee-531e-4ab1-9613-8ed349cbf013 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:27:00.332661 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-76b393ee-531e-4ab1-9613-8ed349cbf013 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:27:00.333275 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-76b393ee-531e-4ab1-9613-8ed349cbf013 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:27:00.631227 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-82ad89ac-6310-4400-ab20-e57a09796ab4 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 17 03:27:00.632407 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-82ad89ac-6310-4400-ab20-e57a09796ab4 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] [instance: 5d54db85-b991-4890-abaa-952413baa2e7] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:27:00.640092 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-82ad89ac-6310-4400-ab20-e57a09796ab4 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:27:00.640528 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-82ad89ac-6310-4400-ab20-e57a09796ab4 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:27:00.641357 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-82ad89ac-6310-4400-ab20-e57a09796ab4 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:27:00.641785 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-82ad89ac-6310-4400-ab20-e57a09796ab4 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:27:00.765658 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-82ad89ac-6310-4400-ab20-e57a09796ab4 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] 10.222.0.11 "POST /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7/action" status: 200 len: 29220 microversion: 2.20 time: 0.138465 Nov 17 03:27:00.770103 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 190/397] 10.222.0.11 () {62 vars in 1318 bytes} [Wed Nov 17 03:27:00 2021] POST /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7/action => generated 29220 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 17 03:27:00.797504 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-76b393ee-531e-4ab1-9613-8ed349cbf013 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f046401c6a04f6495ebe0821120bd72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a58e89ceeea4a9c8a72a1de4bcaf2d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:27:00.810138 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-3f2f080f-687c-41cd-8e96-86a44ae5baf2 tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:27:00.810831 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-3f2f080f-687c-41cd-8e96-86a44ae5baf2 tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] [instance: 5c1643c5-72d3-4676-85e6-84c5f245c517] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:27:00.815288 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-76b393ee-531e-4ab1-9613-8ed349cbf013 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] 10.222.0.11 "GET /compute/v2.1/servers/6dc785d7-bc95-4fee-8206-c2fd3b930e4f" status: 200 len: 1501 microversion: 2.1 time: 0.495457 Nov 17 03:27:00.815866 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 208/398] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:27:00 2021] GET /compute/v2.1/servers/6dc785d7-bc95-4fee-8206-c2fd3b930e4f => generated 1501 bytes in 497 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:27:00.820677 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-3f2f080f-687c-41cd-8e96-86a44ae5baf2 tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:27:00.821141 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-3f2f080f-687c-41cd-8e96-86a44ae5baf2 tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:27:00.821914 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-3f2f080f-687c-41cd-8e96-86a44ae5baf2 tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:27:00.822342 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-3f2f080f-687c-41cd-8e96-86a44ae5baf2 tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:27:00.831783 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-3c01c9a8-be19-4124-84c9-aedc3fde94e7 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:27:00.832614 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-3c01c9a8-be19-4124-84c9-aedc3fde94e7 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] [instance: a49437df-3059-4528-8328-2f3471d5fb45] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:27:00.838812 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-3c01c9a8-be19-4124-84c9-aedc3fde94e7 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:27:00.839497 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-3c01c9a8-be19-4124-84c9-aedc3fde94e7 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:27:00.840746 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-3c01c9a8-be19-4124-84c9-aedc3fde94e7 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:27:00.841405 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-3c01c9a8-be19-4124-84c9-aedc3fde94e7 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:27:00.979233 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-3f2f080f-687c-41cd-8e96-86a44ae5baf2 tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d4e8ac9538f42c9b637bd9e086668b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfc480343d4d493bb4295b055e274df5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:27:00.987332 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-3f2f080f-687c-41cd-8e96-86a44ae5baf2 tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] 10.222.0.11 "GET /compute/v2.1/servers/5c1643c5-72d3-4676-85e6-84c5f245c517" status: 200 len: 1318 microversion: 2.1 time: 0.181358 Nov 17 03:27:00.994370 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 191/399] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:27:00 2021] GET /compute/v2.1/servers/5c1643c5-72d3-4676-85e6-84c5f245c517 => generated 1318 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:27:00.999118 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-02c18b10-cdb1-4b5c-9300-17760df26acd tempest-VolumesNegativeTest-1100551557 tempest-VolumesNegativeTest-1100551557-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:27:00.999721 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-02c18b10-cdb1-4b5c-9300-17760df26acd tempest-VolumesNegativeTest-1100551557 tempest-VolumesNegativeTest-1100551557-project] [instance: 45027e8f-667f-45f3-a5f9-2399d6ea3830] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:27:01.006085 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-02c18b10-cdb1-4b5c-9300-17760df26acd tempest-VolumesNegativeTest-1100551557 tempest-VolumesNegativeTest-1100551557-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:27:01.006528 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-02c18b10-cdb1-4b5c-9300-17760df26acd tempest-VolumesNegativeTest-1100551557 tempest-VolumesNegativeTest-1100551557-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:27:01.007309 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-02c18b10-cdb1-4b5c-9300-17760df26acd tempest-VolumesNegativeTest-1100551557 tempest-VolumesNegativeTest-1100551557-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:27:01.007734 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-02c18b10-cdb1-4b5c-9300-17760df26acd tempest-VolumesNegativeTest-1100551557 tempest-VolumesNegativeTest-1100551557-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:27:01.115146 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-3c01c9a8-be19-4124-84c9-aedc3fde94e7 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f046401c6a04f6495ebe0821120bd72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a58e89ceeea4a9c8a72a1de4bcaf2d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:27:01.123629 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-3c01c9a8-be19-4124-84c9-aedc3fde94e7 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] 10.222.0.11 "GET /compute/v2.1/servers/a49437df-3059-4528-8328-2f3471d5fb45" status: 200 len: 1514 microversion: 2.1 time: 0.295427 Nov 17 03:27:01.136691 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 209/400] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:27:00 2021] GET /compute/v2.1/servers/a49437df-3059-4528-8328-2f3471d5fb45 => generated 1514 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 17 03:27:01.175950 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-02c18b10-cdb1-4b5c-9300-17760df26acd tempest-VolumesNegativeTest-1100551557 tempest-VolumesNegativeTest-1100551557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20f76a7333f14ee2ad5223b6f038e271', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0718c5e9ff9246ecb9100477e30e25eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:27:01.185188 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-02c18b10-cdb1-4b5c-9300-17760df26acd tempest-VolumesNegativeTest-1100551557 tempest-VolumesNegativeTest-1100551557-project] 10.222.0.11 "GET /compute/v2.1/servers/45027e8f-667f-45f3-a5f9-2399d6ea3830" status: 200 len: 1465 microversion: 2.1 time: 0.189996 Nov 17 03:27:01.185963 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 192/401] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:27:00 2021] GET /compute/v2.1/servers/45027e8f-667f-45f3-a5f9-2399d6ea3830 => generated 1465 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:27:01.226945 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-9deb987d-9477-475b-bdd6-89c45052eff2 tempest-VolumesNegativeTest-1100551557 tempest-VolumesNegativeTest-1100551557-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:27:01.227610 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-9deb987d-9477-475b-bdd6-89c45052eff2 tempest-VolumesNegativeTest-1100551557 tempest-VolumesNegativeTest-1100551557-project] [instance: 45027e8f-667f-45f3-a5f9-2399d6ea3830] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:27:01.233890 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-9deb987d-9477-475b-bdd6-89c45052eff2 tempest-VolumesNegativeTest-1100551557 tempest-VolumesNegativeTest-1100551557-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:27:01.235403 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-9deb987d-9477-475b-bdd6-89c45052eff2 tempest-VolumesNegativeTest-1100551557 tempest-VolumesNegativeTest-1100551557-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:27:01.236359 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-9deb987d-9477-475b-bdd6-89c45052eff2 tempest-VolumesNegativeTest-1100551557 tempest-VolumesNegativeTest-1100551557-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:27:01.236917 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-9deb987d-9477-475b-bdd6-89c45052eff2 tempest-VolumesNegativeTest-1100551557 tempest-VolumesNegativeTest-1100551557-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:27:01.259963 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-83aa2c91-a2e0-4c63-98a8-d756cbc94319 tempest-AttachVolumeTestJSON-1651611701 tempest-AttachVolumeTestJSON-1651611701-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 17 03:27:01.261165 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-83aa2c91-a2e0-4c63-98a8-d756cbc94319 tempest-AttachVolumeTestJSON-1651611701 tempest-AttachVolumeTestJSON-1651611701-project] [instance: 5e11ea9c-f66a-4962-b5ca-b95784624824] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:27:01.263461 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-9deb987d-9477-475b-bdd6-89c45052eff2 tempest-VolumesNegativeTest-1100551557 tempest-VolumesNegativeTest-1100551557-project] [instance: 45027e8f-667f-45f3-a5f9-2399d6ea3830] Going to try to terminate instance {{(pid=115917) delete /opt/stack/nova/nova/compute/api.py:2614}} Nov 17 03:27:01.267494 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-83aa2c91-a2e0-4c63-98a8-d756cbc94319 tempest-AttachVolumeTestJSON-1651611701 tempest-AttachVolumeTestJSON-1651611701-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:27:01.267938 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-83aa2c91-a2e0-4c63-98a8-d756cbc94319 tempest-AttachVolumeTestJSON-1651611701 tempest-AttachVolumeTestJSON-1651611701-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:27:01.268745 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-83aa2c91-a2e0-4c63-98a8-d756cbc94319 tempest-AttachVolumeTestJSON-1651611701 tempest-AttachVolumeTestJSON-1651611701-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:27:01.269486 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-83aa2c91-a2e0-4c63-98a8-d756cbc94319 tempest-AttachVolumeTestJSON-1651611701 tempest-AttachVolumeTestJSON-1651611701-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:27:01.357326 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-9deb987d-9477-475b-bdd6-89c45052eff2 tempest-VolumesNegativeTest-1100551557 tempest-VolumesNegativeTest-1100551557-project] 10.222.0.11 "DELETE /compute/v2.1/servers/45027e8f-667f-45f3-a5f9-2399d6ea3830" status: 204 len: 0 microversion: 2.1 time: 0.134179 Nov 17 03:27:01.358305 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 210/402] 10.222.0.11 () {58 vars in 1238 bytes} [Wed Nov 17 03:27:01 2021] DELETE /compute/v2.1/servers/45027e8f-667f-45f3-a5f9-2399d6ea3830 => generated 0 bytes in 136 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 17 03:27:01.367068 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-6b64f8b6-7472-4a71-97ab-ad90506b91a5 tempest-VolumesNegativeTest-1100551557 tempest-VolumesNegativeTest-1100551557-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:27:01.368210 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-6b64f8b6-7472-4a71-97ab-ad90506b91a5 tempest-VolumesNegativeTest-1100551557 tempest-VolumesNegativeTest-1100551557-project] [instance: 45027e8f-667f-45f3-a5f9-2399d6ea3830] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:27:01.375484 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-6b64f8b6-7472-4a71-97ab-ad90506b91a5 tempest-VolumesNegativeTest-1100551557 tempest-VolumesNegativeTest-1100551557-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:27:01.375927 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-6b64f8b6-7472-4a71-97ab-ad90506b91a5 tempest-VolumesNegativeTest-1100551557 tempest-VolumesNegativeTest-1100551557-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:27:01.376705 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-6b64f8b6-7472-4a71-97ab-ad90506b91a5 tempest-VolumesNegativeTest-1100551557 tempest-VolumesNegativeTest-1100551557-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:27:01.377345 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-6b64f8b6-7472-4a71-97ab-ad90506b91a5 tempest-VolumesNegativeTest-1100551557 tempest-VolumesNegativeTest-1100551557-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:27:01.391002 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-83aa2c91-a2e0-4c63-98a8-d756cbc94319 tempest-AttachVolumeTestJSON-1651611701 tempest-AttachVolumeTestJSON-1651611701-project] 10.222.0.11 "POST /compute/v2.1/servers/5e11ea9c-f66a-4962-b5ca-b95784624824/action" status: 200 len: 14 microversion: 2.1 time: 0.132665 Nov 17 03:27:01.392330 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 193/403] 10.222.0.11 () {60 vars in 1277 bytes} [Wed Nov 17 03:27:01 2021] POST /compute/v2.1/servers/5e11ea9c-f66a-4962-b5ca-b95784624824/action => generated 14 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Nov 17 03:27:01.543297 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-6b64f8b6-7472-4a71-97ab-ad90506b91a5 tempest-VolumesNegativeTest-1100551557 tempest-VolumesNegativeTest-1100551557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20f76a7333f14ee2ad5223b6f038e271', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0718c5e9ff9246ecb9100477e30e25eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:27:01.550681 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-6b64f8b6-7472-4a71-97ab-ad90506b91a5 tempest-VolumesNegativeTest-1100551557 tempest-VolumesNegativeTest-1100551557-project] 10.222.0.11 "GET /compute/v2.1/servers/45027e8f-667f-45f3-a5f9-2399d6ea3830" status: 200 len: 1471 microversion: 2.1 time: 0.188289 Nov 17 03:27:01.551243 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 211/404] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:27:01 2021] GET /compute/v2.1/servers/45027e8f-667f-45f3-a5f9-2399d6ea3830 => generated 1471 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 17 03:27:01.780327 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-f5771f75-a577-466b-bf67-7c647750f7d7 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 17 03:27:01.781373 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-f5771f75-a577-466b-bf67-7c647750f7d7 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] [instance: 5d54db85-b991-4890-abaa-952413baa2e7] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:27:01.788596 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-f5771f75-a577-466b-bf67-7c647750f7d7 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:27:01.789115 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-f5771f75-a577-466b-bf67-7c647750f7d7 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:27:01.789892 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-f5771f75-a577-466b-bf67-7c647750f7d7 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:27:01.790320 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-f5771f75-a577-466b-bf67-7c647750f7d7 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:27:01.971518 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-f5771f75-a577-466b-bf67-7c647750f7d7 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] 10.222.0.11 "POST /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7/action" status: 200 len: 30186 microversion: 2.20 time: 0.196904 Nov 17 03:27:01.972405 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 194/405] 10.222.0.11 () {62 vars in 1318 bytes} [Wed Nov 17 03:27:01 2021] POST /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7/action => generated 30186 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 17 03:27:02.004543 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-0a6e635c-2423-4f4c-ab56-ff37cde26dfe tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:27:02.005169 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-0a6e635c-2423-4f4c-ab56-ff37cde26dfe tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] [instance: 5c1643c5-72d3-4676-85e6-84c5f245c517] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:27:02.012242 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-0a6e635c-2423-4f4c-ab56-ff37cde26dfe tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:27:02.012698 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-0a6e635c-2423-4f4c-ab56-ff37cde26dfe tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:27:02.013522 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-0a6e635c-2423-4f4c-ab56-ff37cde26dfe tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:27:02.013959 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-0a6e635c-2423-4f4c-ab56-ff37cde26dfe tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:27:02.297047 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-0a6e635c-2423-4f4c-ab56-ff37cde26dfe tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d4e8ac9538f42c9b637bd9e086668b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfc480343d4d493bb4295b055e274df5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:27:02.306868 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-0a6e635c-2423-4f4c-ab56-ff37cde26dfe tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] 10.222.0.11 "GET /compute/v2.1/servers/5c1643c5-72d3-4676-85e6-84c5f245c517" status: 200 len: 1318 microversion: 2.1 time: 0.305671 Nov 17 03:27:02.308083 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 212/406] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:27:01 2021] GET /compute/v2.1/servers/5c1643c5-72d3-4676-85e6-84c5f245c517 => generated 1318 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:27:02.401242 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-4f325875-fc41-44ee-912b-887dfbbfc50e tempest-AttachVolumeTestJSON-1651611701 tempest-AttachVolumeTestJSON-1651611701-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 17 03:27:02.402289 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-4f325875-fc41-44ee-912b-887dfbbfc50e tempest-AttachVolumeTestJSON-1651611701 tempest-AttachVolumeTestJSON-1651611701-project] [instance: 5e11ea9c-f66a-4962-b5ca-b95784624824] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:27:02.409602 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-4f325875-fc41-44ee-912b-887dfbbfc50e tempest-AttachVolumeTestJSON-1651611701 tempest-AttachVolumeTestJSON-1651611701-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:27:02.410044 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-4f325875-fc41-44ee-912b-887dfbbfc50e tempest-AttachVolumeTestJSON-1651611701 tempest-AttachVolumeTestJSON-1651611701-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:27:02.410820 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-4f325875-fc41-44ee-912b-887dfbbfc50e tempest-AttachVolumeTestJSON-1651611701 tempest-AttachVolumeTestJSON-1651611701-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:27:02.411246 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-4f325875-fc41-44ee-912b-887dfbbfc50e tempest-AttachVolumeTestJSON-1651611701 tempest-AttachVolumeTestJSON-1651611701-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:27:02.537117 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-4f325875-fc41-44ee-912b-887dfbbfc50e tempest-AttachVolumeTestJSON-1651611701 tempest-AttachVolumeTestJSON-1651611701-project] 10.222.0.11 "POST /compute/v2.1/servers/5e11ea9c-f66a-4962-b5ca-b95784624824/action" status: 200 len: 14 microversion: 2.1 time: 0.140767 Nov 17 03:27:02.537722 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 195/407] 10.222.0.11 () {60 vars in 1277 bytes} [Wed Nov 17 03:27:02 2021] POST /compute/v2.1/servers/5e11ea9c-f66a-4962-b5ca-b95784624824/action => generated 14 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 17 03:27:02.567318 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-fe3d484a-8859-462f-ab13-859ea3240acc tempest-VolumesNegativeTest-1100551557 tempest-VolumesNegativeTest-1100551557-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:27:02.568488 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-fe3d484a-8859-462f-ab13-859ea3240acc tempest-VolumesNegativeTest-1100551557 tempest-VolumesNegativeTest-1100551557-project] [instance: 45027e8f-667f-45f3-a5f9-2399d6ea3830] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:27:02.574422 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-fe3d484a-8859-462f-ab13-859ea3240acc tempest-VolumesNegativeTest-1100551557 tempest-VolumesNegativeTest-1100551557-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:27:02.575063 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-fe3d484a-8859-462f-ab13-859ea3240acc tempest-VolumesNegativeTest-1100551557 tempest-VolumesNegativeTest-1100551557-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:27:02.575834 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-fe3d484a-8859-462f-ab13-859ea3240acc tempest-VolumesNegativeTest-1100551557 tempest-VolumesNegativeTest-1100551557-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:27:02.576258 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-fe3d484a-8859-462f-ab13-859ea3240acc tempest-VolumesNegativeTest-1100551557 tempest-VolumesNegativeTest-1100551557-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:27:02.587491 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-ea279ac5-971b-4fff-8b5a-93a8e34d5e56 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 17 03:27:02.588535 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-ea279ac5-971b-4fff-8b5a-93a8e34d5e56 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] [instance: a49437df-3059-4528-8328-2f3471d5fb45] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:27:02.595718 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-ea279ac5-971b-4fff-8b5a-93a8e34d5e56 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:27:02.596167 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-ea279ac5-971b-4fff-8b5a-93a8e34d5e56 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:27:02.596983 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-ea279ac5-971b-4fff-8b5a-93a8e34d5e56 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:27:02.597418 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-ea279ac5-971b-4fff-8b5a-93a8e34d5e56 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:27:02.623380 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.objects.instance [None req-ea279ac5-971b-4fff-8b5a-93a8e34d5e56 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lazy-loading 'flavor' on Instance uuid a49437df-3059-4528-8328-2f3471d5fb45 {{(pid=115916) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Nov 17 03:27:02.715875 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-fe3d484a-8859-462f-ab13-859ea3240acc tempest-VolumesNegativeTest-1100551557 tempest-VolumesNegativeTest-1100551557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20f76a7333f14ee2ad5223b6f038e271', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0718c5e9ff9246ecb9100477e30e25eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:27:02.723389 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-fe3d484a-8859-462f-ab13-859ea3240acc tempest-VolumesNegativeTest-1100551557 tempest-VolumesNegativeTest-1100551557-project] 10.222.0.11 "GET /compute/v2.1/servers/45027e8f-667f-45f3-a5f9-2399d6ea3830" status: 200 len: 1471 microversion: 2.1 time: 0.159654 Nov 17 03:27:02.723942 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 213/408] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:27:02 2021] GET /compute/v2.1/servers/45027e8f-667f-45f3-a5f9-2399d6ea3830 => generated 1471 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:27:02.739085 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-ea279ac5-971b-4fff-8b5a-93a8e34d5e56 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] 10.222.0.11 "POST /compute/v2.1/servers/a49437df-3059-4528-8328-2f3471d5fb45/action" status: 200 len: 32 microversion: 2.1 time: 0.155607 Nov 17 03:27:02.740034 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 196/409] 10.222.0.11 () {60 vars in 1277 bytes} [Wed Nov 17 03:27:02 2021] POST /compute/v2.1/servers/a49437df-3059-4528-8328-2f3471d5fb45/action => generated 32 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Nov 17 03:27:02.749005 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-c188ca39-80e7-42dc-acef-a39cb95caffb tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:27:02.749605 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-c188ca39-80e7-42dc-acef-a39cb95caffb tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] [instance: a49437df-3059-4528-8328-2f3471d5fb45] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:27:02.756564 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-c188ca39-80e7-42dc-acef-a39cb95caffb tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:27:02.757132 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-c188ca39-80e7-42dc-acef-a39cb95caffb tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:27:02.758009 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-c188ca39-80e7-42dc-acef-a39cb95caffb tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:27:02.758439 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-c188ca39-80e7-42dc-acef-a39cb95caffb tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:27:02.931108 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-c188ca39-80e7-42dc-acef-a39cb95caffb tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f046401c6a04f6495ebe0821120bd72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a58e89ceeea4a9c8a72a1de4bcaf2d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:27:02.939316 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-c188ca39-80e7-42dc-acef-a39cb95caffb tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] 10.222.0.11 "GET /compute/v2.1/servers/a49437df-3059-4528-8328-2f3471d5fb45" status: 200 len: 1520 microversion: 2.1 time: 0.194037 Nov 17 03:27:02.940089 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 214/410] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:27:02 2021] GET /compute/v2.1/servers/a49437df-3059-4528-8328-2f3471d5fb45 => generated 1520 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 17 03:27:02.983836 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-54131e80-2c69-41ea-a4af-a63305d0c35e tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 17 03:27:02.985098 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-54131e80-2c69-41ea-a4af-a63305d0c35e tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] [instance: 5d54db85-b991-4890-abaa-952413baa2e7] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:27:02.992647 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-54131e80-2c69-41ea-a4af-a63305d0c35e tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:27:02.993432 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-54131e80-2c69-41ea-a4af-a63305d0c35e tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:27:02.994179 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-54131e80-2c69-41ea-a4af-a63305d0c35e tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:27:02.994698 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-54131e80-2c69-41ea-a4af-a63305d0c35e tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:27:03.151866 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-54131e80-2c69-41ea-a4af-a63305d0c35e tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] 10.222.0.11 "POST /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7/action" status: 200 len: 31054 microversion: 2.20 time: 0.172102 Nov 17 03:27:03.152556 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 197/411] 10.222.0.11 () {62 vars in 1318 bytes} [Wed Nov 17 03:27:02 2021] POST /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7/action => generated 31054 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 17 03:27:03.332688 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-b4567bc1-f54d-497c-b0fb-d701a6a11869 tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:27:03.333653 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-b4567bc1-f54d-497c-b0fb-d701a6a11869 tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] [instance: 5c1643c5-72d3-4676-85e6-84c5f245c517] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:27:03.342314 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-b4567bc1-f54d-497c-b0fb-d701a6a11869 tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:27:03.342761 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-b4567bc1-f54d-497c-b0fb-d701a6a11869 tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:27:03.343770 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-b4567bc1-f54d-497c-b0fb-d701a6a11869 tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:27:03.344555 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-b4567bc1-f54d-497c-b0fb-d701a6a11869 tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:27:03.540905 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-b4567bc1-f54d-497c-b0fb-d701a6a11869 tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d4e8ac9538f42c9b637bd9e086668b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfc480343d4d493bb4295b055e274df5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:27:03.547977 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-f10c187d-07c0-46af-bfd0-f4e80ffc038b tempest-AttachVolumeTestJSON-1651611701 tempest-AttachVolumeTestJSON-1651611701-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 17 03:27:03.548990 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-b4567bc1-f54d-497c-b0fb-d701a6a11869 tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] 10.222.0.11 "GET /compute/v2.1/servers/5c1643c5-72d3-4676-85e6-84c5f245c517" status: 200 len: 1318 microversion: 2.1 time: 0.221949 Nov 17 03:27:03.549318 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-f10c187d-07c0-46af-bfd0-f4e80ffc038b tempest-AttachVolumeTestJSON-1651611701 tempest-AttachVolumeTestJSON-1651611701-project] [instance: 5e11ea9c-f66a-4962-b5ca-b95784624824] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:27:03.551308 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 215/412] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:27:03 2021] GET /compute/v2.1/servers/5c1643c5-72d3-4676-85e6-84c5f245c517 => generated 1318 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:27:03.556634 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-f10c187d-07c0-46af-bfd0-f4e80ffc038b tempest-AttachVolumeTestJSON-1651611701 tempest-AttachVolumeTestJSON-1651611701-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:27:03.557465 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-f10c187d-07c0-46af-bfd0-f4e80ffc038b tempest-AttachVolumeTestJSON-1651611701 tempest-AttachVolumeTestJSON-1651611701-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:27:03.558995 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-f10c187d-07c0-46af-bfd0-f4e80ffc038b tempest-AttachVolumeTestJSON-1651611701 tempest-AttachVolumeTestJSON-1651611701-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:27:03.558995 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-f10c187d-07c0-46af-bfd0-f4e80ffc038b tempest-AttachVolumeTestJSON-1651611701 tempest-AttachVolumeTestJSON-1651611701-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:27:03.741497 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-cc7832a7-335f-4564-9e38-19b4c32aa345 tempest-VolumesNegativeTest-1100551557 tempest-VolumesNegativeTest-1100551557-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:27:03.742093 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-cc7832a7-335f-4564-9e38-19b4c32aa345 tempest-VolumesNegativeTest-1100551557 tempest-VolumesNegativeTest-1100551557-project] [instance: 45027e8f-667f-45f3-a5f9-2399d6ea3830] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:27:03.749109 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-cc7832a7-335f-4564-9e38-19b4c32aa345 tempest-VolumesNegativeTest-1100551557 tempest-VolumesNegativeTest-1100551557-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:27:03.749579 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-cc7832a7-335f-4564-9e38-19b4c32aa345 tempest-VolumesNegativeTest-1100551557 tempest-VolumesNegativeTest-1100551557-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:27:03.750386 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-cc7832a7-335f-4564-9e38-19b4c32aa345 tempest-VolumesNegativeTest-1100551557 tempest-VolumesNegativeTest-1100551557-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:27:03.750812 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-cc7832a7-335f-4564-9e38-19b4c32aa345 tempest-VolumesNegativeTest-1100551557 tempest-VolumesNegativeTest-1100551557-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:27:03.755945 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-f10c187d-07c0-46af-bfd0-f4e80ffc038b tempest-AttachVolumeTestJSON-1651611701 tempest-AttachVolumeTestJSON-1651611701-project] 10.222.0.11 "POST /compute/v2.1/servers/5e11ea9c-f66a-4962-b5ca-b95784624824/action" status: 200 len: 14 microversion: 2.1 time: 0.211806 Nov 17 03:27:03.756588 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 198/413] 10.222.0.11 () {60 vars in 1277 bytes} [Wed Nov 17 03:27:03 2021] POST /compute/v2.1/servers/5e11ea9c-f66a-4962-b5ca-b95784624824/action => generated 14 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Nov 17 03:27:03.887045 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-cc7832a7-335f-4564-9e38-19b4c32aa345 tempest-VolumesNegativeTest-1100551557 tempest-VolumesNegativeTest-1100551557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20f76a7333f14ee2ad5223b6f038e271', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0718c5e9ff9246ecb9100477e30e25eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:27:03.895536 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-cc7832a7-335f-4564-9e38-19b4c32aa345 tempest-VolumesNegativeTest-1100551557 tempest-VolumesNegativeTest-1100551557-project] 10.222.0.11 "GET /compute/v2.1/servers/45027e8f-667f-45f3-a5f9-2399d6ea3830" status: 200 len: 1471 microversion: 2.1 time: 0.157379 Nov 17 03:27:03.896508 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 216/414] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:27:03 2021] GET /compute/v2.1/servers/45027e8f-667f-45f3-a5f9-2399d6ea3830 => generated 1471 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:27:03.956835 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-ad13f38f-7af3-4a52-ae37-5b4b6de08395 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:27:03.957429 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-ad13f38f-7af3-4a52-ae37-5b4b6de08395 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] [instance: a49437df-3059-4528-8328-2f3471d5fb45] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:27:03.964356 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-ad13f38f-7af3-4a52-ae37-5b4b6de08395 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:27:03.964939 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-ad13f38f-7af3-4a52-ae37-5b4b6de08395 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:27:03.965698 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-ad13f38f-7af3-4a52-ae37-5b4b6de08395 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:27:03.966124 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-ad13f38f-7af3-4a52-ae37-5b4b6de08395 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:27:04.103942 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-ad13f38f-7af3-4a52-ae37-5b4b6de08395 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f046401c6a04f6495ebe0821120bd72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a58e89ceeea4a9c8a72a1de4bcaf2d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:27:04.111821 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-ad13f38f-7af3-4a52-ae37-5b4b6de08395 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] 10.222.0.11 "GET /compute/v2.1/servers/a49437df-3059-4528-8328-2f3471d5fb45" status: 200 len: 1520 microversion: 2.1 time: 0.159315 Nov 17 03:27:04.112395 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 199/415] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:27:03 2021] GET /compute/v2.1/servers/a49437df-3059-4528-8328-2f3471d5fb45 => generated 1520 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:27:04.168230 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-d63b49e6-be3d-4d92-b35f-682173d5850f tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 17 03:27:04.169910 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-d63b49e6-be3d-4d92-b35f-682173d5850f tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] [instance: 5d54db85-b991-4890-abaa-952413baa2e7] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:27:04.180413 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-d63b49e6-be3d-4d92-b35f-682173d5850f tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:27:04.181242 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-d63b49e6-be3d-4d92-b35f-682173d5850f tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:27:04.182941 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-d63b49e6-be3d-4d92-b35f-682173d5850f tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:27:04.183706 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-d63b49e6-be3d-4d92-b35f-682173d5850f tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:27:04.432304 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-d63b49e6-be3d-4d92-b35f-682173d5850f tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] 10.222.0.11 "POST /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7/action" status: 200 len: 31968 microversion: 2.20 time: 0.270308 Nov 17 03:27:04.433032 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 217/416] 10.222.0.11 () {62 vars in 1318 bytes} [Wed Nov 17 03:27:04 2021] POST /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7/action => generated 31968 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 17 03:27:04.566051 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-a433f8d7-b723-4688-a8ff-6a4206376d97 tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:27:04.566652 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-a433f8d7-b723-4688-a8ff-6a4206376d97 tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] [instance: 5c1643c5-72d3-4676-85e6-84c5f245c517] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:27:04.573167 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-a433f8d7-b723-4688-a8ff-6a4206376d97 tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:27:04.573611 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-a433f8d7-b723-4688-a8ff-6a4206376d97 tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:27:04.574377 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-a433f8d7-b723-4688-a8ff-6a4206376d97 tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:27:04.575111 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-a433f8d7-b723-4688-a8ff-6a4206376d97 tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:27:04.731250 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-a433f8d7-b723-4688-a8ff-6a4206376d97 tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d4e8ac9538f42c9b637bd9e086668b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfc480343d4d493bb4295b055e274df5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:27:04.742742 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-a433f8d7-b723-4688-a8ff-6a4206376d97 tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] 10.222.0.11 "GET /compute/v2.1/servers/5c1643c5-72d3-4676-85e6-84c5f245c517" status: 200 len: 1318 microversion: 2.1 time: 0.180078 Nov 17 03:27:04.743576 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 200/417] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:27:04 2021] GET /compute/v2.1/servers/5c1643c5-72d3-4676-85e6-84c5f245c517 => generated 1318 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:27:04.766720 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-0c2030ab-4af5-40aa-8967-3baa58d43ca8 tempest-AttachVolumeTestJSON-1651611701 tempest-AttachVolumeTestJSON-1651611701-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 17 03:27:04.767891 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-0c2030ab-4af5-40aa-8967-3baa58d43ca8 tempest-AttachVolumeTestJSON-1651611701 tempest-AttachVolumeTestJSON-1651611701-project] [instance: 5e11ea9c-f66a-4962-b5ca-b95784624824] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:27:04.775067 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-0c2030ab-4af5-40aa-8967-3baa58d43ca8 tempest-AttachVolumeTestJSON-1651611701 tempest-AttachVolumeTestJSON-1651611701-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:27:04.775523 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-0c2030ab-4af5-40aa-8967-3baa58d43ca8 tempest-AttachVolumeTestJSON-1651611701 tempest-AttachVolumeTestJSON-1651611701-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:27:04.776298 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-0c2030ab-4af5-40aa-8967-3baa58d43ca8 tempest-AttachVolumeTestJSON-1651611701 tempest-AttachVolumeTestJSON-1651611701-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:27:04.776731 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-0c2030ab-4af5-40aa-8967-3baa58d43ca8 tempest-AttachVolumeTestJSON-1651611701 tempest-AttachVolumeTestJSON-1651611701-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:27:04.913426 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-d1087a7d-3132-40fe-a4a4-c4c2e9fb444b tempest-VolumesNegativeTest-1100551557 tempest-VolumesNegativeTest-1100551557-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:27:04.913943 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-d1087a7d-3132-40fe-a4a4-c4c2e9fb444b tempest-VolumesNegativeTest-1100551557 tempest-VolumesNegativeTest-1100551557-project] [instance: 45027e8f-667f-45f3-a5f9-2399d6ea3830] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:27:04.920811 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-d1087a7d-3132-40fe-a4a4-c4c2e9fb444b tempest-VolumesNegativeTest-1100551557 tempest-VolumesNegativeTest-1100551557-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:27:04.921293 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-d1087a7d-3132-40fe-a4a4-c4c2e9fb444b tempest-VolumesNegativeTest-1100551557 tempest-VolumesNegativeTest-1100551557-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:27:04.922466 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-d1087a7d-3132-40fe-a4a4-c4c2e9fb444b tempest-VolumesNegativeTest-1100551557 tempest-VolumesNegativeTest-1100551557-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:27:04.922948 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-d1087a7d-3132-40fe-a4a4-c4c2e9fb444b tempest-VolumesNegativeTest-1100551557 tempest-VolumesNegativeTest-1100551557-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:27:04.947427 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-0c2030ab-4af5-40aa-8967-3baa58d43ca8 tempest-AttachVolumeTestJSON-1651611701 tempest-AttachVolumeTestJSON-1651611701-project] 10.222.0.11 "POST /compute/v2.1/servers/5e11ea9c-f66a-4962-b5ca-b95784624824/action" status: 200 len: 14 microversion: 2.1 time: 0.184775 Nov 17 03:27:04.948045 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 218/418] 10.222.0.11 () {60 vars in 1277 bytes} [Wed Nov 17 03:27:04 2021] POST /compute/v2.1/servers/5e11ea9c-f66a-4962-b5ca-b95784624824/action => generated 14 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 17 03:27:05.065022 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-d1087a7d-3132-40fe-a4a4-c4c2e9fb444b tempest-VolumesNegativeTest-1100551557 tempest-VolumesNegativeTest-1100551557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20f76a7333f14ee2ad5223b6f038e271', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0718c5e9ff9246ecb9100477e30e25eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:27:05.073259 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-d1087a7d-3132-40fe-a4a4-c4c2e9fb444b tempest-VolumesNegativeTest-1100551557 tempest-VolumesNegativeTest-1100551557-project] 10.222.0.11 "GET /compute/v2.1/servers/45027e8f-667f-45f3-a5f9-2399d6ea3830" status: 200 len: 1471 microversion: 2.1 time: 0.164016 Nov 17 03:27:05.074143 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 201/419] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:27:04 2021] GET /compute/v2.1/servers/45027e8f-667f-45f3-a5f9-2399d6ea3830 => generated 1471 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:27:05.130252 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-d52fb92d-6308-406d-9eda-1cb68f0b836a tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:27:05.130458 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-d52fb92d-6308-406d-9eda-1cb68f0b836a tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] [instance: a49437df-3059-4528-8328-2f3471d5fb45] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:27:05.145878 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-d52fb92d-6308-406d-9eda-1cb68f0b836a tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:27:05.146449 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-d52fb92d-6308-406d-9eda-1cb68f0b836a tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:27:05.147311 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-d52fb92d-6308-406d-9eda-1cb68f0b836a tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:27:05.147805 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-d52fb92d-6308-406d-9eda-1cb68f0b836a tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:27:05.371188 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-d52fb92d-6308-406d-9eda-1cb68f0b836a tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f046401c6a04f6495ebe0821120bd72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a58e89ceeea4a9c8a72a1de4bcaf2d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:27:05.378723 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-d52fb92d-6308-406d-9eda-1cb68f0b836a tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] 10.222.0.11 "GET /compute/v2.1/servers/a49437df-3059-4528-8328-2f3471d5fb45" status: 200 len: 1520 microversion: 2.1 time: 0.252926 Nov 17 03:27:05.379262 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 219/420] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:27:05 2021] GET /compute/v2.1/servers/a49437df-3059-4528-8328-2f3471d5fb45 => generated 1520 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:27:05.444293 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-794b5afb-677b-4ee5-be1b-493a4c53ed7f tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 17 03:27:05.445299 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-794b5afb-677b-4ee5-be1b-493a4c53ed7f tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] [instance: 5d54db85-b991-4890-abaa-952413baa2e7] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:27:05.454520 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-794b5afb-677b-4ee5-be1b-493a4c53ed7f tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:27:05.454961 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-794b5afb-677b-4ee5-be1b-493a4c53ed7f tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:27:05.455742 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-794b5afb-677b-4ee5-be1b-493a4c53ed7f tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:27:05.456401 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-794b5afb-677b-4ee5-be1b-493a4c53ed7f tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:27:05.478531 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [req-71df7990-283e-4cd4-ab17-919535acac40 req-9fb0c5ce-342c-46ef-8cc6-d83895fd3bf0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "45027e8f-667f-45f3-a5f9-2399d6ea3830", "name": "network-vif-deleted", "tag": "56975407-dbfd-44f5-b514-f53c325f17ac"}]} {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 17 03:27:05.480100 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 17 03:27:05.480100 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: warnings.warn(msg) Nov 17 03:27:05.495477 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [req-71df7990-283e-4cd4-ab17-919535acac40 req-9fb0c5ce-342c-46ef-8cc6-d83895fd3bf0 service nova] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:27:05.495883 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [req-71df7990-283e-4cd4-ab17-919535acac40 req-9fb0c5ce-342c-46ef-8cc6-d83895fd3bf0 service nova] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:27:05.509585 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.compute.server_external_events [req-71df7990-283e-4cd4-ab17-919535acac40 req-9fb0c5ce-342c-46ef-8cc6-d83895fd3bf0 service nova] Creating event network-vif-deleted:56975407-dbfd-44f5-b514-f53c325f17ac for instance 45027e8f-667f-45f3-a5f9-2399d6ea3830 on hv-cinder-81803 Nov 17 03:27:05.514456 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [req-71df7990-283e-4cd4-ab17-919535acac40 req-9fb0c5ce-342c-46ef-8cc6-d83895fd3bf0 service nova] 10.222.0.11 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039563 Nov 17 03:27:05.515046 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 220/421] 10.222.0.11 () {64 vars in 1317 bytes} [Wed Nov 17 03:27:05 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 17 03:27:05.657344 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-794b5afb-677b-4ee5-be1b-493a4c53ed7f tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] 10.222.0.11 "POST /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7/action" status: 200 len: 32926 microversion: 2.20 time: 0.216531 Nov 17 03:27:05.658306 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 202/422] 10.222.0.11 () {62 vars in 1318 bytes} [Wed Nov 17 03:27:05 2021] POST /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7/action => generated 32926 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 17 03:27:05.705119 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [req-e1741bc5-8c1a-4fb5-8328-3e64a2d1a2c0 req-96b09bff-2ef3-4eb4-b7f0-6b80cd0938e1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5c1643c5-72d3-4676-85e6-84c5f245c517", "name": "network-vif-plugged", "status": "completed", "tag": "cffd3e2c-1775-45b1-b1e1-1bc7ee24953e"}]} {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 17 03:27:05.707118 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 17 03:27:05.707118 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: warnings.warn(msg) Nov 17 03:27:05.716441 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [req-e1741bc5-8c1a-4fb5-8328-3e64a2d1a2c0 req-96b09bff-2ef3-4eb4-b7f0-6b80cd0938e1 service nova] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:27:05.716919 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [req-e1741bc5-8c1a-4fb5-8328-3e64a2d1a2c0 req-96b09bff-2ef3-4eb4-b7f0-6b80cd0938e1 service nova] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:27:05.732698 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.compute.server_external_events [req-e1741bc5-8c1a-4fb5-8328-3e64a2d1a2c0 req-96b09bff-2ef3-4eb4-b7f0-6b80cd0938e1 service nova] Creating event network-vif-plugged:cffd3e2c-1775-45b1-b1e1-1bc7ee24953e for instance 5c1643c5-72d3-4676-85e6-84c5f245c517 on hv-cinder-81803 Nov 17 03:27:05.737682 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [req-e1741bc5-8c1a-4fb5-8328-3e64a2d1a2c0 req-96b09bff-2ef3-4eb4-b7f0-6b80cd0938e1 service nova] 10.222.0.11 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037691 Nov 17 03:27:05.738698 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 221/423] 10.222.0.11 () {64 vars in 1317 bytes} [Wed Nov 17 03:27:05 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 17 03:27:05.760363 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-5a6c7429-4a46-4ec7-aa66-5b6c01f3ec1e tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:27:05.761220 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-5a6c7429-4a46-4ec7-aa66-5b6c01f3ec1e tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] [instance: 5c1643c5-72d3-4676-85e6-84c5f245c517] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:27:05.769208 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-5a6c7429-4a46-4ec7-aa66-5b6c01f3ec1e tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:27:05.769761 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-5a6c7429-4a46-4ec7-aa66-5b6c01f3ec1e tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:27:05.770642 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-5a6c7429-4a46-4ec7-aa66-5b6c01f3ec1e tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:27:05.771179 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-5a6c7429-4a46-4ec7-aa66-5b6c01f3ec1e tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:27:05.924669 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-5a6c7429-4a46-4ec7-aa66-5b6c01f3ec1e tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d4e8ac9538f42c9b637bd9e086668b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfc480343d4d493bb4295b055e274df5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:27:05.937842 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-5a6c7429-4a46-4ec7-aa66-5b6c01f3ec1e tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] 10.222.0.11 "GET /compute/v2.1/servers/5c1643c5-72d3-4676-85e6-84c5f245c517" status: 200 len: 1318 microversion: 2.1 time: 0.181715 Nov 17 03:27:05.938457 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 203/424] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:27:05 2021] GET /compute/v2.1/servers/5c1643c5-72d3-4676-85e6-84c5f245c517 => generated 1318 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:27:05.959119 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-8912bd80-f70a-4a77-8514-4596ccd75963 tempest-AttachVolumeTestJSON-1651611701 tempest-AttachVolumeTestJSON-1651611701-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 17 03:27:05.960284 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-8912bd80-f70a-4a77-8514-4596ccd75963 tempest-AttachVolumeTestJSON-1651611701 tempest-AttachVolumeTestJSON-1651611701-project] [instance: 5e11ea9c-f66a-4962-b5ca-b95784624824] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:27:05.966771 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-8912bd80-f70a-4a77-8514-4596ccd75963 tempest-AttachVolumeTestJSON-1651611701 tempest-AttachVolumeTestJSON-1651611701-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:27:05.967275 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-8912bd80-f70a-4a77-8514-4596ccd75963 tempest-AttachVolumeTestJSON-1651611701 tempest-AttachVolumeTestJSON-1651611701-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:27:05.968050 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-8912bd80-f70a-4a77-8514-4596ccd75963 tempest-AttachVolumeTestJSON-1651611701 tempest-AttachVolumeTestJSON-1651611701-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:27:05.968908 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-8912bd80-f70a-4a77-8514-4596ccd75963 tempest-AttachVolumeTestJSON-1651611701 tempest-AttachVolumeTestJSON-1651611701-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:27:06.080312 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-8912bd80-f70a-4a77-8514-4596ccd75963 tempest-AttachVolumeTestJSON-1651611701 tempest-AttachVolumeTestJSON-1651611701-project] 10.222.0.11 "POST /compute/v2.1/servers/5e11ea9c-f66a-4962-b5ca-b95784624824/action" status: 200 len: 14 microversion: 2.1 time: 0.124856 Nov 17 03:27:06.081206 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 222/425] 10.222.0.11 () {60 vars in 1277 bytes} [Wed Nov 17 03:27:05 2021] POST /compute/v2.1/servers/5e11ea9c-f66a-4962-b5ca-b95784624824/action => generated 14 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 17 03:27:06.095747 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-9e9a8c3e-9569-40e7-bdc9-befa55acc583 tempest-VolumesNegativeTest-1100551557 tempest-VolumesNegativeTest-1100551557-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:27:06.096375 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-9e9a8c3e-9569-40e7-bdc9-befa55acc583 tempest-VolumesNegativeTest-1100551557 tempest-VolumesNegativeTest-1100551557-project] [instance: 45027e8f-667f-45f3-a5f9-2399d6ea3830] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:27:06.102905 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-9e9a8c3e-9569-40e7-bdc9-befa55acc583 tempest-VolumesNegativeTest-1100551557 tempest-VolumesNegativeTest-1100551557-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:27:06.103361 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-9e9a8c3e-9569-40e7-bdc9-befa55acc583 tempest-VolumesNegativeTest-1100551557 tempest-VolumesNegativeTest-1100551557-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:27:06.104147 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-9e9a8c3e-9569-40e7-bdc9-befa55acc583 tempest-VolumesNegativeTest-1100551557 tempest-VolumesNegativeTest-1100551557-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:27:06.104818 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-9e9a8c3e-9569-40e7-bdc9-befa55acc583 tempest-VolumesNegativeTest-1100551557 tempest-VolumesNegativeTest-1100551557-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:27:06.151474 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-9e9a8c3e-9569-40e7-bdc9-befa55acc583 tempest-VolumesNegativeTest-1100551557 tempest-VolumesNegativeTest-1100551557-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:27:06.151928 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-9e9a8c3e-9569-40e7-bdc9-befa55acc583 tempest-VolumesNegativeTest-1100551557 tempest-VolumesNegativeTest-1100551557-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:27:06.152379 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.objects.instance [None req-9e9a8c3e-9569-40e7-bdc9-befa55acc583 tempest-VolumesNegativeTest-1100551557 tempest-VolumesNegativeTest-1100551557-project] Lazy-loading 'fault' on Instance uuid 45027e8f-667f-45f3-a5f9-2399d6ea3830 {{(pid=115916) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Nov 17 03:27:06.197925 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-9e9a8c3e-9569-40e7-bdc9-befa55acc583 tempest-VolumesNegativeTest-1100551557 tempest-VolumesNegativeTest-1100551557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20f76a7333f14ee2ad5223b6f038e271', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0718c5e9ff9246ecb9100477e30e25eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:27:06.205784 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-9e9a8c3e-9569-40e7-bdc9-befa55acc583 tempest-VolumesNegativeTest-1100551557 tempest-VolumesNegativeTest-1100551557-project] 10.222.0.11 "GET /compute/v2.1/servers/45027e8f-667f-45f3-a5f9-2399d6ea3830" status: 200 len: 1305 microversion: 2.1 time: 0.115902 Nov 17 03:27:06.206568 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 204/426] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:27:06 2021] GET /compute/v2.1/servers/45027e8f-667f-45f3-a5f9-2399d6ea3830 => generated 1305 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 17 03:27:06.396938 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-5ed05e8d-c9ff-4f39-9820-1754b18e0fb8 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:27:06.397632 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-5ed05e8d-c9ff-4f39-9820-1754b18e0fb8 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] [instance: a49437df-3059-4528-8328-2f3471d5fb45] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:27:06.404902 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-5ed05e8d-c9ff-4f39-9820-1754b18e0fb8 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:27:06.405356 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-5ed05e8d-c9ff-4f39-9820-1754b18e0fb8 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:27:06.406132 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-5ed05e8d-c9ff-4f39-9820-1754b18e0fb8 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:27:06.406526 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-5ed05e8d-c9ff-4f39-9820-1754b18e0fb8 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:27:06.550170 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-5ed05e8d-c9ff-4f39-9820-1754b18e0fb8 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f046401c6a04f6495ebe0821120bd72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a58e89ceeea4a9c8a72a1de4bcaf2d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:27:06.559851 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-5ed05e8d-c9ff-4f39-9820-1754b18e0fb8 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] 10.222.0.11 "GET /compute/v2.1/servers/a49437df-3059-4528-8328-2f3471d5fb45" status: 200 len: 1520 microversion: 2.1 time: 0.166975 Nov 17 03:27:06.560702 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 223/427] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:27:06 2021] GET /compute/v2.1/servers/a49437df-3059-4528-8328-2f3471d5fb45 => generated 1520 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:27:06.669671 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-e934501a-6c40-4604-b7a3-143e4834fc9c tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 17 03:27:06.671365 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-e934501a-6c40-4604-b7a3-143e4834fc9c tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] [instance: 5d54db85-b991-4890-abaa-952413baa2e7] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:27:06.677825 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-e934501a-6c40-4604-b7a3-143e4834fc9c tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:27:06.678265 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-e934501a-6c40-4604-b7a3-143e4834fc9c tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:27:06.679072 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-e934501a-6c40-4604-b7a3-143e4834fc9c tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:27:06.679522 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-e934501a-6c40-4604-b7a3-143e4834fc9c tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:27:06.827023 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-e934501a-6c40-4604-b7a3-143e4834fc9c tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] 10.222.0.11 "POST /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7/action" status: 200 len: 33321 microversion: 2.20 time: 0.160750 Nov 17 03:27:06.827597 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 205/428] 10.222.0.11 () {62 vars in 1318 bytes} [Wed Nov 17 03:27:06 2021] POST /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7/action => generated 33321 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 17 03:27:06.957822 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-99b62ccf-9638-433e-b861-0e90ab9d10e8 tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:27:06.958632 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-99b62ccf-9638-433e-b861-0e90ab9d10e8 tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] [instance: 5c1643c5-72d3-4676-85e6-84c5f245c517] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:27:06.967921 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-99b62ccf-9638-433e-b861-0e90ab9d10e8 tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:27:06.968606 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-99b62ccf-9638-433e-b861-0e90ab9d10e8 tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:27:06.969178 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-99b62ccf-9638-433e-b861-0e90ab9d10e8 tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:27:06.969611 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-99b62ccf-9638-433e-b861-0e90ab9d10e8 tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:27:07.093144 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-0aa842e2-130f-4e4e-8334-878424974c02 tempest-AttachVolumeTestJSON-1651611701 tempest-AttachVolumeTestJSON-1651611701-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 17 03:27:07.095339 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-0aa842e2-130f-4e4e-8334-878424974c02 tempest-AttachVolumeTestJSON-1651611701 tempest-AttachVolumeTestJSON-1651611701-project] [instance: 5e11ea9c-f66a-4962-b5ca-b95784624824] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:27:07.103965 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-0aa842e2-130f-4e4e-8334-878424974c02 tempest-AttachVolumeTestJSON-1651611701 tempest-AttachVolumeTestJSON-1651611701-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:27:07.104472 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-0aa842e2-130f-4e4e-8334-878424974c02 tempest-AttachVolumeTestJSON-1651611701 tempest-AttachVolumeTestJSON-1651611701-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:27:07.105515 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-0aa842e2-130f-4e4e-8334-878424974c02 tempest-AttachVolumeTestJSON-1651611701 tempest-AttachVolumeTestJSON-1651611701-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:27:07.105916 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-0aa842e2-130f-4e4e-8334-878424974c02 tempest-AttachVolumeTestJSON-1651611701 tempest-AttachVolumeTestJSON-1651611701-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:27:07.109887 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-99b62ccf-9638-433e-b861-0e90ab9d10e8 tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d4e8ac9538f42c9b637bd9e086668b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfc480343d4d493bb4295b055e274df5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:27:07.117589 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-99b62ccf-9638-433e-b861-0e90ab9d10e8 tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] 10.222.0.11 "GET /compute/v2.1/servers/5c1643c5-72d3-4676-85e6-84c5f245c517" status: 200 len: 1318 microversion: 2.1 time: 0.165816 Nov 17 03:27:07.118925 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 224/429] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:27:06 2021] GET /compute/v2.1/servers/5c1643c5-72d3-4676-85e6-84c5f245c517 => generated 1318 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:27:07.223467 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-ee73bf90-40d8-4058-aab6-28e4fdf73044 tempest-VolumesNegativeTest-1100551557 tempest-VolumesNegativeTest-1100551557-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:27:07.224228 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-ee73bf90-40d8-4058-aab6-28e4fdf73044 tempest-VolumesNegativeTest-1100551557 tempest-VolumesNegativeTest-1100551557-project] [instance: 45027e8f-667f-45f3-a5f9-2399d6ea3830] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:27:07.231800 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-ee73bf90-40d8-4058-aab6-28e4fdf73044 tempest-VolumesNegativeTest-1100551557 tempest-VolumesNegativeTest-1100551557-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:27:07.234380 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-ee73bf90-40d8-4058-aab6-28e4fdf73044 tempest-VolumesNegativeTest-1100551557 tempest-VolumesNegativeTest-1100551557-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:27:07.235699 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-ee73bf90-40d8-4058-aab6-28e4fdf73044 tempest-VolumesNegativeTest-1100551557 tempest-VolumesNegativeTest-1100551557-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:27:07.236150 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-ee73bf90-40d8-4058-aab6-28e4fdf73044 tempest-VolumesNegativeTest-1100551557 tempest-VolumesNegativeTest-1100551557-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:27:07.251706 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.wsgi [None req-ee73bf90-40d8-4058-aab6-28e4fdf73044 tempest-VolumesNegativeTest-1100551557 tempest-VolumesNegativeTest-1100551557-project] HTTP exception thrown: Instance 45027e8f-667f-45f3-a5f9-2399d6ea3830 could not be found. Nov 17 03:27:07.252319 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-ee73bf90-40d8-4058-aab6-28e4fdf73044 tempest-VolumesNegativeTest-1100551557 tempest-VolumesNegativeTest-1100551557-project] Returning 404 to user: Instance 45027e8f-667f-45f3-a5f9-2399d6ea3830 could not be found. {{(pid=115917) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 17 03:27:07.253213 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-ee73bf90-40d8-4058-aab6-28e4fdf73044 tempest-VolumesNegativeTest-1100551557 tempest-VolumesNegativeTest-1100551557-project] 10.222.0.11 "GET /compute/v2.1/servers/45027e8f-667f-45f3-a5f9-2399d6ea3830" status: 404 len: 111 microversion: 2.1 time: 0.033416 Nov 17 03:27:07.253769 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 225/430] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:27:07 2021] GET /compute/v2.1/servers/45027e8f-667f-45f3-a5f9-2399d6ea3830 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 17 03:27:07.262772 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-0aa842e2-130f-4e4e-8334-878424974c02 tempest-AttachVolumeTestJSON-1651611701 tempest-AttachVolumeTestJSON-1651611701-project] 10.222.0.11 "POST /compute/v2.1/servers/5e11ea9c-f66a-4962-b5ca-b95784624824/action" status: 200 len: 14 microversion: 2.1 time: 0.174498 Nov 17 03:27:07.263411 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 206/431] 10.222.0.11 () {60 vars in 1277 bytes} [Wed Nov 17 03:27:07 2021] POST /compute/v2.1/servers/5e11ea9c-f66a-4962-b5ca-b95784624824/action => generated 14 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Nov 17 03:27:07.578379 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-b0dcf37c-b0db-4504-b52f-a8f0749f59a9 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:27:07.579027 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-b0dcf37c-b0db-4504-b52f-a8f0749f59a9 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] [instance: a49437df-3059-4528-8328-2f3471d5fb45] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:27:07.586562 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-b0dcf37c-b0db-4504-b52f-a8f0749f59a9 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:27:07.587001 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-b0dcf37c-b0db-4504-b52f-a8f0749f59a9 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:27:07.587802 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-b0dcf37c-b0db-4504-b52f-a8f0749f59a9 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:27:07.588227 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-b0dcf37c-b0db-4504-b52f-a8f0749f59a9 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:27:07.739282 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-b0dcf37c-b0db-4504-b52f-a8f0749f59a9 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f046401c6a04f6495ebe0821120bd72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a58e89ceeea4a9c8a72a1de4bcaf2d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:27:07.747188 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-b0dcf37c-b0db-4504-b52f-a8f0749f59a9 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] 10.222.0.11 "GET /compute/v2.1/servers/a49437df-3059-4528-8328-2f3471d5fb45" status: 200 len: 1520 microversion: 2.1 time: 0.173551 Nov 17 03:27:07.748819 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 226/432] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:27:07 2021] GET /compute/v2.1/servers/a49437df-3059-4528-8328-2f3471d5fb45 => generated 1520 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:27:07.847271 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-0da01134-f8b3-45f3-a728-03bb646d4f8d tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 17 03:27:07.848408 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-0da01134-f8b3-45f3-a728-03bb646d4f8d tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] [instance: 5d54db85-b991-4890-abaa-952413baa2e7] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:27:07.855618 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-0da01134-f8b3-45f3-a728-03bb646d4f8d tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:27:07.856137 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-0da01134-f8b3-45f3-a728-03bb646d4f8d tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:27:07.857172 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-0da01134-f8b3-45f3-a728-03bb646d4f8d tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:27:07.857677 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-0da01134-f8b3-45f3-a728-03bb646d4f8d tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:27:08.135892 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-94accddb-ea94-4b44-9dce-63e39049c283 tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:27:08.136945 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-94accddb-ea94-4b44-9dce-63e39049c283 tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] [instance: 5c1643c5-72d3-4676-85e6-84c5f245c517] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:27:08.146811 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-94accddb-ea94-4b44-9dce-63e39049c283 tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:27:08.147263 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-94accddb-ea94-4b44-9dce-63e39049c283 tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:27:08.148041 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-94accddb-ea94-4b44-9dce-63e39049c283 tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:27:08.148652 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-94accddb-ea94-4b44-9dce-63e39049c283 tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:27:08.290769 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-94accddb-ea94-4b44-9dce-63e39049c283 tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d4e8ac9538f42c9b637bd9e086668b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfc480343d4d493bb4295b055e274df5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:27:08.300038 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-94accddb-ea94-4b44-9dce-63e39049c283 tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] 10.222.0.11 "GET /compute/v2.1/servers/5c1643c5-72d3-4676-85e6-84c5f245c517" status: 200 len: 1318 microversion: 2.1 time: 0.168334 Nov 17 03:27:08.300672 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 227/433] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:27:08 2021] GET /compute/v2.1/servers/5c1643c5-72d3-4676-85e6-84c5f245c517 => generated 1318 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:27:08.305077 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-79951ff1-670f-46d2-9c74-5e9422b3291c tempest-AttachVolumeTestJSON-1651611701 tempest-AttachVolumeTestJSON-1651611701-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 17 03:27:08.306066 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-79951ff1-670f-46d2-9c74-5e9422b3291c tempest-AttachVolumeTestJSON-1651611701 tempest-AttachVolumeTestJSON-1651611701-project] [instance: 5e11ea9c-f66a-4962-b5ca-b95784624824] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:27:08.312944 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-79951ff1-670f-46d2-9c74-5e9422b3291c tempest-AttachVolumeTestJSON-1651611701 tempest-AttachVolumeTestJSON-1651611701-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:27:08.313370 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-79951ff1-670f-46d2-9c74-5e9422b3291c tempest-AttachVolumeTestJSON-1651611701 tempest-AttachVolumeTestJSON-1651611701-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:27:08.314142 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-79951ff1-670f-46d2-9c74-5e9422b3291c tempest-AttachVolumeTestJSON-1651611701 tempest-AttachVolumeTestJSON-1651611701-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:27:08.314737 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-79951ff1-670f-46d2-9c74-5e9422b3291c tempest-AttachVolumeTestJSON-1651611701 tempest-AttachVolumeTestJSON-1651611701-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:27:11.224113 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-0da01134-f8b3-45f3-a728-03bb646d4f8d tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] 10.222.0.11 "POST /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7/action" status: 200 len: 34828 microversion: 2.20 time: 3.380742 Nov 17 03:27:11.224871 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 207/434] 10.222.0.11 () {62 vars in 1318 bytes} [Wed Nov 17 03:27:07 2021] POST /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7/action => generated 34828 bytes in 3383 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 17 03:27:11.230171 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-fa5867f7-2d05-4ded-9033-f47ab9377b4a tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:27:11.230930 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-fa5867f7-2d05-4ded-9033-f47ab9377b4a tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] [instance: a49437df-3059-4528-8328-2f3471d5fb45] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:27:11.239110 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-fa5867f7-2d05-4ded-9033-f47ab9377b4a tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:27:11.239555 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-fa5867f7-2d05-4ded-9033-f47ab9377b4a tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:27:11.240323 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-fa5867f7-2d05-4ded-9033-f47ab9377b4a tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:27:11.240755 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-fa5867f7-2d05-4ded-9033-f47ab9377b4a tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:27:11.274538 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-79951ff1-670f-46d2-9c74-5e9422b3291c tempest-AttachVolumeTestJSON-1651611701 tempest-AttachVolumeTestJSON-1651611701-project] 10.222.0.11 "POST /compute/v2.1/servers/5e11ea9c-f66a-4962-b5ca-b95784624824/action" status: 200 len: 14 microversion: 2.1 time: 2.972534 Nov 17 03:27:11.275158 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 228/435] 10.222.0.11 () {60 vars in 1277 bytes} [Wed Nov 17 03:27:08 2021] POST /compute/v2.1/servers/5e11ea9c-f66a-4962-b5ca-b95784624824/action => generated 14 bytes in 2974 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 17 03:27:11.280150 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-8e6b0579-7c4b-42ba-ba3a-73464bf0400c tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:27:11.280942 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-8e6b0579-7c4b-42ba-ba3a-73464bf0400c tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] [instance: 5c1643c5-72d3-4676-85e6-84c5f245c517] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:27:11.289232 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-8e6b0579-7c4b-42ba-ba3a-73464bf0400c tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:27:11.292117 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-8e6b0579-7c4b-42ba-ba3a-73464bf0400c tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:27:11.293351 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-8e6b0579-7c4b-42ba-ba3a-73464bf0400c tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:27:11.293763 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-8e6b0579-7c4b-42ba-ba3a-73464bf0400c tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:27:11.409099 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-fa5867f7-2d05-4ded-9033-f47ab9377b4a tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f046401c6a04f6495ebe0821120bd72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a58e89ceeea4a9c8a72a1de4bcaf2d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:27:11.417034 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-fa5867f7-2d05-4ded-9033-f47ab9377b4a tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] 10.222.0.11 "GET /compute/v2.1/servers/a49437df-3059-4528-8328-2f3471d5fb45" status: 200 len: 1520 microversion: 2.1 time: 0.190899 Nov 17 03:27:11.417617 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 208/436] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:27:11 2021] GET /compute/v2.1/servers/a49437df-3059-4528-8328-2f3471d5fb45 => generated 1520 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:27:11.458222 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-8e6b0579-7c4b-42ba-ba3a-73464bf0400c tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d4e8ac9538f42c9b637bd9e086668b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfc480343d4d493bb4295b055e274df5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:27:11.465483 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-8e6b0579-7c4b-42ba-ba3a-73464bf0400c tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] 10.222.0.11 "GET /compute/v2.1/servers/5c1643c5-72d3-4676-85e6-84c5f245c517" status: 200 len: 1318 microversion: 2.1 time: 0.189171 Nov 17 03:27:11.466047 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 229/437] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:27:11 2021] GET /compute/v2.1/servers/5c1643c5-72d3-4676-85e6-84c5f245c517 => generated 1318 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:27:12.236955 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-5798f1cc-9fd0-40f1-9abb-de6466017bb3 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 17 03:27:12.237936 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-5798f1cc-9fd0-40f1-9abb-de6466017bb3 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] [instance: 5d54db85-b991-4890-abaa-952413baa2e7] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:27:12.244303 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-5798f1cc-9fd0-40f1-9abb-de6466017bb3 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:27:12.244723 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-5798f1cc-9fd0-40f1-9abb-de6466017bb3 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:27:12.245562 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-5798f1cc-9fd0-40f1-9abb-de6466017bb3 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:27:12.246195 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-5798f1cc-9fd0-40f1-9abb-de6466017bb3 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:27:12.284682 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-02d82f5b-970d-46c4-b9fa-9a59d7c83c7a tempest-AttachVolumeTestJSON-1651611701 tempest-AttachVolumeTestJSON-1651611701-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 17 03:27:12.285793 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-02d82f5b-970d-46c4-b9fa-9a59d7c83c7a tempest-AttachVolumeTestJSON-1651611701 tempest-AttachVolumeTestJSON-1651611701-project] [instance: 5e11ea9c-f66a-4962-b5ca-b95784624824] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:27:12.292094 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-02d82f5b-970d-46c4-b9fa-9a59d7c83c7a tempest-AttachVolumeTestJSON-1651611701 tempest-AttachVolumeTestJSON-1651611701-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:27:12.292586 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-02d82f5b-970d-46c4-b9fa-9a59d7c83c7a tempest-AttachVolumeTestJSON-1651611701 tempest-AttachVolumeTestJSON-1651611701-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:27:12.293433 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-02d82f5b-970d-46c4-b9fa-9a59d7c83c7a tempest-AttachVolumeTestJSON-1651611701 tempest-AttachVolumeTestJSON-1651611701-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:27:12.293935 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-02d82f5b-970d-46c4-b9fa-9a59d7c83c7a tempest-AttachVolumeTestJSON-1651611701 tempest-AttachVolumeTestJSON-1651611701-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:27:12.400096 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-5798f1cc-9fd0-40f1-9abb-de6466017bb3 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] 10.222.0.11 "POST /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7/action" status: 200 len: 35301 microversion: 2.20 time: 0.167314 Nov 17 03:27:12.400807 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 209/438] 10.222.0.11 () {62 vars in 1318 bytes} [Wed Nov 17 03:27:12 2021] POST /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7/action => generated 35301 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 17 03:27:12.435634 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-1851fe8d-34e5-43c1-a295-895f865f99c1 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:27:12.436342 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-1851fe8d-34e5-43c1-a295-895f865f99c1 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] [instance: a49437df-3059-4528-8328-2f3471d5fb45] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:27:12.443866 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-1851fe8d-34e5-43c1-a295-895f865f99c1 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:27:12.444311 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-1851fe8d-34e5-43c1-a295-895f865f99c1 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:27:12.445124 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-1851fe8d-34e5-43c1-a295-895f865f99c1 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:27:12.445585 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-1851fe8d-34e5-43c1-a295-895f865f99c1 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:27:12.462364 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-02d82f5b-970d-46c4-b9fa-9a59d7c83c7a tempest-AttachVolumeTestJSON-1651611701 tempest-AttachVolumeTestJSON-1651611701-project] 10.222.0.11 "POST /compute/v2.1/servers/5e11ea9c-f66a-4962-b5ca-b95784624824/action" status: 200 len: 14 microversion: 2.1 time: 0.179686 Nov 17 03:27:12.463390 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 230/439] 10.222.0.11 () {60 vars in 1277 bytes} [Wed Nov 17 03:27:12 2021] POST /compute/v2.1/servers/5e11ea9c-f66a-4962-b5ca-b95784624824/action => generated 14 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Nov 17 03:27:12.484287 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-cf05783d-8150-4e34-a07c-b4ffa2d3b752 tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:27:12.485655 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-cf05783d-8150-4e34-a07c-b4ffa2d3b752 tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] [instance: 5c1643c5-72d3-4676-85e6-84c5f245c517] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:27:12.494458 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-cf05783d-8150-4e34-a07c-b4ffa2d3b752 tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:27:12.495151 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-cf05783d-8150-4e34-a07c-b4ffa2d3b752 tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:27:12.496349 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-cf05783d-8150-4e34-a07c-b4ffa2d3b752 tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:27:12.497143 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-cf05783d-8150-4e34-a07c-b4ffa2d3b752 tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:27:12.605184 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-1851fe8d-34e5-43c1-a295-895f865f99c1 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f046401c6a04f6495ebe0821120bd72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a58e89ceeea4a9c8a72a1de4bcaf2d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:27:12.613231 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-1851fe8d-34e5-43c1-a295-895f865f99c1 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] 10.222.0.11 "GET /compute/v2.1/servers/a49437df-3059-4528-8328-2f3471d5fb45" status: 200 len: 1520 microversion: 2.1 time: 0.182472 Nov 17 03:27:12.613815 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 210/440] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:27:12 2021] GET /compute/v2.1/servers/a49437df-3059-4528-8328-2f3471d5fb45 => generated 1520 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:27:12.709852 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-cf05783d-8150-4e34-a07c-b4ffa2d3b752 tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d4e8ac9538f42c9b637bd9e086668b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfc480343d4d493bb4295b055e274df5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:27:12.717509 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-cf05783d-8150-4e34-a07c-b4ffa2d3b752 tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] 10.222.0.11 "GET /compute/v2.1/servers/5c1643c5-72d3-4676-85e6-84c5f245c517" status: 200 len: 1506 microversion: 2.1 time: 0.238646 Nov 17 03:27:12.718546 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 231/441] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:27:12 2021] GET /compute/v2.1/servers/5c1643c5-72d3-4676-85e6-84c5f245c517 => generated 1506 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:27:13.411884 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-fccc72f8-b780-4515-b26c-57f429c4033d tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 17 03:27:13.412936 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-fccc72f8-b780-4515-b26c-57f429c4033d tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] [instance: 5d54db85-b991-4890-abaa-952413baa2e7] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:27:13.419575 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-fccc72f8-b780-4515-b26c-57f429c4033d tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:27:13.420025 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-fccc72f8-b780-4515-b26c-57f429c4033d tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:27:13.420804 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-fccc72f8-b780-4515-b26c-57f429c4033d tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:27:13.421256 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-fccc72f8-b780-4515-b26c-57f429c4033d tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:27:13.474073 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-abb6be80-93f5-4b17-9be2-44e7371ac6db tempest-AttachVolumeTestJSON-1651611701 tempest-AttachVolumeTestJSON-1651611701-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 17 03:27:13.474972 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-abb6be80-93f5-4b17-9be2-44e7371ac6db tempest-AttachVolumeTestJSON-1651611701 tempest-AttachVolumeTestJSON-1651611701-project] [instance: 5e11ea9c-f66a-4962-b5ca-b95784624824] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:27:13.481872 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-abb6be80-93f5-4b17-9be2-44e7371ac6db tempest-AttachVolumeTestJSON-1651611701 tempest-AttachVolumeTestJSON-1651611701-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:27:13.482328 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-abb6be80-93f5-4b17-9be2-44e7371ac6db tempest-AttachVolumeTestJSON-1651611701 tempest-AttachVolumeTestJSON-1651611701-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:27:13.483070 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-abb6be80-93f5-4b17-9be2-44e7371ac6db tempest-AttachVolumeTestJSON-1651611701 tempest-AttachVolumeTestJSON-1651611701-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:27:13.483526 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-abb6be80-93f5-4b17-9be2-44e7371ac6db tempest-AttachVolumeTestJSON-1651611701 tempest-AttachVolumeTestJSON-1651611701-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:27:13.600602 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-fccc72f8-b780-4515-b26c-57f429c4033d tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] 10.222.0.11 "POST /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7/action" status: 200 len: 35946 microversion: 2.20 time: 0.192499 Nov 17 03:27:13.601330 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 211/442] 10.222.0.11 () {62 vars in 1318 bytes} [Wed Nov 17 03:27:13 2021] POST /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7/action => generated 35946 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 17 03:27:13.632457 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-20249fcd-db65-4898-973b-0f4ae44166a7 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:27:13.633330 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-20249fcd-db65-4898-973b-0f4ae44166a7 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] [instance: a49437df-3059-4528-8328-2f3471d5fb45] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:27:13.638399 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-abb6be80-93f5-4b17-9be2-44e7371ac6db tempest-AttachVolumeTestJSON-1651611701 tempest-AttachVolumeTestJSON-1651611701-project] 10.222.0.11 "POST /compute/v2.1/servers/5e11ea9c-f66a-4962-b5ca-b95784624824/action" status: 200 len: 14 microversion: 2.1 time: 0.168534 Nov 17 03:27:13.639118 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 232/443] 10.222.0.11 () {60 vars in 1277 bytes} [Wed Nov 17 03:27:13 2021] POST /compute/v2.1/servers/5e11ea9c-f66a-4962-b5ca-b95784624824/action => generated 14 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 17 03:27:13.644475 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-20249fcd-db65-4898-973b-0f4ae44166a7 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:27:13.645175 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-20249fcd-db65-4898-973b-0f4ae44166a7 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:27:13.646339 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-20249fcd-db65-4898-973b-0f4ae44166a7 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:27:13.646937 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-20249fcd-db65-4898-973b-0f4ae44166a7 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:27:13.802405 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-20249fcd-db65-4898-973b-0f4ae44166a7 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f046401c6a04f6495ebe0821120bd72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a58e89ceeea4a9c8a72a1de4bcaf2d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:27:13.813092 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-20249fcd-db65-4898-973b-0f4ae44166a7 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] 10.222.0.11 "GET /compute/v2.1/servers/a49437df-3059-4528-8328-2f3471d5fb45" status: 200 len: 1520 microversion: 2.1 time: 0.185225 Nov 17 03:27:13.817200 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 212/444] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:27:13 2021] GET /compute/v2.1/servers/a49437df-3059-4528-8328-2f3471d5fb45 => generated 1520 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 17 03:27:14.056246 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-4da75160-8677-4ef3-9735-543c95193879 tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "dc1876d7-2eae-4f53-a8fb-b8ed689cd7c6"}} {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 17 03:27:14.058587 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-4da75160-8677-4ef3-9735-543c95193879 tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] [instance: 5c1643c5-72d3-4676-85e6-84c5f245c517] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:27:14.075320 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-4da75160-8677-4ef3-9735-543c95193879 tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:27:14.075769 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-4da75160-8677-4ef3-9735-543c95193879 tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:27:14.076550 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-4da75160-8677-4ef3-9735-543c95193879 tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:27:14.077193 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-4da75160-8677-4ef3-9735-543c95193879 tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:27:14.462226 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-4da75160-8677-4ef3-9735-543c95193879 tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] 10.222.0.11 "POST /compute/v2.1/servers/5c1643c5-72d3-4676-85e6-84c5f245c517/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.409851 Nov 17 03:27:14.469012 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 233/445] 10.222.0.11 () {60 vars in 1322 bytes} [Wed Nov 17 03:27:14 2021] POST /compute/v2.1/servers/5c1643c5-72d3-4676-85e6-84c5f245c517/os-volume_attachments => generated 194 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 17 03:27:14.613477 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-5ac0b74d-2b4d-49db-a3f5-5905119c7e6e tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 17 03:27:14.614974 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-5ac0b74d-2b4d-49db-a3f5-5905119c7e6e tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] [instance: 5d54db85-b991-4890-abaa-952413baa2e7] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:27:14.622381 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-5ac0b74d-2b4d-49db-a3f5-5905119c7e6e tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:27:14.623108 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-5ac0b74d-2b4d-49db-a3f5-5905119c7e6e tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:27:14.624288 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-5ac0b74d-2b4d-49db-a3f5-5905119c7e6e tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:27:14.624896 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-5ac0b74d-2b4d-49db-a3f5-5905119c7e6e tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:27:14.650249 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-e6360aea-6f7d-4f4e-8b11-efda3d5358e7 tempest-AttachVolumeTestJSON-1651611701 tempest-AttachVolumeTestJSON-1651611701-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 17 03:27:14.652086 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-e6360aea-6f7d-4f4e-8b11-efda3d5358e7 tempest-AttachVolumeTestJSON-1651611701 tempest-AttachVolumeTestJSON-1651611701-project] [instance: 5e11ea9c-f66a-4962-b5ca-b95784624824] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:27:14.659555 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-e6360aea-6f7d-4f4e-8b11-efda3d5358e7 tempest-AttachVolumeTestJSON-1651611701 tempest-AttachVolumeTestJSON-1651611701-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:27:14.660008 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-e6360aea-6f7d-4f4e-8b11-efda3d5358e7 tempest-AttachVolumeTestJSON-1651611701 tempest-AttachVolumeTestJSON-1651611701-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:27:14.661008 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-e6360aea-6f7d-4f4e-8b11-efda3d5358e7 tempest-AttachVolumeTestJSON-1651611701 tempest-AttachVolumeTestJSON-1651611701-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:27:14.661795 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-e6360aea-6f7d-4f4e-8b11-efda3d5358e7 tempest-AttachVolumeTestJSON-1651611701 tempest-AttachVolumeTestJSON-1651611701-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:27:14.844056 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-5ac0b74d-2b4d-49db-a3f5-5905119c7e6e tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] 10.222.0.11 "POST /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7/action" status: 200 len: 36827 microversion: 2.20 time: 0.234371 Nov 17 03:27:14.846053 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 213/446] 10.222.0.11 () {62 vars in 1318 bytes} [Wed Nov 17 03:27:14 2021] POST /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7/action => generated 36827 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 17 03:27:14.851759 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-eedbeeb6-48e2-4d9f-93c2-4d11c91af7e6 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:27:14.852458 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-eedbeeb6-48e2-4d9f-93c2-4d11c91af7e6 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] [instance: a49437df-3059-4528-8328-2f3471d5fb45] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:27:14.860014 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-eedbeeb6-48e2-4d9f-93c2-4d11c91af7e6 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:27:14.860863 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-eedbeeb6-48e2-4d9f-93c2-4d11c91af7e6 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:27:14.861668 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-eedbeeb6-48e2-4d9f-93c2-4d11c91af7e6 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:27:14.862118 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-eedbeeb6-48e2-4d9f-93c2-4d11c91af7e6 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:27:14.874791 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-e6360aea-6f7d-4f4e-8b11-efda3d5358e7 tempest-AttachVolumeTestJSON-1651611701 tempest-AttachVolumeTestJSON-1651611701-project] 10.222.0.11 "POST /compute/v2.1/servers/5e11ea9c-f66a-4962-b5ca-b95784624824/action" status: 200 len: 14 microversion: 2.1 time: 0.228816 Nov 17 03:27:14.875926 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 234/447] 10.222.0.11 () {60 vars in 1277 bytes} [Wed Nov 17 03:27:14 2021] POST /compute/v2.1/servers/5e11ea9c-f66a-4962-b5ca-b95784624824/action => generated 14 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Nov 17 03:27:15.031310 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-eedbeeb6-48e2-4d9f-93c2-4d11c91af7e6 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f046401c6a04f6495ebe0821120bd72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a58e89ceeea4a9c8a72a1de4bcaf2d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:27:15.045172 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-eedbeeb6-48e2-4d9f-93c2-4d11c91af7e6 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] 10.222.0.11 "GET /compute/v2.1/servers/a49437df-3059-4528-8328-2f3471d5fb45" status: 200 len: 1520 microversion: 2.1 time: 0.197448 Nov 17 03:27:15.045772 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 214/448] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:27:14 2021] GET /compute/v2.1/servers/a49437df-3059-4528-8328-2f3471d5fb45 => generated 1520 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:27:15.857139 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-93ce2e6f-7d24-4995-9044-6c2aacf157da tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 17 03:27:15.858154 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-93ce2e6f-7d24-4995-9044-6c2aacf157da tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] [instance: 5d54db85-b991-4890-abaa-952413baa2e7] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:27:15.866127 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-93ce2e6f-7d24-4995-9044-6c2aacf157da tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:27:15.866577 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-93ce2e6f-7d24-4995-9044-6c2aacf157da tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:27:15.867365 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-93ce2e6f-7d24-4995-9044-6c2aacf157da tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:27:15.867792 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-93ce2e6f-7d24-4995-9044-6c2aacf157da tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:27:15.887659 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-b902712a-dc7d-4c35-bd0c-6fd023b1c297 tempest-AttachVolumeTestJSON-1651611701 tempest-AttachVolumeTestJSON-1651611701-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 17 03:27:15.889222 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-b902712a-dc7d-4c35-bd0c-6fd023b1c297 tempest-AttachVolumeTestJSON-1651611701 tempest-AttachVolumeTestJSON-1651611701-project] [instance: 5e11ea9c-f66a-4962-b5ca-b95784624824] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:27:15.897423 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-b902712a-dc7d-4c35-bd0c-6fd023b1c297 tempest-AttachVolumeTestJSON-1651611701 tempest-AttachVolumeTestJSON-1651611701-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:27:15.898241 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-b902712a-dc7d-4c35-bd0c-6fd023b1c297 tempest-AttachVolumeTestJSON-1651611701 tempest-AttachVolumeTestJSON-1651611701-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:27:15.899288 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-b902712a-dc7d-4c35-bd0c-6fd023b1c297 tempest-AttachVolumeTestJSON-1651611701 tempest-AttachVolumeTestJSON-1651611701-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:27:15.901155 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-b902712a-dc7d-4c35-bd0c-6fd023b1c297 tempest-AttachVolumeTestJSON-1651611701 tempest-AttachVolumeTestJSON-1651611701-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:27:16.031424 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-93ce2e6f-7d24-4995-9044-6c2aacf157da tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] 10.222.0.11 "POST /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7/action" status: 200 len: 37631 microversion: 2.20 time: 0.178576 Nov 17 03:27:16.032087 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 235/449] 10.222.0.11 () {62 vars in 1318 bytes} [Wed Nov 17 03:27:15 2021] POST /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7/action => generated 37631 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 17 03:27:16.063658 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-36e326b5-899e-4187-8495-a90043cd9393 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:27:16.064399 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-36e326b5-899e-4187-8495-a90043cd9393 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] [instance: a49437df-3059-4528-8328-2f3471d5fb45] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:27:16.072044 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-36e326b5-899e-4187-8495-a90043cd9393 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:27:16.072555 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-36e326b5-899e-4187-8495-a90043cd9393 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:27:16.073632 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-36e326b5-899e-4187-8495-a90043cd9393 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:27:16.073841 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-b902712a-dc7d-4c35-bd0c-6fd023b1c297 tempest-AttachVolumeTestJSON-1651611701 tempest-AttachVolumeTestJSON-1651611701-project] 10.222.0.11 "POST /compute/v2.1/servers/5e11ea9c-f66a-4962-b5ca-b95784624824/action" status: 200 len: 14 microversion: 2.1 time: 0.189687 Nov 17 03:27:16.074721 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 215/450] 10.222.0.11 () {60 vars in 1277 bytes} [Wed Nov 17 03:27:15 2021] POST /compute/v2.1/servers/5e11ea9c-f66a-4962-b5ca-b95784624824/action => generated 14 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Nov 17 03:27:16.074978 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-36e326b5-899e-4187-8495-a90043cd9393 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:27:16.329681 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-36e326b5-899e-4187-8495-a90043cd9393 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f046401c6a04f6495ebe0821120bd72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a58e89ceeea4a9c8a72a1de4bcaf2d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:27:16.339293 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-36e326b5-899e-4187-8495-a90043cd9393 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] 10.222.0.11 "GET /compute/v2.1/servers/a49437df-3059-4528-8328-2f3471d5fb45" status: 200 len: 1520 microversion: 2.1 time: 0.279470 Nov 17 03:27:16.349484 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 236/451] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:27:16 2021] GET /compute/v2.1/servers/a49437df-3059-4528-8328-2f3471d5fb45 => generated 1520 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:27:17.044477 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-22925488-7fa2-4b27-80f6-412f274ccb3f tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 17 03:27:17.045819 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-22925488-7fa2-4b27-80f6-412f274ccb3f tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] [instance: 5d54db85-b991-4890-abaa-952413baa2e7] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:27:17.057680 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-22925488-7fa2-4b27-80f6-412f274ccb3f tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:27:17.058136 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-22925488-7fa2-4b27-80f6-412f274ccb3f tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:27:17.058935 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-22925488-7fa2-4b27-80f6-412f274ccb3f tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:27:17.059366 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-22925488-7fa2-4b27-80f6-412f274ccb3f tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:27:17.086721 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-17b0cc88-9ed6-4218-b232-deacc0af79fa tempest-AttachVolumeTestJSON-1651611701 tempest-AttachVolumeTestJSON-1651611701-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 17 03:27:17.089214 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-17b0cc88-9ed6-4218-b232-deacc0af79fa tempest-AttachVolumeTestJSON-1651611701 tempest-AttachVolumeTestJSON-1651611701-project] [instance: 5e11ea9c-f66a-4962-b5ca-b95784624824] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:27:17.096584 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-17b0cc88-9ed6-4218-b232-deacc0af79fa tempest-AttachVolumeTestJSON-1651611701 tempest-AttachVolumeTestJSON-1651611701-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:27:17.097275 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-17b0cc88-9ed6-4218-b232-deacc0af79fa tempest-AttachVolumeTestJSON-1651611701 tempest-AttachVolumeTestJSON-1651611701-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:27:17.098064 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-17b0cc88-9ed6-4218-b232-deacc0af79fa tempest-AttachVolumeTestJSON-1651611701 tempest-AttachVolumeTestJSON-1651611701-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:27:17.098626 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-17b0cc88-9ed6-4218-b232-deacc0af79fa tempest-AttachVolumeTestJSON-1651611701 tempest-AttachVolumeTestJSON-1651611701-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:27:17.216616 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-22925488-7fa2-4b27-80f6-412f274ccb3f tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] 10.222.0.11 "POST /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7/action" status: 200 len: 38106 microversion: 2.20 time: 0.176198 Nov 17 03:27:17.217347 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 216/452] 10.222.0.11 () {62 vars in 1318 bytes} [Wed Nov 17 03:27:17 2021] POST /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7/action => generated 38106 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 17 03:27:17.252335 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-17b0cc88-9ed6-4218-b232-deacc0af79fa tempest-AttachVolumeTestJSON-1651611701 tempest-AttachVolumeTestJSON-1651611701-project] 10.222.0.11 "POST /compute/v2.1/servers/5e11ea9c-f66a-4962-b5ca-b95784624824/action" status: 200 len: 14 microversion: 2.1 time: 0.170057 Nov 17 03:27:17.253339 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 237/453] 10.222.0.11 () {60 vars in 1277 bytes} [Wed Nov 17 03:27:17 2021] POST /compute/v2.1/servers/5e11ea9c-f66a-4962-b5ca-b95784624824/action => generated 14 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Nov 17 03:27:17.357038 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-85586f1f-1c3e-4177-bc28-45d454499345 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:27:17.357781 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-85586f1f-1c3e-4177-bc28-45d454499345 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] [instance: a49437df-3059-4528-8328-2f3471d5fb45] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:27:17.378570 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-85586f1f-1c3e-4177-bc28-45d454499345 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:27:17.379286 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-85586f1f-1c3e-4177-bc28-45d454499345 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:27:17.380315 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-85586f1f-1c3e-4177-bc28-45d454499345 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:27:17.381000 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-85586f1f-1c3e-4177-bc28-45d454499345 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:27:17.885551 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-85586f1f-1c3e-4177-bc28-45d454499345 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f046401c6a04f6495ebe0821120bd72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a58e89ceeea4a9c8a72a1de4bcaf2d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:27:17.894457 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-85586f1f-1c3e-4177-bc28-45d454499345 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] 10.222.0.11 "GET /compute/v2.1/servers/a49437df-3059-4528-8328-2f3471d5fb45" status: 200 len: 1520 microversion: 2.1 time: 0.541486 Nov 17 03:27:17.895361 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 217/454] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:27:17 2021] GET /compute/v2.1/servers/a49437df-3059-4528-8328-2f3471d5fb45 => generated 1520 bytes in 543 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:27:18.231090 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-f4131e9e-2dd1-4ce3-83b6-961c1f656787 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 17 03:27:18.233320 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-f4131e9e-2dd1-4ce3-83b6-961c1f656787 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] [instance: 5d54db85-b991-4890-abaa-952413baa2e7] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:27:18.242030 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-f4131e9e-2dd1-4ce3-83b6-961c1f656787 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:27:18.242550 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-f4131e9e-2dd1-4ce3-83b6-961c1f656787 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:27:18.243463 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-f4131e9e-2dd1-4ce3-83b6-961c1f656787 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:27:18.243908 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-f4131e9e-2dd1-4ce3-83b6-961c1f656787 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:27:18.263584 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-2a1cd6ab-7be4-4c01-bc2c-d9fee47ea82a tempest-AttachVolumeTestJSON-1651611701 tempest-AttachVolumeTestJSON-1651611701-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 17 03:27:18.264509 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-2a1cd6ab-7be4-4c01-bc2c-d9fee47ea82a tempest-AttachVolumeTestJSON-1651611701 tempest-AttachVolumeTestJSON-1651611701-project] [instance: 5e11ea9c-f66a-4962-b5ca-b95784624824] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:27:18.273095 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-2a1cd6ab-7be4-4c01-bc2c-d9fee47ea82a tempest-AttachVolumeTestJSON-1651611701 tempest-AttachVolumeTestJSON-1651611701-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:27:18.273537 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-2a1cd6ab-7be4-4c01-bc2c-d9fee47ea82a tempest-AttachVolumeTestJSON-1651611701 tempest-AttachVolumeTestJSON-1651611701-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:27:18.279273 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-2a1cd6ab-7be4-4c01-bc2c-d9fee47ea82a tempest-AttachVolumeTestJSON-1651611701 tempest-AttachVolumeTestJSON-1651611701-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:27:18.279808 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-2a1cd6ab-7be4-4c01-bc2c-d9fee47ea82a tempest-AttachVolumeTestJSON-1651611701 tempest-AttachVolumeTestJSON-1651611701-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:27:18.421833 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-f4131e9e-2dd1-4ce3-83b6-961c1f656787 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] 10.222.0.11 "POST /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7/action" status: 200 len: 38121 microversion: 2.20 time: 0.194337 Nov 17 03:27:18.422734 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 238/455] 10.222.0.11 () {62 vars in 1318 bytes} [Wed Nov 17 03:27:18 2021] POST /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7/action => generated 38121 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 17 03:27:18.453107 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-2a1cd6ab-7be4-4c01-bc2c-d9fee47ea82a tempest-AttachVolumeTestJSON-1651611701 tempest-AttachVolumeTestJSON-1651611701-project] 10.222.0.11 "POST /compute/v2.1/servers/5e11ea9c-f66a-4962-b5ca-b95784624824/action" status: 200 len: 2802 microversion: 2.1 time: 0.192987 Nov 17 03:27:18.453754 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 218/456] 10.222.0.11 () {60 vars in 1277 bytes} [Wed Nov 17 03:27:18 2021] POST /compute/v2.1/servers/5e11ea9c-f66a-4962-b5ca-b95784624824/action => generated 2802 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 17 03:27:18.915746 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-aeb8f4f5-b0f2-4b6e-990d-04516040573e tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:27:18.916847 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-aeb8f4f5-b0f2-4b6e-990d-04516040573e tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] [instance: a49437df-3059-4528-8328-2f3471d5fb45] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:27:18.927946 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-aeb8f4f5-b0f2-4b6e-990d-04516040573e tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:27:18.928424 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-aeb8f4f5-b0f2-4b6e-990d-04516040573e tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:27:18.929254 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-aeb8f4f5-b0f2-4b6e-990d-04516040573e tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:27:18.929690 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-aeb8f4f5-b0f2-4b6e-990d-04516040573e tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:27:19.085646 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-aeb8f4f5-b0f2-4b6e-990d-04516040573e tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f046401c6a04f6495ebe0821120bd72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a58e89ceeea4a9c8a72a1de4bcaf2d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:27:19.093540 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-aeb8f4f5-b0f2-4b6e-990d-04516040573e tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] 10.222.0.11 "GET /compute/v2.1/servers/a49437df-3059-4528-8328-2f3471d5fb45" status: 200 len: 1520 microversion: 2.1 time: 0.185175 Nov 17 03:27:19.094109 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 239/457] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:27:18 2021] GET /compute/v2.1/servers/a49437df-3059-4528-8328-2f3471d5fb45 => generated 1520 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:27:19.435601 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-49b76c3a-4692-4f5f-949c-a71baa5dbfcc tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 17 03:27:19.436528 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-49b76c3a-4692-4f5f-949c-a71baa5dbfcc tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] [instance: 5d54db85-b991-4890-abaa-952413baa2e7] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:27:19.447969 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-49b76c3a-4692-4f5f-949c-a71baa5dbfcc tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:27:19.448420 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-49b76c3a-4692-4f5f-949c-a71baa5dbfcc tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:27:19.449263 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-49b76c3a-4692-4f5f-949c-a71baa5dbfcc tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:27:19.449686 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-49b76c3a-4692-4f5f-949c-a71baa5dbfcc tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:27:19.464143 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-55fd42af-5963-4772-8df4-10a210c6ebd7 tempest-AttachVolumeTestJSON-1651611701 tempest-AttachVolumeTestJSON-1651611701-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 17 03:27:19.465331 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-55fd42af-5963-4772-8df4-10a210c6ebd7 tempest-AttachVolumeTestJSON-1651611701 tempest-AttachVolumeTestJSON-1651611701-project] [instance: 5e11ea9c-f66a-4962-b5ca-b95784624824] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:27:19.473475 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-55fd42af-5963-4772-8df4-10a210c6ebd7 tempest-AttachVolumeTestJSON-1651611701 tempest-AttachVolumeTestJSON-1651611701-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:27:19.474444 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-55fd42af-5963-4772-8df4-10a210c6ebd7 tempest-AttachVolumeTestJSON-1651611701 tempest-AttachVolumeTestJSON-1651611701-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:27:19.475439 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-55fd42af-5963-4772-8df4-10a210c6ebd7 tempest-AttachVolumeTestJSON-1651611701 tempest-AttachVolumeTestJSON-1651611701-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:27:19.476072 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-55fd42af-5963-4772-8df4-10a210c6ebd7 tempest-AttachVolumeTestJSON-1651611701 tempest-AttachVolumeTestJSON-1651611701-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:27:19.600051 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-49b76c3a-4692-4f5f-949c-a71baa5dbfcc tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] 10.222.0.11 "POST /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7/action" status: 200 len: 38249 microversion: 2.20 time: 0.168872 Nov 17 03:27:19.601080 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 219/458] 10.222.0.11 () {62 vars in 1318 bytes} [Wed Nov 17 03:27:19 2021] POST /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7/action => generated 38249 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 17 03:27:19.616622 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-ed606d61-e9a1-4f15-9370-b55d29344c45 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:27:19.619170 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-ed606d61-e9a1-4f15-9370-b55d29344c45 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] [instance: 5d54db85-b991-4890-abaa-952413baa2e7] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:27:19.629013 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-ed606d61-e9a1-4f15-9370-b55d29344c45 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:27:19.629671 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-ed606d61-e9a1-4f15-9370-b55d29344c45 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:27:19.630446 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-ed606d61-e9a1-4f15-9370-b55d29344c45 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:27:19.630858 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-ed606d61-e9a1-4f15-9370-b55d29344c45 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:27:19.639716 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-55fd42af-5963-4772-8df4-10a210c6ebd7 tempest-AttachVolumeTestJSON-1651611701 tempest-AttachVolumeTestJSON-1651611701-project] 10.222.0.11 "POST /compute/v2.1/servers/5e11ea9c-f66a-4962-b5ca-b95784624824/action" status: 200 len: 10580 microversion: 2.1 time: 0.179792 Nov 17 03:27:19.641938 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 240/459] 10.222.0.11 () {60 vars in 1277 bytes} [Wed Nov 17 03:27:19 2021] POST /compute/v2.1/servers/5e11ea9c-f66a-4962-b5ca-b95784624824/action => generated 10580 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 17 03:27:19.662130 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-ed606d61-e9a1-4f15-9370-b55d29344c45 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] 10.222.0.11 "GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7/ips" status: 200 len: 153 microversion: 2.20 time: 0.052228 Nov 17 03:27:19.662717 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 220/460] 10.222.0.11 () {60 vars in 1288 bytes} [Wed Nov 17 03:27:19 2021] GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7/ips => generated 153 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 17 03:27:20.111729 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-30e337c7-881b-4f39-a193-e997d8772701 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:27:20.112425 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-30e337c7-881b-4f39-a193-e997d8772701 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] [instance: a49437df-3059-4528-8328-2f3471d5fb45] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:27:20.121866 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-30e337c7-881b-4f39-a193-e997d8772701 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:27:20.125484 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-30e337c7-881b-4f39-a193-e997d8772701 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:27:20.126474 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-30e337c7-881b-4f39-a193-e997d8772701 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:27:20.127068 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-30e337c7-881b-4f39-a193-e997d8772701 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:27:20.289179 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-30e337c7-881b-4f39-a193-e997d8772701 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f046401c6a04f6495ebe0821120bd72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a58e89ceeea4a9c8a72a1de4bcaf2d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:27:20.296736 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-30e337c7-881b-4f39-a193-e997d8772701 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] 10.222.0.11 "GET /compute/v2.1/servers/a49437df-3059-4528-8328-2f3471d5fb45" status: 200 len: 1520 microversion: 2.1 time: 0.189454 Nov 17 03:27:20.297660 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 241/461] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:27:20 2021] GET /compute/v2.1/servers/a49437df-3059-4528-8328-2f3471d5fb45 => generated 1520 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:27:20.652266 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-d971ff9f-31e5-4d63-945b-02a0c208331f tempest-AttachVolumeTestJSON-1651611701 tempest-AttachVolumeTestJSON-1651611701-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 17 03:27:20.653798 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-d971ff9f-31e5-4d63-945b-02a0c208331f tempest-AttachVolumeTestJSON-1651611701 tempest-AttachVolumeTestJSON-1651611701-project] [instance: 5e11ea9c-f66a-4962-b5ca-b95784624824] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:27:20.660522 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-d971ff9f-31e5-4d63-945b-02a0c208331f tempest-AttachVolumeTestJSON-1651611701 tempest-AttachVolumeTestJSON-1651611701-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:27:20.661373 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-d971ff9f-31e5-4d63-945b-02a0c208331f tempest-AttachVolumeTestJSON-1651611701 tempest-AttachVolumeTestJSON-1651611701-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:27:20.662400 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-d971ff9f-31e5-4d63-945b-02a0c208331f tempest-AttachVolumeTestJSON-1651611701 tempest-AttachVolumeTestJSON-1651611701-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:27:20.663046 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-d971ff9f-31e5-4d63-945b-02a0c208331f tempest-AttachVolumeTestJSON-1651611701 tempest-AttachVolumeTestJSON-1651611701-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:27:20.785442 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-d971ff9f-31e5-4d63-945b-02a0c208331f tempest-AttachVolumeTestJSON-1651611701 tempest-AttachVolumeTestJSON-1651611701-project] 10.222.0.11 "POST /compute/v2.1/servers/5e11ea9c-f66a-4962-b5ca-b95784624824/action" status: 200 len: 15064 microversion: 2.1 time: 0.136477 Nov 17 03:27:20.790100 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 221/462] 10.222.0.11 () {60 vars in 1277 bytes} [Wed Nov 17 03:27:20 2021] POST /compute/v2.1/servers/5e11ea9c-f66a-4962-b5ca-b95784624824/action => generated 15064 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 17 03:27:21.327199 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-e5851220-4cb7-4a62-accf-ec1f2309ce3d tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:27:21.329315 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-e5851220-4cb7-4a62-accf-ec1f2309ce3d tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] [instance: a49437df-3059-4528-8328-2f3471d5fb45] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:27:21.347567 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-e5851220-4cb7-4a62-accf-ec1f2309ce3d tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:27:21.348164 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-e5851220-4cb7-4a62-accf-ec1f2309ce3d tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:27:21.348887 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-e5851220-4cb7-4a62-accf-ec1f2309ce3d tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:27:21.349600 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-e5851220-4cb7-4a62-accf-ec1f2309ce3d tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:27:21.587364 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-e5851220-4cb7-4a62-accf-ec1f2309ce3d tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f046401c6a04f6495ebe0821120bd72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a58e89ceeea4a9c8a72a1de4bcaf2d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:27:21.609607 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-e5851220-4cb7-4a62-accf-ec1f2309ce3d tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] 10.222.0.11 "GET /compute/v2.1/servers/a49437df-3059-4528-8328-2f3471d5fb45" status: 200 len: 1520 microversion: 2.1 time: 0.298168 Nov 17 03:27:21.621517 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 242/463] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:27:21 2021] GET /compute/v2.1/servers/a49437df-3059-4528-8328-2f3471d5fb45 => generated 1520 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:27:21.799038 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-28705654-b88c-4d31-8637-ba88d5dd10be tempest-AttachVolumeTestJSON-1651611701 tempest-AttachVolumeTestJSON-1651611701-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 17 03:27:21.800101 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-28705654-b88c-4d31-8637-ba88d5dd10be tempest-AttachVolumeTestJSON-1651611701 tempest-AttachVolumeTestJSON-1651611701-project] [instance: 5e11ea9c-f66a-4962-b5ca-b95784624824] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:27:21.812844 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-28705654-b88c-4d31-8637-ba88d5dd10be tempest-AttachVolumeTestJSON-1651611701 tempest-AttachVolumeTestJSON-1651611701-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:27:21.814490 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-28705654-b88c-4d31-8637-ba88d5dd10be tempest-AttachVolumeTestJSON-1651611701 tempest-AttachVolumeTestJSON-1651611701-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:27:21.815686 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-28705654-b88c-4d31-8637-ba88d5dd10be tempest-AttachVolumeTestJSON-1651611701 tempest-AttachVolumeTestJSON-1651611701-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:27:21.816136 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-28705654-b88c-4d31-8637-ba88d5dd10be tempest-AttachVolumeTestJSON-1651611701 tempest-AttachVolumeTestJSON-1651611701-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:27:21.974184 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-28705654-b88c-4d31-8637-ba88d5dd10be tempest-AttachVolumeTestJSON-1651611701 tempest-AttachVolumeTestJSON-1651611701-project] 10.222.0.11 "POST /compute/v2.1/servers/5e11ea9c-f66a-4962-b5ca-b95784624824/action" status: 200 len: 17808 microversion: 2.1 time: 0.179404 Nov 17 03:27:21.976050 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 222/464] 10.222.0.11 () {60 vars in 1277 bytes} [Wed Nov 17 03:27:21 2021] POST /compute/v2.1/servers/5e11ea9c-f66a-4962-b5ca-b95784624824/action => generated 17808 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 17 03:27:22.357295 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-70fb0e53-6fbf-4248-ae90-0375cef73d06 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 17 03:27:22.357840 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-70fb0e53-6fbf-4248-ae90-0375cef73d06 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] [instance: 5d54db85-b991-4890-abaa-952413baa2e7] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:27:22.368506 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-70fb0e53-6fbf-4248-ae90-0375cef73d06 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:27:22.371417 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-70fb0e53-6fbf-4248-ae90-0375cef73d06 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:27:22.374596 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-70fb0e53-6fbf-4248-ae90-0375cef73d06 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:27:22.375384 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-70fb0e53-6fbf-4248-ae90-0375cef73d06 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:27:22.500140 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.objects.instance [None req-70fb0e53-6fbf-4248-ae90-0375cef73d06 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lazy-loading 'flavor' on Instance uuid 5d54db85-b991-4890-abaa-952413baa2e7 {{(pid=115917) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Nov 17 03:27:22.630799 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-af707fa5-a5f5-4d37-a82f-a4e03cc62d70 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:27:22.632010 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-af707fa5-a5f5-4d37-a82f-a4e03cc62d70 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] [instance: a49437df-3059-4528-8328-2f3471d5fb45] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:27:22.648202 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-af707fa5-a5f5-4d37-a82f-a4e03cc62d70 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:27:22.650982 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-af707fa5-a5f5-4d37-a82f-a4e03cc62d70 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:27:22.651880 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-af707fa5-a5f5-4d37-a82f-a4e03cc62d70 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:27:22.656367 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-af707fa5-a5f5-4d37-a82f-a4e03cc62d70 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:27:22.917975 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-70fb0e53-6fbf-4248-ae90-0375cef73d06 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] 10.222.0.11 "POST /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7/action" status: 202 len: 0 microversion: 2.20 time: 0.564563 Nov 17 03:27:22.919765 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 243/465] 10.222.0.11 () {62 vars in 1318 bytes} [Wed Nov 17 03:27:22 2021] POST /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7/action => generated 0 bytes in 567 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Nov 17 03:27:22.935735 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-d64e3609-bbd2-4606-be07-f3e0b9a334fe tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1214030447", "imageRef": "7281a37a-6b99-49c1-881a-41604d06bae1", "flavorRef": "452", "networks": [{"uuid": "eb5a5499-be89-4de3-a9a9-0707395984da"}]}} {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 17 03:27:23.029646 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.network.neutron [None req-d64e3609-bbd2-4606-be07-f3e0b9a334fe tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] validate_networks() for [('eb5a5499-be89-4de3-a9a9-0707395984da', None, None, None, None, None)] {{(pid=115917) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Nov 17 03:27:23.314526 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-af707fa5-a5f5-4d37-a82f-a4e03cc62d70 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f046401c6a04f6495ebe0821120bd72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a58e89ceeea4a9c8a72a1de4bcaf2d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:27:23.330521 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-af707fa5-a5f5-4d37-a82f-a4e03cc62d70 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] 10.222.0.11 "GET /compute/v2.1/servers/a49437df-3059-4528-8328-2f3471d5fb45" status: 200 len: 1520 microversion: 2.1 time: 0.706250 Nov 17 03:27:23.341220 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 223/466] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:27:22 2021] GET /compute/v2.1/servers/a49437df-3059-4528-8328-2f3471d5fb45 => generated 1520 bytes in 718 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:27:23.346293 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-6b64db89-6bc1-4873-8404-a5ca44c372d5 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:27:23.346906 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-6b64db89-6bc1-4873-8404-a5ca44c372d5 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] [instance: 5d54db85-b991-4890-abaa-952413baa2e7] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:27:23.361239 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-6b64db89-6bc1-4873-8404-a5ca44c372d5 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:27:23.361708 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-6b64db89-6bc1-4873-8404-a5ca44c372d5 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:27:23.362556 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-6b64db89-6bc1-4873-8404-a5ca44c372d5 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:27:23.362988 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-6b64db89-6bc1-4873-8404-a5ca44c372d5 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:27:23.713769 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.virt.hardware [None req-d64e3609-bbd2-4606-be07-f3e0b9a334fe tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Flavor limits 0:0:0 {{(pid=115917) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 17 03:27:23.714847 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.virt.hardware [None req-d64e3609-bbd2-4606-be07-f3e0b9a334fe tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Image limits 0:0:0 {{(pid=115917) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 17 03:27:23.715492 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.virt.hardware [None req-d64e3609-bbd2-4606-be07-f3e0b9a334fe tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Flavor pref 0:0:0 {{(pid=115917) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 17 03:27:23.716073 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.virt.hardware [None req-d64e3609-bbd2-4606-be07-f3e0b9a334fe tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Image pref 0:0:0 {{(pid=115917) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 17 03:27:23.716654 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.virt.hardware [None req-d64e3609-bbd2-4606-be07-f3e0b9a334fe tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=115917) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 17 03:27:23.727626 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-d64e3609-bbd2-4606-be07-f3e0b9a334fe tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:27:23.728065 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-d64e3609-bbd2-4606-be07-f3e0b9a334fe tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:27:23.729103 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-d64e3609-bbd2-4606-be07-f3e0b9a334fe tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:27:23.729698 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-d64e3609-bbd2-4606-be07-f3e0b9a334fe tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:27:23.750178 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.quota [None req-d64e3609-bbd2-4606-be07-f3e0b9a334fe tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Getting quotas for project 1e843a3fb49f41dcb376184d7e156528. Resources: {'instances', 'ram', 'cores'} {{(pid=115917) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 17 03:27:23.756892 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.quota [None req-d64e3609-bbd2-4606-be07-f3e0b9a334fe tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Getting quotas for user a792b5b7e6f7461b8d802a5abaaa9518 and project 1e843a3fb49f41dcb376184d7e156528. Resources: {'instances', 'ram', 'cores'} {{(pid=115917) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 17 03:27:23.773166 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-d64e3609-bbd2-4606-be07-f3e0b9a334fe tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Going to run 1 instances... {{(pid=115917) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 17 03:27:23.775996 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-d64e3609-bbd2-4606-be07-f3e0b9a334fe tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] [instance: 15abb40f-daf9-4c4b-ac9c-55f57ee7b938] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='7281a37a-6b99-49c1-881a-41604d06bae1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=115917) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 17 03:27:23.869184 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-d64e3609-bbd2-4606-be07-f3e0b9a334fe tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] 10.222.0.11 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.946845 Nov 17 03:27:23.869854 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 244/467] 10.222.0.11 () {60 vars in 1146 bytes} [Wed Nov 17 03:27:22 2021] POST /compute/v2.1/servers => generated 380 bytes in 949 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 17 03:27:23.877762 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-1a699802-c0e3-4816-8fa1-035afa1f367e tempest-AttachVolumeTestJSON-1651611701 tempest-AttachVolumeTestJSON-1651611701-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 17 03:27:23.886229 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-1a699802-c0e3-4816-8fa1-035afa1f367e tempest-AttachVolumeTestJSON-1651611701 tempest-AttachVolumeTestJSON-1651611701-project] [instance: 5e11ea9c-f66a-4962-b5ca-b95784624824] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:27:23.893285 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-6b64db89-6bc1-4873-8404-a5ca44c372d5 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37f21d6d15cf40a586edda211219fd08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ebb970305844dccacf48a7d8d47ecf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:27:23.898128 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-1a699802-c0e3-4816-8fa1-035afa1f367e tempest-AttachVolumeTestJSON-1651611701 tempest-AttachVolumeTestJSON-1651611701-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:27:23.899080 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-1a699802-c0e3-4816-8fa1-035afa1f367e tempest-AttachVolumeTestJSON-1651611701 tempest-AttachVolumeTestJSON-1651611701-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:27:23.900628 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-1a699802-c0e3-4816-8fa1-035afa1f367e tempest-AttachVolumeTestJSON-1651611701 tempest-AttachVolumeTestJSON-1651611701-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:27:23.901567 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-1a699802-c0e3-4816-8fa1-035afa1f367e tempest-AttachVolumeTestJSON-1651611701 tempest-AttachVolumeTestJSON-1651611701-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:27:23.920135 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-6b64db89-6bc1-4873-8404-a5ca44c372d5 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '37f21d6d15cf40a586edda211219fd08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ebb970305844dccacf48a7d8d47ecf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:27:23.927619 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-6b64db89-6bc1-4873-8404-a5ca44c372d5 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '37f21d6d15cf40a586edda211219fd08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ebb970305844dccacf48a7d8d47ecf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:27:23.935926 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-6b64db89-6bc1-4873-8404-a5ca44c372d5 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] 10.222.0.11 "GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7" status: 200 len: 1725 microversion: 2.20 time: 0.593511 Nov 17 03:27:23.945358 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 224/468] 10.222.0.11 () {60 vars in 1276 bytes} [Wed Nov 17 03:27:23 2021] GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7 => generated 1725 bytes in 603 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 17 03:27:23.957619 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-5e1a399f-633d-4471-9b25-9927f2b29cc7 tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "dc1876d7-2eae-4f53-a8fb-b8ed689cd7c6"}} {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 17 03:27:23.958711 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-5e1a399f-633d-4471-9b25-9927f2b29cc7 tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] [instance: 5c1643c5-72d3-4676-85e6-84c5f245c517] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:27:23.977752 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-5e1a399f-633d-4471-9b25-9927f2b29cc7 tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:27:23.978301 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-5e1a399f-633d-4471-9b25-9927f2b29cc7 tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:27:23.980617 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-5e1a399f-633d-4471-9b25-9927f2b29cc7 tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:27:23.981315 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-5e1a399f-633d-4471-9b25-9927f2b29cc7 tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:27:24.042086 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-1a699802-c0e3-4816-8fa1-035afa1f367e tempest-AttachVolumeTestJSON-1651611701 tempest-AttachVolumeTestJSON-1651611701-project] 10.222.0.11 "POST /compute/v2.1/servers/5e11ea9c-f66a-4962-b5ca-b95784624824/action" status: 200 len: 19342 microversion: 2.1 time: 0.167454 Nov 17 03:27:24.042749 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 245/469] 10.222.0.11 () {60 vars in 1277 bytes} [Wed Nov 17 03:27:23 2021] POST /compute/v2.1/servers/5e11ea9c-f66a-4962-b5ca-b95784624824/action => generated 19342 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 17 03:27:24.048875 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-bffa34d2-f5d7-4a22-8949-b46ebbcaad40 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:27:24.051333 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-bffa34d2-f5d7-4a22-8949-b46ebbcaad40 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] [instance: 15abb40f-daf9-4c4b-ac9c-55f57ee7b938] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:27:24.163874 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-bffa34d2-f5d7-4a22-8949-b46ebbcaad40 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a792b5b7e6f7461b8d802a5abaaa9518', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e843a3fb49f41dcb376184d7e156528', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:27:24.164253 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.wsgi [None req-5e1a399f-633d-4471-9b25-9927f2b29cc7 tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] HTTP exception thrown: Invalid volume: volume dc1876d7-2eae-4f53-a8fb-b8ed689cd7c6 is already attached to instances: 5c1643c5-72d3-4676-85e6-84c5f245c517 Nov 17 03:27:24.165304 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-5e1a399f-633d-4471-9b25-9927f2b29cc7 tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] Returning 400 to user: Invalid volume: volume dc1876d7-2eae-4f53-a8fb-b8ed689cd7c6 is already attached to instances: 5c1643c5-72d3-4676-85e6-84c5f245c517 {{(pid=115916) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 17 03:27:24.167743 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-5e1a399f-633d-4471-9b25-9927f2b29cc7 tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] 10.222.0.11 "POST /compute/v2.1/servers/5c1643c5-72d3-4676-85e6-84c5f245c517/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.220555 Nov 17 03:27:24.168959 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 225/470] 10.222.0.11 () {60 vars in 1322 bytes} [Wed Nov 17 03:27:23 2021] POST /compute/v2.1/servers/5c1643c5-72d3-4676-85e6-84c5f245c517/os-volume_attachments => generated 174 bytes in 222 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Nov 17 03:27:24.186476 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-bffa34d2-f5d7-4a22-8949-b46ebbcaad40 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] 10.222.0.11 "GET /compute/v2.1/servers/15abb40f-daf9-4c4b-ac9c-55f57ee7b938" status: 200 len: 1219 microversion: 2.1 time: 0.142312 Nov 17 03:27:24.187148 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 246/471] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:27:24 2021] GET /compute/v2.1/servers/15abb40f-daf9-4c4b-ac9c-55f57ee7b938 => generated 1219 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:27:24.244674 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-5fc9bebc-0254-4c04-8b5f-de9b5045ce48 tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:27:24.245201 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-5fc9bebc-0254-4c04-8b5f-de9b5045ce48 tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] [instance: 5c1643c5-72d3-4676-85e6-84c5f245c517] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:27:24.251978 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-5fc9bebc-0254-4c04-8b5f-de9b5045ce48 tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:27:24.252809 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-5fc9bebc-0254-4c04-8b5f-de9b5045ce48 tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:27:24.253796 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-5fc9bebc-0254-4c04-8b5f-de9b5045ce48 tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:27:24.263453 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-5fc9bebc-0254-4c04-8b5f-de9b5045ce48 tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:27:24.347700 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-2e944759-97aa-4424-8ea6-dc95990d1cd3 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:27:24.351369 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-2e944759-97aa-4424-8ea6-dc95990d1cd3 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] [instance: a49437df-3059-4528-8328-2f3471d5fb45] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:27:24.374386 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-2e944759-97aa-4424-8ea6-dc95990d1cd3 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:27:24.375187 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-2e944759-97aa-4424-8ea6-dc95990d1cd3 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:27:24.378269 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-2e944759-97aa-4424-8ea6-dc95990d1cd3 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:27:24.378965 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-2e944759-97aa-4424-8ea6-dc95990d1cd3 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:27:24.436599 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.objects.instance [None req-5fc9bebc-0254-4c04-8b5f-de9b5045ce48 tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] Lazy-loading 'services' on Instance uuid 5c1643c5-72d3-4676-85e6-84c5f245c517 {{(pid=115916) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Nov 17 03:27:24.606500 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-5fc9bebc-0254-4c04-8b5f-de9b5045ce48 tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] 10.222.0.11 "DELETE /compute/v2.1/servers/5c1643c5-72d3-4676-85e6-84c5f245c517/os-volume_attachments/dc1876d7-2eae-4f53-a8fb-b8ed689cd7c6" status: 202 len: 0 microversion: 2.1 time: 0.366488 Nov 17 03:27:24.607663 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 226/472] 10.222.0.11 () {58 vars in 1415 bytes} [Wed Nov 17 03:27:24 2021] DELETE /compute/v2.1/servers/5c1643c5-72d3-4676-85e6-84c5f245c517/os-volume_attachments/dc1876d7-2eae-4f53-a8fb-b8ed689cd7c6 => generated 0 bytes in 368 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 17 03:27:24.618876 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-9707ef47-d07d-4a85-94ba-8791bda0b7bd tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:27:24.623128 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-2e944759-97aa-4424-8ea6-dc95990d1cd3 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f046401c6a04f6495ebe0821120bd72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a58e89ceeea4a9c8a72a1de4bcaf2d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:27:24.635289 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-9707ef47-d07d-4a85-94ba-8791bda0b7bd tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] [instance: 5c1643c5-72d3-4676-85e6-84c5f245c517] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:27:24.635466 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-2e944759-97aa-4424-8ea6-dc95990d1cd3 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] 10.222.0.11 "GET /compute/v2.1/servers/a49437df-3059-4528-8328-2f3471d5fb45" status: 200 len: 1520 microversion: 2.1 time: 0.291668 Nov 17 03:27:24.636464 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 247/473] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:27:24 2021] GET /compute/v2.1/servers/a49437df-3059-4528-8328-2f3471d5fb45 => generated 1520 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:27:24.647114 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-9707ef47-d07d-4a85-94ba-8791bda0b7bd tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:27:24.647574 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-9707ef47-d07d-4a85-94ba-8791bda0b7bd tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:27:24.648434 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-9707ef47-d07d-4a85-94ba-8791bda0b7bd tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:27:24.660876 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-9707ef47-d07d-4a85-94ba-8791bda0b7bd tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:27:24.750821 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-9707ef47-d07d-4a85-94ba-8791bda0b7bd tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] 10.222.0.11 "GET /compute/v2.1/servers/5c1643c5-72d3-4676-85e6-84c5f245c517/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.138703 Nov 17 03:27:24.751640 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 227/474] 10.222.0.11 () {58 vars in 1301 bytes} [Wed Nov 17 03:27:24 2021] GET /compute/v2.1/servers/5c1643c5-72d3-4676-85e6-84c5f245c517/os-volume_attachments => generated 197 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 17 03:27:24.956345 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-238d11ff-e763-41b2-82b6-4c084c35b83d tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:27:24.958709 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-238d11ff-e763-41b2-82b6-4c084c35b83d tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] [instance: 5d54db85-b991-4890-abaa-952413baa2e7] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:27:24.967533 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-238d11ff-e763-41b2-82b6-4c084c35b83d tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:27:24.968057 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-238d11ff-e763-41b2-82b6-4c084c35b83d tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:27:24.969552 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-238d11ff-e763-41b2-82b6-4c084c35b83d tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:27:24.970342 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-238d11ff-e763-41b2-82b6-4c084c35b83d tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:27:25.059498 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-04aba2c0-0f6e-42c6-9024-39a2bdebe7a6 tempest-AttachVolumeTestJSON-1651611701 tempest-AttachVolumeTestJSON-1651611701-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 17 03:27:25.060767 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-04aba2c0-0f6e-42c6-9024-39a2bdebe7a6 tempest-AttachVolumeTestJSON-1651611701 tempest-AttachVolumeTestJSON-1651611701-project] [instance: 5e11ea9c-f66a-4962-b5ca-b95784624824] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:27:25.076990 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-04aba2c0-0f6e-42c6-9024-39a2bdebe7a6 tempest-AttachVolumeTestJSON-1651611701 tempest-AttachVolumeTestJSON-1651611701-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:27:25.092309 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-04aba2c0-0f6e-42c6-9024-39a2bdebe7a6 tempest-AttachVolumeTestJSON-1651611701 tempest-AttachVolumeTestJSON-1651611701-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:27:25.094428 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-04aba2c0-0f6e-42c6-9024-39a2bdebe7a6 tempest-AttachVolumeTestJSON-1651611701 tempest-AttachVolumeTestJSON-1651611701-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:27:25.095190 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-04aba2c0-0f6e-42c6-9024-39a2bdebe7a6 tempest-AttachVolumeTestJSON-1651611701 tempest-AttachVolumeTestJSON-1651611701-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:27:25.223212 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-238d11ff-e763-41b2-82b6-4c084c35b83d tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37f21d6d15cf40a586edda211219fd08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ebb970305844dccacf48a7d8d47ecf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:27:25.234314 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-238d11ff-e763-41b2-82b6-4c084c35b83d tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '37f21d6d15cf40a586edda211219fd08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ebb970305844dccacf48a7d8d47ecf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:27:25.236366 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-238d11ff-e763-41b2-82b6-4c084c35b83d tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '37f21d6d15cf40a586edda211219fd08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ebb970305844dccacf48a7d8d47ecf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:27:25.237826 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-238d11ff-e763-41b2-82b6-4c084c35b83d tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] 10.222.0.11 "GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7" status: 200 len: 1725 microversion: 2.20 time: 0.285876 Nov 17 03:27:25.238559 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 248/475] 10.222.0.11 () {60 vars in 1276 bytes} [Wed Nov 17 03:27:24 2021] GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7 => generated 1725 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 17 03:27:25.243395 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-5fd0d81d-c6f3-4ce7-9a48-f992d8ff21f9 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:27:25.247497 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-5fd0d81d-c6f3-4ce7-9a48-f992d8ff21f9 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] [instance: 15abb40f-daf9-4c4b-ac9c-55f57ee7b938] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:27:25.256660 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-04aba2c0-0f6e-42c6-9024-39a2bdebe7a6 tempest-AttachVolumeTestJSON-1651611701 tempest-AttachVolumeTestJSON-1651611701-project] 10.222.0.11 "POST /compute/v2.1/servers/5e11ea9c-f66a-4962-b5ca-b95784624824/action" status: 200 len: 21674 microversion: 2.1 time: 0.203823 Nov 17 03:27:25.257359 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 228/476] 10.222.0.11 () {60 vars in 1277 bytes} [Wed Nov 17 03:27:25 2021] POST /compute/v2.1/servers/5e11ea9c-f66a-4962-b5ca-b95784624824/action => generated 21674 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 17 03:27:25.266114 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-5fd0d81d-c6f3-4ce7-9a48-f992d8ff21f9 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:27:25.266959 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-5fd0d81d-c6f3-4ce7-9a48-f992d8ff21f9 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:27:25.268094 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-5fd0d81d-c6f3-4ce7-9a48-f992d8ff21f9 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:27:25.268717 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-5fd0d81d-c6f3-4ce7-9a48-f992d8ff21f9 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:27:25.355546 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-5fd0d81d-c6f3-4ce7-9a48-f992d8ff21f9 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a792b5b7e6f7461b8d802a5abaaa9518', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e843a3fb49f41dcb376184d7e156528', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:27:25.370184 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-5fd0d81d-c6f3-4ce7-9a48-f992d8ff21f9 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] 10.222.0.11 "GET /compute/v2.1/servers/15abb40f-daf9-4c4b-ac9c-55f57ee7b938" status: 200 len: 1271 microversion: 2.1 time: 0.130223 Nov 17 03:27:25.370900 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 249/477] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:27:25 2021] GET /compute/v2.1/servers/15abb40f-daf9-4c4b-ac9c-55f57ee7b938 => generated 1271 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:27:25.657156 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-8276d5d0-632c-4ca8-866b-b9b21d5cdfe8 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:27:25.659137 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-5619d614-51dd-482a-98ea-018bdd204b21 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-2028430980", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1852819525", "security_groups": [{"name": "tempest-secgroup-smoke-452160600"}], "block_device_mapping_v2": [{"uuid": "c7d136c8-3afa-4749-8af3-1d5b3ca59362", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "f987b928-dbac-48be-83bf-5684912ec42e"}]}} {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 17 03:27:25.660390 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-8276d5d0-632c-4ca8-866b-b9b21d5cdfe8 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] [instance: a49437df-3059-4528-8328-2f3471d5fb45] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:27:25.676052 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-8276d5d0-632c-4ca8-866b-b9b21d5cdfe8 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:27:25.678311 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-8276d5d0-632c-4ca8-866b-b9b21d5cdfe8 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:27:25.681222 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-8276d5d0-632c-4ca8-866b-b9b21d5cdfe8 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:27:25.682266 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-8276d5d0-632c-4ca8-866b-b9b21d5cdfe8 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:27:25.858661 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.network.neutron [None req-5619d614-51dd-482a-98ea-018bdd204b21 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] validate_networks() for [('f987b928-dbac-48be-83bf-5684912ec42e', None, None, None, None, None)] {{(pid=115916) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Nov 17 03:27:26.100022 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-8276d5d0-632c-4ca8-866b-b9b21d5cdfe8 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f046401c6a04f6495ebe0821120bd72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a58e89ceeea4a9c8a72a1de4bcaf2d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:27:26.113646 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-8276d5d0-632c-4ca8-866b-b9b21d5cdfe8 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] 10.222.0.11 "GET /compute/v2.1/servers/a49437df-3059-4528-8328-2f3471d5fb45" status: 200 len: 1520 microversion: 2.1 time: 0.464016 Nov 17 03:27:26.126013 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 250/478] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:27:25 2021] GET /compute/v2.1/servers/a49437df-3059-4528-8328-2f3471d5fb45 => generated 1520 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:27:26.154737 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-b6d02bce-cdeb-4f0c-b3cf-ed17bb20e1a9 tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:27:26.157789 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-b6d02bce-cdeb-4f0c-b3cf-ed17bb20e1a9 tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] [instance: 5c1643c5-72d3-4676-85e6-84c5f245c517] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:27:26.177517 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-b6d02bce-cdeb-4f0c-b3cf-ed17bb20e1a9 tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:27:26.182379 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-b6d02bce-cdeb-4f0c-b3cf-ed17bb20e1a9 tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:27:26.193195 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-b6d02bce-cdeb-4f0c-b3cf-ed17bb20e1a9 tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:27:26.193662 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-b6d02bce-cdeb-4f0c-b3cf-ed17bb20e1a9 tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:27:26.243854 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-b6d02bce-cdeb-4f0c-b3cf-ed17bb20e1a9 tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] 10.222.0.11 "GET /compute/v2.1/servers/5c1643c5-72d3-4676-85e6-84c5f245c517/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.115926 Nov 17 03:27:26.250033 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 251/479] 10.222.0.11 () {58 vars in 1301 bytes} [Wed Nov 17 03:27:26 2021] GET /compute/v2.1/servers/5c1643c5-72d3-4676-85e6-84c5f245c517/os-volume_attachments => generated 25 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 17 03:27:26.518470 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-1d27bfd0-2e9e-46e6-8983-1b0df558007f tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Action: 'create', calling method: .version_select at 0x7f9e1da630d0>, body: {"keypair": {"name": "tempest-TestShelveInstance-1227147341"}} {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 17 03:27:26.537718 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.quota [None req-1d27bfd0-2e9e-46e6-8983-1b0df558007f tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Getting quotas for project 1e123e9b86124c93a7fc2db9984e7466. Resources: {'key_pairs'} {{(pid=115917) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 17 03:27:26.541486 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.quota [None req-1d27bfd0-2e9e-46e6-8983-1b0df558007f tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Getting quotas for user 163b2f24a72649ac8084be1cac32fa09 and project 1e123e9b86124c93a7fc2db9984e7466. Resources: {'key_pairs'} {{(pid=115917) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 17 03:27:26.556227 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.virt.hardware [None req-5619d614-51dd-482a-98ea-018bdd204b21 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Flavor limits 0:0:0 {{(pid=115916) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 17 03:27:26.557312 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.virt.hardware [None req-5619d614-51dd-482a-98ea-018bdd204b21 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Image limits 0:0:0 {{(pid=115916) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 17 03:27:26.557859 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.virt.hardware [None req-5619d614-51dd-482a-98ea-018bdd204b21 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Flavor pref 0:0:0 {{(pid=115916) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 17 03:27:26.558640 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.virt.hardware [None req-5619d614-51dd-482a-98ea-018bdd204b21 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Image pref 0:0:0 {{(pid=115916) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 17 03:27:26.559144 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.virt.hardware [None req-5619d614-51dd-482a-98ea-018bdd204b21 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=115916) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 17 03:27:26.569116 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-5619d614-51dd-482a-98ea-018bdd204b21 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:27:26.569880 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-5619d614-51dd-482a-98ea-018bdd204b21 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:27:26.570725 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-5619d614-51dd-482a-98ea-018bdd204b21 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:27:26.571487 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-5619d614-51dd-482a-98ea-018bdd204b21 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:27:26.589342 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.quota [None req-5619d614-51dd-482a-98ea-018bdd204b21 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Getting quotas for project fef02a1dd77946a2ac0e0414b557435f. Resources: {'instances', 'ram', 'cores'} {{(pid=115916) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 17 03:27:26.593586 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.quota [None req-5619d614-51dd-482a-98ea-018bdd204b21 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Getting quotas for user 80763e09d44c475ea2425b22874e9612 and project fef02a1dd77946a2ac0e0414b557435f. Resources: {'instances', 'ram', 'cores'} {{(pid=115916) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 17 03:27:26.652580 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-5619d614-51dd-482a-98ea-018bdd204b21 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Going to run 1 instances... {{(pid=115916) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 17 03:27:26.656168 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-5619d614-51dd-482a-98ea-018bdd204b21 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] [instance: 5ddbfaaa-fabf-4324-941c-8868625ffefc] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='c7d136c8-3afa-4749-8af3-1d5b3ca59362',volume_size=None,volume_type=None)] {{(pid=115916) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 17 03:27:26.770028 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.quota [None req-1d27bfd0-2e9e-46e6-8983-1b0df558007f tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Getting quotas for project 1e123e9b86124c93a7fc2db9984e7466. Resources: {'key_pairs'} {{(pid=115917) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 17 03:27:26.775828 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.quota [None req-1d27bfd0-2e9e-46e6-8983-1b0df558007f tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Getting quotas for user 163b2f24a72649ac8084be1cac32fa09 and project 1e123e9b86124c93a7fc2db9984e7466. Resources: {'key_pairs'} {{(pid=115917) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 17 03:27:26.792898 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-1d27bfd0-2e9e-46e6-8983-1b0df558007f tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] 10.222.0.11 "POST /compute/v2.1/os-keypairs" status: 200 len: 2316 microversion: 2.1 time: 0.541490 Nov 17 03:27:26.793517 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 252/480] 10.222.0.11 () {60 vars in 1157 bytes} [Wed Nov 17 03:27:26 2021] POST /compute/v2.1/os-keypairs => generated 2316 bytes in 543 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:27:26.803131 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-31b503f0-88e9-4273-abe0-3be86889707e tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:27:26.804664 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-31b503f0-88e9-4273-abe0-3be86889707e tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] [instance: 5d54db85-b991-4890-abaa-952413baa2e7] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:27:26.811441 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-5619d614-51dd-482a-98ea-018bdd204b21 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] 10.222.0.11 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.161166 Nov 17 03:27:26.812079 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 229/481] 10.222.0.11 () {60 vars in 1146 bytes} [Wed Nov 17 03:27:25 2021] POST /compute/v2.1/servers => generated 405 bytes in 1164 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 17 03:27:26.817514 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-31b503f0-88e9-4273-abe0-3be86889707e tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:27:26.818356 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-31b503f0-88e9-4273-abe0-3be86889707e tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:27:26.818659 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-deccee2a-9fb7-4e6b-b0f4-c557a357603f tempest-AttachVolumeTestJSON-1651611701 tempest-AttachVolumeTestJSON-1651611701-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 17 03:27:26.819495 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-31b503f0-88e9-4273-abe0-3be86889707e tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:27:26.820136 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-deccee2a-9fb7-4e6b-b0f4-c557a357603f tempest-AttachVolumeTestJSON-1651611701 tempest-AttachVolumeTestJSON-1651611701-project] [instance: 5e11ea9c-f66a-4962-b5ca-b95784624824] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:27:26.820369 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-31b503f0-88e9-4273-abe0-3be86889707e tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:27:26.827715 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-deccee2a-9fb7-4e6b-b0f4-c557a357603f tempest-AttachVolumeTestJSON-1651611701 tempest-AttachVolumeTestJSON-1651611701-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:27:26.828392 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-deccee2a-9fb7-4e6b-b0f4-c557a357603f tempest-AttachVolumeTestJSON-1651611701 tempest-AttachVolumeTestJSON-1651611701-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:27:26.829765 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-deccee2a-9fb7-4e6b-b0f4-c557a357603f tempest-AttachVolumeTestJSON-1651611701 tempest-AttachVolumeTestJSON-1651611701-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:27:26.830366 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-deccee2a-9fb7-4e6b-b0f4-c557a357603f tempest-AttachVolumeTestJSON-1651611701 tempest-AttachVolumeTestJSON-1651611701-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:27:26.975775 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-deccee2a-9fb7-4e6b-b0f4-c557a357603f tempest-AttachVolumeTestJSON-1651611701 tempest-AttachVolumeTestJSON-1651611701-project] 10.222.0.11 "POST /compute/v2.1/servers/5e11ea9c-f66a-4962-b5ca-b95784624824/action" status: 200 len: 23222 microversion: 2.1 time: 0.160634 Nov 17 03:27:26.976812 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 230/482] 10.222.0.11 () {60 vars in 1277 bytes} [Wed Nov 17 03:27:26 2021] POST /compute/v2.1/servers/5e11ea9c-f66a-4962-b5ca-b95784624824/action => generated 23222 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 17 03:27:26.995027 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-68c6979b-2eb8-4499-a54f-b517ecbdf52e tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:27:26.995851 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-68c6979b-2eb8-4499-a54f-b517ecbdf52e tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] [instance: 15abb40f-daf9-4c4b-ac9c-55f57ee7b938] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:27:27.008904 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-68c6979b-2eb8-4499-a54f-b517ecbdf52e tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:27:27.009676 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-68c6979b-2eb8-4499-a54f-b517ecbdf52e tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:27:27.011349 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-68c6979b-2eb8-4499-a54f-b517ecbdf52e tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:27:27.013087 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-68c6979b-2eb8-4499-a54f-b517ecbdf52e tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:27:27.194264 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-31b503f0-88e9-4273-abe0-3be86889707e tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37f21d6d15cf40a586edda211219fd08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ebb970305844dccacf48a7d8d47ecf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:27:27.203110 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-31b503f0-88e9-4273-abe0-3be86889707e tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '37f21d6d15cf40a586edda211219fd08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ebb970305844dccacf48a7d8d47ecf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:27:27.205967 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-31b503f0-88e9-4273-abe0-3be86889707e tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '37f21d6d15cf40a586edda211219fd08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ebb970305844dccacf48a7d8d47ecf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:27:27.207279 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-31b503f0-88e9-4273-abe0-3be86889707e tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] 10.222.0.11 "GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7" status: 200 len: 1725 microversion: 2.20 time: 0.412846 Nov 17 03:27:27.208149 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 253/483] 10.222.0.11 () {60 vars in 1276 bytes} [Wed Nov 17 03:27:26 2021] GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7 => generated 1725 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 17 03:27:27.225739 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-2200a125-a589-4723-8db0-8a615eaca242 tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-340462321", "imageRef": "7281a37a-6b99-49c1-881a-41604d06bae1", "flavorRef": "452", "networks": [{"uuid": "35db41f0-fe89-4e18-9f58-e0afb8774292"}]}} {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 17 03:27:27.248691 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-68c6979b-2eb8-4499-a54f-b517ecbdf52e tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a792b5b7e6f7461b8d802a5abaaa9518', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e843a3fb49f41dcb376184d7e156528', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:27:27.262459 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-68c6979b-2eb8-4499-a54f-b517ecbdf52e tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] 10.222.0.11 "GET /compute/v2.1/servers/15abb40f-daf9-4c4b-ac9c-55f57ee7b938" status: 200 len: 1319 microversion: 2.1 time: 0.281831 Nov 17 03:27:27.265127 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 231/484] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:27:26 2021] GET /compute/v2.1/servers/15abb40f-daf9-4c4b-ac9c-55f57ee7b938 => generated 1319 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:27:27.284655 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-c2f974a7-a7f9-44e2-8d15-6e4aa36e7685 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:27:27.285563 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-c2f974a7-a7f9-44e2-8d15-6e4aa36e7685 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] [instance: 5ddbfaaa-fabf-4324-941c-8868625ffefc] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:27:27.289781 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.network.neutron [None req-2200a125-a589-4723-8db0-8a615eaca242 tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] validate_networks() for [('35db41f0-fe89-4e18-9f58-e0afb8774292', None, None, None, None, None)] {{(pid=115917) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Nov 17 03:27:27.371628 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-c2f974a7-a7f9-44e2-8d15-6e4aa36e7685 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80763e09d44c475ea2425b22874e9612', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fef02a1dd77946a2ac0e0414b557435f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:27:27.379391 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-c2f974a7-a7f9-44e2-8d15-6e4aa36e7685 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] 10.222.0.11 "GET /compute/v2.1/servers/5ddbfaaa-fabf-4324-941c-8868625ffefc" status: 200 len: 1095 microversion: 2.1 time: 0.112631 Nov 17 03:27:27.381339 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 232/485] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:27:27 2021] GET /compute/v2.1/servers/5ddbfaaa-fabf-4324-941c-8868625ffefc => generated 1095 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:27:27.386991 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-3b062596-8278-46ae-9293-b666f18e7b42 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:27:27.392082 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-3b062596-8278-46ae-9293-b666f18e7b42 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] [instance: a49437df-3059-4528-8328-2f3471d5fb45] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:27:27.407285 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-3b062596-8278-46ae-9293-b666f18e7b42 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:27:27.408373 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-3b062596-8278-46ae-9293-b666f18e7b42 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:27:27.409382 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-3b062596-8278-46ae-9293-b666f18e7b42 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:27:27.410002 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-3b062596-8278-46ae-9293-b666f18e7b42 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:27:27.661204 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-3b062596-8278-46ae-9293-b666f18e7b42 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f046401c6a04f6495ebe0821120bd72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a58e89ceeea4a9c8a72a1de4bcaf2d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:27:27.669777 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-3b062596-8278-46ae-9293-b666f18e7b42 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] 10.222.0.11 "GET /compute/v2.1/servers/a49437df-3059-4528-8328-2f3471d5fb45" status: 200 len: 1520 microversion: 2.1 time: 0.286209 Nov 17 03:27:27.670356 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 233/486] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:27:27 2021] GET /compute/v2.1/servers/a49437df-3059-4528-8328-2f3471d5fb45 => generated 1520 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:27:27.987690 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-4475e7c5-f12f-4312-a628-f9dac89ae219 tempest-AttachVolumeTestJSON-1651611701 tempest-AttachVolumeTestJSON-1651611701-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 17 03:27:27.988655 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-4475e7c5-f12f-4312-a628-f9dac89ae219 tempest-AttachVolumeTestJSON-1651611701 tempest-AttachVolumeTestJSON-1651611701-project] [instance: 5e11ea9c-f66a-4962-b5ca-b95784624824] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:27:27.999516 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-4475e7c5-f12f-4312-a628-f9dac89ae219 tempest-AttachVolumeTestJSON-1651611701 tempest-AttachVolumeTestJSON-1651611701-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:27:28.000322 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-4475e7c5-f12f-4312-a628-f9dac89ae219 tempest-AttachVolumeTestJSON-1651611701 tempest-AttachVolumeTestJSON-1651611701-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:27:28.002457 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-4475e7c5-f12f-4312-a628-f9dac89ae219 tempest-AttachVolumeTestJSON-1651611701 tempest-AttachVolumeTestJSON-1651611701-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:27:28.004481 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-4475e7c5-f12f-4312-a628-f9dac89ae219 tempest-AttachVolumeTestJSON-1651611701 tempest-AttachVolumeTestJSON-1651611701-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:27:28.153756 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-4475e7c5-f12f-4312-a628-f9dac89ae219 tempest-AttachVolumeTestJSON-1651611701 tempest-AttachVolumeTestJSON-1651611701-project] 10.222.0.11 "POST /compute/v2.1/servers/5e11ea9c-f66a-4962-b5ca-b95784624824/action" status: 200 len: 23797 microversion: 2.1 time: 0.169114 Nov 17 03:27:28.157186 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 234/487] 10.222.0.11 () {60 vars in 1277 bytes} [Wed Nov 17 03:27:27 2021] POST /compute/v2.1/servers/5e11ea9c-f66a-4962-b5ca-b95784624824/action => generated 23797 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 17 03:27:28.170070 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.virt.hardware [None req-2200a125-a589-4723-8db0-8a615eaca242 tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] Flavor limits 0:0:0 {{(pid=115917) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 17 03:27:28.170695 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.virt.hardware [None req-2200a125-a589-4723-8db0-8a615eaca242 tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] Image limits 0:0:0 {{(pid=115917) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 17 03:27:28.171177 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.virt.hardware [None req-2200a125-a589-4723-8db0-8a615eaca242 tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] Flavor pref 0:0:0 {{(pid=115917) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 17 03:27:28.171583 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.virt.hardware [None req-2200a125-a589-4723-8db0-8a615eaca242 tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] Image pref 0:0:0 {{(pid=115917) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 17 03:27:28.171987 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.virt.hardware [None req-2200a125-a589-4723-8db0-8a615eaca242 tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=115917) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 17 03:27:28.180753 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-2200a125-a589-4723-8db0-8a615eaca242 tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:27:28.181429 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-2200a125-a589-4723-8db0-8a615eaca242 tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:27:28.182966 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-2200a125-a589-4723-8db0-8a615eaca242 tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:27:28.183581 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-2200a125-a589-4723-8db0-8a615eaca242 tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:27:28.201518 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.quota [None req-2200a125-a589-4723-8db0-8a615eaca242 tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] Getting quotas for project dfc480343d4d493bb4295b055e274df5. Resources: {'instances', 'ram', 'cores'} {{(pid=115917) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 17 03:27:28.206792 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.quota [None req-2200a125-a589-4723-8db0-8a615eaca242 tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] Getting quotas for user 6d4e8ac9538f42c9b637bd9e086668b3 and project dfc480343d4d493bb4295b055e274df5. Resources: {'instances', 'ram', 'cores'} {{(pid=115917) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 17 03:27:28.231289 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-c50f5d44-bb16-4771-95c6-f1d8b629b969 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:27:28.232932 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-c50f5d44-bb16-4771-95c6-f1d8b629b969 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] [instance: 5d54db85-b991-4890-abaa-952413baa2e7] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:27:28.235578 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-2200a125-a589-4723-8db0-8a615eaca242 tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] Going to run 1 instances... {{(pid=115917) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 17 03:27:28.238032 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-2200a125-a589-4723-8db0-8a615eaca242 tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] [instance: b89eca0e-d486-4b3a-a41a-aa02de394cff] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='7281a37a-6b99-49c1-881a-41604d06bae1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=115917) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 17 03:27:28.242575 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-c50f5d44-bb16-4771-95c6-f1d8b629b969 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:27:28.243316 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-c50f5d44-bb16-4771-95c6-f1d8b629b969 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:27:28.244248 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-c50f5d44-bb16-4771-95c6-f1d8b629b969 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:27:28.245598 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-c50f5d44-bb16-4771-95c6-f1d8b629b969 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:27:28.300939 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-2200a125-a589-4723-8db0-8a615eaca242 tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] 10.222.0.11 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.081556 Nov 17 03:27:28.307170 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 254/488] 10.222.0.11 () {60 vars in 1146 bytes} [Wed Nov 17 03:27:27 2021] POST /compute/v2.1/servers => generated 380 bytes in 1098 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 17 03:27:28.312055 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [req-6030c70c-e537-460c-8eea-6eb095ba8d2f req-3385b54e-bcdb-4940-8660-0ad590e1da64 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "15abb40f-daf9-4c4b-ac9c-55f57ee7b938", "tag": "b4c43900-e1e8-426d-b98e-b87ad7f920f6"}]} {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 17 03:27:28.313919 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 17 03:27:28.313919 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: warnings.warn(msg) Nov 17 03:27:28.321699 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [req-6030c70c-e537-460c-8eea-6eb095ba8d2f req-3385b54e-bcdb-4940-8660-0ad590e1da64 service nova] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:27:28.333058 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [req-6030c70c-e537-460c-8eea-6eb095ba8d2f req-3385b54e-bcdb-4940-8660-0ad590e1da64 service nova] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:27:28.349356 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.compute.server_external_events [req-6030c70c-e537-460c-8eea-6eb095ba8d2f req-3385b54e-bcdb-4940-8660-0ad590e1da64 service nova] Creating event network-changed:b4c43900-e1e8-426d-b98e-b87ad7f920f6 for instance 15abb40f-daf9-4c4b-ac9c-55f57ee7b938 on hv-cinder-81803 Nov 17 03:27:28.355801 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [req-6030c70c-e537-460c-8eea-6eb095ba8d2f req-3385b54e-bcdb-4940-8660-0ad590e1da64 service nova] 10.222.0.11 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046454 Nov 17 03:27:28.356920 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 255/489] 10.222.0.11 () {64 vars in 1317 bytes} [Wed Nov 17 03:27:28 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 17 03:27:28.363434 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-7dc78a58-a914-4076-8fcc-ab2d675ebb48 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:27:28.364299 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-7dc78a58-a914-4076-8fcc-ab2d675ebb48 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] [instance: 15abb40f-daf9-4c4b-ac9c-55f57ee7b938] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:27:28.370978 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-7dc78a58-a914-4076-8fcc-ab2d675ebb48 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:27:28.371609 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-7dc78a58-a914-4076-8fcc-ab2d675ebb48 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:27:28.373195 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-7dc78a58-a914-4076-8fcc-ab2d675ebb48 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:27:28.373783 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-7dc78a58-a914-4076-8fcc-ab2d675ebb48 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:27:28.433500 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-c50f5d44-bb16-4771-95c6-f1d8b629b969 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37f21d6d15cf40a586edda211219fd08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ebb970305844dccacf48a7d8d47ecf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:27:28.445577 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-c50f5d44-bb16-4771-95c6-f1d8b629b969 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '37f21d6d15cf40a586edda211219fd08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ebb970305844dccacf48a7d8d47ecf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:27:28.447347 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-c50f5d44-bb16-4771-95c6-f1d8b629b969 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '37f21d6d15cf40a586edda211219fd08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ebb970305844dccacf48a7d8d47ecf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:27:28.449487 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-c50f5d44-bb16-4771-95c6-f1d8b629b969 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] 10.222.0.11 "GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7" status: 200 len: 1725 microversion: 2.20 time: 0.225811 Nov 17 03:27:28.450063 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 235/490] 10.222.0.11 () {60 vars in 1276 bytes} [Wed Nov 17 03:27:28 2021] GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7 => generated 1725 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 17 03:27:28.467938 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-c3fcede7-0e42-4db1-a5b6-d3714f4630e1 tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:27:28.470412 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-c3fcede7-0e42-4db1-a5b6-d3714f4630e1 tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] [instance: b89eca0e-d486-4b3a-a41a-aa02de394cff] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:27:28.536503 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-c3fcede7-0e42-4db1-a5b6-d3714f4630e1 tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d4e8ac9538f42c9b637bd9e086668b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfc480343d4d493bb4295b055e274df5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:27:28.544767 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-c3fcede7-0e42-4db1-a5b6-d3714f4630e1 tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] 10.222.0.11 "GET /compute/v2.1/servers/b89eca0e-d486-4b3a-a41a-aa02de394cff" status: 200 len: 1217 microversion: 2.1 time: 0.082511 Nov 17 03:27:28.562172 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 236/491] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:27:28 2021] GET /compute/v2.1/servers/b89eca0e-d486-4b3a-a41a-aa02de394cff => generated 1217 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:27:28.567123 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-4aaf17f6-a46b-47ac-96a3-d09007f6a304 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:27:28.567769 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-4aaf17f6-a46b-47ac-96a3-d09007f6a304 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] [instance: 5ddbfaaa-fabf-4324-941c-8868625ffefc] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:27:28.599587 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-4aaf17f6-a46b-47ac-96a3-d09007f6a304 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:27:28.605992 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-4aaf17f6-a46b-47ac-96a3-d09007f6a304 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:27:28.609232 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-4aaf17f6-a46b-47ac-96a3-d09007f6a304 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:27:28.609682 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-4aaf17f6-a46b-47ac-96a3-d09007f6a304 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:27:28.721999 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-4aaf17f6-a46b-47ac-96a3-d09007f6a304 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80763e09d44c475ea2425b22874e9612', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fef02a1dd77946a2ac0e0414b557435f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:27:28.733280 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-4aaf17f6-a46b-47ac-96a3-d09007f6a304 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] 10.222.0.11 "GET /compute/v2.1/servers/5ddbfaaa-fabf-4324-941c-8868625ffefc" status: 200 len: 1201 microversion: 2.1 time: 0.169787 Nov 17 03:27:28.734161 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 237/492] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:27:28 2021] GET /compute/v2.1/servers/5ddbfaaa-fabf-4324-941c-8868625ffefc => generated 1201 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:27:28.749963 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-e24c94d1-3bf2-4ed3-8b2d-ba083c17e5dc tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:27:28.750586 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-e24c94d1-3bf2-4ed3-8b2d-ba083c17e5dc tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] [instance: a49437df-3059-4528-8328-2f3471d5fb45] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:27:28.761627 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-e24c94d1-3bf2-4ed3-8b2d-ba083c17e5dc tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:27:28.762078 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-e24c94d1-3bf2-4ed3-8b2d-ba083c17e5dc tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:27:28.762882 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-e24c94d1-3bf2-4ed3-8b2d-ba083c17e5dc tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:27:28.763312 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-e24c94d1-3bf2-4ed3-8b2d-ba083c17e5dc tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:27:28.985585 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-e24c94d1-3bf2-4ed3-8b2d-ba083c17e5dc tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f046401c6a04f6495ebe0821120bd72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a58e89ceeea4a9c8a72a1de4bcaf2d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:27:28.997220 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-e24c94d1-3bf2-4ed3-8b2d-ba083c17e5dc tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] 10.222.0.11 "GET /compute/v2.1/servers/a49437df-3059-4528-8328-2f3471d5fb45" status: 200 len: 1500 microversion: 2.1 time: 0.261980 Nov 17 03:27:28.997987 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 238/493] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:27:28 2021] GET /compute/v2.1/servers/a49437df-3059-4528-8328-2f3471d5fb45 => generated 1500 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:27:29.017515 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-d0a43008-217b-4d41-952c-b15b38770318 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "d931624a-66b9-43b9-8ff0-eb6b3fe7ebef"}} {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 17 03:27:29.019615 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-d0a43008-217b-4d41-952c-b15b38770318 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] [instance: a49437df-3059-4528-8328-2f3471d5fb45] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:27:29.027130 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-d0a43008-217b-4d41-952c-b15b38770318 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:27:29.027864 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-d0a43008-217b-4d41-952c-b15b38770318 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:27:29.028866 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-d0a43008-217b-4d41-952c-b15b38770318 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:27:29.029479 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-d0a43008-217b-4d41-952c-b15b38770318 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:27:29.058884 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.wsgi [None req-d0a43008-217b-4d41-952c-b15b38770318 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] HTTP exception thrown: Cannot 'attach_volume' instance a49437df-3059-4528-8328-2f3471d5fb45 while it is in vm_state rescued Nov 17 03:27:29.059807 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-d0a43008-217b-4d41-952c-b15b38770318 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Returning 409 to user: Cannot 'attach_volume' instance a49437df-3059-4528-8328-2f3471d5fb45 while it is in vm_state rescued {{(pid=115916) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 17 03:27:29.060848 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-d0a43008-217b-4d41-952c-b15b38770318 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] 10.222.0.11 "POST /compute/v2.1/servers/a49437df-3059-4528-8328-2f3471d5fb45/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.050482 Nov 17 03:27:29.062127 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 239/494] 10.222.0.11 () {60 vars in 1322 bytes} [Wed Nov 17 03:27:29 2021] POST /compute/v2.1/servers/a49437df-3059-4528-8328-2f3471d5fb45/os-volume_attachments => generated 152 bytes in 52 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Nov 17 03:27:29.076317 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-ca029529-a1c8-4884-9db9-273a0a5247b3 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 17 03:27:29.077958 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-ca029529-a1c8-4884-9db9-273a0a5247b3 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] [instance: a49437df-3059-4528-8328-2f3471d5fb45] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:27:29.085314 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-ca029529-a1c8-4884-9db9-273a0a5247b3 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:27:29.085836 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-ca029529-a1c8-4884-9db9-273a0a5247b3 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:27:29.086633 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-ca029529-a1c8-4884-9db9-273a0a5247b3 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:27:29.087104 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-ca029529-a1c8-4884-9db9-273a0a5247b3 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:27:29.212426 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-ca029529-a1c8-4884-9db9-273a0a5247b3 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] 10.222.0.11 "POST /compute/v2.1/servers/a49437df-3059-4528-8328-2f3471d5fb45/action" status: 202 len: 0 microversion: 2.1 time: 0.144442 Nov 17 03:27:29.213340 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 240/495] 10.222.0.11 () {60 vars in 1277 bytes} [Wed Nov 17 03:27:29 2021] POST /compute/v2.1/servers/a49437df-3059-4528-8328-2f3471d5fb45/action => generated 0 bytes in 146 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 17 03:27:29.220318 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-4ac8d4f1-16c2-4622-8ee7-f51f0f3a21f5 tempest-AttachVolumeTestJSON-1651611701 tempest-AttachVolumeTestJSON-1651611701-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 17 03:27:29.221759 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-4ac8d4f1-16c2-4622-8ee7-f51f0f3a21f5 tempest-AttachVolumeTestJSON-1651611701 tempest-AttachVolumeTestJSON-1651611701-project] [instance: 5e11ea9c-f66a-4962-b5ca-b95784624824] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:27:29.227764 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-4ac8d4f1-16c2-4622-8ee7-f51f0f3a21f5 tempest-AttachVolumeTestJSON-1651611701 tempest-AttachVolumeTestJSON-1651611701-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:27:29.228202 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-4ac8d4f1-16c2-4622-8ee7-f51f0f3a21f5 tempest-AttachVolumeTestJSON-1651611701 tempest-AttachVolumeTestJSON-1651611701-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:27:29.229185 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-4ac8d4f1-16c2-4622-8ee7-f51f0f3a21f5 tempest-AttachVolumeTestJSON-1651611701 tempest-AttachVolumeTestJSON-1651611701-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:27:29.229806 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-4ac8d4f1-16c2-4622-8ee7-f51f0f3a21f5 tempest-AttachVolumeTestJSON-1651611701 tempest-AttachVolumeTestJSON-1651611701-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:27:29.258038 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-7dc78a58-a914-4076-8fcc-ab2d675ebb48 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a792b5b7e6f7461b8d802a5abaaa9518', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e843a3fb49f41dcb376184d7e156528', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:27:29.293036 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-7dc78a58-a914-4076-8fcc-ab2d675ebb48 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] 10.222.0.11 "GET /compute/v2.1/servers/15abb40f-daf9-4c4b-ac9c-55f57ee7b938" status: 200 len: 1319 microversion: 2.1 time: 0.934301 Nov 17 03:27:29.305730 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 256/496] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:27:28 2021] GET /compute/v2.1/servers/15abb40f-daf9-4c4b-ac9c-55f57ee7b938 => generated 1319 bytes in 936 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:27:29.315852 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-0ab9872e-64a2-436d-a3b9-cf9752f3f32e tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:27:29.316488 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-0ab9872e-64a2-436d-a3b9-cf9752f3f32e tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] [instance: a49437df-3059-4528-8328-2f3471d5fb45] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:27:29.322432 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-0ab9872e-64a2-436d-a3b9-cf9752f3f32e tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:27:29.322886 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-0ab9872e-64a2-436d-a3b9-cf9752f3f32e tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:27:29.323668 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-0ab9872e-64a2-436d-a3b9-cf9752f3f32e tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:27:29.324102 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-0ab9872e-64a2-436d-a3b9-cf9752f3f32e tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:27:29.457328 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-4ac8d4f1-16c2-4622-8ee7-f51f0f3a21f5 tempest-AttachVolumeTestJSON-1651611701 tempest-AttachVolumeTestJSON-1651611701-project] 10.222.0.11 "POST /compute/v2.1/servers/5e11ea9c-f66a-4962-b5ca-b95784624824/action" status: 200 len: 25060 microversion: 2.1 time: 0.242226 Nov 17 03:27:29.458162 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 241/497] 10.222.0.11 () {60 vars in 1277 bytes} [Wed Nov 17 03:27:29 2021] POST /compute/v2.1/servers/5e11ea9c-f66a-4962-b5ca-b95784624824/action => generated 25060 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 17 03:27:29.473232 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-4ee7973d-d9d3-4688-8b6f-bfef2c281424 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:27:29.474648 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-4ee7973d-d9d3-4688-8b6f-bfef2c281424 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] [instance: 5d54db85-b991-4890-abaa-952413baa2e7] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:27:29.499597 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-4ee7973d-d9d3-4688-8b6f-bfef2c281424 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:27:29.501173 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-4ee7973d-d9d3-4688-8b6f-bfef2c281424 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:27:29.502376 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-4ee7973d-d9d3-4688-8b6f-bfef2c281424 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:27:29.505007 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-4ee7973d-d9d3-4688-8b6f-bfef2c281424 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:27:29.736077 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-0ab9872e-64a2-436d-a3b9-cf9752f3f32e tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f046401c6a04f6495ebe0821120bd72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a58e89ceeea4a9c8a72a1de4bcaf2d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:27:29.746848 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-0ab9872e-64a2-436d-a3b9-cf9752f3f32e tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] 10.222.0.11 "GET /compute/v2.1/servers/a49437df-3059-4528-8328-2f3471d5fb45" status: 200 len: 1508 microversion: 2.1 time: 0.439353 Nov 17 03:27:29.747553 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 257/498] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:27:29 2021] GET /compute/v2.1/servers/a49437df-3059-4528-8328-2f3471d5fb45 => generated 1508 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:27:29.752816 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-689a9c32-f91a-49a4-8957-d4f77a4abb69 tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:27:29.767226 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-689a9c32-f91a-49a4-8957-d4f77a4abb69 tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] [instance: b89eca0e-d486-4b3a-a41a-aa02de394cff] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:27:29.789372 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-689a9c32-f91a-49a4-8957-d4f77a4abb69 tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:27:29.790074 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-689a9c32-f91a-49a4-8957-d4f77a4abb69 tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:27:29.791051 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-689a9c32-f91a-49a4-8957-d4f77a4abb69 tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:27:29.793615 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-689a9c32-f91a-49a4-8957-d4f77a4abb69 tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:27:29.917616 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-689a9c32-f91a-49a4-8957-d4f77a4abb69 tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d4e8ac9538f42c9b637bd9e086668b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfc480343d4d493bb4295b055e274df5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:27:29.937494 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-689a9c32-f91a-49a4-8957-d4f77a4abb69 tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] 10.222.0.11 "GET /compute/v2.1/servers/b89eca0e-d486-4b3a-a41a-aa02de394cff" status: 200 len: 1269 microversion: 2.1 time: 0.185514 Nov 17 03:27:29.947229 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 258/499] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:27:29 2021] GET /compute/v2.1/servers/b89eca0e-d486-4b3a-a41a-aa02de394cff => generated 1269 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:27:29.947766 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-c5eb964a-d051-4149-b413-257f079156db tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:27:29.949193 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-c5eb964a-d051-4149-b413-257f079156db tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] [instance: 5ddbfaaa-fabf-4324-941c-8868625ffefc] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:27:29.956358 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-4ee7973d-d9d3-4688-8b6f-bfef2c281424 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37f21d6d15cf40a586edda211219fd08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ebb970305844dccacf48a7d8d47ecf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:27:29.971827 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-c5eb964a-d051-4149-b413-257f079156db tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:27:29.976965 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-4ee7973d-d9d3-4688-8b6f-bfef2c281424 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '37f21d6d15cf40a586edda211219fd08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ebb970305844dccacf48a7d8d47ecf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:27:29.977649 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-c5eb964a-d051-4149-b413-257f079156db tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:27:29.978574 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-c5eb964a-d051-4149-b413-257f079156db tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:27:29.979020 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-4ee7973d-d9d3-4688-8b6f-bfef2c281424 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '37f21d6d15cf40a586edda211219fd08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ebb970305844dccacf48a7d8d47ecf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:27:29.979319 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-c5eb964a-d051-4149-b413-257f079156db tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:27:29.980530 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-4ee7973d-d9d3-4688-8b6f-bfef2c281424 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] 10.222.0.11 "GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7" status: 200 len: 1725 microversion: 2.20 time: 0.514568 Nov 17 03:27:29.981287 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 242/500] 10.222.0.11 () {60 vars in 1276 bytes} [Wed Nov 17 03:27:29 2021] GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7 => generated 1725 bytes in 517 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 17 03:27:30.121257 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-c5eb964a-d051-4149-b413-257f079156db tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80763e09d44c475ea2425b22874e9612', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fef02a1dd77946a2ac0e0414b557435f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:27:30.131686 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-c5eb964a-d051-4149-b413-257f079156db tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] 10.222.0.11 "GET /compute/v2.1/servers/5ddbfaaa-fabf-4324-941c-8868625ffefc" status: 200 len: 1199 microversion: 2.1 time: 0.191775 Nov 17 03:27:30.152552 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 259/501] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:27:29 2021] GET /compute/v2.1/servers/5ddbfaaa-fabf-4324-941c-8868625ffefc => generated 1199 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:27:30.310210 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-f4f27962-cf5e-4b81-a04f-f1826e8470f3 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:27:30.310820 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-f4f27962-cf5e-4b81-a04f-f1826e8470f3 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] [instance: 15abb40f-daf9-4c4b-ac9c-55f57ee7b938] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:27:30.319131 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-f4f27962-cf5e-4b81-a04f-f1826e8470f3 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:27:30.327890 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-f4f27962-cf5e-4b81-a04f-f1826e8470f3 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:27:30.329269 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-f4f27962-cf5e-4b81-a04f-f1826e8470f3 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:27:30.329865 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-f4f27962-cf5e-4b81-a04f-f1826e8470f3 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:27:30.470091 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-eba78565-b235-4daa-a227-95abd1ddabae tempest-AttachVolumeTestJSON-1651611701 tempest-AttachVolumeTestJSON-1651611701-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 17 03:27:30.471171 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-eba78565-b235-4daa-a227-95abd1ddabae tempest-AttachVolumeTestJSON-1651611701 tempest-AttachVolumeTestJSON-1651611701-project] [instance: 5e11ea9c-f66a-4962-b5ca-b95784624824] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:27:30.492534 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-eba78565-b235-4daa-a227-95abd1ddabae tempest-AttachVolumeTestJSON-1651611701 tempest-AttachVolumeTestJSON-1651611701-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:27:30.494412 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-eba78565-b235-4daa-a227-95abd1ddabae tempest-AttachVolumeTestJSON-1651611701 tempest-AttachVolumeTestJSON-1651611701-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:27:30.495985 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-eba78565-b235-4daa-a227-95abd1ddabae tempest-AttachVolumeTestJSON-1651611701 tempest-AttachVolumeTestJSON-1651611701-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:27:30.496434 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-eba78565-b235-4daa-a227-95abd1ddabae tempest-AttachVolumeTestJSON-1651611701 tempest-AttachVolumeTestJSON-1651611701-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:27:30.548735 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-f4f27962-cf5e-4b81-a04f-f1826e8470f3 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a792b5b7e6f7461b8d802a5abaaa9518', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e843a3fb49f41dcb376184d7e156528', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:27:30.559711 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-f4f27962-cf5e-4b81-a04f-f1826e8470f3 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] 10.222.0.11 "GET /compute/v2.1/servers/15abb40f-daf9-4c4b-ac9c-55f57ee7b938" status: 200 len: 1319 microversion: 2.1 time: 0.251069 Nov 17 03:27:30.571533 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 243/502] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:27:30 2021] GET /compute/v2.1/servers/15abb40f-daf9-4c4b-ac9c-55f57ee7b938 => generated 1319 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:27:30.683234 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-eba78565-b235-4daa-a227-95abd1ddabae tempest-AttachVolumeTestJSON-1651611701 tempest-AttachVolumeTestJSON-1651611701-project] 10.222.0.11 "POST /compute/v2.1/servers/5e11ea9c-f66a-4962-b5ca-b95784624824/action" status: 200 len: 25779 microversion: 2.1 time: 0.217686 Nov 17 03:27:30.683973 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 260/503] 10.222.0.11 () {60 vars in 1277 bytes} [Wed Nov 17 03:27:30 2021] POST /compute/v2.1/servers/5e11ea9c-f66a-4962-b5ca-b95784624824/action => generated 25779 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 17 03:27:30.765350 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-0648732a-88ba-4e0e-a6c3-bb0441b7f5d8 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:27:30.765953 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-0648732a-88ba-4e0e-a6c3-bb0441b7f5d8 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] [instance: a49437df-3059-4528-8328-2f3471d5fb45] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:27:30.774504 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-0648732a-88ba-4e0e-a6c3-bb0441b7f5d8 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:27:30.774962 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-0648732a-88ba-4e0e-a6c3-bb0441b7f5d8 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:27:30.775784 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-0648732a-88ba-4e0e-a6c3-bb0441b7f5d8 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:27:30.776212 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-0648732a-88ba-4e0e-a6c3-bb0441b7f5d8 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:27:30.955976 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-1732fd80-824d-4dd5-b22d-b5f4b44b2c35 tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:27:30.958264 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-1732fd80-824d-4dd5-b22d-b5f4b44b2c35 tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] [instance: b89eca0e-d486-4b3a-a41a-aa02de394cff] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:27:30.962377 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-0648732a-88ba-4e0e-a6c3-bb0441b7f5d8 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f046401c6a04f6495ebe0821120bd72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a58e89ceeea4a9c8a72a1de4bcaf2d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:27:30.966987 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-1732fd80-824d-4dd5-b22d-b5f4b44b2c35 tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:27:30.967822 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-1732fd80-824d-4dd5-b22d-b5f4b44b2c35 tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:27:30.969537 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-1732fd80-824d-4dd5-b22d-b5f4b44b2c35 tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:27:30.974012 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-0648732a-88ba-4e0e-a6c3-bb0441b7f5d8 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] 10.222.0.11 "GET /compute/v2.1/servers/a49437df-3059-4528-8328-2f3471d5fb45" status: 200 len: 1508 microversion: 2.1 time: 0.212307 Nov 17 03:27:30.974591 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 244/504] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:27:30 2021] GET /compute/v2.1/servers/a49437df-3059-4528-8328-2f3471d5fb45 => generated 1508 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:27:30.977048 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-1732fd80-824d-4dd5-b22d-b5f4b44b2c35 tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:27:31.003488 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-07e90292-eda6-4a28-84f3-585654031b8c tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:27:31.004133 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-07e90292-eda6-4a28-84f3-585654031b8c tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] [instance: 5d54db85-b991-4890-abaa-952413baa2e7] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:27:31.011514 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-07e90292-eda6-4a28-84f3-585654031b8c tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:27:31.011975 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-07e90292-eda6-4a28-84f3-585654031b8c tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:27:31.012770 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-07e90292-eda6-4a28-84f3-585654031b8c tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:27:31.013230 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-07e90292-eda6-4a28-84f3-585654031b8c tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:27:31.231240 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-07e90292-eda6-4a28-84f3-585654031b8c tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37f21d6d15cf40a586edda211219fd08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ebb970305844dccacf48a7d8d47ecf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:27:31.243201 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-07e90292-eda6-4a28-84f3-585654031b8c tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '37f21d6d15cf40a586edda211219fd08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ebb970305844dccacf48a7d8d47ecf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:27:31.245349 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-07e90292-eda6-4a28-84f3-585654031b8c tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '37f21d6d15cf40a586edda211219fd08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ebb970305844dccacf48a7d8d47ecf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:27:31.246844 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-07e90292-eda6-4a28-84f3-585654031b8c tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] 10.222.0.11 "GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7" status: 200 len: 1725 microversion: 2.20 time: 0.251957 Nov 17 03:27:31.247642 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 245/505] 10.222.0.11 () {60 vars in 1276 bytes} [Wed Nov 17 03:27:30 2021] GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7 => generated 1725 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 17 03:27:31.254364 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-1732fd80-824d-4dd5-b22d-b5f4b44b2c35 tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d4e8ac9538f42c9b637bd9e086668b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfc480343d4d493bb4295b055e274df5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:27:31.267347 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-1732fd80-824d-4dd5-b22d-b5f4b44b2c35 tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] 10.222.0.11 "GET /compute/v2.1/servers/b89eca0e-d486-4b3a-a41a-aa02de394cff" status: 200 len: 1275 microversion: 2.1 time: 0.315993 Nov 17 03:27:31.267930 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 261/506] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:27:30 2021] GET /compute/v2.1/servers/b89eca0e-d486-4b3a-a41a-aa02de394cff => generated 1275 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 17 03:27:31.271251 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-78c96039-8cf3-430b-a06b-c0ecbdea2de8 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:27:31.272162 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-78c96039-8cf3-430b-a06b-c0ecbdea2de8 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] [instance: 5ddbfaaa-fabf-4324-941c-8868625ffefc] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:27:31.279004 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-78c96039-8cf3-430b-a06b-c0ecbdea2de8 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:27:31.280016 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-78c96039-8cf3-430b-a06b-c0ecbdea2de8 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:27:31.281154 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-78c96039-8cf3-430b-a06b-c0ecbdea2de8 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:27:31.281836 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-78c96039-8cf3-430b-a06b-c0ecbdea2de8 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:27:31.462199 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-78c96039-8cf3-430b-a06b-c0ecbdea2de8 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80763e09d44c475ea2425b22874e9612', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fef02a1dd77946a2ac0e0414b557435f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:27:31.475653 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-78c96039-8cf3-430b-a06b-c0ecbdea2de8 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] 10.222.0.11 "GET /compute/v2.1/servers/5ddbfaaa-fabf-4324-941c-8868625ffefc" status: 200 len: 1266 microversion: 2.1 time: 0.226595 Nov 17 03:27:31.485580 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 246/507] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:27:31 2021] GET /compute/v2.1/servers/5ddbfaaa-fabf-4324-941c-8868625ffefc => generated 1266 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:27:31.578257 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-89064c37-23f2-4082-83b8-f728911145c8 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:27:31.578938 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-89064c37-23f2-4082-83b8-f728911145c8 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] [instance: 15abb40f-daf9-4c4b-ac9c-55f57ee7b938] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:27:31.587947 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-89064c37-23f2-4082-83b8-f728911145c8 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:27:31.588728 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-89064c37-23f2-4082-83b8-f728911145c8 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:27:31.589909 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-89064c37-23f2-4082-83b8-f728911145c8 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:27:31.590501 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-89064c37-23f2-4082-83b8-f728911145c8 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:27:31.697033 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-79beb359-ddaf-4bc1-9c20-2d359f2ba0e1 tempest-AttachVolumeTestJSON-1651611701 tempest-AttachVolumeTestJSON-1651611701-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 17 03:27:31.698018 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-79beb359-ddaf-4bc1-9c20-2d359f2ba0e1 tempest-AttachVolumeTestJSON-1651611701 tempest-AttachVolumeTestJSON-1651611701-project] [instance: 5e11ea9c-f66a-4962-b5ca-b95784624824] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:27:31.704180 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-79beb359-ddaf-4bc1-9c20-2d359f2ba0e1 tempest-AttachVolumeTestJSON-1651611701 tempest-AttachVolumeTestJSON-1651611701-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:27:31.704407 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-79beb359-ddaf-4bc1-9c20-2d359f2ba0e1 tempest-AttachVolumeTestJSON-1651611701 tempest-AttachVolumeTestJSON-1651611701-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:27:31.706101 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-79beb359-ddaf-4bc1-9c20-2d359f2ba0e1 tempest-AttachVolumeTestJSON-1651611701 tempest-AttachVolumeTestJSON-1651611701-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:27:31.706552 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-79beb359-ddaf-4bc1-9c20-2d359f2ba0e1 tempest-AttachVolumeTestJSON-1651611701 tempest-AttachVolumeTestJSON-1651611701-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:27:31.835275 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-79beb359-ddaf-4bc1-9c20-2d359f2ba0e1 tempest-AttachVolumeTestJSON-1651611701 tempest-AttachVolumeTestJSON-1651611701-project] 10.222.0.11 "POST /compute/v2.1/servers/5e11ea9c-f66a-4962-b5ca-b95784624824/action" status: 200 len: 26272 microversion: 2.1 time: 0.142425 Nov 17 03:27:31.839562 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 247/508] 10.222.0.11 () {60 vars in 1277 bytes} [Wed Nov 17 03:27:31 2021] POST /compute/v2.1/servers/5e11ea9c-f66a-4962-b5ca-b95784624824/action => generated 26272 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 17 03:27:31.984425 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-89064c37-23f2-4082-83b8-f728911145c8 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a792b5b7e6f7461b8d802a5abaaa9518', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e843a3fb49f41dcb376184d7e156528', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:27:31.996220 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-2283f3af-bfe8-48b0-ac41-47361435aeeb tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:27:31.997414 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-2283f3af-bfe8-48b0-ac41-47361435aeeb tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] [instance: a49437df-3059-4528-8328-2f3471d5fb45] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:27:32.006037 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-89064c37-23f2-4082-83b8-f728911145c8 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] 10.222.0.11 "GET /compute/v2.1/servers/15abb40f-daf9-4c4b-ac9c-55f57ee7b938" status: 200 len: 1319 microversion: 2.1 time: 0.431573 Nov 17 03:27:32.006699 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 262/509] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:27:31 2021] GET /compute/v2.1/servers/15abb40f-daf9-4c4b-ac9c-55f57ee7b938 => generated 1319 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:27:32.007315 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-2283f3af-bfe8-48b0-ac41-47361435aeeb tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:27:32.008384 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-2283f3af-bfe8-48b0-ac41-47361435aeeb tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:27:32.009618 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-2283f3af-bfe8-48b0-ac41-47361435aeeb tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:27:32.010120 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-2283f3af-bfe8-48b0-ac41-47361435aeeb tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:27:32.171369 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-2283f3af-bfe8-48b0-ac41-47361435aeeb tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f046401c6a04f6495ebe0821120bd72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a58e89ceeea4a9c8a72a1de4bcaf2d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:27:32.179605 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-2283f3af-bfe8-48b0-ac41-47361435aeeb tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] 10.222.0.11 "GET /compute/v2.1/servers/a49437df-3059-4528-8328-2f3471d5fb45" status: 200 len: 1508 microversion: 2.1 time: 0.191761 Nov 17 03:27:32.180337 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 248/510] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:27:31 2021] GET /compute/v2.1/servers/a49437df-3059-4528-8328-2f3471d5fb45 => generated 1508 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 17 03:27:32.265479 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-bb3ac63c-d5bc-4da3-95f1-d5f981d37dda tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:27:32.266520 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-bb3ac63c-d5bc-4da3-95f1-d5f981d37dda tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] [instance: 5d54db85-b991-4890-abaa-952413baa2e7] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:27:32.275200 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-bb3ac63c-d5bc-4da3-95f1-d5f981d37dda tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:27:32.276140 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-bb3ac63c-d5bc-4da3-95f1-d5f981d37dda tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:27:32.277206 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-bb3ac63c-d5bc-4da3-95f1-d5f981d37dda tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:27:32.277834 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-bb3ac63c-d5bc-4da3-95f1-d5f981d37dda tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:27:32.285080 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-d3efc582-076e-4422-b553-7cb0beb9245c tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:27:32.286021 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-d3efc582-076e-4422-b553-7cb0beb9245c tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] [instance: b89eca0e-d486-4b3a-a41a-aa02de394cff] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:27:32.292346 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-d3efc582-076e-4422-b553-7cb0beb9245c tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:27:32.293128 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-d3efc582-076e-4422-b553-7cb0beb9245c tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:27:32.294121 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-d3efc582-076e-4422-b553-7cb0beb9245c tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:27:32.294766 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-d3efc582-076e-4422-b553-7cb0beb9245c tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:27:32.502103 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-d3efc582-076e-4422-b553-7cb0beb9245c tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d4e8ac9538f42c9b637bd9e086668b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfc480343d4d493bb4295b055e274df5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:27:32.510606 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-d3efc582-076e-4422-b553-7cb0beb9245c tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] 10.222.0.11 "GET /compute/v2.1/servers/b89eca0e-d486-4b3a-a41a-aa02de394cff" status: 200 len: 1317 microversion: 2.1 time: 0.229346 Nov 17 03:27:32.511509 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 249/511] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:27:32 2021] GET /compute/v2.1/servers/b89eca0e-d486-4b3a-a41a-aa02de394cff => generated 1317 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:27:32.517869 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-239c9096-e80b-4f32-9bf4-8ff128ed8ea3 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:27:32.519574 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-239c9096-e80b-4f32-9bf4-8ff128ed8ea3 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] [instance: 5ddbfaaa-fabf-4324-941c-8868625ffefc] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:27:32.529644 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-239c9096-e80b-4f32-9bf4-8ff128ed8ea3 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:27:32.531786 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-239c9096-e80b-4f32-9bf4-8ff128ed8ea3 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:27:32.532917 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-239c9096-e80b-4f32-9bf4-8ff128ed8ea3 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:27:32.533612 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-239c9096-e80b-4f32-9bf4-8ff128ed8ea3 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:27:32.678758 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-239c9096-e80b-4f32-9bf4-8ff128ed8ea3 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80763e09d44c475ea2425b22874e9612', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fef02a1dd77946a2ac0e0414b557435f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:27:32.686843 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-239c9096-e80b-4f32-9bf4-8ff128ed8ea3 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] 10.222.0.11 "GET /compute/v2.1/servers/5ddbfaaa-fabf-4324-941c-8868625ffefc" status: 200 len: 1266 microversion: 2.1 time: 0.173974 Nov 17 03:27:32.687448 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 250/512] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:27:32 2021] GET /compute/v2.1/servers/5ddbfaaa-fabf-4324-941c-8868625ffefc => generated 1266 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:27:32.847461 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-15be7d67-6dec-4dfb-8e75-8c35141046f8 tempest-AttachVolumeTestJSON-1651611701 tempest-AttachVolumeTestJSON-1651611701-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 17 03:27:32.848460 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-15be7d67-6dec-4dfb-8e75-8c35141046f8 tempest-AttachVolumeTestJSON-1651611701 tempest-AttachVolumeTestJSON-1651611701-project] [instance: 5e11ea9c-f66a-4962-b5ca-b95784624824] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:27:32.854679 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-15be7d67-6dec-4dfb-8e75-8c35141046f8 tempest-AttachVolumeTestJSON-1651611701 tempest-AttachVolumeTestJSON-1651611701-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:27:32.855125 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-15be7d67-6dec-4dfb-8e75-8c35141046f8 tempest-AttachVolumeTestJSON-1651611701 tempest-AttachVolumeTestJSON-1651611701-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:27:32.855896 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-15be7d67-6dec-4dfb-8e75-8c35141046f8 tempest-AttachVolumeTestJSON-1651611701 tempest-AttachVolumeTestJSON-1651611701-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:27:32.856326 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-15be7d67-6dec-4dfb-8e75-8c35141046f8 tempest-AttachVolumeTestJSON-1651611701 tempest-AttachVolumeTestJSON-1651611701-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:27:32.931664 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-bb3ac63c-d5bc-4da3-95f1-d5f981d37dda tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37f21d6d15cf40a586edda211219fd08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ebb970305844dccacf48a7d8d47ecf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:27:32.942443 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-bb3ac63c-d5bc-4da3-95f1-d5f981d37dda tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '37f21d6d15cf40a586edda211219fd08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ebb970305844dccacf48a7d8d47ecf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:27:32.944612 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-bb3ac63c-d5bc-4da3-95f1-d5f981d37dda tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '37f21d6d15cf40a586edda211219fd08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ebb970305844dccacf48a7d8d47ecf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:27:32.946233 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-bb3ac63c-d5bc-4da3-95f1-d5f981d37dda tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] 10.222.0.11 "GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7" status: 200 len: 1725 microversion: 2.20 time: 0.685465 Nov 17 03:27:32.947429 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 263/513] 10.222.0.11 () {60 vars in 1276 bytes} [Wed Nov 17 03:27:32 2021] GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7 => generated 1725 bytes in 687 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 17 03:27:32.953642 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [req-7dc9a5f4-7637-4825-a15c-74cc781c5bec req-0bdb6e13-f01a-4b4c-b36f-05f483695c51 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5ddbfaaa-fabf-4324-941c-8868625ffefc", "tag": "c37d71de-0892-41d0-9d86-8ce8b8ccde7f"}]} {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 17 03:27:32.956326 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 17 03:27:32.956326 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: warnings.warn(msg) Nov 17 03:27:32.966942 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [req-7dc9a5f4-7637-4825-a15c-74cc781c5bec req-0bdb6e13-f01a-4b4c-b36f-05f483695c51 service nova] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:27:32.967798 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [req-7dc9a5f4-7637-4825-a15c-74cc781c5bec req-0bdb6e13-f01a-4b4c-b36f-05f483695c51 service nova] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:27:32.983311 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.compute.server_external_events [req-7dc9a5f4-7637-4825-a15c-74cc781c5bec req-0bdb6e13-f01a-4b4c-b36f-05f483695c51 service nova] Creating event network-changed:c37d71de-0892-41d0-9d86-8ce8b8ccde7f for instance 5ddbfaaa-fabf-4324-941c-8868625ffefc on hv-cinder-81803 Nov 17 03:27:32.989733 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [req-7dc9a5f4-7637-4825-a15c-74cc781c5bec req-0bdb6e13-f01a-4b4c-b36f-05f483695c51 service nova] 10.222.0.11 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040216 Nov 17 03:27:32.990404 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 264/514] 10.222.0.11 () {64 vars in 1317 bytes} [Wed Nov 17 03:27:32 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 17 03:27:33.025628 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-1d4d6e06-7781-4529-9943-6d9da1166dc5 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:27:33.026368 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-1d4d6e06-7781-4529-9943-6d9da1166dc5 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] [instance: 15abb40f-daf9-4c4b-ac9c-55f57ee7b938] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:27:33.032737 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-1d4d6e06-7781-4529-9943-6d9da1166dc5 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:27:33.033222 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-1d4d6e06-7781-4529-9943-6d9da1166dc5 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:27:33.033990 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-1d4d6e06-7781-4529-9943-6d9da1166dc5 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:27:33.034421 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-1d4d6e06-7781-4529-9943-6d9da1166dc5 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:27:33.062513 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-15be7d67-6dec-4dfb-8e75-8c35141046f8 tempest-AttachVolumeTestJSON-1651611701 tempest-AttachVolumeTestJSON-1651611701-project] 10.222.0.11 "POST /compute/v2.1/servers/5e11ea9c-f66a-4962-b5ca-b95784624824/action" status: 200 len: 26812 microversion: 2.1 time: 0.217701 Nov 17 03:27:33.066874 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 251/515] 10.222.0.11 () {60 vars in 1277 bytes} [Wed Nov 17 03:27:32 2021] POST /compute/v2.1/servers/5e11ea9c-f66a-4962-b5ca-b95784624824/action => generated 26812 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 17 03:27:33.198058 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-df3cd54a-7b38-49b2-8a73-ef597a7a5f67 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:27:33.198840 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-df3cd54a-7b38-49b2-8a73-ef597a7a5f67 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] [instance: a49437df-3059-4528-8328-2f3471d5fb45] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:27:33.206208 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-df3cd54a-7b38-49b2-8a73-ef597a7a5f67 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:27:33.206642 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-df3cd54a-7b38-49b2-8a73-ef597a7a5f67 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:27:33.207418 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-df3cd54a-7b38-49b2-8a73-ef597a7a5f67 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:27:33.207845 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-df3cd54a-7b38-49b2-8a73-ef597a7a5f67 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:27:33.297163 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-1d4d6e06-7781-4529-9943-6d9da1166dc5 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a792b5b7e6f7461b8d802a5abaaa9518', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e843a3fb49f41dcb376184d7e156528', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:27:33.306679 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-1d4d6e06-7781-4529-9943-6d9da1166dc5 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] 10.222.0.11 "GET /compute/v2.1/servers/15abb40f-daf9-4c4b-ac9c-55f57ee7b938" status: 200 len: 1319 microversion: 2.1 time: 0.285760 Nov 17 03:27:33.307869 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 265/516] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:27:33 2021] GET /compute/v2.1/servers/15abb40f-daf9-4c4b-ac9c-55f57ee7b938 => generated 1319 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:27:33.355945 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-df3cd54a-7b38-49b2-8a73-ef597a7a5f67 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f046401c6a04f6495ebe0821120bd72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a58e89ceeea4a9c8a72a1de4bcaf2d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:27:33.364742 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-df3cd54a-7b38-49b2-8a73-ef597a7a5f67 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] 10.222.0.11 "GET /compute/v2.1/servers/a49437df-3059-4528-8328-2f3471d5fb45" status: 200 len: 1508 microversion: 2.1 time: 0.170369 Nov 17 03:27:33.365729 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 252/517] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:27:33 2021] GET /compute/v2.1/servers/a49437df-3059-4528-8328-2f3471d5fb45 => generated 1508 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 17 03:27:33.527548 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-c4e1f9c2-6205-45e0-88ee-ac5c3d0fafed tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:27:33.528144 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-c4e1f9c2-6205-45e0-88ee-ac5c3d0fafed tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] [instance: b89eca0e-d486-4b3a-a41a-aa02de394cff] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:27:33.534389 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-c4e1f9c2-6205-45e0-88ee-ac5c3d0fafed tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:27:33.534832 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-c4e1f9c2-6205-45e0-88ee-ac5c3d0fafed tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:27:33.535593 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-c4e1f9c2-6205-45e0-88ee-ac5c3d0fafed tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:27:33.536022 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-c4e1f9c2-6205-45e0-88ee-ac5c3d0fafed tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:27:33.703636 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-c565bdc5-0e44-401b-a482-8da785a7484f tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:27:33.704303 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-c565bdc5-0e44-401b-a482-8da785a7484f tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] [instance: 5ddbfaaa-fabf-4324-941c-8868625ffefc] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:27:33.710882 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-c565bdc5-0e44-401b-a482-8da785a7484f tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:27:33.711330 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-c565bdc5-0e44-401b-a482-8da785a7484f tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:27:33.712305 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-c565bdc5-0e44-401b-a482-8da785a7484f tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:27:33.712746 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-c565bdc5-0e44-401b-a482-8da785a7484f tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:27:33.798563 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-c4e1f9c2-6205-45e0-88ee-ac5c3d0fafed tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d4e8ac9538f42c9b637bd9e086668b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfc480343d4d493bb4295b055e274df5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:27:33.810306 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-c4e1f9c2-6205-45e0-88ee-ac5c3d0fafed tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] 10.222.0.11 "GET /compute/v2.1/servers/b89eca0e-d486-4b3a-a41a-aa02de394cff" status: 200 len: 1317 microversion: 2.1 time: 0.286395 Nov 17 03:27:33.821886 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 266/518] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:27:33 2021] GET /compute/v2.1/servers/b89eca0e-d486-4b3a-a41a-aa02de394cff => generated 1317 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:27:33.862452 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-c565bdc5-0e44-401b-a482-8da785a7484f tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80763e09d44c475ea2425b22874e9612', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fef02a1dd77946a2ac0e0414b557435f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:27:33.869948 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-c565bdc5-0e44-401b-a482-8da785a7484f tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] 10.222.0.11 "GET /compute/v2.1/servers/5ddbfaaa-fabf-4324-941c-8868625ffefc" status: 200 len: 1266 microversion: 2.1 time: 0.170127 Nov 17 03:27:33.870526 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 253/519] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:27:33 2021] GET /compute/v2.1/servers/5ddbfaaa-fabf-4324-941c-8868625ffefc => generated 1266 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:27:33.970523 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-e728aa39-81c1-49d0-a05a-236e72421358 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:27:33.971249 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-e728aa39-81c1-49d0-a05a-236e72421358 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] [instance: 5d54db85-b991-4890-abaa-952413baa2e7] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:27:33.977571 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-e728aa39-81c1-49d0-a05a-236e72421358 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:27:33.978033 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-e728aa39-81c1-49d0-a05a-236e72421358 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:27:33.978783 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-e728aa39-81c1-49d0-a05a-236e72421358 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:27:33.979196 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-e728aa39-81c1-49d0-a05a-236e72421358 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:27:34.074817 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-8ca38395-9984-4d0b-ad80-f4375b8685bc tempest-AttachVolumeTestJSON-1651611701 tempest-AttachVolumeTestJSON-1651611701-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 17 03:27:34.075870 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-8ca38395-9984-4d0b-ad80-f4375b8685bc tempest-AttachVolumeTestJSON-1651611701 tempest-AttachVolumeTestJSON-1651611701-project] [instance: 5e11ea9c-f66a-4962-b5ca-b95784624824] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:27:34.082928 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-8ca38395-9984-4d0b-ad80-f4375b8685bc tempest-AttachVolumeTestJSON-1651611701 tempest-AttachVolumeTestJSON-1651611701-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:27:34.083470 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-8ca38395-9984-4d0b-ad80-f4375b8685bc tempest-AttachVolumeTestJSON-1651611701 tempest-AttachVolumeTestJSON-1651611701-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:27:34.084310 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-8ca38395-9984-4d0b-ad80-f4375b8685bc tempest-AttachVolumeTestJSON-1651611701 tempest-AttachVolumeTestJSON-1651611701-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:27:34.084846 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-8ca38395-9984-4d0b-ad80-f4375b8685bc tempest-AttachVolumeTestJSON-1651611701 tempest-AttachVolumeTestJSON-1651611701-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:27:34.199162 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-8ca38395-9984-4d0b-ad80-f4375b8685bc tempest-AttachVolumeTestJSON-1651611701 tempest-AttachVolumeTestJSON-1651611701-project] 10.222.0.11 "POST /compute/v2.1/servers/5e11ea9c-f66a-4962-b5ca-b95784624824/action" status: 200 len: 27185 microversion: 2.1 time: 0.128156 Nov 17 03:27:34.199821 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 254/520] 10.222.0.11 () {60 vars in 1277 bytes} [Wed Nov 17 03:27:34 2021] POST /compute/v2.1/servers/5e11ea9c-f66a-4962-b5ca-b95784624824/action => generated 27185 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 17 03:27:34.236736 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-e728aa39-81c1-49d0-a05a-236e72421358 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37f21d6d15cf40a586edda211219fd08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ebb970305844dccacf48a7d8d47ecf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:27:34.245297 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-e728aa39-81c1-49d0-a05a-236e72421358 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '37f21d6d15cf40a586edda211219fd08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ebb970305844dccacf48a7d8d47ecf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:27:34.246795 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-e728aa39-81c1-49d0-a05a-236e72421358 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '37f21d6d15cf40a586edda211219fd08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ebb970305844dccacf48a7d8d47ecf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:27:34.247948 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-e728aa39-81c1-49d0-a05a-236e72421358 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] 10.222.0.11 "GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7" status: 200 len: 1725 microversion: 2.20 time: 0.281644 Nov 17 03:27:34.248500 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 267/521] 10.222.0.11 () {60 vars in 1276 bytes} [Wed Nov 17 03:27:33 2021] GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7 => generated 1725 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 17 03:27:34.324337 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-d6ae42a3-ef45-4138-bb96-356143d9ceab tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:27:34.325059 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-d6ae42a3-ef45-4138-bb96-356143d9ceab tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] [instance: 15abb40f-daf9-4c4b-ac9c-55f57ee7b938] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:27:34.332053 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-d6ae42a3-ef45-4138-bb96-356143d9ceab tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:27:34.332491 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-d6ae42a3-ef45-4138-bb96-356143d9ceab tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:27:34.333276 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-d6ae42a3-ef45-4138-bb96-356143d9ceab tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:27:34.333703 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-d6ae42a3-ef45-4138-bb96-356143d9ceab tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:27:34.383309 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-3af10b74-dd83-4f6d-9eb7-7db546e087ba tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:27:34.384580 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-3af10b74-dd83-4f6d-9eb7-7db546e087ba tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] [instance: a49437df-3059-4528-8328-2f3471d5fb45] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:27:34.391626 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-3af10b74-dd83-4f6d-9eb7-7db546e087ba tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:27:34.392077 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-3af10b74-dd83-4f6d-9eb7-7db546e087ba tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:27:34.393087 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-3af10b74-dd83-4f6d-9eb7-7db546e087ba tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:27:34.393525 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-3af10b74-dd83-4f6d-9eb7-7db546e087ba tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:27:34.477416 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-d6ae42a3-ef45-4138-bb96-356143d9ceab tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a792b5b7e6f7461b8d802a5abaaa9518', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e843a3fb49f41dcb376184d7e156528', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:27:34.485446 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-d6ae42a3-ef45-4138-bb96-356143d9ceab tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] 10.222.0.11 "GET /compute/v2.1/servers/15abb40f-daf9-4c4b-ac9c-55f57ee7b938" status: 200 len: 1319 microversion: 2.1 time: 0.165143 Nov 17 03:27:34.486079 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 255/522] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:27:34 2021] GET /compute/v2.1/servers/15abb40f-daf9-4c4b-ac9c-55f57ee7b938 => generated 1319 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:27:34.609306 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-3af10b74-dd83-4f6d-9eb7-7db546e087ba tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f046401c6a04f6495ebe0821120bd72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a58e89ceeea4a9c8a72a1de4bcaf2d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:27:34.618874 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-3af10b74-dd83-4f6d-9eb7-7db546e087ba tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] 10.222.0.11 "GET /compute/v2.1/servers/a49437df-3059-4528-8328-2f3471d5fb45" status: 200 len: 1514 microversion: 2.1 time: 0.239817 Nov 17 03:27:34.619601 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 268/523] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:27:34 2021] GET /compute/v2.1/servers/a49437df-3059-4528-8328-2f3471d5fb45 => generated 1514 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:27:34.849914 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-59ccb0ca-11fc-47fc-9103-bc669fa6270f tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:27:34.850502 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-59ccb0ca-11fc-47fc-9103-bc669fa6270f tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] [instance: b89eca0e-d486-4b3a-a41a-aa02de394cff] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:27:34.858923 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-59ccb0ca-11fc-47fc-9103-bc669fa6270f tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:27:34.859362 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-59ccb0ca-11fc-47fc-9103-bc669fa6270f tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:27:34.864724 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-59ccb0ca-11fc-47fc-9103-bc669fa6270f tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:27:34.865388 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-59ccb0ca-11fc-47fc-9103-bc669fa6270f tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:27:34.887891 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-f9cca624-b176-402c-ac93-95c30801d9e7 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:27:34.888572 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-f9cca624-b176-402c-ac93-95c30801d9e7 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] [instance: 5ddbfaaa-fabf-4324-941c-8868625ffefc] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:27:34.897585 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-f9cca624-b176-402c-ac93-95c30801d9e7 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:27:34.898030 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-f9cca624-b176-402c-ac93-95c30801d9e7 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:27:34.909020 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-f9cca624-b176-402c-ac93-95c30801d9e7 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:27:34.909020 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-f9cca624-b176-402c-ac93-95c30801d9e7 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:27:35.014384 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-59ccb0ca-11fc-47fc-9103-bc669fa6270f tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d4e8ac9538f42c9b637bd9e086668b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfc480343d4d493bb4295b055e274df5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:27:35.022721 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-59ccb0ca-11fc-47fc-9103-bc669fa6270f tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] 10.222.0.11 "GET /compute/v2.1/servers/b89eca0e-d486-4b3a-a41a-aa02de394cff" status: 200 len: 1317 microversion: 2.1 time: 0.196800 Nov 17 03:27:35.023288 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 256/524] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:27:34 2021] GET /compute/v2.1/servers/b89eca0e-d486-4b3a-a41a-aa02de394cff => generated 1317 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:27:35.027942 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [req-218a1394-219c-42aa-b1b1-a8c2659443d6 req-572a42d2-0773-47f2-8263-82dd0b4b6cbd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b89eca0e-d486-4b3a-a41a-aa02de394cff", "tag": "654305a1-4d89-4fdf-9462-aacfa6438fa1"}]} {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 17 03:27:35.029939 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 17 03:27:35.029939 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: warnings.warn(msg) Nov 17 03:27:35.037037 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [req-218a1394-219c-42aa-b1b1-a8c2659443d6 req-572a42d2-0773-47f2-8263-82dd0b4b6cbd service nova] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:27:35.037510 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [req-218a1394-219c-42aa-b1b1-a8c2659443d6 req-572a42d2-0773-47f2-8263-82dd0b4b6cbd service nova] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:27:35.050906 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.compute.server_external_events [req-218a1394-219c-42aa-b1b1-a8c2659443d6 req-572a42d2-0773-47f2-8263-82dd0b4b6cbd service nova] Creating event network-changed:654305a1-4d89-4fdf-9462-aacfa6438fa1 for instance b89eca0e-d486-4b3a-a41a-aa02de394cff on hv-cinder-81803 Nov 17 03:27:35.056355 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [req-218a1394-219c-42aa-b1b1-a8c2659443d6 req-572a42d2-0773-47f2-8263-82dd0b4b6cbd service nova] 10.222.0.11 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031917 Nov 17 03:27:35.057576 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 257/525] 10.222.0.11 () {64 vars in 1317 bytes} [Wed Nov 17 03:27:35 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 17 03:27:35.122628 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-f9cca624-b176-402c-ac93-95c30801d9e7 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80763e09d44c475ea2425b22874e9612', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fef02a1dd77946a2ac0e0414b557435f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:27:35.130382 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-f9cca624-b176-402c-ac93-95c30801d9e7 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] 10.222.0.11 "GET /compute/v2.1/servers/5ddbfaaa-fabf-4324-941c-8868625ffefc" status: 200 len: 1266 microversion: 2.1 time: 0.247053 Nov 17 03:27:35.130947 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 269/526] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:27:34 2021] GET /compute/v2.1/servers/5ddbfaaa-fabf-4324-941c-8868625ffefc => generated 1266 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 17 03:27:35.212578 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-0333f324-4af3-404d-85ba-507b5d0f5c45 tempest-AttachVolumeTestJSON-1651611701 tempest-AttachVolumeTestJSON-1651611701-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 17 03:27:35.213684 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-0333f324-4af3-404d-85ba-507b5d0f5c45 tempest-AttachVolumeTestJSON-1651611701 tempest-AttachVolumeTestJSON-1651611701-project] [instance: 5e11ea9c-f66a-4962-b5ca-b95784624824] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:27:35.220269 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-0333f324-4af3-404d-85ba-507b5d0f5c45 tempest-AttachVolumeTestJSON-1651611701 tempest-AttachVolumeTestJSON-1651611701-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:27:35.220684 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-0333f324-4af3-404d-85ba-507b5d0f5c45 tempest-AttachVolumeTestJSON-1651611701 tempest-AttachVolumeTestJSON-1651611701-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:27:35.221526 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-0333f324-4af3-404d-85ba-507b5d0f5c45 tempest-AttachVolumeTestJSON-1651611701 tempest-AttachVolumeTestJSON-1651611701-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:27:35.222976 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-0333f324-4af3-404d-85ba-507b5d0f5c45 tempest-AttachVolumeTestJSON-1651611701 tempest-AttachVolumeTestJSON-1651611701-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:27:35.265804 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-fd726d80-53b6-4fce-ade8-2c51e18ab503 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:27:35.266430 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-fd726d80-53b6-4fce-ade8-2c51e18ab503 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] [instance: 5d54db85-b991-4890-abaa-952413baa2e7] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:27:35.273149 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-fd726d80-53b6-4fce-ade8-2c51e18ab503 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:27:35.273698 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-fd726d80-53b6-4fce-ade8-2c51e18ab503 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:27:35.274523 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-fd726d80-53b6-4fce-ade8-2c51e18ab503 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:27:35.274963 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-fd726d80-53b6-4fce-ade8-2c51e18ab503 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:27:35.378827 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-0333f324-4af3-404d-85ba-507b5d0f5c45 tempest-AttachVolumeTestJSON-1651611701 tempest-AttachVolumeTestJSON-1651611701-project] 10.222.0.11 "POST /compute/v2.1/servers/5e11ea9c-f66a-4962-b5ca-b95784624824/action" status: 200 len: 27576 microversion: 2.1 time: 0.170519 Nov 17 03:27:35.379523 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 258/527] 10.222.0.11 () {60 vars in 1277 bytes} [Wed Nov 17 03:27:35 2021] POST /compute/v2.1/servers/5e11ea9c-f66a-4962-b5ca-b95784624824/action => generated 27576 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 17 03:27:35.488356 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-fd726d80-53b6-4fce-ade8-2c51e18ab503 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37f21d6d15cf40a586edda211219fd08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ebb970305844dccacf48a7d8d47ecf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:27:35.497121 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-fd726d80-53b6-4fce-ade8-2c51e18ab503 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '37f21d6d15cf40a586edda211219fd08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ebb970305844dccacf48a7d8d47ecf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:27:35.498969 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-fd726d80-53b6-4fce-ade8-2c51e18ab503 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '37f21d6d15cf40a586edda211219fd08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ebb970305844dccacf48a7d8d47ecf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:27:35.500391 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-fd726d80-53b6-4fce-ade8-2c51e18ab503 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] 10.222.0.11 "GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7" status: 200 len: 1725 microversion: 2.20 time: 0.238584 Nov 17 03:27:35.501437 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 270/528] 10.222.0.11 () {60 vars in 1276 bytes} [Wed Nov 17 03:27:35 2021] GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7 => generated 1725 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 17 03:27:35.507665 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-c1f3b5df-914d-4a2e-b1e5-db62a1503b52 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:27:35.508375 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-c1f3b5df-914d-4a2e-b1e5-db62a1503b52 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] [instance: 15abb40f-daf9-4c4b-ac9c-55f57ee7b938] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:27:35.516334 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-c1f3b5df-914d-4a2e-b1e5-db62a1503b52 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:27:35.516704 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-c1f3b5df-914d-4a2e-b1e5-db62a1503b52 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:27:35.517571 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-c1f3b5df-914d-4a2e-b1e5-db62a1503b52 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:27:35.518005 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-c1f3b5df-914d-4a2e-b1e5-db62a1503b52 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:27:35.651952 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-c1f3b5df-914d-4a2e-b1e5-db62a1503b52 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a792b5b7e6f7461b8d802a5abaaa9518', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e843a3fb49f41dcb376184d7e156528', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:27:35.661278 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-c1f3b5df-914d-4a2e-b1e5-db62a1503b52 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] 10.222.0.11 "GET /compute/v2.1/servers/15abb40f-daf9-4c4b-ac9c-55f57ee7b938" status: 200 len: 1319 microversion: 2.1 time: 0.162032 Nov 17 03:27:35.661855 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 259/529] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:27:35 2021] GET /compute/v2.1/servers/15abb40f-daf9-4c4b-ac9c-55f57ee7b938 => generated 1319 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:27:35.848604 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [req-0f1f3ccc-7472-49e4-b7d3-c9f67b7ca6a8 req-434d7b31-441e-48e1-9197-17b6f02df746 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "15abb40f-daf9-4c4b-ac9c-55f57ee7b938", "name": "network-vif-plugged", "status": "completed", "tag": "b4c43900-e1e8-426d-b98e-b87ad7f920f6"}]} {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 17 03:27:35.850699 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 17 03:27:35.850699 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: warnings.warn(msg) Nov 17 03:27:35.859248 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [req-0f1f3ccc-7472-49e4-b7d3-c9f67b7ca6a8 req-434d7b31-441e-48e1-9197-17b6f02df746 service nova] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:27:35.859248 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [req-0f1f3ccc-7472-49e4-b7d3-c9f67b7ca6a8 req-434d7b31-441e-48e1-9197-17b6f02df746 service nova] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:27:35.870233 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.compute.server_external_events [req-0f1f3ccc-7472-49e4-b7d3-c9f67b7ca6a8 req-434d7b31-441e-48e1-9197-17b6f02df746 service nova] Creating event network-vif-plugged:b4c43900-e1e8-426d-b98e-b87ad7f920f6 for instance 15abb40f-daf9-4c4b-ac9c-55f57ee7b938 on hv-cinder-81803 Nov 17 03:27:35.875046 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [req-0f1f3ccc-7472-49e4-b7d3-c9f67b7ca6a8 req-434d7b31-441e-48e1-9197-17b6f02df746 service nova] 10.222.0.11 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030278 Nov 17 03:27:35.875926 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 271/530] 10.222.0.11 () {64 vars in 1317 bytes} [Wed Nov 17 03:27:35 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 17 03:27:35.970305 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-286a6822-c193-4cc5-b2f8-48e3dce8ad1b tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:27:35.970913 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-286a6822-c193-4cc5-b2f8-48e3dce8ad1b tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] [instance: a49437df-3059-4528-8328-2f3471d5fb45] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:27:35.977396 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-286a6822-c193-4cc5-b2f8-48e3dce8ad1b tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:27:35.977845 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-286a6822-c193-4cc5-b2f8-48e3dce8ad1b tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:27:35.978614 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-286a6822-c193-4cc5-b2f8-48e3dce8ad1b tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:27:35.979053 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-286a6822-c193-4cc5-b2f8-48e3dce8ad1b tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:27:36.039988 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-207fc8f2-7a80-40cb-a054-e5ecc0d14d75 tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:27:36.040796 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-207fc8f2-7a80-40cb-a054-e5ecc0d14d75 tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] [instance: b89eca0e-d486-4b3a-a41a-aa02de394cff] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:27:36.047319 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-207fc8f2-7a80-40cb-a054-e5ecc0d14d75 tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:27:36.047760 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-207fc8f2-7a80-40cb-a054-e5ecc0d14d75 tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:27:36.048568 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-207fc8f2-7a80-40cb-a054-e5ecc0d14d75 tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:27:36.054812 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-207fc8f2-7a80-40cb-a054-e5ecc0d14d75 tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:27:36.122625 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-286a6822-c193-4cc5-b2f8-48e3dce8ad1b tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f046401c6a04f6495ebe0821120bd72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a58e89ceeea4a9c8a72a1de4bcaf2d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:27:36.131866 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-286a6822-c193-4cc5-b2f8-48e3dce8ad1b tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] 10.222.0.11 "GET /compute/v2.1/servers/a49437df-3059-4528-8328-2f3471d5fb45" status: 200 len: 1514 microversion: 2.1 time: 0.165158 Nov 17 03:27:36.133033 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 260/531] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:27:35 2021] GET /compute/v2.1/servers/a49437df-3059-4528-8328-2f3471d5fb45 => generated 1514 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:27:36.147258 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-dee0d238-2d4a-4d9b-a2a4-a179c82cd4c5 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:27:36.147984 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-dee0d238-2d4a-4d9b-a2a4-a179c82cd4c5 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] [instance: 5ddbfaaa-fabf-4324-941c-8868625ffefc] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:27:36.154142 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-dee0d238-2d4a-4d9b-a2a4-a179c82cd4c5 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:27:36.154990 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-dee0d238-2d4a-4d9b-a2a4-a179c82cd4c5 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:27:36.155783 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-dee0d238-2d4a-4d9b-a2a4-a179c82cd4c5 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:27:36.156247 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-dee0d238-2d4a-4d9b-a2a4-a179c82cd4c5 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:27:36.245357 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-207fc8f2-7a80-40cb-a054-e5ecc0d14d75 tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d4e8ac9538f42c9b637bd9e086668b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfc480343d4d493bb4295b055e274df5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:27:36.253572 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-207fc8f2-7a80-40cb-a054-e5ecc0d14d75 tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] 10.222.0.11 "GET /compute/v2.1/servers/b89eca0e-d486-4b3a-a41a-aa02de394cff" status: 200 len: 1317 microversion: 2.1 time: 0.217664 Nov 17 03:27:36.254158 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 272/532] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:27:36 2021] GET /compute/v2.1/servers/b89eca0e-d486-4b3a-a41a-aa02de394cff => generated 1317 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:27:36.258630 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-cd1d2361-c9f7-4d52-9656-fa48587b6ed4 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "93480bc3-2042-416b-9af5-bd61259a2345"}} {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 17 03:27:36.259667 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-cd1d2361-c9f7-4d52-9656-fa48587b6ed4 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] [instance: a49437df-3059-4528-8328-2f3471d5fb45] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:27:36.265323 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-cd1d2361-c9f7-4d52-9656-fa48587b6ed4 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:27:36.265775 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-cd1d2361-c9f7-4d52-9656-fa48587b6ed4 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:27:36.266554 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-cd1d2361-c9f7-4d52-9656-fa48587b6ed4 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:27:36.266986 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-cd1d2361-c9f7-4d52-9656-fa48587b6ed4 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:27:36.296567 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-dee0d238-2d4a-4d9b-a2a4-a179c82cd4c5 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80763e09d44c475ea2425b22874e9612', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fef02a1dd77946a2ac0e0414b557435f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:27:36.304437 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-dee0d238-2d4a-4d9b-a2a4-a179c82cd4c5 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] 10.222.0.11 "GET /compute/v2.1/servers/5ddbfaaa-fabf-4324-941c-8868625ffefc" status: 200 len: 1266 microversion: 2.1 time: 0.161041 Nov 17 03:27:36.305068 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 261/533] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:27:36 2021] GET /compute/v2.1/servers/5ddbfaaa-fabf-4324-941c-8868625ffefc => generated 1266 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:27:36.395839 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-9992533e-619f-4dbc-9cc0-50a93ee15b66 tempest-AttachVolumeTestJSON-1651611701 tempest-AttachVolumeTestJSON-1651611701-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 17 03:27:36.397487 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-9992533e-619f-4dbc-9cc0-50a93ee15b66 tempest-AttachVolumeTestJSON-1651611701 tempest-AttachVolumeTestJSON-1651611701-project] [instance: 5e11ea9c-f66a-4962-b5ca-b95784624824] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:27:36.407570 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-9992533e-619f-4dbc-9cc0-50a93ee15b66 tempest-AttachVolumeTestJSON-1651611701 tempest-AttachVolumeTestJSON-1651611701-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:27:36.408500 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-9992533e-619f-4dbc-9cc0-50a93ee15b66 tempest-AttachVolumeTestJSON-1651611701 tempest-AttachVolumeTestJSON-1651611701-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:27:36.409310 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-9992533e-619f-4dbc-9cc0-50a93ee15b66 tempest-AttachVolumeTestJSON-1651611701 tempest-AttachVolumeTestJSON-1651611701-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:27:36.409730 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-9992533e-619f-4dbc-9cc0-50a93ee15b66 tempest-AttachVolumeTestJSON-1651611701 tempest-AttachVolumeTestJSON-1651611701-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:27:36.815595 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-9992533e-619f-4dbc-9cc0-50a93ee15b66 tempest-AttachVolumeTestJSON-1651611701 tempest-AttachVolumeTestJSON-1651611701-project] 10.222.0.11 "POST /compute/v2.1/servers/5e11ea9c-f66a-4962-b5ca-b95784624824/action" status: 200 len: 27752 microversion: 2.1 time: 0.426077 Nov 17 03:27:36.816819 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 262/534] 10.222.0.11 () {60 vars in 1277 bytes} [Wed Nov 17 03:27:36 2021] POST /compute/v2.1/servers/5e11ea9c-f66a-4962-b5ca-b95784624824/action => generated 27752 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 17 03:27:36.821878 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-f745af2e-3815-4952-ae37-d8ec2ad6777c tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:27:36.822704 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-f745af2e-3815-4952-ae37-d8ec2ad6777c tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] [instance: 5d54db85-b991-4890-abaa-952413baa2e7] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:27:36.830317 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-f745af2e-3815-4952-ae37-d8ec2ad6777c tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:27:36.830930 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-f745af2e-3815-4952-ae37-d8ec2ad6777c tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:27:36.831703 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-f745af2e-3815-4952-ae37-d8ec2ad6777c tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:27:36.832134 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-f745af2e-3815-4952-ae37-d8ec2ad6777c tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:27:36.939806 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-cd1d2361-c9f7-4d52-9656-fa48587b6ed4 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] 10.222.0.11 "POST /compute/v2.1/servers/a49437df-3059-4528-8328-2f3471d5fb45/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.684338 Nov 17 03:27:36.940931 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 273/535] 10.222.0.11 () {60 vars in 1322 bytes} [Wed Nov 17 03:27:36 2021] POST /compute/v2.1/servers/a49437df-3059-4528-8328-2f3471d5fb45/os-volume_attachments => generated 194 bytes in 686 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 17 03:27:36.945856 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-57fd4af3-678b-4f29-95d2-1e51ceabcd4d tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:27:36.953824 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-57fd4af3-678b-4f29-95d2-1e51ceabcd4d tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] [instance: 15abb40f-daf9-4c4b-ac9c-55f57ee7b938] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:27:36.953824 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-57fd4af3-678b-4f29-95d2-1e51ceabcd4d tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:27:36.954490 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-57fd4af3-678b-4f29-95d2-1e51ceabcd4d tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:27:36.955427 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-57fd4af3-678b-4f29-95d2-1e51ceabcd4d tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:27:36.956174 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-57fd4af3-678b-4f29-95d2-1e51ceabcd4d tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:27:36.990589 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-f745af2e-3815-4952-ae37-d8ec2ad6777c tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37f21d6d15cf40a586edda211219fd08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ebb970305844dccacf48a7d8d47ecf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:27:36.999074 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-f745af2e-3815-4952-ae37-d8ec2ad6777c tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '37f21d6d15cf40a586edda211219fd08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ebb970305844dccacf48a7d8d47ecf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:27:37.000565 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-f745af2e-3815-4952-ae37-d8ec2ad6777c tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '37f21d6d15cf40a586edda211219fd08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ebb970305844dccacf48a7d8d47ecf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:27:37.001768 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-f745af2e-3815-4952-ae37-d8ec2ad6777c tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] 10.222.0.11 "GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7" status: 200 len: 1725 microversion: 2.20 time: 0.184047 Nov 17 03:27:37.003389 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 263/536] 10.222.0.11 () {60 vars in 1276 bytes} [Wed Nov 17 03:27:36 2021] GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7 => generated 1725 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 17 03:27:37.093366 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-57fd4af3-678b-4f29-95d2-1e51ceabcd4d tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a792b5b7e6f7461b8d802a5abaaa9518', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e843a3fb49f41dcb376184d7e156528', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:27:37.101430 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-57fd4af3-678b-4f29-95d2-1e51ceabcd4d tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] 10.222.0.11 "GET /compute/v2.1/servers/15abb40f-daf9-4c4b-ac9c-55f57ee7b938" status: 200 len: 1319 microversion: 2.1 time: 0.159405 Nov 17 03:27:37.101989 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 274/537] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:27:36 2021] GET /compute/v2.1/servers/15abb40f-daf9-4c4b-ac9c-55f57ee7b938 => generated 1319 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:27:37.270906 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-ff5e5472-2ccd-41d7-9f61-7b6d469c7c9d tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:27:37.271541 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-ff5e5472-2ccd-41d7-9f61-7b6d469c7c9d tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] [instance: b89eca0e-d486-4b3a-a41a-aa02de394cff] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:27:37.278447 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-ff5e5472-2ccd-41d7-9f61-7b6d469c7c9d tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:27:37.278903 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-ff5e5472-2ccd-41d7-9f61-7b6d469c7c9d tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:27:37.279676 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-ff5e5472-2ccd-41d7-9f61-7b6d469c7c9d tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:27:37.280105 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-ff5e5472-2ccd-41d7-9f61-7b6d469c7c9d tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:27:37.321422 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-d661a6e5-feb7-4b6d-9795-a11ea3ecbd7b tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:27:37.322114 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-d661a6e5-feb7-4b6d-9795-a11ea3ecbd7b tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] [instance: 5ddbfaaa-fabf-4324-941c-8868625ffefc] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:27:37.328446 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-d661a6e5-feb7-4b6d-9795-a11ea3ecbd7b tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:27:37.328913 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-d661a6e5-feb7-4b6d-9795-a11ea3ecbd7b tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:27:37.329683 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-d661a6e5-feb7-4b6d-9795-a11ea3ecbd7b tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:27:37.330107 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-d661a6e5-feb7-4b6d-9795-a11ea3ecbd7b tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:27:37.417637 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-ff5e5472-2ccd-41d7-9f61-7b6d469c7c9d tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d4e8ac9538f42c9b637bd9e086668b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfc480343d4d493bb4295b055e274df5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:27:37.425059 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-ff5e5472-2ccd-41d7-9f61-7b6d469c7c9d tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] 10.222.0.11 "GET /compute/v2.1/servers/b89eca0e-d486-4b3a-a41a-aa02de394cff" status: 200 len: 1317 microversion: 2.1 time: 0.158066 Nov 17 03:27:37.425735 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 264/538] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:27:37 2021] GET /compute/v2.1/servers/b89eca0e-d486-4b3a-a41a-aa02de394cff => generated 1317 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:27:37.479194 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-d661a6e5-feb7-4b6d-9795-a11ea3ecbd7b tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80763e09d44c475ea2425b22874e9612', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fef02a1dd77946a2ac0e0414b557435f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:27:37.487158 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-d661a6e5-feb7-4b6d-9795-a11ea3ecbd7b tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] 10.222.0.11 "GET /compute/v2.1/servers/5ddbfaaa-fabf-4324-941c-8868625ffefc" status: 200 len: 1266 microversion: 2.1 time: 0.169335 Nov 17 03:27:37.487719 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 275/539] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:27:37 2021] GET /compute/v2.1/servers/5ddbfaaa-fabf-4324-941c-8868625ffefc => generated 1266 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:27:37.827599 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-e8183ad0-8db9-4a4d-888f-842cbec84a54 tempest-AttachVolumeTestJSON-1651611701 tempest-AttachVolumeTestJSON-1651611701-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 17 03:27:37.828710 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-e8183ad0-8db9-4a4d-888f-842cbec84a54 tempest-AttachVolumeTestJSON-1651611701 tempest-AttachVolumeTestJSON-1651611701-project] [instance: 5e11ea9c-f66a-4962-b5ca-b95784624824] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:27:37.835434 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-e8183ad0-8db9-4a4d-888f-842cbec84a54 tempest-AttachVolumeTestJSON-1651611701 tempest-AttachVolumeTestJSON-1651611701-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:27:37.835887 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-e8183ad0-8db9-4a4d-888f-842cbec84a54 tempest-AttachVolumeTestJSON-1651611701 tempest-AttachVolumeTestJSON-1651611701-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:27:37.836679 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-e8183ad0-8db9-4a4d-888f-842cbec84a54 tempest-AttachVolumeTestJSON-1651611701 tempest-AttachVolumeTestJSON-1651611701-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:27:37.837254 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-e8183ad0-8db9-4a4d-888f-842cbec84a54 tempest-AttachVolumeTestJSON-1651611701 tempest-AttachVolumeTestJSON-1651611701-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:27:38.020737 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-bd42bb7e-dd76-49f0-b184-0fa192fc6873 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:27:38.021376 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-bd42bb7e-dd76-49f0-b184-0fa192fc6873 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] [instance: 5d54db85-b991-4890-abaa-952413baa2e7] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:27:38.027675 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-bd42bb7e-dd76-49f0-b184-0fa192fc6873 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:27:38.028118 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-bd42bb7e-dd76-49f0-b184-0fa192fc6873 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:27:38.028980 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-bd42bb7e-dd76-49f0-b184-0fa192fc6873 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:27:38.029409 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-bd42bb7e-dd76-49f0-b184-0fa192fc6873 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:27:38.093882 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-e8183ad0-8db9-4a4d-888f-842cbec84a54 tempest-AttachVolumeTestJSON-1651611701 tempest-AttachVolumeTestJSON-1651611701-project] 10.222.0.11 "POST /compute/v2.1/servers/5e11ea9c-f66a-4962-b5ca-b95784624824/action" status: 200 len: 27989 microversion: 2.1 time: 0.269876 Nov 17 03:27:38.094719 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 265/540] 10.222.0.11 () {60 vars in 1277 bytes} [Wed Nov 17 03:27:37 2021] POST /compute/v2.1/servers/5e11ea9c-f66a-4962-b5ca-b95784624824/action => generated 27989 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 17 03:27:38.118767 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-0f766d5b-e67e-4248-93d3-d89875c8c17d tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:27:38.119486 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-0f766d5b-e67e-4248-93d3-d89875c8c17d tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] [instance: 15abb40f-daf9-4c4b-ac9c-55f57ee7b938] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:27:38.126376 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-0f766d5b-e67e-4248-93d3-d89875c8c17d tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:27:38.126809 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-0f766d5b-e67e-4248-93d3-d89875c8c17d tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:27:38.127762 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-0f766d5b-e67e-4248-93d3-d89875c8c17d tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:27:38.128192 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-0f766d5b-e67e-4248-93d3-d89875c8c17d tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:27:38.170878 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-bd42bb7e-dd76-49f0-b184-0fa192fc6873 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37f21d6d15cf40a586edda211219fd08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ebb970305844dccacf48a7d8d47ecf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:27:38.181630 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-bd42bb7e-dd76-49f0-b184-0fa192fc6873 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '37f21d6d15cf40a586edda211219fd08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ebb970305844dccacf48a7d8d47ecf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:27:38.183716 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-bd42bb7e-dd76-49f0-b184-0fa192fc6873 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '37f21d6d15cf40a586edda211219fd08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ebb970305844dccacf48a7d8d47ecf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:27:38.184891 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-bd42bb7e-dd76-49f0-b184-0fa192fc6873 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] 10.222.0.11 "GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7" status: 200 len: 1725 microversion: 2.20 time: 0.167953 Nov 17 03:27:38.185911 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 276/541] 10.222.0.11 () {60 vars in 1276 bytes} [Wed Nov 17 03:27:38 2021] GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7 => generated 1725 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 17 03:27:38.274499 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-0f766d5b-e67e-4248-93d3-d89875c8c17d tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a792b5b7e6f7461b8d802a5abaaa9518', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e843a3fb49f41dcb376184d7e156528', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:27:38.281860 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-0f766d5b-e67e-4248-93d3-d89875c8c17d tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] 10.222.0.11 "GET /compute/v2.1/servers/15abb40f-daf9-4c4b-ac9c-55f57ee7b938" status: 200 len: 1319 microversion: 2.1 time: 0.167149 Nov 17 03:27:38.282438 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 266/542] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:27:38 2021] GET /compute/v2.1/servers/15abb40f-daf9-4c4b-ac9c-55f57ee7b938 => generated 1319 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:27:38.447256 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-6b457660-9c87-48b3-80f9-3a62f627bade tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:27:38.448019 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-6b457660-9c87-48b3-80f9-3a62f627bade tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] [instance: b89eca0e-d486-4b3a-a41a-aa02de394cff] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:27:38.459192 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-6b457660-9c87-48b3-80f9-3a62f627bade tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:27:38.459919 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-6b457660-9c87-48b3-80f9-3a62f627bade tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:27:38.461308 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-6b457660-9c87-48b3-80f9-3a62f627bade tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:27:38.462010 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-6b457660-9c87-48b3-80f9-3a62f627bade tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:27:38.503301 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-4c9d94a8-5e4d-432e-b220-3f6eb0953433 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:27:38.503903 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-4c9d94a8-5e4d-432e-b220-3f6eb0953433 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] [instance: 5ddbfaaa-fabf-4324-941c-8868625ffefc] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:27:38.510607 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-4c9d94a8-5e4d-432e-b220-3f6eb0953433 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:27:38.511028 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-4c9d94a8-5e4d-432e-b220-3f6eb0953433 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:27:38.512570 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-4c9d94a8-5e4d-432e-b220-3f6eb0953433 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:27:38.513029 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-4c9d94a8-5e4d-432e-b220-3f6eb0953433 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:27:38.606462 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-6b457660-9c87-48b3-80f9-3a62f627bade tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d4e8ac9538f42c9b637bd9e086668b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfc480343d4d493bb4295b055e274df5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:27:38.614829 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-6b457660-9c87-48b3-80f9-3a62f627bade tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] 10.222.0.11 "GET /compute/v2.1/servers/b89eca0e-d486-4b3a-a41a-aa02de394cff" status: 200 len: 1317 microversion: 2.1 time: 0.174866 Nov 17 03:27:38.615679 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 277/543] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:27:38 2021] GET /compute/v2.1/servers/b89eca0e-d486-4b3a-a41a-aa02de394cff => generated 1317 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:27:38.653031 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-4c9d94a8-5e4d-432e-b220-3f6eb0953433 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80763e09d44c475ea2425b22874e9612', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fef02a1dd77946a2ac0e0414b557435f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:27:38.664716 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-4c9d94a8-5e4d-432e-b220-3f6eb0953433 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] 10.222.0.11 "GET /compute/v2.1/servers/5ddbfaaa-fabf-4324-941c-8868625ffefc" status: 200 len: 1266 microversion: 2.1 time: 0.164784 Nov 17 03:27:38.665623 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 267/544] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:27:38 2021] GET /compute/v2.1/servers/5ddbfaaa-fabf-4324-941c-8868625ffefc => generated 1266 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 17 03:27:39.107554 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-e85f27ca-99ce-4c59-a9a4-940628d1b854 tempest-AttachVolumeTestJSON-1651611701 tempest-AttachVolumeTestJSON-1651611701-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 17 03:27:39.108519 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-e85f27ca-99ce-4c59-a9a4-940628d1b854 tempest-AttachVolumeTestJSON-1651611701 tempest-AttachVolumeTestJSON-1651611701-project] [instance: 5e11ea9c-f66a-4962-b5ca-b95784624824] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:27:39.115901 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-e85f27ca-99ce-4c59-a9a4-940628d1b854 tempest-AttachVolumeTestJSON-1651611701 tempest-AttachVolumeTestJSON-1651611701-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:27:39.116385 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-e85f27ca-99ce-4c59-a9a4-940628d1b854 tempest-AttachVolumeTestJSON-1651611701 tempest-AttachVolumeTestJSON-1651611701-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:27:39.117311 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-e85f27ca-99ce-4c59-a9a4-940628d1b854 tempest-AttachVolumeTestJSON-1651611701 tempest-AttachVolumeTestJSON-1651611701-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:27:39.117743 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-e85f27ca-99ce-4c59-a9a4-940628d1b854 tempest-AttachVolumeTestJSON-1651611701 tempest-AttachVolumeTestJSON-1651611701-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:27:39.207450 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-e15ebb93-fbf2-4a4c-a255-d72fc8bd3d7c tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:27:39.208511 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-e15ebb93-fbf2-4a4c-a255-d72fc8bd3d7c tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] [instance: 5d54db85-b991-4890-abaa-952413baa2e7] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:27:39.218787 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-e15ebb93-fbf2-4a4c-a255-d72fc8bd3d7c tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:27:39.219536 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-e15ebb93-fbf2-4a4c-a255-d72fc8bd3d7c tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:27:39.220893 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-e15ebb93-fbf2-4a4c-a255-d72fc8bd3d7c tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:27:39.221734 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-e15ebb93-fbf2-4a4c-a255-d72fc8bd3d7c tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:27:39.275253 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-e85f27ca-99ce-4c59-a9a4-940628d1b854 tempest-AttachVolumeTestJSON-1651611701 tempest-AttachVolumeTestJSON-1651611701-project] 10.222.0.11 "POST /compute/v2.1/servers/5e11ea9c-f66a-4962-b5ca-b95784624824/action" status: 200 len: 28178 microversion: 2.1 time: 0.171248 Nov 17 03:27:39.275847 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 278/545] 10.222.0.11 () {60 vars in 1277 bytes} [Wed Nov 17 03:27:39 2021] POST /compute/v2.1/servers/5e11ea9c-f66a-4962-b5ca-b95784624824/action => generated 28178 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 17 03:27:39.299090 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-0d319683-bb1b-49c0-bdfd-2e9b4abc01e2 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:27:39.299883 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-0d319683-bb1b-49c0-bdfd-2e9b4abc01e2 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] [instance: 15abb40f-daf9-4c4b-ac9c-55f57ee7b938] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:27:39.307508 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-0d319683-bb1b-49c0-bdfd-2e9b4abc01e2 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:27:39.307950 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-0d319683-bb1b-49c0-bdfd-2e9b4abc01e2 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:27:39.308720 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-0d319683-bb1b-49c0-bdfd-2e9b4abc01e2 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:27:39.309195 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-0d319683-bb1b-49c0-bdfd-2e9b4abc01e2 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:27:39.362945 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-e15ebb93-fbf2-4a4c-a255-d72fc8bd3d7c tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37f21d6d15cf40a586edda211219fd08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ebb970305844dccacf48a7d8d47ecf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:27:39.371305 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-e15ebb93-fbf2-4a4c-a255-d72fc8bd3d7c tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '37f21d6d15cf40a586edda211219fd08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ebb970305844dccacf48a7d8d47ecf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:27:39.372817 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-e15ebb93-fbf2-4a4c-a255-d72fc8bd3d7c tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '37f21d6d15cf40a586edda211219fd08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ebb970305844dccacf48a7d8d47ecf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:27:39.373955 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-e15ebb93-fbf2-4a4c-a255-d72fc8bd3d7c tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] 10.222.0.11 "GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7" status: 200 len: 1746 microversion: 2.20 time: 0.172969 Nov 17 03:27:39.374521 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 268/546] 10.222.0.11 () {60 vars in 1276 bytes} [Wed Nov 17 03:27:39 2021] GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7 => generated 1746 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 17 03:27:39.447932 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-0d319683-bb1b-49c0-bdfd-2e9b4abc01e2 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a792b5b7e6f7461b8d802a5abaaa9518', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e843a3fb49f41dcb376184d7e156528', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:27:39.457120 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-0d319683-bb1b-49c0-bdfd-2e9b4abc01e2 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] 10.222.0.11 "GET /compute/v2.1/servers/15abb40f-daf9-4c4b-ac9c-55f57ee7b938" status: 200 len: 1506 microversion: 2.1 time: 0.162013 Nov 17 03:27:39.457674 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 279/547] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:27:39 2021] GET /compute/v2.1/servers/15abb40f-daf9-4c4b-ac9c-55f57ee7b938 => generated 1506 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:27:39.631736 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-914ed189-b9cf-4be7-b67b-f896b0f8c12b tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:27:39.632340 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-914ed189-b9cf-4be7-b67b-f896b0f8c12b tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] [instance: b89eca0e-d486-4b3a-a41a-aa02de394cff] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:27:39.638721 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-914ed189-b9cf-4be7-b67b-f896b0f8c12b tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:27:39.639175 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-914ed189-b9cf-4be7-b67b-f896b0f8c12b tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:27:39.639948 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-914ed189-b9cf-4be7-b67b-f896b0f8c12b tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:27:39.640374 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-914ed189-b9cf-4be7-b67b-f896b0f8c12b tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:27:39.686207 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-132238d5-a47b-4242-8f67-c4de0929d69a tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:27:39.686929 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-132238d5-a47b-4242-8f67-c4de0929d69a tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] [instance: 5ddbfaaa-fabf-4324-941c-8868625ffefc] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:27:39.693731 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-132238d5-a47b-4242-8f67-c4de0929d69a tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:27:39.694084 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-132238d5-a47b-4242-8f67-c4de0929d69a tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:27:39.706777 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-132238d5-a47b-4242-8f67-c4de0929d69a tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:27:39.707132 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-132238d5-a47b-4242-8f67-c4de0929d69a tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:27:39.809004 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-914ed189-b9cf-4be7-b67b-f896b0f8c12b tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d4e8ac9538f42c9b637bd9e086668b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfc480343d4d493bb4295b055e274df5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:27:39.818569 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-914ed189-b9cf-4be7-b67b-f896b0f8c12b tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] 10.222.0.11 "GET /compute/v2.1/servers/b89eca0e-d486-4b3a-a41a-aa02de394cff" status: 200 len: 1317 microversion: 2.1 time: 0.190324 Nov 17 03:27:39.819885 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 269/548] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:27:39 2021] GET /compute/v2.1/servers/b89eca0e-d486-4b3a-a41a-aa02de394cff => generated 1317 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:27:39.879779 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-132238d5-a47b-4242-8f67-c4de0929d69a tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80763e09d44c475ea2425b22874e9612', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fef02a1dd77946a2ac0e0414b557435f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:27:39.887179 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-132238d5-a47b-4242-8f67-c4de0929d69a tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] 10.222.0.11 "GET /compute/v2.1/servers/5ddbfaaa-fabf-4324-941c-8868625ffefc" status: 200 len: 1266 microversion: 2.1 time: 0.205090 Nov 17 03:27:39.888605 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 280/549] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:27:39 2021] GET /compute/v2.1/servers/5ddbfaaa-fabf-4324-941c-8868625ffefc => generated 1266 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:27:40.286548 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-bfe5b156-7e59-49b3-82db-84cb847ae388 tempest-AttachVolumeTestJSON-1651611701 tempest-AttachVolumeTestJSON-1651611701-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 17 03:27:40.287685 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-bfe5b156-7e59-49b3-82db-84cb847ae388 tempest-AttachVolumeTestJSON-1651611701 tempest-AttachVolumeTestJSON-1651611701-project] [instance: 5e11ea9c-f66a-4962-b5ca-b95784624824] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:27:40.294404 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-bfe5b156-7e59-49b3-82db-84cb847ae388 tempest-AttachVolumeTestJSON-1651611701 tempest-AttachVolumeTestJSON-1651611701-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:27:40.294899 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-bfe5b156-7e59-49b3-82db-84cb847ae388 tempest-AttachVolumeTestJSON-1651611701 tempest-AttachVolumeTestJSON-1651611701-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:27:40.295710 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-bfe5b156-7e59-49b3-82db-84cb847ae388 tempest-AttachVolumeTestJSON-1651611701 tempest-AttachVolumeTestJSON-1651611701-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:27:40.296074 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-bfe5b156-7e59-49b3-82db-84cb847ae388 tempest-AttachVolumeTestJSON-1651611701 tempest-AttachVolumeTestJSON-1651611701-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:27:40.392670 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-47ee4143-ed2e-4407-a109-38d928c3cb5f tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:27:40.393422 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-47ee4143-ed2e-4407-a109-38d928c3cb5f tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] [instance: 5d54db85-b991-4890-abaa-952413baa2e7] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:27:40.396868 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-bfe5b156-7e59-49b3-82db-84cb847ae388 tempest-AttachVolumeTestJSON-1651611701 tempest-AttachVolumeTestJSON-1651611701-project] 10.222.0.11 "POST /compute/v2.1/servers/5e11ea9c-f66a-4962-b5ca-b95784624824/action" status: 200 len: 28178 microversion: 2.1 time: 0.114050 Nov 17 03:27:40.397577 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 270/550] 10.222.0.11 () {60 vars in 1277 bytes} [Wed Nov 17 03:27:40 2021] POST /compute/v2.1/servers/5e11ea9c-f66a-4962-b5ca-b95784624824/action => generated 28178 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 17 03:27:40.400007 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-47ee4143-ed2e-4407-a109-38d928c3cb5f tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:27:40.400465 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-47ee4143-ed2e-4407-a109-38d928c3cb5f tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:27:40.401281 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-47ee4143-ed2e-4407-a109-38d928c3cb5f tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:27:40.401716 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-47ee4143-ed2e-4407-a109-38d928c3cb5f tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:27:40.550370 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-47ee4143-ed2e-4407-a109-38d928c3cb5f tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37f21d6d15cf40a586edda211219fd08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ebb970305844dccacf48a7d8d47ecf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:27:40.559119 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-47ee4143-ed2e-4407-a109-38d928c3cb5f tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '37f21d6d15cf40a586edda211219fd08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ebb970305844dccacf48a7d8d47ecf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:27:40.560651 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-47ee4143-ed2e-4407-a109-38d928c3cb5f tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '37f21d6d15cf40a586edda211219fd08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ebb970305844dccacf48a7d8d47ecf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:27:40.561930 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-47ee4143-ed2e-4407-a109-38d928c3cb5f tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] 10.222.0.11 "GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7" status: 200 len: 1746 microversion: 2.20 time: 0.173076 Nov 17 03:27:40.562482 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 281/551] 10.222.0.11 () {60 vars in 1276 bytes} [Wed Nov 17 03:27:40 2021] GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7 => generated 1746 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 17 03:27:40.839500 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-c0637c6b-aae1-4d61-96b5-3adc879e3f7a tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:27:40.840596 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-c0637c6b-aae1-4d61-96b5-3adc879e3f7a tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] [instance: b89eca0e-d486-4b3a-a41a-aa02de394cff] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:27:40.849234 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-c0637c6b-aae1-4d61-96b5-3adc879e3f7a tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:27:40.849681 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-c0637c6b-aae1-4d61-96b5-3adc879e3f7a tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:27:40.850458 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-c0637c6b-aae1-4d61-96b5-3adc879e3f7a tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:27:40.850892 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-c0637c6b-aae1-4d61-96b5-3adc879e3f7a tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:27:40.905021 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-a815cdeb-2729-4863-9f43-30426a667c82 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:27:40.905693 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-a815cdeb-2729-4863-9f43-30426a667c82 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] [instance: 5ddbfaaa-fabf-4324-941c-8868625ffefc] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:27:40.912577 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-a815cdeb-2729-4863-9f43-30426a667c82 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:27:40.913054 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-a815cdeb-2729-4863-9f43-30426a667c82 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:27:40.913833 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-a815cdeb-2729-4863-9f43-30426a667c82 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:27:40.914267 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-a815cdeb-2729-4863-9f43-30426a667c82 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:27:40.996232 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-c0637c6b-aae1-4d61-96b5-3adc879e3f7a tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d4e8ac9538f42c9b637bd9e086668b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfc480343d4d493bb4295b055e274df5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:27:41.003716 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-c0637c6b-aae1-4d61-96b5-3adc879e3f7a tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] 10.222.0.11 "GET /compute/v2.1/servers/b89eca0e-d486-4b3a-a41a-aa02de394cff" status: 200 len: 1317 microversion: 2.1 time: 0.169748 Nov 17 03:27:41.004412 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 271/552] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:27:40 2021] GET /compute/v2.1/servers/b89eca0e-d486-4b3a-a41a-aa02de394cff => generated 1317 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:27:41.061164 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-a815cdeb-2729-4863-9f43-30426a667c82 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80763e09d44c475ea2425b22874e9612', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fef02a1dd77946a2ac0e0414b557435f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:27:41.070948 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-a815cdeb-2729-4863-9f43-30426a667c82 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] 10.222.0.11 "GET /compute/v2.1/servers/5ddbfaaa-fabf-4324-941c-8868625ffefc" status: 200 len: 1266 microversion: 2.1 time: 0.169544 Nov 17 03:27:41.071768 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 282/553] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:27:40 2021] GET /compute/v2.1/servers/5ddbfaaa-fabf-4324-941c-8868625ffefc => generated 1266 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:27:41.409977 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-f14f5851-7063-4932-809b-b5748c5548cd tempest-AttachVolumeTestJSON-1651611701 tempest-AttachVolumeTestJSON-1651611701-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 17 03:27:41.410906 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-f14f5851-7063-4932-809b-b5748c5548cd tempest-AttachVolumeTestJSON-1651611701 tempest-AttachVolumeTestJSON-1651611701-project] [instance: 5e11ea9c-f66a-4962-b5ca-b95784624824] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:27:41.417721 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-f14f5851-7063-4932-809b-b5748c5548cd tempest-AttachVolumeTestJSON-1651611701 tempest-AttachVolumeTestJSON-1651611701-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:27:41.418175 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-f14f5851-7063-4932-809b-b5748c5548cd tempest-AttachVolumeTestJSON-1651611701 tempest-AttachVolumeTestJSON-1651611701-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:27:41.418959 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-f14f5851-7063-4932-809b-b5748c5548cd tempest-AttachVolumeTestJSON-1651611701 tempest-AttachVolumeTestJSON-1651611701-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:27:41.419399 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-f14f5851-7063-4932-809b-b5748c5548cd tempest-AttachVolumeTestJSON-1651611701 tempest-AttachVolumeTestJSON-1651611701-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:27:41.541753 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-f14f5851-7063-4932-809b-b5748c5548cd tempest-AttachVolumeTestJSON-1651611701 tempest-AttachVolumeTestJSON-1651611701-project] 10.222.0.11 "POST /compute/v2.1/servers/5e11ea9c-f66a-4962-b5ca-b95784624824/action" status: 200 len: 28178 microversion: 2.1 time: 0.135305 Nov 17 03:27:41.542615 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 272/554] 10.222.0.11 () {60 vars in 1277 bytes} [Wed Nov 17 03:27:41 2021] POST /compute/v2.1/servers/5e11ea9c-f66a-4962-b5ca-b95784624824/action => generated 28178 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 17 03:27:41.581655 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-5a6b5700-458f-44cb-93de-94952c96bfea tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:27:41.582452 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-5a6b5700-458f-44cb-93de-94952c96bfea tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] [instance: 5d54db85-b991-4890-abaa-952413baa2e7] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:27:41.591105 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-5a6b5700-458f-44cb-93de-94952c96bfea tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:27:41.591612 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-5a6b5700-458f-44cb-93de-94952c96bfea tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:27:41.592418 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-5a6b5700-458f-44cb-93de-94952c96bfea tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:27:41.592955 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-5a6b5700-458f-44cb-93de-94952c96bfea tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:27:41.736027 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-5a6b5700-458f-44cb-93de-94952c96bfea tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37f21d6d15cf40a586edda211219fd08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ebb970305844dccacf48a7d8d47ecf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:27:41.746304 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-5a6b5700-458f-44cb-93de-94952c96bfea tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '37f21d6d15cf40a586edda211219fd08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ebb970305844dccacf48a7d8d47ecf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:27:41.747873 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-5a6b5700-458f-44cb-93de-94952c96bfea tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '37f21d6d15cf40a586edda211219fd08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ebb970305844dccacf48a7d8d47ecf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:27:41.749534 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-5a6b5700-458f-44cb-93de-94952c96bfea tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] 10.222.0.11 "GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7" status: 200 len: 1746 microversion: 2.20 time: 0.173446 Nov 17 03:27:41.750296 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 283/555] 10.222.0.11 () {60 vars in 1276 bytes} [Wed Nov 17 03:27:41 2021] GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7 => generated 1746 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 17 03:27:42.022618 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-edc9bde8-37ce-490b-b8fa-9057bba80df1 tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:27:42.023483 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-edc9bde8-37ce-490b-b8fa-9057bba80df1 tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] [instance: b89eca0e-d486-4b3a-a41a-aa02de394cff] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:27:42.031467 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-edc9bde8-37ce-490b-b8fa-9057bba80df1 tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:27:42.032932 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-edc9bde8-37ce-490b-b8fa-9057bba80df1 tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:27:42.038907 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-edc9bde8-37ce-490b-b8fa-9057bba80df1 tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:27:42.038907 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-edc9bde8-37ce-490b-b8fa-9057bba80df1 tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:27:42.040559 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [req-631844b5-28ed-4b0d-96cf-4cf9045c9c41 req-9c207ffb-6b98-4436-a765-217d8a21a646 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5d54db85-b991-4890-abaa-952413baa2e7", "name": "network-vif-plugged", "status": "completed", "tag": "51f39c10-57ce-4106-ab58-635a3319ff11"}]} {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 17 03:27:42.042548 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 17 03:27:42.042548 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: warnings.warn(msg) Nov 17 03:27:42.056110 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [req-631844b5-28ed-4b0d-96cf-4cf9045c9c41 req-9c207ffb-6b98-4436-a765-217d8a21a646 service nova] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:27:42.057435 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [req-631844b5-28ed-4b0d-96cf-4cf9045c9c41 req-9c207ffb-6b98-4436-a765-217d8a21a646 service nova] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:27:42.078036 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.compute.server_external_events [req-631844b5-28ed-4b0d-96cf-4cf9045c9c41 req-9c207ffb-6b98-4436-a765-217d8a21a646 service nova] Creating event network-vif-plugged:51f39c10-57ce-4106-ab58-635a3319ff11 for instance 5d54db85-b991-4890-abaa-952413baa2e7 on hv-cinder-81803 Nov 17 03:27:42.092596 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [req-631844b5-28ed-4b0d-96cf-4cf9045c9c41 req-9c207ffb-6b98-4436-a765-217d8a21a646 service nova] 10.222.0.11 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.059681 Nov 17 03:27:42.093648 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 284/556] 10.222.0.11 () {64 vars in 1317 bytes} [Wed Nov 17 03:27:42 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 17 03:27:42.098851 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-9d15358d-04fc-4ae1-9740-23edc8271c74 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:27:42.099627 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-9d15358d-04fc-4ae1-9740-23edc8271c74 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] [instance: 5ddbfaaa-fabf-4324-941c-8868625ffefc] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:27:42.106725 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-9d15358d-04fc-4ae1-9740-23edc8271c74 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:27:42.107249 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-9d15358d-04fc-4ae1-9740-23edc8271c74 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:27:42.108138 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-9d15358d-04fc-4ae1-9740-23edc8271c74 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:27:42.109161 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-9d15358d-04fc-4ae1-9740-23edc8271c74 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:27:42.219700 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-edc9bde8-37ce-490b-b8fa-9057bba80df1 tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d4e8ac9538f42c9b637bd9e086668b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfc480343d4d493bb4295b055e274df5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:27:42.237100 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-edc9bde8-37ce-490b-b8fa-9057bba80df1 tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] 10.222.0.11 "GET /compute/v2.1/servers/b89eca0e-d486-4b3a-a41a-aa02de394cff" status: 200 len: 1317 microversion: 2.1 time: 0.219382 Nov 17 03:27:42.239171 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 273/557] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:27:42 2021] GET /compute/v2.1/servers/b89eca0e-d486-4b3a-a41a-aa02de394cff => generated 1317 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:27:42.289409 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-9d15358d-04fc-4ae1-9740-23edc8271c74 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80763e09d44c475ea2425b22874e9612', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fef02a1dd77946a2ac0e0414b557435f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:27:42.296718 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-9d15358d-04fc-4ae1-9740-23edc8271c74 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] 10.222.0.11 "GET /compute/v2.1/servers/5ddbfaaa-fabf-4324-941c-8868625ffefc" status: 200 len: 1266 microversion: 2.1 time: 0.201976 Nov 17 03:27:42.297321 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 285/558] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:27:42 2021] GET /compute/v2.1/servers/5ddbfaaa-fabf-4324-941c-8868625ffefc => generated 1266 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:27:42.559694 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-61750917-0ac8-4676-95db-199eb8bac7d0 tempest-AttachVolumeTestJSON-1651611701 tempest-AttachVolumeTestJSON-1651611701-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 17 03:27:42.561292 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-61750917-0ac8-4676-95db-199eb8bac7d0 tempest-AttachVolumeTestJSON-1651611701 tempest-AttachVolumeTestJSON-1651611701-project] [instance: 5e11ea9c-f66a-4962-b5ca-b95784624824] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:27:42.571270 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-61750917-0ac8-4676-95db-199eb8bac7d0 tempest-AttachVolumeTestJSON-1651611701 tempest-AttachVolumeTestJSON-1651611701-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:27:42.571961 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-61750917-0ac8-4676-95db-199eb8bac7d0 tempest-AttachVolumeTestJSON-1651611701 tempest-AttachVolumeTestJSON-1651611701-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:27:42.573195 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-61750917-0ac8-4676-95db-199eb8bac7d0 tempest-AttachVolumeTestJSON-1651611701 tempest-AttachVolumeTestJSON-1651611701-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:27:42.573874 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-61750917-0ac8-4676-95db-199eb8bac7d0 tempest-AttachVolumeTestJSON-1651611701 tempest-AttachVolumeTestJSON-1651611701-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:27:42.697041 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-61750917-0ac8-4676-95db-199eb8bac7d0 tempest-AttachVolumeTestJSON-1651611701 tempest-AttachVolumeTestJSON-1651611701-project] 10.222.0.11 "POST /compute/v2.1/servers/5e11ea9c-f66a-4962-b5ca-b95784624824/action" status: 200 len: 28178 microversion: 2.1 time: 0.143127 Nov 17 03:27:42.697871 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 274/559] 10.222.0.11 () {60 vars in 1277 bytes} [Wed Nov 17 03:27:42 2021] POST /compute/v2.1/servers/5e11ea9c-f66a-4962-b5ca-b95784624824/action => generated 28178 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 17 03:27:42.767658 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-ed8822eb-d291-4305-bc4e-82d2c7d0f94a tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:27:42.768401 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-ed8822eb-d291-4305-bc4e-82d2c7d0f94a tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] [instance: 5d54db85-b991-4890-abaa-952413baa2e7] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:27:42.774506 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-ed8822eb-d291-4305-bc4e-82d2c7d0f94a tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:27:42.774949 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-ed8822eb-d291-4305-bc4e-82d2c7d0f94a tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:27:42.775800 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-ed8822eb-d291-4305-bc4e-82d2c7d0f94a tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:27:42.776224 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-ed8822eb-d291-4305-bc4e-82d2c7d0f94a tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:27:42.913234 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-ed8822eb-d291-4305-bc4e-82d2c7d0f94a tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37f21d6d15cf40a586edda211219fd08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ebb970305844dccacf48a7d8d47ecf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:27:42.924446 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-ed8822eb-d291-4305-bc4e-82d2c7d0f94a tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '37f21d6d15cf40a586edda211219fd08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ebb970305844dccacf48a7d8d47ecf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:27:42.926517 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-ed8822eb-d291-4305-bc4e-82d2c7d0f94a tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '37f21d6d15cf40a586edda211219fd08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ebb970305844dccacf48a7d8d47ecf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:27:42.928197 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-ed8822eb-d291-4305-bc4e-82d2c7d0f94a tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] 10.222.0.11 "GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7" status: 200 len: 1746 microversion: 2.20 time: 0.164344 Nov 17 03:27:42.928932 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 286/560] 10.222.0.11 () {60 vars in 1276 bytes} [Wed Nov 17 03:27:42 2021] GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7 => generated 1746 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 17 03:27:43.263565 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-6690e094-5737-4cf5-b93b-6e6179c96d49 tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:27:43.264865 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-6690e094-5737-4cf5-b93b-6e6179c96d49 tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] [instance: b89eca0e-d486-4b3a-a41a-aa02de394cff] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:27:43.274315 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-6690e094-5737-4cf5-b93b-6e6179c96d49 tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:27:43.274765 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-6690e094-5737-4cf5-b93b-6e6179c96d49 tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:27:43.275618 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-6690e094-5737-4cf5-b93b-6e6179c96d49 tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:27:43.276077 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-6690e094-5737-4cf5-b93b-6e6179c96d49 tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:27:43.313865 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-229129a0-eef1-42fe-b237-51e4beaa7f52 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:27:43.314387 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-229129a0-eef1-42fe-b237-51e4beaa7f52 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] [instance: 5ddbfaaa-fabf-4324-941c-8868625ffefc] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:27:43.323266 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-229129a0-eef1-42fe-b237-51e4beaa7f52 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:27:43.323718 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-229129a0-eef1-42fe-b237-51e4beaa7f52 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:27:43.324513 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-229129a0-eef1-42fe-b237-51e4beaa7f52 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:27:43.324984 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-229129a0-eef1-42fe-b237-51e4beaa7f52 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:27:43.430299 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-6690e094-5737-4cf5-b93b-6e6179c96d49 tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d4e8ac9538f42c9b637bd9e086668b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfc480343d4d493bb4295b055e274df5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:27:43.438957 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-6690e094-5737-4cf5-b93b-6e6179c96d49 tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] 10.222.0.11 "GET /compute/v2.1/servers/b89eca0e-d486-4b3a-a41a-aa02de394cff" status: 200 len: 1317 microversion: 2.1 time: 0.182569 Nov 17 03:27:43.439738 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 275/561] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:27:43 2021] GET /compute/v2.1/servers/b89eca0e-d486-4b3a-a41a-aa02de394cff => generated 1317 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:27:43.478956 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-229129a0-eef1-42fe-b237-51e4beaa7f52 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80763e09d44c475ea2425b22874e9612', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fef02a1dd77946a2ac0e0414b557435f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:27:43.489916 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-229129a0-eef1-42fe-b237-51e4beaa7f52 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] 10.222.0.11 "GET /compute/v2.1/servers/5ddbfaaa-fabf-4324-941c-8868625ffefc" status: 200 len: 1266 microversion: 2.1 time: 0.179794 Nov 17 03:27:43.490558 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 287/562] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:27:43 2021] GET /compute/v2.1/servers/5ddbfaaa-fabf-4324-941c-8868625ffefc => generated 1266 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:27:43.710577 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-84e40e05-07bc-437d-a071-d89fe8cd2b96 tempest-AttachVolumeTestJSON-1651611701 tempest-AttachVolumeTestJSON-1651611701-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 17 03:27:43.711380 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-84e40e05-07bc-437d-a071-d89fe8cd2b96 tempest-AttachVolumeTestJSON-1651611701 tempest-AttachVolumeTestJSON-1651611701-project] [instance: 5e11ea9c-f66a-4962-b5ca-b95784624824] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:27:43.718100 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-84e40e05-07bc-437d-a071-d89fe8cd2b96 tempest-AttachVolumeTestJSON-1651611701 tempest-AttachVolumeTestJSON-1651611701-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:27:43.718536 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-84e40e05-07bc-437d-a071-d89fe8cd2b96 tempest-AttachVolumeTestJSON-1651611701 tempest-AttachVolumeTestJSON-1651611701-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:27:43.719299 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-84e40e05-07bc-437d-a071-d89fe8cd2b96 tempest-AttachVolumeTestJSON-1651611701 tempest-AttachVolumeTestJSON-1651611701-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:27:43.719721 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-84e40e05-07bc-437d-a071-d89fe8cd2b96 tempest-AttachVolumeTestJSON-1651611701 tempest-AttachVolumeTestJSON-1651611701-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:27:43.836438 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-84e40e05-07bc-437d-a071-d89fe8cd2b96 tempest-AttachVolumeTestJSON-1651611701 tempest-AttachVolumeTestJSON-1651611701-project] 10.222.0.11 "POST /compute/v2.1/servers/5e11ea9c-f66a-4962-b5ca-b95784624824/action" status: 200 len: 28178 microversion: 2.1 time: 0.130388 Nov 17 03:27:43.837139 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 276/563] 10.222.0.11 () {60 vars in 1277 bytes} [Wed Nov 17 03:27:43 2021] POST /compute/v2.1/servers/5e11ea9c-f66a-4962-b5ca-b95784624824/action => generated 28178 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 17 03:27:43.951588 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-8ae2dc5e-1b99-4b0f-8f07-2442019f2220 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:27:43.952190 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-8ae2dc5e-1b99-4b0f-8f07-2442019f2220 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] [instance: 5d54db85-b991-4890-abaa-952413baa2e7] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:27:43.958892 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-8ae2dc5e-1b99-4b0f-8f07-2442019f2220 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:27:43.959335 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-8ae2dc5e-1b99-4b0f-8f07-2442019f2220 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:27:43.960101 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-8ae2dc5e-1b99-4b0f-8f07-2442019f2220 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:27:43.960526 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-8ae2dc5e-1b99-4b0f-8f07-2442019f2220 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:27:44.098135 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-8ae2dc5e-1b99-4b0f-8f07-2442019f2220 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37f21d6d15cf40a586edda211219fd08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ebb970305844dccacf48a7d8d47ecf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:27:44.107463 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-8ae2dc5e-1b99-4b0f-8f07-2442019f2220 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '37f21d6d15cf40a586edda211219fd08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ebb970305844dccacf48a7d8d47ecf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:27:44.109321 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-8ae2dc5e-1b99-4b0f-8f07-2442019f2220 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '37f21d6d15cf40a586edda211219fd08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ebb970305844dccacf48a7d8d47ecf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:27:44.110775 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-8ae2dc5e-1b99-4b0f-8f07-2442019f2220 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] 10.222.0.11 "GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7" status: 200 len: 1741 microversion: 2.20 time: 0.162876 Nov 17 03:27:44.111737 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 288/564] 10.222.0.11 () {60 vars in 1276 bytes} [Wed Nov 17 03:27:43 2021] GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7 => generated 1741 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 17 03:27:44.122604 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [req-b68f2236-98ca-440e-a7d0-7df41ee6e745 req-91ca9dfd-c06a-4e86-ae7e-ddbc4522beb8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b89eca0e-d486-4b3a-a41a-aa02de394cff", "name": "network-vif-plugged", "status": "completed", "tag": "654305a1-4d89-4fdf-9462-aacfa6438fa1"}]} {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 17 03:27:44.124065 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 17 03:27:44.124065 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: warnings.warn(msg) Nov 17 03:27:44.132065 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [req-b68f2236-98ca-440e-a7d0-7df41ee6e745 req-91ca9dfd-c06a-4e86-ae7e-ddbc4522beb8 service nova] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:27:44.132513 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [req-b68f2236-98ca-440e-a7d0-7df41ee6e745 req-91ca9dfd-c06a-4e86-ae7e-ddbc4522beb8 service nova] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:27:44.143458 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.compute.server_external_events [req-b68f2236-98ca-440e-a7d0-7df41ee6e745 req-91ca9dfd-c06a-4e86-ae7e-ddbc4522beb8 service nova] Creating event network-vif-plugged:654305a1-4d89-4fdf-9462-aacfa6438fa1 for instance b89eca0e-d486-4b3a-a41a-aa02de394cff on hv-cinder-81803 Nov 17 03:27:44.149165 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [req-b68f2236-98ca-440e-a7d0-7df41ee6e745 req-91ca9dfd-c06a-4e86-ae7e-ddbc4522beb8 service nova] 10.222.0.11 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030447 Nov 17 03:27:44.149760 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 277/565] 10.222.0.11 () {64 vars in 1317 bytes} [Wed Nov 17 03:27:44 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 17 03:27:44.455769 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-32032f12-f9cf-41de-ac9f-bda8d860c54f tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:27:44.456691 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-32032f12-f9cf-41de-ac9f-bda8d860c54f tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] [instance: b89eca0e-d486-4b3a-a41a-aa02de394cff] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:27:44.463957 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-32032f12-f9cf-41de-ac9f-bda8d860c54f tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:27:44.464507 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-32032f12-f9cf-41de-ac9f-bda8d860c54f tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:27:44.465390 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-32032f12-f9cf-41de-ac9f-bda8d860c54f tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:27:44.465887 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-32032f12-f9cf-41de-ac9f-bda8d860c54f tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:27:44.506936 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-6f3b7d94-81ab-4dc1-861b-46a3df2f5e19 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:27:44.507903 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-6f3b7d94-81ab-4dc1-861b-46a3df2f5e19 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] [instance: 5ddbfaaa-fabf-4324-941c-8868625ffefc] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:27:44.514324 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-6f3b7d94-81ab-4dc1-861b-46a3df2f5e19 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:27:44.514765 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-6f3b7d94-81ab-4dc1-861b-46a3df2f5e19 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:27:44.515540 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-6f3b7d94-81ab-4dc1-861b-46a3df2f5e19 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:27:44.515971 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-6f3b7d94-81ab-4dc1-861b-46a3df2f5e19 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:27:44.598038 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-32032f12-f9cf-41de-ac9f-bda8d860c54f tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d4e8ac9538f42c9b637bd9e086668b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfc480343d4d493bb4295b055e274df5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:27:44.605507 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-32032f12-f9cf-41de-ac9f-bda8d860c54f tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] 10.222.0.11 "GET /compute/v2.1/servers/b89eca0e-d486-4b3a-a41a-aa02de394cff" status: 200 len: 1317 microversion: 2.1 time: 0.153843 Nov 17 03:27:44.606083 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 289/566] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:27:44 2021] GET /compute/v2.1/servers/b89eca0e-d486-4b3a-a41a-aa02de394cff => generated 1317 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:27:44.650259 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-6f3b7d94-81ab-4dc1-861b-46a3df2f5e19 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80763e09d44c475ea2425b22874e9612', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fef02a1dd77946a2ac0e0414b557435f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:27:44.657960 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-6f3b7d94-81ab-4dc1-861b-46a3df2f5e19 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] 10.222.0.11 "GET /compute/v2.1/servers/5ddbfaaa-fabf-4324-941c-8868625ffefc" status: 200 len: 1266 microversion: 2.1 time: 0.155370 Nov 17 03:27:44.658525 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 278/567] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:27:44 2021] GET /compute/v2.1/servers/5ddbfaaa-fabf-4324-941c-8868625ffefc => generated 1266 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 17 03:27:44.848686 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-6f6d052d-1a62-4a65-9a7c-948334ec77c1 tempest-AttachVolumeTestJSON-1651611701 tempest-AttachVolumeTestJSON-1651611701-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 17 03:27:44.849713 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-6f6d052d-1a62-4a65-9a7c-948334ec77c1 tempest-AttachVolumeTestJSON-1651611701 tempest-AttachVolumeTestJSON-1651611701-project] [instance: 5e11ea9c-f66a-4962-b5ca-b95784624824] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:27:44.856328 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-6f6d052d-1a62-4a65-9a7c-948334ec77c1 tempest-AttachVolumeTestJSON-1651611701 tempest-AttachVolumeTestJSON-1651611701-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:27:44.856813 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-6f6d052d-1a62-4a65-9a7c-948334ec77c1 tempest-AttachVolumeTestJSON-1651611701 tempest-AttachVolumeTestJSON-1651611701-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:27:44.857659 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-6f6d052d-1a62-4a65-9a7c-948334ec77c1 tempest-AttachVolumeTestJSON-1651611701 tempest-AttachVolumeTestJSON-1651611701-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:27:44.858102 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-6f6d052d-1a62-4a65-9a7c-948334ec77c1 tempest-AttachVolumeTestJSON-1651611701 tempest-AttachVolumeTestJSON-1651611701-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:27:45.018097 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-6f6d052d-1a62-4a65-9a7c-948334ec77c1 tempest-AttachVolumeTestJSON-1651611701 tempest-AttachVolumeTestJSON-1651611701-project] 10.222.0.11 "POST /compute/v2.1/servers/5e11ea9c-f66a-4962-b5ca-b95784624824/action" status: 200 len: 28300 microversion: 2.1 time: 0.172573 Nov 17 03:27:45.019506 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 290/568] 10.222.0.11 () {60 vars in 1277 bytes} [Wed Nov 17 03:27:44 2021] POST /compute/v2.1/servers/5e11ea9c-f66a-4962-b5ca-b95784624824/action => generated 28300 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 17 03:27:45.134065 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-cfe182fd-71bb-472c-8b3b-fdc076c9d639 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:27:45.134787 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-cfe182fd-71bb-472c-8b3b-fdc076c9d639 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] [instance: 5d54db85-b991-4890-abaa-952413baa2e7] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:27:45.143213 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-cfe182fd-71bb-472c-8b3b-fdc076c9d639 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:27:45.143819 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-cfe182fd-71bb-472c-8b3b-fdc076c9d639 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:27:45.145151 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-cfe182fd-71bb-472c-8b3b-fdc076c9d639 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:27:45.145766 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-cfe182fd-71bb-472c-8b3b-fdc076c9d639 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:27:45.288041 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-cfe182fd-71bb-472c-8b3b-fdc076c9d639 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37f21d6d15cf40a586edda211219fd08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ebb970305844dccacf48a7d8d47ecf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:27:45.302068 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-cfe182fd-71bb-472c-8b3b-fdc076c9d639 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '37f21d6d15cf40a586edda211219fd08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ebb970305844dccacf48a7d8d47ecf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:27:45.304454 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-cfe182fd-71bb-472c-8b3b-fdc076c9d639 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '37f21d6d15cf40a586edda211219fd08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ebb970305844dccacf48a7d8d47ecf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:27:45.306376 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-cfe182fd-71bb-472c-8b3b-fdc076c9d639 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] 10.222.0.11 "GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7" status: 200 len: 1741 microversion: 2.20 time: 0.178166 Nov 17 03:27:45.307527 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 279/569] 10.222.0.11 () {60 vars in 1276 bytes} [Wed Nov 17 03:27:45 2021] GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7 => generated 1741 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 17 03:27:45.522787 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-1d3d6cd3-5482-4697-92e8-a395f264cfb9 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 17 03:27:45.523799 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-1d3d6cd3-5482-4697-92e8-a395f264cfb9 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] [instance: a49437df-3059-4528-8328-2f3471d5fb45] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:27:45.531208 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-1d3d6cd3-5482-4697-92e8-a395f264cfb9 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:27:45.531663 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-1d3d6cd3-5482-4697-92e8-a395f264cfb9 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:27:45.532468 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-1d3d6cd3-5482-4697-92e8-a395f264cfb9 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:27:45.532932 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-1d3d6cd3-5482-4697-92e8-a395f264cfb9 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:27:45.562154 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.objects.instance [None req-1d3d6cd3-5482-4697-92e8-a395f264cfb9 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lazy-loading 'flavor' on Instance uuid a49437df-3059-4528-8328-2f3471d5fb45 {{(pid=115917) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Nov 17 03:27:45.622759 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-a6229408-456e-411a-a184-58ba6aaf1699 tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:27:45.623348 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-a6229408-456e-411a-a184-58ba6aaf1699 tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] [instance: b89eca0e-d486-4b3a-a41a-aa02de394cff] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:27:45.629793 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-a6229408-456e-411a-a184-58ba6aaf1699 tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:27:45.630187 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-a6229408-456e-411a-a184-58ba6aaf1699 tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:27:45.630974 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-a6229408-456e-411a-a184-58ba6aaf1699 tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:27:45.631597 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-a6229408-456e-411a-a184-58ba6aaf1699 tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:27:45.694597 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-1d3d6cd3-5482-4697-92e8-a395f264cfb9 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] 10.222.0.11 "POST /compute/v2.1/servers/a49437df-3059-4528-8328-2f3471d5fb45/action" status: 200 len: 32 microversion: 2.1 time: 0.176922 Nov 17 03:27:45.696197 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 291/570] 10.222.0.11 () {60 vars in 1277 bytes} [Wed Nov 17 03:27:45 2021] POST /compute/v2.1/servers/a49437df-3059-4528-8328-2f3471d5fb45/action => generated 32 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 17 03:27:45.701950 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-fc9bb630-89fa-407c-b08b-ccfd9c894929 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:27:45.702744 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-fc9bb630-89fa-407c-b08b-ccfd9c894929 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] [instance: 5ddbfaaa-fabf-4324-941c-8868625ffefc] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:27:45.709714 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-fc9bb630-89fa-407c-b08b-ccfd9c894929 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:27:45.710249 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-fc9bb630-89fa-407c-b08b-ccfd9c894929 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:27:45.711108 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-fc9bb630-89fa-407c-b08b-ccfd9c894929 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:27:45.711614 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-fc9bb630-89fa-407c-b08b-ccfd9c894929 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:27:45.777024 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-a6229408-456e-411a-a184-58ba6aaf1699 tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d4e8ac9538f42c9b637bd9e086668b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfc480343d4d493bb4295b055e274df5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:27:45.784414 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-a6229408-456e-411a-a184-58ba6aaf1699 tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] 10.222.0.11 "GET /compute/v2.1/servers/b89eca0e-d486-4b3a-a41a-aa02de394cff" status: 200 len: 1317 microversion: 2.1 time: 0.165226 Nov 17 03:27:45.785279 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 280/571] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:27:45 2021] GET /compute/v2.1/servers/b89eca0e-d486-4b3a-a41a-aa02de394cff => generated 1317 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 17 03:27:45.790290 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-b85380c6-a404-4ea1-aeec-ee67eeea4b91 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:27:45.791231 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-b85380c6-a404-4ea1-aeec-ee67eeea4b91 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] [instance: a49437df-3059-4528-8328-2f3471d5fb45] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:27:45.797728 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-b85380c6-a404-4ea1-aeec-ee67eeea4b91 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:27:45.798402 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-b85380c6-a404-4ea1-aeec-ee67eeea4b91 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:27:45.799369 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-b85380c6-a404-4ea1-aeec-ee67eeea4b91 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:27:45.799800 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-b85380c6-a404-4ea1-aeec-ee67eeea4b91 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:27:45.956447 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-b85380c6-a404-4ea1-aeec-ee67eeea4b91 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f046401c6a04f6495ebe0821120bd72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a58e89ceeea4a9c8a72a1de4bcaf2d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:27:45.966095 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-b85380c6-a404-4ea1-aeec-ee67eeea4b91 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] 10.222.0.11 "GET /compute/v2.1/servers/a49437df-3059-4528-8328-2f3471d5fb45" status: 200 len: 1566 microversion: 2.1 time: 0.179484 Nov 17 03:27:45.966499 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-fc9bb630-89fa-407c-b08b-ccfd9c894929 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80763e09d44c475ea2425b22874e9612', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fef02a1dd77946a2ac0e0414b557435f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:27:45.967811 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 281/572] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:27:45 2021] GET /compute/v2.1/servers/a49437df-3059-4528-8328-2f3471d5fb45 => generated 1566 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:27:45.978128 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-fc9bb630-89fa-407c-b08b-ccfd9c894929 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] 10.222.0.11 "GET /compute/v2.1/servers/5ddbfaaa-fabf-4324-941c-8868625ffefc" status: 200 len: 1266 microversion: 2.1 time: 0.280644 Nov 17 03:27:45.978858 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 292/573] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:27:45 2021] GET /compute/v2.1/servers/5ddbfaaa-fabf-4324-941c-8868625ffefc => generated 1266 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:27:46.031712 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-9fdc3d5e-6d00-4e88-a33a-d8f84e6dcec0 tempest-AttachVolumeTestJSON-1651611701 tempest-AttachVolumeTestJSON-1651611701-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 17 03:27:46.032700 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-9fdc3d5e-6d00-4e88-a33a-d8f84e6dcec0 tempest-AttachVolumeTestJSON-1651611701 tempest-AttachVolumeTestJSON-1651611701-project] [instance: 5e11ea9c-f66a-4962-b5ca-b95784624824] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:27:46.039454 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-9fdc3d5e-6d00-4e88-a33a-d8f84e6dcec0 tempest-AttachVolumeTestJSON-1651611701 tempest-AttachVolumeTestJSON-1651611701-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:27:46.039914 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-9fdc3d5e-6d00-4e88-a33a-d8f84e6dcec0 tempest-AttachVolumeTestJSON-1651611701 tempest-AttachVolumeTestJSON-1651611701-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:27:46.040723 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-9fdc3d5e-6d00-4e88-a33a-d8f84e6dcec0 tempest-AttachVolumeTestJSON-1651611701 tempest-AttachVolumeTestJSON-1651611701-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:27:46.041360 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-9fdc3d5e-6d00-4e88-a33a-d8f84e6dcec0 tempest-AttachVolumeTestJSON-1651611701 tempest-AttachVolumeTestJSON-1651611701-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:27:46.165626 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [req-17c93544-770c-4496-86a7-54d886f3b862 req-73cda9a1-ad0f-48b8-b7dd-66d4961217a6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5ddbfaaa-fabf-4324-941c-8868625ffefc", "name": "network-vif-plugged", "status": "completed", "tag": "c37d71de-0892-41d0-9d86-8ce8b8ccde7f"}]} {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 17 03:27:46.167156 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 17 03:27:46.167156 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: warnings.warn(msg) Nov 17 03:27:46.174965 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [req-17c93544-770c-4496-86a7-54d886f3b862 req-73cda9a1-ad0f-48b8-b7dd-66d4961217a6 service nova] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:27:46.175412 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [req-17c93544-770c-4496-86a7-54d886f3b862 req-73cda9a1-ad0f-48b8-b7dd-66d4961217a6 service nova] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:27:46.189420 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.compute.server_external_events [req-17c93544-770c-4496-86a7-54d886f3b862 req-73cda9a1-ad0f-48b8-b7dd-66d4961217a6 service nova] Creating event network-vif-plugged:c37d71de-0892-41d0-9d86-8ce8b8ccde7f for instance 5ddbfaaa-fabf-4324-941c-8868625ffefc on hv-cinder-81803 Nov 17 03:27:46.194467 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [req-17c93544-770c-4496-86a7-54d886f3b862 req-73cda9a1-ad0f-48b8-b7dd-66d4961217a6 service nova] 10.222.0.11 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034075 Nov 17 03:27:46.195071 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 293/574] 10.222.0.11 () {64 vars in 1317 bytes} [Wed Nov 17 03:27:46 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 17 03:27:46.325976 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-a68626df-27ef-480a-bca0-cdc1811a9d10 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:27:46.326691 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-a68626df-27ef-480a-bca0-cdc1811a9d10 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] [instance: 5d54db85-b991-4890-abaa-952413baa2e7] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:27:46.333436 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-a68626df-27ef-480a-bca0-cdc1811a9d10 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:27:46.333915 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-a68626df-27ef-480a-bca0-cdc1811a9d10 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:27:46.334693 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-a68626df-27ef-480a-bca0-cdc1811a9d10 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:27:46.335128 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-a68626df-27ef-480a-bca0-cdc1811a9d10 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:27:46.353412 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-9fdc3d5e-6d00-4e88-a33a-d8f84e6dcec0 tempest-AttachVolumeTestJSON-1651611701 tempest-AttachVolumeTestJSON-1651611701-project] 10.222.0.11 "POST /compute/v2.1/servers/5e11ea9c-f66a-4962-b5ca-b95784624824/action" status: 200 len: 28466 microversion: 2.1 time: 0.325320 Nov 17 03:27:46.357545 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 282/575] 10.222.0.11 () {60 vars in 1277 bytes} [Wed Nov 17 03:27:46 2021] POST /compute/v2.1/servers/5e11ea9c-f66a-4962-b5ca-b95784624824/action => generated 28466 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 17 03:27:46.514100 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-a68626df-27ef-480a-bca0-cdc1811a9d10 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37f21d6d15cf40a586edda211219fd08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ebb970305844dccacf48a7d8d47ecf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:27:46.522231 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-a68626df-27ef-480a-bca0-cdc1811a9d10 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '37f21d6d15cf40a586edda211219fd08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ebb970305844dccacf48a7d8d47ecf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:27:46.523736 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-a68626df-27ef-480a-bca0-cdc1811a9d10 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '37f21d6d15cf40a586edda211219fd08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ebb970305844dccacf48a7d8d47ecf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:27:46.524913 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-a68626df-27ef-480a-bca0-cdc1811a9d10 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] 10.222.0.11 "GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7" status: 200 len: 1741 microversion: 2.20 time: 0.203120 Nov 17 03:27:46.525478 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 294/576] 10.222.0.11 () {60 vars in 1276 bytes} [Wed Nov 17 03:27:46 2021] GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7 => generated 1741 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 17 03:27:46.803486 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-bd802fae-6f41-42fe-ba69-3391c5dc250c tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:27:46.804567 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-bd802fae-6f41-42fe-ba69-3391c5dc250c tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] [instance: b89eca0e-d486-4b3a-a41a-aa02de394cff] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:27:46.812768 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-bd802fae-6f41-42fe-ba69-3391c5dc250c tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:27:46.813685 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-bd802fae-6f41-42fe-ba69-3391c5dc250c tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:27:46.814630 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-bd802fae-6f41-42fe-ba69-3391c5dc250c tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:27:46.814788 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-bd802fae-6f41-42fe-ba69-3391c5dc250c tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:27:46.954302 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-bd802fae-6f41-42fe-ba69-3391c5dc250c tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d4e8ac9538f42c9b637bd9e086668b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfc480343d4d493bb4295b055e274df5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:27:46.963865 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-bd802fae-6f41-42fe-ba69-3391c5dc250c tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] 10.222.0.11 "GET /compute/v2.1/servers/b89eca0e-d486-4b3a-a41a-aa02de394cff" status: 200 len: 1504 microversion: 2.1 time: 0.164520 Nov 17 03:27:46.964438 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 283/577] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:27:46 2021] GET /compute/v2.1/servers/b89eca0e-d486-4b3a-a41a-aa02de394cff => generated 1504 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:27:46.984116 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-bc6c9fe8-3d34-440e-8893-c6cf71f0ab83 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:27:46.984728 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-bc6c9fe8-3d34-440e-8893-c6cf71f0ab83 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] [instance: a49437df-3059-4528-8328-2f3471d5fb45] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:27:46.992119 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-bc6c9fe8-3d34-440e-8893-c6cf71f0ab83 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:27:46.992575 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-bc6c9fe8-3d34-440e-8893-c6cf71f0ab83 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:27:46.993415 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-bc6c9fe8-3d34-440e-8893-c6cf71f0ab83 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:27:46.993856 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-bc6c9fe8-3d34-440e-8893-c6cf71f0ab83 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:27:46.995461 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-0ba54026-d011-4639-bcc2-6de822b7fa7e tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:27:46.996062 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-0ba54026-d011-4639-bcc2-6de822b7fa7e tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] [instance: 5ddbfaaa-fabf-4324-941c-8868625ffefc] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:27:47.002199 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-0ba54026-d011-4639-bcc2-6de822b7fa7e tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:27:47.002629 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-0ba54026-d011-4639-bcc2-6de822b7fa7e tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:27:47.003392 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-0ba54026-d011-4639-bcc2-6de822b7fa7e tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:27:47.003825 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-0ba54026-d011-4639-bcc2-6de822b7fa7e tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:27:47.140521 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-bc6c9fe8-3d34-440e-8893-c6cf71f0ab83 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f046401c6a04f6495ebe0821120bd72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a58e89ceeea4a9c8a72a1de4bcaf2d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:27:47.150645 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-bc6c9fe8-3d34-440e-8893-c6cf71f0ab83 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] 10.222.0.11 "GET /compute/v2.1/servers/a49437df-3059-4528-8328-2f3471d5fb45" status: 200 len: 1566 microversion: 2.1 time: 0.170040 Nov 17 03:27:47.151948 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 295/578] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:27:46 2021] GET /compute/v2.1/servers/a49437df-3059-4528-8328-2f3471d5fb45 => generated 1566 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:27:47.161447 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-0ba54026-d011-4639-bcc2-6de822b7fa7e tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80763e09d44c475ea2425b22874e9612', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fef02a1dd77946a2ac0e0414b557435f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:27:47.166908 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-0ba54026-d011-4639-bcc2-6de822b7fa7e tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] 10.222.0.11 "GET /compute/v2.1/servers/5ddbfaaa-fabf-4324-941c-8868625ffefc" status: 200 len: 1266 microversion: 2.1 time: 0.175268 Nov 17 03:27:47.167741 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 284/579] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:27:46 2021] GET /compute/v2.1/servers/5ddbfaaa-fabf-4324-941c-8868625ffefc => generated 1266 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:27:47.365651 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-8ce1afde-fdc9-4402-98d1-3e9610c9e689 tempest-AttachVolumeTestJSON-1651611701 tempest-AttachVolumeTestJSON-1651611701-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 17 03:27:47.366647 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-8ce1afde-fdc9-4402-98d1-3e9610c9e689 tempest-AttachVolumeTestJSON-1651611701 tempest-AttachVolumeTestJSON-1651611701-project] [instance: 5e11ea9c-f66a-4962-b5ca-b95784624824] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:27:47.373267 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-8ce1afde-fdc9-4402-98d1-3e9610c9e689 tempest-AttachVolumeTestJSON-1651611701 tempest-AttachVolumeTestJSON-1651611701-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:27:47.373838 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-8ce1afde-fdc9-4402-98d1-3e9610c9e689 tempest-AttachVolumeTestJSON-1651611701 tempest-AttachVolumeTestJSON-1651611701-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:27:47.374656 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-8ce1afde-fdc9-4402-98d1-3e9610c9e689 tempest-AttachVolumeTestJSON-1651611701 tempest-AttachVolumeTestJSON-1651611701-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:27:47.375074 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-8ce1afde-fdc9-4402-98d1-3e9610c9e689 tempest-AttachVolumeTestJSON-1651611701 tempest-AttachVolumeTestJSON-1651611701-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:27:47.526156 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-8ce1afde-fdc9-4402-98d1-3e9610c9e689 tempest-AttachVolumeTestJSON-1651611701 tempest-AttachVolumeTestJSON-1651611701-project] 10.222.0.11 "POST /compute/v2.1/servers/5e11ea9c-f66a-4962-b5ca-b95784624824/action" status: 200 len: 28466 microversion: 2.1 time: 0.163741 Nov 17 03:27:47.526916 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 296/580] 10.222.0.11 () {60 vars in 1277 bytes} [Wed Nov 17 03:27:47 2021] POST /compute/v2.1/servers/5e11ea9c-f66a-4962-b5ca-b95784624824/action => generated 28466 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 17 03:27:47.543376 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-7c5f0781-9e11-4352-a385-fd9ffc1189d3 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:27:47.543982 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-7c5f0781-9e11-4352-a385-fd9ffc1189d3 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] [instance: 5d54db85-b991-4890-abaa-952413baa2e7] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:27:47.551169 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-7c5f0781-9e11-4352-a385-fd9ffc1189d3 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:27:47.551544 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-7c5f0781-9e11-4352-a385-fd9ffc1189d3 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:27:47.552311 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-7c5f0781-9e11-4352-a385-fd9ffc1189d3 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:27:47.552741 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-7c5f0781-9e11-4352-a385-fd9ffc1189d3 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:27:47.710546 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-7c5f0781-9e11-4352-a385-fd9ffc1189d3 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37f21d6d15cf40a586edda211219fd08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ebb970305844dccacf48a7d8d47ecf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:27:47.721641 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-7c5f0781-9e11-4352-a385-fd9ffc1189d3 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '37f21d6d15cf40a586edda211219fd08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ebb970305844dccacf48a7d8d47ecf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:27:47.724145 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-7c5f0781-9e11-4352-a385-fd9ffc1189d3 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '37f21d6d15cf40a586edda211219fd08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ebb970305844dccacf48a7d8d47ecf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:27:47.725572 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-7c5f0781-9e11-4352-a385-fd9ffc1189d3 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] 10.222.0.11 "GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7" status: 200 len: 1741 microversion: 2.20 time: 0.185716 Nov 17 03:27:47.726370 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 285/581] 10.222.0.11 () {60 vars in 1276 bytes} [Wed Nov 17 03:27:47 2021] GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7 => generated 1741 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 17 03:27:48.169840 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-ec98de85-6029-475a-9d58-393994f07a1a tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:27:48.170554 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-ec98de85-6029-475a-9d58-393994f07a1a tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] [instance: a49437df-3059-4528-8328-2f3471d5fb45] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:27:48.179299 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-ec98de85-6029-475a-9d58-393994f07a1a tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:27:48.179720 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-ec98de85-6029-475a-9d58-393994f07a1a tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:27:48.180550 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-ec98de85-6029-475a-9d58-393994f07a1a tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:27:48.181013 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-ec98de85-6029-475a-9d58-393994f07a1a tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:27:48.184458 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-72f8b8f6-2dcd-4ce8-95e3-3e697131ff3e tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:27:48.185099 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-72f8b8f6-2dcd-4ce8-95e3-3e697131ff3e tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] [instance: 5ddbfaaa-fabf-4324-941c-8868625ffefc] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:27:48.192762 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-72f8b8f6-2dcd-4ce8-95e3-3e697131ff3e tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:27:48.193232 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-72f8b8f6-2dcd-4ce8-95e3-3e697131ff3e tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:27:48.194016 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-72f8b8f6-2dcd-4ce8-95e3-3e697131ff3e tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:27:48.194441 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-72f8b8f6-2dcd-4ce8-95e3-3e697131ff3e tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:27:48.323809 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-ec98de85-6029-475a-9d58-393994f07a1a tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f046401c6a04f6495ebe0821120bd72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a58e89ceeea4a9c8a72a1de4bcaf2d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:27:48.331705 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-ec98de85-6029-475a-9d58-393994f07a1a tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] 10.222.0.11 "GET /compute/v2.1/servers/a49437df-3059-4528-8328-2f3471d5fb45" status: 200 len: 1566 microversion: 2.1 time: 0.166070 Nov 17 03:27:48.332269 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 297/582] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:27:48 2021] GET /compute/v2.1/servers/a49437df-3059-4528-8328-2f3471d5fb45 => generated 1566 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:27:48.334590 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-72f8b8f6-2dcd-4ce8-95e3-3e697131ff3e tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80763e09d44c475ea2425b22874e9612', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fef02a1dd77946a2ac0e0414b557435f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:27:48.338451 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-5150eab5-bdb0-4522-ad97-e8464e4564cf tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "cbe64947-d9c3-43a7-b69c-ddc49552ac7d"}} {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 17 03:27:48.339485 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-5150eab5-bdb0-4522-ad97-e8464e4564cf tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] [instance: b89eca0e-d486-4b3a-a41a-aa02de394cff] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:27:48.343566 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-72f8b8f6-2dcd-4ce8-95e3-3e697131ff3e tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] 10.222.0.11 "GET /compute/v2.1/servers/5ddbfaaa-fabf-4324-941c-8868625ffefc" status: 200 len: 1266 microversion: 2.1 time: 0.163034 Nov 17 03:27:48.344149 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 286/583] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:27:48 2021] GET /compute/v2.1/servers/5ddbfaaa-fabf-4324-941c-8868625ffefc => generated 1266 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 17 03:27:48.345400 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-5150eab5-bdb0-4522-ad97-e8464e4564cf tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:27:48.345844 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-5150eab5-bdb0-4522-ad97-e8464e4564cf tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:27:48.346620 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-5150eab5-bdb0-4522-ad97-e8464e4564cf tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:27:48.347049 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-5150eab5-bdb0-4522-ad97-e8464e4564cf tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:27:48.541008 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-ee786247-995e-4e6f-ab4c-1b2f926587c9 tempest-AttachVolumeTestJSON-1651611701 tempest-AttachVolumeTestJSON-1651611701-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 17 03:27:48.542234 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-ee786247-995e-4e6f-ab4c-1b2f926587c9 tempest-AttachVolumeTestJSON-1651611701 tempest-AttachVolumeTestJSON-1651611701-project] [instance: 5e11ea9c-f66a-4962-b5ca-b95784624824] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:27:48.548281 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-ee786247-995e-4e6f-ab4c-1b2f926587c9 tempest-AttachVolumeTestJSON-1651611701 tempest-AttachVolumeTestJSON-1651611701-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:27:48.549413 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-ee786247-995e-4e6f-ab4c-1b2f926587c9 tempest-AttachVolumeTestJSON-1651611701 tempest-AttachVolumeTestJSON-1651611701-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:27:48.550181 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-ee786247-995e-4e6f-ab4c-1b2f926587c9 tempest-AttachVolumeTestJSON-1651611701 tempest-AttachVolumeTestJSON-1651611701-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:27:48.550854 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-ee786247-995e-4e6f-ab4c-1b2f926587c9 tempest-AttachVolumeTestJSON-1651611701 tempest-AttachVolumeTestJSON-1651611701-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:27:48.670523 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-5150eab5-bdb0-4522-ad97-e8464e4564cf tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] 10.222.0.11 "POST /compute/v2.1/servers/b89eca0e-d486-4b3a-a41a-aa02de394cff/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.336990 Nov 17 03:27:48.671167 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 298/584] 10.222.0.11 () {60 vars in 1322 bytes} [Wed Nov 17 03:27:48 2021] POST /compute/v2.1/servers/b89eca0e-d486-4b3a-a41a-aa02de394cff/os-volume_attachments => generated 194 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 17 03:27:48.732147 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-ee786247-995e-4e6f-ab4c-1b2f926587c9 tempest-AttachVolumeTestJSON-1651611701 tempest-AttachVolumeTestJSON-1651611701-project] 10.222.0.11 "POST /compute/v2.1/servers/5e11ea9c-f66a-4962-b5ca-b95784624824/action" status: 200 len: 28633 microversion: 2.1 time: 0.196254 Nov 17 03:27:48.732800 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 287/585] 10.222.0.11 () {60 vars in 1277 bytes} [Wed Nov 17 03:27:48 2021] POST /compute/v2.1/servers/5e11ea9c-f66a-4962-b5ca-b95784624824/action => generated 28633 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 17 03:27:48.743880 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-b51ba3e8-0bbc-43dd-909d-90053edb3479 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:27:48.744571 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-b51ba3e8-0bbc-43dd-909d-90053edb3479 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] [instance: 5d54db85-b991-4890-abaa-952413baa2e7] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:27:48.751535 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-b51ba3e8-0bbc-43dd-909d-90053edb3479 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:27:48.751988 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-b51ba3e8-0bbc-43dd-909d-90053edb3479 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:27:48.752756 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-b51ba3e8-0bbc-43dd-909d-90053edb3479 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:27:48.753218 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-b51ba3e8-0bbc-43dd-909d-90053edb3479 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:27:48.901207 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-b51ba3e8-0bbc-43dd-909d-90053edb3479 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37f21d6d15cf40a586edda211219fd08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ebb970305844dccacf48a7d8d47ecf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:27:48.909570 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-b51ba3e8-0bbc-43dd-909d-90053edb3479 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '37f21d6d15cf40a586edda211219fd08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ebb970305844dccacf48a7d8d47ecf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:27:48.911215 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-b51ba3e8-0bbc-43dd-909d-90053edb3479 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '37f21d6d15cf40a586edda211219fd08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ebb970305844dccacf48a7d8d47ecf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:27:48.912368 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-b51ba3e8-0bbc-43dd-909d-90053edb3479 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] 10.222.0.11 "GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7" status: 200 len: 1741 microversion: 2.20 time: 0.172707 Nov 17 03:27:48.912967 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 299/586] 10.222.0.11 () {60 vars in 1276 bytes} [Wed Nov 17 03:27:48 2021] GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7 => generated 1741 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 17 03:27:49.353739 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-48172be6-2eb5-4074-b88d-097ca878ecf7 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:27:49.354928 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-48172be6-2eb5-4074-b88d-097ca878ecf7 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] [instance: a49437df-3059-4528-8328-2f3471d5fb45] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:27:49.364262 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-18c0b801-dbb3-4875-a3db-b4ca0bb4bb09 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:27:49.365003 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-18c0b801-dbb3-4875-a3db-b4ca0bb4bb09 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] [instance: 5ddbfaaa-fabf-4324-941c-8868625ffefc] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:27:49.365886 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-48172be6-2eb5-4074-b88d-097ca878ecf7 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:27:49.366329 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-48172be6-2eb5-4074-b88d-097ca878ecf7 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:27:49.367103 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-48172be6-2eb5-4074-b88d-097ca878ecf7 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:27:49.367514 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-48172be6-2eb5-4074-b88d-097ca878ecf7 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:27:49.371319 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-18c0b801-dbb3-4875-a3db-b4ca0bb4bb09 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:27:49.371835 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-18c0b801-dbb3-4875-a3db-b4ca0bb4bb09 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:27:49.372624 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-18c0b801-dbb3-4875-a3db-b4ca0bb4bb09 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:27:49.373075 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-18c0b801-dbb3-4875-a3db-b4ca0bb4bb09 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:27:49.511051 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-48172be6-2eb5-4074-b88d-097ca878ecf7 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f046401c6a04f6495ebe0821120bd72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a58e89ceeea4a9c8a72a1de4bcaf2d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:27:49.518931 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-18c0b801-dbb3-4875-a3db-b4ca0bb4bb09 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80763e09d44c475ea2425b22874e9612', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fef02a1dd77946a2ac0e0414b557435f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:27:49.519529 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-48172be6-2eb5-4074-b88d-097ca878ecf7 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] 10.222.0.11 "GET /compute/v2.1/servers/a49437df-3059-4528-8328-2f3471d5fb45" status: 200 len: 1566 microversion: 2.1 time: 0.172662 Nov 17 03:27:49.520257 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 288/587] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:27:49 2021] GET /compute/v2.1/servers/a49437df-3059-4528-8328-2f3471d5fb45 => generated 1566 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:27:49.527159 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-18c0b801-dbb3-4875-a3db-b4ca0bb4bb09 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] 10.222.0.11 "GET /compute/v2.1/servers/5ddbfaaa-fabf-4324-941c-8868625ffefc" status: 200 len: 1266 microversion: 2.1 time: 0.169061 Nov 17 03:27:49.527705 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 300/588] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:27:49 2021] GET /compute/v2.1/servers/5ddbfaaa-fabf-4324-941c-8868625ffefc => generated 1266 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:27:49.747460 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-4a918bfe-4d23-457e-a0cc-022c730978d6 tempest-AttachVolumeTestJSON-1651611701 tempest-AttachVolumeTestJSON-1651611701-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 17 03:27:49.749066 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-4a918bfe-4d23-457e-a0cc-022c730978d6 tempest-AttachVolumeTestJSON-1651611701 tempest-AttachVolumeTestJSON-1651611701-project] [instance: 5e11ea9c-f66a-4962-b5ca-b95784624824] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:27:49.758043 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-4a918bfe-4d23-457e-a0cc-022c730978d6 tempest-AttachVolumeTestJSON-1651611701 tempest-AttachVolumeTestJSON-1651611701-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:27:49.758537 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-4a918bfe-4d23-457e-a0cc-022c730978d6 tempest-AttachVolumeTestJSON-1651611701 tempest-AttachVolumeTestJSON-1651611701-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:27:49.759307 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-4a918bfe-4d23-457e-a0cc-022c730978d6 tempest-AttachVolumeTestJSON-1651611701 tempest-AttachVolumeTestJSON-1651611701-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:27:49.759733 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-4a918bfe-4d23-457e-a0cc-022c730978d6 tempest-AttachVolumeTestJSON-1651611701 tempest-AttachVolumeTestJSON-1651611701-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:27:49.931377 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-b3b89836-d9fe-45ba-ae58-e0c62ab0de07 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:27:49.932329 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-b3b89836-d9fe-45ba-ae58-e0c62ab0de07 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] [instance: 5d54db85-b991-4890-abaa-952413baa2e7] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:27:49.938684 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-b3b89836-d9fe-45ba-ae58-e0c62ab0de07 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:27:49.939127 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-b3b89836-d9fe-45ba-ae58-e0c62ab0de07 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:27:49.939888 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-b3b89836-d9fe-45ba-ae58-e0c62ab0de07 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:27:49.940315 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-b3b89836-d9fe-45ba-ae58-e0c62ab0de07 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:27:49.971679 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-4a918bfe-4d23-457e-a0cc-022c730978d6 tempest-AttachVolumeTestJSON-1651611701 tempest-AttachVolumeTestJSON-1651611701-project] 10.222.0.11 "POST /compute/v2.1/servers/5e11ea9c-f66a-4962-b5ca-b95784624824/action" status: 200 len: 28633 microversion: 2.1 time: 0.230308 Nov 17 03:27:49.975671 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 289/589] 10.222.0.11 () {60 vars in 1277 bytes} [Wed Nov 17 03:27:49 2021] POST /compute/v2.1/servers/5e11ea9c-f66a-4962-b5ca-b95784624824/action => generated 28633 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 17 03:27:50.085449 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-b3b89836-d9fe-45ba-ae58-e0c62ab0de07 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37f21d6d15cf40a586edda211219fd08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ebb970305844dccacf48a7d8d47ecf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:27:50.093834 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-b3b89836-d9fe-45ba-ae58-e0c62ab0de07 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '37f21d6d15cf40a586edda211219fd08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ebb970305844dccacf48a7d8d47ecf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:27:50.095337 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-b3b89836-d9fe-45ba-ae58-e0c62ab0de07 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '37f21d6d15cf40a586edda211219fd08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ebb970305844dccacf48a7d8d47ecf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:27:50.096531 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-b3b89836-d9fe-45ba-ae58-e0c62ab0de07 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] 10.222.0.11 "GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7" status: 200 len: 1741 microversion: 2.20 time: 0.168975 Nov 17 03:27:50.097179 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 301/590] 10.222.0.11 () {60 vars in 1276 bytes} [Wed Nov 17 03:27:49 2021] GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7 => generated 1741 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 17 03:27:50.540271 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-77ac2d88-750e-4628-abf4-3cdb158b0f93 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:27:50.541928 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-77ac2d88-750e-4628-abf4-3cdb158b0f93 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] [instance: a49437df-3059-4528-8328-2f3471d5fb45] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:27:50.545175 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-38dfaa3b-dc4e-401f-9166-a075693cac4b tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:27:50.547071 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-38dfaa3b-dc4e-401f-9166-a075693cac4b tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] [instance: 5ddbfaaa-fabf-4324-941c-8868625ffefc] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:27:50.552159 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-77ac2d88-750e-4628-abf4-3cdb158b0f93 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:27:50.552412 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-77ac2d88-750e-4628-abf4-3cdb158b0f93 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:27:50.553793 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-77ac2d88-750e-4628-abf4-3cdb158b0f93 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:27:50.553918 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-38dfaa3b-dc4e-401f-9166-a075693cac4b tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:27:50.554233 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-77ac2d88-750e-4628-abf4-3cdb158b0f93 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:27:50.554360 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-38dfaa3b-dc4e-401f-9166-a075693cac4b tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:27:50.555057 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-38dfaa3b-dc4e-401f-9166-a075693cac4b tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:27:50.555485 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-38dfaa3b-dc4e-401f-9166-a075693cac4b tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:27:50.699175 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-77ac2d88-750e-4628-abf4-3cdb158b0f93 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f046401c6a04f6495ebe0821120bd72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a58e89ceeea4a9c8a72a1de4bcaf2d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:27:50.701966 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-38dfaa3b-dc4e-401f-9166-a075693cac4b tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80763e09d44c475ea2425b22874e9612', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fef02a1dd77946a2ac0e0414b557435f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:27:50.707178 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-77ac2d88-750e-4628-abf4-3cdb158b0f93 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] 10.222.0.11 "GET /compute/v2.1/servers/a49437df-3059-4528-8328-2f3471d5fb45" status: 200 len: 1566 microversion: 2.1 time: 0.172711 Nov 17 03:27:50.707750 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 290/591] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:27:50 2021] GET /compute/v2.1/servers/a49437df-3059-4528-8328-2f3471d5fb45 => generated 1566 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:27:50.710957 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-38dfaa3b-dc4e-401f-9166-a075693cac4b tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] 10.222.0.11 "GET /compute/v2.1/servers/5ddbfaaa-fabf-4324-941c-8868625ffefc" status: 200 len: 1454 microversion: 2.1 time: 0.170750 Nov 17 03:27:50.711497 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 302/592] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:27:50 2021] GET /compute/v2.1/servers/5ddbfaaa-fabf-4324-941c-8868625ffefc => generated 1454 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 17 03:27:50.727380 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-405ff9b7-5d09-4fd8-88b3-c09dea078585 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:27:50.727984 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-405ff9b7-5d09-4fd8-88b3-c09dea078585 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] [instance: 5ddbfaaa-fabf-4324-941c-8868625ffefc] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:27:50.734055 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-405ff9b7-5d09-4fd8-88b3-c09dea078585 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:27:50.734495 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-405ff9b7-5d09-4fd8-88b3-c09dea078585 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:27:50.735265 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-405ff9b7-5d09-4fd8-88b3-c09dea078585 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:27:50.735698 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-405ff9b7-5d09-4fd8-88b3-c09dea078585 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:27:50.876729 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-405ff9b7-5d09-4fd8-88b3-c09dea078585 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80763e09d44c475ea2425b22874e9612', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fef02a1dd77946a2ac0e0414b557435f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:27:50.886674 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-405ff9b7-5d09-4fd8-88b3-c09dea078585 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] 10.222.0.11 "GET /compute/v2.1/servers/5ddbfaaa-fabf-4324-941c-8868625ffefc" status: 200 len: 1454 microversion: 2.1 time: 0.162938 Nov 17 03:27:50.887771 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 291/593] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:27:50 2021] GET /compute/v2.1/servers/5ddbfaaa-fabf-4324-941c-8868625ffefc => generated 1454 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 17 03:27:50.983620 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-af78ea95-9b4a-4703-9270-a8aebb0a6bec tempest-AttachVolumeTestJSON-1651611701 tempest-AttachVolumeTestJSON-1651611701-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 17 03:27:50.984496 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-af78ea95-9b4a-4703-9270-a8aebb0a6bec tempest-AttachVolumeTestJSON-1651611701 tempest-AttachVolumeTestJSON-1651611701-project] [instance: 5e11ea9c-f66a-4962-b5ca-b95784624824] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:27:50.991461 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-af78ea95-9b4a-4703-9270-a8aebb0a6bec tempest-AttachVolumeTestJSON-1651611701 tempest-AttachVolumeTestJSON-1651611701-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:27:50.991899 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-af78ea95-9b4a-4703-9270-a8aebb0a6bec tempest-AttachVolumeTestJSON-1651611701 tempest-AttachVolumeTestJSON-1651611701-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:27:50.992831 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-af78ea95-9b4a-4703-9270-a8aebb0a6bec tempest-AttachVolumeTestJSON-1651611701 tempest-AttachVolumeTestJSON-1651611701-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:27:50.993120 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-af78ea95-9b4a-4703-9270-a8aebb0a6bec tempest-AttachVolumeTestJSON-1651611701 tempest-AttachVolumeTestJSON-1651611701-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:27:51.115260 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-1da0c7f0-946a-4276-91f9-dd24a386f0a0 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:27:51.115966 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-1da0c7f0-946a-4276-91f9-dd24a386f0a0 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] [instance: 5d54db85-b991-4890-abaa-952413baa2e7] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:27:51.122607 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-1da0c7f0-946a-4276-91f9-dd24a386f0a0 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:27:51.123054 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-1da0c7f0-946a-4276-91f9-dd24a386f0a0 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:27:51.123839 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-1da0c7f0-946a-4276-91f9-dd24a386f0a0 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:27:51.124266 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-1da0c7f0-946a-4276-91f9-dd24a386f0a0 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:27:51.153874 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-af78ea95-9b4a-4703-9270-a8aebb0a6bec tempest-AttachVolumeTestJSON-1651611701 tempest-AttachVolumeTestJSON-1651611701-project] 10.222.0.11 "POST /compute/v2.1/servers/5e11ea9c-f66a-4962-b5ca-b95784624824/action" status: 200 len: 28633 microversion: 2.1 time: 0.170501 Nov 17 03:27:51.155815 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 303/594] 10.222.0.11 () {60 vars in 1277 bytes} [Wed Nov 17 03:27:50 2021] POST /compute/v2.1/servers/5e11ea9c-f66a-4962-b5ca-b95784624824/action => generated 28633 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 17 03:27:51.322526 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-1da0c7f0-946a-4276-91f9-dd24a386f0a0 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37f21d6d15cf40a586edda211219fd08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ebb970305844dccacf48a7d8d47ecf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:27:51.330506 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-1da0c7f0-946a-4276-91f9-dd24a386f0a0 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '37f21d6d15cf40a586edda211219fd08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ebb970305844dccacf48a7d8d47ecf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:27:51.332000 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-1da0c7f0-946a-4276-91f9-dd24a386f0a0 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '37f21d6d15cf40a586edda211219fd08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ebb970305844dccacf48a7d8d47ecf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:27:51.333323 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-1da0c7f0-946a-4276-91f9-dd24a386f0a0 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] 10.222.0.11 "GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7" status: 200 len: 1741 microversion: 2.20 time: 0.221877 Nov 17 03:27:51.333891 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 292/595] 10.222.0.11 () {60 vars in 1276 bytes} [Wed Nov 17 03:27:51 2021] GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7 => generated 1741 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 17 03:27:51.724036 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-1d6c63f9-beaa-44d5-861c-4cd17499a3da tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:27:51.725843 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-1d6c63f9-beaa-44d5-861c-4cd17499a3da tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] [instance: a49437df-3059-4528-8328-2f3471d5fb45] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:27:51.734389 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-1d6c63f9-beaa-44d5-861c-4cd17499a3da tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:27:51.734827 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-1d6c63f9-beaa-44d5-861c-4cd17499a3da tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:27:51.735616 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-1d6c63f9-beaa-44d5-861c-4cd17499a3da tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:27:51.736048 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-1d6c63f9-beaa-44d5-861c-4cd17499a3da tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:27:51.878192 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-1d6c63f9-beaa-44d5-861c-4cd17499a3da tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f046401c6a04f6495ebe0821120bd72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a58e89ceeea4a9c8a72a1de4bcaf2d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:27:51.887219 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-1d6c63f9-beaa-44d5-861c-4cd17499a3da tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] 10.222.0.11 "GET /compute/v2.1/servers/a49437df-3059-4528-8328-2f3471d5fb45" status: 200 len: 1566 microversion: 2.1 time: 0.167330 Nov 17 03:27:51.888035 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 304/596] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:27:51 2021] GET /compute/v2.1/servers/a49437df-3059-4528-8328-2f3471d5fb45 => generated 1566 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:27:52.166374 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-f89156f7-07c0-455b-a723-b9bea7f126fa tempest-AttachVolumeTestJSON-1651611701 tempest-AttachVolumeTestJSON-1651611701-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 17 03:27:52.167392 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-f89156f7-07c0-455b-a723-b9bea7f126fa tempest-AttachVolumeTestJSON-1651611701 tempest-AttachVolumeTestJSON-1651611701-project] [instance: 5e11ea9c-f66a-4962-b5ca-b95784624824] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:27:52.174177 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-f89156f7-07c0-455b-a723-b9bea7f126fa tempest-AttachVolumeTestJSON-1651611701 tempest-AttachVolumeTestJSON-1651611701-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:27:52.174636 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-f89156f7-07c0-455b-a723-b9bea7f126fa tempest-AttachVolumeTestJSON-1651611701 tempest-AttachVolumeTestJSON-1651611701-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:27:52.175484 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-f89156f7-07c0-455b-a723-b9bea7f126fa tempest-AttachVolumeTestJSON-1651611701 tempest-AttachVolumeTestJSON-1651611701-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:27:52.175902 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-f89156f7-07c0-455b-a723-b9bea7f126fa tempest-AttachVolumeTestJSON-1651611701 tempest-AttachVolumeTestJSON-1651611701-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:27:52.311298 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-f89156f7-07c0-455b-a723-b9bea7f126fa tempest-AttachVolumeTestJSON-1651611701 tempest-AttachVolumeTestJSON-1651611701-project] 10.222.0.11 "POST /compute/v2.1/servers/5e11ea9c-f66a-4962-b5ca-b95784624824/action" status: 200 len: 28633 microversion: 2.1 time: 0.148432 Nov 17 03:27:52.313193 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 293/597] 10.222.0.11 () {60 vars in 1277 bytes} [Wed Nov 17 03:27:52 2021] POST /compute/v2.1/servers/5e11ea9c-f66a-4962-b5ca-b95784624824/action => generated 28633 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 17 03:27:52.352008 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-2448432e-d251-48c4-8c9b-41db6c4cc92f tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:27:52.352576 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-2448432e-d251-48c4-8c9b-41db6c4cc92f tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] [instance: 5d54db85-b991-4890-abaa-952413baa2e7] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:27:52.359979 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-2448432e-d251-48c4-8c9b-41db6c4cc92f tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:27:52.360755 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-2448432e-d251-48c4-8c9b-41db6c4cc92f tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:27:52.361579 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-2448432e-d251-48c4-8c9b-41db6c4cc92f tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:27:52.362043 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-2448432e-d251-48c4-8c9b-41db6c4cc92f tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:27:52.502112 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-2448432e-d251-48c4-8c9b-41db6c4cc92f tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37f21d6d15cf40a586edda211219fd08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ebb970305844dccacf48a7d8d47ecf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:27:52.510605 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-2448432e-d251-48c4-8c9b-41db6c4cc92f tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '37f21d6d15cf40a586edda211219fd08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ebb970305844dccacf48a7d8d47ecf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:27:52.512091 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-2448432e-d251-48c4-8c9b-41db6c4cc92f tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '37f21d6d15cf40a586edda211219fd08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ebb970305844dccacf48a7d8d47ecf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:27:52.513313 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-2448432e-d251-48c4-8c9b-41db6c4cc92f tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] 10.222.0.11 "GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7" status: 200 len: 1741 microversion: 2.20 time: 0.165474 Nov 17 03:27:52.514089 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 305/598] 10.222.0.11 () {60 vars in 1276 bytes} [Wed Nov 17 03:27:52 2021] GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7 => generated 1741 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 17 03:27:52.904642 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-eeb894bf-63c6-40e1-bb56-b22d4950b6a6 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:27:52.905377 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-eeb894bf-63c6-40e1-bb56-b22d4950b6a6 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] [instance: a49437df-3059-4528-8328-2f3471d5fb45] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:27:52.913639 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-eeb894bf-63c6-40e1-bb56-b22d4950b6a6 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:27:52.914059 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-eeb894bf-63c6-40e1-bb56-b22d4950b6a6 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:27:52.915031 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-eeb894bf-63c6-40e1-bb56-b22d4950b6a6 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:27:52.915464 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-eeb894bf-63c6-40e1-bb56-b22d4950b6a6 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:27:53.111897 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-eeb894bf-63c6-40e1-bb56-b22d4950b6a6 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f046401c6a04f6495ebe0821120bd72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a58e89ceeea4a9c8a72a1de4bcaf2d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:27:53.120876 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [req-0bb57800-2bfd-48e7-a2ad-972304f53eae req-8b6f832a-9124-40fd-a367-87f4de023dd4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5ddbfaaa-fabf-4324-941c-8868625ffefc", "tag": "c37d71de-0892-41d0-9d86-8ce8b8ccde7f"}]} {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 17 03:27:53.122646 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 17 03:27:53.122646 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: warnings.warn(msg) Nov 17 03:27:53.129494 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-eeb894bf-63c6-40e1-bb56-b22d4950b6a6 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] 10.222.0.11 "GET /compute/v2.1/servers/a49437df-3059-4528-8328-2f3471d5fb45" status: 200 len: 1566 microversion: 2.1 time: 0.229170 Nov 17 03:27:53.130197 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 294/599] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:27:52 2021] GET /compute/v2.1/servers/a49437df-3059-4528-8328-2f3471d5fb45 => generated 1566 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:27:53.135733 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [req-0bb57800-2bfd-48e7-a2ad-972304f53eae req-8b6f832a-9124-40fd-a367-87f4de023dd4 service nova] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:27:53.136282 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [req-0bb57800-2bfd-48e7-a2ad-972304f53eae req-8b6f832a-9124-40fd-a367-87f4de023dd4 service nova] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:27:53.147908 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.compute.server_external_events [req-0bb57800-2bfd-48e7-a2ad-972304f53eae req-8b6f832a-9124-40fd-a367-87f4de023dd4 service nova] Creating event network-changed:c37d71de-0892-41d0-9d86-8ce8b8ccde7f for instance 5ddbfaaa-fabf-4324-941c-8868625ffefc on hv-cinder-81803 Nov 17 03:27:53.152959 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [req-0bb57800-2bfd-48e7-a2ad-972304f53eae req-8b6f832a-9124-40fd-a367-87f4de023dd4 service nova] 10.222.0.11 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036096 Nov 17 03:27:53.153553 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 306/600] 10.222.0.11 () {64 vars in 1317 bytes} [Wed Nov 17 03:27:53 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 17 03:27:53.323890 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-a2a89262-76ea-49b3-82de-a495c88debc9 tempest-AttachVolumeTestJSON-1651611701 tempest-AttachVolumeTestJSON-1651611701-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 17 03:27:53.324876 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-a2a89262-76ea-49b3-82de-a495c88debc9 tempest-AttachVolumeTestJSON-1651611701 tempest-AttachVolumeTestJSON-1651611701-project] [instance: 5e11ea9c-f66a-4962-b5ca-b95784624824] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:27:53.337860 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-a2a89262-76ea-49b3-82de-a495c88debc9 tempest-AttachVolumeTestJSON-1651611701 tempest-AttachVolumeTestJSON-1651611701-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:27:53.338757 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-a2a89262-76ea-49b3-82de-a495c88debc9 tempest-AttachVolumeTestJSON-1651611701 tempest-AttachVolumeTestJSON-1651611701-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:27:53.339810 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-a2a89262-76ea-49b3-82de-a495c88debc9 tempest-AttachVolumeTestJSON-1651611701 tempest-AttachVolumeTestJSON-1651611701-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:27:53.340487 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-a2a89262-76ea-49b3-82de-a495c88debc9 tempest-AttachVolumeTestJSON-1651611701 tempest-AttachVolumeTestJSON-1651611701-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:27:53.517617 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-a2a89262-76ea-49b3-82de-a495c88debc9 tempest-AttachVolumeTestJSON-1651611701 tempest-AttachVolumeTestJSON-1651611701-project] 10.222.0.11 "POST /compute/v2.1/servers/5e11ea9c-f66a-4962-b5ca-b95784624824/action" status: 200 len: 28633 microversion: 2.1 time: 0.197269 Nov 17 03:27:53.518274 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 295/601] 10.222.0.11 () {60 vars in 1277 bytes} [Wed Nov 17 03:27:53 2021] POST /compute/v2.1/servers/5e11ea9c-f66a-4962-b5ca-b95784624824/action => generated 28633 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 17 03:27:53.531930 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-99d3fad3-bf69-421e-9fd1-76960d8824d2 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:27:53.532591 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-99d3fad3-bf69-421e-9fd1-76960d8824d2 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] [instance: 5d54db85-b991-4890-abaa-952413baa2e7] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:27:53.539318 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-99d3fad3-bf69-421e-9fd1-76960d8824d2 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:27:53.539719 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-99d3fad3-bf69-421e-9fd1-76960d8824d2 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:27:53.541661 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-99d3fad3-bf69-421e-9fd1-76960d8824d2 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:27:53.542110 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-99d3fad3-bf69-421e-9fd1-76960d8824d2 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:27:53.761136 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-99d3fad3-bf69-421e-9fd1-76960d8824d2 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37f21d6d15cf40a586edda211219fd08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ebb970305844dccacf48a7d8d47ecf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:27:53.778043 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-99d3fad3-bf69-421e-9fd1-76960d8824d2 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '37f21d6d15cf40a586edda211219fd08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ebb970305844dccacf48a7d8d47ecf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:27:53.779555 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-99d3fad3-bf69-421e-9fd1-76960d8824d2 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '37f21d6d15cf40a586edda211219fd08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ebb970305844dccacf48a7d8d47ecf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:27:53.781180 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-99d3fad3-bf69-421e-9fd1-76960d8824d2 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] 10.222.0.11 "GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7" status: 200 len: 1741 microversion: 2.20 time: 0.252930 Nov 17 03:27:53.793558 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 307/602] 10.222.0.11 () {60 vars in 1276 bytes} [Wed Nov 17 03:27:53 2021] GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7 => generated 1741 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 17 03:27:54.147436 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-535c8942-4db9-4db0-83d2-03cdaa4d483e tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:27:54.148138 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-535c8942-4db9-4db0-83d2-03cdaa4d483e tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] [instance: a49437df-3059-4528-8328-2f3471d5fb45] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:27:54.155269 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-535c8942-4db9-4db0-83d2-03cdaa4d483e tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:27:54.155675 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-535c8942-4db9-4db0-83d2-03cdaa4d483e tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:27:54.156451 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-535c8942-4db9-4db0-83d2-03cdaa4d483e tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:27:54.156920 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-535c8942-4db9-4db0-83d2-03cdaa4d483e tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:27:54.309417 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-535c8942-4db9-4db0-83d2-03cdaa4d483e tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f046401c6a04f6495ebe0821120bd72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a58e89ceeea4a9c8a72a1de4bcaf2d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:27:54.317552 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-535c8942-4db9-4db0-83d2-03cdaa4d483e tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] 10.222.0.11 "GET /compute/v2.1/servers/a49437df-3059-4528-8328-2f3471d5fb45" status: 200 len: 1566 microversion: 2.1 time: 0.174282 Nov 17 03:27:54.318748 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 296/603] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:27:54 2021] GET /compute/v2.1/servers/a49437df-3059-4528-8328-2f3471d5fb45 => generated 1566 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:27:54.530174 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-e97d20bb-df3a-4daa-aafd-6255acc4a7d3 tempest-AttachVolumeTestJSON-1651611701 tempest-AttachVolumeTestJSON-1651611701-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 17 03:27:54.531166 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-e97d20bb-df3a-4daa-aafd-6255acc4a7d3 tempest-AttachVolumeTestJSON-1651611701 tempest-AttachVolumeTestJSON-1651611701-project] [instance: 5e11ea9c-f66a-4962-b5ca-b95784624824] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:27:54.537306 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-e97d20bb-df3a-4daa-aafd-6255acc4a7d3 tempest-AttachVolumeTestJSON-1651611701 tempest-AttachVolumeTestJSON-1651611701-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:27:54.537932 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-e97d20bb-df3a-4daa-aafd-6255acc4a7d3 tempest-AttachVolumeTestJSON-1651611701 tempest-AttachVolumeTestJSON-1651611701-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:27:54.538539 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-e97d20bb-df3a-4daa-aafd-6255acc4a7d3 tempest-AttachVolumeTestJSON-1651611701 tempest-AttachVolumeTestJSON-1651611701-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:27:54.538971 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-e97d20bb-df3a-4daa-aafd-6255acc4a7d3 tempest-AttachVolumeTestJSON-1651611701 tempest-AttachVolumeTestJSON-1651611701-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:27:54.691797 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-e97d20bb-df3a-4daa-aafd-6255acc4a7d3 tempest-AttachVolumeTestJSON-1651611701 tempest-AttachVolumeTestJSON-1651611701-project] 10.222.0.11 "POST /compute/v2.1/servers/5e11ea9c-f66a-4962-b5ca-b95784624824/action" status: 200 len: 28633 microversion: 2.1 time: 0.165269 Nov 17 03:27:54.692447 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 308/604] 10.222.0.11 () {60 vars in 1277 bytes} [Wed Nov 17 03:27:54 2021] POST /compute/v2.1/servers/5e11ea9c-f66a-4962-b5ca-b95784624824/action => generated 28633 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 17 03:27:54.808526 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-166fb935-e651-440f-abcb-0e176449f902 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:27:54.809963 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-166fb935-e651-440f-abcb-0e176449f902 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] [instance: 5d54db85-b991-4890-abaa-952413baa2e7] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:27:54.816539 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-166fb935-e651-440f-abcb-0e176449f902 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:27:54.817013 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-166fb935-e651-440f-abcb-0e176449f902 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:27:54.817797 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-166fb935-e651-440f-abcb-0e176449f902 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:27:54.818221 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-166fb935-e651-440f-abcb-0e176449f902 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:27:54.972332 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-166fb935-e651-440f-abcb-0e176449f902 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37f21d6d15cf40a586edda211219fd08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ebb970305844dccacf48a7d8d47ecf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:27:54.980931 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-166fb935-e651-440f-abcb-0e176449f902 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '37f21d6d15cf40a586edda211219fd08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ebb970305844dccacf48a7d8d47ecf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:27:54.982478 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-166fb935-e651-440f-abcb-0e176449f902 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '37f21d6d15cf40a586edda211219fd08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ebb970305844dccacf48a7d8d47ecf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:27:54.983797 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-166fb935-e651-440f-abcb-0e176449f902 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] 10.222.0.11 "GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7" status: 200 len: 1741 microversion: 2.20 time: 0.180041 Nov 17 03:27:54.984519 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 297/605] 10.222.0.11 () {60 vars in 1276 bytes} [Wed Nov 17 03:27:54 2021] GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7 => generated 1741 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 17 03:27:55.337824 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-cbca026c-f2dc-4090-810f-6fa63cf04be0 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:27:55.338948 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-cbca026c-f2dc-4090-810f-6fa63cf04be0 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] [instance: a49437df-3059-4528-8328-2f3471d5fb45] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:27:55.346308 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-cbca026c-f2dc-4090-810f-6fa63cf04be0 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:27:55.347036 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-cbca026c-f2dc-4090-810f-6fa63cf04be0 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:27:55.348149 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-cbca026c-f2dc-4090-810f-6fa63cf04be0 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:27:55.348801 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-cbca026c-f2dc-4090-810f-6fa63cf04be0 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:27:55.502942 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-cbca026c-f2dc-4090-810f-6fa63cf04be0 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f046401c6a04f6495ebe0821120bd72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a58e89ceeea4a9c8a72a1de4bcaf2d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:27:55.511926 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-cbca026c-f2dc-4090-810f-6fa63cf04be0 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] 10.222.0.11 "GET /compute/v2.1/servers/a49437df-3059-4528-8328-2f3471d5fb45" status: 200 len: 1566 microversion: 2.1 time: 0.179644 Nov 17 03:27:55.521700 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 309/606] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:27:55 2021] GET /compute/v2.1/servers/a49437df-3059-4528-8328-2f3471d5fb45 => generated 1566 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:27:55.704398 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-de8311d1-3edd-4270-84a9-b17dc2806948 tempest-AttachVolumeTestJSON-1651611701 tempest-AttachVolumeTestJSON-1651611701-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 17 03:27:55.705464 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-de8311d1-3edd-4270-84a9-b17dc2806948 tempest-AttachVolumeTestJSON-1651611701 tempest-AttachVolumeTestJSON-1651611701-project] [instance: 5e11ea9c-f66a-4962-b5ca-b95784624824] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:27:55.716676 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-de8311d1-3edd-4270-84a9-b17dc2806948 tempest-AttachVolumeTestJSON-1651611701 tempest-AttachVolumeTestJSON-1651611701-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:27:55.717258 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-de8311d1-3edd-4270-84a9-b17dc2806948 tempest-AttachVolumeTestJSON-1651611701 tempest-AttachVolumeTestJSON-1651611701-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:27:55.718172 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-de8311d1-3edd-4270-84a9-b17dc2806948 tempest-AttachVolumeTestJSON-1651611701 tempest-AttachVolumeTestJSON-1651611701-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:27:55.723754 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-de8311d1-3edd-4270-84a9-b17dc2806948 tempest-AttachVolumeTestJSON-1651611701 tempest-AttachVolumeTestJSON-1651611701-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:27:55.843578 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-de8311d1-3edd-4270-84a9-b17dc2806948 tempest-AttachVolumeTestJSON-1651611701 tempest-AttachVolumeTestJSON-1651611701-project] 10.222.0.11 "POST /compute/v2.1/servers/5e11ea9c-f66a-4962-b5ca-b95784624824/action" status: 200 len: 28633 microversion: 2.1 time: 0.143429 Nov 17 03:27:55.847512 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 298/607] 10.222.0.11 () {60 vars in 1277 bytes} [Wed Nov 17 03:27:55 2021] POST /compute/v2.1/servers/5e11ea9c-f66a-4962-b5ca-b95784624824/action => generated 28633 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 17 03:27:56.002942 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-bbf62e1c-65e2-4686-904e-9b6fe87abee8 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:27:56.005486 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-bbf62e1c-65e2-4686-904e-9b6fe87abee8 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] [instance: 5d54db85-b991-4890-abaa-952413baa2e7] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:27:56.025309 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-bbf62e1c-65e2-4686-904e-9b6fe87abee8 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:27:56.026166 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-bbf62e1c-65e2-4686-904e-9b6fe87abee8 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:27:56.027025 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-bbf62e1c-65e2-4686-904e-9b6fe87abee8 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:27:56.027639 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-bbf62e1c-65e2-4686-904e-9b6fe87abee8 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:27:56.200943 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-bbf62e1c-65e2-4686-904e-9b6fe87abee8 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37f21d6d15cf40a586edda211219fd08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ebb970305844dccacf48a7d8d47ecf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:27:56.211422 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-bbf62e1c-65e2-4686-904e-9b6fe87abee8 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '37f21d6d15cf40a586edda211219fd08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ebb970305844dccacf48a7d8d47ecf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:27:56.213157 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-bbf62e1c-65e2-4686-904e-9b6fe87abee8 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '37f21d6d15cf40a586edda211219fd08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ebb970305844dccacf48a7d8d47ecf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:27:56.214843 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-bbf62e1c-65e2-4686-904e-9b6fe87abee8 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] 10.222.0.11 "GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7" status: 200 len: 1741 microversion: 2.20 time: 0.216749 Nov 17 03:27:56.215722 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 310/608] 10.222.0.11 () {60 vars in 1276 bytes} [Wed Nov 17 03:27:55 2021] GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7 => generated 1741 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 17 03:27:56.530194 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-bf9c6ddc-41f9-44d5-a51d-fe0860ef5ccb tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:27:56.531284 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-bf9c6ddc-41f9-44d5-a51d-fe0860ef5ccb tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] [instance: a49437df-3059-4528-8328-2f3471d5fb45] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:27:56.568029 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-bf9c6ddc-41f9-44d5-a51d-fe0860ef5ccb tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:27:56.568867 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-bf9c6ddc-41f9-44d5-a51d-fe0860ef5ccb tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:27:56.569953 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-bf9c6ddc-41f9-44d5-a51d-fe0860ef5ccb tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:27:56.570543 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-bf9c6ddc-41f9-44d5-a51d-fe0860ef5ccb tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:27:56.774047 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-bf9c6ddc-41f9-44d5-a51d-fe0860ef5ccb tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f046401c6a04f6495ebe0821120bd72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a58e89ceeea4a9c8a72a1de4bcaf2d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:27:56.783140 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-bf9c6ddc-41f9-44d5-a51d-fe0860ef5ccb tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] 10.222.0.11 "GET /compute/v2.1/servers/a49437df-3059-4528-8328-2f3471d5fb45" status: 200 len: 1566 microversion: 2.1 time: 0.256794 Nov 17 03:27:56.784479 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 299/609] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:27:56 2021] GET /compute/v2.1/servers/a49437df-3059-4528-8328-2f3471d5fb45 => generated 1566 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:27:56.856377 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-511a9c5a-0a5b-40f4-af49-f738823d521d tempest-AttachVolumeTestJSON-1651611701 tempest-AttachVolumeTestJSON-1651611701-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 17 03:27:56.857502 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-511a9c5a-0a5b-40f4-af49-f738823d521d tempest-AttachVolumeTestJSON-1651611701 tempest-AttachVolumeTestJSON-1651611701-project] [instance: 5e11ea9c-f66a-4962-b5ca-b95784624824] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:27:56.868180 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-511a9c5a-0a5b-40f4-af49-f738823d521d tempest-AttachVolumeTestJSON-1651611701 tempest-AttachVolumeTestJSON-1651611701-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:27:56.868624 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-511a9c5a-0a5b-40f4-af49-f738823d521d tempest-AttachVolumeTestJSON-1651611701 tempest-AttachVolumeTestJSON-1651611701-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:27:56.869601 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-511a9c5a-0a5b-40f4-af49-f738823d521d tempest-AttachVolumeTestJSON-1651611701 tempest-AttachVolumeTestJSON-1651611701-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:27:56.870033 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-511a9c5a-0a5b-40f4-af49-f738823d521d tempest-AttachVolumeTestJSON-1651611701 tempest-AttachVolumeTestJSON-1651611701-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:27:57.042740 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-511a9c5a-0a5b-40f4-af49-f738823d521d tempest-AttachVolumeTestJSON-1651611701 tempest-AttachVolumeTestJSON-1651611701-project] 10.222.0.11 "POST /compute/v2.1/servers/5e11ea9c-f66a-4962-b5ca-b95784624824/action" status: 200 len: 28633 microversion: 2.1 time: 0.188929 Nov 17 03:27:57.043457 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 311/610] 10.222.0.11 () {60 vars in 1277 bytes} [Wed Nov 17 03:27:56 2021] POST /compute/v2.1/servers/5e11ea9c-f66a-4962-b5ca-b95784624824/action => generated 28633 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 17 03:27:57.234851 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-5e80f7c3-fdad-4a04-aa3d-2d9e0ea6dd91 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:27:57.245520 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-5e80f7c3-fdad-4a04-aa3d-2d9e0ea6dd91 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] [instance: 5d54db85-b991-4890-abaa-952413baa2e7] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:27:57.254095 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-5e80f7c3-fdad-4a04-aa3d-2d9e0ea6dd91 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:27:57.257539 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-5e80f7c3-fdad-4a04-aa3d-2d9e0ea6dd91 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:27:57.258356 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-5e80f7c3-fdad-4a04-aa3d-2d9e0ea6dd91 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:27:57.261603 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-5e80f7c3-fdad-4a04-aa3d-2d9e0ea6dd91 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:27:57.460650 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-5e80f7c3-fdad-4a04-aa3d-2d9e0ea6dd91 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37f21d6d15cf40a586edda211219fd08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ebb970305844dccacf48a7d8d47ecf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:27:57.470707 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-5e80f7c3-fdad-4a04-aa3d-2d9e0ea6dd91 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '37f21d6d15cf40a586edda211219fd08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ebb970305844dccacf48a7d8d47ecf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:27:57.472207 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-5e80f7c3-fdad-4a04-aa3d-2d9e0ea6dd91 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '37f21d6d15cf40a586edda211219fd08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ebb970305844dccacf48a7d8d47ecf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:27:57.473398 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-5e80f7c3-fdad-4a04-aa3d-2d9e0ea6dd91 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] 10.222.0.11 "GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7" status: 200 len: 1741 microversion: 2.20 time: 0.242392 Nov 17 03:27:57.474268 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 300/611] 10.222.0.11 () {60 vars in 1276 bytes} [Wed Nov 17 03:27:57 2021] GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7 => generated 1741 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 17 03:27:57.527175 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-1dbcad1d-bb23-4021-9011-93cd0977ac4b tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:27:57.527746 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-1dbcad1d-bb23-4021-9011-93cd0977ac4b tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] [instance: b89eca0e-d486-4b3a-a41a-aa02de394cff] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:27:57.534839 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-1dbcad1d-bb23-4021-9011-93cd0977ac4b tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:27:57.535284 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-1dbcad1d-bb23-4021-9011-93cd0977ac4b tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:27:57.536050 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-1dbcad1d-bb23-4021-9011-93cd0977ac4b tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:27:57.536478 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-1dbcad1d-bb23-4021-9011-93cd0977ac4b tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:27:57.681381 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.objects.instance [None req-1dbcad1d-bb23-4021-9011-93cd0977ac4b tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] Lazy-loading 'services' on Instance uuid b89eca0e-d486-4b3a-a41a-aa02de394cff {{(pid=115917) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Nov 17 03:27:57.800946 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-cc5b1584-88ce-423e-a7cc-bf8e062d871b tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:27:57.801561 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-cc5b1584-88ce-423e-a7cc-bf8e062d871b tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] [instance: a49437df-3059-4528-8328-2f3471d5fb45] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:27:57.819991 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-cc5b1584-88ce-423e-a7cc-bf8e062d871b tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:27:57.824934 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-cc5b1584-88ce-423e-a7cc-bf8e062d871b tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:27:57.830646 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-cc5b1584-88ce-423e-a7cc-bf8e062d871b tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:27:57.832529 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-cc5b1584-88ce-423e-a7cc-bf8e062d871b tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:27:57.874957 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-1dbcad1d-bb23-4021-9011-93cd0977ac4b tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] 10.222.0.11 "DELETE /compute/v2.1/servers/b89eca0e-d486-4b3a-a41a-aa02de394cff/os-volume_attachments/cbe64947-d9c3-43a7-b69c-ddc49552ac7d" status: 202 len: 0 microversion: 2.1 time: 0.351858 Nov 17 03:27:57.878961 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 312/612] 10.222.0.11 () {58 vars in 1415 bytes} [Wed Nov 17 03:27:57 2021] DELETE /compute/v2.1/servers/b89eca0e-d486-4b3a-a41a-aa02de394cff/os-volume_attachments/cbe64947-d9c3-43a7-b69c-ddc49552ac7d => generated 0 bytes in 354 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 17 03:27:57.892088 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-b5407a32-0090-4d4c-bb30-0eaaa4dd2d23 tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:27:57.897655 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-b5407a32-0090-4d4c-bb30-0eaaa4dd2d23 tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] [instance: b89eca0e-d486-4b3a-a41a-aa02de394cff] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:27:57.908811 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-b5407a32-0090-4d4c-bb30-0eaaa4dd2d23 tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:27:57.909313 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-b5407a32-0090-4d4c-bb30-0eaaa4dd2d23 tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:27:57.910105 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-b5407a32-0090-4d4c-bb30-0eaaa4dd2d23 tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:27:57.910542 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-b5407a32-0090-4d4c-bb30-0eaaa4dd2d23 tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:27:57.969661 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-b5407a32-0090-4d4c-bb30-0eaaa4dd2d23 tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] 10.222.0.11 "GET /compute/v2.1/servers/b89eca0e-d486-4b3a-a41a-aa02de394cff/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.083977 Nov 17 03:27:57.973529 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 313/613] 10.222.0.11 () {58 vars in 1301 bytes} [Wed Nov 17 03:27:57 2021] GET /compute/v2.1/servers/b89eca0e-d486-4b3a-a41a-aa02de394cff/os-volume_attachments => generated 197 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 17 03:27:58.065146 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-a2622003-5e53-45ba-bdc8-eb4a130946ad tempest-AttachVolumeTestJSON-1651611701 tempest-AttachVolumeTestJSON-1651611701-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 17 03:27:58.066298 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-a2622003-5e53-45ba-bdc8-eb4a130946ad tempest-AttachVolumeTestJSON-1651611701 tempest-AttachVolumeTestJSON-1651611701-project] [instance: 5e11ea9c-f66a-4962-b5ca-b95784624824] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:27:58.080633 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-a2622003-5e53-45ba-bdc8-eb4a130946ad tempest-AttachVolumeTestJSON-1651611701 tempest-AttachVolumeTestJSON-1651611701-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:27:58.080998 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-a2622003-5e53-45ba-bdc8-eb4a130946ad tempest-AttachVolumeTestJSON-1651611701 tempest-AttachVolumeTestJSON-1651611701-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:27:58.081792 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-a2622003-5e53-45ba-bdc8-eb4a130946ad tempest-AttachVolumeTestJSON-1651611701 tempest-AttachVolumeTestJSON-1651611701-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:27:58.082224 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-a2622003-5e53-45ba-bdc8-eb4a130946ad tempest-AttachVolumeTestJSON-1651611701 tempest-AttachVolumeTestJSON-1651611701-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:27:58.103697 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-cc5b1584-88ce-423e-a7cc-bf8e062d871b tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f046401c6a04f6495ebe0821120bd72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a58e89ceeea4a9c8a72a1de4bcaf2d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:27:58.112029 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-cc5b1584-88ce-423e-a7cc-bf8e062d871b tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] 10.222.0.11 "GET /compute/v2.1/servers/a49437df-3059-4528-8328-2f3471d5fb45" status: 200 len: 1566 microversion: 2.1 time: 0.315032 Nov 17 03:27:58.118743 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 301/614] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:27:57 2021] GET /compute/v2.1/servers/a49437df-3059-4528-8328-2f3471d5fb45 => generated 1566 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:27:58.265077 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-a2622003-5e53-45ba-bdc8-eb4a130946ad tempest-AttachVolumeTestJSON-1651611701 tempest-AttachVolumeTestJSON-1651611701-project] 10.222.0.11 "POST /compute/v2.1/servers/5e11ea9c-f66a-4962-b5ca-b95784624824/action" status: 200 len: 28633 microversion: 2.1 time: 0.213046 Nov 17 03:27:58.266017 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 314/615] 10.222.0.11 () {60 vars in 1277 bytes} [Wed Nov 17 03:27:58 2021] POST /compute/v2.1/servers/5e11ea9c-f66a-4962-b5ca-b95784624824/action => generated 28633 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 17 03:27:58.491726 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-40671157-5e6b-44de-9a4e-9787f035592c tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:27:58.492419 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-40671157-5e6b-44de-9a4e-9787f035592c tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] [instance: 5d54db85-b991-4890-abaa-952413baa2e7] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:27:58.498990 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-40671157-5e6b-44de-9a4e-9787f035592c tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:27:58.499664 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-40671157-5e6b-44de-9a4e-9787f035592c tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:27:58.500673 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-40671157-5e6b-44de-9a4e-9787f035592c tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:27:58.501124 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-40671157-5e6b-44de-9a4e-9787f035592c tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:27:58.647584 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-40671157-5e6b-44de-9a4e-9787f035592c tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37f21d6d15cf40a586edda211219fd08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ebb970305844dccacf48a7d8d47ecf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:27:58.659744 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-40671157-5e6b-44de-9a4e-9787f035592c tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '37f21d6d15cf40a586edda211219fd08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ebb970305844dccacf48a7d8d47ecf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:27:58.661733 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-40671157-5e6b-44de-9a4e-9787f035592c tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '37f21d6d15cf40a586edda211219fd08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ebb970305844dccacf48a7d8d47ecf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:27:58.663005 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-40671157-5e6b-44de-9a4e-9787f035592c tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] 10.222.0.11 "GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7" status: 200 len: 1741 microversion: 2.20 time: 0.175005 Nov 17 03:27:58.663543 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 302/616] 10.222.0.11 () {60 vars in 1276 bytes} [Wed Nov 17 03:27:58 2021] GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7 => generated 1741 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 17 03:27:58.981826 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-f5bb67bb-fb7c-40bd-a66d-106aa33086b4 tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:27:58.982856 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-f5bb67bb-fb7c-40bd-a66d-106aa33086b4 tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] [instance: b89eca0e-d486-4b3a-a41a-aa02de394cff] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:27:58.989806 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-f5bb67bb-fb7c-40bd-a66d-106aa33086b4 tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:27:58.990266 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-f5bb67bb-fb7c-40bd-a66d-106aa33086b4 tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:27:58.991308 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-f5bb67bb-fb7c-40bd-a66d-106aa33086b4 tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:27:58.992107 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-f5bb67bb-fb7c-40bd-a66d-106aa33086b4 tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:27:59.044163 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-f5bb67bb-fb7c-40bd-a66d-106aa33086b4 tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] 10.222.0.11 "GET /compute/v2.1/servers/b89eca0e-d486-4b3a-a41a-aa02de394cff/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.066450 Nov 17 03:27:59.044762 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 315/617] 10.222.0.11 () {58 vars in 1301 bytes} [Wed Nov 17 03:27:58 2021] GET /compute/v2.1/servers/b89eca0e-d486-4b3a-a41a-aa02de394cff/os-volume_attachments => generated 197 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 17 03:27:59.129899 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-66a62f7e-04e8-43ac-9e3d-e622057cd7ae tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:27:59.130503 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-66a62f7e-04e8-43ac-9e3d-e622057cd7ae tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] [instance: a49437df-3059-4528-8328-2f3471d5fb45] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:27:59.137389 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-66a62f7e-04e8-43ac-9e3d-e622057cd7ae tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:27:59.138038 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-66a62f7e-04e8-43ac-9e3d-e622057cd7ae tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:27:59.139210 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-66a62f7e-04e8-43ac-9e3d-e622057cd7ae tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:27:59.139644 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-66a62f7e-04e8-43ac-9e3d-e622057cd7ae tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:27:59.277752 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-4b9271e5-a614-497f-9024-1d58437024a0 tempest-AttachVolumeTestJSON-1651611701 tempest-AttachVolumeTestJSON-1651611701-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 17 03:27:59.278665 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-4b9271e5-a614-497f-9024-1d58437024a0 tempest-AttachVolumeTestJSON-1651611701 tempest-AttachVolumeTestJSON-1651611701-project] [instance: 5e11ea9c-f66a-4962-b5ca-b95784624824] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:27:59.288020 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-4b9271e5-a614-497f-9024-1d58437024a0 tempest-AttachVolumeTestJSON-1651611701 tempest-AttachVolumeTestJSON-1651611701-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:27:59.288493 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-4b9271e5-a614-497f-9024-1d58437024a0 tempest-AttachVolumeTestJSON-1651611701 tempest-AttachVolumeTestJSON-1651611701-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:27:59.289353 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-4b9271e5-a614-497f-9024-1d58437024a0 tempest-AttachVolumeTestJSON-1651611701 tempest-AttachVolumeTestJSON-1651611701-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:27:59.289798 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-4b9271e5-a614-497f-9024-1d58437024a0 tempest-AttachVolumeTestJSON-1651611701 tempest-AttachVolumeTestJSON-1651611701-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:27:59.313128 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-66a62f7e-04e8-43ac-9e3d-e622057cd7ae tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f046401c6a04f6495ebe0821120bd72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a58e89ceeea4a9c8a72a1de4bcaf2d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:27:59.322580 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-66a62f7e-04e8-43ac-9e3d-e622057cd7ae tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] 10.222.0.11 "GET /compute/v2.1/servers/a49437df-3059-4528-8328-2f3471d5fb45" status: 200 len: 1566 microversion: 2.1 time: 0.196356 Nov 17 03:27:59.323550 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 303/618] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:27:59 2021] GET /compute/v2.1/servers/a49437df-3059-4528-8328-2f3471d5fb45 => generated 1566 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:27:59.462318 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-4b9271e5-a614-497f-9024-1d58437024a0 tempest-AttachVolumeTestJSON-1651611701 tempest-AttachVolumeTestJSON-1651611701-project] 10.222.0.11 "POST /compute/v2.1/servers/5e11ea9c-f66a-4962-b5ca-b95784624824/action" status: 200 len: 28633 microversion: 2.1 time: 0.188083 Nov 17 03:27:59.466311 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 316/619] 10.222.0.11 () {60 vars in 1277 bytes} [Wed Nov 17 03:27:59 2021] POST /compute/v2.1/servers/5e11ea9c-f66a-4962-b5ca-b95784624824/action => generated 28633 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 17 03:27:59.680753 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-66da7331-4a70-41fa-9d07-189c31ad95d3 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:27:59.681402 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-66da7331-4a70-41fa-9d07-189c31ad95d3 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] [instance: 5d54db85-b991-4890-abaa-952413baa2e7] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:27:59.692133 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-66da7331-4a70-41fa-9d07-189c31ad95d3 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:27:59.692906 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-66da7331-4a70-41fa-9d07-189c31ad95d3 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:27:59.693898 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-66da7331-4a70-41fa-9d07-189c31ad95d3 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:27:59.694502 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-66da7331-4a70-41fa-9d07-189c31ad95d3 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:27:59.859260 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-66da7331-4a70-41fa-9d07-189c31ad95d3 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37f21d6d15cf40a586edda211219fd08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ebb970305844dccacf48a7d8d47ecf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:27:59.881263 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-66da7331-4a70-41fa-9d07-189c31ad95d3 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '37f21d6d15cf40a586edda211219fd08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ebb970305844dccacf48a7d8d47ecf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:27:59.893735 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-66da7331-4a70-41fa-9d07-189c31ad95d3 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '37f21d6d15cf40a586edda211219fd08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ebb970305844dccacf48a7d8d47ecf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:27:59.896318 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-66da7331-4a70-41fa-9d07-189c31ad95d3 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] 10.222.0.11 "GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7" status: 200 len: 1741 microversion: 2.20 time: 0.219343 Nov 17 03:27:59.897673 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 304/620] 10.222.0.11 () {60 vars in 1276 bytes} [Wed Nov 17 03:27:59 2021] GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7 => generated 1741 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 17 03:28:00.057623 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-10d23457-a974-4f30-8ee7-c210e903fc8b tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:28:00.058745 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-10d23457-a974-4f30-8ee7-c210e903fc8b tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] [instance: b89eca0e-d486-4b3a-a41a-aa02de394cff] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:28:00.066970 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-10d23457-a974-4f30-8ee7-c210e903fc8b tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:28:00.067518 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-10d23457-a974-4f30-8ee7-c210e903fc8b tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:28:00.071201 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-10d23457-a974-4f30-8ee7-c210e903fc8b tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:28:00.071201 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-10d23457-a974-4f30-8ee7-c210e903fc8b tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:28:00.107338 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-10d23457-a974-4f30-8ee7-c210e903fc8b tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] 10.222.0.11 "GET /compute/v2.1/servers/b89eca0e-d486-4b3a-a41a-aa02de394cff/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.055021 Nov 17 03:28:00.107926 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 317/621] 10.222.0.11 () {58 vars in 1301 bytes} [Wed Nov 17 03:28:00 2021] GET /compute/v2.1/servers/b89eca0e-d486-4b3a-a41a-aa02de394cff/os-volume_attachments => generated 25 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 17 03:28:00.339532 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-a3656bb1-4d08-4133-ae48-a0032a2fcb1f tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:28:00.340169 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-a3656bb1-4d08-4133-ae48-a0032a2fcb1f tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] [instance: a49437df-3059-4528-8328-2f3471d5fb45] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:28:00.349152 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-a3656bb1-4d08-4133-ae48-a0032a2fcb1f tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:28:00.349594 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-a3656bb1-4d08-4133-ae48-a0032a2fcb1f tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:28:00.350397 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-a3656bb1-4d08-4133-ae48-a0032a2fcb1f tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:28:00.350835 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-a3656bb1-4d08-4133-ae48-a0032a2fcb1f tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:28:00.474090 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-c7290955-3444-4955-83a9-ce90cfb3e54c tempest-AttachVolumeTestJSON-1651611701 tempest-AttachVolumeTestJSON-1651611701-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 17 03:28:00.475848 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-c7290955-3444-4955-83a9-ce90cfb3e54c tempest-AttachVolumeTestJSON-1651611701 tempest-AttachVolumeTestJSON-1651611701-project] [instance: 5e11ea9c-f66a-4962-b5ca-b95784624824] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:28:00.482362 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-c7290955-3444-4955-83a9-ce90cfb3e54c tempest-AttachVolumeTestJSON-1651611701 tempest-AttachVolumeTestJSON-1651611701-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:28:00.482803 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-c7290955-3444-4955-83a9-ce90cfb3e54c tempest-AttachVolumeTestJSON-1651611701 tempest-AttachVolumeTestJSON-1651611701-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:28:00.483626 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-c7290955-3444-4955-83a9-ce90cfb3e54c tempest-AttachVolumeTestJSON-1651611701 tempest-AttachVolumeTestJSON-1651611701-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:28:00.484053 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-c7290955-3444-4955-83a9-ce90cfb3e54c tempest-AttachVolumeTestJSON-1651611701 tempest-AttachVolumeTestJSON-1651611701-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:28:00.510314 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-a3656bb1-4d08-4133-ae48-a0032a2fcb1f tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f046401c6a04f6495ebe0821120bd72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a58e89ceeea4a9c8a72a1de4bcaf2d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:28:00.521882 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-a3656bb1-4d08-4133-ae48-a0032a2fcb1f tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] 10.222.0.11 "GET /compute/v2.1/servers/a49437df-3059-4528-8328-2f3471d5fb45" status: 200 len: 1566 microversion: 2.1 time: 0.185044 Nov 17 03:28:00.523117 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 305/622] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:28:00 2021] GET /compute/v2.1/servers/a49437df-3059-4528-8328-2f3471d5fb45 => generated 1566 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:28:00.670179 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-c7290955-3444-4955-83a9-ce90cfb3e54c tempest-AttachVolumeTestJSON-1651611701 tempest-AttachVolumeTestJSON-1651611701-project] 10.222.0.11 "POST /compute/v2.1/servers/5e11ea9c-f66a-4962-b5ca-b95784624824/action" status: 200 len: 28752 microversion: 2.1 time: 0.199629 Nov 17 03:28:00.671024 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 318/623] 10.222.0.11 () {60 vars in 1277 bytes} [Wed Nov 17 03:28:00 2021] POST /compute/v2.1/servers/5e11ea9c-f66a-4962-b5ca-b95784624824/action => generated 28752 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 17 03:28:00.915142 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-5a1ee4a5-3ad4-4066-bee5-4721d373202a tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:28:00.915733 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-5a1ee4a5-3ad4-4066-bee5-4721d373202a tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] [instance: 5d54db85-b991-4890-abaa-952413baa2e7] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:28:00.922456 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-5a1ee4a5-3ad4-4066-bee5-4721d373202a tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:28:00.922832 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-5a1ee4a5-3ad4-4066-bee5-4721d373202a tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:28:00.923619 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-5a1ee4a5-3ad4-4066-bee5-4721d373202a tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:28:00.924062 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-5a1ee4a5-3ad4-4066-bee5-4721d373202a tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:28:01.085028 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-5a1ee4a5-3ad4-4066-bee5-4721d373202a tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37f21d6d15cf40a586edda211219fd08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ebb970305844dccacf48a7d8d47ecf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:28:01.097490 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-5a1ee4a5-3ad4-4066-bee5-4721d373202a tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '37f21d6d15cf40a586edda211219fd08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ebb970305844dccacf48a7d8d47ecf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:28:01.098963 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-5a1ee4a5-3ad4-4066-bee5-4721d373202a tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '37f21d6d15cf40a586edda211219fd08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ebb970305844dccacf48a7d8d47ecf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:28:01.100151 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-5a1ee4a5-3ad4-4066-bee5-4721d373202a tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] 10.222.0.11 "GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7" status: 200 len: 1741 microversion: 2.20 time: 0.189168 Nov 17 03:28:01.100740 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 306/624] 10.222.0.11 () {60 vars in 1276 bytes} [Wed Nov 17 03:28:00 2021] GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7 => generated 1741 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 17 03:28:01.310098 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-e9c1adb5-13af-4843-8ab4-be147af6fe24 tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:28:01.311058 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-e9c1adb5-13af-4843-8ab4-be147af6fe24 tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] [instance: b89eca0e-d486-4b3a-a41a-aa02de394cff] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:28:01.318516 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-e9c1adb5-13af-4843-8ab4-be147af6fe24 tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:28:01.318997 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-e9c1adb5-13af-4843-8ab4-be147af6fe24 tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:28:01.319880 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-e9c1adb5-13af-4843-8ab4-be147af6fe24 tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:28:01.320367 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-e9c1adb5-13af-4843-8ab4-be147af6fe24 tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:28:01.348442 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-e9c1adb5-13af-4843-8ab4-be147af6fe24 tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] [instance: b89eca0e-d486-4b3a-a41a-aa02de394cff] Going to try to terminate instance {{(pid=115917) delete /opt/stack/nova/nova/compute/api.py:2614}} Nov 17 03:28:01.445958 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-e9c1adb5-13af-4843-8ab4-be147af6fe24 tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] 10.222.0.11 "DELETE /compute/v2.1/servers/b89eca0e-d486-4b3a-a41a-aa02de394cff" status: 204 len: 0 microversion: 2.1 time: 0.139894 Nov 17 03:28:01.450356 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 319/625] 10.222.0.11 () {58 vars in 1238 bytes} [Wed Nov 17 03:28:01 2021] DELETE /compute/v2.1/servers/b89eca0e-d486-4b3a-a41a-aa02de394cff => generated 0 bytes in 142 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 17 03:28:01.455656 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-fc7f10f5-3dfd-4ceb-8043-326fd80400c0 tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:28:01.456259 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-fc7f10f5-3dfd-4ceb-8043-326fd80400c0 tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] [instance: b89eca0e-d486-4b3a-a41a-aa02de394cff] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:28:01.463065 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-fc7f10f5-3dfd-4ceb-8043-326fd80400c0 tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:28:01.463520 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-fc7f10f5-3dfd-4ceb-8043-326fd80400c0 tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:28:01.464502 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-fc7f10f5-3dfd-4ceb-8043-326fd80400c0 tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:28:01.465128 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-fc7f10f5-3dfd-4ceb-8043-326fd80400c0 tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:28:01.540410 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-b5c817bf-c069-4443-854c-660d60eeb262 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:28:01.541381 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-b5c817bf-c069-4443-854c-660d60eeb262 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] [instance: a49437df-3059-4528-8328-2f3471d5fb45] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:28:01.559140 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-b5c817bf-c069-4443-854c-660d60eeb262 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:28:01.559684 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-b5c817bf-c069-4443-854c-660d60eeb262 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:28:01.560672 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-b5c817bf-c069-4443-854c-660d60eeb262 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:28:01.561205 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-b5c817bf-c069-4443-854c-660d60eeb262 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:28:01.609082 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-fc7f10f5-3dfd-4ceb-8043-326fd80400c0 tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d4e8ac9538f42c9b637bd9e086668b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfc480343d4d493bb4295b055e274df5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:28:01.618533 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-fc7f10f5-3dfd-4ceb-8043-326fd80400c0 tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] 10.222.0.11 "GET /compute/v2.1/servers/b89eca0e-d486-4b3a-a41a-aa02de394cff" status: 200 len: 1510 microversion: 2.1 time: 0.166433 Nov 17 03:28:01.628915 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 307/626] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:28:01 2021] GET /compute/v2.1/servers/b89eca0e-d486-4b3a-a41a-aa02de394cff => generated 1510 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:28:01.682116 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-f8a4ad7f-05b0-4b2a-a2fd-7e1b1b813c3c tempest-AttachVolumeTestJSON-1651611701 tempest-AttachVolumeTestJSON-1651611701-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 17 03:28:01.683212 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-f8a4ad7f-05b0-4b2a-a2fd-7e1b1b813c3c tempest-AttachVolumeTestJSON-1651611701 tempest-AttachVolumeTestJSON-1651611701-project] [instance: 5e11ea9c-f66a-4962-b5ca-b95784624824] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:28:01.689990 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-f8a4ad7f-05b0-4b2a-a2fd-7e1b1b813c3c tempest-AttachVolumeTestJSON-1651611701 tempest-AttachVolumeTestJSON-1651611701-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:28:01.690791 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-f8a4ad7f-05b0-4b2a-a2fd-7e1b1b813c3c tempest-AttachVolumeTestJSON-1651611701 tempest-AttachVolumeTestJSON-1651611701-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:28:01.691886 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-f8a4ad7f-05b0-4b2a-a2fd-7e1b1b813c3c tempest-AttachVolumeTestJSON-1651611701 tempest-AttachVolumeTestJSON-1651611701-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:28:01.692549 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-f8a4ad7f-05b0-4b2a-a2fd-7e1b1b813c3c tempest-AttachVolumeTestJSON-1651611701 tempest-AttachVolumeTestJSON-1651611701-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:28:01.752013 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-b5c817bf-c069-4443-854c-660d60eeb262 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f046401c6a04f6495ebe0821120bd72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a58e89ceeea4a9c8a72a1de4bcaf2d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:28:01.762296 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-b5c817bf-c069-4443-854c-660d60eeb262 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] 10.222.0.11 "GET /compute/v2.1/servers/a49437df-3059-4528-8328-2f3471d5fb45" status: 200 len: 1566 microversion: 2.1 time: 0.226643 Nov 17 03:28:01.762879 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 320/627] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:28:01 2021] GET /compute/v2.1/servers/a49437df-3059-4528-8328-2f3471d5fb45 => generated 1566 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 17 03:28:01.849031 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-f8a4ad7f-05b0-4b2a-a2fd-7e1b1b813c3c tempest-AttachVolumeTestJSON-1651611701 tempest-AttachVolumeTestJSON-1651611701-project] 10.222.0.11 "POST /compute/v2.1/servers/5e11ea9c-f66a-4962-b5ca-b95784624824/action" status: 200 len: 29566 microversion: 2.1 time: 0.170720 Nov 17 03:28:01.849691 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 308/628] 10.222.0.11 () {60 vars in 1277 bytes} [Wed Nov 17 03:28:01 2021] POST /compute/v2.1/servers/5e11ea9c-f66a-4962-b5ca-b95784624824/action => generated 29566 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 17 03:28:02.121914 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-516b3c48-3894-4ea0-ae9e-4254156f7d04 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:28:02.122676 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-516b3c48-3894-4ea0-ae9e-4254156f7d04 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] [instance: 5d54db85-b991-4890-abaa-952413baa2e7] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:28:02.129436 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-516b3c48-3894-4ea0-ae9e-4254156f7d04 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:28:02.132022 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-516b3c48-3894-4ea0-ae9e-4254156f7d04 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:28:02.132919 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-516b3c48-3894-4ea0-ae9e-4254156f7d04 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:28:02.133518 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-516b3c48-3894-4ea0-ae9e-4254156f7d04 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:28:02.277141 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-516b3c48-3894-4ea0-ae9e-4254156f7d04 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37f21d6d15cf40a586edda211219fd08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ebb970305844dccacf48a7d8d47ecf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:28:02.285800 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-516b3c48-3894-4ea0-ae9e-4254156f7d04 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '37f21d6d15cf40a586edda211219fd08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ebb970305844dccacf48a7d8d47ecf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:28:02.287408 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-516b3c48-3894-4ea0-ae9e-4254156f7d04 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '37f21d6d15cf40a586edda211219fd08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ebb970305844dccacf48a7d8d47ecf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:28:02.289000 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-516b3c48-3894-4ea0-ae9e-4254156f7d04 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] 10.222.0.11 "GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7" status: 200 len: 1741 microversion: 2.20 time: 0.171124 Nov 17 03:28:02.300989 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 321/629] 10.222.0.11 () {60 vars in 1276 bytes} [Wed Nov 17 03:28:02 2021] GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7 => generated 1741 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 17 03:28:02.640141 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-4be3cfbf-7249-469f-b69b-184015791533 tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:28:02.640854 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-4be3cfbf-7249-469f-b69b-184015791533 tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] [instance: b89eca0e-d486-4b3a-a41a-aa02de394cff] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:28:02.648346 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-4be3cfbf-7249-469f-b69b-184015791533 tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:28:02.648812 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-4be3cfbf-7249-469f-b69b-184015791533 tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:28:02.649563 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-4be3cfbf-7249-469f-b69b-184015791533 tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:28:02.650435 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-4be3cfbf-7249-469f-b69b-184015791533 tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:28:02.780523 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-6276d2df-fcec-4a2a-8899-923a62c91e3c tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:28:02.781144 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-6276d2df-fcec-4a2a-8899-923a62c91e3c tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] [instance: a49437df-3059-4528-8328-2f3471d5fb45] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:28:02.789384 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-6276d2df-fcec-4a2a-8899-923a62c91e3c tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:28:02.790281 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-6276d2df-fcec-4a2a-8899-923a62c91e3c tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:28:02.791246 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-6276d2df-fcec-4a2a-8899-923a62c91e3c tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:28:02.791848 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-6276d2df-fcec-4a2a-8899-923a62c91e3c tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:28:02.797698 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-4be3cfbf-7249-469f-b69b-184015791533 tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d4e8ac9538f42c9b637bd9e086668b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfc480343d4d493bb4295b055e274df5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:28:02.805813 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-4be3cfbf-7249-469f-b69b-184015791533 tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] 10.222.0.11 "GET /compute/v2.1/servers/b89eca0e-d486-4b3a-a41a-aa02de394cff" status: 200 len: 1510 microversion: 2.1 time: 0.170536 Nov 17 03:28:02.816855 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 309/630] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:28:02 2021] GET /compute/v2.1/servers/b89eca0e-d486-4b3a-a41a-aa02de394cff => generated 1510 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:28:02.860880 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-ef504279-2268-459a-9a4a-85ac97b75a4a tempest-AttachVolumeTestJSON-1651611701 tempest-AttachVolumeTestJSON-1651611701-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 17 03:28:02.862016 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-ef504279-2268-459a-9a4a-85ac97b75a4a tempest-AttachVolumeTestJSON-1651611701 tempest-AttachVolumeTestJSON-1651611701-project] [instance: 5e11ea9c-f66a-4962-b5ca-b95784624824] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:28:02.876063 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-ef504279-2268-459a-9a4a-85ac97b75a4a tempest-AttachVolumeTestJSON-1651611701 tempest-AttachVolumeTestJSON-1651611701-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:28:02.876841 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-ef504279-2268-459a-9a4a-85ac97b75a4a tempest-AttachVolumeTestJSON-1651611701 tempest-AttachVolumeTestJSON-1651611701-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:28:02.877775 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-ef504279-2268-459a-9a4a-85ac97b75a4a tempest-AttachVolumeTestJSON-1651611701 tempest-AttachVolumeTestJSON-1651611701-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:28:02.878268 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-ef504279-2268-459a-9a4a-85ac97b75a4a tempest-AttachVolumeTestJSON-1651611701 tempest-AttachVolumeTestJSON-1651611701-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:28:02.958382 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-6276d2df-fcec-4a2a-8899-923a62c91e3c tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f046401c6a04f6495ebe0821120bd72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a58e89ceeea4a9c8a72a1de4bcaf2d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:28:02.967023 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-6276d2df-fcec-4a2a-8899-923a62c91e3c tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] 10.222.0.11 "GET /compute/v2.1/servers/a49437df-3059-4528-8328-2f3471d5fb45" status: 200 len: 1566 microversion: 2.1 time: 0.190686 Nov 17 03:28:02.967626 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 322/631] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:28:02 2021] GET /compute/v2.1/servers/a49437df-3059-4528-8328-2f3471d5fb45 => generated 1566 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:28:03.031926 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-ef504279-2268-459a-9a4a-85ac97b75a4a tempest-AttachVolumeTestJSON-1651611701 tempest-AttachVolumeTestJSON-1651611701-project] 10.222.0.11 "POST /compute/v2.1/servers/5e11ea9c-f66a-4962-b5ca-b95784624824/action" status: 200 len: 31168 microversion: 2.1 time: 0.174593 Nov 17 03:28:03.036707 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 310/632] 10.222.0.11 () {60 vars in 1277 bytes} [Wed Nov 17 03:28:02 2021] POST /compute/v2.1/servers/5e11ea9c-f66a-4962-b5ca-b95784624824/action => generated 31168 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 17 03:28:03.309947 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-7d4c0de2-501e-4636-b4f0-d40ac06349d3 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:28:03.310546 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-7d4c0de2-501e-4636-b4f0-d40ac06349d3 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] [instance: 5d54db85-b991-4890-abaa-952413baa2e7] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:28:03.318382 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-7d4c0de2-501e-4636-b4f0-d40ac06349d3 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:28:03.318733 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-7d4c0de2-501e-4636-b4f0-d40ac06349d3 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:28:03.319971 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-7d4c0de2-501e-4636-b4f0-d40ac06349d3 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:28:03.320479 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-7d4c0de2-501e-4636-b4f0-d40ac06349d3 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:28:03.488961 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-7d4c0de2-501e-4636-b4f0-d40ac06349d3 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37f21d6d15cf40a586edda211219fd08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ebb970305844dccacf48a7d8d47ecf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:28:03.500199 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-7d4c0de2-501e-4636-b4f0-d40ac06349d3 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '37f21d6d15cf40a586edda211219fd08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ebb970305844dccacf48a7d8d47ecf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:28:03.501807 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-7d4c0de2-501e-4636-b4f0-d40ac06349d3 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '37f21d6d15cf40a586edda211219fd08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ebb970305844dccacf48a7d8d47ecf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:28:03.503046 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-7d4c0de2-501e-4636-b4f0-d40ac06349d3 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] 10.222.0.11 "GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7" status: 200 len: 1741 microversion: 2.20 time: 0.199876 Nov 17 03:28:03.504230 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 323/633] 10.222.0.11 () {60 vars in 1276 bytes} [Wed Nov 17 03:28:03 2021] GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7 => generated 1741 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 17 03:28:03.823904 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-a3e992f8-7691-4f41-a3cc-ec3396688e45 tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:28:03.824657 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-a3e992f8-7691-4f41-a3cc-ec3396688e45 tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] [instance: b89eca0e-d486-4b3a-a41a-aa02de394cff] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:28:03.831652 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-a3e992f8-7691-4f41-a3cc-ec3396688e45 tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:28:03.832102 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-a3e992f8-7691-4f41-a3cc-ec3396688e45 tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:28:03.832893 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-a3e992f8-7691-4f41-a3cc-ec3396688e45 tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:28:03.833323 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-a3e992f8-7691-4f41-a3cc-ec3396688e45 tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:28:03.984719 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-7b30214b-ccfd-493c-8ad9-747e9d211a7e tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:28:03.986018 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-7b30214b-ccfd-493c-8ad9-747e9d211a7e tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] [instance: a49437df-3059-4528-8328-2f3471d5fb45] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:28:03.993315 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-7b30214b-ccfd-493c-8ad9-747e9d211a7e tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:28:03.994531 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-7b30214b-ccfd-493c-8ad9-747e9d211a7e tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:28:03.995098 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-a3e992f8-7691-4f41-a3cc-ec3396688e45 tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d4e8ac9538f42c9b637bd9e086668b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfc480343d4d493bb4295b055e274df5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:28:03.995536 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-7b30214b-ccfd-493c-8ad9-747e9d211a7e tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:28:03.996079 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-7b30214b-ccfd-493c-8ad9-747e9d211a7e tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:28:04.006677 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-a3e992f8-7691-4f41-a3cc-ec3396688e45 tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] 10.222.0.11 "GET /compute/v2.1/servers/b89eca0e-d486-4b3a-a41a-aa02de394cff" status: 200 len: 1510 microversion: 2.1 time: 0.186349 Nov 17 03:28:04.016642 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 311/634] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:28:03 2021] GET /compute/v2.1/servers/b89eca0e-d486-4b3a-a41a-aa02de394cff => generated 1510 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:28:04.044528 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-62b538e7-8724-4903-8895-46c6592c6477 tempest-AttachVolumeTestJSON-1651611701 tempest-AttachVolumeTestJSON-1651611701-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 17 03:28:04.045475 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-62b538e7-8724-4903-8895-46c6592c6477 tempest-AttachVolumeTestJSON-1651611701 tempest-AttachVolumeTestJSON-1651611701-project] [instance: 5e11ea9c-f66a-4962-b5ca-b95784624824] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:28:04.052450 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-62b538e7-8724-4903-8895-46c6592c6477 tempest-AttachVolumeTestJSON-1651611701 tempest-AttachVolumeTestJSON-1651611701-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:28:04.052989 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-62b538e7-8724-4903-8895-46c6592c6477 tempest-AttachVolumeTestJSON-1651611701 tempest-AttachVolumeTestJSON-1651611701-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:28:04.053915 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-62b538e7-8724-4903-8895-46c6592c6477 tempest-AttachVolumeTestJSON-1651611701 tempest-AttachVolumeTestJSON-1651611701-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:28:04.054341 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-62b538e7-8724-4903-8895-46c6592c6477 tempest-AttachVolumeTestJSON-1651611701 tempest-AttachVolumeTestJSON-1651611701-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:28:04.141022 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-7b30214b-ccfd-493c-8ad9-747e9d211a7e tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f046401c6a04f6495ebe0821120bd72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a58e89ceeea4a9c8a72a1de4bcaf2d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:28:04.149671 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-7b30214b-ccfd-493c-8ad9-747e9d211a7e tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] 10.222.0.11 "GET /compute/v2.1/servers/a49437df-3059-4528-8328-2f3471d5fb45" status: 200 len: 1566 microversion: 2.1 time: 0.168997 Nov 17 03:28:04.150214 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 324/635] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:28:03 2021] GET /compute/v2.1/servers/a49437df-3059-4528-8328-2f3471d5fb45 => generated 1566 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:28:04.342543 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-62b538e7-8724-4903-8895-46c6592c6477 tempest-AttachVolumeTestJSON-1651611701 tempest-AttachVolumeTestJSON-1651611701-project] 10.222.0.11 "POST /compute/v2.1/servers/5e11ea9c-f66a-4962-b5ca-b95784624824/action" status: 200 len: 31986 microversion: 2.1 time: 0.301873 Nov 17 03:28:04.343112 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 312/636] 10.222.0.11 () {60 vars in 1277 bytes} [Wed Nov 17 03:28:04 2021] POST /compute/v2.1/servers/5e11ea9c-f66a-4962-b5ca-b95784624824/action => generated 31986 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 17 03:28:04.522637 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-dab2893a-6738-4123-b338-fdfe79a7b29d tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:28:04.523487 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-dab2893a-6738-4123-b338-fdfe79a7b29d tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] [instance: 5d54db85-b991-4890-abaa-952413baa2e7] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:28:04.530159 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-dab2893a-6738-4123-b338-fdfe79a7b29d tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:28:04.530601 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-dab2893a-6738-4123-b338-fdfe79a7b29d tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:28:04.531361 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-dab2893a-6738-4123-b338-fdfe79a7b29d tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:28:04.531791 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-dab2893a-6738-4123-b338-fdfe79a7b29d tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:28:04.676645 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-dab2893a-6738-4123-b338-fdfe79a7b29d tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37f21d6d15cf40a586edda211219fd08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ebb970305844dccacf48a7d8d47ecf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:28:04.685598 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-dab2893a-6738-4123-b338-fdfe79a7b29d tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '37f21d6d15cf40a586edda211219fd08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ebb970305844dccacf48a7d8d47ecf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:28:04.687080 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-dab2893a-6738-4123-b338-fdfe79a7b29d tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '37f21d6d15cf40a586edda211219fd08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ebb970305844dccacf48a7d8d47ecf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:28:04.688261 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-dab2893a-6738-4123-b338-fdfe79a7b29d tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] 10.222.0.11 "GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7" status: 200 len: 1741 microversion: 2.20 time: 0.169366 Nov 17 03:28:04.688843 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 325/637] 10.222.0.11 () {60 vars in 1276 bytes} [Wed Nov 17 03:28:04 2021] GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7 => generated 1741 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 17 03:28:05.024378 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-aa82d47b-25a8-4640-9fa6-cb1c1d55442c tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:28:05.025257 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-aa82d47b-25a8-4640-9fa6-cb1c1d55442c tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] [instance: b89eca0e-d486-4b3a-a41a-aa02de394cff] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:28:05.032293 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-aa82d47b-25a8-4640-9fa6-cb1c1d55442c tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:28:05.032737 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-aa82d47b-25a8-4640-9fa6-cb1c1d55442c tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:28:05.033563 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-aa82d47b-25a8-4640-9fa6-cb1c1d55442c tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:28:05.033981 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-aa82d47b-25a8-4640-9fa6-cb1c1d55442c tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:28:05.168936 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-94337ea1-b5c3-4b0d-afee-3aaed2fcac26 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:28:05.169555 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-94337ea1-b5c3-4b0d-afee-3aaed2fcac26 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] [instance: a49437df-3059-4528-8328-2f3471d5fb45] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:28:05.179171 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-aa82d47b-25a8-4640-9fa6-cb1c1d55442c tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d4e8ac9538f42c9b637bd9e086668b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfc480343d4d493bb4295b055e274df5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:28:05.181330 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-94337ea1-b5c3-4b0d-afee-3aaed2fcac26 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:28:05.182155 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-94337ea1-b5c3-4b0d-afee-3aaed2fcac26 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:28:05.182952 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-94337ea1-b5c3-4b0d-afee-3aaed2fcac26 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:28:05.183386 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-94337ea1-b5c3-4b0d-afee-3aaed2fcac26 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:28:05.187641 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-aa82d47b-25a8-4640-9fa6-cb1c1d55442c tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] 10.222.0.11 "GET /compute/v2.1/servers/b89eca0e-d486-4b3a-a41a-aa02de394cff" status: 200 len: 1510 microversion: 2.1 time: 0.167655 Nov 17 03:28:05.197270 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 313/638] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:28:05 2021] GET /compute/v2.1/servers/b89eca0e-d486-4b3a-a41a-aa02de394cff => generated 1510 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:28:05.354502 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-9c48b46b-301b-417e-8a40-9071a6f3df63 tempest-AttachVolumeTestJSON-1651611701 tempest-AttachVolumeTestJSON-1651611701-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 17 03:28:05.355524 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-9c48b46b-301b-417e-8a40-9071a6f3df63 tempest-AttachVolumeTestJSON-1651611701 tempest-AttachVolumeTestJSON-1651611701-project] [instance: 5e11ea9c-f66a-4962-b5ca-b95784624824] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:28:05.362390 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-9c48b46b-301b-417e-8a40-9071a6f3df63 tempest-AttachVolumeTestJSON-1651611701 tempest-AttachVolumeTestJSON-1651611701-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:28:05.362844 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-9c48b46b-301b-417e-8a40-9071a6f3df63 tempest-AttachVolumeTestJSON-1651611701 tempest-AttachVolumeTestJSON-1651611701-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:28:05.363596 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-9c48b46b-301b-417e-8a40-9071a6f3df63 tempest-AttachVolumeTestJSON-1651611701 tempest-AttachVolumeTestJSON-1651611701-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:28:05.364199 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-9c48b46b-301b-417e-8a40-9071a6f3df63 tempest-AttachVolumeTestJSON-1651611701 tempest-AttachVolumeTestJSON-1651611701-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:28:05.487223 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-9c48b46b-301b-417e-8a40-9071a6f3df63 tempest-AttachVolumeTestJSON-1651611701 tempest-AttachVolumeTestJSON-1651611701-project] 10.222.0.11 "POST /compute/v2.1/servers/5e11ea9c-f66a-4962-b5ca-b95784624824/action" status: 200 len: 32619 microversion: 2.1 time: 0.136157 Nov 17 03:28:05.488533 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 314/639] 10.222.0.11 () {60 vars in 1277 bytes} [Wed Nov 17 03:28:05 2021] POST /compute/v2.1/servers/5e11ea9c-f66a-4962-b5ca-b95784624824/action => generated 32619 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 17 03:28:05.511117 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [req-cbb73604-7734-4d53-8dbb-5c0940e0fd46 req-6aa61fdb-dccb-46bb-a629-6e2bccf5760d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b89eca0e-d486-4b3a-a41a-aa02de394cff", "name": "network-vif-deleted", "tag": "654305a1-4d89-4fdf-9462-aacfa6438fa1"}]} {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 17 03:28:05.512584 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 17 03:28:05.512584 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: warnings.warn(msg) Nov 17 03:28:05.520065 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-94337ea1-b5c3-4b0d-afee-3aaed2fcac26 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f046401c6a04f6495ebe0821120bd72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a58e89ceeea4a9c8a72a1de4bcaf2d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:28:05.531036 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-94337ea1-b5c3-4b0d-afee-3aaed2fcac26 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] 10.222.0.11 "GET /compute/v2.1/servers/a49437df-3059-4528-8328-2f3471d5fb45" status: 200 len: 1566 microversion: 2.1 time: 0.366701 Nov 17 03:28:05.531925 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 326/640] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:28:05 2021] GET /compute/v2.1/servers/a49437df-3059-4528-8328-2f3471d5fb45 => generated 1566 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:28:05.538983 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [req-cbb73604-7734-4d53-8dbb-5c0940e0fd46 req-6aa61fdb-dccb-46bb-a629-6e2bccf5760d service nova] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:28:05.539598 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [req-cbb73604-7734-4d53-8dbb-5c0940e0fd46 req-6aa61fdb-dccb-46bb-a629-6e2bccf5760d service nova] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:28:05.567234 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.compute.server_external_events [req-cbb73604-7734-4d53-8dbb-5c0940e0fd46 req-6aa61fdb-dccb-46bb-a629-6e2bccf5760d service nova] Creating event network-vif-deleted:654305a1-4d89-4fdf-9462-aacfa6438fa1 for instance b89eca0e-d486-4b3a-a41a-aa02de394cff on hv-cinder-81803 Nov 17 03:28:05.572572 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [req-cbb73604-7734-4d53-8dbb-5c0940e0fd46 req-6aa61fdb-dccb-46bb-a629-6e2bccf5760d service nova] 10.222.0.11 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.065533 Nov 17 03:28:05.573440 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 315/641] 10.222.0.11 () {64 vars in 1317 bytes} [Wed Nov 17 03:28:05 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 17 03:28:05.709041 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-817372d5-8a25-42bb-a836-95348f3c9bd2 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:28:05.709646 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-817372d5-8a25-42bb-a836-95348f3c9bd2 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] [instance: 5d54db85-b991-4890-abaa-952413baa2e7] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:28:05.715699 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-817372d5-8a25-42bb-a836-95348f3c9bd2 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:28:05.716145 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-817372d5-8a25-42bb-a836-95348f3c9bd2 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:28:05.716946 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-817372d5-8a25-42bb-a836-95348f3c9bd2 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:28:05.717378 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-817372d5-8a25-42bb-a836-95348f3c9bd2 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:28:05.927318 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-817372d5-8a25-42bb-a836-95348f3c9bd2 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37f21d6d15cf40a586edda211219fd08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ebb970305844dccacf48a7d8d47ecf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:28:05.936809 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-817372d5-8a25-42bb-a836-95348f3c9bd2 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '37f21d6d15cf40a586edda211219fd08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ebb970305844dccacf48a7d8d47ecf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:28:05.938659 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-817372d5-8a25-42bb-a836-95348f3c9bd2 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '37f21d6d15cf40a586edda211219fd08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ebb970305844dccacf48a7d8d47ecf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:28:05.940064 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-817372d5-8a25-42bb-a836-95348f3c9bd2 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] 10.222.0.11 "GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7" status: 200 len: 1723 microversion: 2.20 time: 0.234631 Nov 17 03:28:05.940566 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 327/642] 10.222.0.11 () {60 vars in 1276 bytes} [Wed Nov 17 03:28:05 2021] GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7 => generated 1723 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 17 03:28:06.209356 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-89675775-7415-4d3c-aefb-8b55a1cff5e6 tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:28:06.210387 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-89675775-7415-4d3c-aefb-8b55a1cff5e6 tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] [instance: b89eca0e-d486-4b3a-a41a-aa02de394cff] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:28:06.221414 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-89675775-7415-4d3c-aefb-8b55a1cff5e6 tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:28:06.222169 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-89675775-7415-4d3c-aefb-8b55a1cff5e6 tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:28:06.223435 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-89675775-7415-4d3c-aefb-8b55a1cff5e6 tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:28:06.224148 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-89675775-7415-4d3c-aefb-8b55a1cff5e6 tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:28:06.255529 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-89675775-7415-4d3c-aefb-8b55a1cff5e6 tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:28:06.255963 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-89675775-7415-4d3c-aefb-8b55a1cff5e6 tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:28:06.256410 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.objects.instance [None req-89675775-7415-4d3c-aefb-8b55a1cff5e6 tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] Lazy-loading 'fault' on Instance uuid b89eca0e-d486-4b3a-a41a-aa02de394cff {{(pid=115916) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Nov 17 03:28:06.299036 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-89675775-7415-4d3c-aefb-8b55a1cff5e6 tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d4e8ac9538f42c9b637bd9e086668b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfc480343d4d493bb4295b055e274df5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:28:06.308155 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-89675775-7415-4d3c-aefb-8b55a1cff5e6 tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] 10.222.0.11 "GET /compute/v2.1/servers/b89eca0e-d486-4b3a-a41a-aa02de394cff" status: 200 len: 1307 microversion: 2.1 time: 0.104437 Nov 17 03:28:06.308155 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 316/643] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:28:06 2021] GET /compute/v2.1/servers/b89eca0e-d486-4b3a-a41a-aa02de394cff => generated 1307 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:28:06.498563 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-df3052a7-b87f-4af1-8fea-ee1e72cf4a2f tempest-AttachVolumeTestJSON-1651611701 tempest-AttachVolumeTestJSON-1651611701-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 17 03:28:06.500381 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-df3052a7-b87f-4af1-8fea-ee1e72cf4a2f tempest-AttachVolumeTestJSON-1651611701 tempest-AttachVolumeTestJSON-1651611701-project] [instance: 5e11ea9c-f66a-4962-b5ca-b95784624824] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:28:06.507049 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-df3052a7-b87f-4af1-8fea-ee1e72cf4a2f tempest-AttachVolumeTestJSON-1651611701 tempest-AttachVolumeTestJSON-1651611701-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:28:06.507499 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-df3052a7-b87f-4af1-8fea-ee1e72cf4a2f tempest-AttachVolumeTestJSON-1651611701 tempest-AttachVolumeTestJSON-1651611701-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:28:06.508489 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-df3052a7-b87f-4af1-8fea-ee1e72cf4a2f tempest-AttachVolumeTestJSON-1651611701 tempest-AttachVolumeTestJSON-1651611701-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:28:06.508952 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-df3052a7-b87f-4af1-8fea-ee1e72cf4a2f tempest-AttachVolumeTestJSON-1651611701 tempest-AttachVolumeTestJSON-1651611701-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:28:06.549370 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-cc27d28b-5f5d-4119-bbc4-ac394217af95 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:28:06.550177 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-cc27d28b-5f5d-4119-bbc4-ac394217af95 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] [instance: a49437df-3059-4528-8328-2f3471d5fb45] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:28:06.558570 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-cc27d28b-5f5d-4119-bbc4-ac394217af95 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:28:06.559015 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-cc27d28b-5f5d-4119-bbc4-ac394217af95 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:28:06.559791 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-cc27d28b-5f5d-4119-bbc4-ac394217af95 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:28:06.560225 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-cc27d28b-5f5d-4119-bbc4-ac394217af95 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:28:06.659515 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-df3052a7-b87f-4af1-8fea-ee1e72cf4a2f tempest-AttachVolumeTestJSON-1651611701 tempest-AttachVolumeTestJSON-1651611701-project] 10.222.0.11 "POST /compute/v2.1/servers/5e11ea9c-f66a-4962-b5ca-b95784624824/action" status: 200 len: 33012 microversion: 2.1 time: 0.164432 Nov 17 03:28:06.660143 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 328/644] 10.222.0.11 () {60 vars in 1277 bytes} [Wed Nov 17 03:28:06 2021] POST /compute/v2.1/servers/5e11ea9c-f66a-4962-b5ca-b95784624824/action => generated 33012 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 17 03:28:06.699352 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-cc27d28b-5f5d-4119-bbc4-ac394217af95 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f046401c6a04f6495ebe0821120bd72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a58e89ceeea4a9c8a72a1de4bcaf2d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:28:06.711342 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-cc27d28b-5f5d-4119-bbc4-ac394217af95 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] 10.222.0.11 "GET /compute/v2.1/servers/a49437df-3059-4528-8328-2f3471d5fb45" status: 200 len: 1566 microversion: 2.1 time: 0.167322 Nov 17 03:28:06.712188 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 317/645] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:28:06 2021] GET /compute/v2.1/servers/a49437df-3059-4528-8328-2f3471d5fb45 => generated 1566 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:28:06.959710 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-12094731-e0f5-4c35-9e2d-6536a8053cb8 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:28:06.960404 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-12094731-e0f5-4c35-9e2d-6536a8053cb8 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] [instance: 5d54db85-b991-4890-abaa-952413baa2e7] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:28:06.967715 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-12094731-e0f5-4c35-9e2d-6536a8053cb8 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:28:06.968156 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-12094731-e0f5-4c35-9e2d-6536a8053cb8 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:28:06.968961 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-12094731-e0f5-4c35-9e2d-6536a8053cb8 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:28:06.969398 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-12094731-e0f5-4c35-9e2d-6536a8053cb8 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:28:07.111961 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-12094731-e0f5-4c35-9e2d-6536a8053cb8 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37f21d6d15cf40a586edda211219fd08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ebb970305844dccacf48a7d8d47ecf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:28:07.120733 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-12094731-e0f5-4c35-9e2d-6536a8053cb8 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '37f21d6d15cf40a586edda211219fd08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ebb970305844dccacf48a7d8d47ecf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:28:07.122265 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-12094731-e0f5-4c35-9e2d-6536a8053cb8 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '37f21d6d15cf40a586edda211219fd08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ebb970305844dccacf48a7d8d47ecf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:28:07.123411 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-12094731-e0f5-4c35-9e2d-6536a8053cb8 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] 10.222.0.11 "GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7" status: 200 len: 1723 microversion: 2.20 time: 0.167883 Nov 17 03:28:07.123972 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 329/646] 10.222.0.11 () {60 vars in 1276 bytes} [Wed Nov 17 03:28:06 2021] GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7 => generated 1723 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 17 03:28:07.325692 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-2c46e51e-7694-4803-a750-418d6702fcee tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:28:07.326333 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-2c46e51e-7694-4803-a750-418d6702fcee tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] [instance: b89eca0e-d486-4b3a-a41a-aa02de394cff] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:28:07.333298 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-2c46e51e-7694-4803-a750-418d6702fcee tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:28:07.333755 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-2c46e51e-7694-4803-a750-418d6702fcee tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:28:07.334511 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-2c46e51e-7694-4803-a750-418d6702fcee tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:28:07.334943 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-2c46e51e-7694-4803-a750-418d6702fcee tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:28:07.350583 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.wsgi [None req-2c46e51e-7694-4803-a750-418d6702fcee tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] HTTP exception thrown: Instance b89eca0e-d486-4b3a-a41a-aa02de394cff could not be found. Nov 17 03:28:07.351175 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-2c46e51e-7694-4803-a750-418d6702fcee tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] Returning 404 to user: Instance b89eca0e-d486-4b3a-a41a-aa02de394cff could not be found. {{(pid=115916) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 17 03:28:07.351988 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-2c46e51e-7694-4803-a750-418d6702fcee tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] 10.222.0.11 "GET /compute/v2.1/servers/b89eca0e-d486-4b3a-a41a-aa02de394cff" status: 404 len: 111 microversion: 2.1 time: 0.031196 Nov 17 03:28:07.355803 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 318/647] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:28:07 2021] GET /compute/v2.1/servers/b89eca0e-d486-4b3a-a41a-aa02de394cff => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 17 03:28:07.673502 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-82a79b2c-be01-4ab2-874d-5cc1c08798de tempest-AttachVolumeTestJSON-1651611701 tempest-AttachVolumeTestJSON-1651611701-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 17 03:28:07.674536 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-82a79b2c-be01-4ab2-874d-5cc1c08798de tempest-AttachVolumeTestJSON-1651611701 tempest-AttachVolumeTestJSON-1651611701-project] [instance: 5e11ea9c-f66a-4962-b5ca-b95784624824] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:28:07.683986 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-82a79b2c-be01-4ab2-874d-5cc1c08798de tempest-AttachVolumeTestJSON-1651611701 tempest-AttachVolumeTestJSON-1651611701-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:28:07.686164 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-82a79b2c-be01-4ab2-874d-5cc1c08798de tempest-AttachVolumeTestJSON-1651611701 tempest-AttachVolumeTestJSON-1651611701-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:28:07.689259 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-82a79b2c-be01-4ab2-874d-5cc1c08798de tempest-AttachVolumeTestJSON-1651611701 tempest-AttachVolumeTestJSON-1651611701-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:28:07.691284 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-82a79b2c-be01-4ab2-874d-5cc1c08798de tempest-AttachVolumeTestJSON-1651611701 tempest-AttachVolumeTestJSON-1651611701-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:28:07.731455 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-840bf753-4575-4a6d-829b-9c614e6f9476 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:28:07.732295 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-840bf753-4575-4a6d-829b-9c614e6f9476 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] [instance: a49437df-3059-4528-8328-2f3471d5fb45] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:28:07.741175 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-840bf753-4575-4a6d-829b-9c614e6f9476 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:28:07.741787 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-840bf753-4575-4a6d-829b-9c614e6f9476 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:28:07.742950 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-840bf753-4575-4a6d-829b-9c614e6f9476 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:28:07.743392 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-840bf753-4575-4a6d-829b-9c614e6f9476 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:28:07.837027 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-82a79b2c-be01-4ab2-874d-5cc1c08798de tempest-AttachVolumeTestJSON-1651611701 tempest-AttachVolumeTestJSON-1651611701-project] 10.222.0.11 "POST /compute/v2.1/servers/5e11ea9c-f66a-4962-b5ca-b95784624824/action" status: 200 len: 33218 microversion: 2.1 time: 0.169285 Nov 17 03:28:07.837869 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 330/648] 10.222.0.11 () {60 vars in 1277 bytes} [Wed Nov 17 03:28:07 2021] POST /compute/v2.1/servers/5e11ea9c-f66a-4962-b5ca-b95784624824/action => generated 33218 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 17 03:28:07.884339 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-840bf753-4575-4a6d-829b-9c614e6f9476 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f046401c6a04f6495ebe0821120bd72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a58e89ceeea4a9c8a72a1de4bcaf2d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:28:07.892522 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-840bf753-4575-4a6d-829b-9c614e6f9476 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] 10.222.0.11 "GET /compute/v2.1/servers/a49437df-3059-4528-8328-2f3471d5fb45" status: 200 len: 1566 microversion: 2.1 time: 0.166936 Nov 17 03:28:07.893134 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 319/649] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:28:07 2021] GET /compute/v2.1/servers/a49437df-3059-4528-8328-2f3471d5fb45 => generated 1566 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:28:08.029341 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [req-54136d81-7e41-4da6-9c47-7f192a3843e1 req-a7679633-bed7-4c7b-baed-dc2ad9951cdb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5d54db85-b991-4890-abaa-952413baa2e7", "name": "network-vif-unplugged", "status": "completed", "tag": "51f39c10-57ce-4106-ab58-635a3319ff11"}]} {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 17 03:28:08.030837 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 17 03:28:08.030837 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: warnings.warn(msg) Nov 17 03:28:08.041099 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [req-54136d81-7e41-4da6-9c47-7f192a3843e1 req-a7679633-bed7-4c7b-baed-dc2ad9951cdb service nova] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:28:08.041641 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [req-54136d81-7e41-4da6-9c47-7f192a3843e1 req-a7679633-bed7-4c7b-baed-dc2ad9951cdb service nova] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:28:08.054366 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.compute.server_external_events [req-54136d81-7e41-4da6-9c47-7f192a3843e1 req-a7679633-bed7-4c7b-baed-dc2ad9951cdb service nova] Creating event network-vif-unplugged:51f39c10-57ce-4106-ab58-635a3319ff11 for instance 5d54db85-b991-4890-abaa-952413baa2e7 on hv-cinder-81803 Nov 17 03:28:08.060096 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [req-54136d81-7e41-4da6-9c47-7f192a3843e1 req-a7679633-bed7-4c7b-baed-dc2ad9951cdb service nova] 10.222.0.11 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.035282 Nov 17 03:28:08.060909 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 331/650] 10.222.0.11 () {64 vars in 1317 bytes} [Wed Nov 17 03:28:08 2021] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 17 03:28:08.141854 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-4d20aff1-3a25-4c19-9d76-c6d0dacbfaaa tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:28:08.142358 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-4d20aff1-3a25-4c19-9d76-c6d0dacbfaaa tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] [instance: 5d54db85-b991-4890-abaa-952413baa2e7] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:28:08.148808 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-4d20aff1-3a25-4c19-9d76-c6d0dacbfaaa tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:28:08.149280 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-4d20aff1-3a25-4c19-9d76-c6d0dacbfaaa tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:28:08.150063 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-4d20aff1-3a25-4c19-9d76-c6d0dacbfaaa tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:28:08.150485 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-4d20aff1-3a25-4c19-9d76-c6d0dacbfaaa tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:28:08.286121 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-4d20aff1-3a25-4c19-9d76-c6d0dacbfaaa tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37f21d6d15cf40a586edda211219fd08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ebb970305844dccacf48a7d8d47ecf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:28:08.294136 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-4d20aff1-3a25-4c19-9d76-c6d0dacbfaaa tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '37f21d6d15cf40a586edda211219fd08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ebb970305844dccacf48a7d8d47ecf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:28:08.295624 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-4d20aff1-3a25-4c19-9d76-c6d0dacbfaaa tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '37f21d6d15cf40a586edda211219fd08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ebb970305844dccacf48a7d8d47ecf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:28:08.296806 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-4d20aff1-3a25-4c19-9d76-c6d0dacbfaaa tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] 10.222.0.11 "GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7" status: 200 len: 1723 microversion: 2.20 time: 0.158841 Nov 17 03:28:08.297401 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 320/651] 10.222.0.11 () {60 vars in 1276 bytes} [Wed Nov 17 03:28:08 2021] GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7 => generated 1723 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 17 03:28:08.508450 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-65d39a36-b6e6-403f-8e7d-afee6f9c43c3 tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:28:08.509069 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-65d39a36-b6e6-403f-8e7d-afee6f9c43c3 tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] [instance: 5c1643c5-72d3-4676-85e6-84c5f245c517] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:28:08.518200 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-65d39a36-b6e6-403f-8e7d-afee6f9c43c3 tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:28:08.518814 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-65d39a36-b6e6-403f-8e7d-afee6f9c43c3 tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:28:08.519780 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-65d39a36-b6e6-403f-8e7d-afee6f9c43c3 tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:28:08.520295 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-65d39a36-b6e6-403f-8e7d-afee6f9c43c3 tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:28:08.547654 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-65d39a36-b6e6-403f-8e7d-afee6f9c43c3 tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] [instance: 5c1643c5-72d3-4676-85e6-84c5f245c517] Going to try to terminate instance {{(pid=115917) delete /opt/stack/nova/nova/compute/api.py:2614}} Nov 17 03:28:08.629606 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-65d39a36-b6e6-403f-8e7d-afee6f9c43c3 tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] 10.222.0.11 "DELETE /compute/v2.1/servers/5c1643c5-72d3-4676-85e6-84c5f245c517" status: 204 len: 0 microversion: 2.1 time: 0.126587 Nov 17 03:28:08.630699 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 332/652] 10.222.0.11 () {58 vars in 1238 bytes} [Wed Nov 17 03:28:08 2021] DELETE /compute/v2.1/servers/5c1643c5-72d3-4676-85e6-84c5f245c517 => generated 0 bytes in 129 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 17 03:28:08.638705 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-045b89d7-6a91-41e9-988d-19f70e963118 tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:28:08.639465 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-045b89d7-6a91-41e9-988d-19f70e963118 tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] [instance: 5c1643c5-72d3-4676-85e6-84c5f245c517] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:28:08.646113 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-045b89d7-6a91-41e9-988d-19f70e963118 tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:28:08.646552 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-045b89d7-6a91-41e9-988d-19f70e963118 tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:28:08.647324 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-045b89d7-6a91-41e9-988d-19f70e963118 tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:28:08.647747 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-045b89d7-6a91-41e9-988d-19f70e963118 tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:28:08.790558 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-045b89d7-6a91-41e9-988d-19f70e963118 tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d4e8ac9538f42c9b637bd9e086668b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfc480343d4d493bb4295b055e274df5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:28:08.798528 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-045b89d7-6a91-41e9-988d-19f70e963118 tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] 10.222.0.11 "GET /compute/v2.1/servers/5c1643c5-72d3-4676-85e6-84c5f245c517" status: 200 len: 1512 microversion: 2.1 time: 0.163808 Nov 17 03:28:08.799097 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 321/653] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:28:08 2021] GET /compute/v2.1/servers/5c1643c5-72d3-4676-85e6-84c5f245c517 => generated 1512 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:28:08.850491 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-265e9003-645c-4805-98ec-15e17c88a23f tempest-AttachVolumeTestJSON-1651611701 tempest-AttachVolumeTestJSON-1651611701-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 17 03:28:08.851528 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-265e9003-645c-4805-98ec-15e17c88a23f tempest-AttachVolumeTestJSON-1651611701 tempest-AttachVolumeTestJSON-1651611701-project] [instance: 5e11ea9c-f66a-4962-b5ca-b95784624824] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:28:08.858104 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-265e9003-645c-4805-98ec-15e17c88a23f tempest-AttachVolumeTestJSON-1651611701 tempest-AttachVolumeTestJSON-1651611701-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:28:08.858558 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-265e9003-645c-4805-98ec-15e17c88a23f tempest-AttachVolumeTestJSON-1651611701 tempest-AttachVolumeTestJSON-1651611701-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:28:08.859335 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-265e9003-645c-4805-98ec-15e17c88a23f tempest-AttachVolumeTestJSON-1651611701 tempest-AttachVolumeTestJSON-1651611701-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:28:08.859768 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-265e9003-645c-4805-98ec-15e17c88a23f tempest-AttachVolumeTestJSON-1651611701 tempest-AttachVolumeTestJSON-1651611701-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:28:08.911017 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-470e6097-19ce-4ec9-9e4d-56a91a2c1777 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:28:08.911631 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-470e6097-19ce-4ec9-9e4d-56a91a2c1777 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] [instance: a49437df-3059-4528-8328-2f3471d5fb45] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:28:08.918513 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-470e6097-19ce-4ec9-9e4d-56a91a2c1777 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:28:08.919001 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-470e6097-19ce-4ec9-9e4d-56a91a2c1777 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:28:08.919770 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-470e6097-19ce-4ec9-9e4d-56a91a2c1777 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:28:08.920202 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-470e6097-19ce-4ec9-9e4d-56a91a2c1777 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:28:08.998128 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-265e9003-645c-4805-98ec-15e17c88a23f tempest-AttachVolumeTestJSON-1651611701 tempest-AttachVolumeTestJSON-1651611701-project] 10.222.0.11 "POST /compute/v2.1/servers/5e11ea9c-f66a-4962-b5ca-b95784624824/action" status: 200 len: 33441 microversion: 2.1 time: 0.151384 Nov 17 03:28:08.998685 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 333/654] 10.222.0.11 () {60 vars in 1277 bytes} [Wed Nov 17 03:28:08 2021] POST /compute/v2.1/servers/5e11ea9c-f66a-4962-b5ca-b95784624824/action => generated 33441 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 17 03:28:09.061126 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-470e6097-19ce-4ec9-9e4d-56a91a2c1777 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f046401c6a04f6495ebe0821120bd72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a58e89ceeea4a9c8a72a1de4bcaf2d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:28:09.069882 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-470e6097-19ce-4ec9-9e4d-56a91a2c1777 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] 10.222.0.11 "GET /compute/v2.1/servers/a49437df-3059-4528-8328-2f3471d5fb45" status: 200 len: 1566 microversion: 2.1 time: 0.162616 Nov 17 03:28:09.070451 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 322/655] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:28:08 2021] GET /compute/v2.1/servers/a49437df-3059-4528-8328-2f3471d5fb45 => generated 1566 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:28:09.316072 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-bf1a3b40-1e94-4c80-9832-b3e73ec4fe8a tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:28:09.316770 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-bf1a3b40-1e94-4c80-9832-b3e73ec4fe8a tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] [instance: 5d54db85-b991-4890-abaa-952413baa2e7] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:28:09.324045 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-bf1a3b40-1e94-4c80-9832-b3e73ec4fe8a tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:28:09.324495 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-bf1a3b40-1e94-4c80-9832-b3e73ec4fe8a tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:28:09.325304 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-bf1a3b40-1e94-4c80-9832-b3e73ec4fe8a tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:28:09.325755 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-bf1a3b40-1e94-4c80-9832-b3e73ec4fe8a tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:28:09.465991 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-bf1a3b40-1e94-4c80-9832-b3e73ec4fe8a tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37f21d6d15cf40a586edda211219fd08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ebb970305844dccacf48a7d8d47ecf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:28:09.474082 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-bf1a3b40-1e94-4c80-9832-b3e73ec4fe8a tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '37f21d6d15cf40a586edda211219fd08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ebb970305844dccacf48a7d8d47ecf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:28:09.475572 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-bf1a3b40-1e94-4c80-9832-b3e73ec4fe8a tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '37f21d6d15cf40a586edda211219fd08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ebb970305844dccacf48a7d8d47ecf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:28:09.476731 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-bf1a3b40-1e94-4c80-9832-b3e73ec4fe8a tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] 10.222.0.11 "GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7" status: 200 len: 1723 microversion: 2.20 time: 0.164792 Nov 17 03:28:09.477854 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 334/656] 10.222.0.11 () {60 vars in 1276 bytes} [Wed Nov 17 03:28:09 2021] GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7 => generated 1723 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 17 03:28:09.816761 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-01dfe901-a98f-4eff-b6fc-cf5bb2400d09 tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:28:09.817569 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-01dfe901-a98f-4eff-b6fc-cf5bb2400d09 tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] [instance: 5c1643c5-72d3-4676-85e6-84c5f245c517] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:28:09.824310 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-01dfe901-a98f-4eff-b6fc-cf5bb2400d09 tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:28:09.824762 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-01dfe901-a98f-4eff-b6fc-cf5bb2400d09 tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:28:09.825557 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-01dfe901-a98f-4eff-b6fc-cf5bb2400d09 tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:28:09.825981 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-01dfe901-a98f-4eff-b6fc-cf5bb2400d09 tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:28:09.958741 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-01dfe901-a98f-4eff-b6fc-cf5bb2400d09 tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d4e8ac9538f42c9b637bd9e086668b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfc480343d4d493bb4295b055e274df5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:28:09.966682 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-01dfe901-a98f-4eff-b6fc-cf5bb2400d09 tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] 10.222.0.11 "GET /compute/v2.1/servers/5c1643c5-72d3-4676-85e6-84c5f245c517" status: 200 len: 1512 microversion: 2.1 time: 0.153563 Nov 17 03:28:09.967252 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 323/657] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:28:09 2021] GET /compute/v2.1/servers/5c1643c5-72d3-4676-85e6-84c5f245c517 => generated 1512 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:28:10.010417 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-a479a5ca-56d1-4723-9643-cc9194d70df6 tempest-AttachVolumeTestJSON-1651611701 tempest-AttachVolumeTestJSON-1651611701-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 17 03:28:10.011331 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-a479a5ca-56d1-4723-9643-cc9194d70df6 tempest-AttachVolumeTestJSON-1651611701 tempest-AttachVolumeTestJSON-1651611701-project] [instance: 5e11ea9c-f66a-4962-b5ca-b95784624824] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:28:10.018851 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-a479a5ca-56d1-4723-9643-cc9194d70df6 tempest-AttachVolumeTestJSON-1651611701 tempest-AttachVolumeTestJSON-1651611701-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:28:10.019287 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-a479a5ca-56d1-4723-9643-cc9194d70df6 tempest-AttachVolumeTestJSON-1651611701 tempest-AttachVolumeTestJSON-1651611701-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:28:10.020070 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-a479a5ca-56d1-4723-9643-cc9194d70df6 tempest-AttachVolumeTestJSON-1651611701 tempest-AttachVolumeTestJSON-1651611701-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:28:10.020490 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-a479a5ca-56d1-4723-9643-cc9194d70df6 tempest-AttachVolumeTestJSON-1651611701 tempest-AttachVolumeTestJSON-1651611701-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:28:10.090185 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-aa852909-4ba5-4722-9632-68a9fa20c6ec tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:28:10.090852 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-aa852909-4ba5-4722-9632-68a9fa20c6ec tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] [instance: a49437df-3059-4528-8328-2f3471d5fb45] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:28:10.097089 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-aa852909-4ba5-4722-9632-68a9fa20c6ec tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:28:10.097539 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-aa852909-4ba5-4722-9632-68a9fa20c6ec tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:28:10.098306 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-aa852909-4ba5-4722-9632-68a9fa20c6ec tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:28:10.098766 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-aa852909-4ba5-4722-9632-68a9fa20c6ec tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:28:10.181353 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-a479a5ca-56d1-4723-9643-cc9194d70df6 tempest-AttachVolumeTestJSON-1651611701 tempest-AttachVolumeTestJSON-1651611701-project] 10.222.0.11 "POST /compute/v2.1/servers/5e11ea9c-f66a-4962-b5ca-b95784624824/action" status: 200 len: 33754 microversion: 2.1 time: 0.174357 Nov 17 03:28:10.182313 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 335/658] 10.222.0.11 () {60 vars in 1277 bytes} [Wed Nov 17 03:28:10 2021] POST /compute/v2.1/servers/5e11ea9c-f66a-4962-b5ca-b95784624824/action => generated 33754 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 17 03:28:10.239172 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-aa852909-4ba5-4722-9632-68a9fa20c6ec tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f046401c6a04f6495ebe0821120bd72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a58e89ceeea4a9c8a72a1de4bcaf2d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:28:10.248290 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-aa852909-4ba5-4722-9632-68a9fa20c6ec tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] 10.222.0.11 "GET /compute/v2.1/servers/a49437df-3059-4528-8328-2f3471d5fb45" status: 200 len: 1566 microversion: 2.1 time: 0.164208 Nov 17 03:28:10.248891 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 324/659] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:28:10 2021] GET /compute/v2.1/servers/a49437df-3059-4528-8328-2f3471d5fb45 => generated 1566 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 17 03:28:10.502361 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-27a5d0bb-73f7-4fd9-8f7d-20bc3d91dd8c tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:28:10.503710 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-27a5d0bb-73f7-4fd9-8f7d-20bc3d91dd8c tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] [instance: 5d54db85-b991-4890-abaa-952413baa2e7] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:28:10.514516 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-27a5d0bb-73f7-4fd9-8f7d-20bc3d91dd8c tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:28:10.514770 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-27a5d0bb-73f7-4fd9-8f7d-20bc3d91dd8c tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:28:10.515557 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-27a5d0bb-73f7-4fd9-8f7d-20bc3d91dd8c tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:28:10.515965 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-27a5d0bb-73f7-4fd9-8f7d-20bc3d91dd8c tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:28:10.650981 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-27a5d0bb-73f7-4fd9-8f7d-20bc3d91dd8c tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37f21d6d15cf40a586edda211219fd08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ebb970305844dccacf48a7d8d47ecf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:28:10.659547 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-27a5d0bb-73f7-4fd9-8f7d-20bc3d91dd8c tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '37f21d6d15cf40a586edda211219fd08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ebb970305844dccacf48a7d8d47ecf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:28:10.661059 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-27a5d0bb-73f7-4fd9-8f7d-20bc3d91dd8c tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '37f21d6d15cf40a586edda211219fd08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ebb970305844dccacf48a7d8d47ecf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:28:10.662203 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-27a5d0bb-73f7-4fd9-8f7d-20bc3d91dd8c tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] 10.222.0.11 "GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7" status: 200 len: 1666 microversion: 2.20 time: 0.168178 Nov 17 03:28:10.662721 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 336/660] 10.222.0.11 () {60 vars in 1276 bytes} [Wed Nov 17 03:28:10 2021] GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7 => generated 1666 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 17 03:28:10.679610 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-a8e124ff-d713-4826-8869-f5b9f1d95f87 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "6b88aa0e-cb40-48f3-83b7-9160eb1e8ee7"}} {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 17 03:28:10.680752 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-a8e124ff-d713-4826-8869-f5b9f1d95f87 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] [instance: 5d54db85-b991-4890-abaa-952413baa2e7] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:28:10.687418 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-a8e124ff-d713-4826-8869-f5b9f1d95f87 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:28:10.687850 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-a8e124ff-d713-4826-8869-f5b9f1d95f87 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:28:10.688646 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-a8e124ff-d713-4826-8869-f5b9f1d95f87 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:28:10.689127 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-a8e124ff-d713-4826-8869-f5b9f1d95f87 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:28:10.983412 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-3d4e4810-c5d4-44fc-a264-682d3046e837 tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:28:10.984110 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-3d4e4810-c5d4-44fc-a264-682d3046e837 tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] [instance: 5c1643c5-72d3-4676-85e6-84c5f245c517] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:28:10.990759 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-a8e124ff-d713-4826-8869-f5b9f1d95f87 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] 10.222.0.11 "POST /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.314939 Nov 17 03:28:10.996283 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 325/661] 10.222.0.11 () {62 vars in 1363 bytes} [Wed Nov 17 03:28:10 2021] POST /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7/os-volume_attachments => generated 188 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 17 03:28:10.996430 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-3d4e4810-c5d4-44fc-a264-682d3046e837 tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:28:10.996430 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-3d4e4810-c5d4-44fc-a264-682d3046e837 tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:28:10.996430 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-3d4e4810-c5d4-44fc-a264-682d3046e837 tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:28:10.996430 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-3d4e4810-c5d4-44fc-a264-682d3046e837 tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:28:11.116311 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-3c36451f-85da-492c-ac43-f6aec30f4ea2 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 17 03:28:11.117309 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-3c36451f-85da-492c-ac43-f6aec30f4ea2 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] [instance: 5d54db85-b991-4890-abaa-952413baa2e7] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:28:11.124968 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-3c36451f-85da-492c-ac43-f6aec30f4ea2 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:28:11.125803 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-3c36451f-85da-492c-ac43-f6aec30f4ea2 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:28:11.126865 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-3c36451f-85da-492c-ac43-f6aec30f4ea2 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:28:11.127510 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-3c36451f-85da-492c-ac43-f6aec30f4ea2 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:28:11.155035 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-3d4e4810-c5d4-44fc-a264-682d3046e837 tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d4e8ac9538f42c9b637bd9e086668b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfc480343d4d493bb4295b055e274df5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:28:11.162768 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-3d4e4810-c5d4-44fc-a264-682d3046e837 tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] 10.222.0.11 "GET /compute/v2.1/servers/5c1643c5-72d3-4676-85e6-84c5f245c517" status: 200 len: 1512 microversion: 2.1 time: 0.183029 Nov 17 03:28:11.163704 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 337/662] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:28:10 2021] GET /compute/v2.1/servers/5c1643c5-72d3-4676-85e6-84c5f245c517 => generated 1512 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:28:11.194485 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-610770de-8522-48c5-9530-11682cfd6eab tempest-AttachVolumeTestJSON-1651611701 tempest-AttachVolumeTestJSON-1651611701-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 17 03:28:11.195442 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-610770de-8522-48c5-9530-11682cfd6eab tempest-AttachVolumeTestJSON-1651611701 tempest-AttachVolumeTestJSON-1651611701-project] [instance: 5e11ea9c-f66a-4962-b5ca-b95784624824] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:28:11.201814 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-610770de-8522-48c5-9530-11682cfd6eab tempest-AttachVolumeTestJSON-1651611701 tempest-AttachVolumeTestJSON-1651611701-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:28:11.202250 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-610770de-8522-48c5-9530-11682cfd6eab tempest-AttachVolumeTestJSON-1651611701 tempest-AttachVolumeTestJSON-1651611701-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:28:11.203095 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-610770de-8522-48c5-9530-11682cfd6eab tempest-AttachVolumeTestJSON-1651611701 tempest-AttachVolumeTestJSON-1651611701-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:28:11.203439 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-610770de-8522-48c5-9530-11682cfd6eab tempest-AttachVolumeTestJSON-1651611701 tempest-AttachVolumeTestJSON-1651611701-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:28:11.229134 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-3c36451f-85da-492c-ac43-f6aec30f4ea2 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] 10.222.0.11 "POST /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7/action" status: 202 len: 0 microversion: 2.20 time: 0.114931 Nov 17 03:28:11.235031 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 326/663] 10.222.0.11 () {62 vars in 1318 bytes} [Wed Nov 17 03:28:11 2021] POST /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7/action => generated 0 bytes in 123 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Nov 17 03:28:11.240041 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-72d1deb2-52cf-4a3a-9f4f-1c4a30ea8e93 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:28:11.241011 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-72d1deb2-52cf-4a3a-9f4f-1c4a30ea8e93 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] [instance: 5d54db85-b991-4890-abaa-952413baa2e7] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:28:11.250741 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-72d1deb2-52cf-4a3a-9f4f-1c4a30ea8e93 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:28:11.251434 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-72d1deb2-52cf-4a3a-9f4f-1c4a30ea8e93 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:28:11.252388 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-72d1deb2-52cf-4a3a-9f4f-1c4a30ea8e93 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:28:11.253069 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-72d1deb2-52cf-4a3a-9f4f-1c4a30ea8e93 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:28:11.374221 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-610770de-8522-48c5-9530-11682cfd6eab tempest-AttachVolumeTestJSON-1651611701 tempest-AttachVolumeTestJSON-1651611701-project] 10.222.0.11 "POST /compute/v2.1/servers/5e11ea9c-f66a-4962-b5ca-b95784624824/action" status: 200 len: 34295 microversion: 2.1 time: 0.182969 Nov 17 03:28:11.376277 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 338/664] 10.222.0.11 () {60 vars in 1277 bytes} [Wed Nov 17 03:28:11 2021] POST /compute/v2.1/servers/5e11ea9c-f66a-4962-b5ca-b95784624824/action => generated 34295 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 17 03:28:11.382505 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-00ab821f-c929-4dbe-a9a4-47278c05fe56 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:28:11.383376 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-00ab821f-c929-4dbe-a9a4-47278c05fe56 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] [instance: a49437df-3059-4528-8328-2f3471d5fb45] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:28:11.390502 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-00ab821f-c929-4dbe-a9a4-47278c05fe56 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:28:11.391199 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-00ab821f-c929-4dbe-a9a4-47278c05fe56 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:28:11.392145 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-00ab821f-c929-4dbe-a9a4-47278c05fe56 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:28:11.392727 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-00ab821f-c929-4dbe-a9a4-47278c05fe56 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:28:11.425788 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-72d1deb2-52cf-4a3a-9f4f-1c4a30ea8e93 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37f21d6d15cf40a586edda211219fd08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ebb970305844dccacf48a7d8d47ecf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:28:11.436170 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-72d1deb2-52cf-4a3a-9f4f-1c4a30ea8e93 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '37f21d6d15cf40a586edda211219fd08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ebb970305844dccacf48a7d8d47ecf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:28:11.437839 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-72d1deb2-52cf-4a3a-9f4f-1c4a30ea8e93 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '37f21d6d15cf40a586edda211219fd08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ebb970305844dccacf48a7d8d47ecf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:28:11.439156 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-72d1deb2-52cf-4a3a-9f4f-1c4a30ea8e93 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] 10.222.0.11 "GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7" status: 200 len: 1752 microversion: 2.20 time: 0.202867 Nov 17 03:28:11.439985 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 327/665] 10.222.0.11 () {60 vars in 1276 bytes} [Wed Nov 17 03:28:11 2021] GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7 => generated 1752 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 17 03:28:11.543890 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-00ab821f-c929-4dbe-a9a4-47278c05fe56 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f046401c6a04f6495ebe0821120bd72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a58e89ceeea4a9c8a72a1de4bcaf2d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:28:11.552652 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-00ab821f-c929-4dbe-a9a4-47278c05fe56 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] 10.222.0.11 "GET /compute/v2.1/servers/a49437df-3059-4528-8328-2f3471d5fb45" status: 200 len: 1566 microversion: 2.1 time: 0.174171 Nov 17 03:28:11.554674 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 339/666] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:28:11 2021] GET /compute/v2.1/servers/a49437df-3059-4528-8328-2f3471d5fb45 => generated 1566 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:28:12.181027 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-06a7732d-ca9d-473a-98fa-4d17926cff9f tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:28:12.181992 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-06a7732d-ca9d-473a-98fa-4d17926cff9f tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] [instance: 5c1643c5-72d3-4676-85e6-84c5f245c517] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:28:12.189383 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-06a7732d-ca9d-473a-98fa-4d17926cff9f tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:28:12.189831 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-06a7732d-ca9d-473a-98fa-4d17926cff9f tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:28:12.190644 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-06a7732d-ca9d-473a-98fa-4d17926cff9f tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:28:12.191073 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-06a7732d-ca9d-473a-98fa-4d17926cff9f tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:28:12.328367 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-06a7732d-ca9d-473a-98fa-4d17926cff9f tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d4e8ac9538f42c9b637bd9e086668b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfc480343d4d493bb4295b055e274df5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:28:12.336390 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-06a7732d-ca9d-473a-98fa-4d17926cff9f tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] 10.222.0.11 "GET /compute/v2.1/servers/5c1643c5-72d3-4676-85e6-84c5f245c517" status: 200 len: 1512 microversion: 2.1 time: 0.159293 Nov 17 03:28:12.339339 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 328/667] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:28:12 2021] GET /compute/v2.1/servers/5c1643c5-72d3-4676-85e6-84c5f245c517 => generated 1512 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:28:12.386833 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-24810a9d-7a02-495f-81b0-feaeb4ec5063 tempest-AttachVolumeTestJSON-1651611701 tempest-AttachVolumeTestJSON-1651611701-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 17 03:28:12.387680 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-24810a9d-7a02-495f-81b0-feaeb4ec5063 tempest-AttachVolumeTestJSON-1651611701 tempest-AttachVolumeTestJSON-1651611701-project] [instance: 5e11ea9c-f66a-4962-b5ca-b95784624824] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:28:12.394158 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-24810a9d-7a02-495f-81b0-feaeb4ec5063 tempest-AttachVolumeTestJSON-1651611701 tempest-AttachVolumeTestJSON-1651611701-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:28:12.394572 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-24810a9d-7a02-495f-81b0-feaeb4ec5063 tempest-AttachVolumeTestJSON-1651611701 tempest-AttachVolumeTestJSON-1651611701-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:28:12.395375 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-24810a9d-7a02-495f-81b0-feaeb4ec5063 tempest-AttachVolumeTestJSON-1651611701 tempest-AttachVolumeTestJSON-1651611701-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:28:12.395811 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-24810a9d-7a02-495f-81b0-feaeb4ec5063 tempest-AttachVolumeTestJSON-1651611701 tempest-AttachVolumeTestJSON-1651611701-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:28:12.458676 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-06c7ea13-30f7-475b-81ab-c4a699c400c1 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:28:12.459274 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-06c7ea13-30f7-475b-81ab-c4a699c400c1 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] [instance: 5d54db85-b991-4890-abaa-952413baa2e7] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:28:12.469358 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-06c7ea13-30f7-475b-81ab-c4a699c400c1 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:28:12.469805 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-06c7ea13-30f7-475b-81ab-c4a699c400c1 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:28:12.470584 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-06c7ea13-30f7-475b-81ab-c4a699c400c1 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:28:12.471010 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-06c7ea13-30f7-475b-81ab-c4a699c400c1 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:28:12.563096 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-24810a9d-7a02-495f-81b0-feaeb4ec5063 tempest-AttachVolumeTestJSON-1651611701 tempest-AttachVolumeTestJSON-1651611701-project] 10.222.0.11 "POST /compute/v2.1/servers/5e11ea9c-f66a-4962-b5ca-b95784624824/action" status: 200 len: 34670 microversion: 2.1 time: 0.180028 Nov 17 03:28:12.564492 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 340/668] 10.222.0.11 () {60 vars in 1277 bytes} [Wed Nov 17 03:28:12 2021] POST /compute/v2.1/servers/5e11ea9c-f66a-4962-b5ca-b95784624824/action => generated 34670 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 17 03:28:12.571749 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-183cb742-02c1-46f7-a8a2-5fe1f1c0acf9 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:28:12.573119 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-183cb742-02c1-46f7-a8a2-5fe1f1c0acf9 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] [instance: a49437df-3059-4528-8328-2f3471d5fb45] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:28:12.583960 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-183cb742-02c1-46f7-a8a2-5fe1f1c0acf9 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:28:12.585032 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-183cb742-02c1-46f7-a8a2-5fe1f1c0acf9 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:28:12.586241 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-183cb742-02c1-46f7-a8a2-5fe1f1c0acf9 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:28:12.586837 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-183cb742-02c1-46f7-a8a2-5fe1f1c0acf9 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:28:12.617793 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-06c7ea13-30f7-475b-81ab-c4a699c400c1 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37f21d6d15cf40a586edda211219fd08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ebb970305844dccacf48a7d8d47ecf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:28:12.628653 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-06c7ea13-30f7-475b-81ab-c4a699c400c1 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '37f21d6d15cf40a586edda211219fd08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ebb970305844dccacf48a7d8d47ecf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:28:12.630410 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-06c7ea13-30f7-475b-81ab-c4a699c400c1 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '37f21d6d15cf40a586edda211219fd08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ebb970305844dccacf48a7d8d47ecf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:28:12.632219 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-06c7ea13-30f7-475b-81ab-c4a699c400c1 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] 10.222.0.11 "GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7" status: 200 len: 1754 microversion: 2.20 time: 0.177954 Nov 17 03:28:12.633453 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 329/669] 10.222.0.11 () {60 vars in 1276 bytes} [Wed Nov 17 03:28:12 2021] GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7 => generated 1754 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 17 03:28:12.676523 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-bf600d9b-8ae9-4adc-9295-ab175dc4028a tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "a3573201-81ca-4c3f-ac74-4588ea819c9f", "device": "/dev/sdb"}} {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 17 03:28:12.678268 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-bf600d9b-8ae9-4adc-9295-ab175dc4028a tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] [instance: 15abb40f-daf9-4c4b-ac9c-55f57ee7b938] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:28:12.688751 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-bf600d9b-8ae9-4adc-9295-ab175dc4028a tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:28:12.689344 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-bf600d9b-8ae9-4adc-9295-ab175dc4028a tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:28:12.690654 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-bf600d9b-8ae9-4adc-9295-ab175dc4028a tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:28:12.691342 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-bf600d9b-8ae9-4adc-9295-ab175dc4028a tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:28:12.879376 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-183cb742-02c1-46f7-a8a2-5fe1f1c0acf9 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f046401c6a04f6495ebe0821120bd72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a58e89ceeea4a9c8a72a1de4bcaf2d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:28:12.891626 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-183cb742-02c1-46f7-a8a2-5fe1f1c0acf9 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] 10.222.0.11 "GET /compute/v2.1/servers/a49437df-3059-4528-8328-2f3471d5fb45" status: 200 len: 1566 microversion: 2.1 time: 0.323679 Nov 17 03:28:12.892205 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 341/670] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:28:12 2021] GET /compute/v2.1/servers/a49437df-3059-4528-8328-2f3471d5fb45 => generated 1566 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:28:12.897017 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-4c745c6e-0856-47c3-a44b-09a8a92ef07f tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-80907878", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-1227147341", "security_groups": [{"name": "tempest-secgroup-smoke-28117422"}], "networks": [{"uuid": "64d5a890-9596-4756-aa8f-1163c2b48c07"}], "block_device_mapping_v2": [{"uuid": "df8ba53d-7bd4-4783-9f36-3595ee64053f", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 17 03:28:12.989553 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-bf600d9b-8ae9-4adc-9295-ab175dc4028a tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] 10.222.0.11 "POST /compute/v2.1/servers/15abb40f-daf9-4c4b-ac9c-55f57ee7b938/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.320895 Nov 17 03:28:12.990393 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 330/671] 10.222.0.11 () {60 vars in 1322 bytes} [Wed Nov 17 03:28:12 2021] POST /compute/v2.1/servers/15abb40f-daf9-4c4b-ac9c-55f57ee7b938/os-volume_attachments => generated 194 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 17 03:28:13.177723 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [req-fb9198c7-774d-406e-a5e5-f2a6b56bf0ee req-b31091ec-920e-4659-b279-21b6b8f9581c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5c1643c5-72d3-4676-85e6-84c5f245c517", "name": "network-vif-deleted", "tag": "cffd3e2c-1775-45b1-b1e1-1bc7ee24953e"}]} {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 17 03:28:13.180082 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 17 03:28:13.180082 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: warnings.warn(msg) Nov 17 03:28:13.189371 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [req-fb9198c7-774d-406e-a5e5-f2a6b56bf0ee req-b31091ec-920e-4659-b279-21b6b8f9581c service nova] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:28:13.190556 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [req-fb9198c7-774d-406e-a5e5-f2a6b56bf0ee req-b31091ec-920e-4659-b279-21b6b8f9581c service nova] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:28:13.200376 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.network.neutron [None req-4c745c6e-0856-47c3-a44b-09a8a92ef07f tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] validate_networks() for [('64d5a890-9596-4756-aa8f-1163c2b48c07', None, None, None, None, None)] {{(pid=115917) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Nov 17 03:28:13.202540 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.compute.server_external_events [req-fb9198c7-774d-406e-a5e5-f2a6b56bf0ee req-b31091ec-920e-4659-b279-21b6b8f9581c service nova] Creating event network-vif-deleted:cffd3e2c-1775-45b1-b1e1-1bc7ee24953e for instance 5c1643c5-72d3-4676-85e6-84c5f245c517 on hv-cinder-81803 Nov 17 03:28:13.207804 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [req-fb9198c7-774d-406e-a5e5-f2a6b56bf0ee req-b31091ec-920e-4659-b279-21b6b8f9581c service nova] 10.222.0.11 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036716 Nov 17 03:28:13.209193 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 331/672] 10.222.0.11 () {64 vars in 1317 bytes} [Wed Nov 17 03:28:13 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 17 03:28:13.354433 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-2027f054-c025-41ef-8ed6-fc65ba304c05 tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:28:13.355952 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-2027f054-c025-41ef-8ed6-fc65ba304c05 tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] [instance: 5c1643c5-72d3-4676-85e6-84c5f245c517] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:28:13.368619 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-2027f054-c025-41ef-8ed6-fc65ba304c05 tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:28:13.372251 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-2027f054-c025-41ef-8ed6-fc65ba304c05 tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:28:13.373756 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-2027f054-c025-41ef-8ed6-fc65ba304c05 tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:28:13.374873 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-2027f054-c025-41ef-8ed6-fc65ba304c05 tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:28:13.413366 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-2027f054-c025-41ef-8ed6-fc65ba304c05 tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:28:13.414055 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-2027f054-c025-41ef-8ed6-fc65ba304c05 tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:28:13.414696 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.objects.instance [None req-2027f054-c025-41ef-8ed6-fc65ba304c05 tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] Lazy-loading 'fault' on Instance uuid 5c1643c5-72d3-4676-85e6-84c5f245c517 {{(pid=115916) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Nov 17 03:28:13.468643 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-2027f054-c025-41ef-8ed6-fc65ba304c05 tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d4e8ac9538f42c9b637bd9e086668b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfc480343d4d493bb4295b055e274df5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:28:13.480586 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-2027f054-c025-41ef-8ed6-fc65ba304c05 tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] 10.222.0.11 "GET /compute/v2.1/servers/5c1643c5-72d3-4676-85e6-84c5f245c517" status: 200 len: 1308 microversion: 2.1 time: 0.130895 Nov 17 03:28:13.481432 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 332/673] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:28:13 2021] GET /compute/v2.1/servers/5c1643c5-72d3-4676-85e6-84c5f245c517 => generated 1308 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 17 03:28:13.577298 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-d7b22f5f-cb36-48c8-921c-be4c359251c7 tempest-AttachVolumeTestJSON-1651611701 tempest-AttachVolumeTestJSON-1651611701-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 17 03:28:13.578430 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-d7b22f5f-cb36-48c8-921c-be4c359251c7 tempest-AttachVolumeTestJSON-1651611701 tempest-AttachVolumeTestJSON-1651611701-project] [instance: 5e11ea9c-f66a-4962-b5ca-b95784624824] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:28:13.585079 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-d7b22f5f-cb36-48c8-921c-be4c359251c7 tempest-AttachVolumeTestJSON-1651611701 tempest-AttachVolumeTestJSON-1651611701-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:28:13.585665 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-d7b22f5f-cb36-48c8-921c-be4c359251c7 tempest-AttachVolumeTestJSON-1651611701 tempest-AttachVolumeTestJSON-1651611701-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:28:13.586562 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-d7b22f5f-cb36-48c8-921c-be4c359251c7 tempest-AttachVolumeTestJSON-1651611701 tempest-AttachVolumeTestJSON-1651611701-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:28:13.587098 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-d7b22f5f-cb36-48c8-921c-be4c359251c7 tempest-AttachVolumeTestJSON-1651611701 tempest-AttachVolumeTestJSON-1651611701-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:28:13.719466 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-d7b22f5f-cb36-48c8-921c-be4c359251c7 tempest-AttachVolumeTestJSON-1651611701 tempest-AttachVolumeTestJSON-1651611701-project] 10.222.0.11 "POST /compute/v2.1/servers/5e11ea9c-f66a-4962-b5ca-b95784624824/action" status: 200 len: 35310 microversion: 2.1 time: 0.146008 Nov 17 03:28:13.720131 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 333/674] 10.222.0.11 () {60 vars in 1277 bytes} [Wed Nov 17 03:28:13 2021] POST /compute/v2.1/servers/5e11ea9c-f66a-4962-b5ca-b95784624824/action => generated 35310 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 17 03:28:13.724927 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-ae3d93eb-ea84-4e34-9054-6bfcd020b249 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:28:13.725616 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-ae3d93eb-ea84-4e34-9054-6bfcd020b249 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] [instance: 5d54db85-b991-4890-abaa-952413baa2e7] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:28:13.733040 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-ae3d93eb-ea84-4e34-9054-6bfcd020b249 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:28:13.733494 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-ae3d93eb-ea84-4e34-9054-6bfcd020b249 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:28:13.734271 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-ae3d93eb-ea84-4e34-9054-6bfcd020b249 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:28:13.734702 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-ae3d93eb-ea84-4e34-9054-6bfcd020b249 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:28:13.874417 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-ae3d93eb-ea84-4e34-9054-6bfcd020b249 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37f21d6d15cf40a586edda211219fd08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ebb970305844dccacf48a7d8d47ecf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:28:13.883802 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-ae3d93eb-ea84-4e34-9054-6bfcd020b249 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '37f21d6d15cf40a586edda211219fd08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ebb970305844dccacf48a7d8d47ecf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:28:13.885256 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-ae3d93eb-ea84-4e34-9054-6bfcd020b249 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '37f21d6d15cf40a586edda211219fd08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ebb970305844dccacf48a7d8d47ecf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:28:13.886446 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-ae3d93eb-ea84-4e34-9054-6bfcd020b249 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] 10.222.0.11 "GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7" status: 200 len: 1754 microversion: 2.20 time: 0.165217 Nov 17 03:28:13.887021 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 334/675] 10.222.0.11 () {60 vars in 1276 bytes} [Wed Nov 17 03:28:13 2021] GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7 => generated 1754 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 17 03:28:13.908953 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-b19a0004-8c2d-4b61-883e-713b46e70958 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:28:13.909552 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-b19a0004-8c2d-4b61-883e-713b46e70958 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] [instance: a49437df-3059-4528-8328-2f3471d5fb45] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:28:13.915497 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-b19a0004-8c2d-4b61-883e-713b46e70958 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:28:13.915940 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-b19a0004-8c2d-4b61-883e-713b46e70958 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:28:13.916698 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-b19a0004-8c2d-4b61-883e-713b46e70958 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:28:13.917154 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-b19a0004-8c2d-4b61-883e-713b46e70958 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:28:13.972081 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.virt.hardware [None req-4c745c6e-0856-47c3-a44b-09a8a92ef07f tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Flavor limits 0:0:0 {{(pid=115917) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 17 03:28:13.972552 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.virt.hardware [None req-4c745c6e-0856-47c3-a44b-09a8a92ef07f tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Image limits 0:0:0 {{(pid=115917) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 17 03:28:13.973762 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.virt.hardware [None req-4c745c6e-0856-47c3-a44b-09a8a92ef07f tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Flavor pref 0:0:0 {{(pid=115917) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 17 03:28:13.974232 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.virt.hardware [None req-4c745c6e-0856-47c3-a44b-09a8a92ef07f tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Image pref 0:0:0 {{(pid=115917) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 17 03:28:13.974691 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.virt.hardware [None req-4c745c6e-0856-47c3-a44b-09a8a92ef07f tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=115917) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 17 03:28:13.983530 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-4c745c6e-0856-47c3-a44b-09a8a92ef07f tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:28:13.983974 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-4c745c6e-0856-47c3-a44b-09a8a92ef07f tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:28:13.984767 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-4c745c6e-0856-47c3-a44b-09a8a92ef07f tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:28:13.985332 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-4c745c6e-0856-47c3-a44b-09a8a92ef07f tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:28:14.002721 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.quota [None req-4c745c6e-0856-47c3-a44b-09a8a92ef07f tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Getting quotas for project 1e123e9b86124c93a7fc2db9984e7466. Resources: {'instances', 'ram', 'cores'} {{(pid=115917) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 17 03:28:14.015730 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.quota [None req-4c745c6e-0856-47c3-a44b-09a8a92ef07f tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Getting quotas for user 163b2f24a72649ac8084be1cac32fa09 and project 1e123e9b86124c93a7fc2db9984e7466. Resources: {'instances', 'ram', 'cores'} {{(pid=115917) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 17 03:28:14.062543 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-b19a0004-8c2d-4b61-883e-713b46e70958 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f046401c6a04f6495ebe0821120bd72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a58e89ceeea4a9c8a72a1de4bcaf2d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:28:14.075841 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-b19a0004-8c2d-4b61-883e-713b46e70958 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] 10.222.0.11 "GET /compute/v2.1/servers/a49437df-3059-4528-8328-2f3471d5fb45" status: 200 len: 1566 microversion: 2.1 time: 0.170777 Nov 17 03:28:14.076631 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 335/676] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:28:13 2021] GET /compute/v2.1/servers/a49437df-3059-4528-8328-2f3471d5fb45 => generated 1566 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:28:14.082074 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-4c745c6e-0856-47c3-a44b-09a8a92ef07f tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Going to run 1 instances... {{(pid=115917) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 17 03:28:14.084448 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-4c745c6e-0856-47c3-a44b-09a8a92ef07f tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] [instance: 0698dc5b-5f47-46c4-ace8-f5e891a964a0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='df8ba53d-7bd4-4783-9f36-3595ee64053f',volume_size=None,volume_type=None)] {{(pid=115917) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 17 03:28:14.264750 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-4c745c6e-0856-47c3-a44b-09a8a92ef07f tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] 10.222.0.11 "POST /compute/v2.1/servers" status: 202 len: 404 microversion: 2.1 time: 1.371268 Nov 17 03:28:14.265417 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 342/677] 10.222.0.11 () {60 vars in 1146 bytes} [Wed Nov 17 03:28:12 2021] POST /compute/v2.1/servers => generated 404 bytes in 1372 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 17 03:28:14.275362 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-9cfcc423-1baa-4ab8-956a-0fcc80f91ea1 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:28:14.276175 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-9cfcc423-1baa-4ab8-956a-0fcc80f91ea1 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] [instance: 0698dc5b-5f47-46c4-ace8-f5e891a964a0] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:28:14.335108 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-9cfcc423-1baa-4ab8-956a-0fcc80f91ea1 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '163b2f24a72649ac8084be1cac32fa09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e123e9b86124c93a7fc2db9984e7466', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:28:14.345487 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-9cfcc423-1baa-4ab8-956a-0fcc80f91ea1 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] 10.222.0.11 "GET /compute/v2.1/servers/0698dc5b-5f47-46c4-ace8-f5e891a964a0" status: 200 len: 1087 microversion: 2.1 time: 0.073718 Nov 17 03:28:14.353177 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 336/678] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:28:14 2021] GET /compute/v2.1/servers/0698dc5b-5f47-46c4-ace8-f5e891a964a0 => generated 1087 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:28:14.498508 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-836e329f-44c1-4836-8f5f-bda39b13fe07 tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:28:14.499112 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-836e329f-44c1-4836-8f5f-bda39b13fe07 tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] [instance: 5c1643c5-72d3-4676-85e6-84c5f245c517] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:28:14.506008 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-836e329f-44c1-4836-8f5f-bda39b13fe07 tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:28:14.506455 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-836e329f-44c1-4836-8f5f-bda39b13fe07 tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:28:14.507223 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-836e329f-44c1-4836-8f5f-bda39b13fe07 tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:28:14.507653 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-836e329f-44c1-4836-8f5f-bda39b13fe07 tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:28:14.521372 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.wsgi [None req-836e329f-44c1-4836-8f5f-bda39b13fe07 tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] HTTP exception thrown: Instance 5c1643c5-72d3-4676-85e6-84c5f245c517 could not be found. Nov 17 03:28:14.521932 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-836e329f-44c1-4836-8f5f-bda39b13fe07 tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] Returning 404 to user: Instance 5c1643c5-72d3-4676-85e6-84c5f245c517 could not be found. {{(pid=115917) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 17 03:28:14.522911 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-836e329f-44c1-4836-8f5f-bda39b13fe07 tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] 10.222.0.11 "GET /compute/v2.1/servers/5c1643c5-72d3-4676-85e6-84c5f245c517" status: 404 len: 111 microversion: 2.1 time: 0.028533 Nov 17 03:28:14.523505 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 343/679] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:28:14 2021] GET /compute/v2.1/servers/5c1643c5-72d3-4676-85e6-84c5f245c517 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 17 03:28:14.532235 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-56944d88-186d-461e-bec0-454c90ecdbe1 tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:28:14.532729 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-56944d88-186d-461e-bec0-454c90ecdbe1 tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] [instance: 645ba67f-2582-4a60-b013-84777a71a70d] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:28:14.539208 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-56944d88-186d-461e-bec0-454c90ecdbe1 tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:28:14.539641 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-56944d88-186d-461e-bec0-454c90ecdbe1 tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:28:14.540409 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-56944d88-186d-461e-bec0-454c90ecdbe1 tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:28:14.540863 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-56944d88-186d-461e-bec0-454c90ecdbe1 tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:28:14.565874 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-56944d88-186d-461e-bec0-454c90ecdbe1 tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] [instance: 645ba67f-2582-4a60-b013-84777a71a70d] Going to try to terminate instance {{(pid=115916) delete /opt/stack/nova/nova/compute/api.py:2614}} Nov 17 03:28:14.650063 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-56944d88-186d-461e-bec0-454c90ecdbe1 tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] 10.222.0.11 "DELETE /compute/v2.1/servers/645ba67f-2582-4a60-b013-84777a71a70d" status: 204 len: 0 microversion: 2.1 time: 0.121323 Nov 17 03:28:14.650761 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 337/680] 10.222.0.11 () {58 vars in 1238 bytes} [Wed Nov 17 03:28:14 2021] DELETE /compute/v2.1/servers/645ba67f-2582-4a60-b013-84777a71a70d => generated 0 bytes in 123 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 17 03:28:14.658780 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-d6484b96-6be2-4956-ab1b-44d41f997cda tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:28:14.659383 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-d6484b96-6be2-4956-ab1b-44d41f997cda tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] [instance: 645ba67f-2582-4a60-b013-84777a71a70d] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:28:14.665891 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-d6484b96-6be2-4956-ab1b-44d41f997cda tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:28:14.666357 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-d6484b96-6be2-4956-ab1b-44d41f997cda tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:28:14.667106 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-d6484b96-6be2-4956-ab1b-44d41f997cda tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:28:14.667536 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-d6484b96-6be2-4956-ab1b-44d41f997cda tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:28:14.731437 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-7131c1d3-7a8e-4efa-8dad-8e76e7b8b184 tempest-AttachVolumeTestJSON-1651611701 tempest-AttachVolumeTestJSON-1651611701-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 17 03:28:14.732699 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-7131c1d3-7a8e-4efa-8dad-8e76e7b8b184 tempest-AttachVolumeTestJSON-1651611701 tempest-AttachVolumeTestJSON-1651611701-project] [instance: 5e11ea9c-f66a-4962-b5ca-b95784624824] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:28:14.739205 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-7131c1d3-7a8e-4efa-8dad-8e76e7b8b184 tempest-AttachVolumeTestJSON-1651611701 tempest-AttachVolumeTestJSON-1651611701-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:28:14.739691 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-7131c1d3-7a8e-4efa-8dad-8e76e7b8b184 tempest-AttachVolumeTestJSON-1651611701 tempest-AttachVolumeTestJSON-1651611701-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:28:14.740520 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-7131c1d3-7a8e-4efa-8dad-8e76e7b8b184 tempest-AttachVolumeTestJSON-1651611701 tempest-AttachVolumeTestJSON-1651611701-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:28:14.740931 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-7131c1d3-7a8e-4efa-8dad-8e76e7b8b184 tempest-AttachVolumeTestJSON-1651611701 tempest-AttachVolumeTestJSON-1651611701-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:28:14.857421 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-d6484b96-6be2-4956-ab1b-44d41f997cda tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d4e8ac9538f42c9b637bd9e086668b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfc480343d4d493bb4295b055e274df5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:28:14.864946 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-d6484b96-6be2-4956-ab1b-44d41f997cda tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] 10.222.0.11 "GET /compute/v2.1/servers/645ba67f-2582-4a60-b013-84777a71a70d" status: 200 len: 1511 microversion: 2.1 time: 0.209787 Nov 17 03:28:14.865508 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 344/681] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:28:14 2021] GET /compute/v2.1/servers/645ba67f-2582-4a60-b013-84777a71a70d => generated 1511 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:28:14.895559 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-7131c1d3-7a8e-4efa-8dad-8e76e7b8b184 tempest-AttachVolumeTestJSON-1651611701 tempest-AttachVolumeTestJSON-1651611701-project] 10.222.0.11 "POST /compute/v2.1/servers/5e11ea9c-f66a-4962-b5ca-b95784624824/action" status: 200 len: 36012 microversion: 2.1 time: 0.168122 Nov 17 03:28:14.899901 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 338/682] 10.222.0.11 () {60 vars in 1277 bytes} [Wed Nov 17 03:28:14 2021] POST /compute/v2.1/servers/5e11ea9c-f66a-4962-b5ca-b95784624824/action => generated 36012 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 17 03:28:14.905251 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-f2e5eed4-e4b2-4988-badc-b70a5f7e3b0e tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:28:14.905849 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-f2e5eed4-e4b2-4988-badc-b70a5f7e3b0e tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] [instance: 5d54db85-b991-4890-abaa-952413baa2e7] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:28:14.911839 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-f2e5eed4-e4b2-4988-badc-b70a5f7e3b0e tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:28:14.912291 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-f2e5eed4-e4b2-4988-badc-b70a5f7e3b0e tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:28:14.913081 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-f2e5eed4-e4b2-4988-badc-b70a5f7e3b0e tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:28:14.913513 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-f2e5eed4-e4b2-4988-badc-b70a5f7e3b0e tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:28:15.093990 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-33dc094a-f1b0-40f5-bb7b-76413e3c6a6c tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:28:15.094801 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-33dc094a-f1b0-40f5-bb7b-76413e3c6a6c tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] [instance: a49437df-3059-4528-8328-2f3471d5fb45] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:28:15.101796 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-33dc094a-f1b0-40f5-bb7b-76413e3c6a6c tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:28:15.102331 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-33dc094a-f1b0-40f5-bb7b-76413e3c6a6c tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:28:15.103187 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-33dc094a-f1b0-40f5-bb7b-76413e3c6a6c tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:28:15.103688 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-33dc094a-f1b0-40f5-bb7b-76413e3c6a6c tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:28:15.114565 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-f2e5eed4-e4b2-4988-badc-b70a5f7e3b0e tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37f21d6d15cf40a586edda211219fd08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ebb970305844dccacf48a7d8d47ecf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:28:15.126177 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-f2e5eed4-e4b2-4988-badc-b70a5f7e3b0e tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '37f21d6d15cf40a586edda211219fd08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ebb970305844dccacf48a7d8d47ecf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:28:15.129424 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-f2e5eed4-e4b2-4988-badc-b70a5f7e3b0e tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '37f21d6d15cf40a586edda211219fd08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ebb970305844dccacf48a7d8d47ecf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:28:15.130857 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-f2e5eed4-e4b2-4988-badc-b70a5f7e3b0e tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] 10.222.0.11 "GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7" status: 200 len: 1810 microversion: 2.20 time: 0.229327 Nov 17 03:28:15.133492 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 345/683] 10.222.0.11 () {60 vars in 1276 bytes} [Wed Nov 17 03:28:14 2021] GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7 => generated 1810 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 17 03:28:15.248621 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-33dc094a-f1b0-40f5-bb7b-76413e3c6a6c tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f046401c6a04f6495ebe0821120bd72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a58e89ceeea4a9c8a72a1de4bcaf2d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:28:15.257015 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-33dc094a-f1b0-40f5-bb7b-76413e3c6a6c tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] 10.222.0.11 "GET /compute/v2.1/servers/a49437df-3059-4528-8328-2f3471d5fb45" status: 200 len: 1566 microversion: 2.1 time: 0.168071 Nov 17 03:28:15.257575 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 339/684] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:28:15 2021] GET /compute/v2.1/servers/a49437df-3059-4528-8328-2f3471d5fb45 => generated 1566 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 17 03:28:15.362582 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-31e79223-1b94-442e-89e7-2a467a1116a1 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:28:15.363393 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-31e79223-1b94-442e-89e7-2a467a1116a1 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] [instance: 0698dc5b-5f47-46c4-ace8-f5e891a964a0] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:28:15.369941 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-31e79223-1b94-442e-89e7-2a467a1116a1 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:28:15.370467 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-31e79223-1b94-442e-89e7-2a467a1116a1 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:28:15.371301 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-31e79223-1b94-442e-89e7-2a467a1116a1 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:28:15.371838 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-31e79223-1b94-442e-89e7-2a467a1116a1 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:28:15.438031 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-31e79223-1b94-442e-89e7-2a467a1116a1 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '163b2f24a72649ac8084be1cac32fa09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e123e9b86124c93a7fc2db9984e7466', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:28:15.446289 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-31e79223-1b94-442e-89e7-2a467a1116a1 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] 10.222.0.11 "GET /compute/v2.1/servers/0698dc5b-5f47-46c4-ace8-f5e891a964a0" status: 200 len: 1185 microversion: 2.1 time: 0.087091 Nov 17 03:28:15.448549 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 346/685] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:28:15 2021] GET /compute/v2.1/servers/0698dc5b-5f47-46c4-ace8-f5e891a964a0 => generated 1185 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:28:15.882406 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-92dfca91-c132-453a-90f0-8cca80afbbb5 tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:28:15.883195 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-92dfca91-c132-453a-90f0-8cca80afbbb5 tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] [instance: 645ba67f-2582-4a60-b013-84777a71a70d] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:28:15.890598 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-92dfca91-c132-453a-90f0-8cca80afbbb5 tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:28:15.891362 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-92dfca91-c132-453a-90f0-8cca80afbbb5 tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:28:15.892377 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-92dfca91-c132-453a-90f0-8cca80afbbb5 tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:28:15.893374 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-92dfca91-c132-453a-90f0-8cca80afbbb5 tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:28:15.917139 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-b442b085-ba26-4193-b22f-a8dfd9283b21 tempest-AttachVolumeTestJSON-1651611701 tempest-AttachVolumeTestJSON-1651611701-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 17 03:28:15.919017 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-b442b085-ba26-4193-b22f-a8dfd9283b21 tempest-AttachVolumeTestJSON-1651611701 tempest-AttachVolumeTestJSON-1651611701-project] [instance: 5e11ea9c-f66a-4962-b5ca-b95784624824] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:28:15.933375 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-b442b085-ba26-4193-b22f-a8dfd9283b21 tempest-AttachVolumeTestJSON-1651611701 tempest-AttachVolumeTestJSON-1651611701-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:28:15.934159 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-b442b085-ba26-4193-b22f-a8dfd9283b21 tempest-AttachVolumeTestJSON-1651611701 tempest-AttachVolumeTestJSON-1651611701-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:28:15.935101 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-b442b085-ba26-4193-b22f-a8dfd9283b21 tempest-AttachVolumeTestJSON-1651611701 tempest-AttachVolumeTestJSON-1651611701-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:28:15.935535 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-b442b085-ba26-4193-b22f-a8dfd9283b21 tempest-AttachVolumeTestJSON-1651611701 tempest-AttachVolumeTestJSON-1651611701-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:28:16.054266 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-92dfca91-c132-453a-90f0-8cca80afbbb5 tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d4e8ac9538f42c9b637bd9e086668b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfc480343d4d493bb4295b055e274df5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:28:16.068445 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-92dfca91-c132-453a-90f0-8cca80afbbb5 tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] 10.222.0.11 "GET /compute/v2.1/servers/645ba67f-2582-4a60-b013-84777a71a70d" status: 200 len: 1511 microversion: 2.1 time: 0.189454 Nov 17 03:28:16.069070 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 340/686] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:28:15 2021] GET /compute/v2.1/servers/645ba67f-2582-4a60-b013-84777a71a70d => generated 1511 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:28:16.084704 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-b442b085-ba26-4193-b22f-a8dfd9283b21 tempest-AttachVolumeTestJSON-1651611701 tempest-AttachVolumeTestJSON-1651611701-project] 10.222.0.11 "POST /compute/v2.1/servers/5e11ea9c-f66a-4962-b5ca-b95784624824/action" status: 200 len: 36759 microversion: 2.1 time: 0.180526 Nov 17 03:28:16.088465 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 347/687] 10.222.0.11 () {60 vars in 1277 bytes} [Wed Nov 17 03:28:15 2021] POST /compute/v2.1/servers/5e11ea9c-f66a-4962-b5ca-b95784624824/action => generated 36759 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 17 03:28:16.153316 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-88ef2bcb-b0f6-4c98-a9c1-f622e5f39502 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:28:16.154735 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-88ef2bcb-b0f6-4c98-a9c1-f622e5f39502 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] [instance: 5d54db85-b991-4890-abaa-952413baa2e7] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:28:16.164702 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-88ef2bcb-b0f6-4c98-a9c1-f622e5f39502 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:28:16.166335 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-88ef2bcb-b0f6-4c98-a9c1-f622e5f39502 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:28:16.167592 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-88ef2bcb-b0f6-4c98-a9c1-f622e5f39502 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:28:16.168601 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-88ef2bcb-b0f6-4c98-a9c1-f622e5f39502 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:28:16.279207 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-67ecb5a7-1baf-4a71-a007-a9a679cf4883 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:28:16.280579 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-67ecb5a7-1baf-4a71-a007-a9a679cf4883 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] [instance: a49437df-3059-4528-8328-2f3471d5fb45] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:28:16.293117 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-67ecb5a7-1baf-4a71-a007-a9a679cf4883 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:28:16.293587 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-67ecb5a7-1baf-4a71-a007-a9a679cf4883 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:28:16.294375 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-67ecb5a7-1baf-4a71-a007-a9a679cf4883 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:28:16.301774 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-67ecb5a7-1baf-4a71-a007-a9a679cf4883 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:28:16.401052 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-88ef2bcb-b0f6-4c98-a9c1-f622e5f39502 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37f21d6d15cf40a586edda211219fd08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ebb970305844dccacf48a7d8d47ecf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:28:16.428806 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-88ef2bcb-b0f6-4c98-a9c1-f622e5f39502 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '37f21d6d15cf40a586edda211219fd08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ebb970305844dccacf48a7d8d47ecf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:28:16.439867 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-88ef2bcb-b0f6-4c98-a9c1-f622e5f39502 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '37f21d6d15cf40a586edda211219fd08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ebb970305844dccacf48a7d8d47ecf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:28:16.441663 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-88ef2bcb-b0f6-4c98-a9c1-f622e5f39502 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] 10.222.0.11 "GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7" status: 200 len: 1810 microversion: 2.20 time: 0.293821 Nov 17 03:28:16.444615 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 341/688] 10.222.0.11 () {60 vars in 1276 bytes} [Wed Nov 17 03:28:16 2021] GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7 => generated 1810 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 17 03:28:16.463927 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-6e94903d-c0b9-4f6f-8f4e-7e968c404fec tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:28:16.464765 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-6e94903d-c0b9-4f6f-8f4e-7e968c404fec tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] [instance: 0698dc5b-5f47-46c4-ace8-f5e891a964a0] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:28:16.476505 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-6e94903d-c0b9-4f6f-8f4e-7e968c404fec tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:28:16.476768 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-6e94903d-c0b9-4f6f-8f4e-7e968c404fec tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:28:16.478547 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-6e94903d-c0b9-4f6f-8f4e-7e968c404fec tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:28:16.480826 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-6e94903d-c0b9-4f6f-8f4e-7e968c404fec tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:28:16.557483 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-6e94903d-c0b9-4f6f-8f4e-7e968c404fec tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '163b2f24a72649ac8084be1cac32fa09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e123e9b86124c93a7fc2db9984e7466', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:28:16.566426 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-6e94903d-c0b9-4f6f-8f4e-7e968c404fec tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] 10.222.0.11 "GET /compute/v2.1/servers/0698dc5b-5f47-46c4-ace8-f5e891a964a0" status: 200 len: 1203 microversion: 2.1 time: 0.106375 Nov 17 03:28:16.571199 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-67ecb5a7-1baf-4a71-a007-a9a679cf4883 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f046401c6a04f6495ebe0821120bd72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a58e89ceeea4a9c8a72a1de4bcaf2d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:28:16.571783 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 342/689] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:28:16 2021] GET /compute/v2.1/servers/0698dc5b-5f47-46c4-ace8-f5e891a964a0 => generated 1203 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:28:16.580957 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-67ecb5a7-1baf-4a71-a007-a9a679cf4883 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] 10.222.0.11 "GET /compute/v2.1/servers/a49437df-3059-4528-8328-2f3471d5fb45" status: 200 len: 1566 microversion: 2.1 time: 0.306758 Nov 17 03:28:16.581528 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 348/690] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:28:16 2021] GET /compute/v2.1/servers/a49437df-3059-4528-8328-2f3471d5fb45 => generated 1566 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 17 03:28:17.085460 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-42ec24b0-bf05-461f-92e6-f7497a6a868e tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:28:17.086256 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-42ec24b0-bf05-461f-92e6-f7497a6a868e tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] [instance: 645ba67f-2582-4a60-b013-84777a71a70d] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:28:17.093093 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-42ec24b0-bf05-461f-92e6-f7497a6a868e tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:28:17.093536 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-42ec24b0-bf05-461f-92e6-f7497a6a868e tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:28:17.094313 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-42ec24b0-bf05-461f-92e6-f7497a6a868e tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:28:17.094735 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-42ec24b0-bf05-461f-92e6-f7497a6a868e tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:28:17.096901 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-fe966330-2924-40cf-a4be-2e6f2da81c22 tempest-AttachVolumeTestJSON-1651611701 tempest-AttachVolumeTestJSON-1651611701-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 17 03:28:17.097879 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-fe966330-2924-40cf-a4be-2e6f2da81c22 tempest-AttachVolumeTestJSON-1651611701 tempest-AttachVolumeTestJSON-1651611701-project] [instance: 5e11ea9c-f66a-4962-b5ca-b95784624824] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:28:17.105381 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-fe966330-2924-40cf-a4be-2e6f2da81c22 tempest-AttachVolumeTestJSON-1651611701 tempest-AttachVolumeTestJSON-1651611701-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:28:17.105975 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-fe966330-2924-40cf-a4be-2e6f2da81c22 tempest-AttachVolumeTestJSON-1651611701 tempest-AttachVolumeTestJSON-1651611701-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:28:17.106875 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-fe966330-2924-40cf-a4be-2e6f2da81c22 tempest-AttachVolumeTestJSON-1651611701 tempest-AttachVolumeTestJSON-1651611701-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:28:17.107414 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-fe966330-2924-40cf-a4be-2e6f2da81c22 tempest-AttachVolumeTestJSON-1651611701 tempest-AttachVolumeTestJSON-1651611701-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:28:17.228053 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-42ec24b0-bf05-461f-92e6-f7497a6a868e tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d4e8ac9538f42c9b637bd9e086668b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfc480343d4d493bb4295b055e274df5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:28:17.235892 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-42ec24b0-bf05-461f-92e6-f7497a6a868e tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] 10.222.0.11 "GET /compute/v2.1/servers/645ba67f-2582-4a60-b013-84777a71a70d" status: 200 len: 1511 microversion: 2.1 time: 0.154430 Nov 17 03:28:17.236468 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 343/691] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:28:17 2021] GET /compute/v2.1/servers/645ba67f-2582-4a60-b013-84777a71a70d => generated 1511 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 17 03:28:17.463340 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-13728272-e369-46be-8d36-a3e58933711e tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:28:17.464136 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-13728272-e369-46be-8d36-a3e58933711e tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] [instance: 5d54db85-b991-4890-abaa-952413baa2e7] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:28:17.470691 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-13728272-e369-46be-8d36-a3e58933711e tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:28:17.471140 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-13728272-e369-46be-8d36-a3e58933711e tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:28:17.471911 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-13728272-e369-46be-8d36-a3e58933711e tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:28:17.472333 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-13728272-e369-46be-8d36-a3e58933711e tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:28:17.610819 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-13728272-e369-46be-8d36-a3e58933711e tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37f21d6d15cf40a586edda211219fd08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ebb970305844dccacf48a7d8d47ecf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:28:17.619238 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-13728272-e369-46be-8d36-a3e58933711e tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '37f21d6d15cf40a586edda211219fd08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ebb970305844dccacf48a7d8d47ecf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:28:17.620709 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-13728272-e369-46be-8d36-a3e58933711e tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '37f21d6d15cf40a586edda211219fd08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ebb970305844dccacf48a7d8d47ecf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:28:17.621937 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-13728272-e369-46be-8d36-a3e58933711e tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] 10.222.0.11 "GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7" status: 200 len: 1810 microversion: 2.20 time: 0.162522 Nov 17 03:28:17.622587 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 344/692] 10.222.0.11 () {60 vars in 1276 bytes} [Wed Nov 17 03:28:17 2021] GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7 => generated 1810 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 17 03:28:17.626938 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-caeddad0-ef5c-4921-b32c-f921a82c809e tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:28:17.627550 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-caeddad0-ef5c-4921-b32c-f921a82c809e tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] [instance: 0698dc5b-5f47-46c4-ace8-f5e891a964a0] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:28:17.633386 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-caeddad0-ef5c-4921-b32c-f921a82c809e tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:28:17.633826 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-caeddad0-ef5c-4921-b32c-f921a82c809e tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:28:17.634591 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-caeddad0-ef5c-4921-b32c-f921a82c809e tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:28:17.635022 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-caeddad0-ef5c-4921-b32c-f921a82c809e tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:28:17.784567 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-caeddad0-ef5c-4921-b32c-f921a82c809e tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '163b2f24a72649ac8084be1cac32fa09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e123e9b86124c93a7fc2db9984e7466', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:28:17.792460 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-caeddad0-ef5c-4921-b32c-f921a82c809e tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] 10.222.0.11 "GET /compute/v2.1/servers/0698dc5b-5f47-46c4-ace8-f5e891a964a0" status: 200 len: 1269 microversion: 2.1 time: 0.168888 Nov 17 03:28:17.793095 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 345/693] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:28:17 2021] GET /compute/v2.1/servers/0698dc5b-5f47-46c4-ace8-f5e891a964a0 => generated 1269 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:28:17.798390 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-963c37d8-9459-40cb-b05e-da827b3e007a tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:28:17.799036 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-963c37d8-9459-40cb-b05e-da827b3e007a tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] [instance: a49437df-3059-4528-8328-2f3471d5fb45] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:28:17.805149 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-963c37d8-9459-40cb-b05e-da827b3e007a tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:28:17.805595 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-963c37d8-9459-40cb-b05e-da827b3e007a tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:28:17.806525 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-963c37d8-9459-40cb-b05e-da827b3e007a tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:28:17.807364 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-963c37d8-9459-40cb-b05e-da827b3e007a tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:28:17.948316 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-963c37d8-9459-40cb-b05e-da827b3e007a tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f046401c6a04f6495ebe0821120bd72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a58e89ceeea4a9c8a72a1de4bcaf2d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:28:17.956483 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-963c37d8-9459-40cb-b05e-da827b3e007a tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] 10.222.0.11 "GET /compute/v2.1/servers/a49437df-3059-4528-8328-2f3471d5fb45" status: 200 len: 1566 microversion: 2.1 time: 0.162335 Nov 17 03:28:17.957200 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 346/694] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:28:17 2021] GET /compute/v2.1/servers/a49437df-3059-4528-8328-2f3471d5fb45 => generated 1566 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:28:18.253539 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-99f5049c-264e-4f68-ac94-bebd44b2616a tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:28:18.254234 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-99f5049c-264e-4f68-ac94-bebd44b2616a tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] [instance: 645ba67f-2582-4a60-b013-84777a71a70d] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:28:18.261080 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-99f5049c-264e-4f68-ac94-bebd44b2616a tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:28:18.261532 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-99f5049c-264e-4f68-ac94-bebd44b2616a tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:28:18.262286 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-99f5049c-264e-4f68-ac94-bebd44b2616a tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:28:18.262935 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-99f5049c-264e-4f68-ac94-bebd44b2616a tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:28:18.409483 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-99f5049c-264e-4f68-ac94-bebd44b2616a tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d4e8ac9538f42c9b637bd9e086668b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfc480343d4d493bb4295b055e274df5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:28:18.417223 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-99f5049c-264e-4f68-ac94-bebd44b2616a tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] 10.222.0.11 "GET /compute/v2.1/servers/645ba67f-2582-4a60-b013-84777a71a70d" status: 200 len: 1511 microversion: 2.1 time: 0.167383 Nov 17 03:28:18.417813 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 347/695] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:28:18 2021] GET /compute/v2.1/servers/645ba67f-2582-4a60-b013-84777a71a70d => generated 1511 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:28:18.640754 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-e1524486-e62b-408e-81c8-2e51b0a75c93 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:28:18.641302 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-e1524486-e62b-408e-81c8-2e51b0a75c93 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] [instance: 5d54db85-b991-4890-abaa-952413baa2e7] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:28:18.647862 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-e1524486-e62b-408e-81c8-2e51b0a75c93 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:28:18.648317 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-e1524486-e62b-408e-81c8-2e51b0a75c93 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:28:18.649104 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-e1524486-e62b-408e-81c8-2e51b0a75c93 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:28:18.649534 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-e1524486-e62b-408e-81c8-2e51b0a75c93 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:28:18.791059 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-e1524486-e62b-408e-81c8-2e51b0a75c93 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37f21d6d15cf40a586edda211219fd08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ebb970305844dccacf48a7d8d47ecf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:28:18.800277 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-e1524486-e62b-408e-81c8-2e51b0a75c93 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '37f21d6d15cf40a586edda211219fd08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ebb970305844dccacf48a7d8d47ecf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:28:18.801795 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-e1524486-e62b-408e-81c8-2e51b0a75c93 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '37f21d6d15cf40a586edda211219fd08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ebb970305844dccacf48a7d8d47ecf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:28:18.802924 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-e1524486-e62b-408e-81c8-2e51b0a75c93 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] 10.222.0.11 "GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7" status: 200 len: 1810 microversion: 2.20 time: 0.166217 Nov 17 03:28:18.803678 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 348/696] 10.222.0.11 () {60 vars in 1276 bytes} [Wed Nov 17 03:28:18 2021] GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7 => generated 1810 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 17 03:28:18.815404 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-f9ed5e28-dbbe-4b45-bcc4-f46544b4a52f tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:28:18.816009 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-f9ed5e28-dbbe-4b45-bcc4-f46544b4a52f tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] [instance: 0698dc5b-5f47-46c4-ace8-f5e891a964a0] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:28:18.822560 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-f9ed5e28-dbbe-4b45-bcc4-f46544b4a52f tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:28:18.823009 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-f9ed5e28-dbbe-4b45-bcc4-f46544b4a52f tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:28:18.823781 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-f9ed5e28-dbbe-4b45-bcc4-f46544b4a52f tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:28:18.824248 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-f9ed5e28-dbbe-4b45-bcc4-f46544b4a52f tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:28:18.962095 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-f9ed5e28-dbbe-4b45-bcc4-f46544b4a52f tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '163b2f24a72649ac8084be1cac32fa09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e123e9b86124c93a7fc2db9984e7466', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:28:18.969606 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-f9ed5e28-dbbe-4b45-bcc4-f46544b4a52f tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] 10.222.0.11 "GET /compute/v2.1/servers/0698dc5b-5f47-46c4-ace8-f5e891a964a0" status: 200 len: 1269 microversion: 2.1 time: 0.157956 Nov 17 03:28:18.970197 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 349/697] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:28:18 2021] GET /compute/v2.1/servers/0698dc5b-5f47-46c4-ace8-f5e891a964a0 => generated 1269 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:28:18.974370 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-47f34858-e99c-4a9d-8bb3-0c68febc9a63 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:28:18.974991 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-47f34858-e99c-4a9d-8bb3-0c68febc9a63 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] [instance: a49437df-3059-4528-8328-2f3471d5fb45] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:28:18.981012 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-47f34858-e99c-4a9d-8bb3-0c68febc9a63 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:28:18.981463 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-47f34858-e99c-4a9d-8bb3-0c68febc9a63 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:28:18.982242 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-47f34858-e99c-4a9d-8bb3-0c68febc9a63 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:28:18.982672 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-47f34858-e99c-4a9d-8bb3-0c68febc9a63 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:28:19.120296 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-47f34858-e99c-4a9d-8bb3-0c68febc9a63 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f046401c6a04f6495ebe0821120bd72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a58e89ceeea4a9c8a72a1de4bcaf2d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:28:19.129135 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-47f34858-e99c-4a9d-8bb3-0c68febc9a63 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] 10.222.0.11 "GET /compute/v2.1/servers/a49437df-3059-4528-8328-2f3471d5fb45" status: 200 len: 1566 microversion: 2.1 time: 0.157929 Nov 17 03:28:19.129817 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 350/698] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:28:18 2021] GET /compute/v2.1/servers/a49437df-3059-4528-8328-2f3471d5fb45 => generated 1566 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:28:19.440955 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-35c3c7d1-bf04-4d08-b765-c1cf1f019f20 tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:28:19.443649 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-35c3c7d1-bf04-4d08-b765-c1cf1f019f20 tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] [instance: 645ba67f-2582-4a60-b013-84777a71a70d] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:28:19.453836 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-35c3c7d1-bf04-4d08-b765-c1cf1f019f20 tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:28:19.454357 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-35c3c7d1-bf04-4d08-b765-c1cf1f019f20 tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:28:19.455250 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-35c3c7d1-bf04-4d08-b765-c1cf1f019f20 tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:28:19.455755 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-35c3c7d1-bf04-4d08-b765-c1cf1f019f20 tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:28:19.594555 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-35c3c7d1-bf04-4d08-b765-c1cf1f019f20 tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d4e8ac9538f42c9b637bd9e086668b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfc480343d4d493bb4295b055e274df5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:28:19.602359 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-35c3c7d1-bf04-4d08-b765-c1cf1f019f20 tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] 10.222.0.11 "GET /compute/v2.1/servers/645ba67f-2582-4a60-b013-84777a71a70d" status: 200 len: 1511 microversion: 2.1 time: 0.169865 Nov 17 03:28:19.602946 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 351/699] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:28:19 2021] GET /compute/v2.1/servers/645ba67f-2582-4a60-b013-84777a71a70d => generated 1511 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:28:19.822301 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-386db193-cbfd-47c6-82c0-a27b987a1e1f tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:28:19.823081 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-386db193-cbfd-47c6-82c0-a27b987a1e1f tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] [instance: 5d54db85-b991-4890-abaa-952413baa2e7] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:28:19.829808 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-386db193-cbfd-47c6-82c0-a27b987a1e1f tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:28:19.830255 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-386db193-cbfd-47c6-82c0-a27b987a1e1f tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:28:19.831034 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-386db193-cbfd-47c6-82c0-a27b987a1e1f tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:28:19.831465 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-386db193-cbfd-47c6-82c0-a27b987a1e1f tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:28:19.967245 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-386db193-cbfd-47c6-82c0-a27b987a1e1f tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37f21d6d15cf40a586edda211219fd08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ebb970305844dccacf48a7d8d47ecf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:28:19.975910 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-386db193-cbfd-47c6-82c0-a27b987a1e1f tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '37f21d6d15cf40a586edda211219fd08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ebb970305844dccacf48a7d8d47ecf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:28:19.977448 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-386db193-cbfd-47c6-82c0-a27b987a1e1f tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '37f21d6d15cf40a586edda211219fd08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ebb970305844dccacf48a7d8d47ecf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:28:19.978615 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-386db193-cbfd-47c6-82c0-a27b987a1e1f tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] 10.222.0.11 "GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7" status: 200 len: 1810 microversion: 2.20 time: 0.160127 Nov 17 03:28:19.979221 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 352/700] 10.222.0.11 () {60 vars in 1276 bytes} [Wed Nov 17 03:28:19 2021] GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7 => generated 1810 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 17 03:28:19.986303 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-d8b3412f-9097-4d01-bfde-c726a4c3b43a tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:28:19.986993 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-d8b3412f-9097-4d01-bfde-c726a4c3b43a tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] [instance: 0698dc5b-5f47-46c4-ace8-f5e891a964a0] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:28:19.993935 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-d8b3412f-9097-4d01-bfde-c726a4c3b43a tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:28:19.994384 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-d8b3412f-9097-4d01-bfde-c726a4c3b43a tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:28:19.995157 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-d8b3412f-9097-4d01-bfde-c726a4c3b43a tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:28:19.995615 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-d8b3412f-9097-4d01-bfde-c726a4c3b43a tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:28:20.134993 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-d8b3412f-9097-4d01-bfde-c726a4c3b43a tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '163b2f24a72649ac8084be1cac32fa09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e123e9b86124c93a7fc2db9984e7466', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:28:20.142376 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-d8b3412f-9097-4d01-bfde-c726a4c3b43a tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] 10.222.0.11 "GET /compute/v2.1/servers/0698dc5b-5f47-46c4-ace8-f5e891a964a0" status: 200 len: 1269 microversion: 2.1 time: 0.159513 Nov 17 03:28:20.142951 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 353/701] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:28:19 2021] GET /compute/v2.1/servers/0698dc5b-5f47-46c4-ace8-f5e891a964a0 => generated 1269 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 17 03:28:20.147250 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-cba3cdea-a3c5-45de-ab02-e96d61cc0ee2 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:28:20.147847 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-cba3cdea-a3c5-45de-ab02-e96d61cc0ee2 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] [instance: a49437df-3059-4528-8328-2f3471d5fb45] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:28:20.154014 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-cba3cdea-a3c5-45de-ab02-e96d61cc0ee2 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:28:20.154457 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-cba3cdea-a3c5-45de-ab02-e96d61cc0ee2 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:28:20.155213 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-cba3cdea-a3c5-45de-ab02-e96d61cc0ee2 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:28:20.155655 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-cba3cdea-a3c5-45de-ab02-e96d61cc0ee2 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:28:20.289467 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-cba3cdea-a3c5-45de-ab02-e96d61cc0ee2 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f046401c6a04f6495ebe0821120bd72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a58e89ceeea4a9c8a72a1de4bcaf2d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:28:20.298174 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-cba3cdea-a3c5-45de-ab02-e96d61cc0ee2 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] 10.222.0.11 "GET /compute/v2.1/servers/a49437df-3059-4528-8328-2f3471d5fb45" status: 200 len: 1566 microversion: 2.1 time: 0.154217 Nov 17 03:28:20.298764 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 354/702] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:28:20 2021] GET /compute/v2.1/servers/a49437df-3059-4528-8328-2f3471d5fb45 => generated 1566 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:28:20.620137 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-d3531267-32ee-44c8-923a-5bdb32ba070f tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:28:20.620966 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-d3531267-32ee-44c8-923a-5bdb32ba070f tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] [instance: 645ba67f-2582-4a60-b013-84777a71a70d] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:28:20.627962 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-d3531267-32ee-44c8-923a-5bdb32ba070f tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:28:20.628410 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-d3531267-32ee-44c8-923a-5bdb32ba070f tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:28:20.629233 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-d3531267-32ee-44c8-923a-5bdb32ba070f tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:28:20.629664 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-d3531267-32ee-44c8-923a-5bdb32ba070f tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:28:20.768685 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-d3531267-32ee-44c8-923a-5bdb32ba070f tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d4e8ac9538f42c9b637bd9e086668b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfc480343d4d493bb4295b055e274df5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:28:20.776522 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-d3531267-32ee-44c8-923a-5bdb32ba070f tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] 10.222.0.11 "GET /compute/v2.1/servers/645ba67f-2582-4a60-b013-84777a71a70d" status: 200 len: 1511 microversion: 2.1 time: 0.160421 Nov 17 03:28:20.777428 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 355/703] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:28:20 2021] GET /compute/v2.1/servers/645ba67f-2582-4a60-b013-84777a71a70d => generated 1511 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:28:20.998951 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-2a8edfa0-eebc-49a8-9cfb-0934f70b6be2 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:28:20.999678 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-2a8edfa0-eebc-49a8-9cfb-0934f70b6be2 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] [instance: 5d54db85-b991-4890-abaa-952413baa2e7] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:28:21.006935 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-2a8edfa0-eebc-49a8-9cfb-0934f70b6be2 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:28:21.007382 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-2a8edfa0-eebc-49a8-9cfb-0934f70b6be2 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:28:21.008176 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-2a8edfa0-eebc-49a8-9cfb-0934f70b6be2 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:28:21.008613 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-2a8edfa0-eebc-49a8-9cfb-0934f70b6be2 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:28:21.159266 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-2a8edfa0-eebc-49a8-9cfb-0934f70b6be2 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37f21d6d15cf40a586edda211219fd08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ebb970305844dccacf48a7d8d47ecf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:28:21.169323 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-2a8edfa0-eebc-49a8-9cfb-0934f70b6be2 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '37f21d6d15cf40a586edda211219fd08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ebb970305844dccacf48a7d8d47ecf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:28:21.170800 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-2a8edfa0-eebc-49a8-9cfb-0934f70b6be2 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '37f21d6d15cf40a586edda211219fd08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ebb970305844dccacf48a7d8d47ecf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:28:21.171960 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-2a8edfa0-eebc-49a8-9cfb-0934f70b6be2 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] 10.222.0.11 "GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7" status: 200 len: 1810 microversion: 2.20 time: 0.178231 Nov 17 03:28:21.172558 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 356/704] 10.222.0.11 () {60 vars in 1276 bytes} [Wed Nov 17 03:28:20 2021] GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7 => generated 1810 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 17 03:28:21.176804 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-dfa6da22-6f7a-4395-aabf-e04a6e5ff98f tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:28:21.177381 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-dfa6da22-6f7a-4395-aabf-e04a6e5ff98f tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] [instance: 0698dc5b-5f47-46c4-ace8-f5e891a964a0] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:28:21.184175 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-dfa6da22-6f7a-4395-aabf-e04a6e5ff98f tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:28:21.184924 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-dfa6da22-6f7a-4395-aabf-e04a6e5ff98f tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:28:21.185733 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-dfa6da22-6f7a-4395-aabf-e04a6e5ff98f tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:28:21.186158 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-dfa6da22-6f7a-4395-aabf-e04a6e5ff98f tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:28:21.321286 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-dfa6da22-6f7a-4395-aabf-e04a6e5ff98f tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '163b2f24a72649ac8084be1cac32fa09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e123e9b86124c93a7fc2db9984e7466', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:28:21.329187 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-dfa6da22-6f7a-4395-aabf-e04a6e5ff98f tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] 10.222.0.11 "GET /compute/v2.1/servers/0698dc5b-5f47-46c4-ace8-f5e891a964a0" status: 200 len: 1269 microversion: 2.1 time: 0.155658 Nov 17 03:28:21.329751 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 357/705] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:28:21 2021] GET /compute/v2.1/servers/0698dc5b-5f47-46c4-ace8-f5e891a964a0 => generated 1269 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:28:21.334579 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-1f5f9118-60ea-4809-b0f6-fe0f08e5f3c2 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:28:21.335393 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-1f5f9118-60ea-4809-b0f6-fe0f08e5f3c2 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] [instance: a49437df-3059-4528-8328-2f3471d5fb45] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:28:21.341805 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-1f5f9118-60ea-4809-b0f6-fe0f08e5f3c2 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:28:21.342259 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-1f5f9118-60ea-4809-b0f6-fe0f08e5f3c2 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:28:21.343035 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-1f5f9118-60ea-4809-b0f6-fe0f08e5f3c2 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:28:21.343465 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-1f5f9118-60ea-4809-b0f6-fe0f08e5f3c2 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:28:21.498390 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-1f5f9118-60ea-4809-b0f6-fe0f08e5f3c2 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f046401c6a04f6495ebe0821120bd72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a58e89ceeea4a9c8a72a1de4bcaf2d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:28:21.509119 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-1f5f9118-60ea-4809-b0f6-fe0f08e5f3c2 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] 10.222.0.11 "GET /compute/v2.1/servers/a49437df-3059-4528-8328-2f3471d5fb45" status: 200 len: 1566 microversion: 2.1 time: 0.177822 Nov 17 03:28:21.510003 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 358/706] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:28:21 2021] GET /compute/v2.1/servers/a49437df-3059-4528-8328-2f3471d5fb45 => generated 1566 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:28:21.794790 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-a930f01e-f2b2-4288-ab5e-63ef6e56c632 tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:28:21.795640 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-a930f01e-f2b2-4288-ab5e-63ef6e56c632 tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] [instance: 645ba67f-2582-4a60-b013-84777a71a70d] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:28:21.802591 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-a930f01e-f2b2-4288-ab5e-63ef6e56c632 tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:28:21.803043 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-a930f01e-f2b2-4288-ab5e-63ef6e56c632 tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:28:21.803828 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-a930f01e-f2b2-4288-ab5e-63ef6e56c632 tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:28:21.804259 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-a930f01e-f2b2-4288-ab5e-63ef6e56c632 tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:28:21.967016 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-a930f01e-f2b2-4288-ab5e-63ef6e56c632 tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d4e8ac9538f42c9b637bd9e086668b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfc480343d4d493bb4295b055e274df5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:28:21.975971 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-a930f01e-f2b2-4288-ab5e-63ef6e56c632 tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] 10.222.0.11 "GET /compute/v2.1/servers/645ba67f-2582-4a60-b013-84777a71a70d" status: 200 len: 1511 microversion: 2.1 time: 0.185093 Nov 17 03:28:21.976810 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 359/707] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:28:21 2021] GET /compute/v2.1/servers/645ba67f-2582-4a60-b013-84777a71a70d => generated 1511 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:28:22.191785 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-7a2621e7-81ad-4309-8869-7e3453f57ecf tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:28:22.193253 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-7a2621e7-81ad-4309-8869-7e3453f57ecf tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] [instance: 5d54db85-b991-4890-abaa-952413baa2e7] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:28:22.199791 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-7a2621e7-81ad-4309-8869-7e3453f57ecf tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:28:22.200242 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-7a2621e7-81ad-4309-8869-7e3453f57ecf tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:28:22.201336 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-7a2621e7-81ad-4309-8869-7e3453f57ecf tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:28:22.201781 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-7a2621e7-81ad-4309-8869-7e3453f57ecf tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:28:22.360833 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-7a2621e7-81ad-4309-8869-7e3453f57ecf tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37f21d6d15cf40a586edda211219fd08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ebb970305844dccacf48a7d8d47ecf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:28:22.370059 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-7a2621e7-81ad-4309-8869-7e3453f57ecf tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '37f21d6d15cf40a586edda211219fd08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ebb970305844dccacf48a7d8d47ecf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:28:22.371552 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-7a2621e7-81ad-4309-8869-7e3453f57ecf tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '37f21d6d15cf40a586edda211219fd08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ebb970305844dccacf48a7d8d47ecf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:28:22.372762 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-7a2621e7-81ad-4309-8869-7e3453f57ecf tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] 10.222.0.11 "GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7" status: 200 len: 1810 microversion: 2.20 time: 0.185445 Nov 17 03:28:22.377902 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 360/708] 10.222.0.11 () {60 vars in 1276 bytes} [Wed Nov 17 03:28:22 2021] GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7 => generated 1810 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 17 03:28:22.377902 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-71fdfc66-c7d0-4c58-8e1d-6451c96791c3 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:28:22.378401 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-71fdfc66-c7d0-4c58-8e1d-6451c96791c3 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] [instance: 0698dc5b-5f47-46c4-ace8-f5e891a964a0] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:28:22.385529 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-71fdfc66-c7d0-4c58-8e1d-6451c96791c3 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:28:22.385975 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-71fdfc66-c7d0-4c58-8e1d-6451c96791c3 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:28:22.386944 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-71fdfc66-c7d0-4c58-8e1d-6451c96791c3 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:28:22.387394 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-71fdfc66-c7d0-4c58-8e1d-6451c96791c3 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:28:22.531768 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-71fdfc66-c7d0-4c58-8e1d-6451c96791c3 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '163b2f24a72649ac8084be1cac32fa09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e123e9b86124c93a7fc2db9984e7466', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:28:22.539773 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-71fdfc66-c7d0-4c58-8e1d-6451c96791c3 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] 10.222.0.11 "GET /compute/v2.1/servers/0698dc5b-5f47-46c4-ace8-f5e891a964a0" status: 200 len: 1269 microversion: 2.1 time: 0.165380 Nov 17 03:28:22.540651 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 361/709] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:28:22 2021] GET /compute/v2.1/servers/0698dc5b-5f47-46c4-ace8-f5e891a964a0 => generated 1269 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:28:22.546751 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-7bbedae8-2c36-4004-a6ce-354761fc9fcf tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:28:22.551931 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-7bbedae8-2c36-4004-a6ce-354761fc9fcf tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] [instance: a49437df-3059-4528-8328-2f3471d5fb45] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:28:22.554055 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-7bbedae8-2c36-4004-a6ce-354761fc9fcf tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:28:22.554512 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-7bbedae8-2c36-4004-a6ce-354761fc9fcf tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:28:22.555312 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-7bbedae8-2c36-4004-a6ce-354761fc9fcf tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:28:22.555935 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-7bbedae8-2c36-4004-a6ce-354761fc9fcf tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:28:22.696001 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-7bbedae8-2c36-4004-a6ce-354761fc9fcf tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f046401c6a04f6495ebe0821120bd72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a58e89ceeea4a9c8a72a1de4bcaf2d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:28:22.704290 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-7bbedae8-2c36-4004-a6ce-354761fc9fcf tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] 10.222.0.11 "GET /compute/v2.1/servers/a49437df-3059-4528-8328-2f3471d5fb45" status: 200 len: 1566 microversion: 2.1 time: 0.162776 Nov 17 03:28:22.704896 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 362/710] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:28:22 2021] GET /compute/v2.1/servers/a49437df-3059-4528-8328-2f3471d5fb45 => generated 1566 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:28:22.995832 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-138bc45c-3a69-4ab2-94a8-9af0edc22142 tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:28:22.996579 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-138bc45c-3a69-4ab2-94a8-9af0edc22142 tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] [instance: 645ba67f-2582-4a60-b013-84777a71a70d] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:28:23.003658 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-138bc45c-3a69-4ab2-94a8-9af0edc22142 tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:28:23.004109 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-138bc45c-3a69-4ab2-94a8-9af0edc22142 tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:28:23.004905 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-138bc45c-3a69-4ab2-94a8-9af0edc22142 tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:28:23.005369 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-138bc45c-3a69-4ab2-94a8-9af0edc22142 tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:28:23.149157 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-138bc45c-3a69-4ab2-94a8-9af0edc22142 tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d4e8ac9538f42c9b637bd9e086668b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfc480343d4d493bb4295b055e274df5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:28:23.157159 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-138bc45c-3a69-4ab2-94a8-9af0edc22142 tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] 10.222.0.11 "GET /compute/v2.1/servers/645ba67f-2582-4a60-b013-84777a71a70d" status: 200 len: 1511 microversion: 2.1 time: 0.164935 Nov 17 03:28:23.157742 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 363/711] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:28:22 2021] GET /compute/v2.1/servers/645ba67f-2582-4a60-b013-84777a71a70d => generated 1511 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:28:23.395064 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-30c3321a-004a-4608-8f68-31732468617e tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:28:23.395668 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-30c3321a-004a-4608-8f68-31732468617e tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] [instance: 5d54db85-b991-4890-abaa-952413baa2e7] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:28:23.402266 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-30c3321a-004a-4608-8f68-31732468617e tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:28:23.402880 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-30c3321a-004a-4608-8f68-31732468617e tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:28:23.404370 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-30c3321a-004a-4608-8f68-31732468617e tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:28:23.405402 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-30c3321a-004a-4608-8f68-31732468617e tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:28:23.545511 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-30c3321a-004a-4608-8f68-31732468617e tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37f21d6d15cf40a586edda211219fd08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ebb970305844dccacf48a7d8d47ecf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:28:23.555254 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-30c3321a-004a-4608-8f68-31732468617e tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '37f21d6d15cf40a586edda211219fd08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ebb970305844dccacf48a7d8d47ecf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:28:23.557434 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-30c3321a-004a-4608-8f68-31732468617e tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '37f21d6d15cf40a586edda211219fd08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ebb970305844dccacf48a7d8d47ecf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:28:23.558613 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-30c3321a-004a-4608-8f68-31732468617e tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] 10.222.0.11 "GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7" status: 200 len: 1810 microversion: 2.20 time: 0.167470 Nov 17 03:28:23.559176 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 364/712] 10.222.0.11 () {60 vars in 1276 bytes} [Wed Nov 17 03:28:23 2021] GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7 => generated 1810 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 17 03:28:23.564049 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-5e933d7b-0846-45ad-9857-da112da1aea0 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:28:23.564670 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-5e933d7b-0846-45ad-9857-da112da1aea0 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] [instance: 0698dc5b-5f47-46c4-ace8-f5e891a964a0] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:28:23.570804 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-5e933d7b-0846-45ad-9857-da112da1aea0 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:28:23.571393 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-5e933d7b-0846-45ad-9857-da112da1aea0 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:28:23.572179 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-5e933d7b-0846-45ad-9857-da112da1aea0 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:28:23.572619 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-5e933d7b-0846-45ad-9857-da112da1aea0 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:28:23.716334 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-5e933d7b-0846-45ad-9857-da112da1aea0 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '163b2f24a72649ac8084be1cac32fa09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e123e9b86124c93a7fc2db9984e7466', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:28:23.723922 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-5e933d7b-0846-45ad-9857-da112da1aea0 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] 10.222.0.11 "GET /compute/v2.1/servers/0698dc5b-5f47-46c4-ace8-f5e891a964a0" status: 200 len: 1269 microversion: 2.1 time: 0.163694 Nov 17 03:28:23.724678 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 365/713] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:28:23 2021] GET /compute/v2.1/servers/0698dc5b-5f47-46c4-ace8-f5e891a964a0 => generated 1269 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:28:23.730390 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-14c015a7-e431-4274-8f08-cc69203a8703 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:28:23.731373 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-14c015a7-e431-4274-8f08-cc69203a8703 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] [instance: a49437df-3059-4528-8328-2f3471d5fb45] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:28:23.738262 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-14c015a7-e431-4274-8f08-cc69203a8703 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:28:23.738703 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-14c015a7-e431-4274-8f08-cc69203a8703 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:28:23.739477 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-14c015a7-e431-4274-8f08-cc69203a8703 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:28:23.739901 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-14c015a7-e431-4274-8f08-cc69203a8703 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:28:23.876154 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-14c015a7-e431-4274-8f08-cc69203a8703 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f046401c6a04f6495ebe0821120bd72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a58e89ceeea4a9c8a72a1de4bcaf2d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:28:23.884360 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-14c015a7-e431-4274-8f08-cc69203a8703 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] 10.222.0.11 "GET /compute/v2.1/servers/a49437df-3059-4528-8328-2f3471d5fb45" status: 200 len: 1566 microversion: 2.1 time: 0.157875 Nov 17 03:28:23.884945 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 366/714] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:28:23 2021] GET /compute/v2.1/servers/a49437df-3059-4528-8328-2f3471d5fb45 => generated 1566 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:28:24.174995 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-f834b35e-2c3e-46eb-830c-b75879ae117c tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:28:24.175735 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-f834b35e-2c3e-46eb-830c-b75879ae117c tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] [instance: 645ba67f-2582-4a60-b013-84777a71a70d] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:28:24.182565 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-f834b35e-2c3e-46eb-830c-b75879ae117c tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:28:24.183023 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-f834b35e-2c3e-46eb-830c-b75879ae117c tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:28:24.183808 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-f834b35e-2c3e-46eb-830c-b75879ae117c tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:28:24.184245 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-f834b35e-2c3e-46eb-830c-b75879ae117c tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:28:24.318241 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-f834b35e-2c3e-46eb-830c-b75879ae117c tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d4e8ac9538f42c9b637bd9e086668b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfc480343d4d493bb4295b055e274df5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:28:24.326446 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-f834b35e-2c3e-46eb-830c-b75879ae117c tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] 10.222.0.11 "GET /compute/v2.1/servers/645ba67f-2582-4a60-b013-84777a71a70d" status: 200 len: 1511 microversion: 2.1 time: 0.155258 Nov 17 03:28:24.327035 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 367/715] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:28:24 2021] GET /compute/v2.1/servers/645ba67f-2582-4a60-b013-84777a71a70d => generated 1511 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:28:24.577431 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-264a3360-c2dc-43d2-8bb7-4992f20cf24a tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:28:24.578228 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-264a3360-c2dc-43d2-8bb7-4992f20cf24a tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] [instance: 5d54db85-b991-4890-abaa-952413baa2e7] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:28:24.588862 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-264a3360-c2dc-43d2-8bb7-4992f20cf24a tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:28:24.589309 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-264a3360-c2dc-43d2-8bb7-4992f20cf24a tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:28:24.590268 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-264a3360-c2dc-43d2-8bb7-4992f20cf24a tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:28:24.591045 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-264a3360-c2dc-43d2-8bb7-4992f20cf24a tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:28:24.742618 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-264a3360-c2dc-43d2-8bb7-4992f20cf24a tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37f21d6d15cf40a586edda211219fd08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ebb970305844dccacf48a7d8d47ecf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:28:24.751917 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-264a3360-c2dc-43d2-8bb7-4992f20cf24a tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '37f21d6d15cf40a586edda211219fd08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ebb970305844dccacf48a7d8d47ecf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:28:24.753433 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-264a3360-c2dc-43d2-8bb7-4992f20cf24a tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '37f21d6d15cf40a586edda211219fd08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ebb970305844dccacf48a7d8d47ecf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:28:24.754626 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-264a3360-c2dc-43d2-8bb7-4992f20cf24a tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] 10.222.0.11 "GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7" status: 200 len: 1810 microversion: 2.20 time: 0.181608 Nov 17 03:28:24.755177 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 368/716] 10.222.0.11 () {60 vars in 1276 bytes} [Wed Nov 17 03:28:24 2021] GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7 => generated 1810 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 17 03:28:24.759463 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-1c16848c-9a6c-4b0c-a503-fdd3647fd810 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:28:24.760056 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-1c16848c-9a6c-4b0c-a503-fdd3647fd810 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] [instance: 0698dc5b-5f47-46c4-ace8-f5e891a964a0] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:28:24.766087 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-1c16848c-9a6c-4b0c-a503-fdd3647fd810 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:28:24.766550 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-1c16848c-9a6c-4b0c-a503-fdd3647fd810 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:28:24.767363 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-1c16848c-9a6c-4b0c-a503-fdd3647fd810 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:28:24.767734 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-1c16848c-9a6c-4b0c-a503-fdd3647fd810 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:28:24.907574 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-1c16848c-9a6c-4b0c-a503-fdd3647fd810 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '163b2f24a72649ac8084be1cac32fa09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e123e9b86124c93a7fc2db9984e7466', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:28:24.915188 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-1c16848c-9a6c-4b0c-a503-fdd3647fd810 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] 10.222.0.11 "GET /compute/v2.1/servers/0698dc5b-5f47-46c4-ace8-f5e891a964a0" status: 200 len: 1269 microversion: 2.1 time: 0.159027 Nov 17 03:28:24.915790 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 369/717] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:28:24 2021] GET /compute/v2.1/servers/0698dc5b-5f47-46c4-ace8-f5e891a964a0 => generated 1269 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:28:24.920311 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-c21debf7-bdc4-479a-88af-029b886ead6d tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:28:24.920931 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-c21debf7-bdc4-479a-88af-029b886ead6d tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] [instance: a49437df-3059-4528-8328-2f3471d5fb45] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:28:24.926797 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-c21debf7-bdc4-479a-88af-029b886ead6d tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:28:24.927252 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-c21debf7-bdc4-479a-88af-029b886ead6d tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:28:24.928021 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-c21debf7-bdc4-479a-88af-029b886ead6d tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:28:24.928453 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-c21debf7-bdc4-479a-88af-029b886ead6d tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:28:25.066679 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-c21debf7-bdc4-479a-88af-029b886ead6d tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f046401c6a04f6495ebe0821120bd72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a58e89ceeea4a9c8a72a1de4bcaf2d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:28:25.075690 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-c21debf7-bdc4-479a-88af-029b886ead6d tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] 10.222.0.11 "GET /compute/v2.1/servers/a49437df-3059-4528-8328-2f3471d5fb45" status: 200 len: 1566 microversion: 2.1 time: 0.158706 Nov 17 03:28:25.076309 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 370/718] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:28:24 2021] GET /compute/v2.1/servers/a49437df-3059-4528-8328-2f3471d5fb45 => generated 1566 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:28:25.343494 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-48009794-69be-442f-8a91-950a8255d1ce tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:28:25.344269 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-48009794-69be-442f-8a91-950a8255d1ce tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] [instance: 645ba67f-2582-4a60-b013-84777a71a70d] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:28:25.350907 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-48009794-69be-442f-8a91-950a8255d1ce tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:28:25.351350 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-48009794-69be-442f-8a91-950a8255d1ce tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:28:25.352125 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-48009794-69be-442f-8a91-950a8255d1ce tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:28:25.352550 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-48009794-69be-442f-8a91-950a8255d1ce tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:28:25.489294 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-48009794-69be-442f-8a91-950a8255d1ce tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d4e8ac9538f42c9b637bd9e086668b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfc480343d4d493bb4295b055e274df5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:28:25.496799 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-48009794-69be-442f-8a91-950a8255d1ce tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] 10.222.0.11 "GET /compute/v2.1/servers/645ba67f-2582-4a60-b013-84777a71a70d" status: 200 len: 1511 microversion: 2.1 time: 0.157501 Nov 17 03:28:25.497451 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 371/719] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:28:25 2021] GET /compute/v2.1/servers/645ba67f-2582-4a60-b013-84777a71a70d => generated 1511 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:28:25.772736 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-0611cab4-1854-4beb-bf9e-3ccb7d9f49d2 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:28:25.773376 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-0611cab4-1854-4beb-bf9e-3ccb7d9f49d2 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] [instance: 5d54db85-b991-4890-abaa-952413baa2e7] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:28:25.779999 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-0611cab4-1854-4beb-bf9e-3ccb7d9f49d2 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:28:25.780472 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-0611cab4-1854-4beb-bf9e-3ccb7d9f49d2 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:28:25.781299 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-0611cab4-1854-4beb-bf9e-3ccb7d9f49d2 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:28:25.781831 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-0611cab4-1854-4beb-bf9e-3ccb7d9f49d2 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:28:25.922941 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-0611cab4-1854-4beb-bf9e-3ccb7d9f49d2 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37f21d6d15cf40a586edda211219fd08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ebb970305844dccacf48a7d8d47ecf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:28:25.932428 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-0611cab4-1854-4beb-bf9e-3ccb7d9f49d2 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '37f21d6d15cf40a586edda211219fd08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ebb970305844dccacf48a7d8d47ecf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:28:25.934122 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-0611cab4-1854-4beb-bf9e-3ccb7d9f49d2 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '37f21d6d15cf40a586edda211219fd08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ebb970305844dccacf48a7d8d47ecf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:28:25.935782 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-0611cab4-1854-4beb-bf9e-3ccb7d9f49d2 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] 10.222.0.11 "GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7" status: 200 len: 1810 microversion: 2.20 time: 0.166334 Nov 17 03:28:25.936350 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 372/720] 10.222.0.11 () {60 vars in 1276 bytes} [Wed Nov 17 03:28:25 2021] GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7 => generated 1810 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 17 03:28:25.940841 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-dd429795-812d-4795-84aa-1156ddd7c0a1 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:28:25.941484 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-dd429795-812d-4795-84aa-1156ddd7c0a1 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] [instance: 0698dc5b-5f47-46c4-ace8-f5e891a964a0] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:28:25.947946 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-dd429795-812d-4795-84aa-1156ddd7c0a1 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:28:25.948399 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-dd429795-812d-4795-84aa-1156ddd7c0a1 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:28:25.949205 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-dd429795-812d-4795-84aa-1156ddd7c0a1 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:28:25.949643 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-dd429795-812d-4795-84aa-1156ddd7c0a1 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:28:26.089469 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-dd429795-812d-4795-84aa-1156ddd7c0a1 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '163b2f24a72649ac8084be1cac32fa09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e123e9b86124c93a7fc2db9984e7466', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:28:26.097319 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-dd429795-812d-4795-84aa-1156ddd7c0a1 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] 10.222.0.11 "GET /compute/v2.1/servers/0698dc5b-5f47-46c4-ace8-f5e891a964a0" status: 200 len: 1269 microversion: 2.1 time: 0.159829 Nov 17 03:28:26.097903 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 373/721] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:28:25 2021] GET /compute/v2.1/servers/0698dc5b-5f47-46c4-ace8-f5e891a964a0 => generated 1269 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:28:26.104412 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-2d5b2c26-8fe3-4c11-a476-7a04becdff72 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:28:26.105077 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-2d5b2c26-8fe3-4c11-a476-7a04becdff72 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] [instance: a49437df-3059-4528-8328-2f3471d5fb45] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:28:26.111115 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-2d5b2c26-8fe3-4c11-a476-7a04becdff72 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:28:26.111566 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-2d5b2c26-8fe3-4c11-a476-7a04becdff72 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:28:26.112338 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-2d5b2c26-8fe3-4c11-a476-7a04becdff72 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:28:26.112768 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-2d5b2c26-8fe3-4c11-a476-7a04becdff72 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:28:26.255709 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-2d5b2c26-8fe3-4c11-a476-7a04becdff72 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f046401c6a04f6495ebe0821120bd72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a58e89ceeea4a9c8a72a1de4bcaf2d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:28:26.263934 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-2d5b2c26-8fe3-4c11-a476-7a04becdff72 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] 10.222.0.11 "GET /compute/v2.1/servers/a49437df-3059-4528-8328-2f3471d5fb45" status: 200 len: 1566 microversion: 2.1 time: 0.162893 Nov 17 03:28:26.264503 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 374/722] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:28:26 2021] GET /compute/v2.1/servers/a49437df-3059-4528-8328-2f3471d5fb45 => generated 1566 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:28:26.515510 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-189ce010-4d15-40af-a899-12b71869384d tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:28:26.516263 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-189ce010-4d15-40af-a899-12b71869384d tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] [instance: 645ba67f-2582-4a60-b013-84777a71a70d] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:28:26.523012 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-189ce010-4d15-40af-a899-12b71869384d tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:28:26.523446 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-189ce010-4d15-40af-a899-12b71869384d tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:28:26.524221 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-189ce010-4d15-40af-a899-12b71869384d tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:28:26.524648 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-189ce010-4d15-40af-a899-12b71869384d tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:28:26.663488 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-189ce010-4d15-40af-a899-12b71869384d tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d4e8ac9538f42c9b637bd9e086668b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfc480343d4d493bb4295b055e274df5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:28:26.671380 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-189ce010-4d15-40af-a899-12b71869384d tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] 10.222.0.11 "GET /compute/v2.1/servers/645ba67f-2582-4a60-b013-84777a71a70d" status: 200 len: 1511 microversion: 2.1 time: 0.160216 Nov 17 03:28:26.672155 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 375/723] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:28:26 2021] GET /compute/v2.1/servers/645ba67f-2582-4a60-b013-84777a71a70d => generated 1511 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:28:26.955291 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-377640a5-37f6-4c36-a7da-b3c00113d293 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:28:26.956416 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-377640a5-37f6-4c36-a7da-b3c00113d293 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] [instance: 5d54db85-b991-4890-abaa-952413baa2e7] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:28:26.964129 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-377640a5-37f6-4c36-a7da-b3c00113d293 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:28:26.964575 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-377640a5-37f6-4c36-a7da-b3c00113d293 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:28:26.965389 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-377640a5-37f6-4c36-a7da-b3c00113d293 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:28:26.965803 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-377640a5-37f6-4c36-a7da-b3c00113d293 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:28:27.101903 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-377640a5-37f6-4c36-a7da-b3c00113d293 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37f21d6d15cf40a586edda211219fd08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ebb970305844dccacf48a7d8d47ecf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:28:27.110728 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-377640a5-37f6-4c36-a7da-b3c00113d293 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '37f21d6d15cf40a586edda211219fd08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ebb970305844dccacf48a7d8d47ecf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:28:27.112193 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-377640a5-37f6-4c36-a7da-b3c00113d293 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '37f21d6d15cf40a586edda211219fd08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ebb970305844dccacf48a7d8d47ecf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:28:27.113410 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-377640a5-37f6-4c36-a7da-b3c00113d293 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] 10.222.0.11 "GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7" status: 200 len: 1810 microversion: 2.20 time: 0.163163 Nov 17 03:28:27.113951 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 376/724] 10.222.0.11 () {60 vars in 1276 bytes} [Wed Nov 17 03:28:26 2021] GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7 => generated 1810 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 17 03:28:27.119516 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-41ede00a-542e-479a-9e1f-3d1dc0bc3184 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:28:27.120838 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-41ede00a-542e-479a-9e1f-3d1dc0bc3184 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] [instance: 0698dc5b-5f47-46c4-ace8-f5e891a964a0] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:28:27.128599 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-41ede00a-542e-479a-9e1f-3d1dc0bc3184 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:28:27.129063 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-41ede00a-542e-479a-9e1f-3d1dc0bc3184 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:28:27.129864 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-41ede00a-542e-479a-9e1f-3d1dc0bc3184 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:28:27.130287 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-41ede00a-542e-479a-9e1f-3d1dc0bc3184 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:28:27.272666 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-41ede00a-542e-479a-9e1f-3d1dc0bc3184 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '163b2f24a72649ac8084be1cac32fa09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e123e9b86124c93a7fc2db9984e7466', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:28:27.281537 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-41ede00a-542e-479a-9e1f-3d1dc0bc3184 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] 10.222.0.11 "GET /compute/v2.1/servers/0698dc5b-5f47-46c4-ace8-f5e891a964a0" status: 200 len: 1269 microversion: 2.1 time: 0.166487 Nov 17 03:28:27.282132 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 377/725] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:28:27 2021] GET /compute/v2.1/servers/0698dc5b-5f47-46c4-ace8-f5e891a964a0 => generated 1269 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:28:27.286473 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-325b4bfc-c126-4f8e-a015-eaa2b73c4faa tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:28:27.287071 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-325b4bfc-c126-4f8e-a015-eaa2b73c4faa tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] [instance: a49437df-3059-4528-8328-2f3471d5fb45] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:28:27.293441 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-325b4bfc-c126-4f8e-a015-eaa2b73c4faa tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:28:27.293888 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-325b4bfc-c126-4f8e-a015-eaa2b73c4faa tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:28:27.294644 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-325b4bfc-c126-4f8e-a015-eaa2b73c4faa tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:28:27.295078 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-325b4bfc-c126-4f8e-a015-eaa2b73c4faa tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:28:27.432560 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-325b4bfc-c126-4f8e-a015-eaa2b73c4faa tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f046401c6a04f6495ebe0821120bd72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a58e89ceeea4a9c8a72a1de4bcaf2d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:28:27.440691 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-325b4bfc-c126-4f8e-a015-eaa2b73c4faa tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] 10.222.0.11 "GET /compute/v2.1/servers/a49437df-3059-4528-8328-2f3471d5fb45" status: 200 len: 1566 microversion: 2.1 time: 0.157638 Nov 17 03:28:27.441475 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 378/726] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:28:27 2021] GET /compute/v2.1/servers/a49437df-3059-4528-8328-2f3471d5fb45 => generated 1566 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:28:27.688625 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-704c44bf-0259-4d27-8f0c-6b394287c42a tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:28:27.689352 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-704c44bf-0259-4d27-8f0c-6b394287c42a tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] [instance: 645ba67f-2582-4a60-b013-84777a71a70d] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:28:27.696269 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-704c44bf-0259-4d27-8f0c-6b394287c42a tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:28:27.696714 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-704c44bf-0259-4d27-8f0c-6b394287c42a tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:28:27.697531 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-704c44bf-0259-4d27-8f0c-6b394287c42a tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:28:27.697969 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-704c44bf-0259-4d27-8f0c-6b394287c42a tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:28:27.833873 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-704c44bf-0259-4d27-8f0c-6b394287c42a tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d4e8ac9538f42c9b637bd9e086668b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfc480343d4d493bb4295b055e274df5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:28:27.841688 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-704c44bf-0259-4d27-8f0c-6b394287c42a tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] 10.222.0.11 "GET /compute/v2.1/servers/645ba67f-2582-4a60-b013-84777a71a70d" status: 200 len: 1511 microversion: 2.1 time: 0.156946 Nov 17 03:28:27.842330 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 379/727] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:28:27 2021] GET /compute/v2.1/servers/645ba67f-2582-4a60-b013-84777a71a70d => generated 1511 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:28:28.132069 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-5880a9be-0df4-4f39-ad1c-8605bb34dce4 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:28:28.132710 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-5880a9be-0df4-4f39-ad1c-8605bb34dce4 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] [instance: 5d54db85-b991-4890-abaa-952413baa2e7] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:28:28.139424 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-5880a9be-0df4-4f39-ad1c-8605bb34dce4 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:28:28.140125 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-5880a9be-0df4-4f39-ad1c-8605bb34dce4 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:28:28.141023 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-5880a9be-0df4-4f39-ad1c-8605bb34dce4 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:28:28.141461 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-5880a9be-0df4-4f39-ad1c-8605bb34dce4 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:28:28.285822 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-5880a9be-0df4-4f39-ad1c-8605bb34dce4 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37f21d6d15cf40a586edda211219fd08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ebb970305844dccacf48a7d8d47ecf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:28:28.294900 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-5880a9be-0df4-4f39-ad1c-8605bb34dce4 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '37f21d6d15cf40a586edda211219fd08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ebb970305844dccacf48a7d8d47ecf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:28:28.296768 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-5880a9be-0df4-4f39-ad1c-8605bb34dce4 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '37f21d6d15cf40a586edda211219fd08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ebb970305844dccacf48a7d8d47ecf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:28:28.297970 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-5880a9be-0df4-4f39-ad1c-8605bb34dce4 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] 10.222.0.11 "GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7" status: 200 len: 1810 microversion: 2.20 time: 0.169669 Nov 17 03:28:28.298712 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 380/728] 10.222.0.11 () {60 vars in 1276 bytes} [Wed Nov 17 03:28:28 2021] GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7 => generated 1810 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 17 03:28:28.302943 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-db62c5b5-75c2-4716-85c0-961c97d637ae tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:28:28.303548 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-db62c5b5-75c2-4716-85c0-961c97d637ae tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] [instance: 0698dc5b-5f47-46c4-ace8-f5e891a964a0] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:28:28.310131 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-db62c5b5-75c2-4716-85c0-961c97d637ae tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:28:28.310524 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-db62c5b5-75c2-4716-85c0-961c97d637ae tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:28:28.311339 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-db62c5b5-75c2-4716-85c0-961c97d637ae tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:28:28.311854 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-db62c5b5-75c2-4716-85c0-961c97d637ae tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:28:28.448008 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-db62c5b5-75c2-4716-85c0-961c97d637ae tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '163b2f24a72649ac8084be1cac32fa09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e123e9b86124c93a7fc2db9984e7466', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:28:28.455623 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-db62c5b5-75c2-4716-85c0-961c97d637ae tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] 10.222.0.11 "GET /compute/v2.1/servers/0698dc5b-5f47-46c4-ace8-f5e891a964a0" status: 200 len: 1269 microversion: 2.1 time: 0.156070 Nov 17 03:28:28.456201 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 381/729] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:28:28 2021] GET /compute/v2.1/servers/0698dc5b-5f47-46c4-ace8-f5e891a964a0 => generated 1269 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:28:28.460554 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-44ce66f4-900f-41f8-9d6a-b56b43ed5221 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:28:28.461201 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-44ce66f4-900f-41f8-9d6a-b56b43ed5221 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] [instance: a49437df-3059-4528-8328-2f3471d5fb45] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:28:28.467410 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-44ce66f4-900f-41f8-9d6a-b56b43ed5221 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:28:28.468079 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-44ce66f4-900f-41f8-9d6a-b56b43ed5221 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:28:28.468939 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-44ce66f4-900f-41f8-9d6a-b56b43ed5221 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:28:28.469381 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-44ce66f4-900f-41f8-9d6a-b56b43ed5221 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:28:28.612633 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-44ce66f4-900f-41f8-9d6a-b56b43ed5221 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f046401c6a04f6495ebe0821120bd72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a58e89ceeea4a9c8a72a1de4bcaf2d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:28:28.620944 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-44ce66f4-900f-41f8-9d6a-b56b43ed5221 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] 10.222.0.11 "GET /compute/v2.1/servers/a49437df-3059-4528-8328-2f3471d5fb45" status: 200 len: 1566 microversion: 2.1 time: 0.163712 Nov 17 03:28:28.621563 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 382/730] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:28:28 2021] GET /compute/v2.1/servers/a49437df-3059-4528-8328-2f3471d5fb45 => generated 1566 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:28:28.860733 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-45461d7f-8bce-418c-9ef7-881d851f3032 tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:28:28.861426 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-45461d7f-8bce-418c-9ef7-881d851f3032 tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] [instance: 645ba67f-2582-4a60-b013-84777a71a70d] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:28:28.868224 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-45461d7f-8bce-418c-9ef7-881d851f3032 tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:28:28.868675 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-45461d7f-8bce-418c-9ef7-881d851f3032 tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:28:28.869495 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-45461d7f-8bce-418c-9ef7-881d851f3032 tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:28:28.869933 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-45461d7f-8bce-418c-9ef7-881d851f3032 tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:28:29.021583 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-45461d7f-8bce-418c-9ef7-881d851f3032 tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d4e8ac9538f42c9b637bd9e086668b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfc480343d4d493bb4295b055e274df5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:28:29.031867 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-45461d7f-8bce-418c-9ef7-881d851f3032 tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] 10.222.0.11 "GET /compute/v2.1/servers/645ba67f-2582-4a60-b013-84777a71a70d" status: 200 len: 1511 microversion: 2.1 time: 0.175661 Nov 17 03:28:29.032440 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 383/731] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:28:28 2021] GET /compute/v2.1/servers/645ba67f-2582-4a60-b013-84777a71a70d => generated 1511 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:28:29.316506 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-f95eb3ef-373c-4105-b347-c399006d0efc tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:28:29.317145 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-f95eb3ef-373c-4105-b347-c399006d0efc tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] [instance: 5d54db85-b991-4890-abaa-952413baa2e7] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:28:29.323601 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-f95eb3ef-373c-4105-b347-c399006d0efc tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:28:29.324045 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-f95eb3ef-373c-4105-b347-c399006d0efc tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:28:29.324859 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-f95eb3ef-373c-4105-b347-c399006d0efc tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:28:29.325279 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-f95eb3ef-373c-4105-b347-c399006d0efc tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:28:29.368153 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-fe966330-2924-40cf-a4be-2e6f2da81c22 tempest-AttachVolumeTestJSON-1651611701 tempest-AttachVolumeTestJSON-1651611701-project] 10.222.0.11 "POST /compute/v2.1/servers/5e11ea9c-f66a-4962-b5ca-b95784624824/action" status: 200 len: 38216 microversion: 2.1 time: 12.274624 Nov 17 03:28:29.374572 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 349/732] 10.222.0.11 () {60 vars in 1277 bytes} [Wed Nov 17 03:28:17 2021] POST /compute/v2.1/servers/5e11ea9c-f66a-4962-b5ca-b95784624824/action => generated 38216 bytes in 12282 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 17 03:28:29.380509 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-d3107792-6eae-480a-8e5b-91526392ab3b tempest-AttachVolumeTestJSON-1651611701 tempest-AttachVolumeTestJSON-1651611701-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:28:29.381207 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-d3107792-6eae-480a-8e5b-91526392ab3b tempest-AttachVolumeTestJSON-1651611701 tempest-AttachVolumeTestJSON-1651611701-project] [instance: 5e11ea9c-f66a-4962-b5ca-b95784624824] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:28:29.389216 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-d3107792-6eae-480a-8e5b-91526392ab3b tempest-AttachVolumeTestJSON-1651611701 tempest-AttachVolumeTestJSON-1651611701-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:28:29.389942 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-d3107792-6eae-480a-8e5b-91526392ab3b tempest-AttachVolumeTestJSON-1651611701 tempest-AttachVolumeTestJSON-1651611701-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:28:29.391017 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-d3107792-6eae-480a-8e5b-91526392ab3b tempest-AttachVolumeTestJSON-1651611701 tempest-AttachVolumeTestJSON-1651611701-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:28:29.391519 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-d3107792-6eae-480a-8e5b-91526392ab3b tempest-AttachVolumeTestJSON-1651611701 tempest-AttachVolumeTestJSON-1651611701-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:28:29.417994 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-d3107792-6eae-480a-8e5b-91526392ab3b tempest-AttachVolumeTestJSON-1651611701 tempest-AttachVolumeTestJSON-1651611701-project] 10.222.0.11 "GET /compute/v2.1/servers/5e11ea9c-f66a-4962-b5ca-b95784624824/ips" status: 200 len: 146 microversion: 2.1 time: 0.041754 Nov 17 03:28:29.435980 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 350/733] 10.222.0.11 () {58 vars in 1247 bytes} [Wed Nov 17 03:28:29 2021] GET /compute/v2.1/servers/5e11ea9c-f66a-4962-b5ca-b95784624824/ips => generated 146 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 17 03:28:29.471351 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-38e162ad-d793-4112-b105-fd170b33f972 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:28:29.472816 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-38e162ad-d793-4112-b105-fd170b33f972 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] [instance: 0698dc5b-5f47-46c4-ace8-f5e891a964a0] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:28:29.479466 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-f95eb3ef-373c-4105-b347-c399006d0efc tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37f21d6d15cf40a586edda211219fd08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ebb970305844dccacf48a7d8d47ecf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:28:29.481857 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-38e162ad-d793-4112-b105-fd170b33f972 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:28:29.482309 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-38e162ad-d793-4112-b105-fd170b33f972 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:28:29.483212 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-38e162ad-d793-4112-b105-fd170b33f972 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:28:29.483641 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-38e162ad-d793-4112-b105-fd170b33f972 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:28:29.491407 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-f95eb3ef-373c-4105-b347-c399006d0efc tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '37f21d6d15cf40a586edda211219fd08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ebb970305844dccacf48a7d8d47ecf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:28:29.492927 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-f95eb3ef-373c-4105-b347-c399006d0efc tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '37f21d6d15cf40a586edda211219fd08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ebb970305844dccacf48a7d8d47ecf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:28:29.494097 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-f95eb3ef-373c-4105-b347-c399006d0efc tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] 10.222.0.11 "GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7" status: 200 len: 1810 microversion: 2.20 time: 0.181462 Nov 17 03:28:29.494726 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 384/734] 10.222.0.11 () {60 vars in 1276 bytes} [Wed Nov 17 03:28:29 2021] GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7 => generated 1810 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 17 03:28:29.638417 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-665e693b-7e75-4212-8a1a-bb6d942f5def tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:28:29.639052 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-665e693b-7e75-4212-8a1a-bb6d942f5def tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] [instance: a49437df-3059-4528-8328-2f3471d5fb45] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:28:29.645626 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-665e693b-7e75-4212-8a1a-bb6d942f5def tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:28:29.646084 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-665e693b-7e75-4212-8a1a-bb6d942f5def tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:28:29.646869 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-665e693b-7e75-4212-8a1a-bb6d942f5def tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:28:29.647309 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-665e693b-7e75-4212-8a1a-bb6d942f5def tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:28:29.717956 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-38e162ad-d793-4112-b105-fd170b33f972 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '163b2f24a72649ac8084be1cac32fa09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e123e9b86124c93a7fc2db9984e7466', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:28:29.731779 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-38e162ad-d793-4112-b105-fd170b33f972 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] 10.222.0.11 "GET /compute/v2.1/servers/0698dc5b-5f47-46c4-ace8-f5e891a964a0" status: 200 len: 1269 microversion: 2.1 time: 0.264119 Nov 17 03:28:29.738401 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 351/735] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:28:29 2021] GET /compute/v2.1/servers/0698dc5b-5f47-46c4-ace8-f5e891a964a0 => generated 1269 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 17 03:28:29.786371 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-665e693b-7e75-4212-8a1a-bb6d942f5def tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f046401c6a04f6495ebe0821120bd72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a58e89ceeea4a9c8a72a1de4bcaf2d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:28:29.794727 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-665e693b-7e75-4212-8a1a-bb6d942f5def tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] 10.222.0.11 "GET /compute/v2.1/servers/a49437df-3059-4528-8328-2f3471d5fb45" status: 200 len: 1566 microversion: 2.1 time: 0.159905 Nov 17 03:28:29.795521 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 385/736] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:28:29 2021] GET /compute/v2.1/servers/a49437df-3059-4528-8328-2f3471d5fb45 => generated 1566 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 17 03:28:29.925019 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [req-5b080365-7d8e-487d-9985-5c051d9bb947 req-fca373d5-98a6-498e-bd7e-767a1edb6542 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0698dc5b-5f47-46c4-ace8-f5e891a964a0", "tag": "ade336c1-073e-4cb9-90d9-0e1652a810a1"}]} {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 17 03:28:29.926974 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 17 03:28:29.926974 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: warnings.warn(msg) Nov 17 03:28:29.935178 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [req-5b080365-7d8e-487d-9985-5c051d9bb947 req-fca373d5-98a6-498e-bd7e-767a1edb6542 service nova] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:28:29.935721 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [req-5b080365-7d8e-487d-9985-5c051d9bb947 req-fca373d5-98a6-498e-bd7e-767a1edb6542 service nova] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:28:29.947847 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.compute.server_external_events [req-5b080365-7d8e-487d-9985-5c051d9bb947 req-fca373d5-98a6-498e-bd7e-767a1edb6542 service nova] Creating event network-changed:ade336c1-073e-4cb9-90d9-0e1652a810a1 for instance 0698dc5b-5f47-46c4-ace8-f5e891a964a0 on hv-cinder-81803 Nov 17 03:28:29.953620 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [req-5b080365-7d8e-487d-9985-5c051d9bb947 req-fca373d5-98a6-498e-bd7e-767a1edb6542 service nova] 10.222.0.11 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032551 Nov 17 03:28:29.954273 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 352/737] 10.222.0.11 () {64 vars in 1317 bytes} [Wed Nov 17 03:28:29 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 17 03:28:30.048691 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-b858789c-ee30-4146-a049-d59b09533925 tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:28:30.050189 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-b858789c-ee30-4146-a049-d59b09533925 tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] [instance: 645ba67f-2582-4a60-b013-84777a71a70d] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:28:30.063224 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-b858789c-ee30-4146-a049-d59b09533925 tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:28:30.063675 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-b858789c-ee30-4146-a049-d59b09533925 tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:28:30.064551 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-b858789c-ee30-4146-a049-d59b09533925 tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:28:30.065307 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-b858789c-ee30-4146-a049-d59b09533925 tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:28:30.207983 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-b858789c-ee30-4146-a049-d59b09533925 tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d4e8ac9538f42c9b637bd9e086668b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfc480343d4d493bb4295b055e274df5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:28:30.215567 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-b858789c-ee30-4146-a049-d59b09533925 tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] 10.222.0.11 "GET /compute/v2.1/servers/645ba67f-2582-4a60-b013-84777a71a70d" status: 200 len: 1511 microversion: 2.1 time: 0.170514 Nov 17 03:28:30.216226 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 386/738] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:28:30 2021] GET /compute/v2.1/servers/645ba67f-2582-4a60-b013-84777a71a70d => generated 1511 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:28:30.513758 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-7bc2ba98-866a-4045-816c-0567ae408237 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:28:30.514473 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-7bc2ba98-866a-4045-816c-0567ae408237 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] [instance: 5d54db85-b991-4890-abaa-952413baa2e7] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:28:30.520692 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-7bc2ba98-866a-4045-816c-0567ae408237 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:28:30.521184 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-7bc2ba98-866a-4045-816c-0567ae408237 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:28:30.521954 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-7bc2ba98-866a-4045-816c-0567ae408237 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:28:30.522391 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-7bc2ba98-866a-4045-816c-0567ae408237 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:28:30.749035 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-6ee1a237-6b64-466d-8530-b16b0eea5492 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:28:30.750273 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-6ee1a237-6b64-466d-8530-b16b0eea5492 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] [instance: 0698dc5b-5f47-46c4-ace8-f5e891a964a0] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:28:30.756482 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-6ee1a237-6b64-466d-8530-b16b0eea5492 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:28:30.756976 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-6ee1a237-6b64-466d-8530-b16b0eea5492 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:28:30.757769 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-6ee1a237-6b64-466d-8530-b16b0eea5492 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:28:30.758210 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-6ee1a237-6b64-466d-8530-b16b0eea5492 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:28:30.767985 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-7bc2ba98-866a-4045-816c-0567ae408237 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37f21d6d15cf40a586edda211219fd08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ebb970305844dccacf48a7d8d47ecf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:28:30.776936 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-7bc2ba98-866a-4045-816c-0567ae408237 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '37f21d6d15cf40a586edda211219fd08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ebb970305844dccacf48a7d8d47ecf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:28:30.778467 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-7bc2ba98-866a-4045-816c-0567ae408237 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '37f21d6d15cf40a586edda211219fd08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ebb970305844dccacf48a7d8d47ecf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:28:30.779704 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-7bc2ba98-866a-4045-816c-0567ae408237 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] 10.222.0.11 "GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7" status: 200 len: 1810 microversion: 2.20 time: 0.270531 Nov 17 03:28:30.790834 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 353/739] 10.222.0.11 () {60 vars in 1276 bytes} [Wed Nov 17 03:28:30 2021] GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7 => generated 1810 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 17 03:28:30.814414 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-dc9e65b7-5999-4241-8f80-5864db36ce3e tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:28:30.819702 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-dc9e65b7-5999-4241-8f80-5864db36ce3e tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] [instance: a49437df-3059-4528-8328-2f3471d5fb45] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:28:30.834417 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-dc9e65b7-5999-4241-8f80-5864db36ce3e tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:28:30.834949 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-dc9e65b7-5999-4241-8f80-5864db36ce3e tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:28:30.839531 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-dc9e65b7-5999-4241-8f80-5864db36ce3e tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:28:30.839986 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-dc9e65b7-5999-4241-8f80-5864db36ce3e tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:28:30.914853 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-6ee1a237-6b64-466d-8530-b16b0eea5492 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '163b2f24a72649ac8084be1cac32fa09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e123e9b86124c93a7fc2db9984e7466', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:28:30.924765 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-6ee1a237-6b64-466d-8530-b16b0eea5492 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] 10.222.0.11 "GET /compute/v2.1/servers/0698dc5b-5f47-46c4-ace8-f5e891a964a0" status: 200 len: 1269 microversion: 2.1 time: 0.179691 Nov 17 03:28:30.925824 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 387/740] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:28:30 2021] GET /compute/v2.1/servers/0698dc5b-5f47-46c4-ace8-f5e891a964a0 => generated 1269 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:28:31.172129 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-dc9e65b7-5999-4241-8f80-5864db36ce3e tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f046401c6a04f6495ebe0821120bd72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a58e89ceeea4a9c8a72a1de4bcaf2d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:28:31.193756 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-dc9e65b7-5999-4241-8f80-5864db36ce3e tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] 10.222.0.11 "GET /compute/v2.1/servers/a49437df-3059-4528-8328-2f3471d5fb45" status: 200 len: 1566 microversion: 2.1 time: 0.385673 Nov 17 03:28:31.195187 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 354/741] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:28:30 2021] GET /compute/v2.1/servers/a49437df-3059-4528-8328-2f3471d5fb45 => generated 1566 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:28:31.234057 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-fba5f1b7-0c3d-4526-b9b6-e933f8308f3f tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:28:31.235350 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-fba5f1b7-0c3d-4526-b9b6-e933f8308f3f tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] [instance: 645ba67f-2582-4a60-b013-84777a71a70d] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:28:31.249911 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-fba5f1b7-0c3d-4526-b9b6-e933f8308f3f tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:28:31.250623 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-fba5f1b7-0c3d-4526-b9b6-e933f8308f3f tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:28:31.251610 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-fba5f1b7-0c3d-4526-b9b6-e933f8308f3f tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:28:31.252230 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-fba5f1b7-0c3d-4526-b9b6-e933f8308f3f tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:28:31.409996 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-fba5f1b7-0c3d-4526-b9b6-e933f8308f3f tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d4e8ac9538f42c9b637bd9e086668b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfc480343d4d493bb4295b055e274df5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:28:31.418548 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-fba5f1b7-0c3d-4526-b9b6-e933f8308f3f tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] 10.222.0.11 "GET /compute/v2.1/servers/645ba67f-2582-4a60-b013-84777a71a70d" status: 200 len: 1511 microversion: 2.1 time: 0.188190 Nov 17 03:28:31.425529 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 388/742] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:28:31 2021] GET /compute/v2.1/servers/645ba67f-2582-4a60-b013-84777a71a70d => generated 1511 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:28:31.798194 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-4b7e7847-9982-4412-afd4-9238bf4dde45 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:28:31.798800 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-4b7e7847-9982-4412-afd4-9238bf4dde45 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] [instance: 5d54db85-b991-4890-abaa-952413baa2e7] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:28:31.805586 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-4b7e7847-9982-4412-afd4-9238bf4dde45 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:28:31.806004 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-4b7e7847-9982-4412-afd4-9238bf4dde45 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:28:31.807502 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-4b7e7847-9982-4412-afd4-9238bf4dde45 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:28:31.807979 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-4b7e7847-9982-4412-afd4-9238bf4dde45 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:28:31.942713 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-ad04c5d3-5a3e-4f7a-b8df-cced2e50bb9e tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:28:31.943356 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-ad04c5d3-5a3e-4f7a-b8df-cced2e50bb9e tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] [instance: 0698dc5b-5f47-46c4-ace8-f5e891a964a0] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:28:31.949506 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-ad04c5d3-5a3e-4f7a-b8df-cced2e50bb9e tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:28:31.949963 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-ad04c5d3-5a3e-4f7a-b8df-cced2e50bb9e tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:28:31.950746 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-ad04c5d3-5a3e-4f7a-b8df-cced2e50bb9e tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:28:31.951173 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-ad04c5d3-5a3e-4f7a-b8df-cced2e50bb9e tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:28:32.000972 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-4b7e7847-9982-4412-afd4-9238bf4dde45 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37f21d6d15cf40a586edda211219fd08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ebb970305844dccacf48a7d8d47ecf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:28:32.011035 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-4b7e7847-9982-4412-afd4-9238bf4dde45 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '37f21d6d15cf40a586edda211219fd08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ebb970305844dccacf48a7d8d47ecf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:28:32.012605 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-4b7e7847-9982-4412-afd4-9238bf4dde45 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '37f21d6d15cf40a586edda211219fd08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ebb970305844dccacf48a7d8d47ecf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:28:32.014747 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-4b7e7847-9982-4412-afd4-9238bf4dde45 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] 10.222.0.11 "GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7" status: 200 len: 1810 microversion: 2.20 time: 0.220303 Nov 17 03:28:32.015340 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 355/743] 10.222.0.11 () {60 vars in 1276 bytes} [Wed Nov 17 03:28:31 2021] GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7 => generated 1810 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 17 03:28:32.019789 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [req-7ac6ba5d-52cc-4b8c-878b-93b7d3d867bf req-6941df95-f017-4c89-8450-141803325a9d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "645ba67f-2582-4a60-b013-84777a71a70d", "name": "network-vif-deleted", "tag": "0ebffcbf-ae21-4111-bfbb-365005048a48"}]} {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 17 03:28:32.021355 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 17 03:28:32.021355 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: warnings.warn(msg) Nov 17 03:28:32.028491 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [req-7ac6ba5d-52cc-4b8c-878b-93b7d3d867bf req-6941df95-f017-4c89-8450-141803325a9d service nova] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:28:32.028966 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [req-7ac6ba5d-52cc-4b8c-878b-93b7d3d867bf req-6941df95-f017-4c89-8450-141803325a9d service nova] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:28:32.039954 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.compute.server_external_events [req-7ac6ba5d-52cc-4b8c-878b-93b7d3d867bf req-6941df95-f017-4c89-8450-141803325a9d service nova] Creating event network-vif-deleted:0ebffcbf-ae21-4111-bfbb-365005048a48 for instance 645ba67f-2582-4a60-b013-84777a71a70d on hv-cinder-81803 Nov 17 03:28:32.044922 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [req-7ac6ba5d-52cc-4b8c-878b-93b7d3d867bf req-6941df95-f017-4c89-8450-141803325a9d service nova] 10.222.0.11 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028450 Nov 17 03:28:32.045726 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 356/744] 10.222.0.11 () {64 vars in 1317 bytes} [Wed Nov 17 03:28:32 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 17 03:28:32.093640 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-ad04c5d3-5a3e-4f7a-b8df-cced2e50bb9e tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '163b2f24a72649ac8084be1cac32fa09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e123e9b86124c93a7fc2db9984e7466', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:28:32.101065 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-ad04c5d3-5a3e-4f7a-b8df-cced2e50bb9e tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] 10.222.0.11 "GET /compute/v2.1/servers/0698dc5b-5f47-46c4-ace8-f5e891a964a0" status: 200 len: 1269 microversion: 2.1 time: 0.162046 Nov 17 03:28:32.101642 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 389/745] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:28:31 2021] GET /compute/v2.1/servers/0698dc5b-5f47-46c4-ace8-f5e891a964a0 => generated 1269 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 17 03:28:32.215133 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-5e914b5d-217f-4a78-bf9d-dce34c0433a1 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:28:32.216175 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-5e914b5d-217f-4a78-bf9d-dce34c0433a1 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] [instance: a49437df-3059-4528-8328-2f3471d5fb45] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:28:32.223161 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-5e914b5d-217f-4a78-bf9d-dce34c0433a1 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:28:32.223942 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-5e914b5d-217f-4a78-bf9d-dce34c0433a1 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:28:32.224451 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-5e914b5d-217f-4a78-bf9d-dce34c0433a1 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:28:32.224918 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-5e914b5d-217f-4a78-bf9d-dce34c0433a1 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:28:32.253244 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-3c853d97-f05a-4c97-a791-374bfc9bf72a tempest-AttachVolumeTestJSON-1651611701 tempest-AttachVolumeTestJSON-1651611701-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "d1892da5-326d-4d4a-ada9-7eea75f81777"}} {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 17 03:28:32.254351 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-3c853d97-f05a-4c97-a791-374bfc9bf72a tempest-AttachVolumeTestJSON-1651611701 tempest-AttachVolumeTestJSON-1651611701-project] [instance: 5e11ea9c-f66a-4962-b5ca-b95784624824] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:28:32.261004 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-3c853d97-f05a-4c97-a791-374bfc9bf72a tempest-AttachVolumeTestJSON-1651611701 tempest-AttachVolumeTestJSON-1651611701-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:28:32.261474 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-3c853d97-f05a-4c97-a791-374bfc9bf72a tempest-AttachVolumeTestJSON-1651611701 tempest-AttachVolumeTestJSON-1651611701-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:28:32.262244 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-3c853d97-f05a-4c97-a791-374bfc9bf72a tempest-AttachVolumeTestJSON-1651611701 tempest-AttachVolumeTestJSON-1651611701-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:28:32.262669 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-3c853d97-f05a-4c97-a791-374bfc9bf72a tempest-AttachVolumeTestJSON-1651611701 tempest-AttachVolumeTestJSON-1651611701-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:28:32.360150 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-5e914b5d-217f-4a78-bf9d-dce34c0433a1 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f046401c6a04f6495ebe0821120bd72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a58e89ceeea4a9c8a72a1de4bcaf2d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:28:32.368478 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-5e914b5d-217f-4a78-bf9d-dce34c0433a1 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] 10.222.0.11 "GET /compute/v2.1/servers/a49437df-3059-4528-8328-2f3471d5fb45" status: 200 len: 1566 microversion: 2.1 time: 0.159483 Nov 17 03:28:32.369071 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 357/746] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:28:32 2021] GET /compute/v2.1/servers/a49437df-3059-4528-8328-2f3471d5fb45 => generated 1566 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:28:32.440642 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-d2e0ed56-97d7-40ec-947a-185754a63992 tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:28:32.441763 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-d2e0ed56-97d7-40ec-947a-185754a63992 tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] [instance: 645ba67f-2582-4a60-b013-84777a71a70d] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:28:32.451921 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-d2e0ed56-97d7-40ec-947a-185754a63992 tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:28:32.452537 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-d2e0ed56-97d7-40ec-947a-185754a63992 tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:28:32.453212 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-d2e0ed56-97d7-40ec-947a-185754a63992 tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:28:32.453664 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-d2e0ed56-97d7-40ec-947a-185754a63992 tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:28:32.484918 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-d2e0ed56-97d7-40ec-947a-185754a63992 tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:28:32.485361 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-d2e0ed56-97d7-40ec-947a-185754a63992 tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:28:32.485810 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.objects.instance [None req-d2e0ed56-97d7-40ec-947a-185754a63992 tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] Lazy-loading 'fault' on Instance uuid 645ba67f-2582-4a60-b013-84777a71a70d {{(pid=115917) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Nov 17 03:28:32.527806 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-d2e0ed56-97d7-40ec-947a-185754a63992 tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d4e8ac9538f42c9b637bd9e086668b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfc480343d4d493bb4295b055e274df5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:28:32.535405 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-d2e0ed56-97d7-40ec-947a-185754a63992 tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] 10.222.0.11 "GET /compute/v2.1/servers/645ba67f-2582-4a60-b013-84777a71a70d" status: 200 len: 1308 microversion: 2.1 time: 0.101086 Nov 17 03:28:32.535980 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 358/747] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:28:32 2021] GET /compute/v2.1/servers/645ba67f-2582-4a60-b013-84777a71a70d => generated 1308 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 17 03:28:33.035094 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-2fe16dad-948b-46f9-bbdb-5da3ca41ef1b tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:28:33.035908 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-2fe16dad-948b-46f9-bbdb-5da3ca41ef1b tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] [instance: 5d54db85-b991-4890-abaa-952413baa2e7] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:28:33.044032 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-2fe16dad-948b-46f9-bbdb-5da3ca41ef1b tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:28:33.044585 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-2fe16dad-948b-46f9-bbdb-5da3ca41ef1b tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:28:33.045880 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-2fe16dad-948b-46f9-bbdb-5da3ca41ef1b tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:28:33.046424 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-2fe16dad-948b-46f9-bbdb-5da3ca41ef1b tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:28:33.195482 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-2fe16dad-948b-46f9-bbdb-5da3ca41ef1b tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37f21d6d15cf40a586edda211219fd08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ebb970305844dccacf48a7d8d47ecf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:28:33.204669 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-2fe16dad-948b-46f9-bbdb-5da3ca41ef1b tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '37f21d6d15cf40a586edda211219fd08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ebb970305844dccacf48a7d8d47ecf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:28:33.206177 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-2fe16dad-948b-46f9-bbdb-5da3ca41ef1b tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '37f21d6d15cf40a586edda211219fd08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ebb970305844dccacf48a7d8d47ecf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:28:33.207327 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-2fe16dad-948b-46f9-bbdb-5da3ca41ef1b tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] 10.222.0.11 "GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7" status: 200 len: 1810 microversion: 2.20 time: 0.177185 Nov 17 03:28:33.207891 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 359/748] 10.222.0.11 () {60 vars in 1276 bytes} [Wed Nov 17 03:28:33 2021] GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7 => generated 1810 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 17 03:28:33.212032 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-f9571530-666f-4e01-808b-f949711eef9d tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:28:33.212625 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-f9571530-666f-4e01-808b-f949711eef9d tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] [instance: 0698dc5b-5f47-46c4-ace8-f5e891a964a0] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:28:33.218622 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-f9571530-666f-4e01-808b-f949711eef9d tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:28:33.219106 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-f9571530-666f-4e01-808b-f949711eef9d tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:28:33.219885 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-f9571530-666f-4e01-808b-f949711eef9d tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:28:33.220322 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-f9571530-666f-4e01-808b-f949711eef9d tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:28:33.355050 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-f9571530-666f-4e01-808b-f949711eef9d tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '163b2f24a72649ac8084be1cac32fa09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e123e9b86124c93a7fc2db9984e7466', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:28:33.362537 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-f9571530-666f-4e01-808b-f949711eef9d tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] 10.222.0.11 "GET /compute/v2.1/servers/0698dc5b-5f47-46c4-ace8-f5e891a964a0" status: 200 len: 1269 microversion: 2.1 time: 0.153702 Nov 17 03:28:33.363085 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 360/749] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:28:33 2021] GET /compute/v2.1/servers/0698dc5b-5f47-46c4-ace8-f5e891a964a0 => generated 1269 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:28:33.388160 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-1078ba27-856c-4b1d-badb-68c823d21916 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:28:33.389157 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-1078ba27-856c-4b1d-badb-68c823d21916 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] [instance: a49437df-3059-4528-8328-2f3471d5fb45] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:28:33.395074 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-1078ba27-856c-4b1d-badb-68c823d21916 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:28:33.395517 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-1078ba27-856c-4b1d-badb-68c823d21916 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:28:33.396276 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-1078ba27-856c-4b1d-badb-68c823d21916 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:28:33.396702 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-1078ba27-856c-4b1d-badb-68c823d21916 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:28:33.527902 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-1078ba27-856c-4b1d-badb-68c823d21916 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f046401c6a04f6495ebe0821120bd72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a58e89ceeea4a9c8a72a1de4bcaf2d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:28:33.536460 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-1078ba27-856c-4b1d-badb-68c823d21916 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] 10.222.0.11 "GET /compute/v2.1/servers/a49437df-3059-4528-8328-2f3471d5fb45" status: 200 len: 1566 microversion: 2.1 time: 0.153973 Nov 17 03:28:33.537088 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 361/750] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:28:33 2021] GET /compute/v2.1/servers/a49437df-3059-4528-8328-2f3471d5fb45 => generated 1566 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:28:33.552391 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-a57e04b4-67d9-4c85-b70f-43e5ab66251f tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:28:33.553046 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-a57e04b4-67d9-4c85-b70f-43e5ab66251f tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] [instance: 645ba67f-2582-4a60-b013-84777a71a70d] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:28:33.559755 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-a57e04b4-67d9-4c85-b70f-43e5ab66251f tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:28:33.560210 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-a57e04b4-67d9-4c85-b70f-43e5ab66251f tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:28:33.561095 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-a57e04b4-67d9-4c85-b70f-43e5ab66251f tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:28:33.561536 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-a57e04b4-67d9-4c85-b70f-43e5ab66251f tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:28:33.591810 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-a57e04b4-67d9-4c85-b70f-43e5ab66251f tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:28:33.592458 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-a57e04b4-67d9-4c85-b70f-43e5ab66251f tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:28:33.592953 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.objects.instance [None req-a57e04b4-67d9-4c85-b70f-43e5ab66251f tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] Lazy-loading 'fault' on Instance uuid 645ba67f-2582-4a60-b013-84777a71a70d {{(pid=115917) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Nov 17 03:28:33.641480 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-a57e04b4-67d9-4c85-b70f-43e5ab66251f tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d4e8ac9538f42c9b637bd9e086668b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfc480343d4d493bb4295b055e274df5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:28:33.649322 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-a57e04b4-67d9-4c85-b70f-43e5ab66251f tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] 10.222.0.11 "GET /compute/v2.1/servers/645ba67f-2582-4a60-b013-84777a71a70d" status: 200 len: 1308 microversion: 2.1 time: 0.100441 Nov 17 03:28:33.649890 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 362/751] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:28:33 2021] GET /compute/v2.1/servers/645ba67f-2582-4a60-b013-84777a71a70d => generated 1308 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:28:34.229621 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-6c1325cf-5a57-481f-8dbf-a6fa9a5128fa tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:28:34.230642 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-6c1325cf-5a57-481f-8dbf-a6fa9a5128fa tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] [instance: 5d54db85-b991-4890-abaa-952413baa2e7] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:28:34.241275 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-6c1325cf-5a57-481f-8dbf-a6fa9a5128fa tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:28:34.242027 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-6c1325cf-5a57-481f-8dbf-a6fa9a5128fa tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:28:34.243323 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-6c1325cf-5a57-481f-8dbf-a6fa9a5128fa tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:28:34.244043 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-6c1325cf-5a57-481f-8dbf-a6fa9a5128fa tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:28:34.383774 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-6c1325cf-5a57-481f-8dbf-a6fa9a5128fa tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37f21d6d15cf40a586edda211219fd08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ebb970305844dccacf48a7d8d47ecf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:28:34.392992 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-6c1325cf-5a57-481f-8dbf-a6fa9a5128fa tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '37f21d6d15cf40a586edda211219fd08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ebb970305844dccacf48a7d8d47ecf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:28:34.394468 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-6c1325cf-5a57-481f-8dbf-a6fa9a5128fa tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '37f21d6d15cf40a586edda211219fd08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ebb970305844dccacf48a7d8d47ecf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:28:34.395618 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-6c1325cf-5a57-481f-8dbf-a6fa9a5128fa tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] 10.222.0.11 "GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7" status: 200 len: 1810 microversion: 2.20 time: 0.172364 Nov 17 03:28:34.406540 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 363/752] 10.222.0.11 () {60 vars in 1276 bytes} [Wed Nov 17 03:28:34 2021] GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7 => generated 1810 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 17 03:28:34.406540 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-ebb8691c-7cbd-4915-9c90-6f37beddcaf4 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:28:34.406540 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-ebb8691c-7cbd-4915-9c90-6f37beddcaf4 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] [instance: 0698dc5b-5f47-46c4-ace8-f5e891a964a0] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:28:34.406904 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-ebb8691c-7cbd-4915-9c90-6f37beddcaf4 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:28:34.407251 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-ebb8691c-7cbd-4915-9c90-6f37beddcaf4 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:28:34.408011 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-ebb8691c-7cbd-4915-9c90-6f37beddcaf4 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:28:34.408436 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-ebb8691c-7cbd-4915-9c90-6f37beddcaf4 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:28:34.550706 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-ebb8691c-7cbd-4915-9c90-6f37beddcaf4 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '163b2f24a72649ac8084be1cac32fa09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e123e9b86124c93a7fc2db9984e7466', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:28:34.558555 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-ebb8691c-7cbd-4915-9c90-6f37beddcaf4 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] 10.222.0.11 "GET /compute/v2.1/servers/0698dc5b-5f47-46c4-ace8-f5e891a964a0" status: 200 len: 1269 microversion: 2.1 time: 0.161341 Nov 17 03:28:34.559115 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 364/753] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:28:34 2021] GET /compute/v2.1/servers/0698dc5b-5f47-46c4-ace8-f5e891a964a0 => generated 1269 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:28:34.563665 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-77e6c33f-3122-4f0d-94d0-3bb11b6744a5 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:28:34.564255 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-77e6c33f-3122-4f0d-94d0-3bb11b6744a5 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] [instance: a49437df-3059-4528-8328-2f3471d5fb45] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:28:34.570332 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-77e6c33f-3122-4f0d-94d0-3bb11b6744a5 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:28:34.570784 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-77e6c33f-3122-4f0d-94d0-3bb11b6744a5 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:28:34.571562 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-77e6c33f-3122-4f0d-94d0-3bb11b6744a5 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:28:34.571986 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-77e6c33f-3122-4f0d-94d0-3bb11b6744a5 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:28:34.702036 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-77e6c33f-3122-4f0d-94d0-3bb11b6744a5 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f046401c6a04f6495ebe0821120bd72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a58e89ceeea4a9c8a72a1de4bcaf2d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:28:34.709934 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-77e6c33f-3122-4f0d-94d0-3bb11b6744a5 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] 10.222.0.11 "GET /compute/v2.1/servers/a49437df-3059-4528-8328-2f3471d5fb45" status: 200 len: 1566 microversion: 2.1 time: 0.149880 Nov 17 03:28:34.710541 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 365/754] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:28:34 2021] GET /compute/v2.1/servers/a49437df-3059-4528-8328-2f3471d5fb45 => generated 1566 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:28:34.714661 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-fb1df5fa-91cd-4b58-ae20-e03bf31a3c52 tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:28:34.715286 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-fb1df5fa-91cd-4b58-ae20-e03bf31a3c52 tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] [instance: 645ba67f-2582-4a60-b013-84777a71a70d] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:28:34.721319 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-fb1df5fa-91cd-4b58-ae20-e03bf31a3c52 tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:28:34.721767 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-fb1df5fa-91cd-4b58-ae20-e03bf31a3c52 tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:28:34.722548 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-fb1df5fa-91cd-4b58-ae20-e03bf31a3c52 tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:28:34.722980 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-fb1df5fa-91cd-4b58-ae20-e03bf31a3c52 tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:28:34.756010 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-fb1df5fa-91cd-4b58-ae20-e03bf31a3c52 tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:28:34.756446 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-fb1df5fa-91cd-4b58-ae20-e03bf31a3c52 tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:28:34.756922 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.objects.instance [None req-fb1df5fa-91cd-4b58-ae20-e03bf31a3c52 tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] Lazy-loading 'fault' on Instance uuid 645ba67f-2582-4a60-b013-84777a71a70d {{(pid=115917) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Nov 17 03:28:34.805594 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-fb1df5fa-91cd-4b58-ae20-e03bf31a3c52 tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d4e8ac9538f42c9b637bd9e086668b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfc480343d4d493bb4295b055e274df5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:28:34.814195 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-fb1df5fa-91cd-4b58-ae20-e03bf31a3c52 tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] 10.222.0.11 "GET /compute/v2.1/servers/645ba67f-2582-4a60-b013-84777a71a70d" status: 200 len: 1308 microversion: 2.1 time: 0.102746 Nov 17 03:28:34.814773 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 366/755] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:28:34 2021] GET /compute/v2.1/servers/645ba67f-2582-4a60-b013-84777a71a70d => generated 1308 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:28:35.414285 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-4fd87c32-fa12-4b18-ae04-699f583bafed tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:28:35.414878 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-4fd87c32-fa12-4b18-ae04-699f583bafed tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] [instance: 5d54db85-b991-4890-abaa-952413baa2e7] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:28:35.421908 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-4fd87c32-fa12-4b18-ae04-699f583bafed tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:28:35.422357 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-4fd87c32-fa12-4b18-ae04-699f583bafed tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:28:35.423141 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-4fd87c32-fa12-4b18-ae04-699f583bafed tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:28:35.423578 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-4fd87c32-fa12-4b18-ae04-699f583bafed tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:28:35.492478 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-3c853d97-f05a-4c97-a791-374bfc9bf72a tempest-AttachVolumeTestJSON-1651611701 tempest-AttachVolumeTestJSON-1651611701-project] 10.222.0.11 "POST /compute/v2.1/servers/5e11ea9c-f66a-4962-b5ca-b95784624824/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 3.242950 Nov 17 03:28:35.493693 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 390/756] 10.222.0.11 () {60 vars in 1322 bytes} [Wed Nov 17 03:28:32 2021] POST /compute/v2.1/servers/5e11ea9c-f66a-4962-b5ca-b95784624824/os-volume_attachments => generated 194 bytes in 3245 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 17 03:28:35.568284 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-4fd87c32-fa12-4b18-ae04-699f583bafed tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37f21d6d15cf40a586edda211219fd08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ebb970305844dccacf48a7d8d47ecf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:28:35.578851 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-8f5b9eef-71cf-4450-aed7-51f547606eff tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:28:35.579124 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-4fd87c32-fa12-4b18-ae04-699f583bafed tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '37f21d6d15cf40a586edda211219fd08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ebb970305844dccacf48a7d8d47ecf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:28:35.579564 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-8f5b9eef-71cf-4450-aed7-51f547606eff tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] [instance: 0698dc5b-5f47-46c4-ace8-f5e891a964a0] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:28:35.580397 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-4fd87c32-fa12-4b18-ae04-699f583bafed tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '37f21d6d15cf40a586edda211219fd08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ebb970305844dccacf48a7d8d47ecf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:28:35.581787 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-4fd87c32-fa12-4b18-ae04-699f583bafed tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] 10.222.0.11 "GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7" status: 200 len: 1810 microversion: 2.20 time: 0.171230 Nov 17 03:28:35.582487 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 367/757] 10.222.0.11 () {60 vars in 1276 bytes} [Wed Nov 17 03:28:35 2021] GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7 => generated 1810 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 17 03:28:35.591504 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-8f5b9eef-71cf-4450-aed7-51f547606eff tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:28:35.592558 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-8f5b9eef-71cf-4450-aed7-51f547606eff tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:28:35.593747 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-8f5b9eef-71cf-4450-aed7-51f547606eff tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:28:35.594338 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-8f5b9eef-71cf-4450-aed7-51f547606eff tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:28:35.730265 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-fa445765-7ffd-4d7b-a159-cb1fae3d3400 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:28:35.731046 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-fa445765-7ffd-4d7b-a159-cb1fae3d3400 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] [instance: a49437df-3059-4528-8328-2f3471d5fb45] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:28:35.735641 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-8f5b9eef-71cf-4450-aed7-51f547606eff tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '163b2f24a72649ac8084be1cac32fa09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e123e9b86124c93a7fc2db9984e7466', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:28:35.738151 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-fa445765-7ffd-4d7b-a159-cb1fae3d3400 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:28:35.738886 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-fa445765-7ffd-4d7b-a159-cb1fae3d3400 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:28:35.739954 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-fa445765-7ffd-4d7b-a159-cb1fae3d3400 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:28:35.740393 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-fa445765-7ffd-4d7b-a159-cb1fae3d3400 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:28:35.743288 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-8f5b9eef-71cf-4450-aed7-51f547606eff tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] 10.222.0.11 "GET /compute/v2.1/servers/0698dc5b-5f47-46c4-ace8-f5e891a964a0" status: 200 len: 1257 microversion: 2.1 time: 0.171187 Nov 17 03:28:35.743867 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 391/758] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:28:35 2021] GET /compute/v2.1/servers/0698dc5b-5f47-46c4-ace8-f5e891a964a0 => generated 1257 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 17 03:28:35.830610 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-0a208103-aebb-4d36-9a4f-d16f7e5d19f5 tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:28:35.831301 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-0a208103-aebb-4d36-9a4f-d16f7e5d19f5 tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] [instance: 645ba67f-2582-4a60-b013-84777a71a70d] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:28:35.837200 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-0a208103-aebb-4d36-9a4f-d16f7e5d19f5 tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:28:35.837710 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-0a208103-aebb-4d36-9a4f-d16f7e5d19f5 tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:28:35.838545 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-0a208103-aebb-4d36-9a4f-d16f7e5d19f5 tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:28:35.839063 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-0a208103-aebb-4d36-9a4f-d16f7e5d19f5 tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:28:35.869297 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-0a208103-aebb-4d36-9a4f-d16f7e5d19f5 tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:28:35.869668 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-0a208103-aebb-4d36-9a4f-d16f7e5d19f5 tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:28:35.870139 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.objects.instance [None req-0a208103-aebb-4d36-9a4f-d16f7e5d19f5 tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] Lazy-loading 'fault' on Instance uuid 645ba67f-2582-4a60-b013-84777a71a70d {{(pid=115916) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Nov 17 03:28:35.871601 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-fa445765-7ffd-4d7b-a159-cb1fae3d3400 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f046401c6a04f6495ebe0821120bd72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a58e89ceeea4a9c8a72a1de4bcaf2d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:28:35.879823 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-fa445765-7ffd-4d7b-a159-cb1fae3d3400 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] 10.222.0.11 "GET /compute/v2.1/servers/a49437df-3059-4528-8328-2f3471d5fb45" status: 200 len: 1566 microversion: 2.1 time: 0.155848 Nov 17 03:28:35.880404 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 368/759] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:28:35 2021] GET /compute/v2.1/servers/a49437df-3059-4528-8328-2f3471d5fb45 => generated 1566 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:28:35.908941 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-0a208103-aebb-4d36-9a4f-d16f7e5d19f5 tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d4e8ac9538f42c9b637bd9e086668b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfc480343d4d493bb4295b055e274df5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:28:35.916534 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-0a208103-aebb-4d36-9a4f-d16f7e5d19f5 tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] 10.222.0.11 "GET /compute/v2.1/servers/645ba67f-2582-4a60-b013-84777a71a70d" status: 200 len: 1308 microversion: 2.1 time: 0.089601 Nov 17 03:28:35.917125 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 392/760] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:28:35 2021] GET /compute/v2.1/servers/645ba67f-2582-4a60-b013-84777a71a70d => generated 1308 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 17 03:28:36.599305 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-80d05aaf-1901-47a1-aaa4-d9b879825592 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:28:36.599936 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-80d05aaf-1901-47a1-aaa4-d9b879825592 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] [instance: 5d54db85-b991-4890-abaa-952413baa2e7] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:28:36.606688 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-80d05aaf-1901-47a1-aaa4-d9b879825592 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:28:36.607129 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-80d05aaf-1901-47a1-aaa4-d9b879825592 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:28:36.607889 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-80d05aaf-1901-47a1-aaa4-d9b879825592 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:28:36.608316 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-80d05aaf-1901-47a1-aaa4-d9b879825592 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:28:36.753235 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-80d05aaf-1901-47a1-aaa4-d9b879825592 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37f21d6d15cf40a586edda211219fd08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ebb970305844dccacf48a7d8d47ecf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:28:36.760855 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-fb14ab37-a179-4b6a-8fc7-285f83c4951d tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:28:36.761485 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-fb14ab37-a179-4b6a-8fc7-285f83c4951d tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] [instance: 0698dc5b-5f47-46c4-ace8-f5e891a964a0] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:28:36.761994 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-80d05aaf-1901-47a1-aaa4-d9b879825592 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '37f21d6d15cf40a586edda211219fd08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ebb970305844dccacf48a7d8d47ecf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:28:36.763481 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-80d05aaf-1901-47a1-aaa4-d9b879825592 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '37f21d6d15cf40a586edda211219fd08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ebb970305844dccacf48a7d8d47ecf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:28:36.765310 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-80d05aaf-1901-47a1-aaa4-d9b879825592 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] 10.222.0.11 "GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7" status: 200 len: 1810 microversion: 2.20 time: 0.169596 Nov 17 03:28:36.766008 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 369/761] 10.222.0.11 () {60 vars in 1276 bytes} [Wed Nov 17 03:28:36 2021] GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7 => generated 1810 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 17 03:28:36.767848 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-fb14ab37-a179-4b6a-8fc7-285f83c4951d tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:28:36.768292 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-fb14ab37-a179-4b6a-8fc7-285f83c4951d tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:28:36.769086 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-fb14ab37-a179-4b6a-8fc7-285f83c4951d tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:28:36.769521 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-fb14ab37-a179-4b6a-8fc7-285f83c4951d tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:28:36.898025 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-a56d147d-6006-4648-ae62-cbbd6c365976 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:28:36.898623 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-a56d147d-6006-4648-ae62-cbbd6c365976 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] [instance: a49437df-3059-4528-8328-2f3471d5fb45] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:28:36.905220 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-a56d147d-6006-4648-ae62-cbbd6c365976 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:28:36.905698 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-a56d147d-6006-4648-ae62-cbbd6c365976 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:28:36.906455 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-a56d147d-6006-4648-ae62-cbbd6c365976 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:28:36.906918 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-a56d147d-6006-4648-ae62-cbbd6c365976 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:28:36.908699 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-fb14ab37-a179-4b6a-8fc7-285f83c4951d tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '163b2f24a72649ac8084be1cac32fa09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e123e9b86124c93a7fc2db9984e7466', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:28:36.916167 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-fb14ab37-a179-4b6a-8fc7-285f83c4951d tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] 10.222.0.11 "GET /compute/v2.1/servers/0698dc5b-5f47-46c4-ace8-f5e891a964a0" status: 200 len: 1257 microversion: 2.1 time: 0.158931 Nov 17 03:28:36.916704 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 393/762] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:28:36 2021] GET /compute/v2.1/servers/0698dc5b-5f47-46c4-ace8-f5e891a964a0 => generated 1257 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:28:36.933480 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-cb7dcb9e-fd1a-41e4-8001-95db93b8b8f1 tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:28:36.934091 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-cb7dcb9e-fd1a-41e4-8001-95db93b8b8f1 tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] [instance: 645ba67f-2582-4a60-b013-84777a71a70d] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:28:36.940096 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-cb7dcb9e-fd1a-41e4-8001-95db93b8b8f1 tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:28:36.940542 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-cb7dcb9e-fd1a-41e4-8001-95db93b8b8f1 tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:28:36.941351 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-cb7dcb9e-fd1a-41e4-8001-95db93b8b8f1 tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:28:36.941781 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-cb7dcb9e-fd1a-41e4-8001-95db93b8b8f1 tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:28:36.955503 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.wsgi [None req-cb7dcb9e-fd1a-41e4-8001-95db93b8b8f1 tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] HTTP exception thrown: Instance 645ba67f-2582-4a60-b013-84777a71a70d could not be found. Nov 17 03:28:36.956097 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-cb7dcb9e-fd1a-41e4-8001-95db93b8b8f1 tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] Returning 404 to user: Instance 645ba67f-2582-4a60-b013-84777a71a70d could not be found. {{(pid=115916) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 17 03:28:36.956992 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-cb7dcb9e-fd1a-41e4-8001-95db93b8b8f1 tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] 10.222.0.11 "GET /compute/v2.1/servers/645ba67f-2582-4a60-b013-84777a71a70d" status: 404 len: 111 microversion: 2.1 time: 0.027443 Nov 17 03:28:36.957548 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 394/763] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:28:36 2021] GET /compute/v2.1/servers/645ba67f-2582-4a60-b013-84777a71a70d => generated 111 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 17 03:28:37.043281 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-a56d147d-6006-4648-ae62-cbbd6c365976 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f046401c6a04f6495ebe0821120bd72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a58e89ceeea4a9c8a72a1de4bcaf2d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:28:37.056993 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-a56d147d-6006-4648-ae62-cbbd6c365976 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] 10.222.0.11 "GET /compute/v2.1/servers/a49437df-3059-4528-8328-2f3471d5fb45" status: 200 len: 1546 microversion: 2.1 time: 0.161648 Nov 17 03:28:37.064170 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 370/764] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:28:36 2021] GET /compute/v2.1/servers/a49437df-3059-4528-8328-2f3471d5fb45 => generated 1546 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:28:37.073920 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-40b0714b-c058-453f-a0cf-a0962679378f tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:28:37.074417 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-40b0714b-c058-453f-a0cf-a0962679378f tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] [instance: a49437df-3059-4528-8328-2f3471d5fb45] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:28:37.080410 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-40b0714b-c058-453f-a0cf-a0962679378f tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:28:37.080897 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-40b0714b-c058-453f-a0cf-a0962679378f tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:28:37.081678 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-40b0714b-c058-453f-a0cf-a0962679378f tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:28:37.082113 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-40b0714b-c058-453f-a0cf-a0962679378f tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:28:37.163843 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.wsgi [None req-40b0714b-c058-453f-a0cf-a0962679378f tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] HTTP exception thrown: Cannot 'detach_volume' instance a49437df-3059-4528-8328-2f3471d5fb45 while it is in vm_state rescued Nov 17 03:28:37.164441 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-40b0714b-c058-453f-a0cf-a0962679378f tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Returning 409 to user: Cannot 'detach_volume' instance a49437df-3059-4528-8328-2f3471d5fb45 while it is in vm_state rescued {{(pid=115916) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 17 03:28:37.165315 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-40b0714b-c058-453f-a0cf-a0962679378f tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] 10.222.0.11 "DELETE /compute/v2.1/servers/a49437df-3059-4528-8328-2f3471d5fb45/os-volume_attachments/93480bc3-2042-416b-9af5-bd61259a2345" status: 409 len: 152 microversion: 2.1 time: 0.095506 Nov 17 03:28:37.165858 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 395/765] 10.222.0.11 () {58 vars in 1415 bytes} [Wed Nov 17 03:28:37 2021] DELETE /compute/v2.1/servers/a49437df-3059-4528-8328-2f3471d5fb45/os-volume_attachments/93480bc3-2042-416b-9af5-bd61259a2345 => generated 152 bytes in 97 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Nov 17 03:28:37.174324 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-ade9413a-f197-4391-8165-5d93c379490f tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 17 03:28:37.174850 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-ade9413a-f197-4391-8165-5d93c379490f tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] [instance: a49437df-3059-4528-8328-2f3471d5fb45] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:28:37.180717 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-ade9413a-f197-4391-8165-5d93c379490f tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:28:37.181184 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-ade9413a-f197-4391-8165-5d93c379490f tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:28:37.182316 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-ade9413a-f197-4391-8165-5d93c379490f tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:28:37.182730 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-ade9413a-f197-4391-8165-5d93c379490f tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:28:37.252662 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-ade9413a-f197-4391-8165-5d93c379490f tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] 10.222.0.11 "POST /compute/v2.1/servers/a49437df-3059-4528-8328-2f3471d5fb45/action" status: 202 len: 0 microversion: 2.1 time: 0.081960 Nov 17 03:28:37.253317 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 371/766] 10.222.0.11 () {60 vars in 1277 bytes} [Wed Nov 17 03:28:37 2021] POST /compute/v2.1/servers/a49437df-3059-4528-8328-2f3471d5fb45/action => generated 0 bytes in 83 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 17 03:28:37.261225 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-ac382af5-f8f3-4d57-8e33-96226f20925d tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:28:37.261832 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-ac382af5-f8f3-4d57-8e33-96226f20925d tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] [instance: a49437df-3059-4528-8328-2f3471d5fb45] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:28:37.268098 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-ac382af5-f8f3-4d57-8e33-96226f20925d tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:28:37.268473 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-ac382af5-f8f3-4d57-8e33-96226f20925d tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:28:37.269519 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-ac382af5-f8f3-4d57-8e33-96226f20925d tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:28:37.269958 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-ac382af5-f8f3-4d57-8e33-96226f20925d tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:28:37.402901 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-ac382af5-f8f3-4d57-8e33-96226f20925d tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f046401c6a04f6495ebe0821120bd72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a58e89ceeea4a9c8a72a1de4bcaf2d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:28:37.411094 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-ac382af5-f8f3-4d57-8e33-96226f20925d tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] 10.222.0.11 "GET /compute/v2.1/servers/a49437df-3059-4528-8328-2f3471d5fb45" status: 200 len: 1554 microversion: 2.1 time: 0.153325 Nov 17 03:28:37.411557 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 396/767] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:28:37 2021] GET /compute/v2.1/servers/a49437df-3059-4528-8328-2f3471d5fb45 => generated 1554 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:28:37.784476 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-d42ebd17-ea9b-4553-b128-8f186ace19d5 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:28:37.785163 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-d42ebd17-ea9b-4553-b128-8f186ace19d5 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] [instance: 5d54db85-b991-4890-abaa-952413baa2e7] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:28:37.791644 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-d42ebd17-ea9b-4553-b128-8f186ace19d5 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:28:37.792087 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-d42ebd17-ea9b-4553-b128-8f186ace19d5 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:28:37.792888 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-d42ebd17-ea9b-4553-b128-8f186ace19d5 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:28:37.793318 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-d42ebd17-ea9b-4553-b128-8f186ace19d5 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:28:37.935059 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-ff480f7e-b301-488b-8cc7-4bd00cab74d3 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:28:37.935758 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-ff480f7e-b301-488b-8cc7-4bd00cab74d3 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] [instance: 0698dc5b-5f47-46c4-ace8-f5e891a964a0] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:28:37.941949 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-ff480f7e-b301-488b-8cc7-4bd00cab74d3 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:28:37.942402 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-ff480f7e-b301-488b-8cc7-4bd00cab74d3 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:28:37.943182 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-ff480f7e-b301-488b-8cc7-4bd00cab74d3 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:28:37.943290 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-d42ebd17-ea9b-4553-b128-8f186ace19d5 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37f21d6d15cf40a586edda211219fd08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ebb970305844dccacf48a7d8d47ecf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:28:37.943617 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-ff480f7e-b301-488b-8cc7-4bd00cab74d3 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:28:37.951691 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-d42ebd17-ea9b-4553-b128-8f186ace19d5 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '37f21d6d15cf40a586edda211219fd08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ebb970305844dccacf48a7d8d47ecf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:28:37.953501 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-d42ebd17-ea9b-4553-b128-8f186ace19d5 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '37f21d6d15cf40a586edda211219fd08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ebb970305844dccacf48a7d8d47ecf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:28:37.954843 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-d42ebd17-ea9b-4553-b128-8f186ace19d5 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] 10.222.0.11 "GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7" status: 200 len: 1810 microversion: 2.20 time: 0.175114 Nov 17 03:28:37.955503 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 372/768] 10.222.0.11 () {60 vars in 1276 bytes} [Wed Nov 17 03:28:37 2021] GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7 => generated 1810 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 17 03:28:38.090255 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-ff480f7e-b301-488b-8cc7-4bd00cab74d3 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '163b2f24a72649ac8084be1cac32fa09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e123e9b86124c93a7fc2db9984e7466', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:28:38.098181 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-ff480f7e-b301-488b-8cc7-4bd00cab74d3 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] 10.222.0.11 "GET /compute/v2.1/servers/0698dc5b-5f47-46c4-ace8-f5e891a964a0" status: 200 len: 1257 microversion: 2.1 time: 0.167194 Nov 17 03:28:38.098774 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 397/769] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:28:37 2021] GET /compute/v2.1/servers/0698dc5b-5f47-46c4-ace8-f5e891a964a0 => generated 1257 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:28:38.432356 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-16b3f99b-e9d7-425a-a765-62ee778c3666 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:28:38.433374 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-16b3f99b-e9d7-425a-a765-62ee778c3666 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] [instance: a49437df-3059-4528-8328-2f3471d5fb45] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:28:38.443385 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-16b3f99b-e9d7-425a-a765-62ee778c3666 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:28:38.444120 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-16b3f99b-e9d7-425a-a765-62ee778c3666 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:28:38.445450 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-16b3f99b-e9d7-425a-a765-62ee778c3666 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:28:38.446158 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-16b3f99b-e9d7-425a-a765-62ee778c3666 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:28:38.583603 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-16b3f99b-e9d7-425a-a765-62ee778c3666 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f046401c6a04f6495ebe0821120bd72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a58e89ceeea4a9c8a72a1de4bcaf2d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:28:38.595396 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-16b3f99b-e9d7-425a-a765-62ee778c3666 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] 10.222.0.11 "GET /compute/v2.1/servers/a49437df-3059-4528-8328-2f3471d5fb45" status: 200 len: 1554 microversion: 2.1 time: 0.169145 Nov 17 03:28:38.596084 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 373/770] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:28:38 2021] GET /compute/v2.1/servers/a49437df-3059-4528-8328-2f3471d5fb45 => generated 1554 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:28:38.973649 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-28e2683d-de90-4303-924e-0f3ab9f26cb2 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:28:38.974264 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-28e2683d-de90-4303-924e-0f3ab9f26cb2 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] [instance: 5d54db85-b991-4890-abaa-952413baa2e7] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:28:38.980984 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-28e2683d-de90-4303-924e-0f3ab9f26cb2 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:28:38.981442 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-28e2683d-de90-4303-924e-0f3ab9f26cb2 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:28:38.982222 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-28e2683d-de90-4303-924e-0f3ab9f26cb2 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:28:38.982655 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-28e2683d-de90-4303-924e-0f3ab9f26cb2 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:28:39.115727 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-292ec7e0-5490-4adc-953d-788fea9fe59c tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:28:39.117284 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-292ec7e0-5490-4adc-953d-788fea9fe59c tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] [instance: 0698dc5b-5f47-46c4-ace8-f5e891a964a0] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:28:39.124162 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-292ec7e0-5490-4adc-953d-788fea9fe59c tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:28:39.125039 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-292ec7e0-5490-4adc-953d-788fea9fe59c tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:28:39.126241 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-292ec7e0-5490-4adc-953d-788fea9fe59c tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:28:39.126906 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-292ec7e0-5490-4adc-953d-788fea9fe59c tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:28:39.286888 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-292ec7e0-5490-4adc-953d-788fea9fe59c tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '163b2f24a72649ac8084be1cac32fa09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e123e9b86124c93a7fc2db9984e7466', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:28:39.294606 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-292ec7e0-5490-4adc-953d-788fea9fe59c tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] 10.222.0.11 "GET /compute/v2.1/servers/0698dc5b-5f47-46c4-ace8-f5e891a964a0" status: 200 len: 1257 microversion: 2.1 time: 0.183178 Nov 17 03:28:39.295388 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 374/771] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:28:39 2021] GET /compute/v2.1/servers/0698dc5b-5f47-46c4-ace8-f5e891a964a0 => generated 1257 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:28:39.351971 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-28e2683d-de90-4303-924e-0f3ab9f26cb2 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37f21d6d15cf40a586edda211219fd08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ebb970305844dccacf48a7d8d47ecf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:28:39.360456 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-28e2683d-de90-4303-924e-0f3ab9f26cb2 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '37f21d6d15cf40a586edda211219fd08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ebb970305844dccacf48a7d8d47ecf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:28:39.362121 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-28e2683d-de90-4303-924e-0f3ab9f26cb2 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '37f21d6d15cf40a586edda211219fd08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ebb970305844dccacf48a7d8d47ecf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:28:39.363267 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-28e2683d-de90-4303-924e-0f3ab9f26cb2 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] 10.222.0.11 "GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7" status: 200 len: 1810 microversion: 2.20 time: 0.393457 Nov 17 03:28:39.363823 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 398/772] 10.222.0.11 () {60 vars in 1276 bytes} [Wed Nov 17 03:28:38 2021] GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7 => generated 1810 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 17 03:28:39.621060 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-43e636d5-ac8a-47c9-93bc-8b1ecd71517e tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:28:39.622226 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-43e636d5-ac8a-47c9-93bc-8b1ecd71517e tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] [instance: a49437df-3059-4528-8328-2f3471d5fb45] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:28:39.629139 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-43e636d5-ac8a-47c9-93bc-8b1ecd71517e tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:28:39.629566 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-43e636d5-ac8a-47c9-93bc-8b1ecd71517e tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:28:39.630389 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-43e636d5-ac8a-47c9-93bc-8b1ecd71517e tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:28:39.630822 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-43e636d5-ac8a-47c9-93bc-8b1ecd71517e tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:28:39.761549 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-43e636d5-ac8a-47c9-93bc-8b1ecd71517e tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f046401c6a04f6495ebe0821120bd72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a58e89ceeea4a9c8a72a1de4bcaf2d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:28:39.769778 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-43e636d5-ac8a-47c9-93bc-8b1ecd71517e tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] 10.222.0.11 "GET /compute/v2.1/servers/a49437df-3059-4528-8328-2f3471d5fb45" status: 200 len: 1554 microversion: 2.1 time: 0.154933 Nov 17 03:28:39.770369 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 375/773] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:28:39 2021] GET /compute/v2.1/servers/a49437df-3059-4528-8328-2f3471d5fb45 => generated 1554 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:28:40.312145 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-98d0aea2-da63-4146-a51a-f0a52095fd1a tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:28:40.312706 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-98d0aea2-da63-4146-a51a-f0a52095fd1a tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] [instance: 0698dc5b-5f47-46c4-ace8-f5e891a964a0] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:28:40.319423 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-98d0aea2-da63-4146-a51a-f0a52095fd1a tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:28:40.319871 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-98d0aea2-da63-4146-a51a-f0a52095fd1a tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:28:40.320643 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-98d0aea2-da63-4146-a51a-f0a52095fd1a tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:28:40.321105 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-98d0aea2-da63-4146-a51a-f0a52095fd1a tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:28:40.382605 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-db8a3f71-1d55-4522-a08e-e4f3f0f0a261 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:28:40.384196 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-db8a3f71-1d55-4522-a08e-e4f3f0f0a261 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] [instance: 5d54db85-b991-4890-abaa-952413baa2e7] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:28:40.391636 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-db8a3f71-1d55-4522-a08e-e4f3f0f0a261 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:28:40.392084 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-db8a3f71-1d55-4522-a08e-e4f3f0f0a261 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:28:40.392886 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-db8a3f71-1d55-4522-a08e-e4f3f0f0a261 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:28:40.393337 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-db8a3f71-1d55-4522-a08e-e4f3f0f0a261 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:28:40.461575 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-98d0aea2-da63-4146-a51a-f0a52095fd1a tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '163b2f24a72649ac8084be1cac32fa09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e123e9b86124c93a7fc2db9984e7466', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:28:40.469493 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-98d0aea2-da63-4146-a51a-f0a52095fd1a tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] 10.222.0.11 "GET /compute/v2.1/servers/0698dc5b-5f47-46c4-ace8-f5e891a964a0" status: 200 len: 1257 microversion: 2.1 time: 0.161653 Nov 17 03:28:40.470022 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 399/774] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:28:40 2021] GET /compute/v2.1/servers/0698dc5b-5f47-46c4-ace8-f5e891a964a0 => generated 1257 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:28:40.526951 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-db8a3f71-1d55-4522-a08e-e4f3f0f0a261 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37f21d6d15cf40a586edda211219fd08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ebb970305844dccacf48a7d8d47ecf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:28:40.538400 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-db8a3f71-1d55-4522-a08e-e4f3f0f0a261 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '37f21d6d15cf40a586edda211219fd08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ebb970305844dccacf48a7d8d47ecf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:28:40.540824 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-db8a3f71-1d55-4522-a08e-e4f3f0f0a261 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '37f21d6d15cf40a586edda211219fd08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ebb970305844dccacf48a7d8d47ecf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:28:40.542502 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-db8a3f71-1d55-4522-a08e-e4f3f0f0a261 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] 10.222.0.11 "GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7" status: 200 len: 1810 microversion: 2.20 time: 0.163920 Nov 17 03:28:40.543306 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 376/775] 10.222.0.11 () {60 vars in 1276 bytes} [Wed Nov 17 03:28:40 2021] GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7 => generated 1810 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 17 03:28:40.791331 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-036b0c42-f32c-4ff8-acff-1b8bf74182d6 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:28:40.792855 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-036b0c42-f32c-4ff8-acff-1b8bf74182d6 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] [instance: a49437df-3059-4528-8328-2f3471d5fb45] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:28:40.800716 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-036b0c42-f32c-4ff8-acff-1b8bf74182d6 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:28:40.801195 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-036b0c42-f32c-4ff8-acff-1b8bf74182d6 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:28:40.801976 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-036b0c42-f32c-4ff8-acff-1b8bf74182d6 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:28:40.802405 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-036b0c42-f32c-4ff8-acff-1b8bf74182d6 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:28:40.947614 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-036b0c42-f32c-4ff8-acff-1b8bf74182d6 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f046401c6a04f6495ebe0821120bd72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a58e89ceeea4a9c8a72a1de4bcaf2d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:28:40.955664 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-036b0c42-f32c-4ff8-acff-1b8bf74182d6 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] 10.222.0.11 "GET /compute/v2.1/servers/a49437df-3059-4528-8328-2f3471d5fb45" status: 200 len: 1560 microversion: 2.1 time: 0.170552 Nov 17 03:28:40.956238 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 400/776] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:28:40 2021] GET /compute/v2.1/servers/a49437df-3059-4528-8328-2f3471d5fb45 => generated 1560 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:28:41.021821 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-5a5659c0-9d8a-4a21-b076-86f1e661fd5f tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:28:41.022314 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-5a5659c0-9d8a-4a21-b076-86f1e661fd5f tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] [instance: a49437df-3059-4528-8328-2f3471d5fb45] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:28:41.028362 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-5a5659c0-9d8a-4a21-b076-86f1e661fd5f tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:28:41.028736 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-5a5659c0-9d8a-4a21-b076-86f1e661fd5f tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:28:41.029548 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-5a5659c0-9d8a-4a21-b076-86f1e661fd5f tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:28:41.030054 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-5a5659c0-9d8a-4a21-b076-86f1e661fd5f tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:28:41.113320 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.objects.instance [None req-5a5659c0-9d8a-4a21-b076-86f1e661fd5f tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lazy-loading 'services' on Instance uuid a49437df-3059-4528-8328-2f3471d5fb45 {{(pid=115917) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Nov 17 03:28:41.119793 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [req-067ea8a9-d05e-4e66-befc-101c6ce12581 req-a3c7e6f7-e157-4b8a-8223-0bd99dca6903 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5d54db85-b991-4890-abaa-952413baa2e7", "name": "network-vif-plugged", "status": "completed", "tag": "51f39c10-57ce-4106-ab58-635a3319ff11"}]} {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 17 03:28:41.121527 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 17 03:28:41.121527 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: warnings.warn(msg) Nov 17 03:28:41.129386 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [req-067ea8a9-d05e-4e66-befc-101c6ce12581 req-a3c7e6f7-e157-4b8a-8223-0bd99dca6903 service nova] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:28:41.130071 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [req-067ea8a9-d05e-4e66-befc-101c6ce12581 req-a3c7e6f7-e157-4b8a-8223-0bd99dca6903 service nova] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:28:41.143903 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.compute.server_external_events [req-067ea8a9-d05e-4e66-befc-101c6ce12581 req-a3c7e6f7-e157-4b8a-8223-0bd99dca6903 service nova] Creating event network-vif-plugged:51f39c10-57ce-4106-ab58-635a3319ff11 for instance 5d54db85-b991-4890-abaa-952413baa2e7 on hv-cinder-81803 Nov 17 03:28:41.149067 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [req-067ea8a9-d05e-4e66-befc-101c6ce12581 req-a3c7e6f7-e157-4b8a-8223-0bd99dca6903 service nova] 10.222.0.11 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032910 Nov 17 03:28:41.149886 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 401/777] 10.222.0.11 () {64 vars in 1317 bytes} [Wed Nov 17 03:28:41 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 17 03:28:41.185972 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-5a5659c0-9d8a-4a21-b076-86f1e661fd5f tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] 10.222.0.11 "DELETE /compute/v2.1/servers/a49437df-3059-4528-8328-2f3471d5fb45/os-volume_attachments/93480bc3-2042-416b-9af5-bd61259a2345" status: 202 len: 0 microversion: 2.1 time: 0.167427 Nov 17 03:28:41.186382 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 377/778] 10.222.0.11 () {58 vars in 1415 bytes} [Wed Nov 17 03:28:41 2021] DELETE /compute/v2.1/servers/a49437df-3059-4528-8328-2f3471d5fb45/os-volume_attachments/93480bc3-2042-416b-9af5-bd61259a2345 => generated 0 bytes in 169 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 17 03:28:41.195933 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-add0591c-9de9-4b3e-a0e5-ec6f1ee78cdc tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:28:41.196491 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-add0591c-9de9-4b3e-a0e5-ec6f1ee78cdc tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] [instance: a49437df-3059-4528-8328-2f3471d5fb45] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:28:41.203893 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-add0591c-9de9-4b3e-a0e5-ec6f1ee78cdc tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:28:41.204442 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-add0591c-9de9-4b3e-a0e5-ec6f1ee78cdc tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:28:41.205520 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-add0591c-9de9-4b3e-a0e5-ec6f1ee78cdc tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:28:41.206213 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-add0591c-9de9-4b3e-a0e5-ec6f1ee78cdc tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:28:41.238772 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-add0591c-9de9-4b3e-a0e5-ec6f1ee78cdc tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] 10.222.0.11 "GET /compute/v2.1/servers/a49437df-3059-4528-8328-2f3471d5fb45/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047722 Nov 17 03:28:41.242699 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 402/779] 10.222.0.11 () {58 vars in 1301 bytes} [Wed Nov 17 03:28:41 2021] GET /compute/v2.1/servers/a49437df-3059-4528-8328-2f3471d5fb45/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 17 03:28:41.487604 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-3a76c5f1-4e4a-45bb-ad3c-baf99675e109 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:28:41.488274 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-3a76c5f1-4e4a-45bb-ad3c-baf99675e109 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] [instance: 0698dc5b-5f47-46c4-ace8-f5e891a964a0] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:28:41.495277 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-3a76c5f1-4e4a-45bb-ad3c-baf99675e109 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:28:41.495718 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-3a76c5f1-4e4a-45bb-ad3c-baf99675e109 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:28:41.496479 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-3a76c5f1-4e4a-45bb-ad3c-baf99675e109 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:28:41.496943 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-3a76c5f1-4e4a-45bb-ad3c-baf99675e109 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:28:41.561204 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-3de943fb-c8aa-42a5-aaee-1b187afb6ceb tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:28:41.561970 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-3de943fb-c8aa-42a5-aaee-1b187afb6ceb tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] [instance: 5d54db85-b991-4890-abaa-952413baa2e7] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:28:41.569005 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-3de943fb-c8aa-42a5-aaee-1b187afb6ceb tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:28:41.569547 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-3de943fb-c8aa-42a5-aaee-1b187afb6ceb tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:28:41.570389 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-3de943fb-c8aa-42a5-aaee-1b187afb6ceb tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:28:41.570884 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-3de943fb-c8aa-42a5-aaee-1b187afb6ceb tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:28:41.633636 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-3a76c5f1-4e4a-45bb-ad3c-baf99675e109 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '163b2f24a72649ac8084be1cac32fa09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e123e9b86124c93a7fc2db9984e7466', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:28:41.642412 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-3a76c5f1-4e4a-45bb-ad3c-baf99675e109 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] 10.222.0.11 "GET /compute/v2.1/servers/0698dc5b-5f47-46c4-ace8-f5e891a964a0" status: 200 len: 1257 microversion: 2.1 time: 0.158649 Nov 17 03:28:41.653113 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 378/780] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:28:41 2021] GET /compute/v2.1/servers/0698dc5b-5f47-46c4-ace8-f5e891a964a0 => generated 1257 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:28:41.712926 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-3de943fb-c8aa-42a5-aaee-1b187afb6ceb tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37f21d6d15cf40a586edda211219fd08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ebb970305844dccacf48a7d8d47ecf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:28:41.721625 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-3de943fb-c8aa-42a5-aaee-1b187afb6ceb tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '37f21d6d15cf40a586edda211219fd08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ebb970305844dccacf48a7d8d47ecf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:28:41.723083 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-3de943fb-c8aa-42a5-aaee-1b187afb6ceb tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '37f21d6d15cf40a586edda211219fd08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ebb970305844dccacf48a7d8d47ecf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:28:41.724251 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-3de943fb-c8aa-42a5-aaee-1b187afb6ceb tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] 10.222.0.11 "GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7" status: 200 len: 1810 microversion: 2.20 time: 0.167426 Nov 17 03:28:41.724801 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 403/781] 10.222.0.11 () {60 vars in 1276 bytes} [Wed Nov 17 03:28:41 2021] GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7 => generated 1810 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 17 03:28:42.254803 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-3f61aa62-2ecf-4fbe-abcd-2b62b1027d25 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:28:42.256425 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-3f61aa62-2ecf-4fbe-abcd-2b62b1027d25 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] [instance: a49437df-3059-4528-8328-2f3471d5fb45] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:28:42.265805 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-3f61aa62-2ecf-4fbe-abcd-2b62b1027d25 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:28:42.266256 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-3f61aa62-2ecf-4fbe-abcd-2b62b1027d25 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:28:42.267026 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-3f61aa62-2ecf-4fbe-abcd-2b62b1027d25 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:28:42.267460 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-3f61aa62-2ecf-4fbe-abcd-2b62b1027d25 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:28:42.296974 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-3f61aa62-2ecf-4fbe-abcd-2b62b1027d25 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] 10.222.0.11 "GET /compute/v2.1/servers/a49437df-3059-4528-8328-2f3471d5fb45/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048873 Nov 17 03:28:42.297542 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 379/782] 10.222.0.11 () {58 vars in 1301 bytes} [Wed Nov 17 03:28:42 2021] GET /compute/v2.1/servers/a49437df-3059-4528-8328-2f3471d5fb45/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 17 03:28:42.664873 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-081042cc-2689-4d2d-8aae-1a1364318ab7 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:28:42.665708 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-081042cc-2689-4d2d-8aae-1a1364318ab7 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] [instance: 0698dc5b-5f47-46c4-ace8-f5e891a964a0] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:28:42.676719 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-081042cc-2689-4d2d-8aae-1a1364318ab7 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:28:42.677507 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-081042cc-2689-4d2d-8aae-1a1364318ab7 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:28:42.679013 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-081042cc-2689-4d2d-8aae-1a1364318ab7 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:28:42.679720 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-081042cc-2689-4d2d-8aae-1a1364318ab7 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:28:42.742799 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-e8f028c4-fcc8-42f5-818e-b2a9d1d87150 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:28:42.743500 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-e8f028c4-fcc8-42f5-818e-b2a9d1d87150 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] [instance: 5d54db85-b991-4890-abaa-952413baa2e7] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:28:42.750278 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-e8f028c4-fcc8-42f5-818e-b2a9d1d87150 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:28:42.750811 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-e8f028c4-fcc8-42f5-818e-b2a9d1d87150 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:28:42.751662 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-e8f028c4-fcc8-42f5-818e-b2a9d1d87150 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:28:42.752188 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-e8f028c4-fcc8-42f5-818e-b2a9d1d87150 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:28:42.818230 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-081042cc-2689-4d2d-8aae-1a1364318ab7 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '163b2f24a72649ac8084be1cac32fa09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e123e9b86124c93a7fc2db9984e7466', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:28:42.825614 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-081042cc-2689-4d2d-8aae-1a1364318ab7 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] 10.222.0.11 "GET /compute/v2.1/servers/0698dc5b-5f47-46c4-ace8-f5e891a964a0" status: 200 len: 1257 microversion: 2.1 time: 0.167331 Nov 17 03:28:42.826181 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 404/783] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:28:42 2021] GET /compute/v2.1/servers/0698dc5b-5f47-46c4-ace8-f5e891a964a0 => generated 1257 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:28:42.885163 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-e8f028c4-fcc8-42f5-818e-b2a9d1d87150 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37f21d6d15cf40a586edda211219fd08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ebb970305844dccacf48a7d8d47ecf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:28:42.893647 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-e8f028c4-fcc8-42f5-818e-b2a9d1d87150 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '37f21d6d15cf40a586edda211219fd08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ebb970305844dccacf48a7d8d47ecf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:28:42.895439 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-e8f028c4-fcc8-42f5-818e-b2a9d1d87150 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '37f21d6d15cf40a586edda211219fd08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ebb970305844dccacf48a7d8d47ecf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:28:42.896593 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-e8f028c4-fcc8-42f5-818e-b2a9d1d87150 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] 10.222.0.11 "GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7" status: 200 len: 1810 microversion: 2.20 time: 0.157639 Nov 17 03:28:42.897519 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 380/784] 10.222.0.11 () {60 vars in 1276 bytes} [Wed Nov 17 03:28:42 2021] GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7 => generated 1810 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 17 03:28:43.307943 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-7abe55cd-a6bd-4ccd-9f57-1ae5924fa1cd tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:28:43.309200 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-7abe55cd-a6bd-4ccd-9f57-1ae5924fa1cd tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] [instance: a49437df-3059-4528-8328-2f3471d5fb45] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:28:43.316110 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-7abe55cd-a6bd-4ccd-9f57-1ae5924fa1cd tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:28:43.316698 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-7abe55cd-a6bd-4ccd-9f57-1ae5924fa1cd tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:28:43.317582 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-7abe55cd-a6bd-4ccd-9f57-1ae5924fa1cd tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:28:43.318294 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-7abe55cd-a6bd-4ccd-9f57-1ae5924fa1cd tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:28:43.351862 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-7abe55cd-a6bd-4ccd-9f57-1ae5924fa1cd tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] 10.222.0.11 "GET /compute/v2.1/servers/a49437df-3059-4528-8328-2f3471d5fb45/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048055 Nov 17 03:28:43.361177 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 405/785] 10.222.0.11 () {58 vars in 1301 bytes} [Wed Nov 17 03:28:43 2021] GET /compute/v2.1/servers/a49437df-3059-4528-8328-2f3471d5fb45/os-volume_attachments => generated 197 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 17 03:28:43.843068 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-cbbf853b-c44d-4770-a944-0e92f906909a tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:28:43.843679 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-cbbf853b-c44d-4770-a944-0e92f906909a tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] [instance: 0698dc5b-5f47-46c4-ace8-f5e891a964a0] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:28:43.850512 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-cbbf853b-c44d-4770-a944-0e92f906909a tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:28:43.850964 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-cbbf853b-c44d-4770-a944-0e92f906909a tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:28:43.851734 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-cbbf853b-c44d-4770-a944-0e92f906909a tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:28:43.852169 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-cbbf853b-c44d-4770-a944-0e92f906909a tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:28:43.915873 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-42193d6d-ceda-4740-be2a-5792c05d3c76 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:28:43.916481 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-42193d6d-ceda-4740-be2a-5792c05d3c76 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] [instance: 5d54db85-b991-4890-abaa-952413baa2e7] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:28:43.923655 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-42193d6d-ceda-4740-be2a-5792c05d3c76 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:28:43.924107 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-42193d6d-ceda-4740-be2a-5792c05d3c76 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:28:43.924944 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-42193d6d-ceda-4740-be2a-5792c05d3c76 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:28:43.925355 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-42193d6d-ceda-4740-be2a-5792c05d3c76 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:28:44.019629 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-cbbf853b-c44d-4770-a944-0e92f906909a tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '163b2f24a72649ac8084be1cac32fa09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e123e9b86124c93a7fc2db9984e7466', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:28:44.028151 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-cbbf853b-c44d-4770-a944-0e92f906909a tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] 10.222.0.11 "GET /compute/v2.1/servers/0698dc5b-5f47-46c4-ace8-f5e891a964a0" status: 200 len: 1257 microversion: 2.1 time: 0.188924 Nov 17 03:28:44.028753 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 381/786] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:28:43 2021] GET /compute/v2.1/servers/0698dc5b-5f47-46c4-ace8-f5e891a964a0 => generated 1257 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:28:44.087659 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-42193d6d-ceda-4740-be2a-5792c05d3c76 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37f21d6d15cf40a586edda211219fd08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ebb970305844dccacf48a7d8d47ecf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:28:44.096220 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-42193d6d-ceda-4740-be2a-5792c05d3c76 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '37f21d6d15cf40a586edda211219fd08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ebb970305844dccacf48a7d8d47ecf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:28:44.097734 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-42193d6d-ceda-4740-be2a-5792c05d3c76 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '37f21d6d15cf40a586edda211219fd08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ebb970305844dccacf48a7d8d47ecf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:28:44.098922 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-42193d6d-ceda-4740-be2a-5792c05d3c76 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] 10.222.0.11 "GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7" status: 200 len: 1810 microversion: 2.20 time: 0.187335 Nov 17 03:28:44.099481 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 406/787] 10.222.0.11 () {60 vars in 1276 bytes} [Wed Nov 17 03:28:43 2021] GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7 => generated 1810 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 17 03:28:44.374981 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-c8fabc3d-a937-4786-8b41-d3dd808a3891 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:28:44.376403 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-c8fabc3d-a937-4786-8b41-d3dd808a3891 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] [instance: a49437df-3059-4528-8328-2f3471d5fb45] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:28:44.385868 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-c8fabc3d-a937-4786-8b41-d3dd808a3891 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:28:44.386503 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-c8fabc3d-a937-4786-8b41-d3dd808a3891 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:28:44.387652 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-c8fabc3d-a937-4786-8b41-d3dd808a3891 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:28:44.388351 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-c8fabc3d-a937-4786-8b41-d3dd808a3891 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:28:44.421217 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-c8fabc3d-a937-4786-8b41-d3dd808a3891 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] 10.222.0.11 "GET /compute/v2.1/servers/a49437df-3059-4528-8328-2f3471d5fb45/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052203 Nov 17 03:28:44.421762 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 382/788] 10.222.0.11 () {58 vars in 1301 bytes} [Wed Nov 17 03:28:44 2021] GET /compute/v2.1/servers/a49437df-3059-4528-8328-2f3471d5fb45/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 17 03:28:45.045517 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-353adc73-f0cd-4cba-93f6-03fb4bd5263c tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:28:45.046222 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-353adc73-f0cd-4cba-93f6-03fb4bd5263c tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] [instance: 0698dc5b-5f47-46c4-ace8-f5e891a964a0] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:28:45.053328 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-353adc73-f0cd-4cba-93f6-03fb4bd5263c tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:28:45.053531 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-353adc73-f0cd-4cba-93f6-03fb4bd5263c tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:28:45.054285 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-353adc73-f0cd-4cba-93f6-03fb4bd5263c tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:28:45.054718 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-353adc73-f0cd-4cba-93f6-03fb4bd5263c tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:28:45.117394 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-05fdbbcb-f6a3-46ae-b1d0-14b725e590a5 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:28:45.118118 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-05fdbbcb-f6a3-46ae-b1d0-14b725e590a5 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] [instance: 5d54db85-b991-4890-abaa-952413baa2e7] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:28:45.124484 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-05fdbbcb-f6a3-46ae-b1d0-14b725e590a5 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:28:45.124972 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-05fdbbcb-f6a3-46ae-b1d0-14b725e590a5 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:28:45.125749 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-05fdbbcb-f6a3-46ae-b1d0-14b725e590a5 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:28:45.126179 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-05fdbbcb-f6a3-46ae-b1d0-14b725e590a5 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:28:45.190436 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-353adc73-f0cd-4cba-93f6-03fb4bd5263c tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '163b2f24a72649ac8084be1cac32fa09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e123e9b86124c93a7fc2db9984e7466', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:28:45.197849 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-353adc73-f0cd-4cba-93f6-03fb4bd5263c tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] 10.222.0.11 "GET /compute/v2.1/servers/0698dc5b-5f47-46c4-ace8-f5e891a964a0" status: 200 len: 1257 microversion: 2.1 time: 0.156111 Nov 17 03:28:45.198648 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 407/789] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:28:45 2021] GET /compute/v2.1/servers/0698dc5b-5f47-46c4-ace8-f5e891a964a0 => generated 1257 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:28:45.257929 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-05fdbbcb-f6a3-46ae-b1d0-14b725e590a5 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37f21d6d15cf40a586edda211219fd08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ebb970305844dccacf48a7d8d47ecf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:28:45.266862 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-05fdbbcb-f6a3-46ae-b1d0-14b725e590a5 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '37f21d6d15cf40a586edda211219fd08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ebb970305844dccacf48a7d8d47ecf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:28:45.268283 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-05fdbbcb-f6a3-46ae-b1d0-14b725e590a5 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '37f21d6d15cf40a586edda211219fd08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ebb970305844dccacf48a7d8d47ecf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:28:45.269469 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-05fdbbcb-f6a3-46ae-b1d0-14b725e590a5 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] 10.222.0.11 "GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7" status: 200 len: 1797 microversion: 2.20 time: 0.155819 Nov 17 03:28:45.270027 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 383/790] 10.222.0.11 () {60 vars in 1276 bytes} [Wed Nov 17 03:28:45 2021] GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7 => generated 1797 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 17 03:28:45.437282 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-c834f34e-e349-4b7a-bba1-e96cbf4f7fd9 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:28:45.438799 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-c834f34e-e349-4b7a-bba1-e96cbf4f7fd9 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] [instance: a49437df-3059-4528-8328-2f3471d5fb45] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:28:45.448607 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-c834f34e-e349-4b7a-bba1-e96cbf4f7fd9 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:28:45.449588 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-c834f34e-e349-4b7a-bba1-e96cbf4f7fd9 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:28:45.450759 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-c834f34e-e349-4b7a-bba1-e96cbf4f7fd9 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:28:45.451489 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-c834f34e-e349-4b7a-bba1-e96cbf4f7fd9 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:28:45.482098 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-c834f34e-e349-4b7a-bba1-e96cbf4f7fd9 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] 10.222.0.11 "GET /compute/v2.1/servers/a49437df-3059-4528-8328-2f3471d5fb45/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051615 Nov 17 03:28:45.482659 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 408/791] 10.222.0.11 () {58 vars in 1301 bytes} [Wed Nov 17 03:28:45 2021] GET /compute/v2.1/servers/a49437df-3059-4528-8328-2f3471d5fb45/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 17 03:28:46.216639 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-31b843a9-f33a-424c-b72f-b9d9047c4316 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:28:46.217899 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-31b843a9-f33a-424c-b72f-b9d9047c4316 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] [instance: 0698dc5b-5f47-46c4-ace8-f5e891a964a0] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:28:46.224307 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-31b843a9-f33a-424c-b72f-b9d9047c4316 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:28:46.224767 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-31b843a9-f33a-424c-b72f-b9d9047c4316 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:28:46.225564 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-31b843a9-f33a-424c-b72f-b9d9047c4316 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:28:46.226002 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-31b843a9-f33a-424c-b72f-b9d9047c4316 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:28:46.371097 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-31b843a9-f33a-424c-b72f-b9d9047c4316 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '163b2f24a72649ac8084be1cac32fa09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e123e9b86124c93a7fc2db9984e7466', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:28:46.380059 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-31b843a9-f33a-424c-b72f-b9d9047c4316 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] 10.222.0.11 "GET /compute/v2.1/servers/0698dc5b-5f47-46c4-ace8-f5e891a964a0" status: 200 len: 1257 microversion: 2.1 time: 0.168364 Nov 17 03:28:46.380635 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 384/792] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:28:46 2021] GET /compute/v2.1/servers/0698dc5b-5f47-46c4-ace8-f5e891a964a0 => generated 1257 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:28:46.493958 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-0b776938-ea53-44a8-ae0c-84098fc8dfd5 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:28:46.494866 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-0b776938-ea53-44a8-ae0c-84098fc8dfd5 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] [instance: a49437df-3059-4528-8328-2f3471d5fb45] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:28:46.501903 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-0b776938-ea53-44a8-ae0c-84098fc8dfd5 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:28:46.502384 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-0b776938-ea53-44a8-ae0c-84098fc8dfd5 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:28:46.503146 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-0b776938-ea53-44a8-ae0c-84098fc8dfd5 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:28:46.503579 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-0b776938-ea53-44a8-ae0c-84098fc8dfd5 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:28:46.534129 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-0b776938-ea53-44a8-ae0c-84098fc8dfd5 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] 10.222.0.11 "GET /compute/v2.1/servers/a49437df-3059-4528-8328-2f3471d5fb45/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043905 Nov 17 03:28:46.534695 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 409/793] 10.222.0.11 () {58 vars in 1301 bytes} [Wed Nov 17 03:28:46 2021] GET /compute/v2.1/servers/a49437df-3059-4528-8328-2f3471d5fb45/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 17 03:28:47.398957 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-d155ed58-3ca1-4fa6-b192-e8db9d32736f tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:28:47.399564 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-d155ed58-3ca1-4fa6-b192-e8db9d32736f tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] [instance: 0698dc5b-5f47-46c4-ace8-f5e891a964a0] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:28:47.407690 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-d155ed58-3ca1-4fa6-b192-e8db9d32736f tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:28:47.408212 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-d155ed58-3ca1-4fa6-b192-e8db9d32736f tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:28:47.409172 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-d155ed58-3ca1-4fa6-b192-e8db9d32736f tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:28:47.409683 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-d155ed58-3ca1-4fa6-b192-e8db9d32736f tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:28:47.545567 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-092ce5e5-0cc0-49cc-b049-2cd623d0b4af tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:28:47.546596 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-092ce5e5-0cc0-49cc-b049-2cd623d0b4af tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] [instance: a49437df-3059-4528-8328-2f3471d5fb45] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:28:47.550176 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-d155ed58-3ca1-4fa6-b192-e8db9d32736f tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '163b2f24a72649ac8084be1cac32fa09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e123e9b86124c93a7fc2db9984e7466', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:28:47.553573 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-092ce5e5-0cc0-49cc-b049-2cd623d0b4af tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:28:47.554008 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-092ce5e5-0cc0-49cc-b049-2cd623d0b4af tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:28:47.554787 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-092ce5e5-0cc0-49cc-b049-2cd623d0b4af tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:28:47.555197 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-092ce5e5-0cc0-49cc-b049-2cd623d0b4af tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:28:47.558117 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-d155ed58-3ca1-4fa6-b192-e8db9d32736f tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] 10.222.0.11 "GET /compute/v2.1/servers/0698dc5b-5f47-46c4-ace8-f5e891a964a0" status: 200 len: 1257 microversion: 2.1 time: 0.163542 Nov 17 03:28:47.558680 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 385/794] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:28:47 2021] GET /compute/v2.1/servers/0698dc5b-5f47-46c4-ace8-f5e891a964a0 => generated 1257 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:28:47.588022 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-092ce5e5-0cc0-49cc-b049-2cd623d0b4af tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] 10.222.0.11 "GET /compute/v2.1/servers/a49437df-3059-4528-8328-2f3471d5fb45/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046526 Nov 17 03:28:47.588661 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 410/795] 10.222.0.11 () {58 vars in 1301 bytes} [Wed Nov 17 03:28:47 2021] GET /compute/v2.1/servers/a49437df-3059-4528-8328-2f3471d5fb45/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 17 03:28:48.578857 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-33c83335-8425-46c1-b02f-b267a051a5b9 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:28:48.579926 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-33c83335-8425-46c1-b02f-b267a051a5b9 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] [instance: 0698dc5b-5f47-46c4-ace8-f5e891a964a0] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:28:48.590535 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-33c83335-8425-46c1-b02f-b267a051a5b9 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:28:48.591281 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-33c83335-8425-46c1-b02f-b267a051a5b9 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:28:48.592564 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-33c83335-8425-46c1-b02f-b267a051a5b9 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:28:48.593990 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-33c83335-8425-46c1-b02f-b267a051a5b9 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:28:48.600406 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-f2f5eca3-82bf-4523-984b-bb62aca1040f tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:28:48.601529 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-f2f5eca3-82bf-4523-984b-bb62aca1040f tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] [instance: a49437df-3059-4528-8328-2f3471d5fb45] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:28:48.608217 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-f2f5eca3-82bf-4523-984b-bb62aca1040f tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:28:48.608666 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-f2f5eca3-82bf-4523-984b-bb62aca1040f tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:28:48.610203 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-f2f5eca3-82bf-4523-984b-bb62aca1040f tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:28:48.610650 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-f2f5eca3-82bf-4523-984b-bb62aca1040f tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:28:48.641245 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-f2f5eca3-82bf-4523-984b-bb62aca1040f tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] 10.222.0.11 "GET /compute/v2.1/servers/a49437df-3059-4528-8328-2f3471d5fb45/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044177 Nov 17 03:28:48.641831 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 411/796] 10.222.0.11 () {58 vars in 1301 bytes} [Wed Nov 17 03:28:48 2021] GET /compute/v2.1/servers/a49437df-3059-4528-8328-2f3471d5fb45/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 17 03:28:48.731838 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-33c83335-8425-46c1-b02f-b267a051a5b9 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '163b2f24a72649ac8084be1cac32fa09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e123e9b86124c93a7fc2db9984e7466', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:28:48.743821 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-33c83335-8425-46c1-b02f-b267a051a5b9 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] 10.222.0.11 "GET /compute/v2.1/servers/0698dc5b-5f47-46c4-ace8-f5e891a964a0" status: 200 len: 1257 microversion: 2.1 time: 0.171460 Nov 17 03:28:48.744555 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 386/797] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:28:48 2021] GET /compute/v2.1/servers/0698dc5b-5f47-46c4-ace8-f5e891a964a0 => generated 1257 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:28:49.653198 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-91cd90d9-cb8f-4b55-89b5-84b0fcead990 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:28:49.654165 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-91cd90d9-cb8f-4b55-89b5-84b0fcead990 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] [instance: a49437df-3059-4528-8328-2f3471d5fb45] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:28:49.661068 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-91cd90d9-cb8f-4b55-89b5-84b0fcead990 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:28:49.661518 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-91cd90d9-cb8f-4b55-89b5-84b0fcead990 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:28:49.662366 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-91cd90d9-cb8f-4b55-89b5-84b0fcead990 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:28:49.662821 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-91cd90d9-cb8f-4b55-89b5-84b0fcead990 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:28:49.693657 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-91cd90d9-cb8f-4b55-89b5-84b0fcead990 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] 10.222.0.11 "GET /compute/v2.1/servers/a49437df-3059-4528-8328-2f3471d5fb45/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044556 Nov 17 03:28:49.694215 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 412/798] 10.222.0.11 () {58 vars in 1301 bytes} [Wed Nov 17 03:28:49 2021] GET /compute/v2.1/servers/a49437df-3059-4528-8328-2f3471d5fb45/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 17 03:28:49.765665 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-68b5ef74-c6f6-4b69-b8df-61104c818496 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:28:49.767134 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-68b5ef74-c6f6-4b69-b8df-61104c818496 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] [instance: 0698dc5b-5f47-46c4-ace8-f5e891a964a0] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:28:49.774786 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-68b5ef74-c6f6-4b69-b8df-61104c818496 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:28:49.775312 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-68b5ef74-c6f6-4b69-b8df-61104c818496 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:28:49.776216 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-68b5ef74-c6f6-4b69-b8df-61104c818496 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:28:49.776728 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-68b5ef74-c6f6-4b69-b8df-61104c818496 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:28:49.923119 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-68b5ef74-c6f6-4b69-b8df-61104c818496 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '163b2f24a72649ac8084be1cac32fa09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e123e9b86124c93a7fc2db9984e7466', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:28:49.931041 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-68b5ef74-c6f6-4b69-b8df-61104c818496 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] 10.222.0.11 "GET /compute/v2.1/servers/0698dc5b-5f47-46c4-ace8-f5e891a964a0" status: 200 len: 1257 microversion: 2.1 time: 0.171509 Nov 17 03:28:49.931967 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 387/799] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:28:49 2021] GET /compute/v2.1/servers/0698dc5b-5f47-46c4-ace8-f5e891a964a0 => generated 1257 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:28:50.707161 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-a0e6698b-3111-4823-9adb-dfc35d4550cd tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:28:50.708390 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-a0e6698b-3111-4823-9adb-dfc35d4550cd tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] [instance: a49437df-3059-4528-8328-2f3471d5fb45] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:28:50.716944 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-a0e6698b-3111-4823-9adb-dfc35d4550cd tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:28:50.717540 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-a0e6698b-3111-4823-9adb-dfc35d4550cd tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:28:50.718576 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-a0e6698b-3111-4823-9adb-dfc35d4550cd tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:28:50.719191 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-a0e6698b-3111-4823-9adb-dfc35d4550cd tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:28:50.750819 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-a0e6698b-3111-4823-9adb-dfc35d4550cd tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] 10.222.0.11 "GET /compute/v2.1/servers/a49437df-3059-4528-8328-2f3471d5fb45/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048563 Nov 17 03:28:50.751375 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 413/800] 10.222.0.11 () {58 vars in 1301 bytes} [Wed Nov 17 03:28:50 2021] GET /compute/v2.1/servers/a49437df-3059-4528-8328-2f3471d5fb45/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 17 03:28:50.951230 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-4c1f1d4a-2093-45d0-837e-e5ce856a66bc tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:28:50.952055 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-4c1f1d4a-2093-45d0-837e-e5ce856a66bc tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] [instance: 0698dc5b-5f47-46c4-ace8-f5e891a964a0] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:28:50.963457 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-4c1f1d4a-2093-45d0-837e-e5ce856a66bc tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:28:50.964260 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-4c1f1d4a-2093-45d0-837e-e5ce856a66bc tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:28:50.965603 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-4c1f1d4a-2093-45d0-837e-e5ce856a66bc tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:28:50.966413 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-4c1f1d4a-2093-45d0-837e-e5ce856a66bc tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:28:51.104105 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-4c1f1d4a-2093-45d0-837e-e5ce856a66bc tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '163b2f24a72649ac8084be1cac32fa09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e123e9b86124c93a7fc2db9984e7466', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:28:51.112167 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-4c1f1d4a-2093-45d0-837e-e5ce856a66bc tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] 10.222.0.11 "GET /compute/v2.1/servers/0698dc5b-5f47-46c4-ace8-f5e891a964a0" status: 200 len: 1257 microversion: 2.1 time: 0.167235 Nov 17 03:28:51.112746 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 388/801] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:28:50 2021] GET /compute/v2.1/servers/0698dc5b-5f47-46c4-ace8-f5e891a964a0 => generated 1257 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:28:51.764075 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-6223d07b-fd03-489b-96d6-c794b1531a2b tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:28:51.765339 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-6223d07b-fd03-489b-96d6-c794b1531a2b tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] [instance: a49437df-3059-4528-8328-2f3471d5fb45] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:28:51.772205 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-6223d07b-fd03-489b-96d6-c794b1531a2b tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:28:51.772634 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-6223d07b-fd03-489b-96d6-c794b1531a2b tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:28:51.773479 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-6223d07b-fd03-489b-96d6-c794b1531a2b tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:28:51.773973 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-6223d07b-fd03-489b-96d6-c794b1531a2b tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:28:51.804010 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-6223d07b-fd03-489b-96d6-c794b1531a2b tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] 10.222.0.11 "GET /compute/v2.1/servers/a49437df-3059-4528-8328-2f3471d5fb45/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045019 Nov 17 03:28:51.804570 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 414/802] 10.222.0.11 () {58 vars in 1301 bytes} [Wed Nov 17 03:28:51 2021] GET /compute/v2.1/servers/a49437df-3059-4528-8328-2f3471d5fb45/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 17 03:28:52.135649 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-3556eaf0-9f8c-4f6a-9ac8-11e1ebd6e58c tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:28:52.136658 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-3556eaf0-9f8c-4f6a-9ac8-11e1ebd6e58c tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] [instance: 0698dc5b-5f47-46c4-ace8-f5e891a964a0] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:28:52.145297 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-3556eaf0-9f8c-4f6a-9ac8-11e1ebd6e58c tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:28:52.145748 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-3556eaf0-9f8c-4f6a-9ac8-11e1ebd6e58c tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:28:52.146524 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-3556eaf0-9f8c-4f6a-9ac8-11e1ebd6e58c tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:28:52.146957 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-3556eaf0-9f8c-4f6a-9ac8-11e1ebd6e58c tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:28:52.283052 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-3556eaf0-9f8c-4f6a-9ac8-11e1ebd6e58c tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '163b2f24a72649ac8084be1cac32fa09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e123e9b86124c93a7fc2db9984e7466', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:28:52.290801 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-3556eaf0-9f8c-4f6a-9ac8-11e1ebd6e58c tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] 10.222.0.11 "GET /compute/v2.1/servers/0698dc5b-5f47-46c4-ace8-f5e891a964a0" status: 200 len: 1257 microversion: 2.1 time: 0.161831 Nov 17 03:28:52.291411 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 389/803] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:28:52 2021] GET /compute/v2.1/servers/0698dc5b-5f47-46c4-ace8-f5e891a964a0 => generated 1257 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:28:52.821836 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-687c27da-16c2-4dad-9643-03b5c32e9671 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:28:52.823481 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-687c27da-16c2-4dad-9643-03b5c32e9671 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] [instance: a49437df-3059-4528-8328-2f3471d5fb45] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:28:52.831699 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-687c27da-16c2-4dad-9643-03b5c32e9671 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:28:52.831985 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-687c27da-16c2-4dad-9643-03b5c32e9671 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:28:52.832754 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-687c27da-16c2-4dad-9643-03b5c32e9671 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:28:52.833216 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-687c27da-16c2-4dad-9643-03b5c32e9671 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:28:52.862974 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-687c27da-16c2-4dad-9643-03b5c32e9671 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] 10.222.0.11 "GET /compute/v2.1/servers/a49437df-3059-4528-8328-2f3471d5fb45/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048618 Nov 17 03:28:52.863481 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 415/804] 10.222.0.11 () {58 vars in 1301 bytes} [Wed Nov 17 03:28:52 2021] GET /compute/v2.1/servers/a49437df-3059-4528-8328-2f3471d5fb45/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 17 03:28:53.311475 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-755482a2-548a-4e11-a50b-8f7c55af10c3 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:28:53.312345 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-755482a2-548a-4e11-a50b-8f7c55af10c3 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] [instance: 0698dc5b-5f47-46c4-ace8-f5e891a964a0] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:28:53.323410 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-755482a2-548a-4e11-a50b-8f7c55af10c3 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:28:53.324178 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-755482a2-548a-4e11-a50b-8f7c55af10c3 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:28:53.325544 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-755482a2-548a-4e11-a50b-8f7c55af10c3 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:28:53.326304 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-755482a2-548a-4e11-a50b-8f7c55af10c3 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:28:53.467601 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-755482a2-548a-4e11-a50b-8f7c55af10c3 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '163b2f24a72649ac8084be1cac32fa09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e123e9b86124c93a7fc2db9984e7466', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:28:53.475301 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-755482a2-548a-4e11-a50b-8f7c55af10c3 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] 10.222.0.11 "GET /compute/v2.1/servers/0698dc5b-5f47-46c4-ace8-f5e891a964a0" status: 200 len: 1257 microversion: 2.1 time: 0.170501 Nov 17 03:28:53.475882 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 390/805] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:28:53 2021] GET /compute/v2.1/servers/0698dc5b-5f47-46c4-ace8-f5e891a964a0 => generated 1257 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:28:53.877820 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-1632bd4b-c48f-4d83-8fec-3fa49cf8c834 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:28:53.878751 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-1632bd4b-c48f-4d83-8fec-3fa49cf8c834 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] [instance: a49437df-3059-4528-8328-2f3471d5fb45] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:28:53.885472 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-1632bd4b-c48f-4d83-8fec-3fa49cf8c834 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:28:53.886090 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-1632bd4b-c48f-4d83-8fec-3fa49cf8c834 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:28:53.886688 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-1632bd4b-c48f-4d83-8fec-3fa49cf8c834 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:28:53.887128 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-1632bd4b-c48f-4d83-8fec-3fa49cf8c834 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:28:53.919101 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-1632bd4b-c48f-4d83-8fec-3fa49cf8c834 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] 10.222.0.11 "GET /compute/v2.1/servers/a49437df-3059-4528-8328-2f3471d5fb45/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046585 Nov 17 03:28:53.919666 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 416/806] 10.222.0.11 () {58 vars in 1301 bytes} [Wed Nov 17 03:28:53 2021] GET /compute/v2.1/servers/a49437df-3059-4528-8328-2f3471d5fb45/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 17 03:28:54.495730 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-f6578396-1912-4329-9b1c-476079922eab tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:28:54.496654 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-f6578396-1912-4329-9b1c-476079922eab tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] [instance: 0698dc5b-5f47-46c4-ace8-f5e891a964a0] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:28:54.505192 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-f6578396-1912-4329-9b1c-476079922eab tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:28:54.505644 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-f6578396-1912-4329-9b1c-476079922eab tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:28:54.506410 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-f6578396-1912-4329-9b1c-476079922eab tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:28:54.506841 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-f6578396-1912-4329-9b1c-476079922eab tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:28:54.645275 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-f6578396-1912-4329-9b1c-476079922eab tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '163b2f24a72649ac8084be1cac32fa09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e123e9b86124c93a7fc2db9984e7466', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:28:54.657457 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-f6578396-1912-4329-9b1c-476079922eab tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] 10.222.0.11 "GET /compute/v2.1/servers/0698dc5b-5f47-46c4-ace8-f5e891a964a0" status: 200 len: 1257 microversion: 2.1 time: 0.167361 Nov 17 03:28:54.658060 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 391/807] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:28:54 2021] GET /compute/v2.1/servers/0698dc5b-5f47-46c4-ace8-f5e891a964a0 => generated 1257 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:28:54.931043 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-db7173e9-ee90-458c-bbcd-0e933a61dcb9 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:28:54.932376 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-db7173e9-ee90-458c-bbcd-0e933a61dcb9 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] [instance: a49437df-3059-4528-8328-2f3471d5fb45] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:28:54.939547 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-db7173e9-ee90-458c-bbcd-0e933a61dcb9 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:28:54.940028 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-db7173e9-ee90-458c-bbcd-0e933a61dcb9 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:28:54.940884 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-db7173e9-ee90-458c-bbcd-0e933a61dcb9 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:28:54.941324 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-db7173e9-ee90-458c-bbcd-0e933a61dcb9 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:28:54.971571 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-db7173e9-ee90-458c-bbcd-0e933a61dcb9 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] 10.222.0.11 "GET /compute/v2.1/servers/a49437df-3059-4528-8328-2f3471d5fb45/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044588 Nov 17 03:28:54.972120 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 417/808] 10.222.0.11 () {58 vars in 1301 bytes} [Wed Nov 17 03:28:54 2021] GET /compute/v2.1/servers/a49437df-3059-4528-8328-2f3471d5fb45/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 17 03:28:55.674149 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-8c22720c-db0e-4b6e-a957-09ba04f19f30 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:28:55.674755 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-8c22720c-db0e-4b6e-a957-09ba04f19f30 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] [instance: 0698dc5b-5f47-46c4-ace8-f5e891a964a0] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:28:55.681880 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-8c22720c-db0e-4b6e-a957-09ba04f19f30 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:28:55.682330 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-8c22720c-db0e-4b6e-a957-09ba04f19f30 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:28:55.683100 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-8c22720c-db0e-4b6e-a957-09ba04f19f30 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:28:55.683527 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-8c22720c-db0e-4b6e-a957-09ba04f19f30 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:28:55.839184 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-8c22720c-db0e-4b6e-a957-09ba04f19f30 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '163b2f24a72649ac8084be1cac32fa09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e123e9b86124c93a7fc2db9984e7466', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:28:55.848887 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-8c22720c-db0e-4b6e-a957-09ba04f19f30 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] 10.222.0.11 "GET /compute/v2.1/servers/0698dc5b-5f47-46c4-ace8-f5e891a964a0" status: 200 len: 1257 microversion: 2.1 time: 0.178679 Nov 17 03:28:55.849435 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 392/809] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:28:55 2021] GET /compute/v2.1/servers/0698dc5b-5f47-46c4-ace8-f5e891a964a0 => generated 1257 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:28:55.986819 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-93ca4789-ef52-45a9-ab94-0866c05fb429 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:28:55.988297 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-93ca4789-ef52-45a9-ab94-0866c05fb429 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] [instance: a49437df-3059-4528-8328-2f3471d5fb45] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:28:55.998888 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-93ca4789-ef52-45a9-ab94-0866c05fb429 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:28:55.999630 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-93ca4789-ef52-45a9-ab94-0866c05fb429 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:28:56.000885 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-93ca4789-ef52-45a9-ab94-0866c05fb429 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:28:56.001364 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-93ca4789-ef52-45a9-ab94-0866c05fb429 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:28:56.031545 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-93ca4789-ef52-45a9-ab94-0866c05fb429 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] 10.222.0.11 "GET /compute/v2.1/servers/a49437df-3059-4528-8328-2f3471d5fb45/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051035 Nov 17 03:28:56.032218 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 418/810] 10.222.0.11 () {58 vars in 1301 bytes} [Wed Nov 17 03:28:55 2021] GET /compute/v2.1/servers/a49437df-3059-4528-8328-2f3471d5fb45/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 17 03:28:56.868268 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-43cd7e41-b449-4ca0-b0be-2612f45a0098 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:28:56.869171 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-43cd7e41-b449-4ca0-b0be-2612f45a0098 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] [instance: 0698dc5b-5f47-46c4-ace8-f5e891a964a0] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:28:56.878242 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-43cd7e41-b449-4ca0-b0be-2612f45a0098 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:28:56.878831 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-43cd7e41-b449-4ca0-b0be-2612f45a0098 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:28:56.879846 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-43cd7e41-b449-4ca0-b0be-2612f45a0098 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:28:56.880417 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-43cd7e41-b449-4ca0-b0be-2612f45a0098 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:28:57.045269 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-947c4d8b-2911-4162-b40c-2ab1be4719ce tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:28:57.047094 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-947c4d8b-2911-4162-b40c-2ab1be4719ce tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] [instance: a49437df-3059-4528-8328-2f3471d5fb45] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:28:57.048065 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-43cd7e41-b449-4ca0-b0be-2612f45a0098 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '163b2f24a72649ac8084be1cac32fa09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e123e9b86124c93a7fc2db9984e7466', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:28:57.056761 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-947c4d8b-2911-4162-b40c-2ab1be4719ce tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:28:57.057524 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-947c4d8b-2911-4162-b40c-2ab1be4719ce tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:28:57.058209 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-43cd7e41-b449-4ca0-b0be-2612f45a0098 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] 10.222.0.11 "GET /compute/v2.1/servers/0698dc5b-5f47-46c4-ace8-f5e891a964a0" status: 200 len: 1257 microversion: 2.1 time: 0.194777 Nov 17 03:28:57.058359 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-947c4d8b-2911-4162-b40c-2ab1be4719ce tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:28:57.058699 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-947c4d8b-2911-4162-b40c-2ab1be4719ce tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:28:57.059656 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 393/811] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:28:56 2021] GET /compute/v2.1/servers/0698dc5b-5f47-46c4-ace8-f5e891a964a0 => generated 1257 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:28:57.098143 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-947c4d8b-2911-4162-b40c-2ab1be4719ce tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] 10.222.0.11 "GET /compute/v2.1/servers/a49437df-3059-4528-8328-2f3471d5fb45/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.056617 Nov 17 03:28:57.098708 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 419/812] 10.222.0.11 () {58 vars in 1301 bytes} [Wed Nov 17 03:28:57 2021] GET /compute/v2.1/servers/a49437df-3059-4528-8328-2f3471d5fb45/os-volume_attachments => generated 197 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 17 03:28:58.075491 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-7200c906-6035-4b27-bad4-752ba2a897e4 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:28:58.076102 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-7200c906-6035-4b27-bad4-752ba2a897e4 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] [instance: 0698dc5b-5f47-46c4-ace8-f5e891a964a0] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:28:58.082883 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-7200c906-6035-4b27-bad4-752ba2a897e4 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:28:58.083330 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-7200c906-6035-4b27-bad4-752ba2a897e4 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:28:58.084107 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-7200c906-6035-4b27-bad4-752ba2a897e4 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:28:58.084543 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-7200c906-6035-4b27-bad4-752ba2a897e4 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:28:58.109969 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-0c7bf544-8a97-4811-8a47-3abb4bed850d tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:28:58.111703 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-0c7bf544-8a97-4811-8a47-3abb4bed850d tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] [instance: a49437df-3059-4528-8328-2f3471d5fb45] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:28:58.118408 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-0c7bf544-8a97-4811-8a47-3abb4bed850d tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:28:58.118865 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-0c7bf544-8a97-4811-8a47-3abb4bed850d tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:28:58.119654 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-0c7bf544-8a97-4811-8a47-3abb4bed850d tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:28:58.120083 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-0c7bf544-8a97-4811-8a47-3abb4bed850d tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:28:58.149956 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-0c7bf544-8a97-4811-8a47-3abb4bed850d tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] 10.222.0.11 "GET /compute/v2.1/servers/a49437df-3059-4528-8328-2f3471d5fb45/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043827 Nov 17 03:28:58.150718 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 420/813] 10.222.0.11 () {58 vars in 1301 bytes} [Wed Nov 17 03:28:58 2021] GET /compute/v2.1/servers/a49437df-3059-4528-8328-2f3471d5fb45/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 17 03:28:58.224434 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-7200c906-6035-4b27-bad4-752ba2a897e4 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '163b2f24a72649ac8084be1cac32fa09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e123e9b86124c93a7fc2db9984e7466', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:28:58.235599 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-7200c906-6035-4b27-bad4-752ba2a897e4 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] 10.222.0.11 "GET /compute/v2.1/servers/0698dc5b-5f47-46c4-ace8-f5e891a964a0" status: 200 len: 1257 microversion: 2.1 time: 0.163689 Nov 17 03:28:58.236142 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 394/814] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:28:58 2021] GET /compute/v2.1/servers/0698dc5b-5f47-46c4-ace8-f5e891a964a0 => generated 1257 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:28:59.162841 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-bf324273-8e7b-4571-a900-64826accb63b tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:28:59.163759 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-bf324273-8e7b-4571-a900-64826accb63b tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] [instance: a49437df-3059-4528-8328-2f3471d5fb45] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:28:59.170392 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-bf324273-8e7b-4571-a900-64826accb63b tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:28:59.170848 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-bf324273-8e7b-4571-a900-64826accb63b tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:28:59.171640 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-bf324273-8e7b-4571-a900-64826accb63b tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:28:59.172081 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-bf324273-8e7b-4571-a900-64826accb63b tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:28:59.204497 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-bf324273-8e7b-4571-a900-64826accb63b tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] 10.222.0.11 "GET /compute/v2.1/servers/a49437df-3059-4528-8328-2f3471d5fb45/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045380 Nov 17 03:28:59.205490 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 421/815] 10.222.0.11 () {58 vars in 1301 bytes} [Wed Nov 17 03:28:59 2021] GET /compute/v2.1/servers/a49437df-3059-4528-8328-2f3471d5fb45/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 17 03:28:59.251502 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-7c33d774-f0e6-4da0-b9fc-2550f08ec3ae tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:28:59.252219 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-7c33d774-f0e6-4da0-b9fc-2550f08ec3ae tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] [instance: 0698dc5b-5f47-46c4-ace8-f5e891a964a0] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:28:59.259186 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-7c33d774-f0e6-4da0-b9fc-2550f08ec3ae tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:28:59.259630 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-7c33d774-f0e6-4da0-b9fc-2550f08ec3ae tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:28:59.260402 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-7c33d774-f0e6-4da0-b9fc-2550f08ec3ae tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:28:59.260833 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-7c33d774-f0e6-4da0-b9fc-2550f08ec3ae tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:28:59.400123 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-7c33d774-f0e6-4da0-b9fc-2550f08ec3ae tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '163b2f24a72649ac8084be1cac32fa09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e123e9b86124c93a7fc2db9984e7466', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:28:59.411664 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-7c33d774-f0e6-4da0-b9fc-2550f08ec3ae tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] 10.222.0.11 "GET /compute/v2.1/servers/0698dc5b-5f47-46c4-ace8-f5e891a964a0" status: 200 len: 1257 microversion: 2.1 time: 0.163685 Nov 17 03:28:59.412518 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 395/816] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:28:59 2021] GET /compute/v2.1/servers/0698dc5b-5f47-46c4-ace8-f5e891a964a0 => generated 1257 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:29:00.217583 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-eed8c3c3-296b-46bc-85e1-03f24c8e0087 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:29:00.218919 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-eed8c3c3-296b-46bc-85e1-03f24c8e0087 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] [instance: a49437df-3059-4528-8328-2f3471d5fb45] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:29:00.228837 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-eed8c3c3-296b-46bc-85e1-03f24c8e0087 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:29:00.229631 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-eed8c3c3-296b-46bc-85e1-03f24c8e0087 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:29:00.230859 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-eed8c3c3-296b-46bc-85e1-03f24c8e0087 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:29:00.231486 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-eed8c3c3-296b-46bc-85e1-03f24c8e0087 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:29:00.263223 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-eed8c3c3-296b-46bc-85e1-03f24c8e0087 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] 10.222.0.11 "GET /compute/v2.1/servers/a49437df-3059-4528-8328-2f3471d5fb45/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051047 Nov 17 03:29:00.263797 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 422/817] 10.222.0.11 () {58 vars in 1301 bytes} [Wed Nov 17 03:29:00 2021] GET /compute/v2.1/servers/a49437df-3059-4528-8328-2f3471d5fb45/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 17 03:29:00.432407 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-a2909a2b-7889-496c-ac25-90fbdcbd18cd tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:29:00.433061 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-a2909a2b-7889-496c-ac25-90fbdcbd18cd tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] [instance: 0698dc5b-5f47-46c4-ace8-f5e891a964a0] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:29:00.441533 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-a2909a2b-7889-496c-ac25-90fbdcbd18cd tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:29:00.441975 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-a2909a2b-7889-496c-ac25-90fbdcbd18cd tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:29:00.442736 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-a2909a2b-7889-496c-ac25-90fbdcbd18cd tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:29:00.443160 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-a2909a2b-7889-496c-ac25-90fbdcbd18cd tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:29:00.574700 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-a2909a2b-7889-496c-ac25-90fbdcbd18cd tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '163b2f24a72649ac8084be1cac32fa09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e123e9b86124c93a7fc2db9984e7466', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:29:00.582801 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-a2909a2b-7889-496c-ac25-90fbdcbd18cd tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] 10.222.0.11 "GET /compute/v2.1/servers/0698dc5b-5f47-46c4-ace8-f5e891a964a0" status: 200 len: 1257 microversion: 2.1 time: 0.156553 Nov 17 03:29:00.583362 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 396/818] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:29:00 2021] GET /compute/v2.1/servers/0698dc5b-5f47-46c4-ace8-f5e891a964a0 => generated 1257 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:29:01.278048 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-ce33b6a4-1d70-4b5b-bf18-9eb1a1e0e1c7 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:29:01.279696 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-ce33b6a4-1d70-4b5b-bf18-9eb1a1e0e1c7 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] [instance: a49437df-3059-4528-8328-2f3471d5fb45] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:29:01.287630 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-ce33b6a4-1d70-4b5b-bf18-9eb1a1e0e1c7 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:29:01.288056 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-ce33b6a4-1d70-4b5b-bf18-9eb1a1e0e1c7 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:29:01.288954 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-ce33b6a4-1d70-4b5b-bf18-9eb1a1e0e1c7 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:29:01.289378 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-ce33b6a4-1d70-4b5b-bf18-9eb1a1e0e1c7 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:29:01.319736 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-ce33b6a4-1d70-4b5b-bf18-9eb1a1e0e1c7 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] 10.222.0.11 "GET /compute/v2.1/servers/a49437df-3059-4528-8328-2f3471d5fb45/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047920 Nov 17 03:29:01.320264 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 423/819] 10.222.0.11 () {58 vars in 1301 bytes} [Wed Nov 17 03:29:01 2021] GET /compute/v2.1/servers/a49437df-3059-4528-8328-2f3471d5fb45/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 17 03:29:01.608381 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-c97eb936-753c-4635-b1a4-5b4b0595677e tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:29:01.609432 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-c97eb936-753c-4635-b1a4-5b4b0595677e tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] [instance: 0698dc5b-5f47-46c4-ace8-f5e891a964a0] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:29:01.617098 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-c97eb936-753c-4635-b1a4-5b4b0595677e tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:29:01.617540 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-c97eb936-753c-4635-b1a4-5b4b0595677e tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:29:01.618302 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-c97eb936-753c-4635-b1a4-5b4b0595677e tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:29:01.618727 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-c97eb936-753c-4635-b1a4-5b4b0595677e tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:29:01.762766 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-c97eb936-753c-4635-b1a4-5b4b0595677e tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '163b2f24a72649ac8084be1cac32fa09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e123e9b86124c93a7fc2db9984e7466', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:29:01.771039 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-c97eb936-753c-4635-b1a4-5b4b0595677e tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] 10.222.0.11 "GET /compute/v2.1/servers/0698dc5b-5f47-46c4-ace8-f5e891a964a0" status: 200 len: 1257 microversion: 2.1 time: 0.168883 Nov 17 03:29:01.771629 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 397/820] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:29:01 2021] GET /compute/v2.1/servers/0698dc5b-5f47-46c4-ace8-f5e891a964a0 => generated 1257 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:29:02.333171 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-df1fb5bb-b94f-4c44-930e-c348202760a5 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:29:02.334195 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-df1fb5bb-b94f-4c44-930e-c348202760a5 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] [instance: a49437df-3059-4528-8328-2f3471d5fb45] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:29:02.340996 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-df1fb5bb-b94f-4c44-930e-c348202760a5 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:29:02.341550 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-df1fb5bb-b94f-4c44-930e-c348202760a5 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:29:02.342245 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-df1fb5bb-b94f-4c44-930e-c348202760a5 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:29:02.342680 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-df1fb5bb-b94f-4c44-930e-c348202760a5 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:29:02.372678 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-df1fb5bb-b94f-4c44-930e-c348202760a5 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] 10.222.0.11 "GET /compute/v2.1/servers/a49437df-3059-4528-8328-2f3471d5fb45/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043969 Nov 17 03:29:02.373272 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 424/821] 10.222.0.11 () {58 vars in 1301 bytes} [Wed Nov 17 03:29:02 2021] GET /compute/v2.1/servers/a49437df-3059-4528-8328-2f3471d5fb45/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 17 03:29:02.791016 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-273e68de-72e8-46a9-b8d1-473375b6b1cb tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:29:02.791931 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-273e68de-72e8-46a9-b8d1-473375b6b1cb tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] [instance: 0698dc5b-5f47-46c4-ace8-f5e891a964a0] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:29:02.802697 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-273e68de-72e8-46a9-b8d1-473375b6b1cb tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:29:02.803479 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-273e68de-72e8-46a9-b8d1-473375b6b1cb tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:29:02.804734 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-273e68de-72e8-46a9-b8d1-473375b6b1cb tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:29:02.806147 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-273e68de-72e8-46a9-b8d1-473375b6b1cb tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:29:02.947655 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-273e68de-72e8-46a9-b8d1-473375b6b1cb tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '163b2f24a72649ac8084be1cac32fa09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e123e9b86124c93a7fc2db9984e7466', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:29:02.959298 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-273e68de-72e8-46a9-b8d1-473375b6b1cb tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] 10.222.0.11 "GET /compute/v2.1/servers/0698dc5b-5f47-46c4-ace8-f5e891a964a0" status: 200 len: 1257 microversion: 2.1 time: 0.174121 Nov 17 03:29:02.960070 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 398/822] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:29:02 2021] GET /compute/v2.1/servers/0698dc5b-5f47-46c4-ace8-f5e891a964a0 => generated 1257 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:29:03.387406 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-5ca5a433-13b2-48e0-999c-2b3d370e088f tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:29:03.389082 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-5ca5a433-13b2-48e0-999c-2b3d370e088f tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] [instance: a49437df-3059-4528-8328-2f3471d5fb45] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:29:03.397011 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-5ca5a433-13b2-48e0-999c-2b3d370e088f tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:29:03.397471 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-5ca5a433-13b2-48e0-999c-2b3d370e088f tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:29:03.398355 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-5ca5a433-13b2-48e0-999c-2b3d370e088f tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:29:03.398679 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-5ca5a433-13b2-48e0-999c-2b3d370e088f tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:29:03.428616 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-5ca5a433-13b2-48e0-999c-2b3d370e088f tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] 10.222.0.11 "GET /compute/v2.1/servers/a49437df-3059-4528-8328-2f3471d5fb45/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047514 Nov 17 03:29:03.429222 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 425/823] 10.222.0.11 () {58 vars in 1301 bytes} [Wed Nov 17 03:29:03 2021] GET /compute/v2.1/servers/a49437df-3059-4528-8328-2f3471d5fb45/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 17 03:29:03.983271 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-3ad68b88-9d7d-4492-98b1-07778c8ef0cb tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:29:03.984174 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-3ad68b88-9d7d-4492-98b1-07778c8ef0cb tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] [instance: 0698dc5b-5f47-46c4-ace8-f5e891a964a0] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:29:03.991727 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-3ad68b88-9d7d-4492-98b1-07778c8ef0cb tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:29:03.992173 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-3ad68b88-9d7d-4492-98b1-07778c8ef0cb tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:29:03.992977 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-3ad68b88-9d7d-4492-98b1-07778c8ef0cb tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:29:03.993406 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-3ad68b88-9d7d-4492-98b1-07778c8ef0cb tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:29:04.138699 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-3ad68b88-9d7d-4492-98b1-07778c8ef0cb tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '163b2f24a72649ac8084be1cac32fa09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e123e9b86124c93a7fc2db9984e7466', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:29:04.146182 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-3ad68b88-9d7d-4492-98b1-07778c8ef0cb tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] 10.222.0.11 "GET /compute/v2.1/servers/0698dc5b-5f47-46c4-ace8-f5e891a964a0" status: 200 len: 1257 microversion: 2.1 time: 0.169331 Nov 17 03:29:04.146745 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 399/824] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:29:03 2021] GET /compute/v2.1/servers/0698dc5b-5f47-46c4-ace8-f5e891a964a0 => generated 1257 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:29:04.443180 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-ec58e0c0-4466-46d8-b68c-35b66a524e6f tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:29:04.444104 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-ec58e0c0-4466-46d8-b68c-35b66a524e6f tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] [instance: a49437df-3059-4528-8328-2f3471d5fb45] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:29:04.450470 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-ec58e0c0-4466-46d8-b68c-35b66a524e6f tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:29:04.450923 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-ec58e0c0-4466-46d8-b68c-35b66a524e6f tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:29:04.451702 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-ec58e0c0-4466-46d8-b68c-35b66a524e6f tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:29:04.452130 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-ec58e0c0-4466-46d8-b68c-35b66a524e6f tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:29:04.482443 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-ec58e0c0-4466-46d8-b68c-35b66a524e6f tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] 10.222.0.11 "GET /compute/v2.1/servers/a49437df-3059-4528-8328-2f3471d5fb45/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044041 Nov 17 03:29:04.483005 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 426/825] 10.222.0.11 () {58 vars in 1301 bytes} [Wed Nov 17 03:29:04 2021] GET /compute/v2.1/servers/a49437df-3059-4528-8328-2f3471d5fb45/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 17 03:29:05.163691 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-f7d5efc1-5c32-4499-b28b-0ade94ef4381 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:29:05.164300 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-f7d5efc1-5c32-4499-b28b-0ade94ef4381 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] [instance: 0698dc5b-5f47-46c4-ace8-f5e891a964a0] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:29:05.170911 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-f7d5efc1-5c32-4499-b28b-0ade94ef4381 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:29:05.171360 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-f7d5efc1-5c32-4499-b28b-0ade94ef4381 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:29:05.172133 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-f7d5efc1-5c32-4499-b28b-0ade94ef4381 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:29:05.172569 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-f7d5efc1-5c32-4499-b28b-0ade94ef4381 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:29:05.304181 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-f7d5efc1-5c32-4499-b28b-0ade94ef4381 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '163b2f24a72649ac8084be1cac32fa09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e123e9b86124c93a7fc2db9984e7466', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:29:05.312000 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-f7d5efc1-5c32-4499-b28b-0ade94ef4381 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] 10.222.0.11 "GET /compute/v2.1/servers/0698dc5b-5f47-46c4-ace8-f5e891a964a0" status: 200 len: 1257 microversion: 2.1 time: 0.151876 Nov 17 03:29:05.312503 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 400/826] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:29:05 2021] GET /compute/v2.1/servers/0698dc5b-5f47-46c4-ace8-f5e891a964a0 => generated 1257 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:29:05.494397 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-456c9822-dae2-4bf7-bf44-de87be0bea86 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:29:05.495315 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-456c9822-dae2-4bf7-bf44-de87be0bea86 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] [instance: a49437df-3059-4528-8328-2f3471d5fb45] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:29:05.501864 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-456c9822-dae2-4bf7-bf44-de87be0bea86 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:29:05.502366 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-456c9822-dae2-4bf7-bf44-de87be0bea86 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:29:05.503149 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-456c9822-dae2-4bf7-bf44-de87be0bea86 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:29:05.503580 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-456c9822-dae2-4bf7-bf44-de87be0bea86 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:29:05.533461 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-456c9822-dae2-4bf7-bf44-de87be0bea86 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] 10.222.0.11 "GET /compute/v2.1/servers/a49437df-3059-4528-8328-2f3471d5fb45/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042738 Nov 17 03:29:05.534204 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 427/827] 10.222.0.11 () {58 vars in 1301 bytes} [Wed Nov 17 03:29:05 2021] GET /compute/v2.1/servers/a49437df-3059-4528-8328-2f3471d5fb45/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 17 03:29:06.331027 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-c3c7678a-82da-4091-b347-050d7e79fdb1 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:29:06.331568 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-c3c7678a-82da-4091-b347-050d7e79fdb1 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] [instance: 0698dc5b-5f47-46c4-ace8-f5e891a964a0] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:29:06.338415 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-c3c7678a-82da-4091-b347-050d7e79fdb1 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:29:06.338858 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-c3c7678a-82da-4091-b347-050d7e79fdb1 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:29:06.339653 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-c3c7678a-82da-4091-b347-050d7e79fdb1 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:29:06.340080 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-c3c7678a-82da-4091-b347-050d7e79fdb1 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:29:06.487068 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-c3c7678a-82da-4091-b347-050d7e79fdb1 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '163b2f24a72649ac8084be1cac32fa09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e123e9b86124c93a7fc2db9984e7466', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:29:06.494677 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-c3c7678a-82da-4091-b347-050d7e79fdb1 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] 10.222.0.11 "GET /compute/v2.1/servers/0698dc5b-5f47-46c4-ace8-f5e891a964a0" status: 200 len: 1257 microversion: 2.1 time: 0.169097 Nov 17 03:29:06.495223 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 401/828] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:29:06 2021] GET /compute/v2.1/servers/0698dc5b-5f47-46c4-ace8-f5e891a964a0 => generated 1257 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:29:06.545191 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-1106e671-5b85-4df2-932c-ec344ab9411a tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:29:06.546208 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-1106e671-5b85-4df2-932c-ec344ab9411a tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] [instance: a49437df-3059-4528-8328-2f3471d5fb45] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:29:06.553326 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-1106e671-5b85-4df2-932c-ec344ab9411a tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:29:06.553778 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-1106e671-5b85-4df2-932c-ec344ab9411a tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:29:06.554584 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-1106e671-5b85-4df2-932c-ec344ab9411a tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:29:06.554999 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-1106e671-5b85-4df2-932c-ec344ab9411a tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:29:06.593095 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-1106e671-5b85-4df2-932c-ec344ab9411a tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] 10.222.0.11 "GET /compute/v2.1/servers/a49437df-3059-4528-8328-2f3471d5fb45/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051757 Nov 17 03:29:06.593575 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 428/829] 10.222.0.11 () {58 vars in 1301 bytes} [Wed Nov 17 03:29:06 2021] GET /compute/v2.1/servers/a49437df-3059-4528-8328-2f3471d5fb45/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 17 03:29:07.512025 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-4cb811e8-d9ad-4de3-8c92-7ae4151096f2 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:29:07.512629 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-4cb811e8-d9ad-4de3-8c92-7ae4151096f2 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] [instance: 0698dc5b-5f47-46c4-ace8-f5e891a964a0] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:29:07.519448 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-4cb811e8-d9ad-4de3-8c92-7ae4151096f2 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:29:07.519893 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-4cb811e8-d9ad-4de3-8c92-7ae4151096f2 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:29:07.520654 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-4cb811e8-d9ad-4de3-8c92-7ae4151096f2 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:29:07.521113 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-4cb811e8-d9ad-4de3-8c92-7ae4151096f2 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:29:07.604796 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-c88ac97f-9c88-44f4-bb14-69ecae3bc876 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:29:07.605753 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-c88ac97f-9c88-44f4-bb14-69ecae3bc876 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] [instance: a49437df-3059-4528-8328-2f3471d5fb45] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:29:07.613266 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-c88ac97f-9c88-44f4-bb14-69ecae3bc876 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:29:07.613708 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-c88ac97f-9c88-44f4-bb14-69ecae3bc876 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:29:07.614955 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-c88ac97f-9c88-44f4-bb14-69ecae3bc876 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:29:07.615694 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-c88ac97f-9c88-44f4-bb14-69ecae3bc876 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:29:07.646727 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-c88ac97f-9c88-44f4-bb14-69ecae3bc876 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] 10.222.0.11 "GET /compute/v2.1/servers/a49437df-3059-4528-8328-2f3471d5fb45/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045785 Nov 17 03:29:07.647633 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 429/830] 10.222.0.11 () {58 vars in 1301 bytes} [Wed Nov 17 03:29:07 2021] GET /compute/v2.1/servers/a49437df-3059-4528-8328-2f3471d5fb45/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 17 03:29:07.661807 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-4cb811e8-d9ad-4de3-8c92-7ae4151096f2 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '163b2f24a72649ac8084be1cac32fa09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e123e9b86124c93a7fc2db9984e7466', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:29:07.669265 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-4cb811e8-d9ad-4de3-8c92-7ae4151096f2 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] 10.222.0.11 "GET /compute/v2.1/servers/0698dc5b-5f47-46c4-ace8-f5e891a964a0" status: 200 len: 1257 microversion: 2.1 time: 0.160900 Nov 17 03:29:07.669835 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 402/831] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:29:07 2021] GET /compute/v2.1/servers/0698dc5b-5f47-46c4-ace8-f5e891a964a0 => generated 1257 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:29:08.660629 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-5cdf98b1-37ff-4513-9c13-1fe0945a51fd tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:29:08.661653 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-5cdf98b1-37ff-4513-9c13-1fe0945a51fd tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] [instance: a49437df-3059-4528-8328-2f3471d5fb45] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:29:08.668077 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-5cdf98b1-37ff-4513-9c13-1fe0945a51fd tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:29:08.668532 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-5cdf98b1-37ff-4513-9c13-1fe0945a51fd tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:29:08.669342 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-5cdf98b1-37ff-4513-9c13-1fe0945a51fd tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:29:08.669777 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-5cdf98b1-37ff-4513-9c13-1fe0945a51fd tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:29:08.689440 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-d7063ce2-3dc4-4e43-bfb0-2e1badb451f9 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:29:08.689440 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-d7063ce2-3dc4-4e43-bfb0-2e1badb451f9 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] [instance: 0698dc5b-5f47-46c4-ace8-f5e891a964a0] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:29:08.693926 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-d7063ce2-3dc4-4e43-bfb0-2e1badb451f9 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:29:08.694373 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-d7063ce2-3dc4-4e43-bfb0-2e1badb451f9 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:29:08.695141 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-d7063ce2-3dc4-4e43-bfb0-2e1badb451f9 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:29:08.695569 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-d7063ce2-3dc4-4e43-bfb0-2e1badb451f9 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:29:08.701257 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-5cdf98b1-37ff-4513-9c13-1fe0945a51fd tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] 10.222.0.11 "GET /compute/v2.1/servers/a49437df-3059-4528-8328-2f3471d5fb45/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046068 Nov 17 03:29:08.701838 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 430/832] 10.222.0.11 () {58 vars in 1301 bytes} [Wed Nov 17 03:29:08 2021] GET /compute/v2.1/servers/a49437df-3059-4528-8328-2f3471d5fb45/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 17 03:29:08.843930 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-d7063ce2-3dc4-4e43-bfb0-2e1badb451f9 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '163b2f24a72649ac8084be1cac32fa09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e123e9b86124c93a7fc2db9984e7466', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:29:08.851898 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-d7063ce2-3dc4-4e43-bfb0-2e1badb451f9 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] 10.222.0.11 "GET /compute/v2.1/servers/0698dc5b-5f47-46c4-ace8-f5e891a964a0" status: 200 len: 1257 microversion: 2.1 time: 0.168912 Nov 17 03:29:08.852479 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 403/833] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:29:08 2021] GET /compute/v2.1/servers/0698dc5b-5f47-46c4-ace8-f5e891a964a0 => generated 1257 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:29:09.716518 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-960f57d0-453a-4778-b5ee-fca36fae9d49 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:29:09.718065 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-960f57d0-453a-4778-b5ee-fca36fae9d49 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] [instance: a49437df-3059-4528-8328-2f3471d5fb45] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:29:09.725580 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-960f57d0-453a-4778-b5ee-fca36fae9d49 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:29:09.726023 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-960f57d0-453a-4778-b5ee-fca36fae9d49 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:29:09.726796 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-960f57d0-453a-4778-b5ee-fca36fae9d49 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:29:09.727222 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-960f57d0-453a-4778-b5ee-fca36fae9d49 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:29:09.757507 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-960f57d0-453a-4778-b5ee-fca36fae9d49 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] 10.222.0.11 "GET /compute/v2.1/servers/a49437df-3059-4528-8328-2f3471d5fb45/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047176 Nov 17 03:29:09.758054 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 431/834] 10.222.0.11 () {58 vars in 1301 bytes} [Wed Nov 17 03:29:09 2021] GET /compute/v2.1/servers/a49437df-3059-4528-8328-2f3471d5fb45/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 17 03:29:09.872909 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-4e873518-f831-4083-864f-e475ea0ffbba tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:29:09.875987 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-4e873518-f831-4083-864f-e475ea0ffbba tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] [instance: 0698dc5b-5f47-46c4-ace8-f5e891a964a0] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:29:09.884734 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-4e873518-f831-4083-864f-e475ea0ffbba tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:29:09.885536 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-4e873518-f831-4083-864f-e475ea0ffbba tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:29:09.886822 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-4e873518-f831-4083-864f-e475ea0ffbba tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:29:09.887545 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-4e873518-f831-4083-864f-e475ea0ffbba tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:29:10.027530 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-4e873518-f831-4083-864f-e475ea0ffbba tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '163b2f24a72649ac8084be1cac32fa09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e123e9b86124c93a7fc2db9984e7466', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:29:10.037466 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-4e873518-f831-4083-864f-e475ea0ffbba tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] 10.222.0.11 "GET /compute/v2.1/servers/0698dc5b-5f47-46c4-ace8-f5e891a964a0" status: 200 len: 1257 microversion: 2.1 time: 0.170624 Nov 17 03:29:10.038018 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 404/835] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:29:09 2021] GET /compute/v2.1/servers/0698dc5b-5f47-46c4-ace8-f5e891a964a0 => generated 1257 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:29:10.771965 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-14ec0ff5-8cee-4b52-84a0-b803d4c708f8 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:29:10.772915 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-14ec0ff5-8cee-4b52-84a0-b803d4c708f8 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] [instance: a49437df-3059-4528-8328-2f3471d5fb45] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:29:10.779030 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-14ec0ff5-8cee-4b52-84a0-b803d4c708f8 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:29:10.779490 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-14ec0ff5-8cee-4b52-84a0-b803d4c708f8 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:29:10.780339 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-14ec0ff5-8cee-4b52-84a0-b803d4c708f8 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:29:10.780876 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-14ec0ff5-8cee-4b52-84a0-b803d4c708f8 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:29:10.811500 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-14ec0ff5-8cee-4b52-84a0-b803d4c708f8 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] 10.222.0.11 "GET /compute/v2.1/servers/a49437df-3059-4528-8328-2f3471d5fb45/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044931 Nov 17 03:29:10.812055 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 432/836] 10.222.0.11 () {58 vars in 1301 bytes} [Wed Nov 17 03:29:10 2021] GET /compute/v2.1/servers/a49437df-3059-4528-8328-2f3471d5fb45/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 17 03:29:11.058515 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-ce6ec3ea-e855-4c54-a980-f76f934b2c34 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:29:11.059312 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-ce6ec3ea-e855-4c54-a980-f76f934b2c34 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] [instance: 0698dc5b-5f47-46c4-ace8-f5e891a964a0] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:29:11.068589 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-ce6ec3ea-e855-4c54-a980-f76f934b2c34 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:29:11.069065 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-ce6ec3ea-e855-4c54-a980-f76f934b2c34 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:29:11.069875 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-ce6ec3ea-e855-4c54-a980-f76f934b2c34 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:29:11.070271 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-ce6ec3ea-e855-4c54-a980-f76f934b2c34 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:29:11.211031 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-ce6ec3ea-e855-4c54-a980-f76f934b2c34 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '163b2f24a72649ac8084be1cac32fa09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e123e9b86124c93a7fc2db9984e7466', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:29:11.218570 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-ce6ec3ea-e855-4c54-a980-f76f934b2c34 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] 10.222.0.11 "GET /compute/v2.1/servers/0698dc5b-5f47-46c4-ace8-f5e891a964a0" status: 200 len: 1257 microversion: 2.1 time: 0.167086 Nov 17 03:29:11.219098 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 405/837] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:29:11 2021] GET /compute/v2.1/servers/0698dc5b-5f47-46c4-ace8-f5e891a964a0 => generated 1257 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:29:11.823966 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-b3f94b66-ba38-40fe-9606-d40d60146c7b tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:29:11.824962 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-b3f94b66-ba38-40fe-9606-d40d60146c7b tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] [instance: a49437df-3059-4528-8328-2f3471d5fb45] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:29:11.831982 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-b3f94b66-ba38-40fe-9606-d40d60146c7b tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:29:11.833168 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-b3f94b66-ba38-40fe-9606-d40d60146c7b tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:29:11.834097 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-b3f94b66-ba38-40fe-9606-d40d60146c7b tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:29:11.834557 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-b3f94b66-ba38-40fe-9606-d40d60146c7b tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:29:11.864875 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-b3f94b66-ba38-40fe-9606-d40d60146c7b tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] 10.222.0.11 "GET /compute/v2.1/servers/a49437df-3059-4528-8328-2f3471d5fb45/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044956 Nov 17 03:29:11.865434 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 433/838] 10.222.0.11 () {58 vars in 1301 bytes} [Wed Nov 17 03:29:11 2021] GET /compute/v2.1/servers/a49437df-3059-4528-8328-2f3471d5fb45/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 17 03:29:12.239066 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-2fe92f89-b4e6-4664-8c50-2e9f8a04d119 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:29:12.239684 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-2fe92f89-b4e6-4664-8c50-2e9f8a04d119 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] [instance: 0698dc5b-5f47-46c4-ace8-f5e891a964a0] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:29:12.248044 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-2fe92f89-b4e6-4664-8c50-2e9f8a04d119 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:29:12.248598 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-2fe92f89-b4e6-4664-8c50-2e9f8a04d119 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:29:12.249605 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-2fe92f89-b4e6-4664-8c50-2e9f8a04d119 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:29:12.250142 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-2fe92f89-b4e6-4664-8c50-2e9f8a04d119 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:29:12.397368 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-2fe92f89-b4e6-4664-8c50-2e9f8a04d119 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '163b2f24a72649ac8084be1cac32fa09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e123e9b86124c93a7fc2db9984e7466', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:29:12.408406 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-2fe92f89-b4e6-4664-8c50-2e9f8a04d119 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] 10.222.0.11 "GET /compute/v2.1/servers/0698dc5b-5f47-46c4-ace8-f5e891a964a0" status: 200 len: 1257 microversion: 2.1 time: 0.175117 Nov 17 03:29:12.409441 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 406/839] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:29:12 2021] GET /compute/v2.1/servers/0698dc5b-5f47-46c4-ace8-f5e891a964a0 => generated 1257 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:29:12.876184 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-896ab47b-e885-4b6f-b926-d5e7ffcb52d1 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:29:12.877127 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-896ab47b-e885-4b6f-b926-d5e7ffcb52d1 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] [instance: a49437df-3059-4528-8328-2f3471d5fb45] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:29:12.883911 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-896ab47b-e885-4b6f-b926-d5e7ffcb52d1 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:29:12.884361 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-896ab47b-e885-4b6f-b926-d5e7ffcb52d1 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:29:12.885458 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-896ab47b-e885-4b6f-b926-d5e7ffcb52d1 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:29:12.886038 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-896ab47b-e885-4b6f-b926-d5e7ffcb52d1 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:29:12.917018 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-896ab47b-e885-4b6f-b926-d5e7ffcb52d1 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] 10.222.0.11 "GET /compute/v2.1/servers/a49437df-3059-4528-8328-2f3471d5fb45/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045079 Nov 17 03:29:12.918002 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 434/840] 10.222.0.11 () {58 vars in 1301 bytes} [Wed Nov 17 03:29:12 2021] GET /compute/v2.1/servers/a49437df-3059-4528-8328-2f3471d5fb45/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 17 03:29:13.426909 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-c3696383-712a-4356-9b5d-0cae62af13f9 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:29:13.427510 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-c3696383-712a-4356-9b5d-0cae62af13f9 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] [instance: 0698dc5b-5f47-46c4-ace8-f5e891a964a0] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:29:13.434599 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-c3696383-712a-4356-9b5d-0cae62af13f9 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:29:13.435047 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-c3696383-712a-4356-9b5d-0cae62af13f9 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:29:13.435832 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-c3696383-712a-4356-9b5d-0cae62af13f9 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:29:13.436339 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-c3696383-712a-4356-9b5d-0cae62af13f9 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:29:13.575230 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-c3696383-712a-4356-9b5d-0cae62af13f9 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '163b2f24a72649ac8084be1cac32fa09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e123e9b86124c93a7fc2db9984e7466', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:29:13.585092 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-c3696383-712a-4356-9b5d-0cae62af13f9 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] 10.222.0.11 "GET /compute/v2.1/servers/0698dc5b-5f47-46c4-ace8-f5e891a964a0" status: 200 len: 1257 microversion: 2.1 time: 0.162485 Nov 17 03:29:13.585670 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 407/841] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:29:13 2021] GET /compute/v2.1/servers/0698dc5b-5f47-46c4-ace8-f5e891a964a0 => generated 1257 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:29:13.932105 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-04251c66-6c6b-4e72-8618-fb78ea1feff7 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:29:13.933613 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-04251c66-6c6b-4e72-8618-fb78ea1feff7 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] [instance: a49437df-3059-4528-8328-2f3471d5fb45] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:29:13.943395 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-04251c66-6c6b-4e72-8618-fb78ea1feff7 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:29:13.943815 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-04251c66-6c6b-4e72-8618-fb78ea1feff7 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:29:13.944614 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-04251c66-6c6b-4e72-8618-fb78ea1feff7 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:29:13.945074 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-04251c66-6c6b-4e72-8618-fb78ea1feff7 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:29:13.974875 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-04251c66-6c6b-4e72-8618-fb78ea1feff7 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] 10.222.0.11 "GET /compute/v2.1/servers/a49437df-3059-4528-8328-2f3471d5fb45/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049758 Nov 17 03:29:13.975434 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 435/842] 10.222.0.11 () {58 vars in 1301 bytes} [Wed Nov 17 03:29:13 2021] GET /compute/v2.1/servers/a49437df-3059-4528-8328-2f3471d5fb45/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 17 03:29:14.606207 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-e0e30942-351c-4497-aa88-4e084c575ead tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:29:14.607172 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-e0e30942-351c-4497-aa88-4e084c575ead tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] [instance: 0698dc5b-5f47-46c4-ace8-f5e891a964a0] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:29:14.618400 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-e0e30942-351c-4497-aa88-4e084c575ead tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:29:14.619140 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-e0e30942-351c-4497-aa88-4e084c575ead tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:29:14.620414 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-e0e30942-351c-4497-aa88-4e084c575ead tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:29:14.621159 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-e0e30942-351c-4497-aa88-4e084c575ead tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:29:14.772018 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-e0e30942-351c-4497-aa88-4e084c575ead tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '163b2f24a72649ac8084be1cac32fa09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e123e9b86124c93a7fc2db9984e7466', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:29:14.783268 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-e0e30942-351c-4497-aa88-4e084c575ead tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] 10.222.0.11 "GET /compute/v2.1/servers/0698dc5b-5f47-46c4-ace8-f5e891a964a0" status: 200 len: 1257 microversion: 2.1 time: 0.183015 Nov 17 03:29:14.784209 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 408/843] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:29:14 2021] GET /compute/v2.1/servers/0698dc5b-5f47-46c4-ace8-f5e891a964a0 => generated 1257 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:29:14.989900 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-3aa79049-45f3-4205-b217-b7bc71233813 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:29:14.990812 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-3aa79049-45f3-4205-b217-b7bc71233813 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] [instance: a49437df-3059-4528-8328-2f3471d5fb45] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:29:14.997441 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-3aa79049-45f3-4205-b217-b7bc71233813 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:29:14.997894 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-3aa79049-45f3-4205-b217-b7bc71233813 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:29:14.998797 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-3aa79049-45f3-4205-b217-b7bc71233813 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:29:14.999073 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-3aa79049-45f3-4205-b217-b7bc71233813 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:29:15.028193 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-3aa79049-45f3-4205-b217-b7bc71233813 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] 10.222.0.11 "GET /compute/v2.1/servers/a49437df-3059-4528-8328-2f3471d5fb45/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044273 Nov 17 03:29:15.028749 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 436/844] 10.222.0.11 () {58 vars in 1301 bytes} [Wed Nov 17 03:29:14 2021] GET /compute/v2.1/servers/a49437df-3059-4528-8328-2f3471d5fb45/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 17 03:29:15.801402 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-4757983d-b3c7-4c38-ac58-6bf17731f35e tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:29:15.802030 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-4757983d-b3c7-4c38-ac58-6bf17731f35e tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] [instance: 0698dc5b-5f47-46c4-ace8-f5e891a964a0] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:29:15.808811 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-4757983d-b3c7-4c38-ac58-6bf17731f35e tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:29:15.809262 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-4757983d-b3c7-4c38-ac58-6bf17731f35e tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:29:15.810035 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-4757983d-b3c7-4c38-ac58-6bf17731f35e tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:29:15.810461 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-4757983d-b3c7-4c38-ac58-6bf17731f35e tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:29:15.964521 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-4757983d-b3c7-4c38-ac58-6bf17731f35e tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '163b2f24a72649ac8084be1cac32fa09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e123e9b86124c93a7fc2db9984e7466', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:29:15.971937 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-4757983d-b3c7-4c38-ac58-6bf17731f35e tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] 10.222.0.11 "GET /compute/v2.1/servers/0698dc5b-5f47-46c4-ace8-f5e891a964a0" status: 200 len: 1257 microversion: 2.1 time: 0.174282 Nov 17 03:29:15.972497 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 409/845] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:29:15 2021] GET /compute/v2.1/servers/0698dc5b-5f47-46c4-ace8-f5e891a964a0 => generated 1257 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:29:16.043996 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-b81061fc-d402-41bd-8edd-e7d7981e2faf tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:29:16.045704 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-b81061fc-d402-41bd-8edd-e7d7981e2faf tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] [instance: a49437df-3059-4528-8328-2f3471d5fb45] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:29:16.057299 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-b81061fc-d402-41bd-8edd-e7d7981e2faf tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:29:16.057700 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-b81061fc-d402-41bd-8edd-e7d7981e2faf tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:29:16.058487 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-b81061fc-d402-41bd-8edd-e7d7981e2faf tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:29:16.058916 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-b81061fc-d402-41bd-8edd-e7d7981e2faf tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:29:16.088892 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-b81061fc-d402-41bd-8edd-e7d7981e2faf tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] 10.222.0.11 "GET /compute/v2.1/servers/a49437df-3059-4528-8328-2f3471d5fb45/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051155 Nov 17 03:29:16.089450 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 437/846] 10.222.0.11 () {58 vars in 1301 bytes} [Wed Nov 17 03:29:16 2021] GET /compute/v2.1/servers/a49437df-3059-4528-8328-2f3471d5fb45/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 17 03:29:16.992869 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-523d49c7-783a-4d95-aeb2-7f24c1a50d62 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:29:16.993882 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-523d49c7-783a-4d95-aeb2-7f24c1a50d62 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] [instance: 0698dc5b-5f47-46c4-ace8-f5e891a964a0] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:29:17.004754 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-523d49c7-783a-4d95-aeb2-7f24c1a50d62 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:29:17.005359 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-523d49c7-783a-4d95-aeb2-7f24c1a50d62 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:29:17.006147 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-523d49c7-783a-4d95-aeb2-7f24c1a50d62 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:29:17.006588 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-523d49c7-783a-4d95-aeb2-7f24c1a50d62 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:29:17.099487 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-94c19f4c-6b88-42c6-8f8e-23270b2a3808 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:29:17.100416 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-94c19f4c-6b88-42c6-8f8e-23270b2a3808 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] [instance: a49437df-3059-4528-8328-2f3471d5fb45] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:29:17.107610 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-94c19f4c-6b88-42c6-8f8e-23270b2a3808 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:29:17.108060 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-94c19f4c-6b88-42c6-8f8e-23270b2a3808 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:29:17.109073 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-94c19f4c-6b88-42c6-8f8e-23270b2a3808 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:29:17.109515 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-94c19f4c-6b88-42c6-8f8e-23270b2a3808 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:29:17.140046 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-94c19f4c-6b88-42c6-8f8e-23270b2a3808 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] 10.222.0.11 "GET /compute/v2.1/servers/a49437df-3059-4528-8328-2f3471d5fb45/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044292 Nov 17 03:29:17.140608 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 438/847] 10.222.0.11 () {58 vars in 1301 bytes} [Wed Nov 17 03:29:17 2021] GET /compute/v2.1/servers/a49437df-3059-4528-8328-2f3471d5fb45/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 17 03:29:17.149882 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-523d49c7-783a-4d95-aeb2-7f24c1a50d62 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '163b2f24a72649ac8084be1cac32fa09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e123e9b86124c93a7fc2db9984e7466', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:29:17.157243 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-523d49c7-783a-4d95-aeb2-7f24c1a50d62 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] 10.222.0.11 "GET /compute/v2.1/servers/0698dc5b-5f47-46c4-ace8-f5e891a964a0" status: 200 len: 1257 microversion: 2.1 time: 0.170707 Nov 17 03:29:17.157810 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 410/848] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:29:16 2021] GET /compute/v2.1/servers/0698dc5b-5f47-46c4-ace8-f5e891a964a0 => generated 1257 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:29:18.151637 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-d34a924d-3a06-4f61-9c1b-1f192b8ed516 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:29:18.152570 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-d34a924d-3a06-4f61-9c1b-1f192b8ed516 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] [instance: a49437df-3059-4528-8328-2f3471d5fb45] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:29:18.159488 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-d34a924d-3a06-4f61-9c1b-1f192b8ed516 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:29:18.159974 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-d34a924d-3a06-4f61-9c1b-1f192b8ed516 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:29:18.160757 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-d34a924d-3a06-4f61-9c1b-1f192b8ed516 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:29:18.161260 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-d34a924d-3a06-4f61-9c1b-1f192b8ed516 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:29:18.175293 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-7e0e3bcf-591a-429d-9bee-954a6d3b89cb tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:29:18.183519 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-7e0e3bcf-591a-429d-9bee-954a6d3b89cb tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] [instance: 0698dc5b-5f47-46c4-ace8-f5e891a964a0] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:29:18.183519 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-7e0e3bcf-591a-429d-9bee-954a6d3b89cb tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:29:18.183519 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-7e0e3bcf-591a-429d-9bee-954a6d3b89cb tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:29:18.183911 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-7e0e3bcf-591a-429d-9bee-954a6d3b89cb tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:29:18.184532 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-7e0e3bcf-591a-429d-9bee-954a6d3b89cb tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:29:18.192549 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-d34a924d-3a06-4f61-9c1b-1f192b8ed516 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] 10.222.0.11 "GET /compute/v2.1/servers/a49437df-3059-4528-8328-2f3471d5fb45/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044584 Nov 17 03:29:18.193255 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 439/849] 10.222.0.11 () {58 vars in 1301 bytes} [Wed Nov 17 03:29:18 2021] GET /compute/v2.1/servers/a49437df-3059-4528-8328-2f3471d5fb45/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 17 03:29:18.322427 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-7e0e3bcf-591a-429d-9bee-954a6d3b89cb tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '163b2f24a72649ac8084be1cac32fa09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e123e9b86124c93a7fc2db9984e7466', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:29:18.333779 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-7e0e3bcf-591a-429d-9bee-954a6d3b89cb tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] 10.222.0.11 "GET /compute/v2.1/servers/0698dc5b-5f47-46c4-ace8-f5e891a964a0" status: 200 len: 1257 microversion: 2.1 time: 0.162550 Nov 17 03:29:18.334540 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 411/850] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:29:18 2021] GET /compute/v2.1/servers/0698dc5b-5f47-46c4-ace8-f5e891a964a0 => generated 1257 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 17 03:29:18.363273 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-521896e7-aec9-44db-b576-9c223a333adb tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:29:18.363968 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-521896e7-aec9-44db-b576-9c223a333adb tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] [instance: 5d54db85-b991-4890-abaa-952413baa2e7] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:29:18.370074 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-521896e7-aec9-44db-b576-9c223a333adb tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:29:18.370546 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-521896e7-aec9-44db-b576-9c223a333adb tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:29:18.371310 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-521896e7-aec9-44db-b576-9c223a333adb tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:29:18.371741 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-521896e7-aec9-44db-b576-9c223a333adb tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:29:18.401784 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-521896e7-aec9-44db-b576-9c223a333adb tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] 10.222.0.11 "GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7/os-volume_attachments/6b88aa0e-cb40-48f3-83b7-9160eb1e8ee7" status: 200 len: 194 microversion: 2.20 time: 0.042140 Nov 17 03:29:18.402684 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 440/851] 10.222.0.11 () {60 vars in 1453 bytes} [Wed Nov 17 03:29:18 2021] GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7/os-volume_attachments/6b88aa0e-cb40-48f3-83b7-9160eb1e8ee7 => generated 194 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 17 03:29:18.466600 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-29673e5c-f9d8-459c-8a89-cc72dcc4f73b tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:29:18.467094 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-29673e5c-f9d8-459c-8a89-cc72dcc4f73b tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] [instance: 5d54db85-b991-4890-abaa-952413baa2e7] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:29:18.473600 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-29673e5c-f9d8-459c-8a89-cc72dcc4f73b tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:29:18.474043 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-29673e5c-f9d8-459c-8a89-cc72dcc4f73b tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:29:18.474821 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-29673e5c-f9d8-459c-8a89-cc72dcc4f73b tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:29:18.475251 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-29673e5c-f9d8-459c-8a89-cc72dcc4f73b tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:29:18.554429 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.objects.instance [None req-29673e5c-f9d8-459c-8a89-cc72dcc4f73b tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lazy-loading 'services' on Instance uuid 5d54db85-b991-4890-abaa-952413baa2e7 {{(pid=115917) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Nov 17 03:29:18.628459 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-29673e5c-f9d8-459c-8a89-cc72dcc4f73b tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] 10.222.0.11 "DELETE /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7/os-volume_attachments/6b88aa0e-cb40-48f3-83b7-9160eb1e8ee7" status: 202 len: 0 microversion: 2.20 time: 0.165485 Nov 17 03:29:18.629088 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 412/852] 10.222.0.11 () {60 vars in 1456 bytes} [Wed Nov 17 03:29:18 2021] DELETE /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7/os-volume_attachments/6b88aa0e-cb40-48f3-83b7-9160eb1e8ee7 => generated 0 bytes in 167 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Nov 17 03:29:18.638457 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-c20d6cb7-09e9-4eba-8717-8ccbb8abbe11 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:29:18.639407 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-c20d6cb7-09e9-4eba-8717-8ccbb8abbe11 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] [instance: 5d54db85-b991-4890-abaa-952413baa2e7] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:29:18.645576 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-c20d6cb7-09e9-4eba-8717-8ccbb8abbe11 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:29:18.646047 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-c20d6cb7-09e9-4eba-8717-8ccbb8abbe11 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:29:18.647152 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-c20d6cb7-09e9-4eba-8717-8ccbb8abbe11 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:29:18.647690 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-c20d6cb7-09e9-4eba-8717-8ccbb8abbe11 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:29:18.682933 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-c20d6cb7-09e9-4eba-8717-8ccbb8abbe11 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] 10.222.0.11 "GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.048854 Nov 17 03:29:18.683389 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 441/853] 10.222.0.11 () {60 vars in 1342 bytes} [Wed Nov 17 03:29:18 2021] GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 17 03:29:19.206129 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-0a248485-a1c7-438e-b4bf-ac89991150f0 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:29:19.207652 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-0a248485-a1c7-438e-b4bf-ac89991150f0 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] [instance: a49437df-3059-4528-8328-2f3471d5fb45] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:29:19.216295 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-0a248485-a1c7-438e-b4bf-ac89991150f0 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:29:19.217304 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-0a248485-a1c7-438e-b4bf-ac89991150f0 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:29:19.218508 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-0a248485-a1c7-438e-b4bf-ac89991150f0 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:29:19.219299 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-0a248485-a1c7-438e-b4bf-ac89991150f0 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:29:19.252574 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-0a248485-a1c7-438e-b4bf-ac89991150f0 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] 10.222.0.11 "GET /compute/v2.1/servers/a49437df-3059-4528-8328-2f3471d5fb45/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052225 Nov 17 03:29:19.253163 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 413/854] 10.222.0.11 () {58 vars in 1301 bytes} [Wed Nov 17 03:29:19 2021] GET /compute/v2.1/servers/a49437df-3059-4528-8328-2f3471d5fb45/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 17 03:29:19.357934 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-cea11dd3-07a8-40c1-a027-2b6bf923829e tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:29:19.358913 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-cea11dd3-07a8-40c1-a027-2b6bf923829e tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] [instance: 0698dc5b-5f47-46c4-ace8-f5e891a964a0] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:29:19.369054 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-cea11dd3-07a8-40c1-a027-2b6bf923829e tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:29:19.369765 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-cea11dd3-07a8-40c1-a027-2b6bf923829e tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:29:19.370965 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-cea11dd3-07a8-40c1-a027-2b6bf923829e tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:29:19.371603 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-cea11dd3-07a8-40c1-a027-2b6bf923829e tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:29:19.513860 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-cea11dd3-07a8-40c1-a027-2b6bf923829e tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '163b2f24a72649ac8084be1cac32fa09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e123e9b86124c93a7fc2db9984e7466', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:29:19.523980 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-cea11dd3-07a8-40c1-a027-2b6bf923829e tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] 10.222.0.11 "GET /compute/v2.1/servers/0698dc5b-5f47-46c4-ace8-f5e891a964a0" status: 200 len: 1257 microversion: 2.1 time: 0.171884 Nov 17 03:29:19.524552 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 442/855] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:29:19 2021] GET /compute/v2.1/servers/0698dc5b-5f47-46c4-ace8-f5e891a964a0 => generated 1257 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:29:19.699067 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-f6f0eb21-7a1d-49e1-85a0-9054e5341da4 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:29:19.700601 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-f6f0eb21-7a1d-49e1-85a0-9054e5341da4 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] [instance: 5d54db85-b991-4890-abaa-952413baa2e7] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:29:19.709882 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-f6f0eb21-7a1d-49e1-85a0-9054e5341da4 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:29:19.710261 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-f6f0eb21-7a1d-49e1-85a0-9054e5341da4 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:29:19.711034 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-f6f0eb21-7a1d-49e1-85a0-9054e5341da4 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:29:19.711468 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-f6f0eb21-7a1d-49e1-85a0-9054e5341da4 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:29:19.741091 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-f6f0eb21-7a1d-49e1-85a0-9054e5341da4 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] 10.222.0.11 "GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.048907 Nov 17 03:29:19.741642 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 414/856] 10.222.0.11 () {60 vars in 1342 bytes} [Wed Nov 17 03:29:19 2021] GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 17 03:29:20.267388 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-6ee2fd3f-5fed-45aa-b4bc-5505ec5b23db tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:29:20.268890 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-6ee2fd3f-5fed-45aa-b4bc-5505ec5b23db tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] [instance: a49437df-3059-4528-8328-2f3471d5fb45] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:29:20.275982 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-6ee2fd3f-5fed-45aa-b4bc-5505ec5b23db tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:29:20.276400 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-6ee2fd3f-5fed-45aa-b4bc-5505ec5b23db tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:29:20.277212 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-6ee2fd3f-5fed-45aa-b4bc-5505ec5b23db tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:29:20.277649 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-6ee2fd3f-5fed-45aa-b4bc-5505ec5b23db tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:29:20.308835 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-6ee2fd3f-5fed-45aa-b4bc-5505ec5b23db tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] 10.222.0.11 "GET /compute/v2.1/servers/a49437df-3059-4528-8328-2f3471d5fb45/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047740 Nov 17 03:29:20.309438 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 443/857] 10.222.0.11 () {58 vars in 1301 bytes} [Wed Nov 17 03:29:20 2021] GET /compute/v2.1/servers/a49437df-3059-4528-8328-2f3471d5fb45/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 17 03:29:20.544682 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-4ce89c52-b9d4-4db7-a7fc-3402416fe466 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:29:20.545629 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-4ce89c52-b9d4-4db7-a7fc-3402416fe466 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] [instance: 0698dc5b-5f47-46c4-ace8-f5e891a964a0] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:29:20.554690 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-4ce89c52-b9d4-4db7-a7fc-3402416fe466 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:29:20.555154 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-4ce89c52-b9d4-4db7-a7fc-3402416fe466 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:29:20.555938 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-4ce89c52-b9d4-4db7-a7fc-3402416fe466 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:29:20.556737 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-4ce89c52-b9d4-4db7-a7fc-3402416fe466 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:29:20.687564 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-4ce89c52-b9d4-4db7-a7fc-3402416fe466 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '163b2f24a72649ac8084be1cac32fa09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e123e9b86124c93a7fc2db9984e7466', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:29:20.695700 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-4ce89c52-b9d4-4db7-a7fc-3402416fe466 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] 10.222.0.11 "GET /compute/v2.1/servers/0698dc5b-5f47-46c4-ace8-f5e891a964a0" status: 200 len: 1257 microversion: 2.1 time: 0.157301 Nov 17 03:29:20.696275 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 415/858] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:29:20 2021] GET /compute/v2.1/servers/0698dc5b-5f47-46c4-ace8-f5e891a964a0 => generated 1257 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:29:20.754836 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-233a1319-8cb6-41bc-869c-528f24673a86 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:29:20.755760 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-233a1319-8cb6-41bc-869c-528f24673a86 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] [instance: 5d54db85-b991-4890-abaa-952413baa2e7] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:29:20.762722 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-233a1319-8cb6-41bc-869c-528f24673a86 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:29:20.763176 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-233a1319-8cb6-41bc-869c-528f24673a86 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:29:20.763952 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-233a1319-8cb6-41bc-869c-528f24673a86 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:29:20.764388 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-233a1319-8cb6-41bc-869c-528f24673a86 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:29:20.793906 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-233a1319-8cb6-41bc-869c-528f24673a86 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] 10.222.0.11 "GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043018 Nov 17 03:29:20.794463 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 444/859] 10.222.0.11 () {60 vars in 1342 bytes} [Wed Nov 17 03:29:20 2021] GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 17 03:29:21.321152 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-f4b8de84-039f-4749-a338-072dd2a02276 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:29:21.322064 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-f4b8de84-039f-4749-a338-072dd2a02276 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] [instance: a49437df-3059-4528-8328-2f3471d5fb45] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:29:21.328198 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-f4b8de84-039f-4749-a338-072dd2a02276 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:29:21.328662 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-f4b8de84-039f-4749-a338-072dd2a02276 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:29:21.329418 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-f4b8de84-039f-4749-a338-072dd2a02276 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:29:21.329848 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-f4b8de84-039f-4749-a338-072dd2a02276 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:29:21.360707 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-f4b8de84-039f-4749-a338-072dd2a02276 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] 10.222.0.11 "GET /compute/v2.1/servers/a49437df-3059-4528-8328-2f3471d5fb45/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043664 Nov 17 03:29:21.361301 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 416/860] 10.222.0.11 () {58 vars in 1301 bytes} [Wed Nov 17 03:29:21 2021] GET /compute/v2.1/servers/a49437df-3059-4528-8328-2f3471d5fb45/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 17 03:29:21.713039 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-a7760a93-c813-4382-b3f7-e2a2f7e89b5d tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:29:21.713553 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-a7760a93-c813-4382-b3f7-e2a2f7e89b5d tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] [instance: 0698dc5b-5f47-46c4-ace8-f5e891a964a0] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:29:21.719790 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-a7760a93-c813-4382-b3f7-e2a2f7e89b5d tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:29:21.720250 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-a7760a93-c813-4382-b3f7-e2a2f7e89b5d tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:29:21.721067 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-a7760a93-c813-4382-b3f7-e2a2f7e89b5d tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:29:21.721504 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-a7760a93-c813-4382-b3f7-e2a2f7e89b5d tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:29:21.807085 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-0b09ef89-68ab-44da-9879-cb1c245b627a tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:29:21.808061 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-0b09ef89-68ab-44da-9879-cb1c245b627a tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] [instance: 5d54db85-b991-4890-abaa-952413baa2e7] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:29:21.816589 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-0b09ef89-68ab-44da-9879-cb1c245b627a tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:29:21.817443 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-0b09ef89-68ab-44da-9879-cb1c245b627a tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:29:21.818847 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-0b09ef89-68ab-44da-9879-cb1c245b627a tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:29:21.819644 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-0b09ef89-68ab-44da-9879-cb1c245b627a tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:29:21.854036 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-0b09ef89-68ab-44da-9879-cb1c245b627a tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] 10.222.0.11 "GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.051692 Nov 17 03:29:21.854591 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 417/861] 10.222.0.11 () {60 vars in 1342 bytes} [Wed Nov 17 03:29:21 2021] GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 17 03:29:21.861570 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-a7760a93-c813-4382-b3f7-e2a2f7e89b5d tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '163b2f24a72649ac8084be1cac32fa09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e123e9b86124c93a7fc2db9984e7466', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:29:21.869403 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-a7760a93-c813-4382-b3f7-e2a2f7e89b5d tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] 10.222.0.11 "GET /compute/v2.1/servers/0698dc5b-5f47-46c4-ace8-f5e891a964a0" status: 200 len: 1257 microversion: 2.1 time: 0.160436 Nov 17 03:29:21.870597 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 445/862] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:29:21 2021] GET /compute/v2.1/servers/0698dc5b-5f47-46c4-ace8-f5e891a964a0 => generated 1257 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:29:22.376183 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-ad0627c4-d185-4c56-a5af-da3b24539376 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:29:22.377375 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-ad0627c4-d185-4c56-a5af-da3b24539376 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] [instance: a49437df-3059-4528-8328-2f3471d5fb45] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:29:22.384976 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-ad0627c4-d185-4c56-a5af-da3b24539376 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:29:22.385434 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-ad0627c4-d185-4c56-a5af-da3b24539376 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:29:22.386231 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-ad0627c4-d185-4c56-a5af-da3b24539376 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:29:22.386675 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-ad0627c4-d185-4c56-a5af-da3b24539376 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:29:22.420043 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-ad0627c4-d185-4c56-a5af-da3b24539376 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] 10.222.0.11 "GET /compute/v2.1/servers/a49437df-3059-4528-8328-2f3471d5fb45/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049825 Nov 17 03:29:22.421237 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 418/863] 10.222.0.11 () {58 vars in 1301 bytes} [Wed Nov 17 03:29:22 2021] GET /compute/v2.1/servers/a49437df-3059-4528-8328-2f3471d5fb45/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 17 03:29:22.866188 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-cc7c76b0-4225-48a6-a6ea-2a2366d63e05 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:29:22.867099 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-cc7c76b0-4225-48a6-a6ea-2a2366d63e05 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] [instance: 5d54db85-b991-4890-abaa-952413baa2e7] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:29:22.873634 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-cc7c76b0-4225-48a6-a6ea-2a2366d63e05 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:29:22.874123 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-cc7c76b0-4225-48a6-a6ea-2a2366d63e05 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:29:22.874899 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-cc7c76b0-4225-48a6-a6ea-2a2366d63e05 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:29:22.875339 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-cc7c76b0-4225-48a6-a6ea-2a2366d63e05 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:29:22.886414 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-fc076354-c73a-4ead-abe6-5e359377455b tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:29:22.887036 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-fc076354-c73a-4ead-abe6-5e359377455b tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] [instance: 0698dc5b-5f47-46c4-ace8-f5e891a964a0] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:29:22.893648 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-fc076354-c73a-4ead-abe6-5e359377455b tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:29:22.894110 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-fc076354-c73a-4ead-abe6-5e359377455b tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:29:22.894947 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-fc076354-c73a-4ead-abe6-5e359377455b tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:29:22.895297 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-fc076354-c73a-4ead-abe6-5e359377455b tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:29:22.906548 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-cc7c76b0-4225-48a6-a6ea-2a2366d63e05 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] 10.222.0.11 "GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044224 Nov 17 03:29:22.907118 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 446/864] 10.222.0.11 () {60 vars in 1342 bytes} [Wed Nov 17 03:29:22 2021] GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 17 03:29:23.038459 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-fc076354-c73a-4ead-abe6-5e359377455b tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '163b2f24a72649ac8084be1cac32fa09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e123e9b86124c93a7fc2db9984e7466', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:29:23.049419 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-fc076354-c73a-4ead-abe6-5e359377455b tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] 10.222.0.11 "GET /compute/v2.1/servers/0698dc5b-5f47-46c4-ace8-f5e891a964a0" status: 200 len: 1257 microversion: 2.1 time: 0.166687 Nov 17 03:29:23.050027 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 419/865] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:29:22 2021] GET /compute/v2.1/servers/0698dc5b-5f47-46c4-ace8-f5e891a964a0 => generated 1257 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:29:23.433070 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-7d8eb00a-fe19-4599-ba84-6cb7373eda23 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:29:23.433696 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-7d8eb00a-fe19-4599-ba84-6cb7373eda23 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] [instance: a49437df-3059-4528-8328-2f3471d5fb45] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:29:23.439769 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-7d8eb00a-fe19-4599-ba84-6cb7373eda23 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:29:23.440204 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-7d8eb00a-fe19-4599-ba84-6cb7373eda23 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:29:23.441022 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-7d8eb00a-fe19-4599-ba84-6cb7373eda23 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:29:23.441457 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-7d8eb00a-fe19-4599-ba84-6cb7373eda23 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:29:23.470523 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-7d8eb00a-fe19-4599-ba84-6cb7373eda23 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] 10.222.0.11 "GET /compute/v2.1/servers/a49437df-3059-4528-8328-2f3471d5fb45/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041915 Nov 17 03:29:23.471116 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 447/866] 10.222.0.11 () {58 vars in 1301 bytes} [Wed Nov 17 03:29:23 2021] GET /compute/v2.1/servers/a49437df-3059-4528-8328-2f3471d5fb45/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 17 03:29:23.919474 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-83237dd5-a8dc-46a6-9de6-377125344994 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:29:23.920376 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-83237dd5-a8dc-46a6-9de6-377125344994 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] [instance: 5d54db85-b991-4890-abaa-952413baa2e7] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:29:23.930588 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-83237dd5-a8dc-46a6-9de6-377125344994 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:29:23.931046 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-83237dd5-a8dc-46a6-9de6-377125344994 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:29:23.932238 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-83237dd5-a8dc-46a6-9de6-377125344994 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:29:23.932677 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-83237dd5-a8dc-46a6-9de6-377125344994 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:29:23.962593 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-83237dd5-a8dc-46a6-9de6-377125344994 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] 10.222.0.11 "GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046841 Nov 17 03:29:23.963049 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 420/867] 10.222.0.11 () {60 vars in 1342 bytes} [Wed Nov 17 03:29:23 2021] GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 17 03:29:24.066665 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-e85b8db5-b5f9-4a4a-804d-69393874ab8b tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:29:24.067320 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-e85b8db5-b5f9-4a4a-804d-69393874ab8b tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] [instance: 0698dc5b-5f47-46c4-ace8-f5e891a964a0] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:29:24.074081 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-e85b8db5-b5f9-4a4a-804d-69393874ab8b tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:29:24.074542 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-e85b8db5-b5f9-4a4a-804d-69393874ab8b tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:29:24.075321 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-e85b8db5-b5f9-4a4a-804d-69393874ab8b tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:29:24.075765 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-e85b8db5-b5f9-4a4a-804d-69393874ab8b tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:29:24.208934 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-e85b8db5-b5f9-4a4a-804d-69393874ab8b tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '163b2f24a72649ac8084be1cac32fa09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e123e9b86124c93a7fc2db9984e7466', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:29:24.216836 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-e85b8db5-b5f9-4a4a-804d-69393874ab8b tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] 10.222.0.11 "GET /compute/v2.1/servers/0698dc5b-5f47-46c4-ace8-f5e891a964a0" status: 200 len: 1257 microversion: 2.1 time: 0.153831 Nov 17 03:29:24.218856 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 448/868] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:29:24 2021] GET /compute/v2.1/servers/0698dc5b-5f47-46c4-ace8-f5e891a964a0 => generated 1257 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:29:24.481938 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-6e28ee5e-8ff6-495c-9a48-f07283908280 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:29:24.482850 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-6e28ee5e-8ff6-495c-9a48-f07283908280 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] [instance: a49437df-3059-4528-8328-2f3471d5fb45] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:29:24.489201 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-6e28ee5e-8ff6-495c-9a48-f07283908280 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:29:24.489672 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-6e28ee5e-8ff6-495c-9a48-f07283908280 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:29:24.490398 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-6e28ee5e-8ff6-495c-9a48-f07283908280 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:29:24.490829 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-6e28ee5e-8ff6-495c-9a48-f07283908280 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:29:24.519156 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-6e28ee5e-8ff6-495c-9a48-f07283908280 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] 10.222.0.11 "GET /compute/v2.1/servers/a49437df-3059-4528-8328-2f3471d5fb45/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040911 Nov 17 03:29:24.519703 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 421/869] 10.222.0.11 () {58 vars in 1301 bytes} [Wed Nov 17 03:29:24 2021] GET /compute/v2.1/servers/a49437df-3059-4528-8328-2f3471d5fb45/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 17 03:29:24.978542 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-eeecf85c-0238-4356-a00e-60082d9f0886 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:29:24.980171 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-eeecf85c-0238-4356-a00e-60082d9f0886 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] [instance: 5d54db85-b991-4890-abaa-952413baa2e7] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:29:24.990246 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-eeecf85c-0238-4356-a00e-60082d9f0886 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:29:24.990696 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-eeecf85c-0238-4356-a00e-60082d9f0886 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:29:24.991477 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-eeecf85c-0238-4356-a00e-60082d9f0886 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:29:24.991909 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-eeecf85c-0238-4356-a00e-60082d9f0886 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:29:25.021578 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-eeecf85c-0238-4356-a00e-60082d9f0886 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] 10.222.0.11 "GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.049562 Nov 17 03:29:25.022133 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 449/870] 10.222.0.11 () {60 vars in 1342 bytes} [Wed Nov 17 03:29:24 2021] GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 17 03:29:25.235256 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-1304524e-c64a-44ca-98cf-acb1ea3df20d tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:29:25.235865 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-1304524e-c64a-44ca-98cf-acb1ea3df20d tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] [instance: 0698dc5b-5f47-46c4-ace8-f5e891a964a0] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:29:25.243208 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-1304524e-c64a-44ca-98cf-acb1ea3df20d tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:29:25.243736 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-1304524e-c64a-44ca-98cf-acb1ea3df20d tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:29:25.244518 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-1304524e-c64a-44ca-98cf-acb1ea3df20d tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:29:25.245004 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-1304524e-c64a-44ca-98cf-acb1ea3df20d tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:29:25.348013 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [req-70df9cea-8ad9-4c9c-9874-1437d5deff46 req-33df1739-17c8-4376-9994-c37dbc4f91df service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0698dc5b-5f47-46c4-ace8-f5e891a964a0", "name": "network-vif-plugged", "status": "completed", "tag": "ade336c1-073e-4cb9-90d9-0e1652a810a1"}]} {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 17 03:29:25.349866 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 17 03:29:25.349866 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: warnings.warn(msg) Nov 17 03:29:25.357598 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [req-70df9cea-8ad9-4c9c-9874-1437d5deff46 req-33df1739-17c8-4376-9994-c37dbc4f91df service nova] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:29:25.358057 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [req-70df9cea-8ad9-4c9c-9874-1437d5deff46 req-33df1739-17c8-4376-9994-c37dbc4f91df service nova] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:29:25.370353 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.compute.server_external_events [req-70df9cea-8ad9-4c9c-9874-1437d5deff46 req-33df1739-17c8-4376-9994-c37dbc4f91df service nova] Creating event network-vif-plugged:ade336c1-073e-4cb9-90d9-0e1652a810a1 for instance 0698dc5b-5f47-46c4-ace8-f5e891a964a0 on hv-cinder-81803 Nov 17 03:29:25.375475 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [req-70df9cea-8ad9-4c9c-9874-1437d5deff46 req-33df1739-17c8-4376-9994-c37dbc4f91df service nova] 10.222.0.11 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031181 Nov 17 03:29:25.376259 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 450/871] 10.222.0.11 () {64 vars in 1317 bytes} [Wed Nov 17 03:29:25 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 17 03:29:25.388224 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-1304524e-c64a-44ca-98cf-acb1ea3df20d tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '163b2f24a72649ac8084be1cac32fa09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e123e9b86124c93a7fc2db9984e7466', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:29:25.395858 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-1304524e-c64a-44ca-98cf-acb1ea3df20d tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] 10.222.0.11 "GET /compute/v2.1/servers/0698dc5b-5f47-46c4-ace8-f5e891a964a0" status: 200 len: 1257 microversion: 2.1 time: 0.164377 Nov 17 03:29:25.396433 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 422/872] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:29:25 2021] GET /compute/v2.1/servers/0698dc5b-5f47-46c4-ace8-f5e891a964a0 => generated 1257 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:29:25.530147 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-cde0f8ae-cc4f-454b-af87-8abead237c8d tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:29:25.531843 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-cde0f8ae-cc4f-454b-af87-8abead237c8d tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] [instance: a49437df-3059-4528-8328-2f3471d5fb45] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:29:25.538650 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-cde0f8ae-cc4f-454b-af87-8abead237c8d tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:29:25.539109 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-cde0f8ae-cc4f-454b-af87-8abead237c8d tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:29:25.539912 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-cde0f8ae-cc4f-454b-af87-8abead237c8d tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:29:25.540326 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-cde0f8ae-cc4f-454b-af87-8abead237c8d tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:29:25.575391 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-cde0f8ae-cc4f-454b-af87-8abead237c8d tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] 10.222.0.11 "GET /compute/v2.1/servers/a49437df-3059-4528-8328-2f3471d5fb45/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049290 Nov 17 03:29:25.575968 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 451/873] 10.222.0.11 () {58 vars in 1301 bytes} [Wed Nov 17 03:29:25 2021] GET /compute/v2.1/servers/a49437df-3059-4528-8328-2f3471d5fb45/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 17 03:29:26.037316 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-8e6d976f-c46a-4621-9bd9-c5bb1b026bb6 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:29:26.038371 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-8e6d976f-c46a-4621-9bd9-c5bb1b026bb6 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] [instance: 5d54db85-b991-4890-abaa-952413baa2e7] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:29:26.046096 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-8e6d976f-c46a-4621-9bd9-c5bb1b026bb6 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:29:26.046618 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-8e6d976f-c46a-4621-9bd9-c5bb1b026bb6 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:29:26.047551 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-8e6d976f-c46a-4621-9bd9-c5bb1b026bb6 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:29:26.048023 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-8e6d976f-c46a-4621-9bd9-c5bb1b026bb6 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:29:26.081269 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-8e6d976f-c46a-4621-9bd9-c5bb1b026bb6 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] 10.222.0.11 "GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.050236 Nov 17 03:29:26.081830 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 423/874] 10.222.0.11 () {60 vars in 1342 bytes} [Wed Nov 17 03:29:26 2021] GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 17 03:29:26.412712 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-b0008919-79c0-4c5a-8718-bd10601c60e3 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:29:26.413396 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-b0008919-79c0-4c5a-8718-bd10601c60e3 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] [instance: 0698dc5b-5f47-46c4-ace8-f5e891a964a0] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:29:26.420707 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-b0008919-79c0-4c5a-8718-bd10601c60e3 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:29:26.421194 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-b0008919-79c0-4c5a-8718-bd10601c60e3 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:29:26.421967 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-b0008919-79c0-4c5a-8718-bd10601c60e3 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:29:26.422405 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-b0008919-79c0-4c5a-8718-bd10601c60e3 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:29:26.564754 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-b0008919-79c0-4c5a-8718-bd10601c60e3 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '163b2f24a72649ac8084be1cac32fa09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e123e9b86124c93a7fc2db9984e7466', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:29:26.572980 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-b0008919-79c0-4c5a-8718-bd10601c60e3 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] 10.222.0.11 "GET /compute/v2.1/servers/0698dc5b-5f47-46c4-ace8-f5e891a964a0" status: 200 len: 1257 microversion: 2.1 time: 0.163821 Nov 17 03:29:26.573488 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 452/875] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:29:26 2021] GET /compute/v2.1/servers/0698dc5b-5f47-46c4-ace8-f5e891a964a0 => generated 1257 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:29:26.586946 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-a0bbe53b-0696-44be-963a-450fef8a340f tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:29:26.588006 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-a0bbe53b-0696-44be-963a-450fef8a340f tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] [instance: a49437df-3059-4528-8328-2f3471d5fb45] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:29:26.594413 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-a0bbe53b-0696-44be-963a-450fef8a340f tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:29:26.594865 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-a0bbe53b-0696-44be-963a-450fef8a340f tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:29:26.595649 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-a0bbe53b-0696-44be-963a-450fef8a340f tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:29:26.596082 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-a0bbe53b-0696-44be-963a-450fef8a340f tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:29:26.625399 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-a0bbe53b-0696-44be-963a-450fef8a340f tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] 10.222.0.11 "GET /compute/v2.1/servers/a49437df-3059-4528-8328-2f3471d5fb45/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042273 Nov 17 03:29:26.625953 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 424/876] 10.222.0.11 () {58 vars in 1301 bytes} [Wed Nov 17 03:29:26 2021] GET /compute/v2.1/servers/a49437df-3059-4528-8328-2f3471d5fb45/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 17 03:29:27.093209 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-ebd2a420-e505-42f5-b4d2-86d3a775c6b5 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:29:27.094159 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-ebd2a420-e505-42f5-b4d2-86d3a775c6b5 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] [instance: 5d54db85-b991-4890-abaa-952413baa2e7] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:29:27.100815 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-ebd2a420-e505-42f5-b4d2-86d3a775c6b5 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:29:27.101291 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-ebd2a420-e505-42f5-b4d2-86d3a775c6b5 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:29:27.102063 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-ebd2a420-e505-42f5-b4d2-86d3a775c6b5 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:29:27.102498 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-ebd2a420-e505-42f5-b4d2-86d3a775c6b5 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:29:27.133325 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-ebd2a420-e505-42f5-b4d2-86d3a775c6b5 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] 10.222.0.11 "GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043967 Nov 17 03:29:27.133885 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 453/877] 10.222.0.11 () {60 vars in 1342 bytes} [Wed Nov 17 03:29:27 2021] GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 17 03:29:27.593971 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-dd55c77b-8b17-41d8-b01b-b91471984fb1 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:29:27.594975 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-dd55c77b-8b17-41d8-b01b-b91471984fb1 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] [instance: 0698dc5b-5f47-46c4-ace8-f5e891a964a0] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:29:27.603597 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-dd55c77b-8b17-41d8-b01b-b91471984fb1 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:29:27.604091 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-dd55c77b-8b17-41d8-b01b-b91471984fb1 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:29:27.604978 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-dd55c77b-8b17-41d8-b01b-b91471984fb1 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:29:27.605458 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-dd55c77b-8b17-41d8-b01b-b91471984fb1 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:29:27.637077 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-f971c858-d64b-4fda-a203-36a35b1b0c28 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:29:27.637966 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-f971c858-d64b-4fda-a203-36a35b1b0c28 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] [instance: a49437df-3059-4528-8328-2f3471d5fb45] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:29:27.644518 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-f971c858-d64b-4fda-a203-36a35b1b0c28 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:29:27.645012 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-f971c858-d64b-4fda-a203-36a35b1b0c28 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:29:27.646224 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-f971c858-d64b-4fda-a203-36a35b1b0c28 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:29:27.646662 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-f971c858-d64b-4fda-a203-36a35b1b0c28 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:29:27.679097 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-f971c858-d64b-4fda-a203-36a35b1b0c28 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] 10.222.0.11 "GET /compute/v2.1/servers/a49437df-3059-4528-8328-2f3471d5fb45/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045877 Nov 17 03:29:27.679681 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 454/878] 10.222.0.11 () {58 vars in 1301 bytes} [Wed Nov 17 03:29:27 2021] GET /compute/v2.1/servers/a49437df-3059-4528-8328-2f3471d5fb45/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 17 03:29:27.742087 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-dd55c77b-8b17-41d8-b01b-b91471984fb1 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '163b2f24a72649ac8084be1cac32fa09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e123e9b86124c93a7fc2db9984e7466', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:29:27.750115 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-dd55c77b-8b17-41d8-b01b-b91471984fb1 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] 10.222.0.11 "GET /compute/v2.1/servers/0698dc5b-5f47-46c4-ace8-f5e891a964a0" status: 200 len: 1441 microversion: 2.1 time: 0.162292 Nov 17 03:29:27.750691 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 425/879] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:29:27 2021] GET /compute/v2.1/servers/0698dc5b-5f47-46c4-ace8-f5e891a964a0 => generated 1441 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:29:27.766336 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-4bc523ee-e0da-403e-8909-297ac89eb45b tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:29:27.766952 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-4bc523ee-e0da-403e-8909-297ac89eb45b tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] [instance: 0698dc5b-5f47-46c4-ace8-f5e891a964a0] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:29:27.773327 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-4bc523ee-e0da-403e-8909-297ac89eb45b tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:29:27.773781 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-4bc523ee-e0da-403e-8909-297ac89eb45b tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:29:27.774562 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-4bc523ee-e0da-403e-8909-297ac89eb45b tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:29:27.775000 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-4bc523ee-e0da-403e-8909-297ac89eb45b tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:29:27.918350 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-4bc523ee-e0da-403e-8909-297ac89eb45b tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '163b2f24a72649ac8084be1cac32fa09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e123e9b86124c93a7fc2db9984e7466', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:29:27.926445 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-4bc523ee-e0da-403e-8909-297ac89eb45b tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] 10.222.0.11 "GET /compute/v2.1/servers/0698dc5b-5f47-46c4-ace8-f5e891a964a0" status: 200 len: 1441 microversion: 2.1 time: 0.163817 Nov 17 03:29:27.927086 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 455/880] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:29:27 2021] GET /compute/v2.1/servers/0698dc5b-5f47-46c4-ace8-f5e891a964a0 => generated 1441 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:29:28.145395 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-b7f3a55f-5a25-49e2-bc80-cadcf8b29cd6 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:29:28.146349 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-b7f3a55f-5a25-49e2-bc80-cadcf8b29cd6 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] [instance: 5d54db85-b991-4890-abaa-952413baa2e7] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:29:28.152393 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-b7f3a55f-5a25-49e2-bc80-cadcf8b29cd6 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:29:28.152874 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-b7f3a55f-5a25-49e2-bc80-cadcf8b29cd6 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:29:28.153643 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-b7f3a55f-5a25-49e2-bc80-cadcf8b29cd6 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:29:28.154107 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-b7f3a55f-5a25-49e2-bc80-cadcf8b29cd6 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:29:28.183952 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-b7f3a55f-5a25-49e2-bc80-cadcf8b29cd6 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] 10.222.0.11 "GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042297 Nov 17 03:29:28.184731 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 426/881] 10.222.0.11 () {60 vars in 1342 bytes} [Wed Nov 17 03:29:28 2021] GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 17 03:29:28.691510 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-c1e8e6fa-0201-4663-a68f-1ee18026f229 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:29:28.692274 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-c1e8e6fa-0201-4663-a68f-1ee18026f229 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] [instance: a49437df-3059-4528-8328-2f3471d5fb45] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:29:28.698782 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-c1e8e6fa-0201-4663-a68f-1ee18026f229 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:29:28.699477 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-c1e8e6fa-0201-4663-a68f-1ee18026f229 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:29:28.700249 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-c1e8e6fa-0201-4663-a68f-1ee18026f229 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:29:28.700678 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-c1e8e6fa-0201-4663-a68f-1ee18026f229 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:29:28.730920 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-c1e8e6fa-0201-4663-a68f-1ee18026f229 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] 10.222.0.11 "GET /compute/v2.1/servers/a49437df-3059-4528-8328-2f3471d5fb45/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043451 Nov 17 03:29:28.731528 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 456/882] 10.222.0.11 () {58 vars in 1301 bytes} [Wed Nov 17 03:29:28 2021] GET /compute/v2.1/servers/a49437df-3059-4528-8328-2f3471d5fb45/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 17 03:29:29.195979 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-66b70014-8f5b-4d20-be78-9c062f9a8db0 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:29:29.197582 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-66b70014-8f5b-4d20-be78-9c062f9a8db0 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] [instance: 5d54db85-b991-4890-abaa-952413baa2e7] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:29:29.204073 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-66b70014-8f5b-4d20-be78-9c062f9a8db0 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:29:29.204522 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-66b70014-8f5b-4d20-be78-9c062f9a8db0 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:29:29.205328 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-66b70014-8f5b-4d20-be78-9c062f9a8db0 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:29:29.205757 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-66b70014-8f5b-4d20-be78-9c062f9a8db0 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:29:29.239885 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-66b70014-8f5b-4d20-be78-9c062f9a8db0 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] 10.222.0.11 "GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047722 Nov 17 03:29:29.243830 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 427/883] 10.222.0.11 () {60 vars in 1342 bytes} [Wed Nov 17 03:29:29 2021] GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 17 03:29:29.614150 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [req-0b731a58-d1ab-435b-b470-2792ec7bef6d req-d2c9ab86-4ed7-4b12-8002-212d46e6b510 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0698dc5b-5f47-46c4-ace8-f5e891a964a0", "tag": "ade336c1-073e-4cb9-90d9-0e1652a810a1"}]} {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 17 03:29:29.615688 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 17 03:29:29.615688 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: warnings.warn(msg) Nov 17 03:29:29.622689 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [req-0b731a58-d1ab-435b-b470-2792ec7bef6d req-d2c9ab86-4ed7-4b12-8002-212d46e6b510 service nova] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:29:29.623146 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [req-0b731a58-d1ab-435b-b470-2792ec7bef6d req-d2c9ab86-4ed7-4b12-8002-212d46e6b510 service nova] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:29:29.634362 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.compute.server_external_events [req-0b731a58-d1ab-435b-b470-2792ec7bef6d req-d2c9ab86-4ed7-4b12-8002-212d46e6b510 service nova] Creating event network-changed:ade336c1-073e-4cb9-90d9-0e1652a810a1 for instance 0698dc5b-5f47-46c4-ace8-f5e891a964a0 on hv-cinder-81803 Nov 17 03:29:29.639536 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [req-0b731a58-d1ab-435b-b470-2792ec7bef6d req-d2c9ab86-4ed7-4b12-8002-212d46e6b510 service nova] 10.222.0.11 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029081 Nov 17 03:29:29.640201 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 457/884] 10.222.0.11 () {64 vars in 1317 bytes} [Wed Nov 17 03:29:29 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 17 03:29:29.742414 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-d5fc1f92-3513-44ea-9428-1b54f6ebc2ac tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:29:29.743326 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-d5fc1f92-3513-44ea-9428-1b54f6ebc2ac tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] [instance: a49437df-3059-4528-8328-2f3471d5fb45] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:29:29.749637 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-d5fc1f92-3513-44ea-9428-1b54f6ebc2ac tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:29:29.750531 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-d5fc1f92-3513-44ea-9428-1b54f6ebc2ac tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:29:29.751507 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-d5fc1f92-3513-44ea-9428-1b54f6ebc2ac tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:29:29.752263 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-d5fc1f92-3513-44ea-9428-1b54f6ebc2ac tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:29:29.787535 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-d5fc1f92-3513-44ea-9428-1b54f6ebc2ac tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] 10.222.0.11 "GET /compute/v2.1/servers/a49437df-3059-4528-8328-2f3471d5fb45/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048862 Nov 17 03:29:29.789175 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 428/885] 10.222.0.11 () {58 vars in 1301 bytes} [Wed Nov 17 03:29:29 2021] GET /compute/v2.1/servers/a49437df-3059-4528-8328-2f3471d5fb45/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 17 03:29:30.252402 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-6d88cf47-d55e-477c-8ace-9aadc9c5bdd6 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:29:30.253502 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-6d88cf47-d55e-477c-8ace-9aadc9c5bdd6 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] [instance: 5d54db85-b991-4890-abaa-952413baa2e7] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:29:30.260054 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-6d88cf47-d55e-477c-8ace-9aadc9c5bdd6 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:29:30.260581 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-6d88cf47-d55e-477c-8ace-9aadc9c5bdd6 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:29:30.261466 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-6d88cf47-d55e-477c-8ace-9aadc9c5bdd6 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:29:30.261964 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-6d88cf47-d55e-477c-8ace-9aadc9c5bdd6 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:29:30.292821 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-6d88cf47-d55e-477c-8ace-9aadc9c5bdd6 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] 10.222.0.11 "GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045141 Nov 17 03:29:30.293415 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 458/886] 10.222.0.11 () {60 vars in 1342 bytes} [Wed Nov 17 03:29:30 2021] GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 17 03:29:30.800376 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-ce647f5d-1731-458a-a436-98352ca7e669 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:29:30.802123 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-ce647f5d-1731-458a-a436-98352ca7e669 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] [instance: a49437df-3059-4528-8328-2f3471d5fb45] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:29:30.809051 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-ce647f5d-1731-458a-a436-98352ca7e669 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:29:30.809720 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-ce647f5d-1731-458a-a436-98352ca7e669 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:29:30.810511 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-ce647f5d-1731-458a-a436-98352ca7e669 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:29:30.810944 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-ce647f5d-1731-458a-a436-98352ca7e669 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:29:30.845376 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-ce647f5d-1731-458a-a436-98352ca7e669 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] 10.222.0.11 "GET /compute/v2.1/servers/a49437df-3059-4528-8328-2f3471d5fb45/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049112 Nov 17 03:29:30.845958 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 429/887] 10.222.0.11 () {58 vars in 1301 bytes} [Wed Nov 17 03:29:30 2021] GET /compute/v2.1/servers/a49437df-3059-4528-8328-2f3471d5fb45/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 17 03:29:31.304605 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-0c2c9d28-1ea7-4154-9dad-eb8846c4f91c tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:29:31.305610 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-0c2c9d28-1ea7-4154-9dad-eb8846c4f91c tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] [instance: 5d54db85-b991-4890-abaa-952413baa2e7] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:29:31.312751 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-0c2c9d28-1ea7-4154-9dad-eb8846c4f91c tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:29:31.313227 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-0c2c9d28-1ea7-4154-9dad-eb8846c4f91c tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:29:31.314002 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-0c2c9d28-1ea7-4154-9dad-eb8846c4f91c tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:29:31.314434 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-0c2c9d28-1ea7-4154-9dad-eb8846c4f91c tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:29:31.345316 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-0c2c9d28-1ea7-4154-9dad-eb8846c4f91c tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] 10.222.0.11 "GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044914 Nov 17 03:29:31.345916 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 459/888] 10.222.0.11 () {60 vars in 1342 bytes} [Wed Nov 17 03:29:31 2021] GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 17 03:29:31.857622 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-bf8ca08d-fc42-4204-a077-d24994889b31 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:29:31.858530 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-bf8ca08d-fc42-4204-a077-d24994889b31 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] [instance: a49437df-3059-4528-8328-2f3471d5fb45] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:29:31.865419 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-bf8ca08d-fc42-4204-a077-d24994889b31 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:29:31.865787 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-bf8ca08d-fc42-4204-a077-d24994889b31 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:29:31.866573 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-bf8ca08d-fc42-4204-a077-d24994889b31 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:29:31.867003 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-bf8ca08d-fc42-4204-a077-d24994889b31 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:29:31.897602 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-bf8ca08d-fc42-4204-a077-d24994889b31 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] 10.222.0.11 "GET /compute/v2.1/servers/a49437df-3059-4528-8328-2f3471d5fb45/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043673 Nov 17 03:29:31.898160 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 430/889] 10.222.0.11 () {58 vars in 1301 bytes} [Wed Nov 17 03:29:31 2021] GET /compute/v2.1/servers/a49437df-3059-4528-8328-2f3471d5fb45/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 17 03:29:32.357957 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-562b3a0c-b5b4-4e8b-bd44-ed93cc14e445 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:29:32.358944 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-562b3a0c-b5b4-4e8b-bd44-ed93cc14e445 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] [instance: 5d54db85-b991-4890-abaa-952413baa2e7] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:29:32.366290 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-562b3a0c-b5b4-4e8b-bd44-ed93cc14e445 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:29:32.366731 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-562b3a0c-b5b4-4e8b-bd44-ed93cc14e445 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:29:32.367703 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-562b3a0c-b5b4-4e8b-bd44-ed93cc14e445 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:29:32.368206 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-562b3a0c-b5b4-4e8b-bd44-ed93cc14e445 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:29:32.400073 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-562b3a0c-b5b4-4e8b-bd44-ed93cc14e445 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] 10.222.0.11 "GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046175 Nov 17 03:29:32.400637 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 460/890] 10.222.0.11 () {60 vars in 1342 bytes} [Wed Nov 17 03:29:32 2021] GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 17 03:29:32.909771 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-ea0e7573-3c96-4d6b-9edc-a35ea91f9df8 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:29:32.910687 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-ea0e7573-3c96-4d6b-9edc-a35ea91f9df8 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] [instance: a49437df-3059-4528-8328-2f3471d5fb45] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:29:32.917532 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-ea0e7573-3c96-4d6b-9edc-a35ea91f9df8 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:29:32.917978 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-ea0e7573-3c96-4d6b-9edc-a35ea91f9df8 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:29:32.918765 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-ea0e7573-3c96-4d6b-9edc-a35ea91f9df8 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:29:32.919190 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-ea0e7573-3c96-4d6b-9edc-a35ea91f9df8 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:29:32.953193 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-ea0e7573-3c96-4d6b-9edc-a35ea91f9df8 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] 10.222.0.11 "GET /compute/v2.1/servers/a49437df-3059-4528-8328-2f3471d5fb45/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047320 Nov 17 03:29:32.953650 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 431/891] 10.222.0.11 () {58 vars in 1301 bytes} [Wed Nov 17 03:29:32 2021] GET /compute/v2.1/servers/a49437df-3059-4528-8328-2f3471d5fb45/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 17 03:29:33.413967 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-919584bc-1957-418c-849f-26df3461a9ec tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:29:33.414874 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-919584bc-1957-418c-849f-26df3461a9ec tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] [instance: 5d54db85-b991-4890-abaa-952413baa2e7] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:29:33.421598 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-919584bc-1957-418c-849f-26df3461a9ec tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:29:33.422045 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-919584bc-1957-418c-849f-26df3461a9ec tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:29:33.422808 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-919584bc-1957-418c-849f-26df3461a9ec tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:29:33.423229 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-919584bc-1957-418c-849f-26df3461a9ec tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:29:33.453739 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-919584bc-1957-418c-849f-26df3461a9ec tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] 10.222.0.11 "GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044063 Nov 17 03:29:33.454289 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 461/892] 10.222.0.11 () {60 vars in 1342 bytes} [Wed Nov 17 03:29:33 2021] GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 17 03:29:33.965011 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-8a080dff-ea1d-42ff-b584-09861b9f7e32 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:29:33.965925 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-8a080dff-ea1d-42ff-b584-09861b9f7e32 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] [instance: a49437df-3059-4528-8328-2f3471d5fb45] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:29:33.974997 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-8a080dff-ea1d-42ff-b584-09861b9f7e32 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:29:33.975734 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-8a080dff-ea1d-42ff-b584-09861b9f7e32 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:29:33.977089 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-8a080dff-ea1d-42ff-b584-09861b9f7e32 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:29:33.977710 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-8a080dff-ea1d-42ff-b584-09861b9f7e32 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:29:34.010931 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-8a080dff-ea1d-42ff-b584-09861b9f7e32 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] 10.222.0.11 "GET /compute/v2.1/servers/a49437df-3059-4528-8328-2f3471d5fb45/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049842 Nov 17 03:29:34.011483 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 432/893] 10.222.0.11 () {58 vars in 1301 bytes} [Wed Nov 17 03:29:33 2021] GET /compute/v2.1/servers/a49437df-3059-4528-8328-2f3471d5fb45/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 17 03:29:34.465962 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-1c962afb-823c-402c-936b-bb1a5669ef4e tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:29:34.466777 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-1c962afb-823c-402c-936b-bb1a5669ef4e tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] [instance: 5d54db85-b991-4890-abaa-952413baa2e7] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:29:34.473642 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-1c962afb-823c-402c-936b-bb1a5669ef4e tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:29:34.474559 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-1c962afb-823c-402c-936b-bb1a5669ef4e tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:29:34.475413 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-1c962afb-823c-402c-936b-bb1a5669ef4e tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:29:34.475842 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-1c962afb-823c-402c-936b-bb1a5669ef4e tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:29:34.506287 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-1c962afb-823c-402c-936b-bb1a5669ef4e tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] 10.222.0.11 "GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044334 Nov 17 03:29:34.506846 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 462/894] 10.222.0.11 () {60 vars in 1342 bytes} [Wed Nov 17 03:29:34 2021] GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 17 03:29:35.022793 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-fc94a8fb-8eb1-41e3-b8f7-c5dda3ec04b2 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:29:35.023699 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-fc94a8fb-8eb1-41e3-b8f7-c5dda3ec04b2 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] [instance: a49437df-3059-4528-8328-2f3471d5fb45] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:29:35.030427 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-fc94a8fb-8eb1-41e3-b8f7-c5dda3ec04b2 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:29:35.030845 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-fc94a8fb-8eb1-41e3-b8f7-c5dda3ec04b2 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:29:35.031616 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-fc94a8fb-8eb1-41e3-b8f7-c5dda3ec04b2 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:29:35.032041 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-fc94a8fb-8eb1-41e3-b8f7-c5dda3ec04b2 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:29:35.061960 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-fc94a8fb-8eb1-41e3-b8f7-c5dda3ec04b2 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] 10.222.0.11 "GET /compute/v2.1/servers/a49437df-3059-4528-8328-2f3471d5fb45/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043217 Nov 17 03:29:35.062785 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 433/895] 10.222.0.11 () {58 vars in 1301 bytes} [Wed Nov 17 03:29:35 2021] GET /compute/v2.1/servers/a49437df-3059-4528-8328-2f3471d5fb45/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 17 03:29:35.521826 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-d92f0e2a-735a-42c3-b9bb-56fcd9f78b1a tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:29:35.522801 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-d92f0e2a-735a-42c3-b9bb-56fcd9f78b1a tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] [instance: 5d54db85-b991-4890-abaa-952413baa2e7] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:29:35.529607 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-d92f0e2a-735a-42c3-b9bb-56fcd9f78b1a tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:29:35.530049 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-d92f0e2a-735a-42c3-b9bb-56fcd9f78b1a tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:29:35.530816 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-d92f0e2a-735a-42c3-b9bb-56fcd9f78b1a tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:29:35.531243 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-d92f0e2a-735a-42c3-b9bb-56fcd9f78b1a tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:29:35.561069 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-d92f0e2a-735a-42c3-b9bb-56fcd9f78b1a tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] 10.222.0.11 "GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045155 Nov 17 03:29:35.561917 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 463/896] 10.222.0.11 () {60 vars in 1342 bytes} [Wed Nov 17 03:29:35 2021] GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 17 03:29:36.073527 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-0bd096cf-5e8d-4578-8396-e069f7f6d431 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:29:36.074445 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-0bd096cf-5e8d-4578-8396-e069f7f6d431 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] [instance: a49437df-3059-4528-8328-2f3471d5fb45] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:29:36.081060 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-0bd096cf-5e8d-4578-8396-e069f7f6d431 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:29:36.081513 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-0bd096cf-5e8d-4578-8396-e069f7f6d431 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:29:36.082291 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-0bd096cf-5e8d-4578-8396-e069f7f6d431 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:29:36.082703 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-0bd096cf-5e8d-4578-8396-e069f7f6d431 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:29:36.112175 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-0bd096cf-5e8d-4578-8396-e069f7f6d431 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] 10.222.0.11 "GET /compute/v2.1/servers/a49437df-3059-4528-8328-2f3471d5fb45/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042345 Nov 17 03:29:36.112615 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 434/897] 10.222.0.11 () {58 vars in 1301 bytes} [Wed Nov 17 03:29:36 2021] GET /compute/v2.1/servers/a49437df-3059-4528-8328-2f3471d5fb45/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 17 03:29:36.575288 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-78a5814e-4eba-4d3d-88ff-7edefb2c52f4 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:29:36.576556 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-78a5814e-4eba-4d3d-88ff-7edefb2c52f4 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] [instance: 5d54db85-b991-4890-abaa-952413baa2e7] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:29:36.586347 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-78a5814e-4eba-4d3d-88ff-7edefb2c52f4 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:29:36.588831 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-78a5814e-4eba-4d3d-88ff-7edefb2c52f4 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:29:36.592263 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-78a5814e-4eba-4d3d-88ff-7edefb2c52f4 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:29:36.592945 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-78a5814e-4eba-4d3d-88ff-7edefb2c52f4 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:29:36.626511 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-78a5814e-4eba-4d3d-88ff-7edefb2c52f4 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] 10.222.0.11 "GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.056670 Nov 17 03:29:36.627062 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 464/898] 10.222.0.11 () {60 vars in 1342 bytes} [Wed Nov 17 03:29:36 2021] GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7/os-volume_attachments => generated 197 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 17 03:29:37.123631 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-93522282-a6d5-41f8-b9df-1acfde7ea1f2 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:29:37.124695 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-93522282-a6d5-41f8-b9df-1acfde7ea1f2 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] [instance: a49437df-3059-4528-8328-2f3471d5fb45] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:29:37.131306 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-93522282-a6d5-41f8-b9df-1acfde7ea1f2 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:29:37.131760 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-93522282-a6d5-41f8-b9df-1acfde7ea1f2 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:29:37.132531 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-93522282-a6d5-41f8-b9df-1acfde7ea1f2 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:29:37.132994 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-93522282-a6d5-41f8-b9df-1acfde7ea1f2 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:29:37.163759 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-93522282-a6d5-41f8-b9df-1acfde7ea1f2 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] 10.222.0.11 "GET /compute/v2.1/servers/a49437df-3059-4528-8328-2f3471d5fb45/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043839 Nov 17 03:29:37.164239 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 435/899] 10.222.0.11 () {58 vars in 1301 bytes} [Wed Nov 17 03:29:37 2021] GET /compute/v2.1/servers/a49437df-3059-4528-8328-2f3471d5fb45/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 17 03:29:37.642599 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-eccc0a00-e6d1-4b43-96c3-6dba0f72fa7e tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:29:37.644054 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-eccc0a00-e6d1-4b43-96c3-6dba0f72fa7e tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] [instance: 5d54db85-b991-4890-abaa-952413baa2e7] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:29:37.651465 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-eccc0a00-e6d1-4b43-96c3-6dba0f72fa7e tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:29:37.651907 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-eccc0a00-e6d1-4b43-96c3-6dba0f72fa7e tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:29:37.652679 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-eccc0a00-e6d1-4b43-96c3-6dba0f72fa7e tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:29:37.653131 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-eccc0a00-e6d1-4b43-96c3-6dba0f72fa7e tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:29:37.688236 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-eccc0a00-e6d1-4b43-96c3-6dba0f72fa7e tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] 10.222.0.11 "GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.052105 Nov 17 03:29:37.688810 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 465/900] 10.222.0.11 () {60 vars in 1342 bytes} [Wed Nov 17 03:29:37 2021] GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 17 03:29:38.175787 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-94117112-335f-459a-ba47-8379919a729c tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:29:38.176739 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-94117112-335f-459a-ba47-8379919a729c tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] [instance: a49437df-3059-4528-8328-2f3471d5fb45] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:29:38.184214 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-94117112-335f-459a-ba47-8379919a729c tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:29:38.184733 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-94117112-335f-459a-ba47-8379919a729c tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:29:38.185613 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-94117112-335f-459a-ba47-8379919a729c tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:29:38.186039 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-94117112-335f-459a-ba47-8379919a729c tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:29:38.214510 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-94117112-335f-459a-ba47-8379919a729c tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] 10.222.0.11 "GET /compute/v2.1/servers/a49437df-3059-4528-8328-2f3471d5fb45/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042731 Nov 17 03:29:38.215057 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 436/901] 10.222.0.11 () {58 vars in 1301 bytes} [Wed Nov 17 03:29:38 2021] GET /compute/v2.1/servers/a49437df-3059-4528-8328-2f3471d5fb45/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 17 03:29:38.705497 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-9e86b605-12c9-41e4-98a8-e50e0de9aa68 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:29:38.706944 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-9e86b605-12c9-41e4-98a8-e50e0de9aa68 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] [instance: 5d54db85-b991-4890-abaa-952413baa2e7] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:29:38.717616 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-9e86b605-12c9-41e4-98a8-e50e0de9aa68 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:29:38.718354 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-9e86b605-12c9-41e4-98a8-e50e0de9aa68 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:29:38.719677 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-9e86b605-12c9-41e4-98a8-e50e0de9aa68 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:29:38.720687 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-9e86b605-12c9-41e4-98a8-e50e0de9aa68 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:29:38.751509 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-9e86b605-12c9-41e4-98a8-e50e0de9aa68 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] 10.222.0.11 "GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.052737 Nov 17 03:29:38.752083 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 466/902] 10.222.0.11 () {60 vars in 1342 bytes} [Wed Nov 17 03:29:38 2021] GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 17 03:29:39.226050 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-e5c6ea68-58c2-4505-a7f0-fc164e0838ac tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:29:39.226971 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-e5c6ea68-58c2-4505-a7f0-fc164e0838ac tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] [instance: a49437df-3059-4528-8328-2f3471d5fb45] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:29:39.234671 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-e5c6ea68-58c2-4505-a7f0-fc164e0838ac tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:29:39.235134 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-e5c6ea68-58c2-4505-a7f0-fc164e0838ac tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:29:39.235926 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-e5c6ea68-58c2-4505-a7f0-fc164e0838ac tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:29:39.236360 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-e5c6ea68-58c2-4505-a7f0-fc164e0838ac tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:29:39.267715 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-e5c6ea68-58c2-4505-a7f0-fc164e0838ac tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] 10.222.0.11 "GET /compute/v2.1/servers/a49437df-3059-4528-8328-2f3471d5fb45/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045438 Nov 17 03:29:39.268284 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 437/903] 10.222.0.11 () {58 vars in 1301 bytes} [Wed Nov 17 03:29:39 2021] GET /compute/v2.1/servers/a49437df-3059-4528-8328-2f3471d5fb45/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 17 03:29:39.768118 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-5366f275-1843-4ee8-a81b-b1e55a37dcde tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:29:39.769546 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-5366f275-1843-4ee8-a81b-b1e55a37dcde tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] [instance: 5d54db85-b991-4890-abaa-952413baa2e7] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:29:39.777254 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-5366f275-1843-4ee8-a81b-b1e55a37dcde tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:29:39.777705 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-5366f275-1843-4ee8-a81b-b1e55a37dcde tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:29:39.778481 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-5366f275-1843-4ee8-a81b-b1e55a37dcde tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:29:39.778917 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-5366f275-1843-4ee8-a81b-b1e55a37dcde tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:29:39.809257 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-5366f275-1843-4ee8-a81b-b1e55a37dcde tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] 10.222.0.11 "GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.048054 Nov 17 03:29:39.809839 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 467/904] 10.222.0.11 () {60 vars in 1342 bytes} [Wed Nov 17 03:29:39 2021] GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 17 03:29:40.279263 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-2b863a5a-c7d8-488f-89ca-9e68c9193c46 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:29:40.280163 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-2b863a5a-c7d8-488f-89ca-9e68c9193c46 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] [instance: a49437df-3059-4528-8328-2f3471d5fb45] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:29:40.286767 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-2b863a5a-c7d8-488f-89ca-9e68c9193c46 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:29:40.287216 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-2b863a5a-c7d8-488f-89ca-9e68c9193c46 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:29:40.288148 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-2b863a5a-c7d8-488f-89ca-9e68c9193c46 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:29:40.288575 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-2b863a5a-c7d8-488f-89ca-9e68c9193c46 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:29:40.318072 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-2b863a5a-c7d8-488f-89ca-9e68c9193c46 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] 10.222.0.11 "GET /compute/v2.1/servers/a49437df-3059-4528-8328-2f3471d5fb45/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042487 Nov 17 03:29:40.318537 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 438/905] 10.222.0.11 () {58 vars in 1301 bytes} [Wed Nov 17 03:29:40 2021] GET /compute/v2.1/servers/a49437df-3059-4528-8328-2f3471d5fb45/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 17 03:29:40.824122 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-a8a43a60-1825-42e4-aae7-456ddcbd6ec4 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:29:40.825072 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-a8a43a60-1825-42e4-aae7-456ddcbd6ec4 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] [instance: 5d54db85-b991-4890-abaa-952413baa2e7] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:29:40.831293 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-a8a43a60-1825-42e4-aae7-456ddcbd6ec4 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:29:40.831745 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-a8a43a60-1825-42e4-aae7-456ddcbd6ec4 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:29:40.832517 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-a8a43a60-1825-42e4-aae7-456ddcbd6ec4 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:29:40.833001 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-a8a43a60-1825-42e4-aae7-456ddcbd6ec4 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:29:40.862282 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-a8a43a60-1825-42e4-aae7-456ddcbd6ec4 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] 10.222.0.11 "GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043900 Nov 17 03:29:40.862842 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 468/906] 10.222.0.11 () {60 vars in 1342 bytes} [Wed Nov 17 03:29:40 2021] GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 17 03:29:41.330571 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-1f79360a-4a55-4913-97f5-97ad675fe4fa tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:29:41.331522 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-1f79360a-4a55-4913-97f5-97ad675fe4fa tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] [instance: a49437df-3059-4528-8328-2f3471d5fb45] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:29:41.339051 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-1f79360a-4a55-4913-97f5-97ad675fe4fa tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:29:41.339810 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-1f79360a-4a55-4913-97f5-97ad675fe4fa tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:29:41.340821 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-1f79360a-4a55-4913-97f5-97ad675fe4fa tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:29:41.341740 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-1f79360a-4a55-4913-97f5-97ad675fe4fa tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:29:41.372009 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-1f79360a-4a55-4913-97f5-97ad675fe4fa tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] 10.222.0.11 "GET /compute/v2.1/servers/a49437df-3059-4528-8328-2f3471d5fb45/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045281 Nov 17 03:29:41.372573 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 439/907] 10.222.0.11 () {58 vars in 1301 bytes} [Wed Nov 17 03:29:41 2021] GET /compute/v2.1/servers/a49437df-3059-4528-8328-2f3471d5fb45/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 17 03:29:41.877582 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-13e5c595-ae3d-4711-9b64-310861606eaa tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:29:41.878932 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-13e5c595-ae3d-4711-9b64-310861606eaa tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] [instance: 5d54db85-b991-4890-abaa-952413baa2e7] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:29:41.889700 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-13e5c595-ae3d-4711-9b64-310861606eaa tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:29:41.890448 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-13e5c595-ae3d-4711-9b64-310861606eaa tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:29:41.891778 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-13e5c595-ae3d-4711-9b64-310861606eaa tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:29:41.892498 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-13e5c595-ae3d-4711-9b64-310861606eaa tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:29:41.924986 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-13e5c595-ae3d-4711-9b64-310861606eaa tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] 10.222.0.11 "GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.054111 Nov 17 03:29:41.925515 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 469/908] 10.222.0.11 () {60 vars in 1342 bytes} [Wed Nov 17 03:29:41 2021] GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 17 03:29:42.387388 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-b3edffee-d963-4456-b95e-e0523a2532ed tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:29:42.388308 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-b3edffee-d963-4456-b95e-e0523a2532ed tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] [instance: a49437df-3059-4528-8328-2f3471d5fb45] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:29:42.394663 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-b3edffee-d963-4456-b95e-e0523a2532ed tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:29:42.395115 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-b3edffee-d963-4456-b95e-e0523a2532ed tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:29:42.395896 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-b3edffee-d963-4456-b95e-e0523a2532ed tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:29:42.396326 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-b3edffee-d963-4456-b95e-e0523a2532ed tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:29:42.426961 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-b3edffee-d963-4456-b95e-e0523a2532ed tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] 10.222.0.11 "GET /compute/v2.1/servers/a49437df-3059-4528-8328-2f3471d5fb45/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044073 Nov 17 03:29:42.427521 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 440/909] 10.222.0.11 () {58 vars in 1301 bytes} [Wed Nov 17 03:29:42 2021] GET /compute/v2.1/servers/a49437df-3059-4528-8328-2f3471d5fb45/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 17 03:29:42.937745 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-0a7044a0-ca17-438a-bb25-f482f6e6100c tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:29:42.938668 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-0a7044a0-ca17-438a-bb25-f482f6e6100c tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] [instance: 5d54db85-b991-4890-abaa-952413baa2e7] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:29:42.945270 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-0a7044a0-ca17-438a-bb25-f482f6e6100c tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:29:42.945715 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-0a7044a0-ca17-438a-bb25-f482f6e6100c tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:29:42.946530 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-0a7044a0-ca17-438a-bb25-f482f6e6100c tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:29:42.946957 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-0a7044a0-ca17-438a-bb25-f482f6e6100c tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:29:42.976451 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-0a7044a0-ca17-438a-bb25-f482f6e6100c tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] 10.222.0.11 "GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042484 Nov 17 03:29:42.977040 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 470/910] 10.222.0.11 () {60 vars in 1342 bytes} [Wed Nov 17 03:29:42 2021] GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 17 03:29:43.438474 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-5a5fee44-3998-4560-b866-daca49f666ba tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:29:43.439387 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-5a5fee44-3998-4560-b866-daca49f666ba tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] [instance: a49437df-3059-4528-8328-2f3471d5fb45] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:29:43.445870 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-5a5fee44-3998-4560-b866-daca49f666ba tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:29:43.446290 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-5a5fee44-3998-4560-b866-daca49f666ba tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:29:43.447184 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-5a5fee44-3998-4560-b866-daca49f666ba tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:29:43.447785 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-5a5fee44-3998-4560-b866-daca49f666ba tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:29:43.477674 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-5a5fee44-3998-4560-b866-daca49f666ba tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] 10.222.0.11 "GET /compute/v2.1/servers/a49437df-3059-4528-8328-2f3471d5fb45/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042895 Nov 17 03:29:43.478220 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 441/911] 10.222.0.11 () {58 vars in 1301 bytes} [Wed Nov 17 03:29:43 2021] GET /compute/v2.1/servers/a49437df-3059-4528-8328-2f3471d5fb45/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 17 03:29:43.992633 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-35ec9e82-0c68-4aed-a5b9-6df6bafa9b49 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:29:43.994358 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-35ec9e82-0c68-4aed-a5b9-6df6bafa9b49 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] [instance: 5d54db85-b991-4890-abaa-952413baa2e7] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:29:44.005226 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-35ec9e82-0c68-4aed-a5b9-6df6bafa9b49 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:29:44.005987 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-35ec9e82-0c68-4aed-a5b9-6df6bafa9b49 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:29:44.007267 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-35ec9e82-0c68-4aed-a5b9-6df6bafa9b49 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:29:44.007994 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-35ec9e82-0c68-4aed-a5b9-6df6bafa9b49 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:29:44.038418 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-35ec9e82-0c68-4aed-a5b9-6df6bafa9b49 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] 10.222.0.11 "GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.052212 Nov 17 03:29:44.038975 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 471/912] 10.222.0.11 () {60 vars in 1342 bytes} [Wed Nov 17 03:29:43 2021] GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 17 03:29:44.488423 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-da472491-d1e4-490c-8523-2ea08dff16c0 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:29:44.489433 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-da472491-d1e4-490c-8523-2ea08dff16c0 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] [instance: a49437df-3059-4528-8328-2f3471d5fb45] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:29:44.496277 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-da472491-d1e4-490c-8523-2ea08dff16c0 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:29:44.496716 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-da472491-d1e4-490c-8523-2ea08dff16c0 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:29:44.497524 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-da472491-d1e4-490c-8523-2ea08dff16c0 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:29:44.497954 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-da472491-d1e4-490c-8523-2ea08dff16c0 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:29:44.528137 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-da472491-d1e4-490c-8523-2ea08dff16c0 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] 10.222.0.11 "GET /compute/v2.1/servers/a49437df-3059-4528-8328-2f3471d5fb45/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043589 Nov 17 03:29:44.528691 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 442/913] 10.222.0.11 () {58 vars in 1301 bytes} [Wed Nov 17 03:29:44 2021] GET /compute/v2.1/servers/a49437df-3059-4528-8328-2f3471d5fb45/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 17 03:29:45.055030 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-b846e6b9-a5f5-4478-8bca-9ed4f0aed851 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:29:45.056815 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-b846e6b9-a5f5-4478-8bca-9ed4f0aed851 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] [instance: 5d54db85-b991-4890-abaa-952413baa2e7] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:29:45.064111 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-b846e6b9-a5f5-4478-8bca-9ed4f0aed851 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:29:45.064755 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-b846e6b9-a5f5-4478-8bca-9ed4f0aed851 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:29:45.066164 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-b846e6b9-a5f5-4478-8bca-9ed4f0aed851 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:29:45.066705 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-b846e6b9-a5f5-4478-8bca-9ed4f0aed851 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:29:45.103949 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-b846e6b9-a5f5-4478-8bca-9ed4f0aed851 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] 10.222.0.11 "GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.055314 Nov 17 03:29:45.104508 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 472/914] 10.222.0.11 () {60 vars in 1342 bytes} [Wed Nov 17 03:29:45 2021] GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7/os-volume_attachments => generated 197 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 17 03:29:45.542575 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-9613eec5-2ad2-4cf8-968b-240e716f7b19 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:29:45.543614 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-9613eec5-2ad2-4cf8-968b-240e716f7b19 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] [instance: a49437df-3059-4528-8328-2f3471d5fb45] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:29:45.551709 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-9613eec5-2ad2-4cf8-968b-240e716f7b19 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:29:45.552162 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-9613eec5-2ad2-4cf8-968b-240e716f7b19 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:29:45.552974 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-9613eec5-2ad2-4cf8-968b-240e716f7b19 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:29:45.553438 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-9613eec5-2ad2-4cf8-968b-240e716f7b19 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:29:45.584034 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-9613eec5-2ad2-4cf8-968b-240e716f7b19 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] 10.222.0.11 "GET /compute/v2.1/servers/a49437df-3059-4528-8328-2f3471d5fb45/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047019 Nov 17 03:29:45.584581 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 443/915] 10.222.0.11 () {58 vars in 1301 bytes} [Wed Nov 17 03:29:45 2021] GET /compute/v2.1/servers/a49437df-3059-4528-8328-2f3471d5fb45/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 17 03:29:46.120550 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-b142757b-cb18-49ac-b4f6-78695b1ac603 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:29:46.122079 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-b142757b-cb18-49ac-b4f6-78695b1ac603 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] [instance: 5d54db85-b991-4890-abaa-952413baa2e7] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:29:46.132696 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-b142757b-cb18-49ac-b4f6-78695b1ac603 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:29:46.133495 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-b142757b-cb18-49ac-b4f6-78695b1ac603 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:29:46.134609 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-b142757b-cb18-49ac-b4f6-78695b1ac603 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:29:46.135054 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-b142757b-cb18-49ac-b4f6-78695b1ac603 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:29:46.165832 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-b142757b-cb18-49ac-b4f6-78695b1ac603 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] 10.222.0.11 "GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.051911 Nov 17 03:29:46.166406 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 473/916] 10.222.0.11 () {60 vars in 1342 bytes} [Wed Nov 17 03:29:46 2021] GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 17 03:29:46.595495 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-61405705-5ff1-4e4b-bbaf-b219a773dfc8 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:29:46.596457 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-61405705-5ff1-4e4b-bbaf-b219a773dfc8 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] [instance: a49437df-3059-4528-8328-2f3471d5fb45] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:29:46.603123 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-61405705-5ff1-4e4b-bbaf-b219a773dfc8 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:29:46.603574 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-61405705-5ff1-4e4b-bbaf-b219a773dfc8 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:29:46.604359 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-61405705-5ff1-4e4b-bbaf-b219a773dfc8 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:29:46.604808 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-61405705-5ff1-4e4b-bbaf-b219a773dfc8 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:29:46.634551 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-61405705-5ff1-4e4b-bbaf-b219a773dfc8 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] 10.222.0.11 "GET /compute/v2.1/servers/a49437df-3059-4528-8328-2f3471d5fb45/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042808 Nov 17 03:29:46.635131 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 444/917] 10.222.0.11 () {58 vars in 1301 bytes} [Wed Nov 17 03:29:46 2021] GET /compute/v2.1/servers/a49437df-3059-4528-8328-2f3471d5fb45/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 17 03:29:47.182101 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-819ef42a-d817-4701-8eb5-dea87c5cafbc tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:29:47.183140 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-819ef42a-d817-4701-8eb5-dea87c5cafbc tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] [instance: 5d54db85-b991-4890-abaa-952413baa2e7] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:29:47.191689 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-819ef42a-d817-4701-8eb5-dea87c5cafbc tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:29:47.192246 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-819ef42a-d817-4701-8eb5-dea87c5cafbc tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:29:47.193234 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-819ef42a-d817-4701-8eb5-dea87c5cafbc tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:29:47.193805 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-819ef42a-d817-4701-8eb5-dea87c5cafbc tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:29:47.227749 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-819ef42a-d817-4701-8eb5-dea87c5cafbc tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] 10.222.0.11 "GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.052456 Nov 17 03:29:47.228301 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 474/918] 10.222.0.11 () {60 vars in 1342 bytes} [Wed Nov 17 03:29:47 2021] GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 17 03:29:47.645781 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-d86264eb-ed38-4710-89f6-f3fe180cd544 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:29:47.646674 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-d86264eb-ed38-4710-89f6-f3fe180cd544 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] [instance: a49437df-3059-4528-8328-2f3471d5fb45] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:29:47.653439 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-d86264eb-ed38-4710-89f6-f3fe180cd544 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:29:47.653878 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-d86264eb-ed38-4710-89f6-f3fe180cd544 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:29:47.654642 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-d86264eb-ed38-4710-89f6-f3fe180cd544 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:29:47.655074 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-d86264eb-ed38-4710-89f6-f3fe180cd544 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:29:47.684110 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-d86264eb-ed38-4710-89f6-f3fe180cd544 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] 10.222.0.11 "GET /compute/v2.1/servers/a49437df-3059-4528-8328-2f3471d5fb45/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042071 Nov 17 03:29:47.684665 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 445/919] 10.222.0.11 () {58 vars in 1301 bytes} [Wed Nov 17 03:29:47 2021] GET /compute/v2.1/servers/a49437df-3059-4528-8328-2f3471d5fb45/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 17 03:29:48.243655 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-6449c7ae-b7f8-46c9-bae1-b6c5883bed23 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:29:48.245148 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-6449c7ae-b7f8-46c9-bae1-b6c5883bed23 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] [instance: 5d54db85-b991-4890-abaa-952413baa2e7] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:29:48.255702 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-6449c7ae-b7f8-46c9-bae1-b6c5883bed23 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:29:48.256444 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-6449c7ae-b7f8-46c9-bae1-b6c5883bed23 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:29:48.257762 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-6449c7ae-b7f8-46c9-bae1-b6c5883bed23 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:29:48.258471 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-6449c7ae-b7f8-46c9-bae1-b6c5883bed23 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:29:48.288483 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-6449c7ae-b7f8-46c9-bae1-b6c5883bed23 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] 10.222.0.11 "GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.051318 Nov 17 03:29:48.289086 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 475/920] 10.222.0.11 () {60 vars in 1342 bytes} [Wed Nov 17 03:29:48 2021] GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 17 03:29:48.695397 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-aa6c1a38-a25f-4089-8f2e-7c1ace4988e3 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:29:48.696611 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-aa6c1a38-a25f-4089-8f2e-7c1ace4988e3 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] [instance: a49437df-3059-4528-8328-2f3471d5fb45] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:29:48.703616 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-aa6c1a38-a25f-4089-8f2e-7c1ace4988e3 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:29:48.704061 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-aa6c1a38-a25f-4089-8f2e-7c1ace4988e3 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:29:48.704871 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-aa6c1a38-a25f-4089-8f2e-7c1ace4988e3 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:29:48.705305 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-aa6c1a38-a25f-4089-8f2e-7c1ace4988e3 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:29:48.737079 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-aa6c1a38-a25f-4089-8f2e-7c1ace4988e3 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] 10.222.0.11 "GET /compute/v2.1/servers/a49437df-3059-4528-8328-2f3471d5fb45/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045350 Nov 17 03:29:48.737634 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 446/921] 10.222.0.11 () {58 vars in 1301 bytes} [Wed Nov 17 03:29:48 2021] GET /compute/v2.1/servers/a49437df-3059-4528-8328-2f3471d5fb45/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 17 03:29:49.299827 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-cdb00c3a-f5a1-4d3a-baf8-4f48250613fd tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:29:49.300743 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-cdb00c3a-f5a1-4d3a-baf8-4f48250613fd tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] [instance: 5d54db85-b991-4890-abaa-952413baa2e7] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:29:49.308050 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-cdb00c3a-f5a1-4d3a-baf8-4f48250613fd tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:29:49.308426 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-cdb00c3a-f5a1-4d3a-baf8-4f48250613fd tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:29:49.309230 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-cdb00c3a-f5a1-4d3a-baf8-4f48250613fd tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:29:49.309664 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-cdb00c3a-f5a1-4d3a-baf8-4f48250613fd tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:29:49.339062 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-cdb00c3a-f5a1-4d3a-baf8-4f48250613fd tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] 10.222.0.11 "GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043076 Nov 17 03:29:49.339619 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 476/922] 10.222.0.11 () {60 vars in 1342 bytes} [Wed Nov 17 03:29:49 2021] GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 17 03:29:49.748669 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-194cbb68-a7ed-4f29-8054-d849df1d1aa5 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:29:49.749600 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-194cbb68-a7ed-4f29-8054-d849df1d1aa5 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] [instance: a49437df-3059-4528-8328-2f3471d5fb45] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:29:49.755879 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-194cbb68-a7ed-4f29-8054-d849df1d1aa5 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:29:49.756327 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-194cbb68-a7ed-4f29-8054-d849df1d1aa5 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:29:49.757139 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-194cbb68-a7ed-4f29-8054-d849df1d1aa5 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:29:49.757564 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-194cbb68-a7ed-4f29-8054-d849df1d1aa5 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:29:49.786414 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-194cbb68-a7ed-4f29-8054-d849df1d1aa5 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] 10.222.0.11 "GET /compute/v2.1/servers/a49437df-3059-4528-8328-2f3471d5fb45/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041585 Nov 17 03:29:49.786963 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 447/923] 10.222.0.11 () {58 vars in 1301 bytes} [Wed Nov 17 03:29:49 2021] GET /compute/v2.1/servers/a49437df-3059-4528-8328-2f3471d5fb45/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 17 03:29:50.357617 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-b804612a-ac3b-4aaf-ac04-604d2112c22f tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:29:50.358977 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-b804612a-ac3b-4aaf-ac04-604d2112c22f tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] [instance: 5d54db85-b991-4890-abaa-952413baa2e7] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:29:50.369538 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-b804612a-ac3b-4aaf-ac04-604d2112c22f tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:29:50.369987 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-b804612a-ac3b-4aaf-ac04-604d2112c22f tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:29:50.370761 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-b804612a-ac3b-4aaf-ac04-604d2112c22f tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:29:50.371199 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-b804612a-ac3b-4aaf-ac04-604d2112c22f tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:29:50.402413 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-b804612a-ac3b-4aaf-ac04-604d2112c22f tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] 10.222.0.11 "GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.051940 Nov 17 03:29:50.402977 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 477/924] 10.222.0.11 () {60 vars in 1342 bytes} [Wed Nov 17 03:29:50 2021] GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 17 03:29:50.798385 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-d0d87889-bf7c-43c2-8ead-5a56730cf381 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:29:50.799387 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-d0d87889-bf7c-43c2-8ead-5a56730cf381 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] [instance: a49437df-3059-4528-8328-2f3471d5fb45] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:29:50.806933 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-d0d87889-bf7c-43c2-8ead-5a56730cf381 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:29:50.807375 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-d0d87889-bf7c-43c2-8ead-5a56730cf381 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:29:50.808146 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-d0d87889-bf7c-43c2-8ead-5a56730cf381 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:29:50.808568 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-d0d87889-bf7c-43c2-8ead-5a56730cf381 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:29:50.838739 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-d0d87889-bf7c-43c2-8ead-5a56730cf381 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] 10.222.0.11 "GET /compute/v2.1/servers/a49437df-3059-4528-8328-2f3471d5fb45/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044006 Nov 17 03:29:50.839294 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 448/925] 10.222.0.11 () {58 vars in 1301 bytes} [Wed Nov 17 03:29:50 2021] GET /compute/v2.1/servers/a49437df-3059-4528-8328-2f3471d5fb45/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 17 03:29:51.418510 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-9bd7396b-adee-4da9-9aa3-b2fac688e9a6 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:29:51.419831 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-9bd7396b-adee-4da9-9aa3-b2fac688e9a6 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] [instance: 5d54db85-b991-4890-abaa-952413baa2e7] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:29:51.430315 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-9bd7396b-adee-4da9-9aa3-b2fac688e9a6 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:29:51.431052 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-9bd7396b-adee-4da9-9aa3-b2fac688e9a6 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:29:51.432465 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-9bd7396b-adee-4da9-9aa3-b2fac688e9a6 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:29:51.433003 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-9bd7396b-adee-4da9-9aa3-b2fac688e9a6 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:29:51.463023 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-9bd7396b-adee-4da9-9aa3-b2fac688e9a6 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] 10.222.0.11 "GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.051023 Nov 17 03:29:51.463578 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 478/926] 10.222.0.11 () {60 vars in 1342 bytes} [Wed Nov 17 03:29:51 2021] GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 17 03:29:51.850046 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-693360c2-2d81-49ec-93a1-aa25963537f5 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:29:51.850982 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-693360c2-2d81-49ec-93a1-aa25963537f5 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] [instance: a49437df-3059-4528-8328-2f3471d5fb45] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:29:51.857904 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-693360c2-2d81-49ec-93a1-aa25963537f5 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:29:51.858344 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-693360c2-2d81-49ec-93a1-aa25963537f5 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:29:51.859167 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-693360c2-2d81-49ec-93a1-aa25963537f5 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:29:51.859584 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-693360c2-2d81-49ec-93a1-aa25963537f5 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:29:51.888173 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-693360c2-2d81-49ec-93a1-aa25963537f5 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] 10.222.0.11 "GET /compute/v2.1/servers/a49437df-3059-4528-8328-2f3471d5fb45/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041851 Nov 17 03:29:51.888726 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 449/927] 10.222.0.11 () {58 vars in 1301 bytes} [Wed Nov 17 03:29:51 2021] GET /compute/v2.1/servers/a49437df-3059-4528-8328-2f3471d5fb45/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 17 03:29:52.478991 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-47f32546-b763-4bff-85e9-c5dcfd85d4b9 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:29:52.479898 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-47f32546-b763-4bff-85e9-c5dcfd85d4b9 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] [instance: 5d54db85-b991-4890-abaa-952413baa2e7] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:29:52.487286 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-47f32546-b763-4bff-85e9-c5dcfd85d4b9 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:29:52.487776 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-47f32546-b763-4bff-85e9-c5dcfd85d4b9 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:29:52.488626 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-47f32546-b763-4bff-85e9-c5dcfd85d4b9 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:29:52.489213 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-47f32546-b763-4bff-85e9-c5dcfd85d4b9 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:29:52.520088 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-47f32546-b763-4bff-85e9-c5dcfd85d4b9 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] 10.222.0.11 "GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047651 Nov 17 03:29:52.520639 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 479/928] 10.222.0.11 () {60 vars in 1342 bytes} [Wed Nov 17 03:29:52 2021] GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 17 03:29:52.899408 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-5b86b52d-b49d-423e-9911-4162bd65457c tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:29:52.900325 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-5b86b52d-b49d-423e-9911-4162bd65457c tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] [instance: a49437df-3059-4528-8328-2f3471d5fb45] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:29:52.907225 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-5b86b52d-b49d-423e-9911-4162bd65457c tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:29:52.907652 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-5b86b52d-b49d-423e-9911-4162bd65457c tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:29:52.908480 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-5b86b52d-b49d-423e-9911-4162bd65457c tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:29:52.909168 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-5b86b52d-b49d-423e-9911-4162bd65457c tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:29:52.938738 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-5b86b52d-b49d-423e-9911-4162bd65457c tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] 10.222.0.11 "GET /compute/v2.1/servers/a49437df-3059-4528-8328-2f3471d5fb45/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043046 Nov 17 03:29:52.939274 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 450/929] 10.222.0.11 () {58 vars in 1301 bytes} [Wed Nov 17 03:29:52 2021] GET /compute/v2.1/servers/a49437df-3059-4528-8328-2f3471d5fb45/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 17 03:29:53.532761 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-82cb8579-83fa-42b6-a69c-a1e44e714a66 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:29:53.533795 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-82cb8579-83fa-42b6-a69c-a1e44e714a66 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] [instance: 5d54db85-b991-4890-abaa-952413baa2e7] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:29:53.541166 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-82cb8579-83fa-42b6-a69c-a1e44e714a66 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:29:53.541737 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-82cb8579-83fa-42b6-a69c-a1e44e714a66 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:29:53.542604 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-82cb8579-83fa-42b6-a69c-a1e44e714a66 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:29:53.543083 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-82cb8579-83fa-42b6-a69c-a1e44e714a66 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:29:53.574893 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-82cb8579-83fa-42b6-a69c-a1e44e714a66 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] 10.222.0.11 "GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046391 Nov 17 03:29:53.575455 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 480/930] 10.222.0.11 () {60 vars in 1342 bytes} [Wed Nov 17 03:29:53 2021] GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 17 03:29:53.950599 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-d2d6db55-a49d-4ae7-80d5-fc45b6592c8f tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:29:53.951550 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-d2d6db55-a49d-4ae7-80d5-fc45b6592c8f tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] [instance: a49437df-3059-4528-8328-2f3471d5fb45] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:29:53.957724 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-d2d6db55-a49d-4ae7-80d5-fc45b6592c8f tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:29:53.958173 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-d2d6db55-a49d-4ae7-80d5-fc45b6592c8f tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:29:53.958953 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-d2d6db55-a49d-4ae7-80d5-fc45b6592c8f tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:29:53.959389 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-d2d6db55-a49d-4ae7-80d5-fc45b6592c8f tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:29:53.990499 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-d2d6db55-a49d-4ae7-80d5-fc45b6592c8f tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] 10.222.0.11 "GET /compute/v2.1/servers/a49437df-3059-4528-8328-2f3471d5fb45/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044242 Nov 17 03:29:53.991042 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 451/931] 10.222.0.11 () {58 vars in 1301 bytes} [Wed Nov 17 03:29:53 2021] GET /compute/v2.1/servers/a49437df-3059-4528-8328-2f3471d5fb45/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 17 03:29:54.591105 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-20c8d35e-01a7-4478-a2a7-95f6d1c938ed tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:29:54.592568 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-20c8d35e-01a7-4478-a2a7-95f6d1c938ed tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] [instance: 5d54db85-b991-4890-abaa-952413baa2e7] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:29:54.602961 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-20c8d35e-01a7-4478-a2a7-95f6d1c938ed tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:29:54.603699 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-20c8d35e-01a7-4478-a2a7-95f6d1c938ed tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:29:54.604984 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-20c8d35e-01a7-4478-a2a7-95f6d1c938ed tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:29:54.606070 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-20c8d35e-01a7-4478-a2a7-95f6d1c938ed tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:29:54.635115 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-20c8d35e-01a7-4478-a2a7-95f6d1c938ed tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] 10.222.0.11 "GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.051102 Nov 17 03:29:54.635671 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 481/932] 10.222.0.11 () {60 vars in 1342 bytes} [Wed Nov 17 03:29:54 2021] GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 17 03:29:55.002283 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-4ed6989b-3c75-4dda-87b9-2129d17cfefc tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:29:55.003275 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-4ed6989b-3c75-4dda-87b9-2129d17cfefc tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] [instance: a49437df-3059-4528-8328-2f3471d5fb45] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:29:55.010180 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-4ed6989b-3c75-4dda-87b9-2129d17cfefc tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:29:55.010633 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-4ed6989b-3c75-4dda-87b9-2129d17cfefc tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:29:55.011419 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-4ed6989b-3c75-4dda-87b9-2129d17cfefc tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:29:55.012009 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-4ed6989b-3c75-4dda-87b9-2129d17cfefc tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:29:55.042128 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-4ed6989b-3c75-4dda-87b9-2129d17cfefc tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] 10.222.0.11 "GET /compute/v2.1/servers/a49437df-3059-4528-8328-2f3471d5fb45/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043580 Nov 17 03:29:55.042682 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 452/933] 10.222.0.11 () {58 vars in 1301 bytes} [Wed Nov 17 03:29:54 2021] GET /compute/v2.1/servers/a49437df-3059-4528-8328-2f3471d5fb45/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 17 03:29:55.652594 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-e3b3042a-0da1-4f67-850d-bcb26438380b tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:29:55.654299 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-e3b3042a-0da1-4f67-850d-bcb26438380b tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] [instance: 5d54db85-b991-4890-abaa-952413baa2e7] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:29:55.661039 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-e3b3042a-0da1-4f67-850d-bcb26438380b tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:29:55.661485 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-e3b3042a-0da1-4f67-850d-bcb26438380b tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:29:55.662248 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-e3b3042a-0da1-4f67-850d-bcb26438380b tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:29:55.662649 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-e3b3042a-0da1-4f67-850d-bcb26438380b tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:29:55.693273 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-e3b3042a-0da1-4f67-850d-bcb26438380b tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] 10.222.0.11 "GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047020 Nov 17 03:29:55.693849 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 482/934] 10.222.0.11 () {60 vars in 1342 bytes} [Wed Nov 17 03:29:55 2021] GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 17 03:29:56.060835 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-fa5f3152-b8e1-429b-b26f-a63f45200f22 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:29:56.062602 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-fa5f3152-b8e1-429b-b26f-a63f45200f22 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] [instance: a49437df-3059-4528-8328-2f3471d5fb45] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:29:56.071871 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-fa5f3152-b8e1-429b-b26f-a63f45200f22 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:29:56.072325 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-fa5f3152-b8e1-429b-b26f-a63f45200f22 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:29:56.073251 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-fa5f3152-b8e1-429b-b26f-a63f45200f22 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:29:56.073584 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-fa5f3152-b8e1-429b-b26f-a63f45200f22 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:29:56.103766 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-fa5f3152-b8e1-429b-b26f-a63f45200f22 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] 10.222.0.11 "GET /compute/v2.1/servers/a49437df-3059-4528-8328-2f3471d5fb45/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050776 Nov 17 03:29:56.104633 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 453/935] 10.222.0.11 () {58 vars in 1301 bytes} [Wed Nov 17 03:29:56 2021] GET /compute/v2.1/servers/a49437df-3059-4528-8328-2f3471d5fb45/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 17 03:29:56.708683 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-3e2cb343-98f5-4fb3-820f-605bb28bfd1e tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:29:56.710266 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-3e2cb343-98f5-4fb3-820f-605bb28bfd1e tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] [instance: 5d54db85-b991-4890-abaa-952413baa2e7] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:29:56.719738 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-3e2cb343-98f5-4fb3-820f-605bb28bfd1e tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:29:56.720191 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-3e2cb343-98f5-4fb3-820f-605bb28bfd1e tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:29:56.721037 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-3e2cb343-98f5-4fb3-820f-605bb28bfd1e tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:29:56.721471 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-3e2cb343-98f5-4fb3-820f-605bb28bfd1e tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:29:56.751935 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-3e2cb343-98f5-4fb3-820f-605bb28bfd1e tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] 10.222.0.11 "GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.049613 Nov 17 03:29:56.752490 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 483/936] 10.222.0.11 () {60 vars in 1342 bytes} [Wed Nov 17 03:29:56 2021] GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 17 03:29:57.115788 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-85320279-72a6-4a84-9c0e-e6c3b94abca6 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:29:57.116932 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-85320279-72a6-4a84-9c0e-e6c3b94abca6 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] [instance: a49437df-3059-4528-8328-2f3471d5fb45] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:29:57.125547 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-85320279-72a6-4a84-9c0e-e6c3b94abca6 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:29:57.125880 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-85320279-72a6-4a84-9c0e-e6c3b94abca6 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:29:57.126885 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-85320279-72a6-4a84-9c0e-e6c3b94abca6 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:29:57.127324 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-85320279-72a6-4a84-9c0e-e6c3b94abca6 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:29:57.156997 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-85320279-72a6-4a84-9c0e-e6c3b94abca6 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] 10.222.0.11 "GET /compute/v2.1/servers/a49437df-3059-4528-8328-2f3471d5fb45/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045042 Nov 17 03:29:57.157561 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 454/937] 10.222.0.11 () {58 vars in 1301 bytes} [Wed Nov 17 03:29:57 2021] GET /compute/v2.1/servers/a49437df-3059-4528-8328-2f3471d5fb45/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 17 03:29:57.764023 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-0b75903e-2045-4b51-b363-661b9c8f8601 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:29:57.764993 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-0b75903e-2045-4b51-b363-661b9c8f8601 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] [instance: 5d54db85-b991-4890-abaa-952413baa2e7] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:29:57.771786 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-0b75903e-2045-4b51-b363-661b9c8f8601 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:29:57.772167 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-0b75903e-2045-4b51-b363-661b9c8f8601 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:29:57.772966 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-0b75903e-2045-4b51-b363-661b9c8f8601 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:29:57.773395 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-0b75903e-2045-4b51-b363-661b9c8f8601 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:29:57.803282 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-0b75903e-2045-4b51-b363-661b9c8f8601 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] 10.222.0.11 "GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043137 Nov 17 03:29:57.804044 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 484/938] 10.222.0.11 () {60 vars in 1342 bytes} [Wed Nov 17 03:29:57 2021] GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 17 03:29:58.168001 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-a616976a-96b8-4661-b536-4220fb5bf236 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:29:58.169566 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-a616976a-96b8-4661-b536-4220fb5bf236 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] [instance: a49437df-3059-4528-8328-2f3471d5fb45] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:29:58.176188 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-a616976a-96b8-4661-b536-4220fb5bf236 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:29:58.176638 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-a616976a-96b8-4661-b536-4220fb5bf236 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:29:58.177469 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-a616976a-96b8-4661-b536-4220fb5bf236 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:29:58.177898 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-a616976a-96b8-4661-b536-4220fb5bf236 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:29:58.208497 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-a616976a-96b8-4661-b536-4220fb5bf236 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] 10.222.0.11 "GET /compute/v2.1/servers/a49437df-3059-4528-8328-2f3471d5fb45/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044189 Nov 17 03:29:58.209076 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 455/939] 10.222.0.11 () {58 vars in 1301 bytes} [Wed Nov 17 03:29:58 2021] GET /compute/v2.1/servers/a49437df-3059-4528-8328-2f3471d5fb45/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 17 03:29:58.817265 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-6d7891bd-de69-4f88-931c-ab73688e4bb2 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:29:58.818476 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-6d7891bd-de69-4f88-931c-ab73688e4bb2 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] [instance: 5d54db85-b991-4890-abaa-952413baa2e7] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:29:58.827034 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-6d7891bd-de69-4f88-931c-ab73688e4bb2 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:29:58.827531 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-6d7891bd-de69-4f88-931c-ab73688e4bb2 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:29:58.828426 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-6d7891bd-de69-4f88-931c-ab73688e4bb2 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:29:58.828965 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-6d7891bd-de69-4f88-931c-ab73688e4bb2 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:29:58.860290 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-6d7891bd-de69-4f88-931c-ab73688e4bb2 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] 10.222.0.11 "GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047621 Nov 17 03:29:58.860874 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 485/940] 10.222.0.11 () {60 vars in 1342 bytes} [Wed Nov 17 03:29:58 2021] GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 17 03:29:59.220218 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-9e74a726-030a-4ddb-8f26-d0919e764165 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:29:59.221161 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-9e74a726-030a-4ddb-8f26-d0919e764165 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] [instance: a49437df-3059-4528-8328-2f3471d5fb45] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:29:59.227462 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-9e74a726-030a-4ddb-8f26-d0919e764165 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:29:59.227897 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-9e74a726-030a-4ddb-8f26-d0919e764165 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:29:59.228665 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-9e74a726-030a-4ddb-8f26-d0919e764165 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:29:59.229108 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-9e74a726-030a-4ddb-8f26-d0919e764165 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:29:59.263795 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-9e74a726-030a-4ddb-8f26-d0919e764165 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] 10.222.0.11 "GET /compute/v2.1/servers/a49437df-3059-4528-8328-2f3471d5fb45/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047237 Nov 17 03:29:59.264624 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 456/941] 10.222.0.11 () {58 vars in 1301 bytes} [Wed Nov 17 03:29:59 2021] GET /compute/v2.1/servers/a49437df-3059-4528-8328-2f3471d5fb45/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 17 03:29:59.876458 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-919f1be8-92ac-4263-b64f-82ada28933cc tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:29:59.877855 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-919f1be8-92ac-4263-b64f-82ada28933cc tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] [instance: 5d54db85-b991-4890-abaa-952413baa2e7] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:29:59.888472 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-919f1be8-92ac-4263-b64f-82ada28933cc tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:29:59.889282 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-919f1be8-92ac-4263-b64f-82ada28933cc tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:29:59.890318 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-919f1be8-92ac-4263-b64f-82ada28933cc tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:29:59.890749 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-919f1be8-92ac-4263-b64f-82ada28933cc tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:29:59.920915 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-919f1be8-92ac-4263-b64f-82ada28933cc tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] 10.222.0.11 "GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.051084 Nov 17 03:29:59.921651 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 486/942] 10.222.0.11 () {60 vars in 1342 bytes} [Wed Nov 17 03:29:59 2021] GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 17 03:30:00.275793 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-5b034ef3-bdbb-44d1-8402-596edbc03b94 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:30:00.276757 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-5b034ef3-bdbb-44d1-8402-596edbc03b94 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] [instance: a49437df-3059-4528-8328-2f3471d5fb45] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:30:00.283938 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-5b034ef3-bdbb-44d1-8402-596edbc03b94 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:30:00.284396 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-5b034ef3-bdbb-44d1-8402-596edbc03b94 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:30:00.285219 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-5b034ef3-bdbb-44d1-8402-596edbc03b94 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:30:00.285655 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-5b034ef3-bdbb-44d1-8402-596edbc03b94 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:30:00.317129 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-5b034ef3-bdbb-44d1-8402-596edbc03b94 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] 10.222.0.11 "GET /compute/v2.1/servers/a49437df-3059-4528-8328-2f3471d5fb45/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045327 Nov 17 03:30:00.317721 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 457/943] 10.222.0.11 () {58 vars in 1301 bytes} [Wed Nov 17 03:30:00 2021] GET /compute/v2.1/servers/a49437df-3059-4528-8328-2f3471d5fb45/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 17 03:30:00.937796 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-c3a88b00-db8e-4450-b354-2294ea519b58 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:30:00.938824 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-c3a88b00-db8e-4450-b354-2294ea519b58 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] [instance: 5d54db85-b991-4890-abaa-952413baa2e7] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:30:00.946181 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-c3a88b00-db8e-4450-b354-2294ea519b58 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:30:00.946675 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-c3a88b00-db8e-4450-b354-2294ea519b58 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:30:00.947516 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-c3a88b00-db8e-4450-b354-2294ea519b58 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:30:00.947987 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-c3a88b00-db8e-4450-b354-2294ea519b58 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:30:00.979685 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-c3a88b00-db8e-4450-b354-2294ea519b58 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] 10.222.0.11 "GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.048888 Nov 17 03:30:00.980234 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 487/944] 10.222.0.11 () {60 vars in 1342 bytes} [Wed Nov 17 03:30:00 2021] GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 17 03:30:01.330752 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-237008d5-3787-4aa7-91db-c643eca19500 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:30:01.331675 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-237008d5-3787-4aa7-91db-c643eca19500 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] [instance: a49437df-3059-4528-8328-2f3471d5fb45] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:30:01.338398 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-237008d5-3787-4aa7-91db-c643eca19500 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:30:01.338854 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-237008d5-3787-4aa7-91db-c643eca19500 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:30:01.339644 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-237008d5-3787-4aa7-91db-c643eca19500 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:30:01.340080 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-237008d5-3787-4aa7-91db-c643eca19500 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:30:01.370284 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-237008d5-3787-4aa7-91db-c643eca19500 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] 10.222.0.11 "GET /compute/v2.1/servers/a49437df-3059-4528-8328-2f3471d5fb45/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043980 Nov 17 03:30:01.374166 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 458/945] 10.222.0.11 () {58 vars in 1301 bytes} [Wed Nov 17 03:30:01 2021] GET /compute/v2.1/servers/a49437df-3059-4528-8328-2f3471d5fb45/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 17 03:30:01.998909 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-ea72c038-c32f-4b94-93bb-4d32e974c8b1 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:30:02.000841 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-ea72c038-c32f-4b94-93bb-4d32e974c8b1 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] [instance: 5d54db85-b991-4890-abaa-952413baa2e7] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:30:02.011447 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-ea72c038-c32f-4b94-93bb-4d32e974c8b1 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:30:02.012199 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-ea72c038-c32f-4b94-93bb-4d32e974c8b1 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:30:02.013554 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-ea72c038-c32f-4b94-93bb-4d32e974c8b1 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:30:02.014281 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-ea72c038-c32f-4b94-93bb-4d32e974c8b1 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:30:02.043996 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-ea72c038-c32f-4b94-93bb-4d32e974c8b1 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] 10.222.0.11 "GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.051510 Nov 17 03:30:02.044548 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 488/946] 10.222.0.11 () {60 vars in 1342 bytes} [Wed Nov 17 03:30:01 2021] GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 17 03:30:02.381969 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-cf7ee671-2421-48b3-bc85-018e6223b16b tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:30:02.382906 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-cf7ee671-2421-48b3-bc85-018e6223b16b tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] [instance: a49437df-3059-4528-8328-2f3471d5fb45] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:30:02.389690 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-cf7ee671-2421-48b3-bc85-018e6223b16b tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:30:02.390143 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-cf7ee671-2421-48b3-bc85-018e6223b16b tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:30:02.390909 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-cf7ee671-2421-48b3-bc85-018e6223b16b tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:30:02.391345 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-cf7ee671-2421-48b3-bc85-018e6223b16b tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:30:02.420950 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-cf7ee671-2421-48b3-bc85-018e6223b16b tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] 10.222.0.11 "GET /compute/v2.1/servers/a49437df-3059-4528-8328-2f3471d5fb45/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042639 Nov 17 03:30:02.421722 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 459/947] 10.222.0.11 () {58 vars in 1301 bytes} [Wed Nov 17 03:30:02 2021] GET /compute/v2.1/servers/a49437df-3059-4528-8328-2f3471d5fb45/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 17 03:30:03.060553 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-eaa4eed4-e695-4aa4-b6c5-5b5058369d94 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:30:03.062077 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-eaa4eed4-e695-4aa4-b6c5-5b5058369d94 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] [instance: 5d54db85-b991-4890-abaa-952413baa2e7] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:30:03.068599 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-eaa4eed4-e695-4aa4-b6c5-5b5058369d94 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:30:03.069087 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-eaa4eed4-e695-4aa4-b6c5-5b5058369d94 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:30:03.069870 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-eaa4eed4-e695-4aa4-b6c5-5b5058369d94 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:30:03.070355 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-eaa4eed4-e695-4aa4-b6c5-5b5058369d94 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:30:03.100471 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-eaa4eed4-e695-4aa4-b6c5-5b5058369d94 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] 10.222.0.11 "GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046861 Nov 17 03:30:03.101084 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 489/948] 10.222.0.11 () {60 vars in 1342 bytes} [Wed Nov 17 03:30:03 2021] GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 17 03:30:03.437400 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-ce7abafb-6229-412f-87bf-6b37f1351b1b tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:30:03.438385 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-ce7abafb-6229-412f-87bf-6b37f1351b1b tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] [instance: a49437df-3059-4528-8328-2f3471d5fb45] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:30:03.444938 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-ce7abafb-6229-412f-87bf-6b37f1351b1b tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:30:03.445379 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-ce7abafb-6229-412f-87bf-6b37f1351b1b tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:30:03.446158 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-ce7abafb-6229-412f-87bf-6b37f1351b1b tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:30:03.446585 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-ce7abafb-6229-412f-87bf-6b37f1351b1b tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:30:03.476922 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-ce7abafb-6229-412f-87bf-6b37f1351b1b tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] 10.222.0.11 "GET /compute/v2.1/servers/a49437df-3059-4528-8328-2f3471d5fb45/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046610 Nov 17 03:30:03.477471 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 460/949] 10.222.0.11 () {58 vars in 1301 bytes} [Wed Nov 17 03:30:03 2021] GET /compute/v2.1/servers/a49437df-3059-4528-8328-2f3471d5fb45/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 17 03:30:04.113243 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-b9331e58-b048-44ca-af33-fc62ac50d542 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:30:04.114150 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-b9331e58-b048-44ca-af33-fc62ac50d542 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] [instance: 5d54db85-b991-4890-abaa-952413baa2e7] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:30:04.120831 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-b9331e58-b048-44ca-af33-fc62ac50d542 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:30:04.121305 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-b9331e58-b048-44ca-af33-fc62ac50d542 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:30:04.122071 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-b9331e58-b048-44ca-af33-fc62ac50d542 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:30:04.122499 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-b9331e58-b048-44ca-af33-fc62ac50d542 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:30:04.152474 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-b9331e58-b048-44ca-af33-fc62ac50d542 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] 10.222.0.11 "GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043177 Nov 17 03:30:04.153110 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 490/950] 10.222.0.11 () {60 vars in 1342 bytes} [Wed Nov 17 03:30:04 2021] GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 17 03:30:04.492636 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-2728be0c-9c86-417b-b658-f51b965d429f tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:30:04.495342 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-2728be0c-9c86-417b-b658-f51b965d429f tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] [instance: a49437df-3059-4528-8328-2f3471d5fb45] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:30:04.505993 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-2728be0c-9c86-417b-b658-f51b965d429f tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:30:04.506741 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-2728be0c-9c86-417b-b658-f51b965d429f tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:30:04.508014 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-2728be0c-9c86-417b-b658-f51b965d429f tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:30:04.508726 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-2728be0c-9c86-417b-b658-f51b965d429f tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:30:04.541282 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-2728be0c-9c86-417b-b658-f51b965d429f tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] 10.222.0.11 "GET /compute/v2.1/servers/a49437df-3059-4528-8328-2f3471d5fb45/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.054881 Nov 17 03:30:04.541850 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 461/951] 10.222.0.11 () {58 vars in 1301 bytes} [Wed Nov 17 03:30:04 2021] GET /compute/v2.1/servers/a49437df-3059-4528-8328-2f3471d5fb45/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 17 03:30:05.167612 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-1589c71a-5dc3-4768-bfe8-47e7ce5dafc7 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:30:05.169171 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-1589c71a-5dc3-4768-bfe8-47e7ce5dafc7 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] [instance: 5d54db85-b991-4890-abaa-952413baa2e7] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:30:05.176688 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-1589c71a-5dc3-4768-bfe8-47e7ce5dafc7 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:30:05.177190 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-1589c71a-5dc3-4768-bfe8-47e7ce5dafc7 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:30:05.177968 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-1589c71a-5dc3-4768-bfe8-47e7ce5dafc7 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:30:05.178403 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-1589c71a-5dc3-4768-bfe8-47e7ce5dafc7 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:30:05.208471 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-1589c71a-5dc3-4768-bfe8-47e7ce5dafc7 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] 10.222.0.11 "GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047294 Nov 17 03:30:05.209052 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 491/952] 10.222.0.11 () {60 vars in 1342 bytes} [Wed Nov 17 03:30:05 2021] GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 17 03:30:05.557381 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-627036f4-6725-400e-a4ce-f643b97a1094 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:30:05.558871 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-627036f4-6725-400e-a4ce-f643b97a1094 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] [instance: a49437df-3059-4528-8328-2f3471d5fb45] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:30:05.566639 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-627036f4-6725-400e-a4ce-f643b97a1094 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:30:05.567092 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-627036f4-6725-400e-a4ce-f643b97a1094 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:30:05.567881 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-627036f4-6725-400e-a4ce-f643b97a1094 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:30:05.568327 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-627036f4-6725-400e-a4ce-f643b97a1094 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:30:05.598598 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-627036f4-6725-400e-a4ce-f643b97a1094 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] 10.222.0.11 "GET /compute/v2.1/servers/a49437df-3059-4528-8328-2f3471d5fb45/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048152 Nov 17 03:30:05.599332 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 462/953] 10.222.0.11 () {58 vars in 1301 bytes} [Wed Nov 17 03:30:05 2021] GET /compute/v2.1/servers/a49437df-3059-4528-8328-2f3471d5fb45/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 17 03:30:06.220008 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-fa71be5f-45bb-4468-82a7-44e18728d80f tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:30:06.221047 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-fa71be5f-45bb-4468-82a7-44e18728d80f tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] [instance: 5d54db85-b991-4890-abaa-952413baa2e7] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:30:06.227804 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-fa71be5f-45bb-4468-82a7-44e18728d80f tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:30:06.228251 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-fa71be5f-45bb-4468-82a7-44e18728d80f tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:30:06.229058 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-fa71be5f-45bb-4468-82a7-44e18728d80f tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:30:06.229484 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-fa71be5f-45bb-4468-82a7-44e18728d80f tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:30:06.259136 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-fa71be5f-45bb-4468-82a7-44e18728d80f tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] 10.222.0.11 "GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043361 Nov 17 03:30:06.259695 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 492/954] 10.222.0.11 () {60 vars in 1342 bytes} [Wed Nov 17 03:30:06 2021] GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 17 03:30:06.611870 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-545ea567-4534-4d0e-b2b5-6341772ac63a tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:30:06.612802 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-545ea567-4534-4d0e-b2b5-6341772ac63a tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] [instance: a49437df-3059-4528-8328-2f3471d5fb45] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:30:06.619178 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-545ea567-4534-4d0e-b2b5-6341772ac63a tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:30:06.619623 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-545ea567-4534-4d0e-b2b5-6341772ac63a tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:30:06.620395 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-545ea567-4534-4d0e-b2b5-6341772ac63a tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:30:06.622279 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-545ea567-4534-4d0e-b2b5-6341772ac63a tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:30:06.651900 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-545ea567-4534-4d0e-b2b5-6341772ac63a tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] 10.222.0.11 "GET /compute/v2.1/servers/a49437df-3059-4528-8328-2f3471d5fb45/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044310 Nov 17 03:30:06.652649 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 463/955] 10.222.0.11 () {58 vars in 1301 bytes} [Wed Nov 17 03:30:06 2021] GET /compute/v2.1/servers/a49437df-3059-4528-8328-2f3471d5fb45/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 17 03:30:07.275561 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-35768662-78ea-4fe4-9b26-61adbb11ec9a tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:30:07.277105 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-35768662-78ea-4fe4-9b26-61adbb11ec9a tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] [instance: 5d54db85-b991-4890-abaa-952413baa2e7] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:30:07.288048 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-35768662-78ea-4fe4-9b26-61adbb11ec9a tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:30:07.288808 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-35768662-78ea-4fe4-9b26-61adbb11ec9a tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:30:07.290148 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-35768662-78ea-4fe4-9b26-61adbb11ec9a tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:30:07.290853 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-35768662-78ea-4fe4-9b26-61adbb11ec9a tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:30:07.323289 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-35768662-78ea-4fe4-9b26-61adbb11ec9a tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] 10.222.0.11 "GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.054118 Nov 17 03:30:07.323745 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 493/956] 10.222.0.11 () {60 vars in 1342 bytes} [Wed Nov 17 03:30:07 2021] GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 17 03:30:07.664002 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-70060a02-7a17-4955-9e7c-1dfd58375bd4 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:30:07.665126 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-70060a02-7a17-4955-9e7c-1dfd58375bd4 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] [instance: a49437df-3059-4528-8328-2f3471d5fb45] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:30:07.672388 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-70060a02-7a17-4955-9e7c-1dfd58375bd4 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:30:07.672981 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-70060a02-7a17-4955-9e7c-1dfd58375bd4 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:30:07.673948 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-70060a02-7a17-4955-9e7c-1dfd58375bd4 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:30:07.674490 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-70060a02-7a17-4955-9e7c-1dfd58375bd4 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:30:07.705539 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-70060a02-7a17-4955-9e7c-1dfd58375bd4 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] 10.222.0.11 "GET /compute/v2.1/servers/a49437df-3059-4528-8328-2f3471d5fb45/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045871 Nov 17 03:30:07.706089 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 464/957] 10.222.0.11 () {58 vars in 1301 bytes} [Wed Nov 17 03:30:07 2021] GET /compute/v2.1/servers/a49437df-3059-4528-8328-2f3471d5fb45/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 17 03:30:08.339670 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-94b53191-9e75-40ef-a19f-a96316cb0919 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:30:08.341068 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-94b53191-9e75-40ef-a19f-a96316cb0919 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] [instance: 5d54db85-b991-4890-abaa-952413baa2e7] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:30:08.348477 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-94b53191-9e75-40ef-a19f-a96316cb0919 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:30:08.348951 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-94b53191-9e75-40ef-a19f-a96316cb0919 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:30:08.349745 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-94b53191-9e75-40ef-a19f-a96316cb0919 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:30:08.350178 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-94b53191-9e75-40ef-a19f-a96316cb0919 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:30:08.381820 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-94b53191-9e75-40ef-a19f-a96316cb0919 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] 10.222.0.11 "GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.048482 Nov 17 03:30:08.382536 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 494/958] 10.222.0.11 () {60 vars in 1342 bytes} [Wed Nov 17 03:30:08 2021] GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 17 03:30:08.721122 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-da4c6cef-53c7-4519-ada0-89252e4bb950 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:30:08.722781 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-da4c6cef-53c7-4519-ada0-89252e4bb950 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] [instance: a49437df-3059-4528-8328-2f3471d5fb45] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:30:08.733303 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-da4c6cef-53c7-4519-ada0-89252e4bb950 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:30:08.733759 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-da4c6cef-53c7-4519-ada0-89252e4bb950 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:30:08.734538 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-da4c6cef-53c7-4519-ada0-89252e4bb950 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:30:08.734994 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-da4c6cef-53c7-4519-ada0-89252e4bb950 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:30:08.764040 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-da4c6cef-53c7-4519-ada0-89252e4bb950 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] 10.222.0.11 "GET /compute/v2.1/servers/a49437df-3059-4528-8328-2f3471d5fb45/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049473 Nov 17 03:30:08.764827 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 465/959] 10.222.0.11 () {58 vars in 1301 bytes} [Wed Nov 17 03:30:08 2021] GET /compute/v2.1/servers/a49437df-3059-4528-8328-2f3471d5fb45/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 17 03:30:09.523788 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-0e1a5e79-008b-4ea6-8d06-5bbde0a43871 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:30:09.525106 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-0e1a5e79-008b-4ea6-8d06-5bbde0a43871 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] [instance: 5d54db85-b991-4890-abaa-952413baa2e7] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:30:09.534135 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-0e1a5e79-008b-4ea6-8d06-5bbde0a43871 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:30:09.534577 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-0e1a5e79-008b-4ea6-8d06-5bbde0a43871 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:30:09.535350 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-0e1a5e79-008b-4ea6-8d06-5bbde0a43871 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:30:09.535780 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-0e1a5e79-008b-4ea6-8d06-5bbde0a43871 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:30:09.567229 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-0e1a5e79-008b-4ea6-8d06-5bbde0a43871 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] 10.222.0.11 "GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.173718 Nov 17 03:30:09.567772 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 495/960] 10.222.0.11 () {60 vars in 1342 bytes} [Wed Nov 17 03:30:09 2021] GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7/os-volume_attachments => generated 197 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 17 03:30:09.776527 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-d383f777-e711-4da4-b47d-f709676c1188 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:30:09.777980 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-d383f777-e711-4da4-b47d-f709676c1188 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] [instance: a49437df-3059-4528-8328-2f3471d5fb45] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:30:09.785105 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-d383f777-e711-4da4-b47d-f709676c1188 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:30:09.785572 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-d383f777-e711-4da4-b47d-f709676c1188 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:30:09.786680 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-d383f777-e711-4da4-b47d-f709676c1188 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:30:09.786934 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-d383f777-e711-4da4-b47d-f709676c1188 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:30:09.818099 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-d383f777-e711-4da4-b47d-f709676c1188 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] 10.222.0.11 "GET /compute/v2.1/servers/a49437df-3059-4528-8328-2f3471d5fb45/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045861 Nov 17 03:30:09.819087 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 466/961] 10.222.0.11 () {58 vars in 1301 bytes} [Wed Nov 17 03:30:09 2021] GET /compute/v2.1/servers/a49437df-3059-4528-8328-2f3471d5fb45/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 17 03:30:09.880016 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 17 03:30:09.880208 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: Wed Nov 17 03:30:09 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Nov 17 03:30:10.581592 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-232bca49-1006-44a5-b748-a4d94ff97518 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:30:10.582821 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-232bca49-1006-44a5-b748-a4d94ff97518 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] [instance: 5d54db85-b991-4890-abaa-952413baa2e7] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:30:10.591237 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-232bca49-1006-44a5-b748-a4d94ff97518 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:30:10.591844 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-232bca49-1006-44a5-b748-a4d94ff97518 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:30:10.593022 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-232bca49-1006-44a5-b748-a4d94ff97518 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:30:10.593470 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-232bca49-1006-44a5-b748-a4d94ff97518 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:30:10.623589 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-232bca49-1006-44a5-b748-a4d94ff97518 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] 10.222.0.11 "GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047428 Nov 17 03:30:10.624265 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 496/962] 10.222.0.11 () {60 vars in 1342 bytes} [Wed Nov 17 03:30:10 2021] GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 17 03:30:10.834290 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-fdae9d49-ae79-4a05-8f98-4b48d443a0ab tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:30:10.835639 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-fdae9d49-ae79-4a05-8f98-4b48d443a0ab tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] [instance: a49437df-3059-4528-8328-2f3471d5fb45] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:30:10.845146 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-fdae9d49-ae79-4a05-8f98-4b48d443a0ab tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:30:10.845600 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-fdae9d49-ae79-4a05-8f98-4b48d443a0ab tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:30:10.846388 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-fdae9d49-ae79-4a05-8f98-4b48d443a0ab tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:30:10.846820 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-fdae9d49-ae79-4a05-8f98-4b48d443a0ab tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:30:10.879562 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-fdae9d49-ae79-4a05-8f98-4b48d443a0ab tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] 10.222.0.11 "GET /compute/v2.1/servers/a49437df-3059-4528-8328-2f3471d5fb45/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052660 Nov 17 03:30:10.880476 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 467/963] 10.222.0.11 () {58 vars in 1301 bytes} [Wed Nov 17 03:30:10 2021] GET /compute/v2.1/servers/a49437df-3059-4528-8328-2f3471d5fb45/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 17 03:30:11.637711 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-15e42732-a857-4633-97ec-ad8f8c718396 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:30:11.638654 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-15e42732-a857-4633-97ec-ad8f8c718396 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] [instance: 5d54db85-b991-4890-abaa-952413baa2e7] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:30:11.645636 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-15e42732-a857-4633-97ec-ad8f8c718396 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:30:11.646105 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-15e42732-a857-4633-97ec-ad8f8c718396 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:30:11.646904 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-15e42732-a857-4633-97ec-ad8f8c718396 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:30:11.647304 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-15e42732-a857-4633-97ec-ad8f8c718396 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:30:11.681420 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-15e42732-a857-4633-97ec-ad8f8c718396 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] 10.222.0.11 "GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047115 Nov 17 03:30:11.681971 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 497/964] 10.222.0.11 () {60 vars in 1342 bytes} [Wed Nov 17 03:30:11 2021] GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 17 03:30:11.999470 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-428f9f3f-8d56-403f-a19e-faab93a52145 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:30:12.000436 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-428f9f3f-8d56-403f-a19e-faab93a52145 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] [instance: a49437df-3059-4528-8328-2f3471d5fb45] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:30:12.006509 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-428f9f3f-8d56-403f-a19e-faab93a52145 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:30:12.007029 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-428f9f3f-8d56-403f-a19e-faab93a52145 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:30:12.007797 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-428f9f3f-8d56-403f-a19e-faab93a52145 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:30:12.008228 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-428f9f3f-8d56-403f-a19e-faab93a52145 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:30:12.037404 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-428f9f3f-8d56-403f-a19e-faab93a52145 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] 10.222.0.11 "GET /compute/v2.1/servers/a49437df-3059-4528-8328-2f3471d5fb45/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.149684 Nov 17 03:30:12.037958 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 468/965] 10.222.0.11 () {58 vars in 1301 bytes} [Wed Nov 17 03:30:11 2021] GET /compute/v2.1/servers/a49437df-3059-4528-8328-2f3471d5fb45/os-volume_attachments => generated 197 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 17 03:30:12.698994 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-b6ffb009-330f-4dae-b06a-df9999b5bedb tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:30:12.698994 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-b6ffb009-330f-4dae-b06a-df9999b5bedb tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] [instance: 5d54db85-b991-4890-abaa-952413baa2e7] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:30:12.707049 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-b6ffb009-330f-4dae-b06a-df9999b5bedb tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:30:12.707464 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-b6ffb009-330f-4dae-b06a-df9999b5bedb tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:30:12.708210 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-b6ffb009-330f-4dae-b06a-df9999b5bedb tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:30:12.708669 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-b6ffb009-330f-4dae-b06a-df9999b5bedb tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:30:12.738663 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-b6ffb009-330f-4dae-b06a-df9999b5bedb tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] 10.222.0.11 "GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047372 Nov 17 03:30:12.739287 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 498/966] 10.222.0.11 () {60 vars in 1342 bytes} [Wed Nov 17 03:30:12 2021] GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 17 03:30:13.049138 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-bc865acf-207a-4537-b897-173cd0b09145 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:30:13.050090 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-bc865acf-207a-4537-b897-173cd0b09145 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] [instance: a49437df-3059-4528-8328-2f3471d5fb45] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:30:13.056822 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-bc865acf-207a-4537-b897-173cd0b09145 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:30:13.057286 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-bc865acf-207a-4537-b897-173cd0b09145 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:30:13.058072 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-bc865acf-207a-4537-b897-173cd0b09145 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:30:13.058501 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-bc865acf-207a-4537-b897-173cd0b09145 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:30:13.088462 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-bc865acf-207a-4537-b897-173cd0b09145 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] 10.222.0.11 "GET /compute/v2.1/servers/a49437df-3059-4528-8328-2f3471d5fb45/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043360 Nov 17 03:30:13.089045 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 469/967] 10.222.0.11 () {58 vars in 1301 bytes} [Wed Nov 17 03:30:13 2021] GET /compute/v2.1/servers/a49437df-3059-4528-8328-2f3471d5fb45/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 17 03:30:13.517747 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-74f70273-162e-496d-b54f-98dbb4d5cbaa tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:30:13.518444 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-74f70273-162e-496d-b54f-98dbb4d5cbaa tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] [instance: 5ddbfaaa-fabf-4324-941c-8868625ffefc] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:30:13.525049 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-74f70273-162e-496d-b54f-98dbb4d5cbaa tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:30:13.525503 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-74f70273-162e-496d-b54f-98dbb4d5cbaa tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:30:13.526284 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-74f70273-162e-496d-b54f-98dbb4d5cbaa tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:30:13.526721 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-74f70273-162e-496d-b54f-98dbb4d5cbaa tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:30:13.551395 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-74f70273-162e-496d-b54f-98dbb4d5cbaa tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] [instance: 5ddbfaaa-fabf-4324-941c-8868625ffefc] Going to try to terminate instance {{(pid=115916) delete /opt/stack/nova/nova/compute/api.py:2614}} Nov 17 03:30:13.630608 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-74f70273-162e-496d-b54f-98dbb4d5cbaa tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] 10.222.0.11 "DELETE /compute/v2.1/servers/5ddbfaaa-fabf-4324-941c-8868625ffefc" status: 204 len: 0 microversion: 2.1 time: 0.117132 Nov 17 03:30:13.631133 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 499/968] 10.222.0.11 () {58 vars in 1238 bytes} [Wed Nov 17 03:30:13 2021] DELETE /compute/v2.1/servers/5ddbfaaa-fabf-4324-941c-8868625ffefc => generated 0 bytes in 119 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 17 03:30:13.639675 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-2b041230-b38b-49e5-b98b-df74a5de6c0b tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:30:13.640446 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-2b041230-b38b-49e5-b98b-df74a5de6c0b tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] [instance: 5ddbfaaa-fabf-4324-941c-8868625ffefc] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:30:13.646507 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-2b041230-b38b-49e5-b98b-df74a5de6c0b tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:30:13.647046 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-2b041230-b38b-49e5-b98b-df74a5de6c0b tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:30:13.647820 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-2b041230-b38b-49e5-b98b-df74a5de6c0b tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:30:13.648256 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-2b041230-b38b-49e5-b98b-df74a5de6c0b tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:30:13.751342 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-59908cd3-8d82-484b-ae56-6918f7bcf376 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:30:13.752365 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-59908cd3-8d82-484b-ae56-6918f7bcf376 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] [instance: 5d54db85-b991-4890-abaa-952413baa2e7] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:30:13.759000 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-59908cd3-8d82-484b-ae56-6918f7bcf376 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:30:13.759478 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-59908cd3-8d82-484b-ae56-6918f7bcf376 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:30:13.760261 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-59908cd3-8d82-484b-ae56-6918f7bcf376 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:30:13.760923 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-59908cd3-8d82-484b-ae56-6918f7bcf376 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:30:13.793350 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-59908cd3-8d82-484b-ae56-6918f7bcf376 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] 10.222.0.11 "GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046504 Nov 17 03:30:13.793934 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 500/969] 10.222.0.11 () {60 vars in 1342 bytes} [Wed Nov 17 03:30:13 2021] GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 17 03:30:13.859857 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-2b041230-b38b-49e5-b98b-df74a5de6c0b tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80763e09d44c475ea2425b22874e9612', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fef02a1dd77946a2ac0e0414b557435f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:30:13.867927 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-2b041230-b38b-49e5-b98b-df74a5de6c0b tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] 10.222.0.11 "GET /compute/v2.1/servers/5ddbfaaa-fabf-4324-941c-8868625ffefc" status: 200 len: 1579 microversion: 2.1 time: 0.232282 Nov 17 03:30:13.868745 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 470/970] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:30:13 2021] GET /compute/v2.1/servers/5ddbfaaa-fabf-4324-941c-8868625ffefc => generated 1579 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:30:14.099481 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-0b3cda60-19c3-4bec-9c36-cf64c8ea22dd tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:30:14.100319 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-0b3cda60-19c3-4bec-9c36-cf64c8ea22dd tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] [instance: a49437df-3059-4528-8328-2f3471d5fb45] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:30:14.106137 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-0b3cda60-19c3-4bec-9c36-cf64c8ea22dd tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:30:14.106596 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-0b3cda60-19c3-4bec-9c36-cf64c8ea22dd tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:30:14.107378 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-0b3cda60-19c3-4bec-9c36-cf64c8ea22dd tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:30:14.107802 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-0b3cda60-19c3-4bec-9c36-cf64c8ea22dd tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:30:14.137188 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-0b3cda60-19c3-4bec-9c36-cf64c8ea22dd tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] 10.222.0.11 "GET /compute/v2.1/servers/a49437df-3059-4528-8328-2f3471d5fb45/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041452 Nov 17 03:30:14.137751 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 501/971] 10.222.0.11 () {58 vars in 1301 bytes} [Wed Nov 17 03:30:14 2021] GET /compute/v2.1/servers/a49437df-3059-4528-8328-2f3471d5fb45/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 17 03:30:14.809616 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-0086700a-017b-4e46-98f6-c81e1ddd08b9 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:30:14.811092 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-0086700a-017b-4e46-98f6-c81e1ddd08b9 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] [instance: 5d54db85-b991-4890-abaa-952413baa2e7] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:30:14.822811 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-0086700a-017b-4e46-98f6-c81e1ddd08b9 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:30:14.823544 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-0086700a-017b-4e46-98f6-c81e1ddd08b9 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:30:14.825125 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-0086700a-017b-4e46-98f6-c81e1ddd08b9 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:30:14.826056 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-0086700a-017b-4e46-98f6-c81e1ddd08b9 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:30:14.857079 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-0086700a-017b-4e46-98f6-c81e1ddd08b9 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] 10.222.0.11 "GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.054246 Nov 17 03:30:14.857637 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 471/972] 10.222.0.11 () {60 vars in 1342 bytes} [Wed Nov 17 03:30:14 2021] GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 17 03:30:14.891298 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-e001fa92-dd6b-4dcf-ba94-4a1e4194cb7a tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:30:14.891913 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-e001fa92-dd6b-4dcf-ba94-4a1e4194cb7a tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] [instance: 5ddbfaaa-fabf-4324-941c-8868625ffefc] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:30:14.898516 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-e001fa92-dd6b-4dcf-ba94-4a1e4194cb7a tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:30:14.898960 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-e001fa92-dd6b-4dcf-ba94-4a1e4194cb7a tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:30:14.899723 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-e001fa92-dd6b-4dcf-ba94-4a1e4194cb7a tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:30:14.900126 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-e001fa92-dd6b-4dcf-ba94-4a1e4194cb7a tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:30:15.099992 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-e001fa92-dd6b-4dcf-ba94-4a1e4194cb7a tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80763e09d44c475ea2425b22874e9612', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fef02a1dd77946a2ac0e0414b557435f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:30:15.107434 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-e001fa92-dd6b-4dcf-ba94-4a1e4194cb7a tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] 10.222.0.11 "GET /compute/v2.1/servers/5ddbfaaa-fabf-4324-941c-8868625ffefc" status: 200 len: 1579 microversion: 2.1 time: 0.222785 Nov 17 03:30:15.108004 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 502/973] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:30:14 2021] GET /compute/v2.1/servers/5ddbfaaa-fabf-4324-941c-8868625ffefc => generated 1579 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:30:15.148802 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-525a2364-b2f0-4e42-9dd9-ab12e156bfbd tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:30:15.149849 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-525a2364-b2f0-4e42-9dd9-ab12e156bfbd tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] [instance: a49437df-3059-4528-8328-2f3471d5fb45] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:30:15.156000 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-525a2364-b2f0-4e42-9dd9-ab12e156bfbd tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:30:15.156629 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-525a2364-b2f0-4e42-9dd9-ab12e156bfbd tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:30:15.157439 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-525a2364-b2f0-4e42-9dd9-ab12e156bfbd tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:30:15.157871 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-525a2364-b2f0-4e42-9dd9-ab12e156bfbd tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:30:15.188236 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-525a2364-b2f0-4e42-9dd9-ab12e156bfbd tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] 10.222.0.11 "GET /compute/v2.1/servers/a49437df-3059-4528-8328-2f3471d5fb45/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043061 Nov 17 03:30:15.188891 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 472/974] 10.222.0.11 () {58 vars in 1301 bytes} [Wed Nov 17 03:30:15 2021] GET /compute/v2.1/servers/a49437df-3059-4528-8328-2f3471d5fb45/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 17 03:30:15.869086 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-8cfd02b8-a0db-4041-8ba7-db7a00a3c831 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:30:15.870130 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-8cfd02b8-a0db-4041-8ba7-db7a00a3c831 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] [instance: 5d54db85-b991-4890-abaa-952413baa2e7] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:30:15.876817 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-8cfd02b8-a0db-4041-8ba7-db7a00a3c831 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:30:15.877279 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-8cfd02b8-a0db-4041-8ba7-db7a00a3c831 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:30:15.878049 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-8cfd02b8-a0db-4041-8ba7-db7a00a3c831 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:30:15.878477 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-8cfd02b8-a0db-4041-8ba7-db7a00a3c831 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:30:15.908676 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-8cfd02b8-a0db-4041-8ba7-db7a00a3c831 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] 10.222.0.11 "GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043441 Nov 17 03:30:15.912676 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 503/975] 10.222.0.11 () {60 vars in 1342 bytes} [Wed Nov 17 03:30:15 2021] GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 17 03:30:16.127970 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-68a8f8b4-9a64-4126-bb0b-ae34da69f210 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:30:16.127970 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-68a8f8b4-9a64-4126-bb0b-ae34da69f210 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] [instance: 5ddbfaaa-fabf-4324-941c-8868625ffefc] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:30:16.134384 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-68a8f8b4-9a64-4126-bb0b-ae34da69f210 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:30:16.134818 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-68a8f8b4-9a64-4126-bb0b-ae34da69f210 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:30:16.135655 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-68a8f8b4-9a64-4126-bb0b-ae34da69f210 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:30:16.136006 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-68a8f8b4-9a64-4126-bb0b-ae34da69f210 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:30:16.203972 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-5bfe8c0a-8b8c-4034-ba00-dae5aca47de9 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:30:16.205290 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-5bfe8c0a-8b8c-4034-ba00-dae5aca47de9 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] [instance: a49437df-3059-4528-8328-2f3471d5fb45] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:30:16.214586 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-5bfe8c0a-8b8c-4034-ba00-dae5aca47de9 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:30:16.214586 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-5bfe8c0a-8b8c-4034-ba00-dae5aca47de9 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:30:16.214586 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-5bfe8c0a-8b8c-4034-ba00-dae5aca47de9 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:30:16.215498 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-5bfe8c0a-8b8c-4034-ba00-dae5aca47de9 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:30:16.217280 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-68a8f8b4-9a64-4126-bb0b-ae34da69f210 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80763e09d44c475ea2425b22874e9612', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fef02a1dd77946a2ac0e0414b557435f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:30:16.230797 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-68a8f8b4-9a64-4126-bb0b-ae34da69f210 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] 10.222.0.11 "GET /compute/v2.1/servers/5ddbfaaa-fabf-4324-941c-8868625ffefc" status: 200 len: 1512 microversion: 2.1 time: 0.108510 Nov 17 03:30:16.230797 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 473/976] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:30:16 2021] GET /compute/v2.1/servers/5ddbfaaa-fabf-4324-941c-8868625ffefc => generated 1512 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:30:16.262771 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-5bfe8c0a-8b8c-4034-ba00-dae5aca47de9 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] 10.222.0.11 "GET /compute/v2.1/servers/a49437df-3059-4528-8328-2f3471d5fb45/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.066657 Nov 17 03:30:16.263424 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 504/977] 10.222.0.11 () {58 vars in 1301 bytes} [Wed Nov 17 03:30:16 2021] GET /compute/v2.1/servers/a49437df-3059-4528-8328-2f3471d5fb45/os-volume_attachments => generated 197 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 17 03:30:16.554713 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [req-8c3e083f-7ea7-49b4-b406-fe16daac7cc8 req-d8e93b7e-7b30-4c93-bab6-49c165c71f47 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5ddbfaaa-fabf-4324-941c-8868625ffefc", "name": "network-vif-deleted", "tag": "c37d71de-0892-41d0-9d86-8ce8b8ccde7f"}]} {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 17 03:30:16.557412 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 17 03:30:16.557412 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: warnings.warn(msg) Nov 17 03:30:16.568843 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [req-8c3e083f-7ea7-49b4-b406-fe16daac7cc8 req-d8e93b7e-7b30-4c93-bab6-49c165c71f47 service nova] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:30:16.569787 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [req-8c3e083f-7ea7-49b4-b406-fe16daac7cc8 req-d8e93b7e-7b30-4c93-bab6-49c165c71f47 service nova] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:30:16.583109 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.compute.server_external_events [req-8c3e083f-7ea7-49b4-b406-fe16daac7cc8 req-d8e93b7e-7b30-4c93-bab6-49c165c71f47 service nova] Creating event network-vif-deleted:c37d71de-0892-41d0-9d86-8ce8b8ccde7f for instance 5ddbfaaa-fabf-4324-941c-8868625ffefc on hv-cinder-81803 Nov 17 03:30:16.588570 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [req-8c3e083f-7ea7-49b4-b406-fe16daac7cc8 req-d8e93b7e-7b30-4c93-bab6-49c165c71f47 service nova] 10.222.0.11 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037622 Nov 17 03:30:16.593500 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 474/978] 10.222.0.11 () {64 vars in 1317 bytes} [Wed Nov 17 03:30:16 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 17 03:30:16.919846 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-abf8b2e3-c0ae-4360-b41d-39ba9d1a6805 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:30:16.920833 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-abf8b2e3-c0ae-4360-b41d-39ba9d1a6805 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] [instance: 5d54db85-b991-4890-abaa-952413baa2e7] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:30:16.927224 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-abf8b2e3-c0ae-4360-b41d-39ba9d1a6805 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:30:16.927665 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-abf8b2e3-c0ae-4360-b41d-39ba9d1a6805 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:30:16.928434 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-abf8b2e3-c0ae-4360-b41d-39ba9d1a6805 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:30:16.928882 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-abf8b2e3-c0ae-4360-b41d-39ba9d1a6805 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:30:16.958705 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-abf8b2e3-c0ae-4360-b41d-39ba9d1a6805 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] 10.222.0.11 "GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042704 Nov 17 03:30:16.959274 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 505/979] 10.222.0.11 () {60 vars in 1342 bytes} [Wed Nov 17 03:30:16 2021] GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 17 03:30:17.247314 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-585933e0-1d7c-41ec-92de-dab410a5b4e3 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:30:17.248186 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-585933e0-1d7c-41ec-92de-dab410a5b4e3 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] [instance: 5ddbfaaa-fabf-4324-941c-8868625ffefc] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:30:17.255534 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-585933e0-1d7c-41ec-92de-dab410a5b4e3 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:30:17.255978 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-585933e0-1d7c-41ec-92de-dab410a5b4e3 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:30:17.257029 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-585933e0-1d7c-41ec-92de-dab410a5b4e3 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:30:17.257464 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-585933e0-1d7c-41ec-92de-dab410a5b4e3 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:30:17.278648 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-617f07e4-f9f9-4554-ab15-c598fa8f17c7 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:30:17.279775 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-617f07e4-f9f9-4554-ab15-c598fa8f17c7 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] [instance: a49437df-3059-4528-8328-2f3471d5fb45] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:30:17.286608 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-617f07e4-f9f9-4554-ab15-c598fa8f17c7 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:30:17.287318 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-617f07e4-f9f9-4554-ab15-c598fa8f17c7 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:30:17.288100 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-617f07e4-f9f9-4554-ab15-c598fa8f17c7 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:30:17.288531 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-617f07e4-f9f9-4554-ab15-c598fa8f17c7 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:30:17.338147 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-585933e0-1d7c-41ec-92de-dab410a5b4e3 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80763e09d44c475ea2425b22874e9612', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fef02a1dd77946a2ac0e0414b557435f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:30:17.346053 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-585933e0-1d7c-41ec-92de-dab410a5b4e3 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] 10.222.0.11 "GET /compute/v2.1/servers/5ddbfaaa-fabf-4324-941c-8868625ffefc" status: 200 len: 1226 microversion: 2.1 time: 0.102845 Nov 17 03:30:17.346543 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-617f07e4-f9f9-4554-ab15-c598fa8f17c7 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] 10.222.0.11 "GET /compute/v2.1/servers/a49437df-3059-4528-8328-2f3471d5fb45/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.075617 Nov 17 03:30:17.346860 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 475/980] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:30:17 2021] GET /compute/v2.1/servers/5ddbfaaa-fabf-4324-941c-8868625ffefc => generated 1226 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:30:17.347370 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 506/981] 10.222.0.11 () {58 vars in 1301 bytes} [Wed Nov 17 03:30:17 2021] GET /compute/v2.1/servers/a49437df-3059-4528-8328-2f3471d5fb45/os-volume_attachments => generated 197 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 17 03:30:17.970467 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-c6aa2881-0fe3-47d8-bf7e-94e27e08e733 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:30:17.971391 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-c6aa2881-0fe3-47d8-bf7e-94e27e08e733 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] [instance: 5d54db85-b991-4890-abaa-952413baa2e7] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:30:17.977617 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-c6aa2881-0fe3-47d8-bf7e-94e27e08e733 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:30:17.978067 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-c6aa2881-0fe3-47d8-bf7e-94e27e08e733 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:30:17.978848 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-c6aa2881-0fe3-47d8-bf7e-94e27e08e733 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:30:17.979282 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-c6aa2881-0fe3-47d8-bf7e-94e27e08e733 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:30:18.011092 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-c6aa2881-0fe3-47d8-bf7e-94e27e08e733 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] 10.222.0.11 "GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044484 Nov 17 03:30:18.011662 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 476/982] 10.222.0.11 () {60 vars in 1342 bytes} [Wed Nov 17 03:30:17 2021] GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 17 03:30:18.358551 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-9a5f4bd8-ecfe-464b-a408-72a297989b2e tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:30:18.359657 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-9a5f4bd8-ecfe-464b-a408-72a297989b2e tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] [instance: a49437df-3059-4528-8328-2f3471d5fb45] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:30:18.363023 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-54f33a6a-1003-42aa-9517-fdfb8fc7f5db tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:30:18.363467 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-54f33a6a-1003-42aa-9517-fdfb8fc7f5db tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] [instance: 5ddbfaaa-fabf-4324-941c-8868625ffefc] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:30:18.366401 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-9a5f4bd8-ecfe-464b-a408-72a297989b2e tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:30:18.366848 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-9a5f4bd8-ecfe-464b-a408-72a297989b2e tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:30:18.367620 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-9a5f4bd8-ecfe-464b-a408-72a297989b2e tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:30:18.368043 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-9a5f4bd8-ecfe-464b-a408-72a297989b2e tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:30:18.369875 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-54f33a6a-1003-42aa-9517-fdfb8fc7f5db tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:30:18.370319 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-54f33a6a-1003-42aa-9517-fdfb8fc7f5db tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:30:18.371082 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-54f33a6a-1003-42aa-9517-fdfb8fc7f5db tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:30:18.371508 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-54f33a6a-1003-42aa-9517-fdfb8fc7f5db tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:30:18.398660 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-9a5f4bd8-ecfe-464b-a408-72a297989b2e tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] 10.222.0.11 "GET /compute/v2.1/servers/a49437df-3059-4528-8328-2f3471d5fb45/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044135 Nov 17 03:30:18.399201 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 507/983] 10.222.0.11 () {58 vars in 1301 bytes} [Wed Nov 17 03:30:18 2021] GET /compute/v2.1/servers/a49437df-3059-4528-8328-2f3471d5fb45/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 17 03:30:18.431351 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-54f33a6a-1003-42aa-9517-fdfb8fc7f5db tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80763e09d44c475ea2425b22874e9612', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fef02a1dd77946a2ac0e0414b557435f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:30:18.439036 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-54f33a6a-1003-42aa-9517-fdfb8fc7f5db tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] 10.222.0.11 "GET /compute/v2.1/servers/5ddbfaaa-fabf-4324-941c-8868625ffefc" status: 200 len: 1226 microversion: 2.1 time: 0.079876 Nov 17 03:30:18.439577 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 477/984] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:30:18 2021] GET /compute/v2.1/servers/5ddbfaaa-fabf-4324-941c-8868625ffefc => generated 1226 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:30:19.026892 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-e63124c1-0149-4bd0-a28f-f2cce593ac6c tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:30:19.028372 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-e63124c1-0149-4bd0-a28f-f2cce593ac6c tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] [instance: 5d54db85-b991-4890-abaa-952413baa2e7] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:30:19.036073 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-e63124c1-0149-4bd0-a28f-f2cce593ac6c tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:30:19.036520 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-e63124c1-0149-4bd0-a28f-f2cce593ac6c tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:30:19.037349 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-e63124c1-0149-4bd0-a28f-f2cce593ac6c tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:30:19.037776 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-e63124c1-0149-4bd0-a28f-f2cce593ac6c tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:30:19.070649 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-e63124c1-0149-4bd0-a28f-f2cce593ac6c tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] 10.222.0.11 "GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.050272 Nov 17 03:30:19.071217 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 508/985] 10.222.0.11 () {60 vars in 1342 bytes} [Wed Nov 17 03:30:19 2021] GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 17 03:30:19.410421 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-d8aa0c6c-acf2-477b-85a4-b592a42ceaa0 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:30:19.411360 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-d8aa0c6c-acf2-477b-85a4-b592a42ceaa0 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] [instance: a49437df-3059-4528-8328-2f3471d5fb45] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:30:19.418011 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-d8aa0c6c-acf2-477b-85a4-b592a42ceaa0 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:30:19.418451 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-d8aa0c6c-acf2-477b-85a4-b592a42ceaa0 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:30:19.419184 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-d8aa0c6c-acf2-477b-85a4-b592a42ceaa0 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:30:19.419639 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-d8aa0c6c-acf2-477b-85a4-b592a42ceaa0 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:30:19.452872 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-d8aa0c6c-acf2-477b-85a4-b592a42ceaa0 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] 10.222.0.11 "GET /compute/v2.1/servers/a49437df-3059-4528-8328-2f3471d5fb45/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046188 Nov 17 03:30:19.453460 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 478/986] 10.222.0.11 () {58 vars in 1301 bytes} [Wed Nov 17 03:30:19 2021] GET /compute/v2.1/servers/a49437df-3059-4528-8328-2f3471d5fb45/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 17 03:30:19.456331 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-75308570-f02d-4214-a1dd-3e0b697ca973 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:30:19.456973 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-75308570-f02d-4214-a1dd-3e0b697ca973 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] [instance: 5ddbfaaa-fabf-4324-941c-8868625ffefc] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:30:19.463383 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-75308570-f02d-4214-a1dd-3e0b697ca973 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:30:19.463832 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-75308570-f02d-4214-a1dd-3e0b697ca973 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:30:19.464640 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-75308570-f02d-4214-a1dd-3e0b697ca973 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:30:19.465189 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-75308570-f02d-4214-a1dd-3e0b697ca973 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:30:19.526851 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-75308570-f02d-4214-a1dd-3e0b697ca973 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80763e09d44c475ea2425b22874e9612', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fef02a1dd77946a2ac0e0414b557435f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:30:19.534678 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-75308570-f02d-4214-a1dd-3e0b697ca973 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] 10.222.0.11 "GET /compute/v2.1/servers/5ddbfaaa-fabf-4324-941c-8868625ffefc" status: 200 len: 1226 microversion: 2.1 time: 0.082943 Nov 17 03:30:19.535247 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 509/987] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:30:19 2021] GET /compute/v2.1/servers/5ddbfaaa-fabf-4324-941c-8868625ffefc => generated 1226 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:30:20.082761 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-1ee804e4-6496-42a8-81a8-d0dacf489c84 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:30:20.083683 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-1ee804e4-6496-42a8-81a8-d0dacf489c84 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] [instance: 5d54db85-b991-4890-abaa-952413baa2e7] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:30:20.090134 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-1ee804e4-6496-42a8-81a8-d0dacf489c84 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:30:20.090583 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-1ee804e4-6496-42a8-81a8-d0dacf489c84 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:30:20.091361 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-1ee804e4-6496-42a8-81a8-d0dacf489c84 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:30:20.091800 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-1ee804e4-6496-42a8-81a8-d0dacf489c84 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:30:20.121528 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-1ee804e4-6496-42a8-81a8-d0dacf489c84 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] 10.222.0.11 "GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042695 Nov 17 03:30:20.122076 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 479/988] 10.222.0.11 () {60 vars in 1342 bytes} [Wed Nov 17 03:30:20 2021] GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 17 03:30:20.463999 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-d277927b-754b-4f7e-86bf-666c1c5f95fe tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:30:20.464834 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-d277927b-754b-4f7e-86bf-666c1c5f95fe tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] [instance: a49437df-3059-4528-8328-2f3471d5fb45] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:30:20.471978 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-d277927b-754b-4f7e-86bf-666c1c5f95fe tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:30:20.472429 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-d277927b-754b-4f7e-86bf-666c1c5f95fe tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:30:20.473237 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-d277927b-754b-4f7e-86bf-666c1c5f95fe tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:30:20.473670 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-d277927b-754b-4f7e-86bf-666c1c5f95fe tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:30:20.504138 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-d277927b-754b-4f7e-86bf-666c1c5f95fe tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] 10.222.0.11 "GET /compute/v2.1/servers/a49437df-3059-4528-8328-2f3471d5fb45/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044106 Nov 17 03:30:20.504678 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 510/989] 10.222.0.11 () {58 vars in 1301 bytes} [Wed Nov 17 03:30:20 2021] GET /compute/v2.1/servers/a49437df-3059-4528-8328-2f3471d5fb45/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 17 03:30:20.551405 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-123c3638-9ec4-4f02-a2c3-00f4bc7688d9 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:30:20.551991 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-123c3638-9ec4-4f02-a2c3-00f4bc7688d9 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] [instance: 5ddbfaaa-fabf-4324-941c-8868625ffefc] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:30:20.559135 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-123c3638-9ec4-4f02-a2c3-00f4bc7688d9 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:30:20.559556 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-123c3638-9ec4-4f02-a2c3-00f4bc7688d9 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:30:20.560351 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-123c3638-9ec4-4f02-a2c3-00f4bc7688d9 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:30:20.560803 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-123c3638-9ec4-4f02-a2c3-00f4bc7688d9 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:30:20.620706 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-123c3638-9ec4-4f02-a2c3-00f4bc7688d9 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80763e09d44c475ea2425b22874e9612', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fef02a1dd77946a2ac0e0414b557435f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:30:20.629196 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-123c3638-9ec4-4f02-a2c3-00f4bc7688d9 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] 10.222.0.11 "GET /compute/v2.1/servers/5ddbfaaa-fabf-4324-941c-8868625ffefc" status: 200 len: 1226 microversion: 2.1 time: 0.081395 Nov 17 03:30:20.629935 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 480/990] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:30:20 2021] GET /compute/v2.1/servers/5ddbfaaa-fabf-4324-941c-8868625ffefc => generated 1226 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:30:21.132904 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-423a5bb0-0bd9-41c7-b050-d2f3a615f87e tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:30:21.133928 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-423a5bb0-0bd9-41c7-b050-d2f3a615f87e tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] [instance: 5d54db85-b991-4890-abaa-952413baa2e7] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:30:21.141125 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-423a5bb0-0bd9-41c7-b050-d2f3a615f87e tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:30:21.141573 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-423a5bb0-0bd9-41c7-b050-d2f3a615f87e tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:30:21.142349 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-423a5bb0-0bd9-41c7-b050-d2f3a615f87e tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:30:21.142778 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-423a5bb0-0bd9-41c7-b050-d2f3a615f87e tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:30:21.171011 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-423a5bb0-0bd9-41c7-b050-d2f3a615f87e tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] 10.222.0.11 "GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042014 Nov 17 03:30:21.172021 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 511/991] 10.222.0.11 () {60 vars in 1342 bytes} [Wed Nov 17 03:30:21 2021] GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 17 03:30:21.518143 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-3f4d3bca-23d1-4a68-8772-0c90f4e64ee5 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:30:21.519136 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-3f4d3bca-23d1-4a68-8772-0c90f4e64ee5 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] [instance: a49437df-3059-4528-8328-2f3471d5fb45] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:30:21.525394 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-3f4d3bca-23d1-4a68-8772-0c90f4e64ee5 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:30:21.525838 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-3f4d3bca-23d1-4a68-8772-0c90f4e64ee5 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:30:21.526630 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-3f4d3bca-23d1-4a68-8772-0c90f4e64ee5 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:30:21.527038 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-3f4d3bca-23d1-4a68-8772-0c90f4e64ee5 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:30:21.567394 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-3f4d3bca-23d1-4a68-8772-0c90f4e64ee5 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] 10.222.0.11 "GET /compute/v2.1/servers/a49437df-3059-4528-8328-2f3471d5fb45/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053881 Nov 17 03:30:21.571735 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 481/992] 10.222.0.11 () {58 vars in 1301 bytes} [Wed Nov 17 03:30:21 2021] GET /compute/v2.1/servers/a49437df-3059-4528-8328-2f3471d5fb45/os-volume_attachments => generated 197 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 17 03:30:21.645968 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-12ff550e-2a0d-4229-9833-da8ac469c46d tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:30:21.647284 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-12ff550e-2a0d-4229-9833-da8ac469c46d tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] [instance: 5ddbfaaa-fabf-4324-941c-8868625ffefc] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:30:21.654234 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-12ff550e-2a0d-4229-9833-da8ac469c46d tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:30:21.654806 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-12ff550e-2a0d-4229-9833-da8ac469c46d tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:30:21.655629 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-12ff550e-2a0d-4229-9833-da8ac469c46d tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:30:21.656068 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-12ff550e-2a0d-4229-9833-da8ac469c46d tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:30:21.721200 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-12ff550e-2a0d-4229-9833-da8ac469c46d tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80763e09d44c475ea2425b22874e9612', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fef02a1dd77946a2ac0e0414b557435f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:30:21.728601 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-12ff550e-2a0d-4229-9833-da8ac469c46d tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] 10.222.0.11 "GET /compute/v2.1/servers/5ddbfaaa-fabf-4324-941c-8868625ffefc" status: 200 len: 1226 microversion: 2.1 time: 0.086354 Nov 17 03:30:21.729423 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 512/993] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:30:21 2021] GET /compute/v2.1/servers/5ddbfaaa-fabf-4324-941c-8868625ffefc => generated 1226 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:30:22.183985 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-a9093f8a-007a-41c1-8863-9127acee72df tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:30:22.185054 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-a9093f8a-007a-41c1-8863-9127acee72df tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] [instance: 5d54db85-b991-4890-abaa-952413baa2e7] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:30:22.191381 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-a9093f8a-007a-41c1-8863-9127acee72df tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:30:22.191904 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-a9093f8a-007a-41c1-8863-9127acee72df tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:30:22.192763 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-a9093f8a-007a-41c1-8863-9127acee72df tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:30:22.193230 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-a9093f8a-007a-41c1-8863-9127acee72df tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:30:22.222643 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-a9093f8a-007a-41c1-8863-9127acee72df tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] 10.222.0.11 "GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043123 Nov 17 03:30:22.223202 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 482/994] 10.222.0.11 () {60 vars in 1342 bytes} [Wed Nov 17 03:30:22 2021] GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 17 03:30:22.583688 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-0162b6f4-9dc7-4448-891f-248ba2065a36 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:30:22.585208 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-0162b6f4-9dc7-4448-891f-248ba2065a36 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] [instance: a49437df-3059-4528-8328-2f3471d5fb45] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:30:22.594809 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-0162b6f4-9dc7-4448-891f-248ba2065a36 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:30:22.595254 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-0162b6f4-9dc7-4448-891f-248ba2065a36 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:30:22.596060 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-0162b6f4-9dc7-4448-891f-248ba2065a36 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:30:22.596486 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-0162b6f4-9dc7-4448-891f-248ba2065a36 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:30:22.625665 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-0162b6f4-9dc7-4448-891f-248ba2065a36 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] 10.222.0.11 "GET /compute/v2.1/servers/a49437df-3059-4528-8328-2f3471d5fb45/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048643 Nov 17 03:30:22.626226 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 513/995] 10.222.0.11 () {58 vars in 1301 bytes} [Wed Nov 17 03:30:22 2021] GET /compute/v2.1/servers/a49437df-3059-4528-8328-2f3471d5fb45/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 17 03:30:22.746404 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-0d5b8a52-e511-47ef-8f96-ff64efab4e0e tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:30:22.747046 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-0d5b8a52-e511-47ef-8f96-ff64efab4e0e tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] [instance: 5ddbfaaa-fabf-4324-941c-8868625ffefc] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:30:22.754164 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-0d5b8a52-e511-47ef-8f96-ff64efab4e0e tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:30:22.754616 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-0d5b8a52-e511-47ef-8f96-ff64efab4e0e tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:30:22.755386 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-0d5b8a52-e511-47ef-8f96-ff64efab4e0e tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:30:22.755819 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-0d5b8a52-e511-47ef-8f96-ff64efab4e0e tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:30:22.821321 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-0d5b8a52-e511-47ef-8f96-ff64efab4e0e tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80763e09d44c475ea2425b22874e9612', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fef02a1dd77946a2ac0e0414b557435f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:30:22.829709 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-0d5b8a52-e511-47ef-8f96-ff64efab4e0e tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] 10.222.0.11 "GET /compute/v2.1/servers/5ddbfaaa-fabf-4324-941c-8868625ffefc" status: 200 len: 1226 microversion: 2.1 time: 0.087482 Nov 17 03:30:22.830313 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 483/996] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:30:22 2021] GET /compute/v2.1/servers/5ddbfaaa-fabf-4324-941c-8868625ffefc => generated 1226 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:30:23.238739 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-c4024584-d500-4662-ada4-a82875d558f5 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:30:23.240228 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-c4024584-d500-4662-ada4-a82875d558f5 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] [instance: 5d54db85-b991-4890-abaa-952413baa2e7] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:30:23.251100 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-c4024584-d500-4662-ada4-a82875d558f5 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:30:23.251856 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-c4024584-d500-4662-ada4-a82875d558f5 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:30:23.253197 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-c4024584-d500-4662-ada4-a82875d558f5 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:30:23.253929 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-c4024584-d500-4662-ada4-a82875d558f5 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:30:23.288274 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-c4024584-d500-4662-ada4-a82875d558f5 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] 10.222.0.11 "GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.056211 Nov 17 03:30:23.288861 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 514/997] 10.222.0.11 () {60 vars in 1342 bytes} [Wed Nov 17 03:30:23 2021] GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7/os-volume_attachments => generated 197 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 17 03:30:23.641220 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-e917fb78-725c-441f-a515-77bee749e253 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:30:23.643028 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-e917fb78-725c-441f-a515-77bee749e253 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] [instance: a49437df-3059-4528-8328-2f3471d5fb45] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:30:23.649815 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-e917fb78-725c-441f-a515-77bee749e253 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:30:23.650345 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-e917fb78-725c-441f-a515-77bee749e253 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:30:23.651041 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-e917fb78-725c-441f-a515-77bee749e253 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:30:23.651649 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-e917fb78-725c-441f-a515-77bee749e253 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:30:23.684272 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-e917fb78-725c-441f-a515-77bee749e253 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] 10.222.0.11 "GET /compute/v2.1/servers/a49437df-3059-4528-8328-2f3471d5fb45/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050036 Nov 17 03:30:23.684885 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 484/998] 10.222.0.11 () {58 vars in 1301 bytes} [Wed Nov 17 03:30:23 2021] GET /compute/v2.1/servers/a49437df-3059-4528-8328-2f3471d5fb45/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 17 03:30:23.849195 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-4865163f-75c8-4829-b0b0-8070bd396de1 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:30:23.849829 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-4865163f-75c8-4829-b0b0-8070bd396de1 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] [instance: 5ddbfaaa-fabf-4324-941c-8868625ffefc] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:30:23.858233 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-4865163f-75c8-4829-b0b0-8070bd396de1 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:30:23.858788 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-4865163f-75c8-4829-b0b0-8070bd396de1 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:30:23.859574 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-4865163f-75c8-4829-b0b0-8070bd396de1 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:30:23.860262 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-4865163f-75c8-4829-b0b0-8070bd396de1 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:30:23.928867 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-4865163f-75c8-4829-b0b0-8070bd396de1 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80763e09d44c475ea2425b22874e9612', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fef02a1dd77946a2ac0e0414b557435f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:30:23.937912 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-4865163f-75c8-4829-b0b0-8070bd396de1 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] 10.222.0.11 "GET /compute/v2.1/servers/5ddbfaaa-fabf-4324-941c-8868625ffefc" status: 200 len: 1226 microversion: 2.1 time: 0.094513 Nov 17 03:30:23.938363 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 515/999] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:30:23 2021] GET /compute/v2.1/servers/5ddbfaaa-fabf-4324-941c-8868625ffefc => generated 1226 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:30:24.301496 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-1159b67d-dff4-4814-9437-123da4f7bea5 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:30:24.302562 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-1159b67d-dff4-4814-9437-123da4f7bea5 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] [instance: 5d54db85-b991-4890-abaa-952413baa2e7] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:30:24.309582 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-1159b67d-dff4-4814-9437-123da4f7bea5 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:30:24.310053 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-1159b67d-dff4-4814-9437-123da4f7bea5 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:30:24.310823 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-1159b67d-dff4-4814-9437-123da4f7bea5 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:30:24.311246 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-1159b67d-dff4-4814-9437-123da4f7bea5 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:30:24.347170 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-1159b67d-dff4-4814-9437-123da4f7bea5 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] 10.222.0.11 "GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.049589 Nov 17 03:30:24.347741 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 485/1000] 10.222.0.11 () {60 vars in 1342 bytes} [Wed Nov 17 03:30:24 2021] GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 17 03:30:24.696896 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-965d41d1-da6c-48bd-83f9-d13d537387d7 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:30:24.697720 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-965d41d1-da6c-48bd-83f9-d13d537387d7 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] [instance: a49437df-3059-4528-8328-2f3471d5fb45] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:30:24.704720 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-965d41d1-da6c-48bd-83f9-d13d537387d7 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:30:24.705197 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-965d41d1-da6c-48bd-83f9-d13d537387d7 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:30:24.705975 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-965d41d1-da6c-48bd-83f9-d13d537387d7 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:30:24.706405 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-965d41d1-da6c-48bd-83f9-d13d537387d7 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:30:24.736372 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-965d41d1-da6c-48bd-83f9-d13d537387d7 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] 10.222.0.11 "GET /compute/v2.1/servers/a49437df-3059-4528-8328-2f3471d5fb45/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043425 Nov 17 03:30:24.736998 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 516/1001] 10.222.0.11 () {58 vars in 1301 bytes} [Wed Nov 17 03:30:24 2021] GET /compute/v2.1/servers/a49437df-3059-4528-8328-2f3471d5fb45/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 17 03:30:24.959431 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-44e76e34-b63c-43e8-b4fe-1e0890d2ca53 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:30:24.960290 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-44e76e34-b63c-43e8-b4fe-1e0890d2ca53 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] [instance: 5ddbfaaa-fabf-4324-941c-8868625ffefc] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:30:24.969880 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-44e76e34-b63c-43e8-b4fe-1e0890d2ca53 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:30:24.970330 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-44e76e34-b63c-43e8-b4fe-1e0890d2ca53 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:30:24.971098 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-44e76e34-b63c-43e8-b4fe-1e0890d2ca53 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:30:24.971535 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-44e76e34-b63c-43e8-b4fe-1e0890d2ca53 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:30:25.030216 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-44e76e34-b63c-43e8-b4fe-1e0890d2ca53 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80763e09d44c475ea2425b22874e9612', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fef02a1dd77946a2ac0e0414b557435f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:30:25.038055 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-44e76e34-b63c-43e8-b4fe-1e0890d2ca53 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] 10.222.0.11 "GET /compute/v2.1/servers/5ddbfaaa-fabf-4324-941c-8868625ffefc" status: 200 len: 1226 microversion: 2.1 time: 0.085994 Nov 17 03:30:25.038619 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 486/1002] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:30:24 2021] GET /compute/v2.1/servers/5ddbfaaa-fabf-4324-941c-8868625ffefc => generated 1226 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:30:25.359352 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-b3a7a5f6-ccf8-4acc-8be2-f12f5f7deff1 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:30:25.360264 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-b3a7a5f6-ccf8-4acc-8be2-f12f5f7deff1 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] [instance: 5d54db85-b991-4890-abaa-952413baa2e7] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:30:25.366808 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-b3a7a5f6-ccf8-4acc-8be2-f12f5f7deff1 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:30:25.367254 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-b3a7a5f6-ccf8-4acc-8be2-f12f5f7deff1 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:30:25.368013 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-b3a7a5f6-ccf8-4acc-8be2-f12f5f7deff1 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:30:25.368441 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-b3a7a5f6-ccf8-4acc-8be2-f12f5f7deff1 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:30:25.397419 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-b3a7a5f6-ccf8-4acc-8be2-f12f5f7deff1 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] 10.222.0.11 "GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042081 Nov 17 03:30:25.397966 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 517/1003] 10.222.0.11 () {60 vars in 1342 bytes} [Wed Nov 17 03:30:25 2021] GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 17 03:30:25.752091 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-788e53b7-a890-415c-8fca-4587788b22c3 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:30:25.752993 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-788e53b7-a890-415c-8fca-4587788b22c3 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] [instance: a49437df-3059-4528-8328-2f3471d5fb45] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:30:25.759527 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-788e53b7-a890-415c-8fca-4587788b22c3 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:30:25.759973 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-788e53b7-a890-415c-8fca-4587788b22c3 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:30:25.760754 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-788e53b7-a890-415c-8fca-4587788b22c3 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:30:25.761257 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-788e53b7-a890-415c-8fca-4587788b22c3 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:30:25.792487 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-788e53b7-a890-415c-8fca-4587788b22c3 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] 10.222.0.11 "GET /compute/v2.1/servers/a49437df-3059-4528-8328-2f3471d5fb45/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045960 Nov 17 03:30:25.793078 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 487/1004] 10.222.0.11 () {58 vars in 1301 bytes} [Wed Nov 17 03:30:25 2021] GET /compute/v2.1/servers/a49437df-3059-4528-8328-2f3471d5fb45/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 17 03:30:26.060088 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-6c05adb8-8b4c-4608-8a0f-2eca3d039ae5 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:30:26.061046 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-6c05adb8-8b4c-4608-8a0f-2eca3d039ae5 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] [instance: 5ddbfaaa-fabf-4324-941c-8868625ffefc] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:30:26.072357 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-6c05adb8-8b4c-4608-8a0f-2eca3d039ae5 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:30:26.073191 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-6c05adb8-8b4c-4608-8a0f-2eca3d039ae5 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:30:26.074468 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-6c05adb8-8b4c-4608-8a0f-2eca3d039ae5 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:30:26.075176 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-6c05adb8-8b4c-4608-8a0f-2eca3d039ae5 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:30:26.134872 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-6c05adb8-8b4c-4608-8a0f-2eca3d039ae5 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80763e09d44c475ea2425b22874e9612', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fef02a1dd77946a2ac0e0414b557435f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:30:26.142497 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-6c05adb8-8b4c-4608-8a0f-2eca3d039ae5 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] 10.222.0.11 "GET /compute/v2.1/servers/5ddbfaaa-fabf-4324-941c-8868625ffefc" status: 200 len: 1226 microversion: 2.1 time: 0.089709 Nov 17 03:30:26.143115 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 518/1005] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:30:26 2021] GET /compute/v2.1/servers/5ddbfaaa-fabf-4324-941c-8868625ffefc => generated 1226 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:30:26.411113 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-c35968f3-f4f4-4b77-8584-7edaffc49601 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:30:26.411969 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-c35968f3-f4f4-4b77-8584-7edaffc49601 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] [instance: 5d54db85-b991-4890-abaa-952413baa2e7] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:30:26.418979 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-c35968f3-f4f4-4b77-8584-7edaffc49601 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:30:26.419448 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-c35968f3-f4f4-4b77-8584-7edaffc49601 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:30:26.420256 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-c35968f3-f4f4-4b77-8584-7edaffc49601 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:30:26.420708 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-c35968f3-f4f4-4b77-8584-7edaffc49601 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:30:26.451547 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-c35968f3-f4f4-4b77-8584-7edaffc49601 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] 10.222.0.11 "GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044537 Nov 17 03:30:26.452105 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 488/1006] 10.222.0.11 () {60 vars in 1342 bytes} [Wed Nov 17 03:30:26 2021] GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 17 03:30:26.809873 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-6ede78d0-8153-4f14-9496-387adce03fcf tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:30:26.811358 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-6ede78d0-8153-4f14-9496-387adce03fcf tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] [instance: a49437df-3059-4528-8328-2f3471d5fb45] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:30:26.821625 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-6ede78d0-8153-4f14-9496-387adce03fcf tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:30:26.822459 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-6ede78d0-8153-4f14-9496-387adce03fcf tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:30:26.823845 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-6ede78d0-8153-4f14-9496-387adce03fcf tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:30:26.824558 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-6ede78d0-8153-4f14-9496-387adce03fcf tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:30:26.855853 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-6ede78d0-8153-4f14-9496-387adce03fcf tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] 10.222.0.11 "GET /compute/v2.1/servers/a49437df-3059-4528-8328-2f3471d5fb45/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052660 Nov 17 03:30:26.856391 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 519/1007] 10.222.0.11 () {58 vars in 1301 bytes} [Wed Nov 17 03:30:26 2021] GET /compute/v2.1/servers/a49437df-3059-4528-8328-2f3471d5fb45/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 17 03:30:27.161564 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-2ddef488-9e32-4962-8f6d-a22c823101da tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:30:27.162151 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-2ddef488-9e32-4962-8f6d-a22c823101da tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] [instance: 5ddbfaaa-fabf-4324-941c-8868625ffefc] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:30:27.168797 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-2ddef488-9e32-4962-8f6d-a22c823101da tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:30:27.169244 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-2ddef488-9e32-4962-8f6d-a22c823101da tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:30:27.170054 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-2ddef488-9e32-4962-8f6d-a22c823101da tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:30:27.171025 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-2ddef488-9e32-4962-8f6d-a22c823101da tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:30:27.240307 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-2ddef488-9e32-4962-8f6d-a22c823101da tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80763e09d44c475ea2425b22874e9612', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fef02a1dd77946a2ac0e0414b557435f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:30:27.247985 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-2ddef488-9e32-4962-8f6d-a22c823101da tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] 10.222.0.11 "GET /compute/v2.1/servers/5ddbfaaa-fabf-4324-941c-8868625ffefc" status: 200 len: 1226 microversion: 2.1 time: 0.090128 Nov 17 03:30:27.248526 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 489/1008] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:30:27 2021] GET /compute/v2.1/servers/5ddbfaaa-fabf-4324-941c-8868625ffefc => generated 1226 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:30:27.468473 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-8b0eae13-d64c-4746-9b66-7c46e5f4a458 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:30:27.469899 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-8b0eae13-d64c-4746-9b66-7c46e5f4a458 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] [instance: 5d54db85-b991-4890-abaa-952413baa2e7] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:30:27.480632 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-8b0eae13-d64c-4746-9b66-7c46e5f4a458 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:30:27.481430 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-8b0eae13-d64c-4746-9b66-7c46e5f4a458 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:30:27.482777 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-8b0eae13-d64c-4746-9b66-7c46e5f4a458 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:30:27.483676 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-8b0eae13-d64c-4746-9b66-7c46e5f4a458 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:30:27.514152 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-8b0eae13-d64c-4746-9b66-7c46e5f4a458 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] 10.222.0.11 "GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.052424 Nov 17 03:30:27.514799 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 520/1009] 10.222.0.11 () {60 vars in 1342 bytes} [Wed Nov 17 03:30:27 2021] GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 17 03:30:27.867846 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-d09a8414-6f25-4752-9dd8-a53e2beecb12 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:30:27.868811 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-d09a8414-6f25-4752-9dd8-a53e2beecb12 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] [instance: a49437df-3059-4528-8328-2f3471d5fb45] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:30:27.875713 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-d09a8414-6f25-4752-9dd8-a53e2beecb12 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:30:27.876159 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-d09a8414-6f25-4752-9dd8-a53e2beecb12 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:30:27.876973 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-d09a8414-6f25-4752-9dd8-a53e2beecb12 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:30:27.877405 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-d09a8414-6f25-4752-9dd8-a53e2beecb12 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:30:27.907152 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-d09a8414-6f25-4752-9dd8-a53e2beecb12 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] 10.222.0.11 "GET /compute/v2.1/servers/a49437df-3059-4528-8328-2f3471d5fb45/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043126 Nov 17 03:30:27.907692 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 490/1010] 10.222.0.11 () {58 vars in 1301 bytes} [Wed Nov 17 03:30:27 2021] GET /compute/v2.1/servers/a49437df-3059-4528-8328-2f3471d5fb45/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 17 03:30:28.267734 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-408c9362-47a5-41fc-9f34-cdae45f02b1b tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:30:28.268339 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-408c9362-47a5-41fc-9f34-cdae45f02b1b tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] [instance: 5ddbfaaa-fabf-4324-941c-8868625ffefc] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:30:28.274861 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-408c9362-47a5-41fc-9f34-cdae45f02b1b tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:30:28.275312 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-408c9362-47a5-41fc-9f34-cdae45f02b1b tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:30:28.276088 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-408c9362-47a5-41fc-9f34-cdae45f02b1b tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:30:28.276535 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-408c9362-47a5-41fc-9f34-cdae45f02b1b tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:30:28.336423 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-408c9362-47a5-41fc-9f34-cdae45f02b1b tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80763e09d44c475ea2425b22874e9612', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fef02a1dd77946a2ac0e0414b557435f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:30:28.344405 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-408c9362-47a5-41fc-9f34-cdae45f02b1b tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] 10.222.0.11 "GET /compute/v2.1/servers/5ddbfaaa-fabf-4324-941c-8868625ffefc" status: 200 len: 1226 microversion: 2.1 time: 0.081836 Nov 17 03:30:28.345066 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 521/1011] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:30:28 2021] GET /compute/v2.1/servers/5ddbfaaa-fabf-4324-941c-8868625ffefc => generated 1226 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:30:28.531688 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-34e3fc5a-a37b-4fcf-98d4-a94649b72f72 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:30:28.532526 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-34e3fc5a-a37b-4fcf-98d4-a94649b72f72 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] [instance: 5d54db85-b991-4890-abaa-952413baa2e7] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:30:28.539022 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-34e3fc5a-a37b-4fcf-98d4-a94649b72f72 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:30:28.539479 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-34e3fc5a-a37b-4fcf-98d4-a94649b72f72 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:30:28.540383 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-34e3fc5a-a37b-4fcf-98d4-a94649b72f72 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:30:28.540822 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-34e3fc5a-a37b-4fcf-98d4-a94649b72f72 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:30:28.571234 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-34e3fc5a-a37b-4fcf-98d4-a94649b72f72 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] 10.222.0.11 "GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046374 Nov 17 03:30:28.571781 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 491/1012] 10.222.0.11 () {60 vars in 1342 bytes} [Wed Nov 17 03:30:28 2021] GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 17 03:30:28.922367 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-82387913-ec9b-4911-9f73-8917bf32145f tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:30:28.923204 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-82387913-ec9b-4911-9f73-8917bf32145f tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] [instance: a49437df-3059-4528-8328-2f3471d5fb45] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:30:28.930066 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-82387913-ec9b-4911-9f73-8917bf32145f tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:30:28.930519 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-82387913-ec9b-4911-9f73-8917bf32145f tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:30:28.931659 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-82387913-ec9b-4911-9f73-8917bf32145f tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:30:28.932095 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-82387913-ec9b-4911-9f73-8917bf32145f tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:30:28.961958 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-82387913-ec9b-4911-9f73-8917bf32145f tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] 10.222.0.11 "GET /compute/v2.1/servers/a49437df-3059-4528-8328-2f3471d5fb45/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046066 Nov 17 03:30:28.962507 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 522/1013] 10.222.0.11 () {58 vars in 1301 bytes} [Wed Nov 17 03:30:28 2021] GET /compute/v2.1/servers/a49437df-3059-4528-8328-2f3471d5fb45/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 17 03:30:29.361440 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-86640a3c-b472-40ce-ac68-262fbe6b113e tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:30:29.362049 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-86640a3c-b472-40ce-ac68-262fbe6b113e tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] [instance: 5ddbfaaa-fabf-4324-941c-8868625ffefc] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:30:29.369070 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-86640a3c-b472-40ce-ac68-262fbe6b113e tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:30:29.369494 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-86640a3c-b472-40ce-ac68-262fbe6b113e tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:30:29.370256 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-86640a3c-b472-40ce-ac68-262fbe6b113e tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:30:29.370682 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-86640a3c-b472-40ce-ac68-262fbe6b113e tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:30:29.428455 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-86640a3c-b472-40ce-ac68-262fbe6b113e tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80763e09d44c475ea2425b22874e9612', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fef02a1dd77946a2ac0e0414b557435f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:30:29.436294 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-86640a3c-b472-40ce-ac68-262fbe6b113e tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] 10.222.0.11 "GET /compute/v2.1/servers/5ddbfaaa-fabf-4324-941c-8868625ffefc" status: 200 len: 1226 microversion: 2.1 time: 0.078609 Nov 17 03:30:29.436862 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 492/1014] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:30:29 2021] GET /compute/v2.1/servers/5ddbfaaa-fabf-4324-941c-8868625ffefc => generated 1226 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:30:29.586379 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-65fbfd4b-ecb6-41f2-b013-79d8002ac98e tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:30:29.587665 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-65fbfd4b-ecb6-41f2-b013-79d8002ac98e tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] [instance: 5d54db85-b991-4890-abaa-952413baa2e7] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:30:29.596014 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-65fbfd4b-ecb6-41f2-b013-79d8002ac98e tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:30:29.596459 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-65fbfd4b-ecb6-41f2-b013-79d8002ac98e tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:30:29.597278 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-65fbfd4b-ecb6-41f2-b013-79d8002ac98e tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:30:29.597704 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-65fbfd4b-ecb6-41f2-b013-79d8002ac98e tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:30:29.627294 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-65fbfd4b-ecb6-41f2-b013-79d8002ac98e tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] 10.222.0.11 "GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046776 Nov 17 03:30:29.627791 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 523/1015] 10.222.0.11 () {60 vars in 1342 bytes} [Wed Nov 17 03:30:29 2021] GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 17 03:30:29.978032 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-4442634b-b657-4ac0-a689-d0a5c76f9096 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:30:29.979407 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-4442634b-b657-4ac0-a689-d0a5c76f9096 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] [instance: a49437df-3059-4528-8328-2f3471d5fb45] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:30:29.987632 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-4442634b-b657-4ac0-a689-d0a5c76f9096 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:30:29.988075 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-4442634b-b657-4ac0-a689-d0a5c76f9096 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:30:29.988871 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-4442634b-b657-4ac0-a689-d0a5c76f9096 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:30:29.989297 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-4442634b-b657-4ac0-a689-d0a5c76f9096 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:30:30.022913 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-4442634b-b657-4ac0-a689-d0a5c76f9096 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] 10.222.0.11 "GET /compute/v2.1/servers/a49437df-3059-4528-8328-2f3471d5fb45/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051447 Nov 17 03:30:30.023462 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 493/1016] 10.222.0.11 () {58 vars in 1301 bytes} [Wed Nov 17 03:30:29 2021] GET /compute/v2.1/servers/a49437df-3059-4528-8328-2f3471d5fb45/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 17 03:30:30.454030 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-68561096-35b0-41d0-b6ec-9272b7ecc7d9 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:30:30.454627 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-68561096-35b0-41d0-b6ec-9272b7ecc7d9 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] [instance: 5ddbfaaa-fabf-4324-941c-8868625ffefc] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:30:30.461255 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-68561096-35b0-41d0-b6ec-9272b7ecc7d9 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:30:30.461709 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-68561096-35b0-41d0-b6ec-9272b7ecc7d9 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:30:30.462478 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-68561096-35b0-41d0-b6ec-9272b7ecc7d9 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:30:30.462911 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-68561096-35b0-41d0-b6ec-9272b7ecc7d9 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:30:30.531456 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-68561096-35b0-41d0-b6ec-9272b7ecc7d9 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80763e09d44c475ea2425b22874e9612', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fef02a1dd77946a2ac0e0414b557435f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:30:30.539050 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-68561096-35b0-41d0-b6ec-9272b7ecc7d9 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] 10.222.0.11 "GET /compute/v2.1/servers/5ddbfaaa-fabf-4324-941c-8868625ffefc" status: 200 len: 1226 microversion: 2.1 time: 0.088792 Nov 17 03:30:30.539609 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 524/1017] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:30:30 2021] GET /compute/v2.1/servers/5ddbfaaa-fabf-4324-941c-8868625ffefc => generated 1226 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:30:30.640229 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-fd2d5542-a99d-406b-8555-5957b48d025d tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:30:30.641244 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-fd2d5542-a99d-406b-8555-5957b48d025d tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] [instance: 5d54db85-b991-4890-abaa-952413baa2e7] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:30:30.648130 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-fd2d5542-a99d-406b-8555-5957b48d025d tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:30:30.648584 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-fd2d5542-a99d-406b-8555-5957b48d025d tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:30:30.649381 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-fd2d5542-a99d-406b-8555-5957b48d025d tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:30:30.649811 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-fd2d5542-a99d-406b-8555-5957b48d025d tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:30:30.679271 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-fd2d5542-a99d-406b-8555-5957b48d025d tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] 10.222.0.11 "GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042868 Nov 17 03:30:30.679830 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 494/1018] 10.222.0.11 () {60 vars in 1342 bytes} [Wed Nov 17 03:30:30 2021] GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 17 03:30:31.037658 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-eac6ae8b-6b45-4f47-9d18-a72c8b6ab2e3 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:30:31.039012 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-eac6ae8b-6b45-4f47-9d18-a72c8b6ab2e3 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] [instance: a49437df-3059-4528-8328-2f3471d5fb45] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:30:31.049307 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-eac6ae8b-6b45-4f47-9d18-a72c8b6ab2e3 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:30:31.050000 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-eac6ae8b-6b45-4f47-9d18-a72c8b6ab2e3 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:30:31.051133 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-eac6ae8b-6b45-4f47-9d18-a72c8b6ab2e3 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:30:31.051832 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-eac6ae8b-6b45-4f47-9d18-a72c8b6ab2e3 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:30:31.086421 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-eac6ae8b-6b45-4f47-9d18-a72c8b6ab2e3 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] 10.222.0.11 "GET /compute/v2.1/servers/a49437df-3059-4528-8328-2f3471d5fb45/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.055091 Nov 17 03:30:31.086994 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 525/1019] 10.222.0.11 () {58 vars in 1301 bytes} [Wed Nov 17 03:30:31 2021] GET /compute/v2.1/servers/a49437df-3059-4528-8328-2f3471d5fb45/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 17 03:30:31.555474 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-415031c0-f2e1-4ae8-8c3d-a7b60415d8b7 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:30:31.556436 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-415031c0-f2e1-4ae8-8c3d-a7b60415d8b7 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] [instance: 5ddbfaaa-fabf-4324-941c-8868625ffefc] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:30:31.563045 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-415031c0-f2e1-4ae8-8c3d-a7b60415d8b7 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:30:31.563500 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-415031c0-f2e1-4ae8-8c3d-a7b60415d8b7 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:30:31.564322 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-415031c0-f2e1-4ae8-8c3d-a7b60415d8b7 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:30:31.564753 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-415031c0-f2e1-4ae8-8c3d-a7b60415d8b7 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:30:31.634443 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-415031c0-f2e1-4ae8-8c3d-a7b60415d8b7 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80763e09d44c475ea2425b22874e9612', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fef02a1dd77946a2ac0e0414b557435f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:30:31.642554 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-415031c0-f2e1-4ae8-8c3d-a7b60415d8b7 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] 10.222.0.11 "GET /compute/v2.1/servers/5ddbfaaa-fabf-4324-941c-8868625ffefc" status: 200 len: 1226 microversion: 2.1 time: 0.090831 Nov 17 03:30:31.643121 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 495/1020] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:30:31 2021] GET /compute/v2.1/servers/5ddbfaaa-fabf-4324-941c-8868625ffefc => generated 1226 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:30:31.691293 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-8122c1d7-4ce0-4ba5-a562-aa66d10ed377 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:30:31.692194 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-8122c1d7-4ce0-4ba5-a562-aa66d10ed377 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] [instance: 5d54db85-b991-4890-abaa-952413baa2e7] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:30:31.698815 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-8122c1d7-4ce0-4ba5-a562-aa66d10ed377 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:30:31.699281 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-8122c1d7-4ce0-4ba5-a562-aa66d10ed377 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:30:31.700011 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-8122c1d7-4ce0-4ba5-a562-aa66d10ed377 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:30:31.700438 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-8122c1d7-4ce0-4ba5-a562-aa66d10ed377 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:30:31.729598 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-8122c1d7-4ce0-4ba5-a562-aa66d10ed377 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] 10.222.0.11 "GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042530 Nov 17 03:30:31.730140 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 526/1021] 10.222.0.11 () {60 vars in 1342 bytes} [Wed Nov 17 03:30:31 2021] GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 17 03:30:32.098262 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-e4537e76-3c4d-4084-b32f-bc542880a07b tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:30:32.099189 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-e4537e76-3c4d-4084-b32f-bc542880a07b tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] [instance: a49437df-3059-4528-8328-2f3471d5fb45] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:30:32.106033 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-e4537e76-3c4d-4084-b32f-bc542880a07b tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:30:32.106479 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-e4537e76-3c4d-4084-b32f-bc542880a07b tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:30:32.107256 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-e4537e76-3c4d-4084-b32f-bc542880a07b tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:30:32.107691 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-e4537e76-3c4d-4084-b32f-bc542880a07b tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:30:32.137802 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-e4537e76-3c4d-4084-b32f-bc542880a07b tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] 10.222.0.11 "GET /compute/v2.1/servers/a49437df-3059-4528-8328-2f3471d5fb45/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043357 Nov 17 03:30:32.138358 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 496/1022] 10.222.0.11 () {58 vars in 1301 bytes} [Wed Nov 17 03:30:32 2021] GET /compute/v2.1/servers/a49437df-3059-4528-8328-2f3471d5fb45/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 17 03:30:32.663040 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-e3c77fa1-c36b-4180-af2a-777709ebb46c tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:30:32.664048 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-e3c77fa1-c36b-4180-af2a-777709ebb46c tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] [instance: 5ddbfaaa-fabf-4324-941c-8868625ffefc] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:30:32.673469 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-e3c77fa1-c36b-4180-af2a-777709ebb46c tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:30:32.673923 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-e3c77fa1-c36b-4180-af2a-777709ebb46c tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:30:32.674698 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-e3c77fa1-c36b-4180-af2a-777709ebb46c tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:30:32.675134 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-e3c77fa1-c36b-4180-af2a-777709ebb46c tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:30:32.739077 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-e3c77fa1-c36b-4180-af2a-777709ebb46c tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80763e09d44c475ea2425b22874e9612', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fef02a1dd77946a2ac0e0414b557435f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:30:32.741488 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-afddd7cb-48ce-4667-87c5-29a18f045950 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:30:32.742392 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-afddd7cb-48ce-4667-87c5-29a18f045950 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] [instance: 5d54db85-b991-4890-abaa-952413baa2e7] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:30:32.747212 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-e3c77fa1-c36b-4180-af2a-777709ebb46c tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] 10.222.0.11 "GET /compute/v2.1/servers/5ddbfaaa-fabf-4324-941c-8868625ffefc" status: 200 len: 1226 microversion: 2.1 time: 0.090379 Nov 17 03:30:32.747986 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 527/1023] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:30:32 2021] GET /compute/v2.1/servers/5ddbfaaa-fabf-4324-941c-8868625ffefc => generated 1226 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:30:32.749344 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-afddd7cb-48ce-4667-87c5-29a18f045950 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:30:32.749844 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-afddd7cb-48ce-4667-87c5-29a18f045950 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:30:32.750626 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-afddd7cb-48ce-4667-87c5-29a18f045950 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:30:32.751052 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-afddd7cb-48ce-4667-87c5-29a18f045950 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:30:32.781159 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-afddd7cb-48ce-4667-87c5-29a18f045950 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] 10.222.0.11 "GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043391 Nov 17 03:30:32.781708 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 497/1024] 10.222.0.11 () {60 vars in 1342 bytes} [Wed Nov 17 03:30:32 2021] GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 17 03:30:33.155320 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-b6b787a6-e12c-4726-9887-13a908acd3bb tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:30:33.156651 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-b6b787a6-e12c-4726-9887-13a908acd3bb tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] [instance: a49437df-3059-4528-8328-2f3471d5fb45] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:30:33.163342 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-b6b787a6-e12c-4726-9887-13a908acd3bb tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:30:33.163788 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-b6b787a6-e12c-4726-9887-13a908acd3bb tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:30:33.164566 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-b6b787a6-e12c-4726-9887-13a908acd3bb tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:30:33.165028 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-b6b787a6-e12c-4726-9887-13a908acd3bb tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:30:33.195735 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-b6b787a6-e12c-4726-9887-13a908acd3bb tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] 10.222.0.11 "GET /compute/v2.1/servers/a49437df-3059-4528-8328-2f3471d5fb45/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046823 Nov 17 03:30:33.196291 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 528/1025] 10.222.0.11 () {58 vars in 1301 bytes} [Wed Nov 17 03:30:33 2021] GET /compute/v2.1/servers/a49437df-3059-4528-8328-2f3471d5fb45/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 17 03:30:33.767268 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-31515402-b034-41c8-a4b8-d3da19151dc4 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:30:33.767963 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-31515402-b034-41c8-a4b8-d3da19151dc4 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] [instance: 5ddbfaaa-fabf-4324-941c-8868625ffefc] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:30:33.775623 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-31515402-b034-41c8-a4b8-d3da19151dc4 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:30:33.776145 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-31515402-b034-41c8-a4b8-d3da19151dc4 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:30:33.777087 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-31515402-b034-41c8-a4b8-d3da19151dc4 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:30:33.777606 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-31515402-b034-41c8-a4b8-d3da19151dc4 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:30:33.796602 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-f5888f03-31a2-44d3-a1f9-74fff4059ff8 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:30:33.797743 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-f5888f03-31a2-44d3-a1f9-74fff4059ff8 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] [instance: 5d54db85-b991-4890-abaa-952413baa2e7] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:30:33.803914 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-f5888f03-31a2-44d3-a1f9-74fff4059ff8 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:30:33.804476 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-f5888f03-31a2-44d3-a1f9-74fff4059ff8 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:30:33.805353 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-f5888f03-31a2-44d3-a1f9-74fff4059ff8 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:30:33.806212 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-f5888f03-31a2-44d3-a1f9-74fff4059ff8 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:30:33.839510 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-f5888f03-31a2-44d3-a1f9-74fff4059ff8 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] 10.222.0.11 "GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.050355 Nov 17 03:30:33.839905 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-31515402-b034-41c8-a4b8-d3da19151dc4 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80763e09d44c475ea2425b22874e9612', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fef02a1dd77946a2ac0e0414b557435f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:30:33.840380 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 529/1026] 10.222.0.11 () {60 vars in 1342 bytes} [Wed Nov 17 03:30:33 2021] GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 17 03:30:33.847502 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-31515402-b034-41c8-a4b8-d3da19151dc4 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] 10.222.0.11 "GET /compute/v2.1/servers/5ddbfaaa-fabf-4324-941c-8868625ffefc" status: 200 len: 1226 microversion: 2.1 time: 0.085967 Nov 17 03:30:33.848057 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 498/1027] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:30:33 2021] GET /compute/v2.1/servers/5ddbfaaa-fabf-4324-941c-8868625ffefc => generated 1226 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:30:34.211790 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-a1cf0096-c5c3-422d-b857-63435aafa462 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:30:34.213231 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-a1cf0096-c5c3-422d-b857-63435aafa462 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] [instance: a49437df-3059-4528-8328-2f3471d5fb45] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:30:34.223933 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-a1cf0096-c5c3-422d-b857-63435aafa462 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:30:34.224677 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-a1cf0096-c5c3-422d-b857-63435aafa462 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:30:34.226020 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-a1cf0096-c5c3-422d-b857-63435aafa462 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:30:34.226742 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-a1cf0096-c5c3-422d-b857-63435aafa462 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:30:34.262259 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-a1cf0096-c5c3-422d-b857-63435aafa462 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] 10.222.0.11 "GET /compute/v2.1/servers/a49437df-3059-4528-8328-2f3471d5fb45/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.056953 Nov 17 03:30:34.262827 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 530/1028] 10.222.0.11 () {58 vars in 1301 bytes} [Wed Nov 17 03:30:34 2021] GET /compute/v2.1/servers/a49437df-3059-4528-8328-2f3471d5fb45/os-volume_attachments => generated 197 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 17 03:30:34.851558 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-ab23de72-6e9c-467c-897c-51d7b7c5f071 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:30:34.852473 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-ab23de72-6e9c-467c-897c-51d7b7c5f071 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] [instance: 5d54db85-b991-4890-abaa-952413baa2e7] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:30:34.859427 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-ab23de72-6e9c-467c-897c-51d7b7c5f071 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:30:34.859887 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-ab23de72-6e9c-467c-897c-51d7b7c5f071 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:30:34.860664 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-ab23de72-6e9c-467c-897c-51d7b7c5f071 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:30:34.861204 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-ab23de72-6e9c-467c-897c-51d7b7c5f071 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:30:34.863262 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-c0ef1283-531d-4bfe-83a5-f183d5061ec8 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:30:34.864070 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-c0ef1283-531d-4bfe-83a5-f183d5061ec8 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] [instance: 5ddbfaaa-fabf-4324-941c-8868625ffefc] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:30:34.870583 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-c0ef1283-531d-4bfe-83a5-f183d5061ec8 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:30:34.871026 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-c0ef1283-531d-4bfe-83a5-f183d5061ec8 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:30:34.871787 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-c0ef1283-531d-4bfe-83a5-f183d5061ec8 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:30:34.872214 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-c0ef1283-531d-4bfe-83a5-f183d5061ec8 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:30:34.893151 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-ab23de72-6e9c-467c-897c-51d7b7c5f071 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] 10.222.0.11 "GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045375 Nov 17 03:30:34.893731 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 499/1029] 10.222.0.11 () {60 vars in 1342 bytes} [Wed Nov 17 03:30:34 2021] GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 17 03:30:34.942699 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-c0ef1283-531d-4bfe-83a5-f183d5061ec8 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80763e09d44c475ea2425b22874e9612', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fef02a1dd77946a2ac0e0414b557435f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:30:34.950399 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-c0ef1283-531d-4bfe-83a5-f183d5061ec8 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] 10.222.0.11 "GET /compute/v2.1/servers/5ddbfaaa-fabf-4324-941c-8868625ffefc" status: 200 len: 1226 microversion: 2.1 time: 0.090811 Nov 17 03:30:34.950955 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 531/1030] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:30:34 2021] GET /compute/v2.1/servers/5ddbfaaa-fabf-4324-941c-8868625ffefc => generated 1226 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 17 03:30:35.278108 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-ead6d6ed-c200-4e22-a492-c8072d89d7df tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:30:35.279695 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-ead6d6ed-c200-4e22-a492-c8072d89d7df tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] [instance: a49437df-3059-4528-8328-2f3471d5fb45] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:30:35.287006 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-ead6d6ed-c200-4e22-a492-c8072d89d7df tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:30:35.287449 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-ead6d6ed-c200-4e22-a492-c8072d89d7df tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:30:35.288215 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-ead6d6ed-c200-4e22-a492-c8072d89d7df tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:30:35.288641 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-ead6d6ed-c200-4e22-a492-c8072d89d7df tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:30:35.318297 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-ead6d6ed-c200-4e22-a492-c8072d89d7df tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] 10.222.0.11 "GET /compute/v2.1/servers/a49437df-3059-4528-8328-2f3471d5fb45/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046516 Nov 17 03:30:35.318844 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 500/1031] 10.222.0.11 () {58 vars in 1301 bytes} [Wed Nov 17 03:30:35 2021] GET /compute/v2.1/servers/a49437df-3059-4528-8328-2f3471d5fb45/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 17 03:30:35.904894 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-92f40b29-a873-4403-99cb-d7738704dbe2 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:30:35.905757 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-92f40b29-a873-4403-99cb-d7738704dbe2 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] [instance: 5d54db85-b991-4890-abaa-952413baa2e7] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:30:35.911948 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-92f40b29-a873-4403-99cb-d7738704dbe2 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:30:35.912383 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-92f40b29-a873-4403-99cb-d7738704dbe2 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:30:35.913184 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-92f40b29-a873-4403-99cb-d7738704dbe2 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:30:35.913616 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-92f40b29-a873-4403-99cb-d7738704dbe2 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:30:35.945053 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-92f40b29-a873-4403-99cb-d7738704dbe2 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] 10.222.0.11 "GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043917 Nov 17 03:30:35.945610 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 532/1032] 10.222.0.11 () {60 vars in 1342 bytes} [Wed Nov 17 03:30:35 2021] GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 17 03:30:35.973695 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-438b9ea5-b707-471e-a5f1-cc6816f9c14e tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:30:35.974299 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-438b9ea5-b707-471e-a5f1-cc6816f9c14e tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] [instance: 5ddbfaaa-fabf-4324-941c-8868625ffefc] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:30:35.981635 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-438b9ea5-b707-471e-a5f1-cc6816f9c14e tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:30:35.982681 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-438b9ea5-b707-471e-a5f1-cc6816f9c14e tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:30:35.983868 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-438b9ea5-b707-471e-a5f1-cc6816f9c14e tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:30:35.984908 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-438b9ea5-b707-471e-a5f1-cc6816f9c14e tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:30:36.046767 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-438b9ea5-b707-471e-a5f1-cc6816f9c14e tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80763e09d44c475ea2425b22874e9612', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fef02a1dd77946a2ac0e0414b557435f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:30:36.054577 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-438b9ea5-b707-471e-a5f1-cc6816f9c14e tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] 10.222.0.11 "GET /compute/v2.1/servers/5ddbfaaa-fabf-4324-941c-8868625ffefc" status: 200 len: 1226 microversion: 2.1 time: 0.084669 Nov 17 03:30:36.055567 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 501/1033] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:30:35 2021] GET /compute/v2.1/servers/5ddbfaaa-fabf-4324-941c-8868625ffefc => generated 1226 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:30:36.331920 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-1fa9f5bf-3e66-4dba-8e87-f4cece0bc5d8 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:30:36.332871 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-1fa9f5bf-3e66-4dba-8e87-f4cece0bc5d8 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] [instance: a49437df-3059-4528-8328-2f3471d5fb45] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:30:36.339313 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-1fa9f5bf-3e66-4dba-8e87-f4cece0bc5d8 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:30:36.339753 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-1fa9f5bf-3e66-4dba-8e87-f4cece0bc5d8 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:30:36.340531 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-1fa9f5bf-3e66-4dba-8e87-f4cece0bc5d8 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:30:36.341013 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-1fa9f5bf-3e66-4dba-8e87-f4cece0bc5d8 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:30:36.370912 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-1fa9f5bf-3e66-4dba-8e87-f4cece0bc5d8 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] 10.222.0.11 "GET /compute/v2.1/servers/a49437df-3059-4528-8328-2f3471d5fb45/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043191 Nov 17 03:30:36.371749 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 533/1034] 10.222.0.11 () {58 vars in 1301 bytes} [Wed Nov 17 03:30:36 2021] GET /compute/v2.1/servers/a49437df-3059-4528-8328-2f3471d5fb45/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 17 03:30:36.956915 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-511b5502-d12e-4519-a6d2-2eacf5380326 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:30:36.957828 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-511b5502-d12e-4519-a6d2-2eacf5380326 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] [instance: 5d54db85-b991-4890-abaa-952413baa2e7] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:30:36.968147 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-511b5502-d12e-4519-a6d2-2eacf5380326 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:30:36.968593 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-511b5502-d12e-4519-a6d2-2eacf5380326 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:30:36.969408 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-511b5502-d12e-4519-a6d2-2eacf5380326 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:30:36.969857 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-511b5502-d12e-4519-a6d2-2eacf5380326 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:30:37.001606 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-511b5502-d12e-4519-a6d2-2eacf5380326 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] 10.222.0.11 "GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.048534 Nov 17 03:30:37.002478 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 502/1035] 10.222.0.11 () {60 vars in 1342 bytes} [Wed Nov 17 03:30:36 2021] GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 17 03:30:37.071803 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-8a55bcf6-7711-4f0d-80fc-921bd42a07b1 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:30:37.072394 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-8a55bcf6-7711-4f0d-80fc-921bd42a07b1 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] [instance: 5ddbfaaa-fabf-4324-941c-8868625ffefc] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:30:37.079015 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-8a55bcf6-7711-4f0d-80fc-921bd42a07b1 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:30:37.079446 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-8a55bcf6-7711-4f0d-80fc-921bd42a07b1 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:30:37.080250 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-8a55bcf6-7711-4f0d-80fc-921bd42a07b1 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:30:37.080679 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-8a55bcf6-7711-4f0d-80fc-921bd42a07b1 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:30:37.140616 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-8a55bcf6-7711-4f0d-80fc-921bd42a07b1 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80763e09d44c475ea2425b22874e9612', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fef02a1dd77946a2ac0e0414b557435f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:30:37.148233 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-8a55bcf6-7711-4f0d-80fc-921bd42a07b1 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] 10.222.0.11 "GET /compute/v2.1/servers/5ddbfaaa-fabf-4324-941c-8868625ffefc" status: 200 len: 1226 microversion: 2.1 time: 0.080291 Nov 17 03:30:37.148864 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 534/1036] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:30:37 2021] GET /compute/v2.1/servers/5ddbfaaa-fabf-4324-941c-8868625ffefc => generated 1226 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:30:37.383521 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-2ac2358e-7084-4fc9-8fca-32112a9d76bc tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:30:37.384448 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-2ac2358e-7084-4fc9-8fca-32112a9d76bc tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] [instance: a49437df-3059-4528-8328-2f3471d5fb45] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:30:37.390977 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-2ac2358e-7084-4fc9-8fca-32112a9d76bc tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:30:37.391423 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-2ac2358e-7084-4fc9-8fca-32112a9d76bc tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:30:37.392207 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-2ac2358e-7084-4fc9-8fca-32112a9d76bc tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:30:37.392643 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-2ac2358e-7084-4fc9-8fca-32112a9d76bc tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:30:37.422240 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-2ac2358e-7084-4fc9-8fca-32112a9d76bc tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] 10.222.0.11 "GET /compute/v2.1/servers/a49437df-3059-4528-8328-2f3471d5fb45/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042850 Nov 17 03:30:37.422825 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 503/1037] 10.222.0.11 () {58 vars in 1301 bytes} [Wed Nov 17 03:30:37 2021] GET /compute/v2.1/servers/a49437df-3059-4528-8328-2f3471d5fb45/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 17 03:30:38.014791 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-0b406161-062d-45be-9e05-42ba31f72b31 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:30:38.015736 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-0b406161-062d-45be-9e05-42ba31f72b31 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] [instance: 5d54db85-b991-4890-abaa-952413baa2e7] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:30:38.022398 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-0b406161-062d-45be-9e05-42ba31f72b31 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:30:38.022922 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-0b406161-062d-45be-9e05-42ba31f72b31 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:30:38.023842 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-0b406161-062d-45be-9e05-42ba31f72b31 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:30:38.028296 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-0b406161-062d-45be-9e05-42ba31f72b31 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:30:38.064329 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-0b406161-062d-45be-9e05-42ba31f72b31 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] 10.222.0.11 "GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.053355 Nov 17 03:30:38.065482 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 535/1038] 10.222.0.11 () {60 vars in 1342 bytes} [Wed Nov 17 03:30:38 2021] GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 17 03:30:38.165169 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-548220ef-35f7-4391-a8a5-a17c08109b5c tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:30:38.165946 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-548220ef-35f7-4391-a8a5-a17c08109b5c tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] [instance: 5ddbfaaa-fabf-4324-941c-8868625ffefc] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:30:38.172485 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-548220ef-35f7-4391-a8a5-a17c08109b5c tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:30:38.173036 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-548220ef-35f7-4391-a8a5-a17c08109b5c tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:30:38.173819 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-548220ef-35f7-4391-a8a5-a17c08109b5c tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:30:38.174364 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-548220ef-35f7-4391-a8a5-a17c08109b5c tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:30:38.235646 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-548220ef-35f7-4391-a8a5-a17c08109b5c tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80763e09d44c475ea2425b22874e9612', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fef02a1dd77946a2ac0e0414b557435f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:30:38.243638 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-548220ef-35f7-4391-a8a5-a17c08109b5c tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] 10.222.0.11 "GET /compute/v2.1/servers/5ddbfaaa-fabf-4324-941c-8868625ffefc" status: 200 len: 1226 microversion: 2.1 time: 0.082211 Nov 17 03:30:38.244321 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 504/1039] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:30:38 2021] GET /compute/v2.1/servers/5ddbfaaa-fabf-4324-941c-8868625ffefc => generated 1226 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:30:38.434707 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-9fefbbd6-7bcc-4243-bada-fa067e7f16b1 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:30:38.435545 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-9fefbbd6-7bcc-4243-bada-fa067e7f16b1 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] [instance: a49437df-3059-4528-8328-2f3471d5fb45] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:30:38.442408 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-9fefbbd6-7bcc-4243-bada-fa067e7f16b1 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:30:38.442859 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-9fefbbd6-7bcc-4243-bada-fa067e7f16b1 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:30:38.443670 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-9fefbbd6-7bcc-4243-bada-fa067e7f16b1 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:30:38.444122 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-9fefbbd6-7bcc-4243-bada-fa067e7f16b1 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:30:38.474575 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-9fefbbd6-7bcc-4243-bada-fa067e7f16b1 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] 10.222.0.11 "GET /compute/v2.1/servers/a49437df-3059-4528-8328-2f3471d5fb45/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044067 Nov 17 03:30:38.475139 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 536/1040] 10.222.0.11 () {58 vars in 1301 bytes} [Wed Nov 17 03:30:38 2021] GET /compute/v2.1/servers/a49437df-3059-4528-8328-2f3471d5fb45/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 17 03:30:39.076289 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-1e5bab3c-31f9-415e-a3aa-df2b0363d704 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:30:39.077255 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-1e5bab3c-31f9-415e-a3aa-df2b0363d704 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] [instance: 5d54db85-b991-4890-abaa-952413baa2e7] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:30:39.084241 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-1e5bab3c-31f9-415e-a3aa-df2b0363d704 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:30:39.084692 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-1e5bab3c-31f9-415e-a3aa-df2b0363d704 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:30:39.085525 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-1e5bab3c-31f9-415e-a3aa-df2b0363d704 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:30:39.085962 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-1e5bab3c-31f9-415e-a3aa-df2b0363d704 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:30:39.116689 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-1e5bab3c-31f9-415e-a3aa-df2b0363d704 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] 10.222.0.11 "GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044699 Nov 17 03:30:39.117297 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 505/1041] 10.222.0.11 () {60 vars in 1342 bytes} [Wed Nov 17 03:30:39 2021] GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 17 03:30:39.261935 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-e2b58c75-f928-45b0-be84-5d467c10ff67 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:30:39.262471 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-e2b58c75-f928-45b0-be84-5d467c10ff67 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] [instance: 5ddbfaaa-fabf-4324-941c-8868625ffefc] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:30:39.269318 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-e2b58c75-f928-45b0-be84-5d467c10ff67 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:30:39.269811 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-e2b58c75-f928-45b0-be84-5d467c10ff67 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:30:39.270596 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-e2b58c75-f928-45b0-be84-5d467c10ff67 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:30:39.271129 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-e2b58c75-f928-45b0-be84-5d467c10ff67 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:30:39.337936 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-e2b58c75-f928-45b0-be84-5d467c10ff67 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80763e09d44c475ea2425b22874e9612', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fef02a1dd77946a2ac0e0414b557435f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:30:39.347543 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-e2b58c75-f928-45b0-be84-5d467c10ff67 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] 10.222.0.11 "GET /compute/v2.1/servers/5ddbfaaa-fabf-4324-941c-8868625ffefc" status: 200 len: 1226 microversion: 2.1 time: 0.089442 Nov 17 03:30:39.348268 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 537/1042] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:30:39 2021] GET /compute/v2.1/servers/5ddbfaaa-fabf-4324-941c-8868625ffefc => generated 1226 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:30:39.486589 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-2b2cb74f-c469-4237-89ce-e9c2a31df062 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:30:39.487621 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-2b2cb74f-c469-4237-89ce-e9c2a31df062 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] [instance: a49437df-3059-4528-8328-2f3471d5fb45] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:30:39.494309 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-2b2cb74f-c469-4237-89ce-e9c2a31df062 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:30:39.494750 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-2b2cb74f-c469-4237-89ce-e9c2a31df062 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:30:39.495520 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-2b2cb74f-c469-4237-89ce-e9c2a31df062 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:30:39.495971 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-2b2cb74f-c469-4237-89ce-e9c2a31df062 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:30:39.526220 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-2b2cb74f-c469-4237-89ce-e9c2a31df062 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] 10.222.0.11 "GET /compute/v2.1/servers/a49437df-3059-4528-8328-2f3471d5fb45/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043474 Nov 17 03:30:39.527006 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 506/1043] 10.222.0.11 () {58 vars in 1301 bytes} [Wed Nov 17 03:30:39 2021] GET /compute/v2.1/servers/a49437df-3059-4528-8328-2f3471d5fb45/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 17 03:30:40.128148 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-8e8c921d-c2c7-44b7-a834-b9ff120bb77c tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:30:40.129063 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-8e8c921d-c2c7-44b7-a834-b9ff120bb77c tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] [instance: 5d54db85-b991-4890-abaa-952413baa2e7] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:30:40.136049 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-8e8c921d-c2c7-44b7-a834-b9ff120bb77c tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:30:40.136506 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-8e8c921d-c2c7-44b7-a834-b9ff120bb77c tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:30:40.137374 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-8e8c921d-c2c7-44b7-a834-b9ff120bb77c tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:30:40.137807 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-8e8c921d-c2c7-44b7-a834-b9ff120bb77c tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:30:40.168940 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-8e8c921d-c2c7-44b7-a834-b9ff120bb77c tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] 10.222.0.11 "GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044636 Nov 17 03:30:40.169636 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 538/1044] 10.222.0.11 () {60 vars in 1342 bytes} [Wed Nov 17 03:30:40 2021] GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 17 03:30:40.365200 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-138b696d-3c4f-4cb6-b810-39e4d60e1a34 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:30:40.365695 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-138b696d-3c4f-4cb6-b810-39e4d60e1a34 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] [instance: 5ddbfaaa-fabf-4324-941c-8868625ffefc] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:30:40.372258 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-138b696d-3c4f-4cb6-b810-39e4d60e1a34 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:30:40.372799 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-138b696d-3c4f-4cb6-b810-39e4d60e1a34 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:30:40.373612 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-138b696d-3c4f-4cb6-b810-39e4d60e1a34 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:30:40.374040 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-138b696d-3c4f-4cb6-b810-39e4d60e1a34 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:30:40.442212 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-138b696d-3c4f-4cb6-b810-39e4d60e1a34 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80763e09d44c475ea2425b22874e9612', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fef02a1dd77946a2ac0e0414b557435f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:30:40.450247 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-138b696d-3c4f-4cb6-b810-39e4d60e1a34 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] 10.222.0.11 "GET /compute/v2.1/servers/5ddbfaaa-fabf-4324-941c-8868625ffefc" status: 200 len: 1226 microversion: 2.1 time: 0.089109 Nov 17 03:30:40.450890 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 507/1045] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:30:40 2021] GET /compute/v2.1/servers/5ddbfaaa-fabf-4324-941c-8868625ffefc => generated 1226 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:30:40.538141 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-e814f66e-4259-41f0-87b7-13226d940b75 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:30:40.539053 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-e814f66e-4259-41f0-87b7-13226d940b75 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] [instance: a49437df-3059-4528-8328-2f3471d5fb45] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:30:40.545218 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-e814f66e-4259-41f0-87b7-13226d940b75 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:30:40.545668 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-e814f66e-4259-41f0-87b7-13226d940b75 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:30:40.546441 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-e814f66e-4259-41f0-87b7-13226d940b75 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:30:40.546877 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-e814f66e-4259-41f0-87b7-13226d940b75 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:30:40.577363 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-e814f66e-4259-41f0-87b7-13226d940b75 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] 10.222.0.11 "GET /compute/v2.1/servers/a49437df-3059-4528-8328-2f3471d5fb45/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043130 Nov 17 03:30:40.577959 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 539/1046] 10.222.0.11 () {58 vars in 1301 bytes} [Wed Nov 17 03:30:40 2021] GET /compute/v2.1/servers/a49437df-3059-4528-8328-2f3471d5fb45/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 17 03:30:41.182243 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-93b97c92-c4a3-450d-9771-61ad558c8e1a tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:30:41.183148 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-93b97c92-c4a3-450d-9771-61ad558c8e1a tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] [instance: 5d54db85-b991-4890-abaa-952413baa2e7] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:30:41.189988 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-93b97c92-c4a3-450d-9771-61ad558c8e1a tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:30:41.190458 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-93b97c92-c4a3-450d-9771-61ad558c8e1a tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:30:41.191233 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-93b97c92-c4a3-450d-9771-61ad558c8e1a tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:30:41.191642 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-93b97c92-c4a3-450d-9771-61ad558c8e1a tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:30:41.223425 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-93b97c92-c4a3-450d-9771-61ad558c8e1a tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] 10.222.0.11 "GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045296 Nov 17 03:30:41.224101 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 508/1047] 10.222.0.11 () {60 vars in 1342 bytes} [Wed Nov 17 03:30:41 2021] GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 17 03:30:41.467665 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-afb5ee38-1a17-42f4-8b17-04db68323fc1 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:30:41.468253 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-afb5ee38-1a17-42f4-8b17-04db68323fc1 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] [instance: 5ddbfaaa-fabf-4324-941c-8868625ffefc] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:30:41.474997 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-afb5ee38-1a17-42f4-8b17-04db68323fc1 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:30:41.475450 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-afb5ee38-1a17-42f4-8b17-04db68323fc1 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:30:41.476246 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-afb5ee38-1a17-42f4-8b17-04db68323fc1 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:30:41.476682 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-afb5ee38-1a17-42f4-8b17-04db68323fc1 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:30:41.538761 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-afb5ee38-1a17-42f4-8b17-04db68323fc1 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80763e09d44c475ea2425b22874e9612', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fef02a1dd77946a2ac0e0414b557435f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:30:41.547012 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-afb5ee38-1a17-42f4-8b17-04db68323fc1 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] 10.222.0.11 "GET /compute/v2.1/servers/5ddbfaaa-fabf-4324-941c-8868625ffefc" status: 200 len: 1226 microversion: 2.1 time: 0.083089 Nov 17 03:30:41.547663 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 540/1048] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:30:41 2021] GET /compute/v2.1/servers/5ddbfaaa-fabf-4324-941c-8868625ffefc => generated 1226 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:30:41.588090 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-5c15a3a3-f154-45fc-9b6c-8382b73d9bbc tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:30:41.589059 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-5c15a3a3-f154-45fc-9b6c-8382b73d9bbc tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] [instance: a49437df-3059-4528-8328-2f3471d5fb45] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:30:41.595229 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-5c15a3a3-f154-45fc-9b6c-8382b73d9bbc tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:30:41.595667 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-5c15a3a3-f154-45fc-9b6c-8382b73d9bbc tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:30:41.596448 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-5c15a3a3-f154-45fc-9b6c-8382b73d9bbc tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:30:41.596927 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-5c15a3a3-f154-45fc-9b6c-8382b73d9bbc tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:30:41.629698 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-5c15a3a3-f154-45fc-9b6c-8382b73d9bbc tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] 10.222.0.11 "GET /compute/v2.1/servers/a49437df-3059-4528-8328-2f3471d5fb45/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044994 Nov 17 03:30:41.630252 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 509/1049] 10.222.0.11 () {58 vars in 1301 bytes} [Wed Nov 17 03:30:41 2021] GET /compute/v2.1/servers/a49437df-3059-4528-8328-2f3471d5fb45/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 17 03:30:42.235323 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-b6905b36-0bb3-4134-9322-3d30f2ee7e89 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:30:42.236238 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-b6905b36-0bb3-4134-9322-3d30f2ee7e89 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] [instance: 5d54db85-b991-4890-abaa-952413baa2e7] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:30:42.242817 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-b6905b36-0bb3-4134-9322-3d30f2ee7e89 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:30:42.243293 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-b6905b36-0bb3-4134-9322-3d30f2ee7e89 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:30:42.244063 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-b6905b36-0bb3-4134-9322-3d30f2ee7e89 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:30:42.244529 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-b6905b36-0bb3-4134-9322-3d30f2ee7e89 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:30:42.275887 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-b6905b36-0bb3-4134-9322-3d30f2ee7e89 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] 10.222.0.11 "GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044328 Nov 17 03:30:42.276674 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 541/1050] 10.222.0.11 () {60 vars in 1342 bytes} [Wed Nov 17 03:30:42 2021] GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 17 03:30:42.564417 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-883aac64-bb8c-48a2-b7b7-c8af97522c32 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:30:42.565137 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-883aac64-bb8c-48a2-b7b7-c8af97522c32 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] [instance: 5ddbfaaa-fabf-4324-941c-8868625ffefc] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:30:42.572473 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-883aac64-bb8c-48a2-b7b7-c8af97522c32 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:30:42.573000 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-883aac64-bb8c-48a2-b7b7-c8af97522c32 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:30:42.573784 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-883aac64-bb8c-48a2-b7b7-c8af97522c32 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:30:42.574221 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-883aac64-bb8c-48a2-b7b7-c8af97522c32 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:30:42.639556 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-883aac64-bb8c-48a2-b7b7-c8af97522c32 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80763e09d44c475ea2425b22874e9612', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fef02a1dd77946a2ac0e0414b557435f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:30:42.641556 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-a88bcd3c-51cd-48cb-9a6f-0b7e8de1f740 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:30:42.642391 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-a88bcd3c-51cd-48cb-9a6f-0b7e8de1f740 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] [instance: a49437df-3059-4528-8328-2f3471d5fb45] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:30:42.647849 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-883aac64-bb8c-48a2-b7b7-c8af97522c32 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] 10.222.0.11 "GET /compute/v2.1/servers/5ddbfaaa-fabf-4324-941c-8868625ffefc" status: 200 len: 1226 microversion: 2.1 time: 0.087249 Nov 17 03:30:42.648430 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 510/1051] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:30:42 2021] GET /compute/v2.1/servers/5ddbfaaa-fabf-4324-941c-8868625ffefc => generated 1226 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:30:42.649120 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-a88bcd3c-51cd-48cb-9a6f-0b7e8de1f740 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:30:42.649568 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-a88bcd3c-51cd-48cb-9a6f-0b7e8de1f740 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:30:42.650392 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-a88bcd3c-51cd-48cb-9a6f-0b7e8de1f740 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:30:42.650826 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-a88bcd3c-51cd-48cb-9a6f-0b7e8de1f740 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:30:42.682227 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-a88bcd3c-51cd-48cb-9a6f-0b7e8de1f740 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] 10.222.0.11 "GET /compute/v2.1/servers/a49437df-3059-4528-8328-2f3471d5fb45/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044713 Nov 17 03:30:42.682803 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 542/1052] 10.222.0.11 () {58 vars in 1301 bytes} [Wed Nov 17 03:30:42 2021] GET /compute/v2.1/servers/a49437df-3059-4528-8328-2f3471d5fb45/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 17 03:30:43.290508 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-54a658b8-89a4-48b0-ad93-f2d113f7f9aa tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:30:43.291908 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-54a658b8-89a4-48b0-ad93-f2d113f7f9aa tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] [instance: 5d54db85-b991-4890-abaa-952413baa2e7] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:30:43.300559 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-54a658b8-89a4-48b0-ad93-f2d113f7f9aa tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:30:43.301339 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-54a658b8-89a4-48b0-ad93-f2d113f7f9aa tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:30:43.302436 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-54a658b8-89a4-48b0-ad93-f2d113f7f9aa tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:30:43.302862 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-54a658b8-89a4-48b0-ad93-f2d113f7f9aa tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:30:43.335141 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-54a658b8-89a4-48b0-ad93-f2d113f7f9aa tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] 10.222.0.11 "GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.050696 Nov 17 03:30:43.336341 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 511/1053] 10.222.0.11 () {60 vars in 1342 bytes} [Wed Nov 17 03:30:43 2021] GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 17 03:30:43.666043 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-9c70f056-a1f2-47ca-8142-e16e3ecd578d tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:30:43.666683 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-9c70f056-a1f2-47ca-8142-e16e3ecd578d tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] [instance: 5ddbfaaa-fabf-4324-941c-8868625ffefc] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:30:43.672851 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-9c70f056-a1f2-47ca-8142-e16e3ecd578d tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:30:43.673311 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-9c70f056-a1f2-47ca-8142-e16e3ecd578d tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:30:43.674086 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-9c70f056-a1f2-47ca-8142-e16e3ecd578d tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:30:43.674524 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-9c70f056-a1f2-47ca-8142-e16e3ecd578d tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:30:43.692994 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-34c8ad31-1203-4d7f-99fe-520210ed008c tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:30:43.693943 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-34c8ad31-1203-4d7f-99fe-520210ed008c tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] [instance: a49437df-3059-4528-8328-2f3471d5fb45] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:30:43.700276 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-34c8ad31-1203-4d7f-99fe-520210ed008c tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:30:43.700695 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-34c8ad31-1203-4d7f-99fe-520210ed008c tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:30:43.701537 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-34c8ad31-1203-4d7f-99fe-520210ed008c tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:30:43.701940 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-34c8ad31-1203-4d7f-99fe-520210ed008c tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:30:43.730915 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-34c8ad31-1203-4d7f-99fe-520210ed008c tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] 10.222.0.11 "GET /compute/v2.1/servers/a49437df-3059-4528-8328-2f3471d5fb45/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041846 Nov 17 03:30:43.735285 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 512/1054] 10.222.0.11 () {58 vars in 1301 bytes} [Wed Nov 17 03:30:43 2021] GET /compute/v2.1/servers/a49437df-3059-4528-8328-2f3471d5fb45/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 17 03:30:43.735444 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-9c70f056-a1f2-47ca-8142-e16e3ecd578d tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80763e09d44c475ea2425b22874e9612', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fef02a1dd77946a2ac0e0414b557435f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:30:43.742920 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-9c70f056-a1f2-47ca-8142-e16e3ecd578d tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] 10.222.0.11 "GET /compute/v2.1/servers/5ddbfaaa-fabf-4324-941c-8868625ffefc" status: 200 len: 1226 microversion: 2.1 time: 0.081522 Nov 17 03:30:43.743485 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 543/1055] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:30:43 2021] GET /compute/v2.1/servers/5ddbfaaa-fabf-4324-941c-8868625ffefc => generated 1226 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:30:44.347378 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-49904894-6920-44c0-a3ea-732ffb21b99b tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:30:44.348313 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-49904894-6920-44c0-a3ea-732ffb21b99b tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] [instance: 5d54db85-b991-4890-abaa-952413baa2e7] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:30:44.354735 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-49904894-6920-44c0-a3ea-732ffb21b99b tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:30:44.355182 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-49904894-6920-44c0-a3ea-732ffb21b99b tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:30:44.355956 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-49904894-6920-44c0-a3ea-732ffb21b99b tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:30:44.356385 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-49904894-6920-44c0-a3ea-732ffb21b99b tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:30:44.385976 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-49904894-6920-44c0-a3ea-732ffb21b99b tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] 10.222.0.11 "GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042531 Nov 17 03:30:44.386536 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 513/1056] 10.222.0.11 () {60 vars in 1342 bytes} [Wed Nov 17 03:30:44 2021] GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 17 03:30:44.747398 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-139e8c8b-bff7-4f7f-84c2-961fad342d7c tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:30:44.748739 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-139e8c8b-bff7-4f7f-84c2-961fad342d7c tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] [instance: a49437df-3059-4528-8328-2f3471d5fb45] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:30:44.759616 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-139e8c8b-bff7-4f7f-84c2-961fad342d7c tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:30:44.760386 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-139e8c8b-bff7-4f7f-84c2-961fad342d7c tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:30:44.761736 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-139e8c8b-bff7-4f7f-84c2-961fad342d7c tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:30:44.762463 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-139e8c8b-bff7-4f7f-84c2-961fad342d7c tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:30:44.762910 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-69d20dc4-6385-4796-a933-7ebba6879736 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:30:44.763908 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-69d20dc4-6385-4796-a933-7ebba6879736 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] [instance: 5ddbfaaa-fabf-4324-941c-8868625ffefc] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:30:44.773109 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-69d20dc4-6385-4796-a933-7ebba6879736 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:30:44.773575 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-69d20dc4-6385-4796-a933-7ebba6879736 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:30:44.774329 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-69d20dc4-6385-4796-a933-7ebba6879736 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:30:44.774760 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-69d20dc4-6385-4796-a933-7ebba6879736 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:30:44.795561 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-139e8c8b-bff7-4f7f-84c2-961fad342d7c tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] 10.222.0.11 "GET /compute/v2.1/servers/a49437df-3059-4528-8328-2f3471d5fb45/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.054935 Nov 17 03:30:44.796130 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 544/1057] 10.222.0.11 () {58 vars in 1301 bytes} [Wed Nov 17 03:30:44 2021] GET /compute/v2.1/servers/a49437df-3059-4528-8328-2f3471d5fb45/os-volume_attachments => generated 197 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 17 03:30:44.834779 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-69d20dc4-6385-4796-a933-7ebba6879736 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80763e09d44c475ea2425b22874e9612', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fef02a1dd77946a2ac0e0414b557435f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:30:44.842732 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-69d20dc4-6385-4796-a933-7ebba6879736 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] 10.222.0.11 "GET /compute/v2.1/servers/5ddbfaaa-fabf-4324-941c-8868625ffefc" status: 200 len: 1226 microversion: 2.1 time: 0.085955 Nov 17 03:30:44.843298 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 514/1058] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:30:44 2021] GET /compute/v2.1/servers/5ddbfaaa-fabf-4324-941c-8868625ffefc => generated 1226 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:30:45.401703 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-34a6b141-edae-4b4b-a112-c3203e4b54e1 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:30:45.403100 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-34a6b141-edae-4b4b-a112-c3203e4b54e1 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] [instance: 5d54db85-b991-4890-abaa-952413baa2e7] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:30:45.413464 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-34a6b141-edae-4b4b-a112-c3203e4b54e1 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:30:45.414227 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-34a6b141-edae-4b4b-a112-c3203e4b54e1 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:30:45.415518 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-34a6b141-edae-4b4b-a112-c3203e4b54e1 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:30:45.416261 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-34a6b141-edae-4b4b-a112-c3203e4b54e1 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:30:45.450132 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-34a6b141-edae-4b4b-a112-c3203e4b54e1 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] 10.222.0.11 "GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.055295 Nov 17 03:30:45.450683 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 545/1059] 10.222.0.11 () {60 vars in 1342 bytes} [Wed Nov 17 03:30:45 2021] GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7/os-volume_attachments => generated 197 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 17 03:30:45.807888 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-11136d9a-f6b5-451b-a819-4802ef683cc3 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:30:45.808835 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-11136d9a-f6b5-451b-a819-4802ef683cc3 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] [instance: a49437df-3059-4528-8328-2f3471d5fb45] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:30:45.815690 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-11136d9a-f6b5-451b-a819-4802ef683cc3 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:30:45.816140 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-11136d9a-f6b5-451b-a819-4802ef683cc3 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:30:45.816991 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-11136d9a-f6b5-451b-a819-4802ef683cc3 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:30:45.817424 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-11136d9a-f6b5-451b-a819-4802ef683cc3 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:30:45.849957 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-11136d9a-f6b5-451b-a819-4802ef683cc3 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] 10.222.0.11 "GET /compute/v2.1/servers/a49437df-3059-4528-8328-2f3471d5fb45/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045472 Nov 17 03:30:45.850540 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 515/1060] 10.222.0.11 () {58 vars in 1301 bytes} [Wed Nov 17 03:30:45 2021] GET /compute/v2.1/servers/a49437df-3059-4528-8328-2f3471d5fb45/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 17 03:30:45.865475 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-82b99407-de75-455f-acd8-8f41fd235027 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:30:45.866286 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-82b99407-de75-455f-acd8-8f41fd235027 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] [instance: 5ddbfaaa-fabf-4324-941c-8868625ffefc] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:30:45.873002 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-82b99407-de75-455f-acd8-8f41fd235027 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:30:45.873457 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-82b99407-de75-455f-acd8-8f41fd235027 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:30:45.874234 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-82b99407-de75-455f-acd8-8f41fd235027 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:30:45.874664 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-82b99407-de75-455f-acd8-8f41fd235027 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:30:45.936060 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-82b99407-de75-455f-acd8-8f41fd235027 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80763e09d44c475ea2425b22874e9612', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fef02a1dd77946a2ac0e0414b557435f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:30:45.943681 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-82b99407-de75-455f-acd8-8f41fd235027 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] 10.222.0.11 "GET /compute/v2.1/servers/5ddbfaaa-fabf-4324-941c-8868625ffefc" status: 200 len: 1226 microversion: 2.1 time: 0.082457 Nov 17 03:30:45.944227 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 546/1061] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:30:45 2021] GET /compute/v2.1/servers/5ddbfaaa-fabf-4324-941c-8868625ffefc => generated 1226 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:30:46.465836 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-c442ad54-2f74-4b80-b5e5-2d3e761307cb tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:30:46.467303 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-c442ad54-2f74-4b80-b5e5-2d3e761307cb tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] [instance: 5d54db85-b991-4890-abaa-952413baa2e7] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:30:46.476363 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-c442ad54-2f74-4b80-b5e5-2d3e761307cb tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:30:46.476828 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-c442ad54-2f74-4b80-b5e5-2d3e761307cb tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:30:46.477594 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-c442ad54-2f74-4b80-b5e5-2d3e761307cb tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:30:46.478019 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-c442ad54-2f74-4b80-b5e5-2d3e761307cb tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:30:46.507181 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-c442ad54-2f74-4b80-b5e5-2d3e761307cb tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] 10.222.0.11 "GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047685 Nov 17 03:30:46.507728 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 516/1062] 10.222.0.11 () {60 vars in 1342 bytes} [Wed Nov 17 03:30:46 2021] GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 17 03:30:46.864434 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-c4c7a1ab-57a4-4e6f-8ce9-db9462b25dc1 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:30:46.865892 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-c4c7a1ab-57a4-4e6f-8ce9-db9462b25dc1 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] [instance: a49437df-3059-4528-8328-2f3471d5fb45] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:30:46.872336 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-c4c7a1ab-57a4-4e6f-8ce9-db9462b25dc1 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:30:46.872802 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-c4c7a1ab-57a4-4e6f-8ce9-db9462b25dc1 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:30:46.873592 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-c4c7a1ab-57a4-4e6f-8ce9-db9462b25dc1 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:30:46.874020 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-c4c7a1ab-57a4-4e6f-8ce9-db9462b25dc1 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:30:46.903640 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-c4c7a1ab-57a4-4e6f-8ce9-db9462b25dc1 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] 10.222.0.11 "GET /compute/v2.1/servers/a49437df-3059-4528-8328-2f3471d5fb45/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045563 Nov 17 03:30:46.904186 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 547/1063] 10.222.0.11 () {58 vars in 1301 bytes} [Wed Nov 17 03:30:46 2021] GET /compute/v2.1/servers/a49437df-3059-4528-8328-2f3471d5fb45/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 17 03:30:46.960574 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-997e2676-b542-4495-b609-2adc9f46125a tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:30:46.961172 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-997e2676-b542-4495-b609-2adc9f46125a tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] [instance: 5ddbfaaa-fabf-4324-941c-8868625ffefc] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:30:46.967750 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-997e2676-b542-4495-b609-2adc9f46125a tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:30:46.968197 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-997e2676-b542-4495-b609-2adc9f46125a tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:30:46.968995 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-997e2676-b542-4495-b609-2adc9f46125a tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:30:46.969423 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-997e2676-b542-4495-b609-2adc9f46125a tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:30:47.035007 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-997e2676-b542-4495-b609-2adc9f46125a tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80763e09d44c475ea2425b22874e9612', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fef02a1dd77946a2ac0e0414b557435f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:30:47.042736 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-997e2676-b542-4495-b609-2adc9f46125a tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] 10.222.0.11 "GET /compute/v2.1/servers/5ddbfaaa-fabf-4324-941c-8868625ffefc" status: 200 len: 1226 microversion: 2.1 time: 0.085952 Nov 17 03:30:47.043320 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 517/1064] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:30:46 2021] GET /compute/v2.1/servers/5ddbfaaa-fabf-4324-941c-8868625ffefc => generated 1226 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:30:47.522400 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-2aa51f6c-bf47-4e23-915e-3e5bbe52adf9 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:30:47.523303 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-2aa51f6c-bf47-4e23-915e-3e5bbe52adf9 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] [instance: 5d54db85-b991-4890-abaa-952413baa2e7] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:30:47.529728 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-2aa51f6c-bf47-4e23-915e-3e5bbe52adf9 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:30:47.530171 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-2aa51f6c-bf47-4e23-915e-3e5bbe52adf9 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:30:47.530934 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-2aa51f6c-bf47-4e23-915e-3e5bbe52adf9 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:30:47.531361 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-2aa51f6c-bf47-4e23-915e-3e5bbe52adf9 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:30:47.561560 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-2aa51f6c-bf47-4e23-915e-3e5bbe52adf9 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] 10.222.0.11 "GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044866 Nov 17 03:30:47.562125 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 548/1065] 10.222.0.11 () {60 vars in 1342 bytes} [Wed Nov 17 03:30:47 2021] GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 17 03:30:47.920157 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-94dbe41d-f41d-49c3-af43-9c0b8a75807e tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:30:47.921556 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-94dbe41d-f41d-49c3-af43-9c0b8a75807e tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] [instance: a49437df-3059-4528-8328-2f3471d5fb45] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:30:47.932427 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-94dbe41d-f41d-49c3-af43-9c0b8a75807e tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:30:47.933244 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-94dbe41d-f41d-49c3-af43-9c0b8a75807e tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:30:47.934524 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-94dbe41d-f41d-49c3-af43-9c0b8a75807e tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:30:47.935254 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-94dbe41d-f41d-49c3-af43-9c0b8a75807e tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:30:47.967500 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-94dbe41d-f41d-49c3-af43-9c0b8a75807e tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] 10.222.0.11 "GET /compute/v2.1/servers/a49437df-3059-4528-8328-2f3471d5fb45/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.054611 Nov 17 03:30:47.968136 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 518/1066] 10.222.0.11 () {58 vars in 1301 bytes} [Wed Nov 17 03:30:47 2021] GET /compute/v2.1/servers/a49437df-3059-4528-8328-2f3471d5fb45/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 17 03:30:48.061683 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-f565a660-d737-4168-9765-bf8710ffb02f tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:30:48.062318 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-f565a660-d737-4168-9765-bf8710ffb02f tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] [instance: 5ddbfaaa-fabf-4324-941c-8868625ffefc] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:30:48.070132 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-f565a660-d737-4168-9765-bf8710ffb02f tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:30:48.070578 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-f565a660-d737-4168-9765-bf8710ffb02f tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:30:48.071352 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-f565a660-d737-4168-9765-bf8710ffb02f tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:30:48.071787 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-f565a660-d737-4168-9765-bf8710ffb02f tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:30:48.136196 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-f565a660-d737-4168-9765-bf8710ffb02f tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80763e09d44c475ea2425b22874e9612', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fef02a1dd77946a2ac0e0414b557435f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:30:48.143869 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-f565a660-d737-4168-9765-bf8710ffb02f tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] 10.222.0.11 "GET /compute/v2.1/servers/5ddbfaaa-fabf-4324-941c-8868625ffefc" status: 200 len: 1226 microversion: 2.1 time: 0.087996 Nov 17 03:30:48.144447 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 549/1067] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:30:48 2021] GET /compute/v2.1/servers/5ddbfaaa-fabf-4324-941c-8868625ffefc => generated 1226 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:30:48.577533 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-8440accd-1b1d-45a3-96f5-99b5b8a86001 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:30:48.579065 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-8440accd-1b1d-45a3-96f5-99b5b8a86001 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] [instance: 5d54db85-b991-4890-abaa-952413baa2e7] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:30:48.587730 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-8440accd-1b1d-45a3-96f5-99b5b8a86001 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:30:48.588176 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-8440accd-1b1d-45a3-96f5-99b5b8a86001 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:30:48.588977 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-8440accd-1b1d-45a3-96f5-99b5b8a86001 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:30:48.589403 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-8440accd-1b1d-45a3-96f5-99b5b8a86001 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:30:48.620129 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-8440accd-1b1d-45a3-96f5-99b5b8a86001 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] 10.222.0.11 "GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.049042 Nov 17 03:30:48.620670 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 519/1068] 10.222.0.11 () {60 vars in 1342 bytes} [Wed Nov 17 03:30:48 2021] GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 17 03:30:48.983251 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-79b6246b-66ac-4c60-a187-021c670ae622 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:30:48.984586 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-79b6246b-66ac-4c60-a187-021c670ae622 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] [instance: a49437df-3059-4528-8328-2f3471d5fb45] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:30:48.993577 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-79b6246b-66ac-4c60-a187-021c670ae622 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:30:48.994025 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-79b6246b-66ac-4c60-a187-021c670ae622 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:30:48.994786 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-79b6246b-66ac-4c60-a187-021c670ae622 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:30:48.995215 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-79b6246b-66ac-4c60-a187-021c670ae622 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:30:49.023816 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-79b6246b-66ac-4c60-a187-021c670ae622 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] 10.222.0.11 "GET /compute/v2.1/servers/a49437df-3059-4528-8328-2f3471d5fb45/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047012 Nov 17 03:30:49.024328 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 550/1069] 10.222.0.11 () {58 vars in 1301 bytes} [Wed Nov 17 03:30:48 2021] GET /compute/v2.1/servers/a49437df-3059-4528-8328-2f3471d5fb45/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 17 03:30:49.166723 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-57425c14-4e8b-4c7a-9b54-7f21134e60c0 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:30:49.167741 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-57425c14-4e8b-4c7a-9b54-7f21134e60c0 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] [instance: 5ddbfaaa-fabf-4324-941c-8868625ffefc] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:30:49.178367 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-57425c14-4e8b-4c7a-9b54-7f21134e60c0 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:30:49.178788 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-57425c14-4e8b-4c7a-9b54-7f21134e60c0 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:30:49.179588 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-57425c14-4e8b-4c7a-9b54-7f21134e60c0 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:30:49.180033 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-57425c14-4e8b-4c7a-9b54-7f21134e60c0 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:30:49.240727 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-57425c14-4e8b-4c7a-9b54-7f21134e60c0 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80763e09d44c475ea2425b22874e9612', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fef02a1dd77946a2ac0e0414b557435f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:30:49.248415 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-57425c14-4e8b-4c7a-9b54-7f21134e60c0 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] 10.222.0.11 "GET /compute/v2.1/servers/5ddbfaaa-fabf-4324-941c-8868625ffefc" status: 200 len: 1226 microversion: 2.1 time: 0.088425 Nov 17 03:30:49.249024 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 520/1070] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:30:49 2021] GET /compute/v2.1/servers/5ddbfaaa-fabf-4324-941c-8868625ffefc => generated 1226 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:30:49.634251 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-bf8bf0b0-86fe-4333-8b1c-38ff772534db tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:30:49.635304 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-bf8bf0b0-86fe-4333-8b1c-38ff772534db tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] [instance: 5d54db85-b991-4890-abaa-952413baa2e7] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:30:49.641963 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-bf8bf0b0-86fe-4333-8b1c-38ff772534db tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:30:49.642404 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-bf8bf0b0-86fe-4333-8b1c-38ff772534db tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:30:49.643172 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-bf8bf0b0-86fe-4333-8b1c-38ff772534db tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:30:49.643597 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-bf8bf0b0-86fe-4333-8b1c-38ff772534db tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:30:49.673816 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-bf8bf0b0-86fe-4333-8b1c-38ff772534db tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] 10.222.0.11 "GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044183 Nov 17 03:30:49.674354 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 551/1071] 10.222.0.11 () {60 vars in 1342 bytes} [Wed Nov 17 03:30:49 2021] GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 17 03:30:50.039524 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-9710039f-acfd-442d-8989-2b5b08ea2453 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:30:50.041056 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-9710039f-acfd-442d-8989-2b5b08ea2453 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] [instance: a49437df-3059-4528-8328-2f3471d5fb45] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:30:50.051222 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-9710039f-acfd-442d-8989-2b5b08ea2453 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:30:50.051962 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-9710039f-acfd-442d-8989-2b5b08ea2453 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:30:50.053394 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-9710039f-acfd-442d-8989-2b5b08ea2453 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:30:50.053981 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-9710039f-acfd-442d-8989-2b5b08ea2453 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:30:50.086935 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-9710039f-acfd-442d-8989-2b5b08ea2453 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] 10.222.0.11 "GET /compute/v2.1/servers/a49437df-3059-4528-8328-2f3471d5fb45/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053574 Nov 17 03:30:50.087650 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 521/1072] 10.222.0.11 () {58 vars in 1301 bytes} [Wed Nov 17 03:30:50 2021] GET /compute/v2.1/servers/a49437df-3059-4528-8328-2f3471d5fb45/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 17 03:30:50.269066 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-834508fa-42e1-4907-8dd8-d45477ddeb70 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:30:50.270103 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-834508fa-42e1-4907-8dd8-d45477ddeb70 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] [instance: 5ddbfaaa-fabf-4324-941c-8868625ffefc] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:30:50.280454 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-834508fa-42e1-4907-8dd8-d45477ddeb70 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:30:50.281248 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-834508fa-42e1-4907-8dd8-d45477ddeb70 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:30:50.282506 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-834508fa-42e1-4907-8dd8-d45477ddeb70 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:30:50.283281 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-834508fa-42e1-4907-8dd8-d45477ddeb70 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:30:50.357031 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-834508fa-42e1-4907-8dd8-d45477ddeb70 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80763e09d44c475ea2425b22874e9612', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fef02a1dd77946a2ac0e0414b557435f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:30:50.367582 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-834508fa-42e1-4907-8dd8-d45477ddeb70 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] 10.222.0.11 "GET /compute/v2.1/servers/5ddbfaaa-fabf-4324-941c-8868625ffefc" status: 200 len: 1226 microversion: 2.1 time: 0.104460 Nov 17 03:30:50.368115 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 552/1073] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:30:50 2021] GET /compute/v2.1/servers/5ddbfaaa-fabf-4324-941c-8868625ffefc => generated 1226 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:30:50.690133 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-ce3dea02-d246-4525-a3a8-cd41997c975a tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:30:50.691442 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-ce3dea02-d246-4525-a3a8-cd41997c975a tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] [instance: 5d54db85-b991-4890-abaa-952413baa2e7] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:30:50.701946 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-ce3dea02-d246-4525-a3a8-cd41997c975a tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:30:50.702784 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-ce3dea02-d246-4525-a3a8-cd41997c975a tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:30:50.704050 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-ce3dea02-d246-4525-a3a8-cd41997c975a tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:30:50.704766 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-ce3dea02-d246-4525-a3a8-cd41997c975a tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:30:50.735797 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-ce3dea02-d246-4525-a3a8-cd41997c975a tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] 10.222.0.11 "GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.052186 Nov 17 03:30:50.736336 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 522/1074] 10.222.0.11 () {60 vars in 1342 bytes} [Wed Nov 17 03:30:50 2021] GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 17 03:30:51.099926 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-39bf21b6-ed53-474a-aabc-9a0d91c07623 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:30:51.100953 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-39bf21b6-ed53-474a-aabc-9a0d91c07623 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] [instance: a49437df-3059-4528-8328-2f3471d5fb45] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:30:51.107649 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-39bf21b6-ed53-474a-aabc-9a0d91c07623 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:30:51.108094 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-39bf21b6-ed53-474a-aabc-9a0d91c07623 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:30:51.108886 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-39bf21b6-ed53-474a-aabc-9a0d91c07623 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:30:51.109316 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-39bf21b6-ed53-474a-aabc-9a0d91c07623 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:30:51.139835 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-39bf21b6-ed53-474a-aabc-9a0d91c07623 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] 10.222.0.11 "GET /compute/v2.1/servers/a49437df-3059-4528-8328-2f3471d5fb45/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043829 Nov 17 03:30:51.140397 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 553/1075] 10.222.0.11 () {58 vars in 1301 bytes} [Wed Nov 17 03:30:51 2021] GET /compute/v2.1/servers/a49437df-3059-4528-8328-2f3471d5fb45/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 17 03:30:51.388100 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-ef9c2ac1-3424-40ed-b893-76932b0f9df0 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:30:51.388927 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-ef9c2ac1-3424-40ed-b893-76932b0f9df0 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] [instance: 5ddbfaaa-fabf-4324-941c-8868625ffefc] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:30:51.398037 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-ef9c2ac1-3424-40ed-b893-76932b0f9df0 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:30:51.398483 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-ef9c2ac1-3424-40ed-b893-76932b0f9df0 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:30:51.399236 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-ef9c2ac1-3424-40ed-b893-76932b0f9df0 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:30:51.399662 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-ef9c2ac1-3424-40ed-b893-76932b0f9df0 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:30:51.469919 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-ef9c2ac1-3424-40ed-b893-76932b0f9df0 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80763e09d44c475ea2425b22874e9612', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fef02a1dd77946a2ac0e0414b557435f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:30:51.480637 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-ef9c2ac1-3424-40ed-b893-76932b0f9df0 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] 10.222.0.11 "GET /compute/v2.1/servers/5ddbfaaa-fabf-4324-941c-8868625ffefc" status: 200 len: 1226 microversion: 2.1 time: 0.098519 Nov 17 03:30:51.481354 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 523/1076] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:30:51 2021] GET /compute/v2.1/servers/5ddbfaaa-fabf-4324-941c-8868625ffefc => generated 1226 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:30:51.751340 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-1492c62c-5502-4a1a-a8e8-5ed433fe96eb tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:30:51.752507 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-1492c62c-5502-4a1a-a8e8-5ed433fe96eb tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] [instance: 5d54db85-b991-4890-abaa-952413baa2e7] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:30:51.760175 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-1492c62c-5502-4a1a-a8e8-5ed433fe96eb tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:30:51.760621 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-1492c62c-5502-4a1a-a8e8-5ed433fe96eb tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:30:51.761411 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-1492c62c-5502-4a1a-a8e8-5ed433fe96eb tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:30:51.761833 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-1492c62c-5502-4a1a-a8e8-5ed433fe96eb tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:30:51.791444 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-1492c62c-5502-4a1a-a8e8-5ed433fe96eb tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] 10.222.0.11 "GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046470 Nov 17 03:30:51.792012 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 554/1077] 10.222.0.11 () {60 vars in 1342 bytes} [Wed Nov 17 03:30:51 2021] GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 17 03:30:52.155968 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-492c4186-2b73-4cc1-b3b8-5bc7ae154614 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:30:52.157525 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-492c4186-2b73-4cc1-b3b8-5bc7ae154614 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] [instance: a49437df-3059-4528-8328-2f3471d5fb45] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:30:52.168173 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-492c4186-2b73-4cc1-b3b8-5bc7ae154614 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:30:52.168972 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-492c4186-2b73-4cc1-b3b8-5bc7ae154614 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:30:52.170372 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-492c4186-2b73-4cc1-b3b8-5bc7ae154614 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:30:52.171088 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-492c4186-2b73-4cc1-b3b8-5bc7ae154614 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:30:52.203332 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-492c4186-2b73-4cc1-b3b8-5bc7ae154614 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] 10.222.0.11 "GET /compute/v2.1/servers/a49437df-3059-4528-8328-2f3471d5fb45/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053759 Nov 17 03:30:52.203867 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 524/1078] 10.222.0.11 () {58 vars in 1301 bytes} [Wed Nov 17 03:30:52 2021] GET /compute/v2.1/servers/a49437df-3059-4528-8328-2f3471d5fb45/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 17 03:30:52.504937 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-c1476f48-1e60-45d0-a142-922197f81d2a tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:30:52.505910 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-c1476f48-1e60-45d0-a142-922197f81d2a tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] [instance: 5ddbfaaa-fabf-4324-941c-8868625ffefc] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:30:52.513145 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-c1476f48-1e60-45d0-a142-922197f81d2a tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:30:52.513590 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-c1476f48-1e60-45d0-a142-922197f81d2a tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:30:52.514353 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-c1476f48-1e60-45d0-a142-922197f81d2a tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:30:52.514780 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-c1476f48-1e60-45d0-a142-922197f81d2a tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:30:52.582148 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-c1476f48-1e60-45d0-a142-922197f81d2a tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80763e09d44c475ea2425b22874e9612', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fef02a1dd77946a2ac0e0414b557435f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:30:52.594420 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-c1476f48-1e60-45d0-a142-922197f81d2a tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] 10.222.0.11 "GET /compute/v2.1/servers/5ddbfaaa-fabf-4324-941c-8868625ffefc" status: 200 len: 1226 microversion: 2.1 time: 0.095364 Nov 17 03:30:52.595539 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 555/1079] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:30:52 2021] GET /compute/v2.1/servers/5ddbfaaa-fabf-4324-941c-8868625ffefc => generated 1226 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:30:52.807009 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-14239fd6-fb75-48ce-92d2-4c90b7bc8c90 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:30:52.808073 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-14239fd6-fb75-48ce-92d2-4c90b7bc8c90 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] [instance: 5d54db85-b991-4890-abaa-952413baa2e7] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:30:52.816387 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-14239fd6-fb75-48ce-92d2-4c90b7bc8c90 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:30:52.817030 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-14239fd6-fb75-48ce-92d2-4c90b7bc8c90 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:30:52.818043 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-14239fd6-fb75-48ce-92d2-4c90b7bc8c90 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:30:52.818882 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-14239fd6-fb75-48ce-92d2-4c90b7bc8c90 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:30:52.851861 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-14239fd6-fb75-48ce-92d2-4c90b7bc8c90 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] 10.222.0.11 "GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.051594 Nov 17 03:30:52.852405 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 525/1080] 10.222.0.11 () {60 vars in 1342 bytes} [Wed Nov 17 03:30:52 2021] GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 17 03:30:53.219816 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-6391227f-10fa-4c67-b62d-d8889a7b967f tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:30:53.221332 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-6391227f-10fa-4c67-b62d-d8889a7b967f tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] [instance: a49437df-3059-4528-8328-2f3471d5fb45] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:30:53.229602 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-6391227f-10fa-4c67-b62d-d8889a7b967f tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:30:53.230047 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-6391227f-10fa-4c67-b62d-d8889a7b967f tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:30:53.230811 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-6391227f-10fa-4c67-b62d-d8889a7b967f tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:30:53.231244 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-6391227f-10fa-4c67-b62d-d8889a7b967f tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:30:53.261324 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-6391227f-10fa-4c67-b62d-d8889a7b967f tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] 10.222.0.11 "GET /compute/v2.1/servers/a49437df-3059-4528-8328-2f3471d5fb45/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048032 Nov 17 03:30:53.261868 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 556/1081] 10.222.0.11 () {58 vars in 1301 bytes} [Wed Nov 17 03:30:53 2021] GET /compute/v2.1/servers/a49437df-3059-4528-8328-2f3471d5fb45/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 17 03:30:53.611712 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-256d50a7-3bf1-467c-b9e8-0671cdcf840c tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:30:53.612320 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-256d50a7-3bf1-467c-b9e8-0671cdcf840c tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] [instance: 5ddbfaaa-fabf-4324-941c-8868625ffefc] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:30:53.618832 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-256d50a7-3bf1-467c-b9e8-0671cdcf840c tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:30:53.619281 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-256d50a7-3bf1-467c-b9e8-0671cdcf840c tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:30:53.620054 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-256d50a7-3bf1-467c-b9e8-0671cdcf840c tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:30:53.620513 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-256d50a7-3bf1-467c-b9e8-0671cdcf840c tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:30:53.694329 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-256d50a7-3bf1-467c-b9e8-0671cdcf840c tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80763e09d44c475ea2425b22874e9612', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fef02a1dd77946a2ac0e0414b557435f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:30:53.702235 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-256d50a7-3bf1-467c-b9e8-0671cdcf840c tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] 10.222.0.11 "GET /compute/v2.1/servers/5ddbfaaa-fabf-4324-941c-8868625ffefc" status: 200 len: 1226 microversion: 2.1 time: 0.094481 Nov 17 03:30:53.702848 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 526/1082] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:30:53 2021] GET /compute/v2.1/servers/5ddbfaaa-fabf-4324-941c-8868625ffefc => generated 1226 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:30:53.868429 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-7ba4ff90-a109-4efb-a043-bcb55cd337a7 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:30:53.869814 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-7ba4ff90-a109-4efb-a043-bcb55cd337a7 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] [instance: 5d54db85-b991-4890-abaa-952413baa2e7] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:30:53.880630 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-7ba4ff90-a109-4efb-a043-bcb55cd337a7 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:30:53.881475 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-7ba4ff90-a109-4efb-a043-bcb55cd337a7 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:30:53.882275 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-7ba4ff90-a109-4efb-a043-bcb55cd337a7 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:30:53.882708 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-7ba4ff90-a109-4efb-a043-bcb55cd337a7 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:30:53.912009 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-7ba4ff90-a109-4efb-a043-bcb55cd337a7 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] 10.222.0.11 "GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.050635 Nov 17 03:30:53.912689 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 557/1083] 10.222.0.11 () {60 vars in 1342 bytes} [Wed Nov 17 03:30:53 2021] GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 17 03:30:54.278865 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-4325800c-f92d-4f22-be37-0d43ff403449 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:30:54.280343 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-4325800c-f92d-4f22-be37-0d43ff403449 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] [instance: a49437df-3059-4528-8328-2f3471d5fb45] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:30:54.290622 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-4325800c-f92d-4f22-be37-0d43ff403449 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:30:54.291363 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-4325800c-f92d-4f22-be37-0d43ff403449 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:30:54.292645 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-4325800c-f92d-4f22-be37-0d43ff403449 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:30:54.293410 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-4325800c-f92d-4f22-be37-0d43ff403449 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:30:54.327621 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-4325800c-f92d-4f22-be37-0d43ff403449 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] 10.222.0.11 "GET /compute/v2.1/servers/a49437df-3059-4528-8328-2f3471d5fb45/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.055994 Nov 17 03:30:54.328176 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 527/1084] 10.222.0.11 () {58 vars in 1301 bytes} [Wed Nov 17 03:30:54 2021] GET /compute/v2.1/servers/a49437df-3059-4528-8328-2f3471d5fb45/os-volume_attachments => generated 197 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 17 03:30:54.723227 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-ee63909a-40a7-4d4c-afef-15c022a284d4 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:30:54.724088 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-ee63909a-40a7-4d4c-afef-15c022a284d4 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] [instance: 5ddbfaaa-fabf-4324-941c-8868625ffefc] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:30:54.734207 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-ee63909a-40a7-4d4c-afef-15c022a284d4 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:30:54.734942 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-ee63909a-40a7-4d4c-afef-15c022a284d4 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:30:54.736200 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-ee63909a-40a7-4d4c-afef-15c022a284d4 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:30:54.736959 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-ee63909a-40a7-4d4c-afef-15c022a284d4 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:30:54.797853 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-ee63909a-40a7-4d4c-afef-15c022a284d4 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80763e09d44c475ea2425b22874e9612', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fef02a1dd77946a2ac0e0414b557435f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:30:54.805361 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-ee63909a-40a7-4d4c-afef-15c022a284d4 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] 10.222.0.11 "GET /compute/v2.1/servers/5ddbfaaa-fabf-4324-941c-8868625ffefc" status: 200 len: 1226 microversion: 2.1 time: 0.088661 Nov 17 03:30:54.806298 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 558/1085] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:30:54 2021] GET /compute/v2.1/servers/5ddbfaaa-fabf-4324-941c-8868625ffefc => generated 1226 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:30:54.929067 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-a563114a-254e-441f-86ae-240fe812e5bf tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:30:54.930024 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-a563114a-254e-441f-86ae-240fe812e5bf tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] [instance: 5d54db85-b991-4890-abaa-952413baa2e7] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:30:54.938260 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-a563114a-254e-441f-86ae-240fe812e5bf tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:30:54.938818 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-a563114a-254e-441f-86ae-240fe812e5bf tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:30:54.939979 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-a563114a-254e-441f-86ae-240fe812e5bf tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:30:54.940580 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-a563114a-254e-441f-86ae-240fe812e5bf tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:30:54.977196 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-a563114a-254e-441f-86ae-240fe812e5bf tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] 10.222.0.11 "GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.054267 Nov 17 03:30:54.977666 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 528/1086] 10.222.0.11 () {60 vars in 1342 bytes} [Wed Nov 17 03:30:54 2021] GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 17 03:30:55.342041 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-5383634a-a575-4f34-b267-8f8a3c68ac0d tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:30:55.343233 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-5383634a-a575-4f34-b267-8f8a3c68ac0d tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] [instance: a49437df-3059-4528-8328-2f3471d5fb45] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:30:55.351551 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-5383634a-a575-4f34-b267-8f8a3c68ac0d tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:30:55.352005 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-5383634a-a575-4f34-b267-8f8a3c68ac0d tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:30:55.352796 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-5383634a-a575-4f34-b267-8f8a3c68ac0d tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:30:55.353351 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-5383634a-a575-4f34-b267-8f8a3c68ac0d tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:30:55.388357 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-5383634a-a575-4f34-b267-8f8a3c68ac0d tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] 10.222.0.11 "GET /compute/v2.1/servers/a49437df-3059-4528-8328-2f3471d5fb45/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051354 Nov 17 03:30:55.388959 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 559/1087] 10.222.0.11 () {58 vars in 1301 bytes} [Wed Nov 17 03:30:55 2021] GET /compute/v2.1/servers/a49437df-3059-4528-8328-2f3471d5fb45/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 17 03:30:55.832957 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-d6e10a29-76c7-4047-9633-7c641f7127da tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:30:55.833943 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-d6e10a29-76c7-4047-9633-7c641f7127da tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] [instance: 5ddbfaaa-fabf-4324-941c-8868625ffefc] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:30:55.844143 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-d6e10a29-76c7-4047-9633-7c641f7127da tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:30:55.844939 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-d6e10a29-76c7-4047-9633-7c641f7127da tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:30:55.846198 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-d6e10a29-76c7-4047-9633-7c641f7127da tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:30:55.846912 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-d6e10a29-76c7-4047-9633-7c641f7127da tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:30:55.906683 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-d6e10a29-76c7-4047-9633-7c641f7127da tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80763e09d44c475ea2425b22874e9612', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fef02a1dd77946a2ac0e0414b557435f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:30:55.914450 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-d6e10a29-76c7-4047-9633-7c641f7127da tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] 10.222.0.11 "GET /compute/v2.1/servers/5ddbfaaa-fabf-4324-941c-8868625ffefc" status: 200 len: 1226 microversion: 2.1 time: 0.088881 Nov 17 03:30:55.915007 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 529/1088] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:30:55 2021] GET /compute/v2.1/servers/5ddbfaaa-fabf-4324-941c-8868625ffefc => generated 1226 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:30:55.992667 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-2251f2af-9820-4699-b594-3916c7e27635 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:30:55.994172 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-2251f2af-9820-4699-b594-3916c7e27635 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] [instance: 5d54db85-b991-4890-abaa-952413baa2e7] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:30:56.004230 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-2251f2af-9820-4699-b594-3916c7e27635 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:30:56.005210 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-2251f2af-9820-4699-b594-3916c7e27635 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:30:56.006416 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-2251f2af-9820-4699-b594-3916c7e27635 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:30:56.006848 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-2251f2af-9820-4699-b594-3916c7e27635 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:30:56.038082 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-2251f2af-9820-4699-b594-3916c7e27635 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] 10.222.0.11 "GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.051746 Nov 17 03:30:56.038605 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 560/1089] 10.222.0.11 () {60 vars in 1342 bytes} [Wed Nov 17 03:30:55 2021] GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 17 03:30:56.404951 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-38de55f4-9103-4f65-865f-6f0a085735f8 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:30:56.406415 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-38de55f4-9103-4f65-865f-6f0a085735f8 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] [instance: a49437df-3059-4528-8328-2f3471d5fb45] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:30:56.417788 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-38de55f4-9103-4f65-865f-6f0a085735f8 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:30:56.418514 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-38de55f4-9103-4f65-865f-6f0a085735f8 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:30:56.419818 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-38de55f4-9103-4f65-865f-6f0a085735f8 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:30:56.420527 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-38de55f4-9103-4f65-865f-6f0a085735f8 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:30:56.453366 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-38de55f4-9103-4f65-865f-6f0a085735f8 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] 10.222.0.11 "GET /compute/v2.1/servers/a49437df-3059-4528-8328-2f3471d5fb45/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.054940 Nov 17 03:30:56.453914 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 530/1090] 10.222.0.11 () {58 vars in 1301 bytes} [Wed Nov 17 03:30:56 2021] GET /compute/v2.1/servers/a49437df-3059-4528-8328-2f3471d5fb45/os-volume_attachments => generated 197 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 17 03:30:56.933177 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-042bc7a4-5b83-4afe-adec-0978af90e5c1 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:30:56.933820 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-042bc7a4-5b83-4afe-adec-0978af90e5c1 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] [instance: 5ddbfaaa-fabf-4324-941c-8868625ffefc] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:30:56.940613 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-042bc7a4-5b83-4afe-adec-0978af90e5c1 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:30:56.941083 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-042bc7a4-5b83-4afe-adec-0978af90e5c1 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:30:56.941846 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-042bc7a4-5b83-4afe-adec-0978af90e5c1 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:30:56.942272 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-042bc7a4-5b83-4afe-adec-0978af90e5c1 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:30:57.000355 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-042bc7a4-5b83-4afe-adec-0978af90e5c1 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80763e09d44c475ea2425b22874e9612', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fef02a1dd77946a2ac0e0414b557435f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:30:57.008368 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-042bc7a4-5b83-4afe-adec-0978af90e5c1 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] 10.222.0.11 "GET /compute/v2.1/servers/5ddbfaaa-fabf-4324-941c-8868625ffefc" status: 200 len: 1226 microversion: 2.1 time: 0.079373 Nov 17 03:30:57.008951 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 561/1091] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:30:56 2021] GET /compute/v2.1/servers/5ddbfaaa-fabf-4324-941c-8868625ffefc => generated 1226 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:30:57.050061 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-21987686-1acf-4c6c-a25c-4020a5a680c6 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:30:57.051106 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-21987686-1acf-4c6c-a25c-4020a5a680c6 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] [instance: 5d54db85-b991-4890-abaa-952413baa2e7] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:30:57.058141 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-21987686-1acf-4c6c-a25c-4020a5a680c6 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:30:57.058594 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-21987686-1acf-4c6c-a25c-4020a5a680c6 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:30:57.059377 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-21987686-1acf-4c6c-a25c-4020a5a680c6 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:30:57.059809 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-21987686-1acf-4c6c-a25c-4020a5a680c6 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:30:57.089748 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-21987686-1acf-4c6c-a25c-4020a5a680c6 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] 10.222.0.11 "GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043504 Nov 17 03:30:57.090304 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 531/1092] 10.222.0.11 () {60 vars in 1342 bytes} [Wed Nov 17 03:30:57 2021] GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 17 03:30:57.469426 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-b8d7746a-16b7-419a-9606-90e966eb0217 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:30:57.470906 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-b8d7746a-16b7-419a-9606-90e966eb0217 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] [instance: a49437df-3059-4528-8328-2f3471d5fb45] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:30:57.478963 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-b8d7746a-16b7-419a-9606-90e966eb0217 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:30:57.479415 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-b8d7746a-16b7-419a-9606-90e966eb0217 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:30:57.480182 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-b8d7746a-16b7-419a-9606-90e966eb0217 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:30:57.480616 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-b8d7746a-16b7-419a-9606-90e966eb0217 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:30:57.510392 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-b8d7746a-16b7-419a-9606-90e966eb0217 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] 10.222.0.11 "GET /compute/v2.1/servers/a49437df-3059-4528-8328-2f3471d5fb45/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047427 Nov 17 03:30:57.510931 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 562/1093] 10.222.0.11 () {58 vars in 1301 bytes} [Wed Nov 17 03:30:57 2021] GET /compute/v2.1/servers/a49437df-3059-4528-8328-2f3471d5fb45/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 17 03:30:58.029780 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-5d8d37ef-c043-4b73-82df-4643b701bbe4 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:30:58.030768 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-5d8d37ef-c043-4b73-82df-4643b701bbe4 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] [instance: 5ddbfaaa-fabf-4324-941c-8868625ffefc] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:30:58.040155 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-5d8d37ef-c043-4b73-82df-4643b701bbe4 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:30:58.040597 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-5d8d37ef-c043-4b73-82df-4643b701bbe4 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:30:58.041394 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-5d8d37ef-c043-4b73-82df-4643b701bbe4 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:30:58.041826 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-5d8d37ef-c043-4b73-82df-4643b701bbe4 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:30:58.102075 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-2b5a1b7d-8ea6-492b-acda-0053b236ee61 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:30:58.103112 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-2b5a1b7d-8ea6-492b-acda-0053b236ee61 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] [instance: 5d54db85-b991-4890-abaa-952413baa2e7] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:30:58.109779 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-2b5a1b7d-8ea6-492b-acda-0053b236ee61 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:30:58.109924 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-5d8d37ef-c043-4b73-82df-4643b701bbe4 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80763e09d44c475ea2425b22874e9612', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fef02a1dd77946a2ac0e0414b557435f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:30:58.110228 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-2b5a1b7d-8ea6-492b-acda-0053b236ee61 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:30:58.111002 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-2b5a1b7d-8ea6-492b-acda-0053b236ee61 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:30:58.111433 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-2b5a1b7d-8ea6-492b-acda-0053b236ee61 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:30:58.118015 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-5d8d37ef-c043-4b73-82df-4643b701bbe4 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] 10.222.0.11 "GET /compute/v2.1/servers/5ddbfaaa-fabf-4324-941c-8868625ffefc" status: 200 len: 1226 microversion: 2.1 time: 0.094357 Nov 17 03:30:58.118571 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 532/1094] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:30:58 2021] GET /compute/v2.1/servers/5ddbfaaa-fabf-4324-941c-8868625ffefc => generated 1226 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:30:58.140793 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-2b5a1b7d-8ea6-492b-acda-0053b236ee61 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] 10.222.0.11 "GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042760 Nov 17 03:30:58.141387 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 563/1095] 10.222.0.11 () {60 vars in 1342 bytes} [Wed Nov 17 03:30:58 2021] GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 17 03:30:58.526660 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-ccfff78f-2fd0-49e0-8cab-5b50b9b7cbf4 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:30:58.528120 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-ccfff78f-2fd0-49e0-8cab-5b50b9b7cbf4 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] [instance: a49437df-3059-4528-8328-2f3471d5fb45] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:30:58.538967 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-ccfff78f-2fd0-49e0-8cab-5b50b9b7cbf4 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:30:58.539716 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-ccfff78f-2fd0-49e0-8cab-5b50b9b7cbf4 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:30:58.541016 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-ccfff78f-2fd0-49e0-8cab-5b50b9b7cbf4 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:30:58.541765 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-ccfff78f-2fd0-49e0-8cab-5b50b9b7cbf4 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:30:58.575940 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-ccfff78f-2fd0-49e0-8cab-5b50b9b7cbf4 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] 10.222.0.11 "GET /compute/v2.1/servers/a49437df-3059-4528-8328-2f3471d5fb45/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.056089 Nov 17 03:30:58.576484 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 533/1096] 10.222.0.11 () {58 vars in 1301 bytes} [Wed Nov 17 03:30:58 2021] GET /compute/v2.1/servers/a49437df-3059-4528-8328-2f3471d5fb45/os-volume_attachments => generated 197 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 17 03:30:59.140351 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-ab3398c9-99b4-45bc-9a1e-7a1845582b71 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:30:59.141417 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-ab3398c9-99b4-45bc-9a1e-7a1845582b71 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] [instance: 5ddbfaaa-fabf-4324-941c-8868625ffefc] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:30:59.150096 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-ab3398c9-99b4-45bc-9a1e-7a1845582b71 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:30:59.150542 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-ab3398c9-99b4-45bc-9a1e-7a1845582b71 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:30:59.151312 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-ab3398c9-99b4-45bc-9a1e-7a1845582b71 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:30:59.151740 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-ab3398c9-99b4-45bc-9a1e-7a1845582b71 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:30:59.152376 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-f7b9438f-e89f-45f7-9d7c-a06fa1c2cf95 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:30:59.153373 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-f7b9438f-e89f-45f7-9d7c-a06fa1c2cf95 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] [instance: 5d54db85-b991-4890-abaa-952413baa2e7] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:30:59.160030 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-f7b9438f-e89f-45f7-9d7c-a06fa1c2cf95 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:30:59.160483 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-f7b9438f-e89f-45f7-9d7c-a06fa1c2cf95 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:30:59.161335 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-f7b9438f-e89f-45f7-9d7c-a06fa1c2cf95 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:30:59.161769 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-f7b9438f-e89f-45f7-9d7c-a06fa1c2cf95 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:30:59.192029 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-f7b9438f-e89f-45f7-9d7c-a06fa1c2cf95 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] 10.222.0.11 "GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043392 Nov 17 03:30:59.192853 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 534/1097] 10.222.0.11 () {60 vars in 1342 bytes} [Wed Nov 17 03:30:59 2021] GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 17 03:30:59.212162 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-ab3398c9-99b4-45bc-9a1e-7a1845582b71 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80763e09d44c475ea2425b22874e9612', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fef02a1dd77946a2ac0e0414b557435f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:30:59.220175 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-ab3398c9-99b4-45bc-9a1e-7a1845582b71 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] 10.222.0.11 "GET /compute/v2.1/servers/5ddbfaaa-fabf-4324-941c-8868625ffefc" status: 200 len: 1226 microversion: 2.1 time: 0.086040 Nov 17 03:30:59.220718 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 564/1098] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:30:59 2021] GET /compute/v2.1/servers/5ddbfaaa-fabf-4324-941c-8868625ffefc => generated 1226 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:30:59.593043 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-a1489458-9b06-4fd6-af07-f2880d0ec202 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:30:59.594499 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-a1489458-9b06-4fd6-af07-f2880d0ec202 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] [instance: a49437df-3059-4528-8328-2f3471d5fb45] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:30:59.603372 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-a1489458-9b06-4fd6-af07-f2880d0ec202 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:30:59.603819 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-a1489458-9b06-4fd6-af07-f2880d0ec202 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:30:59.604622 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-a1489458-9b06-4fd6-af07-f2880d0ec202 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:30:59.605085 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-a1489458-9b06-4fd6-af07-f2880d0ec202 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:30:59.634856 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-a1489458-9b06-4fd6-af07-f2880d0ec202 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] 10.222.0.11 "GET /compute/v2.1/servers/a49437df-3059-4528-8328-2f3471d5fb45/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048165 Nov 17 03:30:59.635423 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 535/1099] 10.222.0.11 () {58 vars in 1301 bytes} [Wed Nov 17 03:30:59 2021] GET /compute/v2.1/servers/a49437df-3059-4528-8328-2f3471d5fb45/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 17 03:31:00.208046 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-0851a8db-1e95-4ff0-8171-9c8a0ae9ff4a tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:31:00.209499 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-0851a8db-1e95-4ff0-8171-9c8a0ae9ff4a tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] [instance: 5d54db85-b991-4890-abaa-952413baa2e7] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:31:00.216463 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-0851a8db-1e95-4ff0-8171-9c8a0ae9ff4a tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:31:00.216963 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-0851a8db-1e95-4ff0-8171-9c8a0ae9ff4a tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:31:00.217767 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-0851a8db-1e95-4ff0-8171-9c8a0ae9ff4a tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:31:00.218220 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-0851a8db-1e95-4ff0-8171-9c8a0ae9ff4a tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:31:00.237534 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-f0fb1360-096d-4e44-9161-7c81efba4f6a tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:31:00.238140 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-f0fb1360-096d-4e44-9161-7c81efba4f6a tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] [instance: 5ddbfaaa-fabf-4324-941c-8868625ffefc] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:31:00.245845 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-f0fb1360-096d-4e44-9161-7c81efba4f6a tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:31:00.246285 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-f0fb1360-096d-4e44-9161-7c81efba4f6a tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:31:00.247062 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-f0fb1360-096d-4e44-9161-7c81efba4f6a tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:31:00.247492 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-f0fb1360-096d-4e44-9161-7c81efba4f6a tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:31:00.250135 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-0851a8db-1e95-4ff0-8171-9c8a0ae9ff4a tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] 10.222.0.11 "GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.048542 Nov 17 03:31:00.250716 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 565/1100] 10.222.0.11 () {60 vars in 1342 bytes} [Wed Nov 17 03:31:00 2021] GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 17 03:31:00.306629 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-f0fb1360-096d-4e44-9161-7c81efba4f6a tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80763e09d44c475ea2425b22874e9612', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fef02a1dd77946a2ac0e0414b557435f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:31:00.314124 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-f0fb1360-096d-4e44-9161-7c81efba4f6a tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] 10.222.0.11 "GET /compute/v2.1/servers/5ddbfaaa-fabf-4324-941c-8868625ffefc" status: 200 len: 1226 microversion: 2.1 time: 0.080341 Nov 17 03:31:00.314626 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 536/1101] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:31:00 2021] GET /compute/v2.1/servers/5ddbfaaa-fabf-4324-941c-8868625ffefc => generated 1226 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:31:00.652648 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-3a0f6e70-551c-4d0f-8454-6075b98ae2a1 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:31:00.654026 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-3a0f6e70-551c-4d0f-8454-6075b98ae2a1 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] [instance: a49437df-3059-4528-8328-2f3471d5fb45] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:31:00.663446 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-3a0f6e70-551c-4d0f-8454-6075b98ae2a1 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:31:00.663883 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-3a0f6e70-551c-4d0f-8454-6075b98ae2a1 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:31:00.664650 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-3a0f6e70-551c-4d0f-8454-6075b98ae2a1 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:31:00.665110 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-3a0f6e70-551c-4d0f-8454-6075b98ae2a1 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:31:00.693793 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-3a0f6e70-551c-4d0f-8454-6075b98ae2a1 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] 10.222.0.11 "GET /compute/v2.1/servers/a49437df-3059-4528-8328-2f3471d5fb45/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047891 Nov 17 03:31:00.694328 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 566/1102] 10.222.0.11 () {58 vars in 1301 bytes} [Wed Nov 17 03:31:00 2021] GET /compute/v2.1/servers/a49437df-3059-4528-8328-2f3471d5fb45/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 17 03:31:01.266192 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-4e0fc4fc-e515-4b32-9797-4294c8ce7b64 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:31:01.267664 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-4e0fc4fc-e515-4b32-9797-4294c8ce7b64 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] [instance: 5d54db85-b991-4890-abaa-952413baa2e7] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:31:01.275941 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-4e0fc4fc-e515-4b32-9797-4294c8ce7b64 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:31:01.276392 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-4e0fc4fc-e515-4b32-9797-4294c8ce7b64 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:31:01.277204 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-4e0fc4fc-e515-4b32-9797-4294c8ce7b64 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:31:01.277635 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-4e0fc4fc-e515-4b32-9797-4294c8ce7b64 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:31:01.306923 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-4e0fc4fc-e515-4b32-9797-4294c8ce7b64 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] 10.222.0.11 "GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047170 Nov 17 03:31:01.307489 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 537/1103] 10.222.0.11 () {60 vars in 1342 bytes} [Wed Nov 17 03:31:01 2021] GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 17 03:31:01.333524 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-2281c419-adb1-40fa-8a25-46f07783be08 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:31:01.334310 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-2281c419-adb1-40fa-8a25-46f07783be08 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] [instance: 5ddbfaaa-fabf-4324-941c-8868625ffefc] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:31:01.340709 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-2281c419-adb1-40fa-8a25-46f07783be08 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:31:01.341186 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-2281c419-adb1-40fa-8a25-46f07783be08 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:31:01.341948 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-2281c419-adb1-40fa-8a25-46f07783be08 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:31:01.342378 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-2281c419-adb1-40fa-8a25-46f07783be08 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:31:01.413468 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-2281c419-adb1-40fa-8a25-46f07783be08 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80763e09d44c475ea2425b22874e9612', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fef02a1dd77946a2ac0e0414b557435f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:31:01.421638 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-2281c419-adb1-40fa-8a25-46f07783be08 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] 10.222.0.11 "GET /compute/v2.1/servers/5ddbfaaa-fabf-4324-941c-8868625ffefc" status: 200 len: 1226 microversion: 2.1 time: 0.094096 Nov 17 03:31:01.422215 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 567/1104] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:31:01 2021] GET /compute/v2.1/servers/5ddbfaaa-fabf-4324-941c-8868625ffefc => generated 1226 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:31:01.705857 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-8fb8c501-782b-49a2-bf52-797a87538393 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:31:01.706760 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-8fb8c501-782b-49a2-bf52-797a87538393 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] [instance: a49437df-3059-4528-8328-2f3471d5fb45] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:31:01.713332 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-8fb8c501-782b-49a2-bf52-797a87538393 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:31:01.713776 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-8fb8c501-782b-49a2-bf52-797a87538393 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:31:01.714542 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-8fb8c501-782b-49a2-bf52-797a87538393 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:31:01.714971 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-8fb8c501-782b-49a2-bf52-797a87538393 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:31:01.752233 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-8fb8c501-782b-49a2-bf52-797a87538393 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] 10.222.0.11 "GET /compute/v2.1/servers/a49437df-3059-4528-8328-2f3471d5fb45/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050171 Nov 17 03:31:01.752908 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 538/1105] 10.222.0.11 () {58 vars in 1301 bytes} [Wed Nov 17 03:31:01 2021] GET /compute/v2.1/servers/a49437df-3059-4528-8328-2f3471d5fb45/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 17 03:31:02.321566 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-2c06e1d1-4aea-473c-98a3-ab5e6ed43615 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:31:02.322574 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-2c06e1d1-4aea-473c-98a3-ab5e6ed43615 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] [instance: 5d54db85-b991-4890-abaa-952413baa2e7] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:31:02.330593 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-2c06e1d1-4aea-473c-98a3-ab5e6ed43615 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:31:02.331147 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-2c06e1d1-4aea-473c-98a3-ab5e6ed43615 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:31:02.332093 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-2c06e1d1-4aea-473c-98a3-ab5e6ed43615 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:31:02.332622 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-2c06e1d1-4aea-473c-98a3-ab5e6ed43615 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:31:02.365274 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-2c06e1d1-4aea-473c-98a3-ab5e6ed43615 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] 10.222.0.11 "GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.049596 Nov 17 03:31:02.365958 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 568/1106] 10.222.0.11 () {60 vars in 1342 bytes} [Wed Nov 17 03:31:02 2021] GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 17 03:31:02.444617 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-fd922d27-7537-4685-b853-5e737ebf5754 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:31:02.445285 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-fd922d27-7537-4685-b853-5e737ebf5754 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] [instance: 5ddbfaaa-fabf-4324-941c-8868625ffefc] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:31:02.452378 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-fd922d27-7537-4685-b853-5e737ebf5754 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:31:02.452817 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-fd922d27-7537-4685-b853-5e737ebf5754 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:31:02.453749 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-fd922d27-7537-4685-b853-5e737ebf5754 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:31:02.454218 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-fd922d27-7537-4685-b853-5e737ebf5754 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:31:02.519289 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-fd922d27-7537-4685-b853-5e737ebf5754 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80763e09d44c475ea2425b22874e9612', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fef02a1dd77946a2ac0e0414b557435f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:31:02.529453 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-fd922d27-7537-4685-b853-5e737ebf5754 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] 10.222.0.11 "GET /compute/v2.1/servers/5ddbfaaa-fabf-4324-941c-8868625ffefc" status: 200 len: 1226 microversion: 2.1 time: 0.090293 Nov 17 03:31:02.530327 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 539/1107] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:31:02 2021] GET /compute/v2.1/servers/5ddbfaaa-fabf-4324-941c-8868625ffefc => generated 1226 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:31:02.769270 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-8e8c3e03-004a-4d20-9c7e-9e14d8690c52 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:31:02.770734 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-8e8c3e03-004a-4d20-9c7e-9e14d8690c52 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] [instance: a49437df-3059-4528-8328-2f3471d5fb45] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:31:02.777557 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-8e8c3e03-004a-4d20-9c7e-9e14d8690c52 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:31:02.778005 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-8e8c3e03-004a-4d20-9c7e-9e14d8690c52 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:31:02.778771 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-8e8c3e03-004a-4d20-9c7e-9e14d8690c52 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:31:02.779203 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-8e8c3e03-004a-4d20-9c7e-9e14d8690c52 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:31:02.809565 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-8e8c3e03-004a-4d20-9c7e-9e14d8690c52 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] 10.222.0.11 "GET /compute/v2.1/servers/a49437df-3059-4528-8328-2f3471d5fb45/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046668 Nov 17 03:31:02.810102 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 569/1108] 10.222.0.11 () {58 vars in 1301 bytes} [Wed Nov 17 03:31:02 2021] GET /compute/v2.1/servers/a49437df-3059-4528-8328-2f3471d5fb45/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 17 03:31:03.381374 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-861428e6-0557-4814-966b-3c70ed53b021 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:31:03.383294 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-861428e6-0557-4814-966b-3c70ed53b021 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] [instance: 5d54db85-b991-4890-abaa-952413baa2e7] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:31:03.398166 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-861428e6-0557-4814-966b-3c70ed53b021 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:31:03.398630 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-861428e6-0557-4814-966b-3c70ed53b021 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:31:03.399415 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-861428e6-0557-4814-966b-3c70ed53b021 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:31:03.399850 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-861428e6-0557-4814-966b-3c70ed53b021 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:31:03.429694 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-861428e6-0557-4814-966b-3c70ed53b021 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] 10.222.0.11 "GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.054974 Nov 17 03:31:03.430263 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 540/1109] 10.222.0.11 () {60 vars in 1342 bytes} [Wed Nov 17 03:31:03 2021] GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7/os-volume_attachments => generated 197 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 17 03:31:03.550317 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-fd0febfd-bddc-4af2-bb27-a5c81491cfe5 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:31:03.551386 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-fd0febfd-bddc-4af2-bb27-a5c81491cfe5 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] [instance: 5ddbfaaa-fabf-4324-941c-8868625ffefc] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:31:03.559128 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-fd0febfd-bddc-4af2-bb27-a5c81491cfe5 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:31:03.559574 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-fd0febfd-bddc-4af2-bb27-a5c81491cfe5 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:31:03.560342 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-fd0febfd-bddc-4af2-bb27-a5c81491cfe5 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:31:03.560820 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-fd0febfd-bddc-4af2-bb27-a5c81491cfe5 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:31:03.628304 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-fd0febfd-bddc-4af2-bb27-a5c81491cfe5 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80763e09d44c475ea2425b22874e9612', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fef02a1dd77946a2ac0e0414b557435f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:31:03.635871 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-fd0febfd-bddc-4af2-bb27-a5c81491cfe5 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] 10.222.0.11 "GET /compute/v2.1/servers/5ddbfaaa-fabf-4324-941c-8868625ffefc" status: 200 len: 1226 microversion: 2.1 time: 0.091803 Nov 17 03:31:03.636338 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 570/1110] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:31:03 2021] GET /compute/v2.1/servers/5ddbfaaa-fabf-4324-941c-8868625ffefc => generated 1226 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:31:03.826683 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-e653ce33-393b-4950-a2c1-bc915c08df29 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:31:03.828370 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-e653ce33-393b-4950-a2c1-bc915c08df29 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] [instance: a49437df-3059-4528-8328-2f3471d5fb45] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:31:03.837479 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-e653ce33-393b-4950-a2c1-bc915c08df29 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:31:03.837924 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-e653ce33-393b-4950-a2c1-bc915c08df29 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:31:03.838712 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-e653ce33-393b-4950-a2c1-bc915c08df29 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:31:03.839144 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-e653ce33-393b-4950-a2c1-bc915c08df29 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:31:03.868459 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-e653ce33-393b-4950-a2c1-bc915c08df29 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] 10.222.0.11 "GET /compute/v2.1/servers/a49437df-3059-4528-8328-2f3471d5fb45/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048121 Nov 17 03:31:03.869049 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 541/1111] 10.222.0.11 () {58 vars in 1301 bytes} [Wed Nov 17 03:31:03 2021] GET /compute/v2.1/servers/a49437df-3059-4528-8328-2f3471d5fb45/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 17 03:31:04.445615 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-b84969da-0a04-405f-b403-089bd99d4d73 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:31:04.446929 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-b84969da-0a04-405f-b403-089bd99d4d73 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] [instance: 5d54db85-b991-4890-abaa-952413baa2e7] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:31:04.457071 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-b84969da-0a04-405f-b403-089bd99d4d73 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:31:04.457802 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-b84969da-0a04-405f-b403-089bd99d4d73 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:31:04.459086 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-b84969da-0a04-405f-b403-089bd99d4d73 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:31:04.459619 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-b84969da-0a04-405f-b403-089bd99d4d73 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:31:04.490549 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-b84969da-0a04-405f-b403-089bd99d4d73 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] 10.222.0.11 "GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.051519 Nov 17 03:31:04.491106 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 571/1112] 10.222.0.11 () {60 vars in 1342 bytes} [Wed Nov 17 03:31:04 2021] GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 17 03:31:04.656741 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-51601254-e985-4810-a4a1-491043e48867 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:31:04.657785 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-51601254-e985-4810-a4a1-491043e48867 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] [instance: 5ddbfaaa-fabf-4324-941c-8868625ffefc] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:31:04.667942 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-51601254-e985-4810-a4a1-491043e48867 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:31:04.668665 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-51601254-e985-4810-a4a1-491043e48867 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:31:04.670014 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-51601254-e985-4810-a4a1-491043e48867 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:31:04.670731 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-51601254-e985-4810-a4a1-491043e48867 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:31:04.734750 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-51601254-e985-4810-a4a1-491043e48867 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80763e09d44c475ea2425b22874e9612', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fef02a1dd77946a2ac0e0414b557435f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:31:04.743161 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-51601254-e985-4810-a4a1-491043e48867 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] 10.222.0.11 "GET /compute/v2.1/servers/5ddbfaaa-fabf-4324-941c-8868625ffefc" status: 200 len: 1226 microversion: 2.1 time: 0.092804 Nov 17 03:31:04.743734 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 542/1113] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:31:04 2021] GET /compute/v2.1/servers/5ddbfaaa-fabf-4324-941c-8868625ffefc => generated 1226 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:31:04.879739 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-c1db79e7-7ac6-4d26-b6ea-640178a8e382 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:31:04.880695 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-c1db79e7-7ac6-4d26-b6ea-640178a8e382 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] [instance: a49437df-3059-4528-8328-2f3471d5fb45] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:31:04.887894 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-c1db79e7-7ac6-4d26-b6ea-640178a8e382 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:31:04.888370 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-c1db79e7-7ac6-4d26-b6ea-640178a8e382 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:31:04.889215 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-c1db79e7-7ac6-4d26-b6ea-640178a8e382 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:31:04.889676 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-c1db79e7-7ac6-4d26-b6ea-640178a8e382 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:31:04.921383 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-c1db79e7-7ac6-4d26-b6ea-640178a8e382 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] 10.222.0.11 "GET /compute/v2.1/servers/a49437df-3059-4528-8328-2f3471d5fb45/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045680 Nov 17 03:31:04.921936 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 572/1114] 10.222.0.11 () {58 vars in 1301 bytes} [Wed Nov 17 03:31:04 2021] GET /compute/v2.1/servers/a49437df-3059-4528-8328-2f3471d5fb45/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 17 03:31:05.505790 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-c79efb79-4b7b-457b-bee4-091921176251 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:31:05.507278 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-c79efb79-4b7b-457b-bee4-091921176251 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] [instance: 5d54db85-b991-4890-abaa-952413baa2e7] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:31:05.514074 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-c79efb79-4b7b-457b-bee4-091921176251 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:31:05.514529 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-c79efb79-4b7b-457b-bee4-091921176251 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:31:05.515309 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-c79efb79-4b7b-457b-bee4-091921176251 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:31:05.515743 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-c79efb79-4b7b-457b-bee4-091921176251 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:31:05.544810 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-c79efb79-4b7b-457b-bee4-091921176251 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] 10.222.0.11 "GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045631 Nov 17 03:31:05.545504 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 543/1115] 10.222.0.11 () {60 vars in 1342 bytes} [Wed Nov 17 03:31:05 2021] GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 17 03:31:05.760901 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-f8f5dd6b-0527-4b20-b916-18b62fdc91be tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:31:05.761454 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-f8f5dd6b-0527-4b20-b916-18b62fdc91be tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] [instance: 5ddbfaaa-fabf-4324-941c-8868625ffefc] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:31:05.767891 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-f8f5dd6b-0527-4b20-b916-18b62fdc91be tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:31:05.768345 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-f8f5dd6b-0527-4b20-b916-18b62fdc91be tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:31:05.769148 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-f8f5dd6b-0527-4b20-b916-18b62fdc91be tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:31:05.769577 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-f8f5dd6b-0527-4b20-b916-18b62fdc91be tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:31:05.844995 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-f8f5dd6b-0527-4b20-b916-18b62fdc91be tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80763e09d44c475ea2425b22874e9612', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fef02a1dd77946a2ac0e0414b557435f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:31:05.853291 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-f8f5dd6b-0527-4b20-b916-18b62fdc91be tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] 10.222.0.11 "GET /compute/v2.1/servers/5ddbfaaa-fabf-4324-941c-8868625ffefc" status: 200 len: 1226 microversion: 2.1 time: 0.096627 Nov 17 03:31:05.853896 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 573/1116] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:31:05 2021] GET /compute/v2.1/servers/5ddbfaaa-fabf-4324-941c-8868625ffefc => generated 1226 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:31:05.937900 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-149598c1-5d1f-4ab0-8270-176e903158f6 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:31:05.939350 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-149598c1-5d1f-4ab0-8270-176e903158f6 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] [instance: a49437df-3059-4528-8328-2f3471d5fb45] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:31:05.949813 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-149598c1-5d1f-4ab0-8270-176e903158f6 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:31:05.950589 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-149598c1-5d1f-4ab0-8270-176e903158f6 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:31:05.951879 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-149598c1-5d1f-4ab0-8270-176e903158f6 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:31:05.952661 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-149598c1-5d1f-4ab0-8270-176e903158f6 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:31:05.985440 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-149598c1-5d1f-4ab0-8270-176e903158f6 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] 10.222.0.11 "GET /compute/v2.1/servers/a49437df-3059-4528-8328-2f3471d5fb45/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.054545 Nov 17 03:31:05.985982 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 544/1117] 10.222.0.11 () {58 vars in 1301 bytes} [Wed Nov 17 03:31:05 2021] GET /compute/v2.1/servers/a49437df-3059-4528-8328-2f3471d5fb45/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 17 03:31:06.563144 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-26e31915-5e36-4e01-8710-4ba5adaf8872 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:31:06.564597 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-26e31915-5e36-4e01-8710-4ba5adaf8872 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] [instance: 5d54db85-b991-4890-abaa-952413baa2e7] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:31:06.573338 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-26e31915-5e36-4e01-8710-4ba5adaf8872 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:31:06.573793 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-26e31915-5e36-4e01-8710-4ba5adaf8872 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:31:06.574618 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-26e31915-5e36-4e01-8710-4ba5adaf8872 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:31:06.575044 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-26e31915-5e36-4e01-8710-4ba5adaf8872 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:31:06.604769 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-26e31915-5e36-4e01-8710-4ba5adaf8872 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] 10.222.0.11 "GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047936 Nov 17 03:31:06.605342 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 574/1118] 10.222.0.11 () {60 vars in 1342 bytes} [Wed Nov 17 03:31:06 2021] GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 17 03:31:06.872427 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-d88fcc80-bef0-4e88-a9ce-a7fa2637479e tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:31:06.873176 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-d88fcc80-bef0-4e88-a9ce-a7fa2637479e tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] [instance: 5ddbfaaa-fabf-4324-941c-8868625ffefc] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:31:06.882028 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-d88fcc80-bef0-4e88-a9ce-a7fa2637479e tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:31:06.882607 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-d88fcc80-bef0-4e88-a9ce-a7fa2637479e tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:31:06.883707 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-d88fcc80-bef0-4e88-a9ce-a7fa2637479e tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:31:06.884292 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-d88fcc80-bef0-4e88-a9ce-a7fa2637479e tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:31:06.951407 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-d88fcc80-bef0-4e88-a9ce-a7fa2637479e tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80763e09d44c475ea2425b22874e9612', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fef02a1dd77946a2ac0e0414b557435f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:31:06.959335 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-d88fcc80-bef0-4e88-a9ce-a7fa2637479e tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] 10.222.0.11 "GET /compute/v2.1/servers/5ddbfaaa-fabf-4324-941c-8868625ffefc" status: 200 len: 1226 microversion: 2.1 time: 0.092060 Nov 17 03:31:06.959927 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 545/1119] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:31:06 2021] GET /compute/v2.1/servers/5ddbfaaa-fabf-4324-941c-8868625ffefc => generated 1226 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:31:06.997796 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-a38c8801-6d14-4a04-ad66-0e59a05767ad tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:31:06.998707 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-a38c8801-6d14-4a04-ad66-0e59a05767ad tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] [instance: a49437df-3059-4528-8328-2f3471d5fb45] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:31:07.005099 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-a38c8801-6d14-4a04-ad66-0e59a05767ad tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:31:07.005570 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-a38c8801-6d14-4a04-ad66-0e59a05767ad tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:31:07.006335 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-a38c8801-6d14-4a04-ad66-0e59a05767ad tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:31:07.006762 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-a38c8801-6d14-4a04-ad66-0e59a05767ad tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:31:07.037719 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-a38c8801-6d14-4a04-ad66-0e59a05767ad tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] 10.222.0.11 "GET /compute/v2.1/servers/a49437df-3059-4528-8328-2f3471d5fb45/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043648 Nov 17 03:31:07.038260 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 575/1120] 10.222.0.11 () {58 vars in 1301 bytes} [Wed Nov 17 03:31:06 2021] GET /compute/v2.1/servers/a49437df-3059-4528-8328-2f3471d5fb45/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 17 03:31:07.619943 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-61393a81-6f30-4c30-8ba1-af93a20933c9 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:31:07.620887 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-61393a81-6f30-4c30-8ba1-af93a20933c9 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] [instance: 5d54db85-b991-4890-abaa-952413baa2e7] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:31:07.627318 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-61393a81-6f30-4c30-8ba1-af93a20933c9 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:31:07.627771 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-61393a81-6f30-4c30-8ba1-af93a20933c9 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:31:07.628545 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-61393a81-6f30-4c30-8ba1-af93a20933c9 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:31:07.629010 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-61393a81-6f30-4c30-8ba1-af93a20933c9 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:31:07.662160 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-61393a81-6f30-4c30-8ba1-af93a20933c9 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] 10.222.0.11 "GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047745 Nov 17 03:31:07.662927 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 546/1121] 10.222.0.11 () {60 vars in 1342 bytes} [Wed Nov 17 03:31:07 2021] GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 17 03:31:07.985223 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-2821b72b-9a7d-4bd0-a118-43c28c5cceed tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:31:07.986081 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-2821b72b-9a7d-4bd0-a118-43c28c5cceed tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] [instance: 5ddbfaaa-fabf-4324-941c-8868625ffefc] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:31:07.996648 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-2821b72b-9a7d-4bd0-a118-43c28c5cceed tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:31:07.997435 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-2821b72b-9a7d-4bd0-a118-43c28c5cceed tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:31:07.998694 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-2821b72b-9a7d-4bd0-a118-43c28c5cceed tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:31:07.999417 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-2821b72b-9a7d-4bd0-a118-43c28c5cceed tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:31:08.051054 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-5d835a48-7144-4a36-8bbf-17038d3d21f8 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:31:08.052114 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-5d835a48-7144-4a36-8bbf-17038d3d21f8 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] [instance: a49437df-3059-4528-8328-2f3471d5fb45] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:31:08.061527 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-5d835a48-7144-4a36-8bbf-17038d3d21f8 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:31:08.061993 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-5d835a48-7144-4a36-8bbf-17038d3d21f8 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:31:08.062817 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-5d835a48-7144-4a36-8bbf-17038d3d21f8 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:31:08.063254 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-5d835a48-7144-4a36-8bbf-17038d3d21f8 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:31:08.063489 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-2821b72b-9a7d-4bd0-a118-43c28c5cceed tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80763e09d44c475ea2425b22874e9612', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fef02a1dd77946a2ac0e0414b557435f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:31:08.072352 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-2821b72b-9a7d-4bd0-a118-43c28c5cceed tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] 10.222.0.11 "GET /compute/v2.1/servers/5ddbfaaa-fabf-4324-941c-8868625ffefc" status: 200 len: 1226 microversion: 2.1 time: 0.093331 Nov 17 03:31:08.072944 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 576/1122] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:31:07 2021] GET /compute/v2.1/servers/5ddbfaaa-fabf-4324-941c-8868625ffefc => generated 1226 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:31:08.098382 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-5d835a48-7144-4a36-8bbf-17038d3d21f8 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] 10.222.0.11 "GET /compute/v2.1/servers/a49437df-3059-4528-8328-2f3471d5fb45/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051461 Nov 17 03:31:08.098950 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 547/1123] 10.222.0.11 () {58 vars in 1301 bytes} [Wed Nov 17 03:31:08 2021] GET /compute/v2.1/servers/a49437df-3059-4528-8328-2f3471d5fb45/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 17 03:31:08.678747 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-02497aac-75a9-4f3d-a2cc-23c59e149033 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:31:08.680269 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-02497aac-75a9-4f3d-a2cc-23c59e149033 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] [instance: 5d54db85-b991-4890-abaa-952413baa2e7] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:31:08.690850 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-02497aac-75a9-4f3d-a2cc-23c59e149033 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:31:08.691615 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-02497aac-75a9-4f3d-a2cc-23c59e149033 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:31:08.692971 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-02497aac-75a9-4f3d-a2cc-23c59e149033 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:31:08.693701 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-02497aac-75a9-4f3d-a2cc-23c59e149033 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:31:08.724121 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-02497aac-75a9-4f3d-a2cc-23c59e149033 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] 10.222.0.11 "GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.051815 Nov 17 03:31:08.724669 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 577/1124] 10.222.0.11 () {60 vars in 1342 bytes} [Wed Nov 17 03:31:08 2021] GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 17 03:31:09.090004 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-9bf30d3e-c2ce-4607-8cbf-fae67f783a0f tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:31:09.090591 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-9bf30d3e-c2ce-4607-8cbf-fae67f783a0f tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] [instance: 5ddbfaaa-fabf-4324-941c-8868625ffefc] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:31:09.097293 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-9bf30d3e-c2ce-4607-8cbf-fae67f783a0f tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:31:09.097736 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-9bf30d3e-c2ce-4607-8cbf-fae67f783a0f tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:31:09.098501 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-9bf30d3e-c2ce-4607-8cbf-fae67f783a0f tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:31:09.098930 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-9bf30d3e-c2ce-4607-8cbf-fae67f783a0f tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:31:09.110520 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-b7d97798-798a-4be5-b893-5ae41dff3638 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:31:09.111560 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-b7d97798-798a-4be5-b893-5ae41dff3638 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] [instance: a49437df-3059-4528-8328-2f3471d5fb45] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:31:09.118187 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-b7d97798-798a-4be5-b893-5ae41dff3638 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:31:09.118633 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-b7d97798-798a-4be5-b893-5ae41dff3638 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:31:09.119406 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-b7d97798-798a-4be5-b893-5ae41dff3638 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:31:09.119857 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-b7d97798-798a-4be5-b893-5ae41dff3638 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:31:09.150476 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-b7d97798-798a-4be5-b893-5ae41dff3638 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] 10.222.0.11 "GET /compute/v2.1/servers/a49437df-3059-4528-8328-2f3471d5fb45/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043677 Nov 17 03:31:09.151080 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 578/1125] 10.222.0.11 () {58 vars in 1301 bytes} [Wed Nov 17 03:31:09 2021] GET /compute/v2.1/servers/a49437df-3059-4528-8328-2f3471d5fb45/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 17 03:31:09.158269 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-9bf30d3e-c2ce-4607-8cbf-fae67f783a0f tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80763e09d44c475ea2425b22874e9612', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fef02a1dd77946a2ac0e0414b557435f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:31:09.165942 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-9bf30d3e-c2ce-4607-8cbf-fae67f783a0f tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] 10.222.0.11 "GET /compute/v2.1/servers/5ddbfaaa-fabf-4324-941c-8868625ffefc" status: 200 len: 1226 microversion: 2.1 time: 0.079637 Nov 17 03:31:09.166497 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 548/1126] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:31:09 2021] GET /compute/v2.1/servers/5ddbfaaa-fabf-4324-941c-8868625ffefc => generated 1226 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:31:09.740289 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-f6806b37-d499-42cd-acdc-71f6c8322f26 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:31:09.741916 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-f6806b37-d499-42cd-acdc-71f6c8322f26 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] [instance: 5d54db85-b991-4890-abaa-952413baa2e7] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:31:09.748439 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-f6806b37-d499-42cd-acdc-71f6c8322f26 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:31:09.748921 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-f6806b37-d499-42cd-acdc-71f6c8322f26 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:31:09.749698 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-f6806b37-d499-42cd-acdc-71f6c8322f26 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:31:09.750130 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-f6806b37-d499-42cd-acdc-71f6c8322f26 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:31:09.780221 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-f6806b37-d499-42cd-acdc-71f6c8322f26 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] 10.222.0.11 "GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046432 Nov 17 03:31:09.780799 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 579/1127] 10.222.0.11 () {60 vars in 1342 bytes} [Wed Nov 17 03:31:09 2021] GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 17 03:31:10.164934 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-d70532e3-3667-4f0b-975a-6d1a6735f73e tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:31:10.165841 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-d70532e3-3667-4f0b-975a-6d1a6735f73e tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] [instance: a49437df-3059-4528-8328-2f3471d5fb45] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:31:10.172874 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-d70532e3-3667-4f0b-975a-6d1a6735f73e tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:31:10.173319 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-d70532e3-3667-4f0b-975a-6d1a6735f73e tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:31:10.174084 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-d70532e3-3667-4f0b-975a-6d1a6735f73e tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:31:10.174493 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-d70532e3-3667-4f0b-975a-6d1a6735f73e tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:31:10.182973 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-81a923e6-d84d-457f-84a2-f5bc64485952 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:31:10.183598 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-81a923e6-d84d-457f-84a2-f5bc64485952 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] [instance: 5ddbfaaa-fabf-4324-941c-8868625ffefc] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:31:10.190149 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-81a923e6-d84d-457f-84a2-f5bc64485952 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:31:10.190590 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-81a923e6-d84d-457f-84a2-f5bc64485952 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:31:10.191362 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-81a923e6-d84d-457f-84a2-f5bc64485952 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:31:10.191791 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-81a923e6-d84d-457f-84a2-f5bc64485952 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:31:10.205218 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-d70532e3-3667-4f0b-975a-6d1a6735f73e tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] 10.222.0.11 "GET /compute/v2.1/servers/a49437df-3059-4528-8328-2f3471d5fb45/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045597 Nov 17 03:31:10.205749 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 549/1128] 10.222.0.11 () {58 vars in 1301 bytes} [Wed Nov 17 03:31:10 2021] GET /compute/v2.1/servers/a49437df-3059-4528-8328-2f3471d5fb45/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 17 03:31:10.253343 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-81a923e6-d84d-457f-84a2-f5bc64485952 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80763e09d44c475ea2425b22874e9612', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fef02a1dd77946a2ac0e0414b557435f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:31:10.260938 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-81a923e6-d84d-457f-84a2-f5bc64485952 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] 10.222.0.11 "GET /compute/v2.1/servers/5ddbfaaa-fabf-4324-941c-8868625ffefc" status: 200 len: 1226 microversion: 2.1 time: 0.082264 Nov 17 03:31:10.261507 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 580/1129] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:31:10 2021] GET /compute/v2.1/servers/5ddbfaaa-fabf-4324-941c-8868625ffefc => generated 1226 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:31:10.793933 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-69e605a6-d040-495e-bd52-646894a17986 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:31:10.795184 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-69e605a6-d040-495e-bd52-646894a17986 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] [instance: 5d54db85-b991-4890-abaa-952413baa2e7] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:31:10.803964 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-69e605a6-d040-495e-bd52-646894a17986 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:31:10.805118 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-69e605a6-d040-495e-bd52-646894a17986 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:31:10.806590 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-69e605a6-d040-495e-bd52-646894a17986 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:31:10.807202 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-69e605a6-d040-495e-bd52-646894a17986 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:31:10.842537 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-69e605a6-d040-495e-bd52-646894a17986 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] 10.222.0.11 "GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.054158 Nov 17 03:31:10.843107 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 550/1130] 10.222.0.11 () {60 vars in 1342 bytes} [Wed Nov 17 03:31:10 2021] GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 17 03:31:11.221478 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-c2706063-0f0f-4f13-bb23-ac9b849054f3 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:31:11.222986 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-c2706063-0f0f-4f13-bb23-ac9b849054f3 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] [instance: a49437df-3059-4528-8328-2f3471d5fb45] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:31:11.234081 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-c2706063-0f0f-4f13-bb23-ac9b849054f3 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:31:11.234818 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-c2706063-0f0f-4f13-bb23-ac9b849054f3 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:31:11.236059 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-c2706063-0f0f-4f13-bb23-ac9b849054f3 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:31:11.236766 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-c2706063-0f0f-4f13-bb23-ac9b849054f3 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:31:11.269714 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-c2706063-0f0f-4f13-bb23-ac9b849054f3 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] 10.222.0.11 "GET /compute/v2.1/servers/a49437df-3059-4528-8328-2f3471d5fb45/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.054280 Nov 17 03:31:11.270480 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 581/1131] 10.222.0.11 () {58 vars in 1301 bytes} [Wed Nov 17 03:31:11 2021] GET /compute/v2.1/servers/a49437df-3059-4528-8328-2f3471d5fb45/os-volume_attachments => generated 197 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 17 03:31:11.278196 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-19bc0f0c-e840-4710-8002-614da257135c tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:31:11.278796 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-19bc0f0c-e840-4710-8002-614da257135c tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] [instance: 5ddbfaaa-fabf-4324-941c-8868625ffefc] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:31:11.285115 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-19bc0f0c-e840-4710-8002-614da257135c tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:31:11.285557 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-19bc0f0c-e840-4710-8002-614da257135c tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:31:11.286307 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-19bc0f0c-e840-4710-8002-614da257135c tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:31:11.286743 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-19bc0f0c-e840-4710-8002-614da257135c tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:31:11.353365 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-19bc0f0c-e840-4710-8002-614da257135c tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80763e09d44c475ea2425b22874e9612', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fef02a1dd77946a2ac0e0414b557435f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:31:11.361065 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-19bc0f0c-e840-4710-8002-614da257135c tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] 10.222.0.11 "GET /compute/v2.1/servers/5ddbfaaa-fabf-4324-941c-8868625ffefc" status: 200 len: 1226 microversion: 2.1 time: 0.086627 Nov 17 03:31:11.361650 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 551/1132] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:31:11 2021] GET /compute/v2.1/servers/5ddbfaaa-fabf-4324-941c-8868625ffefc => generated 1226 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:31:11.855958 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-9548d929-a883-4784-b8cf-3372e0bf2506 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:31:11.857011 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-9548d929-a883-4784-b8cf-3372e0bf2506 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] [instance: 5d54db85-b991-4890-abaa-952413baa2e7] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:31:11.863458 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-9548d929-a883-4784-b8cf-3372e0bf2506 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:31:11.863901 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-9548d929-a883-4784-b8cf-3372e0bf2506 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:31:11.864667 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-9548d929-a883-4784-b8cf-3372e0bf2506 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:31:11.865136 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-9548d929-a883-4784-b8cf-3372e0bf2506 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:31:11.894946 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-9548d929-a883-4784-b8cf-3372e0bf2506 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] 10.222.0.11 "GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043029 Nov 17 03:31:11.899102 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 582/1133] 10.222.0.11 () {60 vars in 1342 bytes} [Wed Nov 17 03:31:11 2021] GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 17 03:31:12.286058 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-e06dfa29-a9aa-4ad8-a4ab-7b757be536af tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:31:12.287551 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-e06dfa29-a9aa-4ad8-a4ab-7b757be536af tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] [instance: a49437df-3059-4528-8328-2f3471d5fb45] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:31:12.295096 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-e06dfa29-a9aa-4ad8-a4ab-7b757be536af tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:31:12.295546 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-e06dfa29-a9aa-4ad8-a4ab-7b757be536af tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:31:12.296326 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-e06dfa29-a9aa-4ad8-a4ab-7b757be536af tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:31:12.296761 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-e06dfa29-a9aa-4ad8-a4ab-7b757be536af tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:31:12.326672 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-e06dfa29-a9aa-4ad8-a4ab-7b757be536af tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] 10.222.0.11 "GET /compute/v2.1/servers/a49437df-3059-4528-8328-2f3471d5fb45/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047057 Nov 17 03:31:12.327230 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 552/1134] 10.222.0.11 () {58 vars in 1301 bytes} [Wed Nov 17 03:31:12 2021] GET /compute/v2.1/servers/a49437df-3059-4528-8328-2f3471d5fb45/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 17 03:31:12.381600 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-7a760fc7-1232-47a7-a16d-6e5722678f54 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:31:12.382499 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-7a760fc7-1232-47a7-a16d-6e5722678f54 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] [instance: 5ddbfaaa-fabf-4324-941c-8868625ffefc] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:31:12.389267 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-7a760fc7-1232-47a7-a16d-6e5722678f54 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:31:12.389705 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-7a760fc7-1232-47a7-a16d-6e5722678f54 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:31:12.390466 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-7a760fc7-1232-47a7-a16d-6e5722678f54 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:31:12.390888 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-7a760fc7-1232-47a7-a16d-6e5722678f54 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:31:12.452166 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-7a760fc7-1232-47a7-a16d-6e5722678f54 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80763e09d44c475ea2425b22874e9612', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fef02a1dd77946a2ac0e0414b557435f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:31:12.463996 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-7a760fc7-1232-47a7-a16d-6e5722678f54 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] 10.222.0.11 "GET /compute/v2.1/servers/5ddbfaaa-fabf-4324-941c-8868625ffefc" status: 200 len: 1226 microversion: 2.1 time: 0.088171 Nov 17 03:31:12.464646 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 583/1135] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:31:12 2021] GET /compute/v2.1/servers/5ddbfaaa-fabf-4324-941c-8868625ffefc => generated 1226 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:31:12.907737 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-16cbaef9-f4dc-4678-83d6-9427d21de16c tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:31:12.908643 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-16cbaef9-f4dc-4678-83d6-9427d21de16c tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] [instance: 5d54db85-b991-4890-abaa-952413baa2e7] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:31:12.915497 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-16cbaef9-f4dc-4678-83d6-9427d21de16c tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:31:12.915943 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-16cbaef9-f4dc-4678-83d6-9427d21de16c tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:31:12.916697 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-16cbaef9-f4dc-4678-83d6-9427d21de16c tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:31:12.917167 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-16cbaef9-f4dc-4678-83d6-9427d21de16c tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:31:12.952057 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-16cbaef9-f4dc-4678-83d6-9427d21de16c tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] 10.222.0.11 "GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047461 Nov 17 03:31:12.953442 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 553/1136] 10.222.0.11 () {60 vars in 1342 bytes} [Wed Nov 17 03:31:12 2021] GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 17 03:31:13.340601 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-8428612b-9f8f-4047-b396-d2916d024d8c tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:31:13.341843 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-8428612b-9f8f-4047-b396-d2916d024d8c tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] [instance: a49437df-3059-4528-8328-2f3471d5fb45] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:31:13.350199 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-8428612b-9f8f-4047-b396-d2916d024d8c tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:31:13.350824 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-8428612b-9f8f-4047-b396-d2916d024d8c tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:31:13.351819 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-8428612b-9f8f-4047-b396-d2916d024d8c tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:31:13.352342 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-8428612b-9f8f-4047-b396-d2916d024d8c tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:31:13.382268 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-8428612b-9f8f-4047-b396-d2916d024d8c tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] 10.222.0.11 "GET /compute/v2.1/servers/a49437df-3059-4528-8328-2f3471d5fb45/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046746 Nov 17 03:31:13.382964 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 584/1137] 10.222.0.11 () {58 vars in 1301 bytes} [Wed Nov 17 03:31:13 2021] GET /compute/v2.1/servers/a49437df-3059-4528-8328-2f3471d5fb45/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 17 03:31:13.483541 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-85eb396b-6854-4827-b505-18b1be2a1cd7 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:31:13.484330 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-85eb396b-6854-4827-b505-18b1be2a1cd7 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] [instance: 5ddbfaaa-fabf-4324-941c-8868625ffefc] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:31:13.493589 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-85eb396b-6854-4827-b505-18b1be2a1cd7 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:31:13.494033 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-85eb396b-6854-4827-b505-18b1be2a1cd7 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:31:13.494796 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-85eb396b-6854-4827-b505-18b1be2a1cd7 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:31:13.495220 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-85eb396b-6854-4827-b505-18b1be2a1cd7 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:31:13.558631 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-85eb396b-6854-4827-b505-18b1be2a1cd7 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80763e09d44c475ea2425b22874e9612', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fef02a1dd77946a2ac0e0414b557435f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:31:13.566425 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-85eb396b-6854-4827-b505-18b1be2a1cd7 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] 10.222.0.11 "GET /compute/v2.1/servers/5ddbfaaa-fabf-4324-941c-8868625ffefc" status: 200 len: 1226 microversion: 2.1 time: 0.088430 Nov 17 03:31:13.566988 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 554/1138] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:31:13 2021] GET /compute/v2.1/servers/5ddbfaaa-fabf-4324-941c-8868625ffefc => generated 1226 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:31:13.965904 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-725c9a1e-8d83-42c8-909b-d61c25e0e2d3 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:31:13.966778 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-725c9a1e-8d83-42c8-909b-d61c25e0e2d3 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] [instance: 5d54db85-b991-4890-abaa-952413baa2e7] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:31:13.973995 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-725c9a1e-8d83-42c8-909b-d61c25e0e2d3 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:31:13.974464 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-725c9a1e-8d83-42c8-909b-d61c25e0e2d3 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:31:13.975271 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-725c9a1e-8d83-42c8-909b-d61c25e0e2d3 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:31:13.975724 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-725c9a1e-8d83-42c8-909b-d61c25e0e2d3 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:31:14.012226 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-725c9a1e-8d83-42c8-909b-d61c25e0e2d3 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] 10.222.0.11 "GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.050439 Nov 17 03:31:14.012804 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 585/1139] 10.222.0.11 () {60 vars in 1342 bytes} [Wed Nov 17 03:31:13 2021] GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 17 03:31:14.398081 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-24057941-35fb-4d4d-9017-c2bdc29d6574 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:31:14.399329 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-24057941-35fb-4d4d-9017-c2bdc29d6574 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] [instance: a49437df-3059-4528-8328-2f3471d5fb45] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:31:14.406307 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-24057941-35fb-4d4d-9017-c2bdc29d6574 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:31:14.406803 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-24057941-35fb-4d4d-9017-c2bdc29d6574 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:31:14.407649 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-24057941-35fb-4d4d-9017-c2bdc29d6574 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:31:14.408126 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-24057941-35fb-4d4d-9017-c2bdc29d6574 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:31:14.441122 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-24057941-35fb-4d4d-9017-c2bdc29d6574 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] 10.222.0.11 "GET /compute/v2.1/servers/a49437df-3059-4528-8328-2f3471d5fb45/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049478 Nov 17 03:31:14.441653 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 555/1140] 10.222.0.11 () {58 vars in 1301 bytes} [Wed Nov 17 03:31:14 2021] GET /compute/v2.1/servers/a49437df-3059-4528-8328-2f3471d5fb45/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 17 03:31:14.588549 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-f1273460-7590-42d7-9dec-11027691ecee tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:31:14.589599 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-f1273460-7590-42d7-9dec-11027691ecee tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] [instance: 5ddbfaaa-fabf-4324-941c-8868625ffefc] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:31:14.599648 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-f1273460-7590-42d7-9dec-11027691ecee tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:31:14.600392 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-f1273460-7590-42d7-9dec-11027691ecee tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:31:14.601774 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-f1273460-7590-42d7-9dec-11027691ecee tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:31:14.602587 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-f1273460-7590-42d7-9dec-11027691ecee tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:31:14.665180 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-f1273460-7590-42d7-9dec-11027691ecee tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80763e09d44c475ea2425b22874e9612', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fef02a1dd77946a2ac0e0414b557435f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:31:14.672761 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-f1273460-7590-42d7-9dec-11027691ecee tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] 10.222.0.11 "GET /compute/v2.1/servers/5ddbfaaa-fabf-4324-941c-8868625ffefc" status: 200 len: 1226 microversion: 2.1 time: 0.090379 Nov 17 03:31:14.673353 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 586/1141] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:31:14 2021] GET /compute/v2.1/servers/5ddbfaaa-fabf-4324-941c-8868625ffefc => generated 1226 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:31:15.023662 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-917931a6-c7a4-44c9-84c3-ab4af169c053 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:31:15.024626 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-917931a6-c7a4-44c9-84c3-ab4af169c053 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] [instance: 5d54db85-b991-4890-abaa-952413baa2e7] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:31:15.031580 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-917931a6-c7a4-44c9-84c3-ab4af169c053 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:31:15.032149 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-917931a6-c7a4-44c9-84c3-ab4af169c053 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:31:15.032967 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-917931a6-c7a4-44c9-84c3-ab4af169c053 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:31:15.033417 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-917931a6-c7a4-44c9-84c3-ab4af169c053 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:31:15.064662 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-917931a6-c7a4-44c9-84c3-ab4af169c053 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] 10.222.0.11 "GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044738 Nov 17 03:31:15.065247 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 556/1142] 10.222.0.11 () {60 vars in 1342 bytes} [Wed Nov 17 03:31:15 2021] GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 17 03:31:15.453317 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-959eeee1-4664-46fe-8c58-8634a64f5f07 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:31:15.454256 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-959eeee1-4664-46fe-8c58-8634a64f5f07 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] [instance: a49437df-3059-4528-8328-2f3471d5fb45] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:31:15.461359 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-959eeee1-4664-46fe-8c58-8634a64f5f07 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:31:15.461806 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-959eeee1-4664-46fe-8c58-8634a64f5f07 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:31:15.462617 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-959eeee1-4664-46fe-8c58-8634a64f5f07 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:31:15.463095 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-959eeee1-4664-46fe-8c58-8634a64f5f07 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:31:15.493494 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-959eeee1-4664-46fe-8c58-8634a64f5f07 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] 10.222.0.11 "GET /compute/v2.1/servers/a49437df-3059-4528-8328-2f3471d5fb45/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044091 Nov 17 03:31:15.494064 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 587/1143] 10.222.0.11 () {58 vars in 1301 bytes} [Wed Nov 17 03:31:15 2021] GET /compute/v2.1/servers/a49437df-3059-4528-8328-2f3471d5fb45/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 17 03:31:15.698896 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-3af9a9d7-5c05-4a03-b36a-4ec52e532033 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:31:15.699886 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-3af9a9d7-5c05-4a03-b36a-4ec52e532033 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] [instance: 5ddbfaaa-fabf-4324-941c-8868625ffefc] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:31:15.710023 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-3af9a9d7-5c05-4a03-b36a-4ec52e532033 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:31:15.710762 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-3af9a9d7-5c05-4a03-b36a-4ec52e532033 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:31:15.712028 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-3af9a9d7-5c05-4a03-b36a-4ec52e532033 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:31:15.712738 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-3af9a9d7-5c05-4a03-b36a-4ec52e532033 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:31:15.785568 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-3af9a9d7-5c05-4a03-b36a-4ec52e532033 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80763e09d44c475ea2425b22874e9612', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fef02a1dd77946a2ac0e0414b557435f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:31:15.797084 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-3af9a9d7-5c05-4a03-b36a-4ec52e532033 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] 10.222.0.11 "GET /compute/v2.1/servers/5ddbfaaa-fabf-4324-941c-8868625ffefc" status: 200 len: 1226 microversion: 2.1 time: 0.104272 Nov 17 03:31:15.797815 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 557/1144] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:31:15 2021] GET /compute/v2.1/servers/5ddbfaaa-fabf-4324-941c-8868625ffefc => generated 1226 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:31:16.077536 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-17989a1f-9ade-4fd4-9526-9bcaceae907d tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:31:16.078448 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-17989a1f-9ade-4fd4-9526-9bcaceae907d tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] [instance: 5d54db85-b991-4890-abaa-952413baa2e7] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:31:16.084914 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-17989a1f-9ade-4fd4-9526-9bcaceae907d tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:31:16.085360 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-17989a1f-9ade-4fd4-9526-9bcaceae907d tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:31:16.086137 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-17989a1f-9ade-4fd4-9526-9bcaceae907d tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:31:16.086566 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-17989a1f-9ade-4fd4-9526-9bcaceae907d tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:31:16.121797 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-17989a1f-9ade-4fd4-9526-9bcaceae907d tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] 10.222.0.11 "GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.048190 Nov 17 03:31:16.122363 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 588/1145] 10.222.0.11 () {60 vars in 1342 bytes} [Wed Nov 17 03:31:16 2021] GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 17 03:31:16.509441 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-631616fe-0d79-4287-907d-22218959a8af tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:31:16.511221 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-631616fe-0d79-4287-907d-22218959a8af tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] [instance: a49437df-3059-4528-8328-2f3471d5fb45] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:31:16.521813 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-631616fe-0d79-4287-907d-22218959a8af tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:31:16.522557 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-631616fe-0d79-4287-907d-22218959a8af tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:31:16.523824 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-631616fe-0d79-4287-907d-22218959a8af tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:31:16.524531 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-631616fe-0d79-4287-907d-22218959a8af tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:31:16.553804 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-631616fe-0d79-4287-907d-22218959a8af tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] 10.222.0.11 "GET /compute/v2.1/servers/a49437df-3059-4528-8328-2f3471d5fb45/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050735 Nov 17 03:31:16.554341 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 558/1146] 10.222.0.11 () {58 vars in 1301 bytes} [Wed Nov 17 03:31:16 2021] GET /compute/v2.1/servers/a49437df-3059-4528-8328-2f3471d5fb45/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 17 03:31:16.821816 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-0ab43dec-49e7-419d-9357-571f72abb8bf tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:31:16.823102 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-0ab43dec-49e7-419d-9357-571f72abb8bf tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] [instance: 5ddbfaaa-fabf-4324-941c-8868625ffefc] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:31:16.835470 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-0ab43dec-49e7-419d-9357-571f72abb8bf tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:31:16.836227 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-0ab43dec-49e7-419d-9357-571f72abb8bf tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:31:16.837606 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-0ab43dec-49e7-419d-9357-571f72abb8bf tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:31:16.838345 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-0ab43dec-49e7-419d-9357-571f72abb8bf tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:31:16.898936 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-0ab43dec-49e7-419d-9357-571f72abb8bf tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80763e09d44c475ea2425b22874e9612', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fef02a1dd77946a2ac0e0414b557435f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:31:16.907892 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-0ab43dec-49e7-419d-9357-571f72abb8bf tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] 10.222.0.11 "GET /compute/v2.1/servers/5ddbfaaa-fabf-4324-941c-8868625ffefc" status: 200 len: 1226 microversion: 2.1 time: 0.092381 Nov 17 03:31:16.908461 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 589/1147] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:31:16 2021] GET /compute/v2.1/servers/5ddbfaaa-fabf-4324-941c-8868625ffefc => generated 1226 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:31:17.139652 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-44602dd3-9e4c-4820-871a-16f901076d66 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:31:17.141092 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-44602dd3-9e4c-4820-871a-16f901076d66 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] [instance: 5d54db85-b991-4890-abaa-952413baa2e7] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:31:17.151143 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-44602dd3-9e4c-4820-871a-16f901076d66 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:31:17.151870 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-44602dd3-9e4c-4820-871a-16f901076d66 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:31:17.153272 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-44602dd3-9e4c-4820-871a-16f901076d66 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:31:17.153988 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-44602dd3-9e4c-4820-871a-16f901076d66 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:31:17.188347 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-44602dd3-9e4c-4820-871a-16f901076d66 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] 10.222.0.11 "GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.055221 Nov 17 03:31:17.188923 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 559/1148] 10.222.0.11 () {60 vars in 1342 bytes} [Wed Nov 17 03:31:17 2021] GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7/os-volume_attachments => generated 197 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 17 03:31:17.570867 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-24ab51e9-0431-4c19-a9ce-cfea12963a62 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:31:17.572352 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-24ab51e9-0431-4c19-a9ce-cfea12963a62 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] [instance: a49437df-3059-4528-8328-2f3471d5fb45] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:31:17.582540 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-24ab51e9-0431-4c19-a9ce-cfea12963a62 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:31:17.583300 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-24ab51e9-0431-4c19-a9ce-cfea12963a62 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:31:17.584547 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-24ab51e9-0431-4c19-a9ce-cfea12963a62 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:31:17.585313 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-24ab51e9-0431-4c19-a9ce-cfea12963a62 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:31:17.615182 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-24ab51e9-0431-4c19-a9ce-cfea12963a62 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] 10.222.0.11 "GET /compute/v2.1/servers/a49437df-3059-4528-8328-2f3471d5fb45/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050693 Nov 17 03:31:17.615727 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 590/1149] 10.222.0.11 () {58 vars in 1301 bytes} [Wed Nov 17 03:31:17 2021] GET /compute/v2.1/servers/a49437df-3059-4528-8328-2f3471d5fb45/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 17 03:31:17.929029 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-382fc4c3-2314-48c9-adb6-cebed08e8da9 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:31:17.929972 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-382fc4c3-2314-48c9-adb6-cebed08e8da9 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] [instance: 5ddbfaaa-fabf-4324-941c-8868625ffefc] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:31:17.940736 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-382fc4c3-2314-48c9-adb6-cebed08e8da9 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:31:17.941533 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-382fc4c3-2314-48c9-adb6-cebed08e8da9 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:31:17.942805 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-382fc4c3-2314-48c9-adb6-cebed08e8da9 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:31:17.943518 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-382fc4c3-2314-48c9-adb6-cebed08e8da9 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:31:18.004971 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-382fc4c3-2314-48c9-adb6-cebed08e8da9 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80763e09d44c475ea2425b22874e9612', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fef02a1dd77946a2ac0e0414b557435f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:31:18.012862 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-382fc4c3-2314-48c9-adb6-cebed08e8da9 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] 10.222.0.11 "GET /compute/v2.1/servers/5ddbfaaa-fabf-4324-941c-8868625ffefc" status: 200 len: 1226 microversion: 2.1 time: 0.090301 Nov 17 03:31:18.013428 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 560/1150] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:31:17 2021] GET /compute/v2.1/servers/5ddbfaaa-fabf-4324-941c-8868625ffefc => generated 1226 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:31:18.201678 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-4c4e155e-e44d-40de-b57e-715330a2fc06 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:31:18.202494 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-4c4e155e-e44d-40de-b57e-715330a2fc06 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] [instance: 5d54db85-b991-4890-abaa-952413baa2e7] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:31:18.208919 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-4c4e155e-e44d-40de-b57e-715330a2fc06 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:31:18.209362 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-4c4e155e-e44d-40de-b57e-715330a2fc06 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:31:18.210128 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-4c4e155e-e44d-40de-b57e-715330a2fc06 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:31:18.210554 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-4c4e155e-e44d-40de-b57e-715330a2fc06 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:31:18.242436 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-4c4e155e-e44d-40de-b57e-715330a2fc06 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] 10.222.0.11 "GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044977 Nov 17 03:31:18.242993 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 591/1151] 10.222.0.11 () {60 vars in 1342 bytes} [Wed Nov 17 03:31:18 2021] GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 17 03:31:18.630883 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-8d432849-c364-4c5d-880b-4f90cf2c8e7a tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:31:18.632361 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-8d432849-c364-4c5d-880b-4f90cf2c8e7a tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] [instance: a49437df-3059-4528-8328-2f3471d5fb45] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:31:18.640111 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-8d432849-c364-4c5d-880b-4f90cf2c8e7a tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:31:18.640562 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-8d432849-c364-4c5d-880b-4f90cf2c8e7a tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:31:18.641380 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-8d432849-c364-4c5d-880b-4f90cf2c8e7a tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:31:18.641818 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-8d432849-c364-4c5d-880b-4f90cf2c8e7a tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:31:18.671313 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-8d432849-c364-4c5d-880b-4f90cf2c8e7a tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] 10.222.0.11 "GET /compute/v2.1/servers/a49437df-3059-4528-8328-2f3471d5fb45/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046895 Nov 17 03:31:18.671874 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 561/1152] 10.222.0.11 () {58 vars in 1301 bytes} [Wed Nov 17 03:31:18 2021] GET /compute/v2.1/servers/a49437df-3059-4528-8328-2f3471d5fb45/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 17 03:31:19.038183 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-09e2729c-aa53-4707-9f2c-9c2267cdf61b tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:31:19.039187 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-09e2729c-aa53-4707-9f2c-9c2267cdf61b tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] [instance: 5ddbfaaa-fabf-4324-941c-8868625ffefc] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:31:19.049479 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-09e2729c-aa53-4707-9f2c-9c2267cdf61b tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:31:19.050223 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-09e2729c-aa53-4707-9f2c-9c2267cdf61b tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:31:19.051485 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-09e2729c-aa53-4707-9f2c-9c2267cdf61b tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:31:19.052170 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-09e2729c-aa53-4707-9f2c-9c2267cdf61b tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:31:19.126671 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-09e2729c-aa53-4707-9f2c-9c2267cdf61b tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80763e09d44c475ea2425b22874e9612', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fef02a1dd77946a2ac0e0414b557435f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:31:19.138285 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-09e2729c-aa53-4707-9f2c-9c2267cdf61b tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] 10.222.0.11 "GET /compute/v2.1/servers/5ddbfaaa-fabf-4324-941c-8868625ffefc" status: 200 len: 1226 microversion: 2.1 time: 0.105913 Nov 17 03:31:19.139100 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 592/1153] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:31:19 2021] GET /compute/v2.1/servers/5ddbfaaa-fabf-4324-941c-8868625ffefc => generated 1226 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:31:19.257425 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-9a9158c2-aeb4-409b-b89e-799af6994fd8 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:31:19.258866 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-9a9158c2-aeb4-409b-b89e-799af6994fd8 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] [instance: 5d54db85-b991-4890-abaa-952413baa2e7] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:31:19.268393 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-9a9158c2-aeb4-409b-b89e-799af6994fd8 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:31:19.269172 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-9a9158c2-aeb4-409b-b89e-799af6994fd8 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:31:19.270477 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-9a9158c2-aeb4-409b-b89e-799af6994fd8 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:31:19.271175 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-9a9158c2-aeb4-409b-b89e-799af6994fd8 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:31:19.311779 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-9a9158c2-aeb4-409b-b89e-799af6994fd8 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] 10.222.0.11 "GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.061186 Nov 17 03:31:19.312258 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 562/1154] 10.222.0.11 () {60 vars in 1342 bytes} [Wed Nov 17 03:31:19 2021] GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7/os-volume_attachments => generated 197 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 17 03:31:19.685102 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-f0ab0a4d-397c-4d24-87fc-0d6902f25a1d tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:31:19.686052 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-f0ab0a4d-397c-4d24-87fc-0d6902f25a1d tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] [instance: a49437df-3059-4528-8328-2f3471d5fb45] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:31:19.692648 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-f0ab0a4d-397c-4d24-87fc-0d6902f25a1d tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:31:19.693141 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-f0ab0a4d-397c-4d24-87fc-0d6902f25a1d tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:31:19.693912 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-f0ab0a4d-397c-4d24-87fc-0d6902f25a1d tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:31:19.694342 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-f0ab0a4d-397c-4d24-87fc-0d6902f25a1d tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:31:19.723687 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-f0ab0a4d-397c-4d24-87fc-0d6902f25a1d tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] 10.222.0.11 "GET /compute/v2.1/servers/a49437df-3059-4528-8328-2f3471d5fb45/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043336 Nov 17 03:31:19.724254 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 593/1155] 10.222.0.11 () {58 vars in 1301 bytes} [Wed Nov 17 03:31:19 2021] GET /compute/v2.1/servers/a49437df-3059-4528-8328-2f3471d5fb45/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 17 03:31:20.163358 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-a587cf40-4a91-4e27-9e9e-37958e89efb0 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:31:20.164361 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-a587cf40-4a91-4e27-9e9e-37958e89efb0 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] [instance: 5ddbfaaa-fabf-4324-941c-8868625ffefc] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:31:20.171662 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-a587cf40-4a91-4e27-9e9e-37958e89efb0 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:31:20.172114 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-a587cf40-4a91-4e27-9e9e-37958e89efb0 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:31:20.172935 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-a587cf40-4a91-4e27-9e9e-37958e89efb0 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:31:20.173371 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-a587cf40-4a91-4e27-9e9e-37958e89efb0 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:31:20.245737 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-a587cf40-4a91-4e27-9e9e-37958e89efb0 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80763e09d44c475ea2425b22874e9612', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fef02a1dd77946a2ac0e0414b557435f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:31:20.253415 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-a587cf40-4a91-4e27-9e9e-37958e89efb0 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] 10.222.0.11 "GET /compute/v2.1/servers/5ddbfaaa-fabf-4324-941c-8868625ffefc" status: 200 len: 1226 microversion: 2.1 time: 0.096336 Nov 17 03:31:20.253960 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 563/1156] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:31:20 2021] GET /compute/v2.1/servers/5ddbfaaa-fabf-4324-941c-8868625ffefc => generated 1226 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:31:20.325406 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-945485d6-ac10-44d7-a0bd-acfada2ed13f tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:31:20.326235 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-945485d6-ac10-44d7-a0bd-acfada2ed13f tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] [instance: 5d54db85-b991-4890-abaa-952413baa2e7] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:31:20.332856 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-945485d6-ac10-44d7-a0bd-acfada2ed13f tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:31:20.333305 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-945485d6-ac10-44d7-a0bd-acfada2ed13f tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:31:20.334079 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-945485d6-ac10-44d7-a0bd-acfada2ed13f tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:31:20.334510 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-945485d6-ac10-44d7-a0bd-acfada2ed13f tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:31:20.364534 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-945485d6-ac10-44d7-a0bd-acfada2ed13f tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] 10.222.0.11 "GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044231 Nov 17 03:31:20.365116 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 594/1157] 10.222.0.11 () {60 vars in 1342 bytes} [Wed Nov 17 03:31:20 2021] GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 17 03:31:20.739273 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-dfbbbc2c-2c16-49c0-884b-876dcf8a52ed tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:31:20.740607 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-dfbbbc2c-2c16-49c0-884b-876dcf8a52ed tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] [instance: a49437df-3059-4528-8328-2f3471d5fb45] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:31:20.749092 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-dfbbbc2c-2c16-49c0-884b-876dcf8a52ed tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:31:20.749546 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-dfbbbc2c-2c16-49c0-884b-876dcf8a52ed tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:31:20.750314 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-dfbbbc2c-2c16-49c0-884b-876dcf8a52ed tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:31:20.750746 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-dfbbbc2c-2c16-49c0-884b-876dcf8a52ed tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:31:20.784896 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-dfbbbc2c-2c16-49c0-884b-876dcf8a52ed tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] 10.222.0.11 "GET /compute/v2.1/servers/a49437df-3059-4528-8328-2f3471d5fb45/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051821 Nov 17 03:31:20.785828 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 564/1158] 10.222.0.11 () {58 vars in 1301 bytes} [Wed Nov 17 03:31:20 2021] GET /compute/v2.1/servers/a49437df-3059-4528-8328-2f3471d5fb45/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 17 03:31:21.276613 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-ca092f50-55e4-4a43-aa4e-d067dda61157 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:31:21.277319 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-ca092f50-55e4-4a43-aa4e-d067dda61157 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] [instance: 5ddbfaaa-fabf-4324-941c-8868625ffefc] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:31:21.284677 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-ca092f50-55e4-4a43-aa4e-d067dda61157 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:31:21.285210 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-ca092f50-55e4-4a43-aa4e-d067dda61157 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:31:21.286063 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-ca092f50-55e4-4a43-aa4e-d067dda61157 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:31:21.286538 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-ca092f50-55e4-4a43-aa4e-d067dda61157 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:31:21.361440 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-ca092f50-55e4-4a43-aa4e-d067dda61157 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80763e09d44c475ea2425b22874e9612', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fef02a1dd77946a2ac0e0414b557435f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:31:21.371547 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-ca092f50-55e4-4a43-aa4e-d067dda61157 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] 10.222.0.11 "GET /compute/v2.1/servers/5ddbfaaa-fabf-4324-941c-8868625ffefc" status: 200 len: 1226 microversion: 2.1 time: 0.100975 Nov 17 03:31:21.372091 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 595/1159] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:31:21 2021] GET /compute/v2.1/servers/5ddbfaaa-fabf-4324-941c-8868625ffefc => generated 1226 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:31:21.375781 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-d641c1e0-3923-456f-b1d1-eb243e04679c tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:31:21.376699 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-d641c1e0-3923-456f-b1d1-eb243e04679c tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] [instance: 5d54db85-b991-4890-abaa-952413baa2e7] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:31:21.383036 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-d641c1e0-3923-456f-b1d1-eb243e04679c tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:31:21.383496 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-d641c1e0-3923-456f-b1d1-eb243e04679c tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:31:21.384294 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-d641c1e0-3923-456f-b1d1-eb243e04679c tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:31:21.384751 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-d641c1e0-3923-456f-b1d1-eb243e04679c tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:31:21.416908 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-d641c1e0-3923-456f-b1d1-eb243e04679c tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] 10.222.0.11 "GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044805 Nov 17 03:31:21.417469 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 565/1160] 10.222.0.11 () {60 vars in 1342 bytes} [Wed Nov 17 03:31:21 2021] GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 17 03:31:21.803096 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-a6d725f7-d51b-4269-b60d-9718430a625f tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:31:21.804557 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-a6d725f7-d51b-4269-b60d-9718430a625f tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] [instance: a49437df-3059-4528-8328-2f3471d5fb45] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:31:21.815263 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-a6d725f7-d51b-4269-b60d-9718430a625f tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:31:21.816110 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-a6d725f7-d51b-4269-b60d-9718430a625f tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:31:21.817427 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-a6d725f7-d51b-4269-b60d-9718430a625f tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:31:21.818113 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-a6d725f7-d51b-4269-b60d-9718430a625f tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:31:21.849848 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-a6d725f7-d51b-4269-b60d-9718430a625f tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] 10.222.0.11 "GET /compute/v2.1/servers/a49437df-3059-4528-8328-2f3471d5fb45/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053091 Nov 17 03:31:21.850403 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 596/1161] 10.222.0.11 () {58 vars in 1301 bytes} [Wed Nov 17 03:31:21 2021] GET /compute/v2.1/servers/a49437df-3059-4528-8328-2f3471d5fb45/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 17 03:31:22.390548 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-ceee8bf4-bfd3-4b77-8e22-92a3f4cf1c55 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:31:22.391217 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-ceee8bf4-bfd3-4b77-8e22-92a3f4cf1c55 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] [instance: 5ddbfaaa-fabf-4324-941c-8868625ffefc] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:31:22.398839 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-ceee8bf4-bfd3-4b77-8e22-92a3f4cf1c55 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:31:22.399357 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-ceee8bf4-bfd3-4b77-8e22-92a3f4cf1c55 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:31:22.400290 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-ceee8bf4-bfd3-4b77-8e22-92a3f4cf1c55 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:31:22.400809 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-ceee8bf4-bfd3-4b77-8e22-92a3f4cf1c55 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:31:22.429617 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-e2770bf1-8620-4d03-8277-c285222ac27b tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:31:22.430561 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-e2770bf1-8620-4d03-8277-c285222ac27b tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] [instance: 5d54db85-b991-4890-abaa-952413baa2e7] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:31:22.438959 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-e2770bf1-8620-4d03-8277-c285222ac27b tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:31:22.439483 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-e2770bf1-8620-4d03-8277-c285222ac27b tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:31:22.440358 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-e2770bf1-8620-4d03-8277-c285222ac27b tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:31:22.440882 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-e2770bf1-8620-4d03-8277-c285222ac27b tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:31:22.466598 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-ceee8bf4-bfd3-4b77-8e22-92a3f4cf1c55 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80763e09d44c475ea2425b22874e9612', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fef02a1dd77946a2ac0e0414b557435f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:31:22.472446 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-e2770bf1-8620-4d03-8277-c285222ac27b tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] 10.222.0.11 "GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047429 Nov 17 03:31:22.473051 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 597/1162] 10.222.0.11 () {60 vars in 1342 bytes} [Wed Nov 17 03:31:22 2021] GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 17 03:31:22.474507 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-ceee8bf4-bfd3-4b77-8e22-92a3f4cf1c55 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] 10.222.0.11 "GET /compute/v2.1/servers/5ddbfaaa-fabf-4324-941c-8868625ffefc" status: 200 len: 1226 microversion: 2.1 time: 0.089128 Nov 17 03:31:22.475314 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 566/1163] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:31:22 2021] GET /compute/v2.1/servers/5ddbfaaa-fabf-4324-941c-8868625ffefc => generated 1226 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:31:22.865827 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-a18b9adb-a5cc-4f41-9a40-9536e3e6f72a tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:31:22.867320 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-a18b9adb-a5cc-4f41-9a40-9536e3e6f72a tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] [instance: a49437df-3059-4528-8328-2f3471d5fb45] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:31:22.875164 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-a18b9adb-a5cc-4f41-9a40-9536e3e6f72a tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:31:22.875611 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-a18b9adb-a5cc-4f41-9a40-9536e3e6f72a tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:31:22.876386 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-a18b9adb-a5cc-4f41-9a40-9536e3e6f72a tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:31:22.876805 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-a18b9adb-a5cc-4f41-9a40-9536e3e6f72a tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:31:22.905688 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-a18b9adb-a5cc-4f41-9a40-9536e3e6f72a tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] 10.222.0.11 "GET /compute/v2.1/servers/a49437df-3059-4528-8328-2f3471d5fb45/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046378 Nov 17 03:31:22.906237 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 598/1164] 10.222.0.11 () {58 vars in 1301 bytes} [Wed Nov 17 03:31:22 2021] GET /compute/v2.1/servers/a49437df-3059-4528-8328-2f3471d5fb45/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 17 03:31:23.486769 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-15340961-1192-4183-86cb-18f2ab35cf9c tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:31:23.487920 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-15340961-1192-4183-86cb-18f2ab35cf9c tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] [instance: 5d54db85-b991-4890-abaa-952413baa2e7] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:31:23.492624 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-d3fbcc68-6253-4d45-873e-07bb537e7ce9 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:31:23.493454 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-d3fbcc68-6253-4d45-873e-07bb537e7ce9 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] [instance: 5ddbfaaa-fabf-4324-941c-8868625ffefc] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:31:23.497212 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-15340961-1192-4183-86cb-18f2ab35cf9c tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:31:23.497666 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-15340961-1192-4183-86cb-18f2ab35cf9c tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:31:23.498445 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-15340961-1192-4183-86cb-18f2ab35cf9c tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:31:23.498871 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-15340961-1192-4183-86cb-18f2ab35cf9c tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:31:23.501203 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-d3fbcc68-6253-4d45-873e-07bb537e7ce9 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:31:23.501652 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-d3fbcc68-6253-4d45-873e-07bb537e7ce9 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:31:23.502446 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-d3fbcc68-6253-4d45-873e-07bb537e7ce9 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:31:23.502879 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-d3fbcc68-6253-4d45-873e-07bb537e7ce9 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:31:23.528166 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-15340961-1192-4183-86cb-18f2ab35cf9c tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] 10.222.0.11 "GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046659 Nov 17 03:31:23.529048 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 567/1165] 10.222.0.11 () {60 vars in 1342 bytes} [Wed Nov 17 03:31:23 2021] GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 17 03:31:23.563592 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-d3fbcc68-6253-4d45-873e-07bb537e7ce9 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80763e09d44c475ea2425b22874e9612', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fef02a1dd77946a2ac0e0414b557435f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:31:23.571149 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-d3fbcc68-6253-4d45-873e-07bb537e7ce9 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] 10.222.0.11 "GET /compute/v2.1/servers/5ddbfaaa-fabf-4324-941c-8868625ffefc" status: 200 len: 1226 microversion: 2.1 time: 0.083643 Nov 17 03:31:23.571715 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 599/1166] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:31:23 2021] GET /compute/v2.1/servers/5ddbfaaa-fabf-4324-941c-8868625ffefc => generated 1226 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:31:23.925585 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-b86ee224-f291-47fb-97ba-881b4bc20e8c tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:31:23.926566 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-b86ee224-f291-47fb-97ba-881b4bc20e8c tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] [instance: a49437df-3059-4528-8328-2f3471d5fb45] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:31:23.934714 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-b86ee224-f291-47fb-97ba-881b4bc20e8c tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:31:23.935284 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-b86ee224-f291-47fb-97ba-881b4bc20e8c tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:31:23.936223 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-b86ee224-f291-47fb-97ba-881b4bc20e8c tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:31:23.936766 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-b86ee224-f291-47fb-97ba-881b4bc20e8c tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:31:23.975443 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-b86ee224-f291-47fb-97ba-881b4bc20e8c tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] 10.222.0.11 "GET /compute/v2.1/servers/a49437df-3059-4528-8328-2f3471d5fb45/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.054388 Nov 17 03:31:23.976068 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 568/1167] 10.222.0.11 () {58 vars in 1301 bytes} [Wed Nov 17 03:31:23 2021] GET /compute/v2.1/servers/a49437df-3059-4528-8328-2f3471d5fb45/os-volume_attachments => generated 197 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 17 03:31:24.544150 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-b00f3f8d-189d-4db7-a55a-98d0645c4944 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:31:24.545092 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-b00f3f8d-189d-4db7-a55a-98d0645c4944 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] [instance: 5d54db85-b991-4890-abaa-952413baa2e7] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:31:24.551793 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-b00f3f8d-189d-4db7-a55a-98d0645c4944 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:31:24.552236 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-b00f3f8d-189d-4db7-a55a-98d0645c4944 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:31:24.553052 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-b00f3f8d-189d-4db7-a55a-98d0645c4944 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:31:24.553514 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-b00f3f8d-189d-4db7-a55a-98d0645c4944 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:31:24.584188 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-b00f3f8d-189d-4db7-a55a-98d0645c4944 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] 10.222.0.11 "GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046460 Nov 17 03:31:24.584668 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 600/1168] 10.222.0.11 () {60 vars in 1342 bytes} [Wed Nov 17 03:31:24 2021] GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 17 03:31:24.587696 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-d0ab0ff5-8354-40da-9e38-02d3dd69bd82 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:31:24.588340 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-d0ab0ff5-8354-40da-9e38-02d3dd69bd82 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] [instance: 5ddbfaaa-fabf-4324-941c-8868625ffefc] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:31:24.598392 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-d0ab0ff5-8354-40da-9e38-02d3dd69bd82 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:31:24.599056 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-d0ab0ff5-8354-40da-9e38-02d3dd69bd82 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:31:24.600281 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-d0ab0ff5-8354-40da-9e38-02d3dd69bd82 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:31:24.601041 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-d0ab0ff5-8354-40da-9e38-02d3dd69bd82 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:31:24.664328 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-d0ab0ff5-8354-40da-9e38-02d3dd69bd82 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80763e09d44c475ea2425b22874e9612', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fef02a1dd77946a2ac0e0414b557435f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:31:24.672792 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-d0ab0ff5-8354-40da-9e38-02d3dd69bd82 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] 10.222.0.11 "GET /compute/v2.1/servers/5ddbfaaa-fabf-4324-941c-8868625ffefc" status: 200 len: 1226 microversion: 2.1 time: 0.088866 Nov 17 03:31:24.673364 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 569/1169] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:31:24 2021] GET /compute/v2.1/servers/5ddbfaaa-fabf-4324-941c-8868625ffefc => generated 1226 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:31:24.991425 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-b70ba857-8eb0-4dd0-84dc-493aef4bcf1c tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:31:24.992820 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-b70ba857-8eb0-4dd0-84dc-493aef4bcf1c tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] [instance: a49437df-3059-4528-8328-2f3471d5fb45] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:31:25.000670 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-b70ba857-8eb0-4dd0-84dc-493aef4bcf1c tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:31:25.001149 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-b70ba857-8eb0-4dd0-84dc-493aef4bcf1c tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:31:25.001909 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-b70ba857-8eb0-4dd0-84dc-493aef4bcf1c tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:31:25.002335 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-b70ba857-8eb0-4dd0-84dc-493aef4bcf1c tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:31:25.031533 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-b70ba857-8eb0-4dd0-84dc-493aef4bcf1c tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] 10.222.0.11 "GET /compute/v2.1/servers/a49437df-3059-4528-8328-2f3471d5fb45/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046530 Nov 17 03:31:25.032073 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 601/1170] 10.222.0.11 () {58 vars in 1301 bytes} [Wed Nov 17 03:31:24 2021] GET /compute/v2.1/servers/a49437df-3059-4528-8328-2f3471d5fb45/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 17 03:31:25.599043 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-3ccbb986-63fa-41bf-96a2-1fb42c6c9864 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:31:25.600351 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-3ccbb986-63fa-41bf-96a2-1fb42c6c9864 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] [instance: 5d54db85-b991-4890-abaa-952413baa2e7] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:31:25.609394 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-3ccbb986-63fa-41bf-96a2-1fb42c6c9864 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:31:25.609879 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-3ccbb986-63fa-41bf-96a2-1fb42c6c9864 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:31:25.610593 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-3ccbb986-63fa-41bf-96a2-1fb42c6c9864 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:31:25.610969 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-3ccbb986-63fa-41bf-96a2-1fb42c6c9864 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:31:25.646722 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-3ccbb986-63fa-41bf-96a2-1fb42c6c9864 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] 10.222.0.11 "GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.054071 Nov 17 03:31:25.647479 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 570/1171] 10.222.0.11 () {60 vars in 1342 bytes} [Wed Nov 17 03:31:25 2021] GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 17 03:31:25.691805 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-b2f3ca25-63dc-48c5-b4d6-2f26b5ea2bb7 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:31:25.692393 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-b2f3ca25-63dc-48c5-b4d6-2f26b5ea2bb7 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] [instance: 5ddbfaaa-fabf-4324-941c-8868625ffefc] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:31:25.703064 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-b2f3ca25-63dc-48c5-b4d6-2f26b5ea2bb7 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:31:25.705189 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-b2f3ca25-63dc-48c5-b4d6-2f26b5ea2bb7 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:31:25.706960 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-b2f3ca25-63dc-48c5-b4d6-2f26b5ea2bb7 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:31:25.707399 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-b2f3ca25-63dc-48c5-b4d6-2f26b5ea2bb7 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:31:25.779681 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-b2f3ca25-63dc-48c5-b4d6-2f26b5ea2bb7 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80763e09d44c475ea2425b22874e9612', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fef02a1dd77946a2ac0e0414b557435f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:31:25.790451 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-b2f3ca25-63dc-48c5-b4d6-2f26b5ea2bb7 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] 10.222.0.11 "GET /compute/v2.1/servers/5ddbfaaa-fabf-4324-941c-8868625ffefc" status: 200 len: 1226 microversion: 2.1 time: 0.103348 Nov 17 03:31:25.791006 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 602/1172] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:31:25 2021] GET /compute/v2.1/servers/5ddbfaaa-fabf-4324-941c-8868625ffefc => generated 1226 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:31:26.043777 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-cdd93b7f-e17e-4ff8-a35d-2d65d9ba65bc tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:31:26.044749 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-cdd93b7f-e17e-4ff8-a35d-2d65d9ba65bc tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] [instance: a49437df-3059-4528-8328-2f3471d5fb45] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:31:26.051451 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-cdd93b7f-e17e-4ff8-a35d-2d65d9ba65bc tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:31:26.051889 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-cdd93b7f-e17e-4ff8-a35d-2d65d9ba65bc tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:31:26.052664 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-cdd93b7f-e17e-4ff8-a35d-2d65d9ba65bc tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:31:26.053129 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-cdd93b7f-e17e-4ff8-a35d-2d65d9ba65bc tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:31:26.085905 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-cdd93b7f-e17e-4ff8-a35d-2d65d9ba65bc tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] 10.222.0.11 "GET /compute/v2.1/servers/a49437df-3059-4528-8328-2f3471d5fb45/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046253 Nov 17 03:31:26.086597 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 571/1173] 10.222.0.11 () {58 vars in 1301 bytes} [Wed Nov 17 03:31:26 2021] GET /compute/v2.1/servers/a49437df-3059-4528-8328-2f3471d5fb45/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 17 03:31:26.659374 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-77f1d48e-379b-42e0-9e13-48ead5f31c74 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:31:26.660277 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-77f1d48e-379b-42e0-9e13-48ead5f31c74 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] [instance: 5d54db85-b991-4890-abaa-952413baa2e7] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:31:26.666756 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-77f1d48e-379b-42e0-9e13-48ead5f31c74 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:31:26.667204 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-77f1d48e-379b-42e0-9e13-48ead5f31c74 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:31:26.667956 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-77f1d48e-379b-42e0-9e13-48ead5f31c74 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:31:26.668386 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-77f1d48e-379b-42e0-9e13-48ead5f31c74 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:31:26.698423 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-77f1d48e-379b-42e0-9e13-48ead5f31c74 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] 10.222.0.11 "GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042880 Nov 17 03:31:26.699110 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 603/1174] 10.222.0.11 () {60 vars in 1342 bytes} [Wed Nov 17 03:31:26 2021] GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 17 03:31:26.814334 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-c82d4bf0-b095-4a61-a692-133b7c54e6bc tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:31:26.815213 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-c82d4bf0-b095-4a61-a692-133b7c54e6bc tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] [instance: 5ddbfaaa-fabf-4324-941c-8868625ffefc] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:31:26.824476 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-c82d4bf0-b095-4a61-a692-133b7c54e6bc tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:31:26.825185 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-c82d4bf0-b095-4a61-a692-133b7c54e6bc tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:31:26.826078 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-c82d4bf0-b095-4a61-a692-133b7c54e6bc tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:31:26.826513 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-c82d4bf0-b095-4a61-a692-133b7c54e6bc tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:31:26.888493 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-c82d4bf0-b095-4a61-a692-133b7c54e6bc tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80763e09d44c475ea2425b22874e9612', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fef02a1dd77946a2ac0e0414b557435f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:31:26.897280 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-c82d4bf0-b095-4a61-a692-133b7c54e6bc tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] 10.222.0.11 "GET /compute/v2.1/servers/5ddbfaaa-fabf-4324-941c-8868625ffefc" status: 200 len: 1226 microversion: 2.1 time: 0.087988 Nov 17 03:31:26.898186 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 572/1175] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:31:26 2021] GET /compute/v2.1/servers/5ddbfaaa-fabf-4324-941c-8868625ffefc => generated 1226 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:31:27.019910 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-bd615120-6395-4db7-b41b-6fe1abad63ce tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 17 03:31:27.020591 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-bd615120-6395-4db7-b41b-6fe1abad63ce tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] [instance: 0698dc5b-5f47-46c4-ace8-f5e891a964a0] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:31:27.030152 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-bd615120-6395-4db7-b41b-6fe1abad63ce tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:31:27.030878 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-bd615120-6395-4db7-b41b-6fe1abad63ce tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:31:27.032150 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-bd615120-6395-4db7-b41b-6fe1abad63ce tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:31:27.032847 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-bd615120-6395-4db7-b41b-6fe1abad63ce tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:31:27.061232 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.objects.instance [None req-bd615120-6395-4db7-b41b-6fe1abad63ce tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lazy-loading 'flavor' on Instance uuid 0698dc5b-5f47-46c4-ace8-f5e891a964a0 {{(pid=115916) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Nov 17 03:31:27.097862 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-0a4c039d-8b45-4962-85a2-e1d022cdf216 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:31:27.098766 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-0a4c039d-8b45-4962-85a2-e1d022cdf216 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] [instance: a49437df-3059-4528-8328-2f3471d5fb45] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:31:27.104892 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-0a4c039d-8b45-4962-85a2-e1d022cdf216 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:31:27.105346 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-0a4c039d-8b45-4962-85a2-e1d022cdf216 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:31:27.106131 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-0a4c039d-8b45-4962-85a2-e1d022cdf216 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:31:27.106566 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-0a4c039d-8b45-4962-85a2-e1d022cdf216 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:31:27.137062 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-bd615120-6395-4db7-b41b-6fe1abad63ce tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] 10.222.0.11 "POST /compute/v2.1/servers/0698dc5b-5f47-46c4-ace8-f5e891a964a0/action" status: 202 len: 0 microversion: 2.1 time: 0.121714 Nov 17 03:31:27.137654 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 604/1176] 10.222.0.11 () {60 vars in 1277 bytes} [Wed Nov 17 03:31:27 2021] POST /compute/v2.1/servers/0698dc5b-5f47-46c4-ace8-f5e891a964a0/action => generated 0 bytes in 123 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 17 03:31:27.138403 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-0a4c039d-8b45-4962-85a2-e1d022cdf216 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] 10.222.0.11 "GET /compute/v2.1/servers/a49437df-3059-4528-8328-2f3471d5fb45/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044441 Nov 17 03:31:27.139132 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 573/1177] 10.222.0.11 () {58 vars in 1301 bytes} [Wed Nov 17 03:31:27 2021] GET /compute/v2.1/servers/a49437df-3059-4528-8328-2f3471d5fb45/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 17 03:31:27.147018 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-246dac46-0bad-4023-b1ee-10c368722203 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:31:27.147710 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-246dac46-0bad-4023-b1ee-10c368722203 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] [instance: 0698dc5b-5f47-46c4-ace8-f5e891a964a0] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:31:27.153890 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-246dac46-0bad-4023-b1ee-10c368722203 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:31:27.154558 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-246dac46-0bad-4023-b1ee-10c368722203 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:31:27.155446 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-246dac46-0bad-4023-b1ee-10c368722203 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:31:27.155967 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-246dac46-0bad-4023-b1ee-10c368722203 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:31:27.323120 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-246dac46-0bad-4023-b1ee-10c368722203 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '163b2f24a72649ac8084be1cac32fa09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e123e9b86124c93a7fc2db9984e7466', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:31:27.335373 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-246dac46-0bad-4023-b1ee-10c368722203 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] 10.222.0.11 "GET /compute/v2.1/servers/0698dc5b-5f47-46c4-ace8-f5e891a964a0" status: 200 len: 1565 microversion: 2.1 time: 0.192073 Nov 17 03:31:27.336279 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 605/1178] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:31:27 2021] GET /compute/v2.1/servers/0698dc5b-5f47-46c4-ace8-f5e891a964a0 => generated 1565 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 17 03:31:27.714817 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-5b5f0bcc-b57f-4ebf-a413-f2994e80df64 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:31:27.716286 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-5b5f0bcc-b57f-4ebf-a413-f2994e80df64 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] [instance: 5d54db85-b991-4890-abaa-952413baa2e7] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:31:27.727319 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-5b5f0bcc-b57f-4ebf-a413-f2994e80df64 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:31:27.728067 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-5b5f0bcc-b57f-4ebf-a413-f2994e80df64 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:31:27.729400 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-5b5f0bcc-b57f-4ebf-a413-f2994e80df64 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:31:27.730125 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-5b5f0bcc-b57f-4ebf-a413-f2994e80df64 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:31:27.761294 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-5b5f0bcc-b57f-4ebf-a413-f2994e80df64 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] 10.222.0.11 "GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.052957 Nov 17 03:31:27.761857 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 574/1179] 10.222.0.11 () {60 vars in 1342 bytes} [Wed Nov 17 03:31:27 2021] GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 17 03:31:27.927327 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-4d1952e0-97ba-4d32-b6b0-3e0100aa542c tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:31:27.928144 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-4d1952e0-97ba-4d32-b6b0-3e0100aa542c tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] [instance: 5ddbfaaa-fabf-4324-941c-8868625ffefc] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:31:27.938206 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-4d1952e0-97ba-4d32-b6b0-3e0100aa542c tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:31:27.938656 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-4d1952e0-97ba-4d32-b6b0-3e0100aa542c tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:31:27.939425 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-4d1952e0-97ba-4d32-b6b0-3e0100aa542c tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:31:27.939866 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-4d1952e0-97ba-4d32-b6b0-3e0100aa542c tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:31:28.010589 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-4d1952e0-97ba-4d32-b6b0-3e0100aa542c tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80763e09d44c475ea2425b22874e9612', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fef02a1dd77946a2ac0e0414b557435f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:31:28.023431 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-4d1952e0-97ba-4d32-b6b0-3e0100aa542c tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] 10.222.0.11 "GET /compute/v2.1/servers/5ddbfaaa-fabf-4324-941c-8868625ffefc" status: 200 len: 1226 microversion: 2.1 time: 0.102251 Nov 17 03:31:28.024234 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 606/1180] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:31:27 2021] GET /compute/v2.1/servers/5ddbfaaa-fabf-4324-941c-8868625ffefc => generated 1226 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:31:28.154010 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-f10a7ae8-dc21-4cba-b296-11c22386b215 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:31:28.155242 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-f10a7ae8-dc21-4cba-b296-11c22386b215 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] [instance: a49437df-3059-4528-8328-2f3471d5fb45] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:31:28.161809 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-f10a7ae8-dc21-4cba-b296-11c22386b215 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:31:28.162270 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-f10a7ae8-dc21-4cba-b296-11c22386b215 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:31:28.163041 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-f10a7ae8-dc21-4cba-b296-11c22386b215 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:31:28.163475 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-f10a7ae8-dc21-4cba-b296-11c22386b215 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:31:28.193380 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-f10a7ae8-dc21-4cba-b296-11c22386b215 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] 10.222.0.11 "GET /compute/v2.1/servers/a49437df-3059-4528-8328-2f3471d5fb45/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045721 Nov 17 03:31:28.193855 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 575/1181] 10.222.0.11 () {58 vars in 1301 bytes} [Wed Nov 17 03:31:28 2021] GET /compute/v2.1/servers/a49437df-3059-4528-8328-2f3471d5fb45/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 17 03:31:28.359424 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-fe02d867-39f7-412a-b89b-f2f585b937ad tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:31:28.360159 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-fe02d867-39f7-412a-b89b-f2f585b937ad tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] [instance: 0698dc5b-5f47-46c4-ace8-f5e891a964a0] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:31:28.369207 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-fe02d867-39f7-412a-b89b-f2f585b937ad tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:31:28.369751 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-fe02d867-39f7-412a-b89b-f2f585b937ad tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:31:28.370640 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-fe02d867-39f7-412a-b89b-f2f585b937ad tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:31:28.371181 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-fe02d867-39f7-412a-b89b-f2f585b937ad tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:31:28.516027 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-fe02d867-39f7-412a-b89b-f2f585b937ad tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '163b2f24a72649ac8084be1cac32fa09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e123e9b86124c93a7fc2db9984e7466', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:31:28.526997 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-fe02d867-39f7-412a-b89b-f2f585b937ad tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] 10.222.0.11 "GET /compute/v2.1/servers/0698dc5b-5f47-46c4-ace8-f5e891a964a0" status: 200 len: 1565 microversion: 2.1 time: 0.173728 Nov 17 03:31:28.527730 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 607/1182] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:31:28 2021] GET /compute/v2.1/servers/0698dc5b-5f47-46c4-ace8-f5e891a964a0 => generated 1565 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:31:28.777306 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-111ea271-6b64-4fb0-b82a-74396a651fb7 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:31:28.778722 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-111ea271-6b64-4fb0-b82a-74396a651fb7 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] [instance: 5d54db85-b991-4890-abaa-952413baa2e7] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:31:28.786444 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-111ea271-6b64-4fb0-b82a-74396a651fb7 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:31:28.786891 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-111ea271-6b64-4fb0-b82a-74396a651fb7 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:31:28.787663 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-111ea271-6b64-4fb0-b82a-74396a651fb7 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:31:28.788202 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-111ea271-6b64-4fb0-b82a-74396a651fb7 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:31:28.817300 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-111ea271-6b64-4fb0-b82a-74396a651fb7 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] 10.222.0.11 "GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046480 Nov 17 03:31:28.817848 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 576/1183] 10.222.0.11 () {60 vars in 1342 bytes} [Wed Nov 17 03:31:28 2021] GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 17 03:31:29.046285 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-057f1c57-ce4d-4864-a953-47517d082f01 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:31:29.046918 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-057f1c57-ce4d-4864-a953-47517d082f01 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] [instance: 5ddbfaaa-fabf-4324-941c-8868625ffefc] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:31:29.054814 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-057f1c57-ce4d-4864-a953-47517d082f01 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:31:29.056212 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-057f1c57-ce4d-4864-a953-47517d082f01 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:31:29.056620 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-057f1c57-ce4d-4864-a953-47517d082f01 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:31:29.057165 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-057f1c57-ce4d-4864-a953-47517d082f01 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:31:29.123447 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-057f1c57-ce4d-4864-a953-47517d082f01 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80763e09d44c475ea2425b22874e9612', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fef02a1dd77946a2ac0e0414b557435f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:31:29.131460 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-057f1c57-ce4d-4864-a953-47517d082f01 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] 10.222.0.11 "GET /compute/v2.1/servers/5ddbfaaa-fabf-4324-941c-8868625ffefc" status: 200 len: 1226 microversion: 2.1 time: 0.091706 Nov 17 03:31:29.132036 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 608/1184] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:31:29 2021] GET /compute/v2.1/servers/5ddbfaaa-fabf-4324-941c-8868625ffefc => generated 1226 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:31:29.209619 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-3b4d3fc2-455e-45eb-8be0-90d6bc8c47e4 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:31:29.211367 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-3b4d3fc2-455e-45eb-8be0-90d6bc8c47e4 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] [instance: a49437df-3059-4528-8328-2f3471d5fb45] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:31:29.221898 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-3b4d3fc2-455e-45eb-8be0-90d6bc8c47e4 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:31:29.222636 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-3b4d3fc2-455e-45eb-8be0-90d6bc8c47e4 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:31:29.223898 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-3b4d3fc2-455e-45eb-8be0-90d6bc8c47e4 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:31:29.224605 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-3b4d3fc2-455e-45eb-8be0-90d6bc8c47e4 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:31:29.257756 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-3b4d3fc2-455e-45eb-8be0-90d6bc8c47e4 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] 10.222.0.11 "GET /compute/v2.1/servers/a49437df-3059-4528-8328-2f3471d5fb45/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.054547 Nov 17 03:31:29.258346 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 577/1185] 10.222.0.11 () {58 vars in 1301 bytes} [Wed Nov 17 03:31:29 2021] GET /compute/v2.1/servers/a49437df-3059-4528-8328-2f3471d5fb45/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 17 03:31:29.548438 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-74f4ceec-c4b5-42c6-b08e-c71a1c9dc3ab tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:31:29.549479 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-74f4ceec-c4b5-42c6-b08e-c71a1c9dc3ab tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] [instance: 0698dc5b-5f47-46c4-ace8-f5e891a964a0] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:31:29.560093 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-74f4ceec-c4b5-42c6-b08e-c71a1c9dc3ab tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:31:29.560888 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-74f4ceec-c4b5-42c6-b08e-c71a1c9dc3ab tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:31:29.561658 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-74f4ceec-c4b5-42c6-b08e-c71a1c9dc3ab tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:31:29.562083 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-74f4ceec-c4b5-42c6-b08e-c71a1c9dc3ab tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:31:29.709967 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-74f4ceec-c4b5-42c6-b08e-c71a1c9dc3ab tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '163b2f24a72649ac8084be1cac32fa09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e123e9b86124c93a7fc2db9984e7466', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:31:29.718654 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-74f4ceec-c4b5-42c6-b08e-c71a1c9dc3ab tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] 10.222.0.11 "GET /compute/v2.1/servers/0698dc5b-5f47-46c4-ace8-f5e891a964a0" status: 200 len: 1565 microversion: 2.1 time: 0.176584 Nov 17 03:31:29.719208 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 609/1186] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:31:29 2021] GET /compute/v2.1/servers/0698dc5b-5f47-46c4-ace8-f5e891a964a0 => generated 1565 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:31:29.833249 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-2d000693-9d60-4788-80b3-01017f19ca4b tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:31:29.834572 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-2d000693-9d60-4788-80b3-01017f19ca4b tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] [instance: 5d54db85-b991-4890-abaa-952413baa2e7] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:31:29.844917 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-2d000693-9d60-4788-80b3-01017f19ca4b tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:31:29.845657 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-2d000693-9d60-4788-80b3-01017f19ca4b tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:31:29.846917 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-2d000693-9d60-4788-80b3-01017f19ca4b tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:31:29.847639 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-2d000693-9d60-4788-80b3-01017f19ca4b tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:31:29.881609 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-2d000693-9d60-4788-80b3-01017f19ca4b tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] 10.222.0.11 "GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.055129 Nov 17 03:31:29.882166 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 578/1187] 10.222.0.11 () {60 vars in 1342 bytes} [Wed Nov 17 03:31:29 2021] GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7/os-volume_attachments => generated 197 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 17 03:31:30.152516 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-b8e57c80-16f2-47bb-9c05-3c3fd8f65bca tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:31:30.153416 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-b8e57c80-16f2-47bb-9c05-3c3fd8f65bca tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] [instance: 5ddbfaaa-fabf-4324-941c-8868625ffefc] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:31:30.160516 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-b8e57c80-16f2-47bb-9c05-3c3fd8f65bca tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:31:30.160997 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-b8e57c80-16f2-47bb-9c05-3c3fd8f65bca tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:31:30.161759 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-b8e57c80-16f2-47bb-9c05-3c3fd8f65bca tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:31:30.162221 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-b8e57c80-16f2-47bb-9c05-3c3fd8f65bca tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:31:30.229541 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-b8e57c80-16f2-47bb-9c05-3c3fd8f65bca tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80763e09d44c475ea2425b22874e9612', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fef02a1dd77946a2ac0e0414b557435f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:31:30.237169 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-b8e57c80-16f2-47bb-9c05-3c3fd8f65bca tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] 10.222.0.11 "GET /compute/v2.1/servers/5ddbfaaa-fabf-4324-941c-8868625ffefc" status: 200 len: 1226 microversion: 2.1 time: 0.091085 Nov 17 03:31:30.237744 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 610/1188] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:31:30 2021] GET /compute/v2.1/servers/5ddbfaaa-fabf-4324-941c-8868625ffefc => generated 1226 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:31:30.272913 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-5c22689b-4c56-4dde-aaab-cd019dce29be tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:31:30.274111 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-5c22689b-4c56-4dde-aaab-cd019dce29be tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] [instance: a49437df-3059-4528-8328-2f3471d5fb45] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:31:30.283072 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-5c22689b-4c56-4dde-aaab-cd019dce29be tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:31:30.283555 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-5c22689b-4c56-4dde-aaab-cd019dce29be tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:31:30.284327 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-5c22689b-4c56-4dde-aaab-cd019dce29be tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:31:30.284756 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-5c22689b-4c56-4dde-aaab-cd019dce29be tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:31:30.315200 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-5c22689b-4c56-4dde-aaab-cd019dce29be tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] 10.222.0.11 "GET /compute/v2.1/servers/a49437df-3059-4528-8328-2f3471d5fb45/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048573 Nov 17 03:31:30.315749 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 579/1189] 10.222.0.11 () {58 vars in 1301 bytes} [Wed Nov 17 03:31:30 2021] GET /compute/v2.1/servers/a49437df-3059-4528-8328-2f3471d5fb45/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 17 03:31:30.744244 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-715a1870-ff1a-438b-8b50-1afbe3744b3c tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:31:30.745301 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-715a1870-ff1a-438b-8b50-1afbe3744b3c tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] [instance: 0698dc5b-5f47-46c4-ace8-f5e891a964a0] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:31:30.755982 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-715a1870-ff1a-438b-8b50-1afbe3744b3c tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:31:30.756730 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-715a1870-ff1a-438b-8b50-1afbe3744b3c tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:31:30.758078 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-715a1870-ff1a-438b-8b50-1afbe3744b3c tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:31:30.758808 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-715a1870-ff1a-438b-8b50-1afbe3744b3c tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:31:30.893998 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-e9915bdf-e982-4fdb-a6ea-99be73f6e2b6 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:31:30.894960 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-e9915bdf-e982-4fdb-a6ea-99be73f6e2b6 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] [instance: 5d54db85-b991-4890-abaa-952413baa2e7] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:31:30.900950 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-e9915bdf-e982-4fdb-a6ea-99be73f6e2b6 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:31:30.901396 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-e9915bdf-e982-4fdb-a6ea-99be73f6e2b6 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:31:30.902166 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-e9915bdf-e982-4fdb-a6ea-99be73f6e2b6 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:31:30.902599 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-e9915bdf-e982-4fdb-a6ea-99be73f6e2b6 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:31:30.906269 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-715a1870-ff1a-438b-8b50-1afbe3744b3c tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '163b2f24a72649ac8084be1cac32fa09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e123e9b86124c93a7fc2db9984e7466', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:31:30.913972 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-715a1870-ff1a-438b-8b50-1afbe3744b3c tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] 10.222.0.11 "GET /compute/v2.1/servers/0698dc5b-5f47-46c4-ace8-f5e891a964a0" status: 200 len: 1565 microversion: 2.1 time: 0.175935 Nov 17 03:31:30.914581 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 611/1190] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:31:30 2021] GET /compute/v2.1/servers/0698dc5b-5f47-46c4-ace8-f5e891a964a0 => generated 1565 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:31:30.933749 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-e9915bdf-e982-4fdb-a6ea-99be73f6e2b6 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] 10.222.0.11 "GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043775 Nov 17 03:31:30.934313 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 580/1191] 10.222.0.11 () {60 vars in 1342 bytes} [Wed Nov 17 03:31:30 2021] GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 17 03:31:31.257294 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-86c2eaf2-55ef-4fcb-a266-f53bd6fc3837 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:31:31.258253 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-86c2eaf2-55ef-4fcb-a266-f53bd6fc3837 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] [instance: 5ddbfaaa-fabf-4324-941c-8868625ffefc] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:31:31.267237 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-86c2eaf2-55ef-4fcb-a266-f53bd6fc3837 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:31:31.267683 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-86c2eaf2-55ef-4fcb-a266-f53bd6fc3837 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:31:31.268448 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-86c2eaf2-55ef-4fcb-a266-f53bd6fc3837 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:31:31.268911 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-86c2eaf2-55ef-4fcb-a266-f53bd6fc3837 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:31:31.327071 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-e565e906-ff5a-4337-94ae-08b34128801e tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:31:31.327981 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-e565e906-ff5a-4337-94ae-08b34128801e tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] [instance: a49437df-3059-4528-8328-2f3471d5fb45] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:31:31.328508 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-86c2eaf2-55ef-4fcb-a266-f53bd6fc3837 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80763e09d44c475ea2425b22874e9612', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fef02a1dd77946a2ac0e0414b557435f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:31:31.334716 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-e565e906-ff5a-4337-94ae-08b34128801e tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:31:31.335158 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-e565e906-ff5a-4337-94ae-08b34128801e tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:31:31.335854 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-86c2eaf2-55ef-4fcb-a266-f53bd6fc3837 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] 10.222.0.11 "GET /compute/v2.1/servers/5ddbfaaa-fabf-4324-941c-8868625ffefc" status: 200 len: 1226 microversion: 2.1 time: 0.084782 Nov 17 03:31:31.336018 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-e565e906-ff5a-4337-94ae-08b34128801e tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:31:31.336679 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-e565e906-ff5a-4337-94ae-08b34128801e tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:31:31.336912 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 612/1192] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:31:31 2021] GET /compute/v2.1/servers/5ddbfaaa-fabf-4324-941c-8868625ffefc => generated 1226 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:31:31.366488 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-e565e906-ff5a-4337-94ae-08b34128801e tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] 10.222.0.11 "GET /compute/v2.1/servers/a49437df-3059-4528-8328-2f3471d5fb45/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043345 Nov 17 03:31:31.367036 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 581/1193] 10.222.0.11 () {58 vars in 1301 bytes} [Wed Nov 17 03:31:31 2021] GET /compute/v2.1/servers/a49437df-3059-4528-8328-2f3471d5fb45/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 17 03:31:31.936548 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-2d993615-5ff1-44cf-9f50-f77d24c80c97 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:31:31.937295 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-2d993615-5ff1-44cf-9f50-f77d24c80c97 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] [instance: 0698dc5b-5f47-46c4-ace8-f5e891a964a0] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:31:31.944250 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-2d993615-5ff1-44cf-9f50-f77d24c80c97 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:31:31.944694 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-2d993615-5ff1-44cf-9f50-f77d24c80c97 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:31:31.945664 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-2d993615-5ff1-44cf-9f50-f77d24c80c97 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:31:31.946098 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-2d993615-5ff1-44cf-9f50-f77d24c80c97 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:31:31.947665 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-419d6563-ac66-4ac0-ad7a-a217265f978a tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:31:31.948598 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-419d6563-ac66-4ac0-ad7a-a217265f978a tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] [instance: 5d54db85-b991-4890-abaa-952413baa2e7] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:31:31.955324 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-419d6563-ac66-4ac0-ad7a-a217265f978a tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:31:31.955858 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-419d6563-ac66-4ac0-ad7a-a217265f978a tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:31:31.956672 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-419d6563-ac66-4ac0-ad7a-a217265f978a tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:31:31.957287 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-419d6563-ac66-4ac0-ad7a-a217265f978a tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:31:31.987417 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-419d6563-ac66-4ac0-ad7a-a217265f978a tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] 10.222.0.11 "GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044990 Nov 17 03:31:31.988254 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 582/1194] 10.222.0.11 () {60 vars in 1342 bytes} [Wed Nov 17 03:31:31 2021] GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 17 03:31:32.092868 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-2d993615-5ff1-44cf-9f50-f77d24c80c97 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '163b2f24a72649ac8084be1cac32fa09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e123e9b86124c93a7fc2db9984e7466', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:31:32.100248 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-2d993615-5ff1-44cf-9f50-f77d24c80c97 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] 10.222.0.11 "GET /compute/v2.1/servers/0698dc5b-5f47-46c4-ace8-f5e891a964a0" status: 200 len: 1565 microversion: 2.1 time: 0.171426 Nov 17 03:31:32.100812 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 613/1195] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:31:31 2021] GET /compute/v2.1/servers/0698dc5b-5f47-46c4-ace8-f5e891a964a0 => generated 1565 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:31:32.353384 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-31f3840f-aee1-4a0f-8210-84d68aa34c80 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:31:32.354010 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-31f3840f-aee1-4a0f-8210-84d68aa34c80 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] [instance: 5ddbfaaa-fabf-4324-941c-8868625ffefc] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:31:32.360837 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-31f3840f-aee1-4a0f-8210-84d68aa34c80 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:31:32.361289 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-31f3840f-aee1-4a0f-8210-84d68aa34c80 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:31:32.362053 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-31f3840f-aee1-4a0f-8210-84d68aa34c80 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:31:32.362458 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-31f3840f-aee1-4a0f-8210-84d68aa34c80 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:31:32.378207 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-885eadb9-8a5d-4c6e-9a20-242d5de52d30 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:31:32.379294 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-885eadb9-8a5d-4c6e-9a20-242d5de52d30 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] [instance: a49437df-3059-4528-8328-2f3471d5fb45] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:31:32.385868 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-885eadb9-8a5d-4c6e-9a20-242d5de52d30 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:31:32.386316 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-885eadb9-8a5d-4c6e-9a20-242d5de52d30 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:31:32.387082 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-885eadb9-8a5d-4c6e-9a20-242d5de52d30 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:31:32.387530 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-885eadb9-8a5d-4c6e-9a20-242d5de52d30 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:31:32.418629 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-885eadb9-8a5d-4c6e-9a20-242d5de52d30 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] 10.222.0.11 "GET /compute/v2.1/servers/a49437df-3059-4528-8328-2f3471d5fb45/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044157 Nov 17 03:31:32.419213 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 614/1196] 10.222.0.11 () {58 vars in 1301 bytes} [Wed Nov 17 03:31:32 2021] GET /compute/v2.1/servers/a49437df-3059-4528-8328-2f3471d5fb45/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 17 03:31:32.423390 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-31f3840f-aee1-4a0f-8210-84d68aa34c80 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80763e09d44c475ea2425b22874e9612', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fef02a1dd77946a2ac0e0414b557435f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:31:32.431222 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-31f3840f-aee1-4a0f-8210-84d68aa34c80 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] 10.222.0.11 "GET /compute/v2.1/servers/5ddbfaaa-fabf-4324-941c-8868625ffefc" status: 200 len: 1226 microversion: 2.1 time: 0.081155 Nov 17 03:31:32.431764 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 583/1197] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:31:32 2021] GET /compute/v2.1/servers/5ddbfaaa-fabf-4324-941c-8868625ffefc => generated 1226 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:31:32.999493 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-cac25528-267f-4549-b6b7-db3ea5bcdda6 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:31:33.000395 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-cac25528-267f-4549-b6b7-db3ea5bcdda6 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] [instance: 5d54db85-b991-4890-abaa-952413baa2e7] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:31:33.006778 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-cac25528-267f-4549-b6b7-db3ea5bcdda6 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:31:33.007215 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-cac25528-267f-4549-b6b7-db3ea5bcdda6 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:31:33.007976 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-cac25528-267f-4549-b6b7-db3ea5bcdda6 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:31:33.008396 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-cac25528-267f-4549-b6b7-db3ea5bcdda6 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:31:33.038542 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-cac25528-267f-4549-b6b7-db3ea5bcdda6 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] 10.222.0.11 "GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042915 Nov 17 03:31:33.039102 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 615/1198] 10.222.0.11 () {60 vars in 1342 bytes} [Wed Nov 17 03:31:32 2021] GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 17 03:31:33.117675 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-bcaa434b-1828-4eb9-8845-faa916953646 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:31:33.118441 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-bcaa434b-1828-4eb9-8845-faa916953646 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] [instance: 0698dc5b-5f47-46c4-ace8-f5e891a964a0] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:31:33.125108 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-bcaa434b-1828-4eb9-8845-faa916953646 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:31:33.125553 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-bcaa434b-1828-4eb9-8845-faa916953646 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:31:33.126317 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-bcaa434b-1828-4eb9-8845-faa916953646 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:31:33.126740 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-bcaa434b-1828-4eb9-8845-faa916953646 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:31:33.269497 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-bcaa434b-1828-4eb9-8845-faa916953646 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '163b2f24a72649ac8084be1cac32fa09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e123e9b86124c93a7fc2db9984e7466', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:31:33.277522 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-bcaa434b-1828-4eb9-8845-faa916953646 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] 10.222.0.11 "GET /compute/v2.1/servers/0698dc5b-5f47-46c4-ace8-f5e891a964a0" status: 200 len: 1565 microversion: 2.1 time: 0.163651 Nov 17 03:31:33.278094 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 584/1199] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:31:33 2021] GET /compute/v2.1/servers/0698dc5b-5f47-46c4-ace8-f5e891a964a0 => generated 1565 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:31:33.434082 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-7fd659c4-d1a0-4ed7-bc8f-801c89eb252d tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:31:33.435326 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-7fd659c4-d1a0-4ed7-bc8f-801c89eb252d tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] [instance: a49437df-3059-4528-8328-2f3471d5fb45] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:31:33.442553 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-7fd659c4-d1a0-4ed7-bc8f-801c89eb252d tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:31:33.442997 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-7fd659c4-d1a0-4ed7-bc8f-801c89eb252d tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:31:33.443765 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-7fd659c4-d1a0-4ed7-bc8f-801c89eb252d tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:31:33.444195 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-7fd659c4-d1a0-4ed7-bc8f-801c89eb252d tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:31:33.447503 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-3e53d2da-203f-4920-908b-7072488b8427 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:31:33.450218 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-3e53d2da-203f-4920-908b-7072488b8427 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] [instance: 5ddbfaaa-fabf-4324-941c-8868625ffefc] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:31:33.454722 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-3e53d2da-203f-4920-908b-7072488b8427 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:31:33.455165 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-3e53d2da-203f-4920-908b-7072488b8427 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:31:33.455901 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-3e53d2da-203f-4920-908b-7072488b8427 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:31:33.456352 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-3e53d2da-203f-4920-908b-7072488b8427 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:31:33.474916 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-7fd659c4-d1a0-4ed7-bc8f-801c89eb252d tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] 10.222.0.11 "GET /compute/v2.1/servers/a49437df-3059-4528-8328-2f3471d5fb45/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047072 Nov 17 03:31:33.475512 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 616/1200] 10.222.0.11 () {58 vars in 1301 bytes} [Wed Nov 17 03:31:33 2021] GET /compute/v2.1/servers/a49437df-3059-4528-8328-2f3471d5fb45/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 17 03:31:33.517176 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-3e53d2da-203f-4920-908b-7072488b8427 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80763e09d44c475ea2425b22874e9612', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fef02a1dd77946a2ac0e0414b557435f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:31:33.524592 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-3e53d2da-203f-4920-908b-7072488b8427 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] 10.222.0.11 "GET /compute/v2.1/servers/5ddbfaaa-fabf-4324-941c-8868625ffefc" status: 200 len: 1226 microversion: 2.1 time: 0.080817 Nov 17 03:31:33.525186 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 585/1201] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:31:33 2021] GET /compute/v2.1/servers/5ddbfaaa-fabf-4324-941c-8868625ffefc => generated 1226 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:31:34.050789 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-2ac697df-fb7a-495b-835e-9e66599960f7 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:31:34.051736 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-2ac697df-fb7a-495b-835e-9e66599960f7 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] [instance: 5d54db85-b991-4890-abaa-952413baa2e7] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:31:34.058530 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-2ac697df-fb7a-495b-835e-9e66599960f7 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:31:34.058984 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-2ac697df-fb7a-495b-835e-9e66599960f7 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:31:34.059765 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-2ac697df-fb7a-495b-835e-9e66599960f7 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:31:34.060202 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-2ac697df-fb7a-495b-835e-9e66599960f7 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:31:34.090078 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-2ac697df-fb7a-495b-835e-9e66599960f7 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] 10.222.0.11 "GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043302 Nov 17 03:31:34.090642 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 617/1202] 10.222.0.11 () {60 vars in 1342 bytes} [Wed Nov 17 03:31:34 2021] GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 17 03:31:34.299907 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-67edaab2-b8dd-4733-8101-f60f943d260f tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:31:34.300515 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-67edaab2-b8dd-4733-8101-f60f943d260f tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] [instance: 0698dc5b-5f47-46c4-ace8-f5e891a964a0] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:31:34.307773 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-67edaab2-b8dd-4733-8101-f60f943d260f tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:31:34.308150 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-67edaab2-b8dd-4733-8101-f60f943d260f tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:31:34.308963 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-67edaab2-b8dd-4733-8101-f60f943d260f tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:31:34.309398 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-67edaab2-b8dd-4733-8101-f60f943d260f tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:31:34.454391 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-67edaab2-b8dd-4733-8101-f60f943d260f tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '163b2f24a72649ac8084be1cac32fa09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e123e9b86124c93a7fc2db9984e7466', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:31:34.467040 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-67edaab2-b8dd-4733-8101-f60f943d260f tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] 10.222.0.11 "GET /compute/v2.1/servers/0698dc5b-5f47-46c4-ace8-f5e891a964a0" status: 200 len: 1565 microversion: 2.1 time: 0.170962 Nov 17 03:31:34.468085 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 586/1203] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:31:34 2021] GET /compute/v2.1/servers/0698dc5b-5f47-46c4-ace8-f5e891a964a0 => generated 1565 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:31:34.488689 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-b63135fa-23b5-401c-8863-e5adabcb399d tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:31:34.489705 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-b63135fa-23b5-401c-8863-e5adabcb399d tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] [instance: a49437df-3059-4528-8328-2f3471d5fb45] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:31:34.496320 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-b63135fa-23b5-401c-8863-e5adabcb399d tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:31:34.496802 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-b63135fa-23b5-401c-8863-e5adabcb399d tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:31:34.497737 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-b63135fa-23b5-401c-8863-e5adabcb399d tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:31:34.498173 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-b63135fa-23b5-401c-8863-e5adabcb399d tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:31:34.528019 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-b63135fa-23b5-401c-8863-e5adabcb399d tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] 10.222.0.11 "GET /compute/v2.1/servers/a49437df-3059-4528-8328-2f3471d5fb45/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043278 Nov 17 03:31:34.528606 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 618/1204] 10.222.0.11 () {58 vars in 1301 bytes} [Wed Nov 17 03:31:34 2021] GET /compute/v2.1/servers/a49437df-3059-4528-8328-2f3471d5fb45/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 17 03:31:34.541948 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-d60a0194-f200-4921-a5d4-4be91b0ab5dd tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:31:34.542554 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-d60a0194-f200-4921-a5d4-4be91b0ab5dd tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] [instance: 5ddbfaaa-fabf-4324-941c-8868625ffefc] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:31:34.549541 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-d60a0194-f200-4921-a5d4-4be91b0ab5dd tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:31:34.549989 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-d60a0194-f200-4921-a5d4-4be91b0ab5dd tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:31:34.552875 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-d60a0194-f200-4921-a5d4-4be91b0ab5dd tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:31:34.553540 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-d60a0194-f200-4921-a5d4-4be91b0ab5dd tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:31:34.617167 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-d60a0194-f200-4921-a5d4-4be91b0ab5dd tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80763e09d44c475ea2425b22874e9612', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fef02a1dd77946a2ac0e0414b557435f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:31:34.625649 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-d60a0194-f200-4921-a5d4-4be91b0ab5dd tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] 10.222.0.11 "GET /compute/v2.1/servers/5ddbfaaa-fabf-4324-941c-8868625ffefc" status: 200 len: 1226 microversion: 2.1 time: 0.087795 Nov 17 03:31:34.626216 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 587/1205] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:31:34 2021] GET /compute/v2.1/servers/5ddbfaaa-fabf-4324-941c-8868625ffefc => generated 1226 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:31:35.102596 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-c2883b8b-aaa0-4be0-bc9a-044427a35e8e tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:31:35.103504 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-c2883b8b-aaa0-4be0-bc9a-044427a35e8e tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] [instance: 5d54db85-b991-4890-abaa-952413baa2e7] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:31:35.110061 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-c2883b8b-aaa0-4be0-bc9a-044427a35e8e tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:31:35.110511 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-c2883b8b-aaa0-4be0-bc9a-044427a35e8e tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:31:35.111275 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-c2883b8b-aaa0-4be0-bc9a-044427a35e8e tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:31:35.111707 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-c2883b8b-aaa0-4be0-bc9a-044427a35e8e tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:31:35.141331 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-c2883b8b-aaa0-4be0-bc9a-044427a35e8e tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] 10.222.0.11 "GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042546 Nov 17 03:31:35.141882 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 619/1206] 10.222.0.11 () {60 vars in 1342 bytes} [Wed Nov 17 03:31:35 2021] GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 17 03:31:35.491715 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-9b8f7338-8462-4347-ab79-ec5e053a8787 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:31:35.492289 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-9b8f7338-8462-4347-ab79-ec5e053a8787 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] [instance: 0698dc5b-5f47-46c4-ace8-f5e891a964a0] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:31:35.499548 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-9b8f7338-8462-4347-ab79-ec5e053a8787 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:31:35.500010 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-9b8f7338-8462-4347-ab79-ec5e053a8787 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:31:35.500812 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-9b8f7338-8462-4347-ab79-ec5e053a8787 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:31:35.501261 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-9b8f7338-8462-4347-ab79-ec5e053a8787 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:31:35.539785 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-63c04595-953b-4ff4-aef6-bd869e24039c tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:31:35.540699 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-63c04595-953b-4ff4-aef6-bd869e24039c tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] [instance: a49437df-3059-4528-8328-2f3471d5fb45] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:31:35.547722 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-63c04595-953b-4ff4-aef6-bd869e24039c tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:31:35.548177 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-63c04595-953b-4ff4-aef6-bd869e24039c tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:31:35.549060 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-63c04595-953b-4ff4-aef6-bd869e24039c tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:31:35.549428 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-63c04595-953b-4ff4-aef6-bd869e24039c tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:31:35.581309 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-63c04595-953b-4ff4-aef6-bd869e24039c tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] 10.222.0.11 "GET /compute/v2.1/servers/a49437df-3059-4528-8328-2f3471d5fb45/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045220 Nov 17 03:31:35.581924 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 620/1207] 10.222.0.11 () {58 vars in 1301 bytes} [Wed Nov 17 03:31:35 2021] GET /compute/v2.1/servers/a49437df-3059-4528-8328-2f3471d5fb45/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 17 03:31:35.640666 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-9b8f7338-8462-4347-ab79-ec5e053a8787 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '163b2f24a72649ac8084be1cac32fa09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e123e9b86124c93a7fc2db9984e7466', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:31:35.641720 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-d595fed8-18ce-4f07-b377-d842e9879cd6 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:31:35.642329 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-d595fed8-18ce-4f07-b377-d842e9879cd6 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] [instance: 5ddbfaaa-fabf-4324-941c-8868625ffefc] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:31:35.648445 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-9b8f7338-8462-4347-ab79-ec5e053a8787 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] 10.222.0.11 "GET /compute/v2.1/servers/0698dc5b-5f47-46c4-ace8-f5e891a964a0" status: 200 len: 1565 microversion: 2.1 time: 0.160578 Nov 17 03:31:35.648637 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-d595fed8-18ce-4f07-b377-d842e9879cd6 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:31:35.649030 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-d595fed8-18ce-4f07-b377-d842e9879cd6 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:31:35.649200 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 588/1208] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:31:35 2021] GET /compute/v2.1/servers/0698dc5b-5f47-46c4-ace8-f5e891a964a0 => generated 1565 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:31:35.650658 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-d595fed8-18ce-4f07-b377-d842e9879cd6 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:31:35.651223 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-d595fed8-18ce-4f07-b377-d842e9879cd6 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:31:35.710518 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-d595fed8-18ce-4f07-b377-d842e9879cd6 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80763e09d44c475ea2425b22874e9612', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fef02a1dd77946a2ac0e0414b557435f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:31:35.718204 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-d595fed8-18ce-4f07-b377-d842e9879cd6 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] 10.222.0.11 "GET /compute/v2.1/servers/5ddbfaaa-fabf-4324-941c-8868625ffefc" status: 200 len: 1226 microversion: 2.1 time: 0.080223 Nov 17 03:31:35.718764 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 621/1209] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:31:35 2021] GET /compute/v2.1/servers/5ddbfaaa-fabf-4324-941c-8868625ffefc => generated 1226 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:31:36.156691 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-0de803d7-491a-41e0-b4c5-307d671b0d2b tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:31:36.157851 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-0de803d7-491a-41e0-b4c5-307d671b0d2b tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] [instance: 5d54db85-b991-4890-abaa-952413baa2e7] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:31:36.164549 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-0de803d7-491a-41e0-b4c5-307d671b0d2b tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:31:36.164957 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-0de803d7-491a-41e0-b4c5-307d671b0d2b tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:31:36.166039 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-0de803d7-491a-41e0-b4c5-307d671b0d2b tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:31:36.166188 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-0de803d7-491a-41e0-b4c5-307d671b0d2b tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:31:36.198077 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-0de803d7-491a-41e0-b4c5-307d671b0d2b tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] 10.222.0.11 "GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046709 Nov 17 03:31:36.198624 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 589/1210] 10.222.0.11 () {60 vars in 1342 bytes} [Wed Nov 17 03:31:36 2021] GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 17 03:31:36.597264 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-9a6e3451-c000-493c-be53-a81a57c7c89c tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:31:36.598736 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-9a6e3451-c000-493c-be53-a81a57c7c89c tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] [instance: a49437df-3059-4528-8328-2f3471d5fb45] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:31:36.609284 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-9a6e3451-c000-493c-be53-a81a57c7c89c tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:31:36.609749 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-9a6e3451-c000-493c-be53-a81a57c7c89c tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:31:36.610637 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-9a6e3451-c000-493c-be53-a81a57c7c89c tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:31:36.611076 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-9a6e3451-c000-493c-be53-a81a57c7c89c tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:31:36.640680 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-9a6e3451-c000-493c-be53-a81a57c7c89c tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] 10.222.0.11 "GET /compute/v2.1/servers/a49437df-3059-4528-8328-2f3471d5fb45/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050042 Nov 17 03:31:36.641275 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 622/1211] 10.222.0.11 () {58 vars in 1301 bytes} [Wed Nov 17 03:31:36 2021] GET /compute/v2.1/servers/a49437df-3059-4528-8328-2f3471d5fb45/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 17 03:31:36.665867 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-3d75d508-3715-4931-9e3f-ac3a8a1ec2f9 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:31:36.666481 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-3d75d508-3715-4931-9e3f-ac3a8a1ec2f9 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] [instance: 0698dc5b-5f47-46c4-ace8-f5e891a964a0] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:31:36.673252 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-3d75d508-3715-4931-9e3f-ac3a8a1ec2f9 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:31:36.673702 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-3d75d508-3715-4931-9e3f-ac3a8a1ec2f9 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:31:36.674484 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-3d75d508-3715-4931-9e3f-ac3a8a1ec2f9 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:31:36.674920 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-3d75d508-3715-4931-9e3f-ac3a8a1ec2f9 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:31:36.735816 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-861a1aee-30a9-4fcf-85fa-ec7c6df85335 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:31:36.736426 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-861a1aee-30a9-4fcf-85fa-ec7c6df85335 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] [instance: 5ddbfaaa-fabf-4324-941c-8868625ffefc] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:31:36.742867 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-861a1aee-30a9-4fcf-85fa-ec7c6df85335 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:31:36.743317 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-861a1aee-30a9-4fcf-85fa-ec7c6df85335 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:31:36.744094 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-861a1aee-30a9-4fcf-85fa-ec7c6df85335 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:31:36.744519 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-861a1aee-30a9-4fcf-85fa-ec7c6df85335 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:31:36.807980 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-861a1aee-30a9-4fcf-85fa-ec7c6df85335 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80763e09d44c475ea2425b22874e9612', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fef02a1dd77946a2ac0e0414b557435f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:31:36.815817 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-861a1aee-30a9-4fcf-85fa-ec7c6df85335 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] 10.222.0.11 "GET /compute/v2.1/servers/5ddbfaaa-fabf-4324-941c-8868625ffefc" status: 200 len: 1226 microversion: 2.1 time: 0.083769 Nov 17 03:31:36.816395 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 623/1212] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:31:36 2021] GET /compute/v2.1/servers/5ddbfaaa-fabf-4324-941c-8868625ffefc => generated 1226 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:31:36.817837 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-3d75d508-3715-4931-9e3f-ac3a8a1ec2f9 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '163b2f24a72649ac8084be1cac32fa09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e123e9b86124c93a7fc2db9984e7466', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:31:36.825859 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-3d75d508-3715-4931-9e3f-ac3a8a1ec2f9 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] 10.222.0.11 "GET /compute/v2.1/servers/0698dc5b-5f47-46c4-ace8-f5e891a964a0" status: 200 len: 1565 microversion: 2.1 time: 0.163723 Nov 17 03:31:36.826390 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 590/1213] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:31:36 2021] GET /compute/v2.1/servers/0698dc5b-5f47-46c4-ace8-f5e891a964a0 => generated 1565 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:31:37.213738 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-6be48259-eb58-4780-a8d1-8a8566e8b8a2 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:31:37.215241 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-6be48259-eb58-4780-a8d1-8a8566e8b8a2 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] [instance: 5d54db85-b991-4890-abaa-952413baa2e7] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:31:37.225986 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-6be48259-eb58-4780-a8d1-8a8566e8b8a2 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:31:37.226737 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-6be48259-eb58-4780-a8d1-8a8566e8b8a2 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:31:37.228050 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-6be48259-eb58-4780-a8d1-8a8566e8b8a2 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:31:37.228721 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-6be48259-eb58-4780-a8d1-8a8566e8b8a2 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:31:37.261964 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-6be48259-eb58-4780-a8d1-8a8566e8b8a2 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] 10.222.0.11 "GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.054872 Nov 17 03:31:37.262520 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 624/1214] 10.222.0.11 () {60 vars in 1342 bytes} [Wed Nov 17 03:31:37 2021] GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 17 03:31:37.652535 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-2f5ec527-cca1-4e07-aea0-ade869075961 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:31:37.653401 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-2f5ec527-cca1-4e07-aea0-ade869075961 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] [instance: a49437df-3059-4528-8328-2f3471d5fb45] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:31:37.660918 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-2f5ec527-cca1-4e07-aea0-ade869075961 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:31:37.661365 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-2f5ec527-cca1-4e07-aea0-ade869075961 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:31:37.662144 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-2f5ec527-cca1-4e07-aea0-ade869075961 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:31:37.662589 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-2f5ec527-cca1-4e07-aea0-ade869075961 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:31:37.692460 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-2f5ec527-cca1-4e07-aea0-ade869075961 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] 10.222.0.11 "GET /compute/v2.1/servers/a49437df-3059-4528-8328-2f3471d5fb45/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043922 Nov 17 03:31:37.693177 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 591/1215] 10.222.0.11 () {58 vars in 1301 bytes} [Wed Nov 17 03:31:37 2021] GET /compute/v2.1/servers/a49437df-3059-4528-8328-2f3471d5fb45/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 17 03:31:37.833907 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-012199a2-7736-4536-9fba-ec5eefc597c5 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:31:37.835023 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-012199a2-7736-4536-9fba-ec5eefc597c5 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] [instance: 5ddbfaaa-fabf-4324-941c-8868625ffefc] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:31:37.843412 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-012199a2-7736-4536-9fba-ec5eefc597c5 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:31:37.844207 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-012199a2-7736-4536-9fba-ec5eefc597c5 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:31:37.844371 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-6224e8c1-7f7d-4e0e-a687-736571da6a97 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:31:37.845126 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-6224e8c1-7f7d-4e0e-a687-736571da6a97 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] [instance: 0698dc5b-5f47-46c4-ace8-f5e891a964a0] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:31:37.845288 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-012199a2-7736-4536-9fba-ec5eefc597c5 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:31:37.845709 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-012199a2-7736-4536-9fba-ec5eefc597c5 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:31:37.851706 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-6224e8c1-7f7d-4e0e-a687-736571da6a97 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:31:37.852222 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-6224e8c1-7f7d-4e0e-a687-736571da6a97 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:31:37.853099 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-6224e8c1-7f7d-4e0e-a687-736571da6a97 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:31:37.853596 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-6224e8c1-7f7d-4e0e-a687-736571da6a97 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:31:37.907155 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-012199a2-7736-4536-9fba-ec5eefc597c5 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80763e09d44c475ea2425b22874e9612', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fef02a1dd77946a2ac0e0414b557435f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:31:37.914552 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-012199a2-7736-4536-9fba-ec5eefc597c5 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] 10.222.0.11 "GET /compute/v2.1/servers/5ddbfaaa-fabf-4324-941c-8868625ffefc" status: 200 len: 1226 microversion: 2.1 time: 0.086679 Nov 17 03:31:37.915130 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 625/1216] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:31:37 2021] GET /compute/v2.1/servers/5ddbfaaa-fabf-4324-941c-8868625ffefc => generated 1226 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:31:38.047757 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-6224e8c1-7f7d-4e0e-a687-736571da6a97 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '163b2f24a72649ac8084be1cac32fa09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e123e9b86124c93a7fc2db9984e7466', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:31:38.056675 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-6224e8c1-7f7d-4e0e-a687-736571da6a97 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] 10.222.0.11 "GET /compute/v2.1/servers/0698dc5b-5f47-46c4-ace8-f5e891a964a0" status: 200 len: 1565 microversion: 2.1 time: 0.216311 Nov 17 03:31:38.057503 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 592/1217] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:31:37 2021] GET /compute/v2.1/servers/0698dc5b-5f47-46c4-ace8-f5e891a964a0 => generated 1565 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 17 03:31:38.277831 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-f745a9fe-f4a2-4548-98dc-510ee62a54eb tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:31:38.279287 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-f745a9fe-f4a2-4548-98dc-510ee62a54eb tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] [instance: 5d54db85-b991-4890-abaa-952413baa2e7] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:31:38.290389 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-f745a9fe-f4a2-4548-98dc-510ee62a54eb tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:31:38.291126 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-f745a9fe-f4a2-4548-98dc-510ee62a54eb tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:31:38.292387 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-f745a9fe-f4a2-4548-98dc-510ee62a54eb tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:31:38.293163 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-f745a9fe-f4a2-4548-98dc-510ee62a54eb tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:31:38.324868 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-f745a9fe-f4a2-4548-98dc-510ee62a54eb tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] 10.222.0.11 "GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.053471 Nov 17 03:31:38.325384 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 626/1218] 10.222.0.11 () {60 vars in 1342 bytes} [Wed Nov 17 03:31:38 2021] GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 17 03:31:38.706448 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-847c81de-8988-489b-ae12-fefc2b58e73f tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:31:38.707446 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-847c81de-8988-489b-ae12-fefc2b58e73f tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] [instance: a49437df-3059-4528-8328-2f3471d5fb45] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:31:38.715110 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-847c81de-8988-489b-ae12-fefc2b58e73f tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:31:38.715631 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-847c81de-8988-489b-ae12-fefc2b58e73f tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:31:38.716533 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-847c81de-8988-489b-ae12-fefc2b58e73f tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:31:38.717092 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-847c81de-8988-489b-ae12-fefc2b58e73f tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:31:38.748923 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-847c81de-8988-489b-ae12-fefc2b58e73f tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] 10.222.0.11 "GET /compute/v2.1/servers/a49437df-3059-4528-8328-2f3471d5fb45/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047575 Nov 17 03:31:38.749608 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 593/1219] 10.222.0.11 () {58 vars in 1301 bytes} [Wed Nov 17 03:31:38 2021] GET /compute/v2.1/servers/a49437df-3059-4528-8328-2f3471d5fb45/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 17 03:31:38.939984 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-5718eba0-c86f-4292-88d2-a1ff40dac67b tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:31:38.940967 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-5718eba0-c86f-4292-88d2-a1ff40dac67b tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] [instance: 5ddbfaaa-fabf-4324-941c-8868625ffefc] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:31:38.951608 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-5718eba0-c86f-4292-88d2-a1ff40dac67b tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:31:38.952423 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-5718eba0-c86f-4292-88d2-a1ff40dac67b tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:31:38.953212 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-5718eba0-c86f-4292-88d2-a1ff40dac67b tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:31:38.953639 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-5718eba0-c86f-4292-88d2-a1ff40dac67b tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:31:39.027728 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-5718eba0-c86f-4292-88d2-a1ff40dac67b tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80763e09d44c475ea2425b22874e9612', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fef02a1dd77946a2ac0e0414b557435f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:31:39.039137 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-5718eba0-c86f-4292-88d2-a1ff40dac67b tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] 10.222.0.11 "GET /compute/v2.1/servers/5ddbfaaa-fabf-4324-941c-8868625ffefc" status: 200 len: 1226 microversion: 2.1 time: 0.105439 Nov 17 03:31:39.039915 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 627/1220] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:31:38 2021] GET /compute/v2.1/servers/5ddbfaaa-fabf-4324-941c-8868625ffefc => generated 1226 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:31:39.075509 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-b3e76330-5ed5-4ca5-9fcb-899cb744f06b tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:31:39.076123 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-b3e76330-5ed5-4ca5-9fcb-899cb744f06b tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] [instance: 0698dc5b-5f47-46c4-ace8-f5e891a964a0] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:31:39.082576 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-b3e76330-5ed5-4ca5-9fcb-899cb744f06b tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:31:39.083030 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-b3e76330-5ed5-4ca5-9fcb-899cb744f06b tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:31:39.083806 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-b3e76330-5ed5-4ca5-9fcb-899cb744f06b tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:31:39.084240 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-b3e76330-5ed5-4ca5-9fcb-899cb744f06b tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:31:39.218305 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-b3e76330-5ed5-4ca5-9fcb-899cb744f06b tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '163b2f24a72649ac8084be1cac32fa09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e123e9b86124c93a7fc2db9984e7466', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:31:39.226442 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-b3e76330-5ed5-4ca5-9fcb-899cb744f06b tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] 10.222.0.11 "GET /compute/v2.1/servers/0698dc5b-5f47-46c4-ace8-f5e891a964a0" status: 200 len: 1565 microversion: 2.1 time: 0.154664 Nov 17 03:31:39.227012 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 594/1221] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:31:39 2021] GET /compute/v2.1/servers/0698dc5b-5f47-46c4-ace8-f5e891a964a0 => generated 1565 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:31:39.342431 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-85e42fac-2045-4ef6-b1a7-f0e269a2683d tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:31:39.343612 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-85e42fac-2045-4ef6-b1a7-f0e269a2683d tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] [instance: 5d54db85-b991-4890-abaa-952413baa2e7] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:31:39.349934 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-85e42fac-2045-4ef6-b1a7-f0e269a2683d tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:31:39.350378 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-85e42fac-2045-4ef6-b1a7-f0e269a2683d tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:31:39.351155 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-85e42fac-2045-4ef6-b1a7-f0e269a2683d tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:31:39.351578 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-85e42fac-2045-4ef6-b1a7-f0e269a2683d tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:31:39.381594 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-85e42fac-2045-4ef6-b1a7-f0e269a2683d tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] 10.222.0.11 "GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047044 Nov 17 03:31:39.382164 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 628/1222] 10.222.0.11 () {60 vars in 1342 bytes} [Wed Nov 17 03:31:39 2021] GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 17 03:31:39.764978 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-6d77bac4-30be-4986-9d4d-cf27cf18128d tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:31:39.765896 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-6d77bac4-30be-4986-9d4d-cf27cf18128d tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] [instance: a49437df-3059-4528-8328-2f3471d5fb45] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:31:39.773730 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-6d77bac4-30be-4986-9d4d-cf27cf18128d tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:31:39.774293 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-6d77bac4-30be-4986-9d4d-cf27cf18128d tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:31:39.775088 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-6d77bac4-30be-4986-9d4d-cf27cf18128d tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:31:39.775504 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-6d77bac4-30be-4986-9d4d-cf27cf18128d tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:31:39.806908 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-6d77bac4-30be-4986-9d4d-cf27cf18128d tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] 10.222.0.11 "GET /compute/v2.1/servers/a49437df-3059-4528-8328-2f3471d5fb45/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048363 Nov 17 03:31:39.807680 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 595/1223] 10.222.0.11 () {58 vars in 1301 bytes} [Wed Nov 17 03:31:39 2021] GET /compute/v2.1/servers/a49437df-3059-4528-8328-2f3471d5fb45/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 17 03:31:40.063671 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-b7f62d0c-5b77-4e02-a607-04ca0989b076 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:31:40.064328 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-b7f62d0c-5b77-4e02-a607-04ca0989b076 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] [instance: 5ddbfaaa-fabf-4324-941c-8868625ffefc] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:31:40.071154 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-b7f62d0c-5b77-4e02-a607-04ca0989b076 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:31:40.071605 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-b7f62d0c-5b77-4e02-a607-04ca0989b076 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:31:40.072386 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-b7f62d0c-5b77-4e02-a607-04ca0989b076 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:31:40.072820 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-b7f62d0c-5b77-4e02-a607-04ca0989b076 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:31:40.141585 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-b7f62d0c-5b77-4e02-a607-04ca0989b076 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80763e09d44c475ea2425b22874e9612', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fef02a1dd77946a2ac0e0414b557435f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:31:40.149785 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-b7f62d0c-5b77-4e02-a607-04ca0989b076 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] 10.222.0.11 "GET /compute/v2.1/servers/5ddbfaaa-fabf-4324-941c-8868625ffefc" status: 200 len: 1226 microversion: 2.1 time: 0.092076 Nov 17 03:31:40.150351 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 629/1224] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:31:40 2021] GET /compute/v2.1/servers/5ddbfaaa-fabf-4324-941c-8868625ffefc => generated 1226 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:31:40.253228 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-d07d1073-bb40-4f9a-a15e-4bd0036a2149 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:31:40.254249 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-d07d1073-bb40-4f9a-a15e-4bd0036a2149 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] [instance: 0698dc5b-5f47-46c4-ace8-f5e891a964a0] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:31:40.264537 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-d07d1073-bb40-4f9a-a15e-4bd0036a2149 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:31:40.265358 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-d07d1073-bb40-4f9a-a15e-4bd0036a2149 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:31:40.266567 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-d07d1073-bb40-4f9a-a15e-4bd0036a2149 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:31:40.267001 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-d07d1073-bb40-4f9a-a15e-4bd0036a2149 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:31:40.393407 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-5c54547d-da21-4135-9dd8-fb60d70bb724 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:31:40.394669 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-5c54547d-da21-4135-9dd8-fb60d70bb724 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] [instance: 5d54db85-b991-4890-abaa-952413baa2e7] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:31:40.400697 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-5c54547d-da21-4135-9dd8-fb60d70bb724 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:31:40.401271 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-5c54547d-da21-4135-9dd8-fb60d70bb724 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:31:40.401931 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-5c54547d-da21-4135-9dd8-fb60d70bb724 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:31:40.402359 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-5c54547d-da21-4135-9dd8-fb60d70bb724 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:31:40.404177 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-d07d1073-bb40-4f9a-a15e-4bd0036a2149 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '163b2f24a72649ac8084be1cac32fa09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e123e9b86124c93a7fc2db9984e7466', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:31:40.412069 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-d07d1073-bb40-4f9a-a15e-4bd0036a2149 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] 10.222.0.11 "GET /compute/v2.1/servers/0698dc5b-5f47-46c4-ace8-f5e891a964a0" status: 200 len: 1565 microversion: 2.1 time: 0.164981 Nov 17 03:31:40.412651 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 596/1225] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:31:40 2021] GET /compute/v2.1/servers/0698dc5b-5f47-46c4-ace8-f5e891a964a0 => generated 1565 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:31:40.432831 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-5c54547d-da21-4135-9dd8-fb60d70bb724 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] 10.222.0.11 "GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043360 Nov 17 03:31:40.433416 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 630/1226] 10.222.0.11 () {60 vars in 1342 bytes} [Wed Nov 17 03:31:40 2021] GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 17 03:31:40.823593 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-e138f476-8cdc-4731-bf41-8353ba911298 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:31:40.825129 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-e138f476-8cdc-4731-bf41-8353ba911298 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] [instance: a49437df-3059-4528-8328-2f3471d5fb45] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:31:40.836543 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-e138f476-8cdc-4731-bf41-8353ba911298 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:31:40.837357 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-e138f476-8cdc-4731-bf41-8353ba911298 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:31:40.838672 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-e138f476-8cdc-4731-bf41-8353ba911298 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:31:40.839430 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-e138f476-8cdc-4731-bf41-8353ba911298 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:31:40.870194 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-e138f476-8cdc-4731-bf41-8353ba911298 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] 10.222.0.11 "GET /compute/v2.1/servers/a49437df-3059-4528-8328-2f3471d5fb45/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053023 Nov 17 03:31:40.870753 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 597/1227] 10.222.0.11 () {58 vars in 1301 bytes} [Wed Nov 17 03:31:40 2021] GET /compute/v2.1/servers/a49437df-3059-4528-8328-2f3471d5fb45/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 17 03:31:41.171060 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-baafc5a6-c2dd-464f-90a6-d13d8603b7b4 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:31:41.172078 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-baafc5a6-c2dd-464f-90a6-d13d8603b7b4 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] [instance: 5ddbfaaa-fabf-4324-941c-8868625ffefc] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:31:41.179327 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-baafc5a6-c2dd-464f-90a6-d13d8603b7b4 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:31:41.179802 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-baafc5a6-c2dd-464f-90a6-d13d8603b7b4 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:31:41.181015 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-baafc5a6-c2dd-464f-90a6-d13d8603b7b4 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:31:41.181471 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-baafc5a6-c2dd-464f-90a6-d13d8603b7b4 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:31:41.248864 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-baafc5a6-c2dd-464f-90a6-d13d8603b7b4 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80763e09d44c475ea2425b22874e9612', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fef02a1dd77946a2ac0e0414b557435f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:31:41.256821 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-baafc5a6-c2dd-464f-90a6-d13d8603b7b4 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] 10.222.0.11 "GET /compute/v2.1/servers/5ddbfaaa-fabf-4324-941c-8868625ffefc" status: 200 len: 1226 microversion: 2.1 time: 0.092088 Nov 17 03:31:41.257397 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 631/1228] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:31:41 2021] GET /compute/v2.1/servers/5ddbfaaa-fabf-4324-941c-8868625ffefc => generated 1226 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:31:41.433724 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-b3a4f36b-a541-4b8d-8e01-41a26206bdec tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:31:41.434528 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-b3a4f36b-a541-4b8d-8e01-41a26206bdec tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] [instance: 0698dc5b-5f47-46c4-ace8-f5e891a964a0] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:31:41.442007 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-b3a4f36b-a541-4b8d-8e01-41a26206bdec tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:31:41.442448 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-b3a4f36b-a541-4b8d-8e01-41a26206bdec tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:31:41.443218 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-b3a4f36b-a541-4b8d-8e01-41a26206bdec tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:31:41.443644 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-b3a4f36b-a541-4b8d-8e01-41a26206bdec tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:31:41.444919 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-34490595-070b-4329-a433-300bdc680278 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:31:41.445813 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-34490595-070b-4329-a433-300bdc680278 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] [instance: 5d54db85-b991-4890-abaa-952413baa2e7] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:31:41.452656 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-34490595-070b-4329-a433-300bdc680278 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:31:41.453295 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-34490595-070b-4329-a433-300bdc680278 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:31:41.454083 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-34490595-070b-4329-a433-300bdc680278 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:31:41.454501 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-34490595-070b-4329-a433-300bdc680278 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:31:41.483605 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-34490595-070b-4329-a433-300bdc680278 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] 10.222.0.11 "GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042749 Nov 17 03:31:41.484423 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 632/1229] 10.222.0.11 () {60 vars in 1342 bytes} [Wed Nov 17 03:31:41 2021] GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 17 03:31:41.581886 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-b3a4f36b-a541-4b8d-8e01-41a26206bdec tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '163b2f24a72649ac8084be1cac32fa09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e123e9b86124c93a7fc2db9984e7466', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:31:41.589273 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-b3a4f36b-a541-4b8d-8e01-41a26206bdec tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] 10.222.0.11 "GET /compute/v2.1/servers/0698dc5b-5f47-46c4-ace8-f5e891a964a0" status: 200 len: 1565 microversion: 2.1 time: 0.162371 Nov 17 03:31:41.589809 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 598/1230] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:31:41 2021] GET /compute/v2.1/servers/0698dc5b-5f47-46c4-ace8-f5e891a964a0 => generated 1565 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:31:41.883960 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-2138acab-25aa-4f8d-8225-3ba85fa934f5 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:31:41.885106 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-2138acab-25aa-4f8d-8225-3ba85fa934f5 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] [instance: a49437df-3059-4528-8328-2f3471d5fb45] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:31:41.891999 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-2138acab-25aa-4f8d-8225-3ba85fa934f5 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:31:41.892656 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-2138acab-25aa-4f8d-8225-3ba85fa934f5 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:31:41.893767 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-2138acab-25aa-4f8d-8225-3ba85fa934f5 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:31:41.894201 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-2138acab-25aa-4f8d-8225-3ba85fa934f5 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:31:41.925744 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-2138acab-25aa-4f8d-8225-3ba85fa934f5 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] 10.222.0.11 "GET /compute/v2.1/servers/a49437df-3059-4528-8328-2f3471d5fb45/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045881 Nov 17 03:31:41.930092 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 633/1231] 10.222.0.11 () {58 vars in 1301 bytes} [Wed Nov 17 03:31:41 2021] GET /compute/v2.1/servers/a49437df-3059-4528-8328-2f3471d5fb45/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 17 03:31:41.961716 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [req-0efb5a97-9a88-49e7-bd63-456c99e8db9e req-975cd12c-0bb0-41c3-881b-df0c5e35e1dc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0698dc5b-5f47-46c4-ace8-f5e891a964a0", "name": "network-vif-unplugged", "status": "completed", "tag": "ade336c1-073e-4cb9-90d9-0e1652a810a1"}]} {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 17 03:31:41.963259 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 17 03:31:41.963259 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: warnings.warn(msg) Nov 17 03:31:41.970115 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [req-0efb5a97-9a88-49e7-bd63-456c99e8db9e req-975cd12c-0bb0-41c3-881b-df0c5e35e1dc service nova] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:31:41.970529 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [req-0efb5a97-9a88-49e7-bd63-456c99e8db9e req-975cd12c-0bb0-41c3-881b-df0c5e35e1dc service nova] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:31:41.982031 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.compute.server_external_events [req-0efb5a97-9a88-49e7-bd63-456c99e8db9e req-975cd12c-0bb0-41c3-881b-df0c5e35e1dc service nova] Creating event network-vif-unplugged:ade336c1-073e-4cb9-90d9-0e1652a810a1 for instance 0698dc5b-5f47-46c4-ace8-f5e891a964a0 on hv-cinder-81803 Nov 17 03:31:41.987536 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [req-0efb5a97-9a88-49e7-bd63-456c99e8db9e req-975cd12c-0bb0-41c3-881b-df0c5e35e1dc service nova] 10.222.0.11 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.091082 Nov 17 03:31:41.988185 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 599/1232] 10.222.0.11 () {64 vars in 1317 bytes} [Wed Nov 17 03:31:41 2021] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 17 03:31:42.277646 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-7918a573-d7f7-4205-936b-5d583de8391f tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:31:42.278629 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-7918a573-d7f7-4205-936b-5d583de8391f tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] [instance: 5ddbfaaa-fabf-4324-941c-8868625ffefc] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:31:42.286062 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-7918a573-d7f7-4205-936b-5d583de8391f tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:31:42.286506 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-7918a573-d7f7-4205-936b-5d583de8391f tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:31:42.287282 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-7918a573-d7f7-4205-936b-5d583de8391f tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:31:42.287711 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-7918a573-d7f7-4205-936b-5d583de8391f tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:31:42.355912 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-7918a573-d7f7-4205-936b-5d583de8391f tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80763e09d44c475ea2425b22874e9612', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fef02a1dd77946a2ac0e0414b557435f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:31:42.364153 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-7918a573-d7f7-4205-936b-5d583de8391f tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] 10.222.0.11 "GET /compute/v2.1/servers/5ddbfaaa-fabf-4324-941c-8868625ffefc" status: 200 len: 1226 microversion: 2.1 time: 0.092709 Nov 17 03:31:42.364729 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 634/1233] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:31:42 2021] GET /compute/v2.1/servers/5ddbfaaa-fabf-4324-941c-8868625ffefc => generated 1226 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:31:42.496342 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-3a6487cf-32f8-48ad-a61f-e221af3d49a5 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:31:42.497377 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-3a6487cf-32f8-48ad-a61f-e221af3d49a5 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] [instance: 5d54db85-b991-4890-abaa-952413baa2e7] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:31:42.503487 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-3a6487cf-32f8-48ad-a61f-e221af3d49a5 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:31:42.503933 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-3a6487cf-32f8-48ad-a61f-e221af3d49a5 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:31:42.504743 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-3a6487cf-32f8-48ad-a61f-e221af3d49a5 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:31:42.505218 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-3a6487cf-32f8-48ad-a61f-e221af3d49a5 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:31:42.536159 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-3a6487cf-32f8-48ad-a61f-e221af3d49a5 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] 10.222.0.11 "GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043967 Nov 17 03:31:42.536726 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 600/1234] 10.222.0.11 () {60 vars in 1342 bytes} [Wed Nov 17 03:31:42 2021] GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 17 03:31:42.609611 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-32fb7224-90a7-470f-9fae-ae1b1b92f6a0 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:31:42.610134 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-32fb7224-90a7-470f-9fae-ae1b1b92f6a0 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] [instance: 0698dc5b-5f47-46c4-ace8-f5e891a964a0] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:31:42.616799 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-32fb7224-90a7-470f-9fae-ae1b1b92f6a0 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:31:42.617258 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-32fb7224-90a7-470f-9fae-ae1b1b92f6a0 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:31:42.618018 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-32fb7224-90a7-470f-9fae-ae1b1b92f6a0 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:31:42.618445 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-32fb7224-90a7-470f-9fae-ae1b1b92f6a0 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:31:42.768051 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-32fb7224-90a7-470f-9fae-ae1b1b92f6a0 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '163b2f24a72649ac8084be1cac32fa09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e123e9b86124c93a7fc2db9984e7466', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:31:42.775753 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-32fb7224-90a7-470f-9fae-ae1b1b92f6a0 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] 10.222.0.11 "GET /compute/v2.1/servers/0698dc5b-5f47-46c4-ace8-f5e891a964a0" status: 200 len: 1565 microversion: 2.1 time: 0.171840 Nov 17 03:31:42.776317 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 635/1235] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:31:42 2021] GET /compute/v2.1/servers/0698dc5b-5f47-46c4-ace8-f5e891a964a0 => generated 1565 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:31:42.940089 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-8706f60e-6268-4e06-996a-d1bb87044bb7 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:31:42.940927 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-8706f60e-6268-4e06-996a-d1bb87044bb7 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] [instance: a49437df-3059-4528-8328-2f3471d5fb45] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:31:42.947993 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-8706f60e-6268-4e06-996a-d1bb87044bb7 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:31:42.948446 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-8706f60e-6268-4e06-996a-d1bb87044bb7 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:31:42.949251 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-8706f60e-6268-4e06-996a-d1bb87044bb7 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:31:42.949688 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-8706f60e-6268-4e06-996a-d1bb87044bb7 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:31:42.981016 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-8706f60e-6268-4e06-996a-d1bb87044bb7 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] 10.222.0.11 "GET /compute/v2.1/servers/a49437df-3059-4528-8328-2f3471d5fb45/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046539 Nov 17 03:31:42.981724 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 601/1236] 10.222.0.11 () {58 vars in 1301 bytes} [Wed Nov 17 03:31:42 2021] GET /compute/v2.1/servers/a49437df-3059-4528-8328-2f3471d5fb45/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 17 03:31:43.381430 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-192d0127-1e9c-44a0-a8ef-a0370d2e84b1 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:31:43.382050 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-192d0127-1e9c-44a0-a8ef-a0370d2e84b1 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] [instance: 5ddbfaaa-fabf-4324-941c-8868625ffefc] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:31:43.388420 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-192d0127-1e9c-44a0-a8ef-a0370d2e84b1 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:31:43.388908 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-192d0127-1e9c-44a0-a8ef-a0370d2e84b1 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:31:43.389684 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-192d0127-1e9c-44a0-a8ef-a0370d2e84b1 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:31:43.390121 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-192d0127-1e9c-44a0-a8ef-a0370d2e84b1 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:31:43.450688 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-192d0127-1e9c-44a0-a8ef-a0370d2e84b1 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80763e09d44c475ea2425b22874e9612', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fef02a1dd77946a2ac0e0414b557435f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:31:43.460565 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-192d0127-1e9c-44a0-a8ef-a0370d2e84b1 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] 10.222.0.11 "GET /compute/v2.1/servers/5ddbfaaa-fabf-4324-941c-8868625ffefc" status: 200 len: 1226 microversion: 2.1 time: 0.082578 Nov 17 03:31:43.461436 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 636/1237] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:31:43 2021] GET /compute/v2.1/servers/5ddbfaaa-fabf-4324-941c-8868625ffefc => generated 1226 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:31:43.551780 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-ed7f1909-27a4-4f8c-bcd6-528cd7b88edc tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:31:43.553372 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-ed7f1909-27a4-4f8c-bcd6-528cd7b88edc tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] [instance: 5d54db85-b991-4890-abaa-952413baa2e7] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:31:43.563603 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-ed7f1909-27a4-4f8c-bcd6-528cd7b88edc tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:31:43.564040 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-ed7f1909-27a4-4f8c-bcd6-528cd7b88edc tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:31:43.564807 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-ed7f1909-27a4-4f8c-bcd6-528cd7b88edc tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:31:43.565273 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-ed7f1909-27a4-4f8c-bcd6-528cd7b88edc tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:31:43.595440 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-ed7f1909-27a4-4f8c-bcd6-528cd7b88edc tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] 10.222.0.11 "GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.050223 Nov 17 03:31:43.596072 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 602/1238] 10.222.0.11 () {60 vars in 1342 bytes} [Wed Nov 17 03:31:43 2021] GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 17 03:31:43.797018 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-43ae4d69-6cf2-4ae1-b66f-41859bc35767 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:31:43.798066 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-43ae4d69-6cf2-4ae1-b66f-41859bc35767 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] [instance: 0698dc5b-5f47-46c4-ace8-f5e891a964a0] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:31:43.809078 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-43ae4d69-6cf2-4ae1-b66f-41859bc35767 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:31:43.809814 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-43ae4d69-6cf2-4ae1-b66f-41859bc35767 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:31:43.811072 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-43ae4d69-6cf2-4ae1-b66f-41859bc35767 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:31:43.811794 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-43ae4d69-6cf2-4ae1-b66f-41859bc35767 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:31:43.955188 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-43ae4d69-6cf2-4ae1-b66f-41859bc35767 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '163b2f24a72649ac8084be1cac32fa09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e123e9b86124c93a7fc2db9984e7466', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:31:43.963102 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-43ae4d69-6cf2-4ae1-b66f-41859bc35767 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] 10.222.0.11 "GET /compute/v2.1/servers/0698dc5b-5f47-46c4-ace8-f5e891a964a0" status: 200 len: 1565 microversion: 2.1 time: 0.172325 Nov 17 03:31:43.963673 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 637/1239] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:31:43 2021] GET /compute/v2.1/servers/0698dc5b-5f47-46c4-ace8-f5e891a964a0 => generated 1565 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:31:43.994635 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-8cc15627-a71b-4e95-a831-1be30476f707 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:31:43.995556 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-8cc15627-a71b-4e95-a831-1be30476f707 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] [instance: a49437df-3059-4528-8328-2f3471d5fb45] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:31:44.002157 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-8cc15627-a71b-4e95-a831-1be30476f707 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:31:44.002604 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-8cc15627-a71b-4e95-a831-1be30476f707 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:31:44.003375 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-8cc15627-a71b-4e95-a831-1be30476f707 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:31:44.003807 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-8cc15627-a71b-4e95-a831-1be30476f707 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:31:44.033681 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-8cc15627-a71b-4e95-a831-1be30476f707 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] 10.222.0.11 "GET /compute/v2.1/servers/a49437df-3059-4528-8328-2f3471d5fb45/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042824 Nov 17 03:31:44.034271 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 603/1240] 10.222.0.11 () {58 vars in 1301 bytes} [Wed Nov 17 03:31:43 2021] GET /compute/v2.1/servers/a49437df-3059-4528-8328-2f3471d5fb45/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 17 03:31:44.481987 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-ba77772e-1007-4889-b306-c2a48991fadf tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:31:44.482914 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-ba77772e-1007-4889-b306-c2a48991fadf tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] [instance: 5ddbfaaa-fabf-4324-941c-8868625ffefc] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:31:44.496441 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-ba77772e-1007-4889-b306-c2a48991fadf tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:31:44.497255 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-ba77772e-1007-4889-b306-c2a48991fadf tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:31:44.498526 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-ba77772e-1007-4889-b306-c2a48991fadf tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:31:44.499246 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-ba77772e-1007-4889-b306-c2a48991fadf tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:31:44.564469 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-ba77772e-1007-4889-b306-c2a48991fadf tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80763e09d44c475ea2425b22874e9612', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fef02a1dd77946a2ac0e0414b557435f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:31:44.572449 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-ba77772e-1007-4889-b306-c2a48991fadf tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] 10.222.0.11 "GET /compute/v2.1/servers/5ddbfaaa-fabf-4324-941c-8868625ffefc" status: 200 len: 1226 microversion: 2.1 time: 0.096706 Nov 17 03:31:44.573054 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 638/1241] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:31:44 2021] GET /compute/v2.1/servers/5ddbfaaa-fabf-4324-941c-8868625ffefc => generated 1226 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:31:44.612337 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-55fe42eb-28c9-4501-a3d5-aa1431f10287 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:31:44.613653 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-55fe42eb-28c9-4501-a3d5-aa1431f10287 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] [instance: 5d54db85-b991-4890-abaa-952413baa2e7] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:31:44.622810 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-55fe42eb-28c9-4501-a3d5-aa1431f10287 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:31:44.623390 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-55fe42eb-28c9-4501-a3d5-aa1431f10287 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:31:44.624517 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-55fe42eb-28c9-4501-a3d5-aa1431f10287 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:31:44.625139 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-55fe42eb-28c9-4501-a3d5-aa1431f10287 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:31:44.654423 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-55fe42eb-28c9-4501-a3d5-aa1431f10287 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] 10.222.0.11 "GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.048251 Nov 17 03:31:44.654985 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 604/1242] 10.222.0.11 () {60 vars in 1342 bytes} [Wed Nov 17 03:31:44 2021] GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 17 03:31:44.984269 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-a92f8c83-39b6-486b-8e93-a3ab0dc047bf tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:31:44.985363 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-a92f8c83-39b6-486b-8e93-a3ab0dc047bf tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] [instance: 0698dc5b-5f47-46c4-ace8-f5e891a964a0] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:31:44.992070 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-a92f8c83-39b6-486b-8e93-a3ab0dc047bf tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:31:44.992516 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-a92f8c83-39b6-486b-8e93-a3ab0dc047bf tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:31:44.993314 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-a92f8c83-39b6-486b-8e93-a3ab0dc047bf tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:31:44.993742 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-a92f8c83-39b6-486b-8e93-a3ab0dc047bf tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:31:45.045549 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-efc5d12b-639a-4117-bdd5-afd5273b368d tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:31:45.046467 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-efc5d12b-639a-4117-bdd5-afd5273b368d tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] [instance: a49437df-3059-4528-8328-2f3471d5fb45] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:31:45.053345 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-efc5d12b-639a-4117-bdd5-afd5273b368d tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:31:45.053801 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-efc5d12b-639a-4117-bdd5-afd5273b368d tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:31:45.054631 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-efc5d12b-639a-4117-bdd5-afd5273b368d tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:31:45.055066 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-efc5d12b-639a-4117-bdd5-afd5273b368d tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:31:45.086140 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-efc5d12b-639a-4117-bdd5-afd5273b368d tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] 10.222.0.11 "GET /compute/v2.1/servers/a49437df-3059-4528-8328-2f3471d5fb45/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044436 Nov 17 03:31:45.086718 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 605/1243] 10.222.0.11 () {58 vars in 1301 bytes} [Wed Nov 17 03:31:45 2021] GET /compute/v2.1/servers/a49437df-3059-4528-8328-2f3471d5fb45/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 17 03:31:45.127255 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-a92f8c83-39b6-486b-8e93-a3ab0dc047bf tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '163b2f24a72649ac8084be1cac32fa09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e123e9b86124c93a7fc2db9984e7466', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:31:45.134873 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-a92f8c83-39b6-486b-8e93-a3ab0dc047bf tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] 10.222.0.11 "GET /compute/v2.1/servers/0698dc5b-5f47-46c4-ace8-f5e891a964a0" status: 200 len: 1565 microversion: 2.1 time: 0.156683 Nov 17 03:31:45.135430 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 639/1244] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:31:44 2021] GET /compute/v2.1/servers/0698dc5b-5f47-46c4-ace8-f5e891a964a0 => generated 1565 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:31:45.594042 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-161de24c-7942-4d28-81bd-aed1c808bc3c tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:31:45.595203 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-161de24c-7942-4d28-81bd-aed1c808bc3c tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] [instance: 5ddbfaaa-fabf-4324-941c-8868625ffefc] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:31:45.605433 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-161de24c-7942-4d28-81bd-aed1c808bc3c tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:31:45.606180 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-161de24c-7942-4d28-81bd-aed1c808bc3c tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:31:45.607467 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-161de24c-7942-4d28-81bd-aed1c808bc3c tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:31:45.608183 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-161de24c-7942-4d28-81bd-aed1c808bc3c tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:31:45.668078 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-af103e39-114c-4c3b-8104-b848ef78cb4c tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:31:45.668924 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-af103e39-114c-4c3b-8104-b848ef78cb4c tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] [instance: 5d54db85-b991-4890-abaa-952413baa2e7] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:31:45.670040 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-161de24c-7942-4d28-81bd-aed1c808bc3c tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80763e09d44c475ea2425b22874e9612', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fef02a1dd77946a2ac0e0414b557435f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:31:45.675936 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-af103e39-114c-4c3b-8104-b848ef78cb4c tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:31:45.676404 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-af103e39-114c-4c3b-8104-b848ef78cb4c tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:31:45.677195 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-af103e39-114c-4c3b-8104-b848ef78cb4c tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:31:45.677620 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-af103e39-114c-4c3b-8104-b848ef78cb4c tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:31:45.678139 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-161de24c-7942-4d28-81bd-aed1c808bc3c tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] 10.222.0.11 "GET /compute/v2.1/servers/5ddbfaaa-fabf-4324-941c-8868625ffefc" status: 200 len: 1226 microversion: 2.1 time: 0.090269 Nov 17 03:31:45.679068 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 606/1245] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:31:45 2021] GET /compute/v2.1/servers/5ddbfaaa-fabf-4324-941c-8868625ffefc => generated 1226 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:31:45.706859 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-af103e39-114c-4c3b-8104-b848ef78cb4c tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] 10.222.0.11 "GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042982 Nov 17 03:31:45.707412 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 640/1246] 10.222.0.11 () {60 vars in 1342 bytes} [Wed Nov 17 03:31:45 2021] GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 17 03:31:46.098102 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-64313a13-b992-4a81-8135-43eb5ce9b5a5 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:31:46.099027 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-64313a13-b992-4a81-8135-43eb5ce9b5a5 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] [instance: a49437df-3059-4528-8328-2f3471d5fb45] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:31:46.105813 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-64313a13-b992-4a81-8135-43eb5ce9b5a5 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:31:46.106266 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-64313a13-b992-4a81-8135-43eb5ce9b5a5 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:31:46.107048 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-64313a13-b992-4a81-8135-43eb5ce9b5a5 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:31:46.107486 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-64313a13-b992-4a81-8135-43eb5ce9b5a5 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:31:46.137271 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-64313a13-b992-4a81-8135-43eb5ce9b5a5 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] 10.222.0.11 "GET /compute/v2.1/servers/a49437df-3059-4528-8328-2f3471d5fb45/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043153 Nov 17 03:31:46.137827 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 607/1247] 10.222.0.11 () {58 vars in 1301 bytes} [Wed Nov 17 03:31:46 2021] GET /compute/v2.1/servers/a49437df-3059-4528-8328-2f3471d5fb45/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 17 03:31:46.151524 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-9152f6bd-04a2-4b94-abca-dd7b2ca857ad tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:31:46.152135 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-9152f6bd-04a2-4b94-abca-dd7b2ca857ad tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] [instance: 0698dc5b-5f47-46c4-ace8-f5e891a964a0] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:31:46.159448 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-9152f6bd-04a2-4b94-abca-dd7b2ca857ad tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:31:46.159898 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-9152f6bd-04a2-4b94-abca-dd7b2ca857ad tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:31:46.160688 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-9152f6bd-04a2-4b94-abca-dd7b2ca857ad tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:31:46.161157 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-9152f6bd-04a2-4b94-abca-dd7b2ca857ad tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:31:46.298334 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-9152f6bd-04a2-4b94-abca-dd7b2ca857ad tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '163b2f24a72649ac8084be1cac32fa09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e123e9b86124c93a7fc2db9984e7466', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:31:46.306538 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-9152f6bd-04a2-4b94-abca-dd7b2ca857ad tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] 10.222.0.11 "GET /compute/v2.1/servers/0698dc5b-5f47-46c4-ace8-f5e891a964a0" status: 200 len: 1565 microversion: 2.1 time: 0.158748 Nov 17 03:31:46.307103 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 641/1248] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:31:46 2021] GET /compute/v2.1/servers/0698dc5b-5f47-46c4-ace8-f5e891a964a0 => generated 1565 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:31:46.698967 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-56f183db-f062-4c49-bd76-7f791886d2ea tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:31:46.700251 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-56f183db-f062-4c49-bd76-7f791886d2ea tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] [instance: 5ddbfaaa-fabf-4324-941c-8868625ffefc] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:31:46.710623 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-56f183db-f062-4c49-bd76-7f791886d2ea tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:31:46.711355 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-56f183db-f062-4c49-bd76-7f791886d2ea tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:31:46.712609 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-56f183db-f062-4c49-bd76-7f791886d2ea tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:31:46.713376 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-56f183db-f062-4c49-bd76-7f791886d2ea tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:31:46.721408 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-1589be45-6084-4fac-ab49-3b4b3f952375 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:31:46.722384 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-1589be45-6084-4fac-ab49-3b4b3f952375 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] [instance: 5d54db85-b991-4890-abaa-952413baa2e7] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:31:46.728798 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-1589be45-6084-4fac-ab49-3b4b3f952375 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:31:46.729258 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-1589be45-6084-4fac-ab49-3b4b3f952375 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:31:46.730031 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-1589be45-6084-4fac-ab49-3b4b3f952375 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:31:46.730459 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-1589be45-6084-4fac-ab49-3b4b3f952375 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:31:46.759971 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-1589be45-6084-4fac-ab49-3b4b3f952375 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] 10.222.0.11 "GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043950 Nov 17 03:31:46.760589 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 642/1249] 10.222.0.11 () {60 vars in 1342 bytes} [Wed Nov 17 03:31:46 2021] GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 17 03:31:46.775496 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-56f183db-f062-4c49-bd76-7f791886d2ea tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80763e09d44c475ea2425b22874e9612', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fef02a1dd77946a2ac0e0414b557435f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:31:46.783386 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-56f183db-f062-4c49-bd76-7f791886d2ea tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] 10.222.0.11 "GET /compute/v2.1/servers/5ddbfaaa-fabf-4324-941c-8868625ffefc" status: 200 len: 1226 microversion: 2.1 time: 0.090558 Nov 17 03:31:46.783918 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 608/1250] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:31:46 2021] GET /compute/v2.1/servers/5ddbfaaa-fabf-4324-941c-8868625ffefc => generated 1226 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:31:47.152798 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-2fcf3dbd-3b42-4d23-aa38-3eccb22ea876 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:31:47.154297 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-2fcf3dbd-3b42-4d23-aa38-3eccb22ea876 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] [instance: a49437df-3059-4528-8328-2f3471d5fb45] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:31:47.165631 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-2fcf3dbd-3b42-4d23-aa38-3eccb22ea876 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:31:47.166382 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-2fcf3dbd-3b42-4d23-aa38-3eccb22ea876 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:31:47.167656 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-2fcf3dbd-3b42-4d23-aa38-3eccb22ea876 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:31:47.168373 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-2fcf3dbd-3b42-4d23-aa38-3eccb22ea876 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:31:47.201246 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-2fcf3dbd-3b42-4d23-aa38-3eccb22ea876 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] 10.222.0.11 "GET /compute/v2.1/servers/a49437df-3059-4528-8328-2f3471d5fb45/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.054661 Nov 17 03:31:47.201840 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 643/1251] 10.222.0.11 () {58 vars in 1301 bytes} [Wed Nov 17 03:31:47 2021] GET /compute/v2.1/servers/a49437df-3059-4528-8328-2f3471d5fb45/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 17 03:31:47.328042 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-0572dbaa-cd3f-499f-8cd6-33d4926dbf51 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:31:47.328963 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-0572dbaa-cd3f-499f-8cd6-33d4926dbf51 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] [instance: 0698dc5b-5f47-46c4-ace8-f5e891a964a0] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:31:47.339242 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-0572dbaa-cd3f-499f-8cd6-33d4926dbf51 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:31:47.339945 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-0572dbaa-cd3f-499f-8cd6-33d4926dbf51 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:31:47.341253 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-0572dbaa-cd3f-499f-8cd6-33d4926dbf51 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:31:47.342012 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-0572dbaa-cd3f-499f-8cd6-33d4926dbf51 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:31:47.490205 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-0572dbaa-cd3f-499f-8cd6-33d4926dbf51 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '163b2f24a72649ac8084be1cac32fa09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e123e9b86124c93a7fc2db9984e7466', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:31:47.501610 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-0572dbaa-cd3f-499f-8cd6-33d4926dbf51 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] 10.222.0.11 "GET /compute/v2.1/servers/0698dc5b-5f47-46c4-ace8-f5e891a964a0" status: 200 len: 1565 microversion: 2.1 time: 0.179788 Nov 17 03:31:47.502157 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 609/1252] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:31:47 2021] GET /compute/v2.1/servers/0698dc5b-5f47-46c4-ace8-f5e891a964a0 => generated 1565 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:31:47.772635 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-2e7d7e02-d85a-438d-85d4-12d571a647a4 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:31:47.773560 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-2e7d7e02-d85a-438d-85d4-12d571a647a4 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] [instance: 5d54db85-b991-4890-abaa-952413baa2e7] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:31:47.782348 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-2e7d7e02-d85a-438d-85d4-12d571a647a4 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:31:47.782884 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-2e7d7e02-d85a-438d-85d4-12d571a647a4 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:31:47.784009 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-2e7d7e02-d85a-438d-85d4-12d571a647a4 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:31:47.784547 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-2e7d7e02-d85a-438d-85d4-12d571a647a4 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:31:47.799665 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-071d0615-a6b1-4b14-908a-e61113896d01 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:31:47.800303 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-071d0615-a6b1-4b14-908a-e61113896d01 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] [instance: 5ddbfaaa-fabf-4324-941c-8868625ffefc] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:31:47.806938 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-071d0615-a6b1-4b14-908a-e61113896d01 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:31:47.807367 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-071d0615-a6b1-4b14-908a-e61113896d01 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:31:47.808169 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-071d0615-a6b1-4b14-908a-e61113896d01 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:31:47.808592 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-071d0615-a6b1-4b14-908a-e61113896d01 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:31:47.817162 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-2e7d7e02-d85a-438d-85d4-12d571a647a4 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] 10.222.0.11 "GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.048426 Nov 17 03:31:47.817727 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 644/1253] 10.222.0.11 () {60 vars in 1342 bytes} [Wed Nov 17 03:31:47 2021] GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 17 03:31:47.868853 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-071d0615-a6b1-4b14-908a-e61113896d01 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80763e09d44c475ea2425b22874e9612', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fef02a1dd77946a2ac0e0414b557435f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:31:47.880399 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-071d0615-a6b1-4b14-908a-e61113896d01 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] 10.222.0.11 "GET /compute/v2.1/servers/5ddbfaaa-fabf-4324-941c-8868625ffefc" status: 200 len: 1226 microversion: 2.1 time: 0.084424 Nov 17 03:31:47.881236 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 610/1254] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:31:47 2021] GET /compute/v2.1/servers/5ddbfaaa-fabf-4324-941c-8868625ffefc => generated 1226 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:31:48.217169 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-c54a19ce-7cd7-4a51-9cc2-00c036a78811 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:31:48.218726 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-c54a19ce-7cd7-4a51-9cc2-00c036a78811 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] [instance: a49437df-3059-4528-8328-2f3471d5fb45] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:31:48.225831 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-c54a19ce-7cd7-4a51-9cc2-00c036a78811 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:31:48.226252 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-c54a19ce-7cd7-4a51-9cc2-00c036a78811 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:31:48.227034 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-c54a19ce-7cd7-4a51-9cc2-00c036a78811 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:31:48.227459 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-c54a19ce-7cd7-4a51-9cc2-00c036a78811 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:31:48.257583 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-c54a19ce-7cd7-4a51-9cc2-00c036a78811 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] 10.222.0.11 "GET /compute/v2.1/servers/a49437df-3059-4528-8328-2f3471d5fb45/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046848 Nov 17 03:31:48.258140 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 645/1255] 10.222.0.11 () {58 vars in 1301 bytes} [Wed Nov 17 03:31:48 2021] GET /compute/v2.1/servers/a49437df-3059-4528-8328-2f3471d5fb45/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 17 03:31:48.522981 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-348bca2d-460b-432f-97b2-121437435017 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:31:48.526738 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-348bca2d-460b-432f-97b2-121437435017 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] [instance: 0698dc5b-5f47-46c4-ace8-f5e891a964a0] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:31:48.537440 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-348bca2d-460b-432f-97b2-121437435017 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:31:48.538186 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-348bca2d-460b-432f-97b2-121437435017 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:31:48.539460 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-348bca2d-460b-432f-97b2-121437435017 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:31:48.540187 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-348bca2d-460b-432f-97b2-121437435017 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:31:48.677933 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-348bca2d-460b-432f-97b2-121437435017 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '163b2f24a72649ac8084be1cac32fa09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e123e9b86124c93a7fc2db9984e7466', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:31:48.688300 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-348bca2d-460b-432f-97b2-121437435017 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] 10.222.0.11 "GET /compute/v2.1/servers/0698dc5b-5f47-46c4-ace8-f5e891a964a0" status: 200 len: 1565 microversion: 2.1 time: 0.171432 Nov 17 03:31:48.688932 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 611/1256] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:31:48 2021] GET /compute/v2.1/servers/0698dc5b-5f47-46c4-ace8-f5e891a964a0 => generated 1565 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:31:48.830206 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-654a9581-e139-4d8f-b273-05fd32e2d4d5 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:31:48.831334 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-654a9581-e139-4d8f-b273-05fd32e2d4d5 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] [instance: 5d54db85-b991-4890-abaa-952413baa2e7] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:31:48.838409 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-654a9581-e139-4d8f-b273-05fd32e2d4d5 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:31:48.838904 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-654a9581-e139-4d8f-b273-05fd32e2d4d5 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:31:48.839764 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-654a9581-e139-4d8f-b273-05fd32e2d4d5 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:31:48.840234 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-654a9581-e139-4d8f-b273-05fd32e2d4d5 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:31:48.871382 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-654a9581-e139-4d8f-b273-05fd32e2d4d5 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] 10.222.0.11 "GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046079 Nov 17 03:31:48.871952 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 646/1257] 10.222.0.11 () {60 vars in 1342 bytes} [Wed Nov 17 03:31:48 2021] GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 17 03:31:48.900221 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-f6151f0d-da3f-46a5-aa07-aeb71d723701 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:31:48.901072 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-f6151f0d-da3f-46a5-aa07-aeb71d723701 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] [instance: 5ddbfaaa-fabf-4324-941c-8868625ffefc] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:31:48.909031 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-f6151f0d-da3f-46a5-aa07-aeb71d723701 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:31:48.909481 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-f6151f0d-da3f-46a5-aa07-aeb71d723701 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:31:48.910270 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-f6151f0d-da3f-46a5-aa07-aeb71d723701 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:31:48.910692 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-f6151f0d-da3f-46a5-aa07-aeb71d723701 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:31:48.976099 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-f6151f0d-da3f-46a5-aa07-aeb71d723701 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80763e09d44c475ea2425b22874e9612', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fef02a1dd77946a2ac0e0414b557435f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:31:48.984763 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-f6151f0d-da3f-46a5-aa07-aeb71d723701 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] 10.222.0.11 "GET /compute/v2.1/servers/5ddbfaaa-fabf-4324-941c-8868625ffefc" status: 200 len: 1226 microversion: 2.1 time: 0.090446 Nov 17 03:31:48.985363 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 612/1258] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:31:48 2021] GET /compute/v2.1/servers/5ddbfaaa-fabf-4324-941c-8868625ffefc => generated 1226 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:31:49.269508 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-c2c043d8-b247-4fd3-a2a9-00109a1037d2 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:31:49.270396 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-c2c043d8-b247-4fd3-a2a9-00109a1037d2 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] [instance: a49437df-3059-4528-8328-2f3471d5fb45] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:31:49.276953 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-c2c043d8-b247-4fd3-a2a9-00109a1037d2 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:31:49.277401 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-c2c043d8-b247-4fd3-a2a9-00109a1037d2 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:31:49.278173 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-c2c043d8-b247-4fd3-a2a9-00109a1037d2 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:31:49.278588 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-c2c043d8-b247-4fd3-a2a9-00109a1037d2 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:31:49.308212 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-c2c043d8-b247-4fd3-a2a9-00109a1037d2 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] 10.222.0.11 "GET /compute/v2.1/servers/a49437df-3059-4528-8328-2f3471d5fb45/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042652 Nov 17 03:31:49.308766 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 647/1259] 10.222.0.11 () {58 vars in 1301 bytes} [Wed Nov 17 03:31:49 2021] GET /compute/v2.1/servers/a49437df-3059-4528-8328-2f3471d5fb45/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 17 03:31:49.714255 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-51ecfb8d-1d8d-47c5-9369-f126fbce3eb5 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:31:49.715276 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-51ecfb8d-1d8d-47c5-9369-f126fbce3eb5 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] [instance: 0698dc5b-5f47-46c4-ace8-f5e891a964a0] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:31:49.723628 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-51ecfb8d-1d8d-47c5-9369-f126fbce3eb5 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:31:49.724082 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-51ecfb8d-1d8d-47c5-9369-f126fbce3eb5 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:31:49.724891 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-51ecfb8d-1d8d-47c5-9369-f126fbce3eb5 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:31:49.725331 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-51ecfb8d-1d8d-47c5-9369-f126fbce3eb5 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:31:49.862924 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-51ecfb8d-1d8d-47c5-9369-f126fbce3eb5 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '163b2f24a72649ac8084be1cac32fa09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e123e9b86124c93a7fc2db9984e7466', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:31:49.870781 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-51ecfb8d-1d8d-47c5-9369-f126fbce3eb5 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] 10.222.0.11 "GET /compute/v2.1/servers/0698dc5b-5f47-46c4-ace8-f5e891a964a0" status: 200 len: 1565 microversion: 2.1 time: 0.162807 Nov 17 03:31:49.871358 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 613/1260] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:31:49 2021] GET /compute/v2.1/servers/0698dc5b-5f47-46c4-ace8-f5e891a964a0 => generated 1565 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:31:49.883201 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-6ef5e036-3ac4-43f2-895a-11d25db9a3e7 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:31:49.884127 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-6ef5e036-3ac4-43f2-895a-11d25db9a3e7 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] [instance: 5d54db85-b991-4890-abaa-952413baa2e7] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:31:49.890536 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-6ef5e036-3ac4-43f2-895a-11d25db9a3e7 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:31:49.890918 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-6ef5e036-3ac4-43f2-895a-11d25db9a3e7 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:31:49.891882 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-6ef5e036-3ac4-43f2-895a-11d25db9a3e7 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:31:49.892342 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-6ef5e036-3ac4-43f2-895a-11d25db9a3e7 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:31:49.923983 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-6ef5e036-3ac4-43f2-895a-11d25db9a3e7 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] 10.222.0.11 "GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044606 Nov 17 03:31:49.924539 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 648/1261] 10.222.0.11 () {60 vars in 1342 bytes} [Wed Nov 17 03:31:49 2021] GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 17 03:31:50.005807 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-b9247962-e80b-4495-962f-f324d25d9add tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:31:50.006798 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-b9247962-e80b-4495-962f-f324d25d9add tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] [instance: 5ddbfaaa-fabf-4324-941c-8868625ffefc] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:31:50.016680 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-b9247962-e80b-4495-962f-f324d25d9add tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:31:50.017261 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-b9247962-e80b-4495-962f-f324d25d9add tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:31:50.018041 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-b9247962-e80b-4495-962f-f324d25d9add tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:31:50.018477 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-b9247962-e80b-4495-962f-f324d25d9add tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:31:50.083740 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-b9247962-e80b-4495-962f-f324d25d9add tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80763e09d44c475ea2425b22874e9612', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fef02a1dd77946a2ac0e0414b557435f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:31:50.091334 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-b9247962-e80b-4495-962f-f324d25d9add tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] 10.222.0.11 "GET /compute/v2.1/servers/5ddbfaaa-fabf-4324-941c-8868625ffefc" status: 200 len: 1226 microversion: 2.1 time: 0.091970 Nov 17 03:31:50.091894 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 614/1262] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:31:49 2021] GET /compute/v2.1/servers/5ddbfaaa-fabf-4324-941c-8868625ffefc => generated 1226 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:31:50.324165 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-a8f1de96-4b4b-4574-9380-b292afb2119f tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:31:50.325736 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-a8f1de96-4b4b-4574-9380-b292afb2119f tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] [instance: a49437df-3059-4528-8328-2f3471d5fb45] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:31:50.336479 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-a8f1de96-4b4b-4574-9380-b292afb2119f tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:31:50.337265 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-a8f1de96-4b4b-4574-9380-b292afb2119f tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:31:50.338516 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-a8f1de96-4b4b-4574-9380-b292afb2119f tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:31:50.339226 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-a8f1de96-4b4b-4574-9380-b292afb2119f tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:31:50.372246 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-a8f1de96-4b4b-4574-9380-b292afb2119f tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] 10.222.0.11 "GET /compute/v2.1/servers/a49437df-3059-4528-8328-2f3471d5fb45/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.054318 Nov 17 03:31:50.372821 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 649/1263] 10.222.0.11 () {58 vars in 1301 bytes} [Wed Nov 17 03:31:50 2021] GET /compute/v2.1/servers/a49437df-3059-4528-8328-2f3471d5fb45/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 17 03:31:50.893202 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-66582581-911b-4ec9-83e4-e9286466ec16 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:31:50.894192 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-66582581-911b-4ec9-83e4-e9286466ec16 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] [instance: 0698dc5b-5f47-46c4-ace8-f5e891a964a0] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:31:50.904843 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-66582581-911b-4ec9-83e4-e9286466ec16 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:31:50.905562 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-66582581-911b-4ec9-83e4-e9286466ec16 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:31:50.906965 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-66582581-911b-4ec9-83e4-e9286466ec16 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:31:50.908147 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-66582581-911b-4ec9-83e4-e9286466ec16 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:31:50.936013 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-5e71250e-ed8e-4b45-a553-eaa8404010f0 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:31:50.936974 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-5e71250e-ed8e-4b45-a553-eaa8404010f0 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] [instance: 5d54db85-b991-4890-abaa-952413baa2e7] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:31:50.943127 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-5e71250e-ed8e-4b45-a553-eaa8404010f0 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:31:50.943581 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-5e71250e-ed8e-4b45-a553-eaa8404010f0 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:31:50.944351 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-5e71250e-ed8e-4b45-a553-eaa8404010f0 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:31:50.944804 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-5e71250e-ed8e-4b45-a553-eaa8404010f0 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:31:50.975419 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-5e71250e-ed8e-4b45-a553-eaa8404010f0 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] 10.222.0.11 "GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043142 Nov 17 03:31:50.975969 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 650/1264] 10.222.0.11 () {60 vars in 1342 bytes} [Wed Nov 17 03:31:50 2021] GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 17 03:31:51.045931 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-66582581-911b-4ec9-83e4-e9286466ec16 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '163b2f24a72649ac8084be1cac32fa09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e123e9b86124c93a7fc2db9984e7466', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:31:51.055204 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-66582581-911b-4ec9-83e4-e9286466ec16 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] 10.222.0.11 "GET /compute/v2.1/servers/0698dc5b-5f47-46c4-ace8-f5e891a964a0" status: 200 len: 1565 microversion: 2.1 time: 0.168081 Nov 17 03:31:51.056761 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 615/1265] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:31:50 2021] GET /compute/v2.1/servers/0698dc5b-5f47-46c4-ace8-f5e891a964a0 => generated 1565 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:31:51.108504 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-380ce33c-f7b5-4272-9c63-fba2b0d8cc6e tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:31:51.109148 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-380ce33c-f7b5-4272-9c63-fba2b0d8cc6e tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] [instance: 5ddbfaaa-fabf-4324-941c-8868625ffefc] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:31:51.115882 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-380ce33c-f7b5-4272-9c63-fba2b0d8cc6e tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:31:51.116315 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-380ce33c-f7b5-4272-9c63-fba2b0d8cc6e tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:31:51.117132 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-380ce33c-f7b5-4272-9c63-fba2b0d8cc6e tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:31:51.117565 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-380ce33c-f7b5-4272-9c63-fba2b0d8cc6e tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:31:51.186403 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-380ce33c-f7b5-4272-9c63-fba2b0d8cc6e tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80763e09d44c475ea2425b22874e9612', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fef02a1dd77946a2ac0e0414b557435f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:31:51.195319 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-380ce33c-f7b5-4272-9c63-fba2b0d8cc6e tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] 10.222.0.11 "GET /compute/v2.1/servers/5ddbfaaa-fabf-4324-941c-8868625ffefc" status: 200 len: 1226 microversion: 2.1 time: 0.090511 Nov 17 03:31:51.195886 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 651/1266] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:31:51 2021] GET /compute/v2.1/servers/5ddbfaaa-fabf-4324-941c-8868625ffefc => generated 1226 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:31:51.387970 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-8eeae1f0-1d7d-469d-8477-4d1e6d34f178 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:31:51.389540 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-8eeae1f0-1d7d-469d-8477-4d1e6d34f178 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] [instance: a49437df-3059-4528-8328-2f3471d5fb45] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:31:51.396821 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-8eeae1f0-1d7d-469d-8477-4d1e6d34f178 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:31:51.397285 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-8eeae1f0-1d7d-469d-8477-4d1e6d34f178 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:31:51.398057 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-8eeae1f0-1d7d-469d-8477-4d1e6d34f178 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:31:51.398491 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-8eeae1f0-1d7d-469d-8477-4d1e6d34f178 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:31:51.428059 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-8eeae1f0-1d7d-469d-8477-4d1e6d34f178 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] 10.222.0.11 "GET /compute/v2.1/servers/a49437df-3059-4528-8328-2f3471d5fb45/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046458 Nov 17 03:31:51.428602 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 616/1267] 10.222.0.11 () {58 vars in 1301 bytes} [Wed Nov 17 03:31:51 2021] GET /compute/v2.1/servers/a49437df-3059-4528-8328-2f3471d5fb45/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 17 03:31:51.991114 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-881a8c67-ca72-443c-b248-72e0621c4c75 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:31:51.992428 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-881a8c67-ca72-443c-b248-72e0621c4c75 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] [instance: 5d54db85-b991-4890-abaa-952413baa2e7] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:31:52.002176 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-881a8c67-ca72-443c-b248-72e0621c4c75 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:31:52.002621 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-881a8c67-ca72-443c-b248-72e0621c4c75 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:31:52.003381 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-881a8c67-ca72-443c-b248-72e0621c4c75 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:31:52.003812 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-881a8c67-ca72-443c-b248-72e0621c4c75 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:31:52.033053 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-881a8c67-ca72-443c-b248-72e0621c4c75 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] 10.222.0.11 "GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.048907 Nov 17 03:31:52.033590 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 652/1268] 10.222.0.11 () {60 vars in 1342 bytes} [Wed Nov 17 03:31:51 2021] GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 17 03:31:52.078215 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-59ca4840-b693-43fe-8dce-a6c5ad663172 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:31:52.078910 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-59ca4840-b693-43fe-8dce-a6c5ad663172 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] [instance: 0698dc5b-5f47-46c4-ace8-f5e891a964a0] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:31:52.088754 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-59ca4840-b693-43fe-8dce-a6c5ad663172 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:31:52.089375 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-59ca4840-b693-43fe-8dce-a6c5ad663172 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:31:52.090475 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-59ca4840-b693-43fe-8dce-a6c5ad663172 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:31:52.091103 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-59ca4840-b693-43fe-8dce-a6c5ad663172 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:31:52.211361 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-d7e27908-9684-4cec-8f31-39e2635c69ea tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:31:52.212095 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-d7e27908-9684-4cec-8f31-39e2635c69ea tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] [instance: 5ddbfaaa-fabf-4324-941c-8868625ffefc] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:31:52.218404 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-d7e27908-9684-4cec-8f31-39e2635c69ea tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:31:52.218857 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-d7e27908-9684-4cec-8f31-39e2635c69ea tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:31:52.219631 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-d7e27908-9684-4cec-8f31-39e2635c69ea tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:31:52.220064 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-d7e27908-9684-4cec-8f31-39e2635c69ea tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:31:52.241473 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-59ca4840-b693-43fe-8dce-a6c5ad663172 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '163b2f24a72649ac8084be1cac32fa09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e123e9b86124c93a7fc2db9984e7466', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:31:52.249111 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-59ca4840-b693-43fe-8dce-a6c5ad663172 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] 10.222.0.11 "GET /compute/v2.1/servers/0698dc5b-5f47-46c4-ace8-f5e891a964a0" status: 200 len: 1565 microversion: 2.1 time: 0.177072 Nov 17 03:31:52.249711 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 617/1269] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:31:52 2021] GET /compute/v2.1/servers/0698dc5b-5f47-46c4-ace8-f5e891a964a0 => generated 1565 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:31:52.279628 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-d7e27908-9684-4cec-8f31-39e2635c69ea tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80763e09d44c475ea2425b22874e9612', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fef02a1dd77946a2ac0e0414b557435f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:31:52.287215 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-d7e27908-9684-4cec-8f31-39e2635c69ea tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] 10.222.0.11 "GET /compute/v2.1/servers/5ddbfaaa-fabf-4324-941c-8868625ffefc" status: 200 len: 1226 microversion: 2.1 time: 0.079543 Nov 17 03:31:52.287779 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 653/1270] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:31:52 2021] GET /compute/v2.1/servers/5ddbfaaa-fabf-4324-941c-8868625ffefc => generated 1226 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:31:52.444233 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-9e8117e4-9e0e-485b-a414-1c1cdf67aeca tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:31:52.445752 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-9e8117e4-9e0e-485b-a414-1c1cdf67aeca tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] [instance: a49437df-3059-4528-8328-2f3471d5fb45] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:31:52.455204 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-9e8117e4-9e0e-485b-a414-1c1cdf67aeca tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:31:52.455635 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-9e8117e4-9e0e-485b-a414-1c1cdf67aeca tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:31:52.456419 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-9e8117e4-9e0e-485b-a414-1c1cdf67aeca tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:31:52.456891 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-9e8117e4-9e0e-485b-a414-1c1cdf67aeca tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:31:52.485608 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-9e8117e4-9e0e-485b-a414-1c1cdf67aeca tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] 10.222.0.11 "GET /compute/v2.1/servers/a49437df-3059-4528-8328-2f3471d5fb45/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047826 Nov 17 03:31:52.486159 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 618/1271] 10.222.0.11 () {58 vars in 1301 bytes} [Wed Nov 17 03:31:52 2021] GET /compute/v2.1/servers/a49437df-3059-4528-8328-2f3471d5fb45/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 17 03:31:53.050095 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-6751466f-c5e3-46a3-bc17-a1f2d97d1f5d tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:31:53.051007 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-6751466f-c5e3-46a3-bc17-a1f2d97d1f5d tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] [instance: 5d54db85-b991-4890-abaa-952413baa2e7] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:31:53.058163 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-6751466f-c5e3-46a3-bc17-a1f2d97d1f5d tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:31:53.058607 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-6751466f-c5e3-46a3-bc17-a1f2d97d1f5d tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:31:53.059384 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-6751466f-c5e3-46a3-bc17-a1f2d97d1f5d tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:31:53.059809 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-6751466f-c5e3-46a3-bc17-a1f2d97d1f5d tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:31:53.089577 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-6751466f-c5e3-46a3-bc17-a1f2d97d1f5d tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] 10.222.0.11 "GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045536 Nov 17 03:31:53.090129 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 654/1272] 10.222.0.11 () {60 vars in 1342 bytes} [Wed Nov 17 03:31:53 2021] GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 17 03:31:53.270105 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-f2e29ded-c4b0-4e3b-b210-dccbd8e99fb6 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:31:53.271065 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-f2e29ded-c4b0-4e3b-b210-dccbd8e99fb6 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] [instance: 0698dc5b-5f47-46c4-ace8-f5e891a964a0] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:31:53.281640 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-f2e29ded-c4b0-4e3b-b210-dccbd8e99fb6 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:31:53.282376 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-f2e29ded-c4b0-4e3b-b210-dccbd8e99fb6 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:31:53.283829 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-f2e29ded-c4b0-4e3b-b210-dccbd8e99fb6 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:31:53.284262 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-f2e29ded-c4b0-4e3b-b210-dccbd8e99fb6 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:31:53.303357 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-a8ae565c-933c-44ad-ab77-737bbbde07b7 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:31:53.303853 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-a8ae565c-933c-44ad-ab77-737bbbde07b7 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] [instance: 5ddbfaaa-fabf-4324-941c-8868625ffefc] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:31:53.310578 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-a8ae565c-933c-44ad-ab77-737bbbde07b7 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:31:53.311035 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-a8ae565c-933c-44ad-ab77-737bbbde07b7 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:31:53.311811 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-a8ae565c-933c-44ad-ab77-737bbbde07b7 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:31:53.312243 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-a8ae565c-933c-44ad-ab77-737bbbde07b7 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:31:53.373910 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-a8ae565c-933c-44ad-ab77-737bbbde07b7 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80763e09d44c475ea2425b22874e9612', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fef02a1dd77946a2ac0e0414b557435f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:31:53.381859 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-a8ae565c-933c-44ad-ab77-737bbbde07b7 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] 10.222.0.11 "GET /compute/v2.1/servers/5ddbfaaa-fabf-4324-941c-8868625ffefc" status: 200 len: 1226 microversion: 2.1 time: 0.082376 Nov 17 03:31:53.382434 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 655/1273] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:31:53 2021] GET /compute/v2.1/servers/5ddbfaaa-fabf-4324-941c-8868625ffefc => generated 1226 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:31:53.417761 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-f2e29ded-c4b0-4e3b-b210-dccbd8e99fb6 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '163b2f24a72649ac8084be1cac32fa09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e123e9b86124c93a7fc2db9984e7466', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:31:53.429929 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-f2e29ded-c4b0-4e3b-b210-dccbd8e99fb6 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] 10.222.0.11 "GET /compute/v2.1/servers/0698dc5b-5f47-46c4-ace8-f5e891a964a0" status: 200 len: 1565 microversion: 2.1 time: 0.165829 Nov 17 03:31:53.431083 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 619/1274] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:31:53 2021] GET /compute/v2.1/servers/0698dc5b-5f47-46c4-ace8-f5e891a964a0 => generated 1565 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:31:53.500841 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-d5838b61-0b09-4da1-8750-9c9540092033 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:31:53.502284 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-d5838b61-0b09-4da1-8750-9c9540092033 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] [instance: a49437df-3059-4528-8328-2f3471d5fb45] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:31:53.508675 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-d5838b61-0b09-4da1-8750-9c9540092033 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:31:53.509150 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-d5838b61-0b09-4da1-8750-9c9540092033 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:31:53.509918 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-d5838b61-0b09-4da1-8750-9c9540092033 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:31:53.510343 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-d5838b61-0b09-4da1-8750-9c9540092033 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:31:53.543863 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-d5838b61-0b09-4da1-8750-9c9540092033 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] 10.222.0.11 "GET /compute/v2.1/servers/a49437df-3059-4528-8328-2f3471d5fb45/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048830 Nov 17 03:31:53.544573 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 656/1275] 10.222.0.11 () {58 vars in 1301 bytes} [Wed Nov 17 03:31:53 2021] GET /compute/v2.1/servers/a49437df-3059-4528-8328-2f3471d5fb45/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 17 03:31:54.106392 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-28713ac7-693f-4cde-ab22-007d0ca720e6 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:31:54.107701 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-28713ac7-693f-4cde-ab22-007d0ca720e6 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] [instance: 5d54db85-b991-4890-abaa-952413baa2e7] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:31:54.117410 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-28713ac7-693f-4cde-ab22-007d0ca720e6 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:31:54.117960 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-28713ac7-693f-4cde-ab22-007d0ca720e6 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:31:54.119009 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-28713ac7-693f-4cde-ab22-007d0ca720e6 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:31:54.119591 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-28713ac7-693f-4cde-ab22-007d0ca720e6 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:31:54.151418 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-28713ac7-693f-4cde-ab22-007d0ca720e6 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] 10.222.0.11 "GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.050945 Nov 17 03:31:54.151990 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 620/1276] 10.222.0.11 () {60 vars in 1342 bytes} [Wed Nov 17 03:31:54 2021] GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 17 03:31:54.401925 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-afd5cf18-625e-4367-b6c4-03091754a767 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:31:54.402757 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-afd5cf18-625e-4367-b6c4-03091754a767 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] [instance: 5ddbfaaa-fabf-4324-941c-8868625ffefc] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:31:54.413759 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-afd5cf18-625e-4367-b6c4-03091754a767 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:31:54.414505 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-afd5cf18-625e-4367-b6c4-03091754a767 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:31:54.415792 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-afd5cf18-625e-4367-b6c4-03091754a767 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:31:54.416513 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-afd5cf18-625e-4367-b6c4-03091754a767 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:31:54.448199 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-d4e3dfd8-bbfd-4da0-96e6-5323b8e91e04 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:31:54.448818 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-d4e3dfd8-bbfd-4da0-96e6-5323b8e91e04 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] [instance: 0698dc5b-5f47-46c4-ace8-f5e891a964a0] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:31:54.455292 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-d4e3dfd8-bbfd-4da0-96e6-5323b8e91e04 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:31:54.455740 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-d4e3dfd8-bbfd-4da0-96e6-5323b8e91e04 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:31:54.456531 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-d4e3dfd8-bbfd-4da0-96e6-5323b8e91e04 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:31:54.457008 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-d4e3dfd8-bbfd-4da0-96e6-5323b8e91e04 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:31:54.534336 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-afd5cf18-625e-4367-b6c4-03091754a767 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80763e09d44c475ea2425b22874e9612', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fef02a1dd77946a2ac0e0414b557435f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:31:54.541817 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-afd5cf18-625e-4367-b6c4-03091754a767 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] 10.222.0.11 "GET /compute/v2.1/servers/5ddbfaaa-fabf-4324-941c-8868625ffefc" status: 200 len: 1226 microversion: 2.1 time: 0.146276 Nov 17 03:31:54.542384 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 657/1277] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:31:54 2021] GET /compute/v2.1/servers/5ddbfaaa-fabf-4324-941c-8868625ffefc => generated 1226 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:31:54.557503 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-dd58af11-ba41-439d-9377-bc082ef3076c tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:31:54.558423 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-dd58af11-ba41-439d-9377-bc082ef3076c tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] [instance: a49437df-3059-4528-8328-2f3471d5fb45] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:31:54.564347 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-dd58af11-ba41-439d-9377-bc082ef3076c tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:31:54.564938 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-dd58af11-ba41-439d-9377-bc082ef3076c tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:31:54.566021 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-dd58af11-ba41-439d-9377-bc082ef3076c tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:31:54.566463 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-dd58af11-ba41-439d-9377-bc082ef3076c tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:31:54.596889 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-dd58af11-ba41-439d-9377-bc082ef3076c tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] 10.222.0.11 "GET /compute/v2.1/servers/a49437df-3059-4528-8328-2f3471d5fb45/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043558 Nov 17 03:31:54.597710 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 658/1278] 10.222.0.11 () {58 vars in 1301 bytes} [Wed Nov 17 03:31:54 2021] GET /compute/v2.1/servers/a49437df-3059-4528-8328-2f3471d5fb45/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 17 03:31:54.601134 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-d4e3dfd8-bbfd-4da0-96e6-5323b8e91e04 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '163b2f24a72649ac8084be1cac32fa09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e123e9b86124c93a7fc2db9984e7466', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:31:54.609026 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-d4e3dfd8-bbfd-4da0-96e6-5323b8e91e04 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] 10.222.0.11 "GET /compute/v2.1/servers/0698dc5b-5f47-46c4-ace8-f5e891a964a0" status: 200 len: 1565 microversion: 2.1 time: 0.164445 Nov 17 03:31:54.609582 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 621/1279] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:31:54 2021] GET /compute/v2.1/servers/0698dc5b-5f47-46c4-ace8-f5e891a964a0 => generated 1565 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:31:55.167361 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-6d771473-fb4e-4b7d-8d20-e161c6667d43 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:31:55.168897 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-6d771473-fb4e-4b7d-8d20-e161c6667d43 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] [instance: 5d54db85-b991-4890-abaa-952413baa2e7] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:31:55.177247 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-6d771473-fb4e-4b7d-8d20-e161c6667d43 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:31:55.177698 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-6d771473-fb4e-4b7d-8d20-e161c6667d43 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:31:55.178465 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-6d771473-fb4e-4b7d-8d20-e161c6667d43 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:31:55.178899 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-6d771473-fb4e-4b7d-8d20-e161c6667d43 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:31:55.208969 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-6d771473-fb4e-4b7d-8d20-e161c6667d43 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] 10.222.0.11 "GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047959 Nov 17 03:31:55.209521 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 659/1280] 10.222.0.11 () {60 vars in 1342 bytes} [Wed Nov 17 03:31:55 2021] GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 17 03:31:55.559020 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-e913dddd-80ad-49e5-89d4-de28681df8bd tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:31:55.559613 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-e913dddd-80ad-49e5-89d4-de28681df8bd tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] [instance: 5ddbfaaa-fabf-4324-941c-8868625ffefc] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:31:55.566389 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-e913dddd-80ad-49e5-89d4-de28681df8bd tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:31:55.566832 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-e913dddd-80ad-49e5-89d4-de28681df8bd tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:31:55.567623 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-e913dddd-80ad-49e5-89d4-de28681df8bd tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:31:55.568047 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-e913dddd-80ad-49e5-89d4-de28681df8bd tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:31:55.608752 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-80a119e6-adee-4355-b43c-88cd17987399 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:31:55.609697 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-80a119e6-adee-4355-b43c-88cd17987399 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] [instance: a49437df-3059-4528-8328-2f3471d5fb45] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:31:55.616530 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-80a119e6-adee-4355-b43c-88cd17987399 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:31:55.617007 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-80a119e6-adee-4355-b43c-88cd17987399 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:31:55.617779 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-80a119e6-adee-4355-b43c-88cd17987399 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:31:55.618237 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-80a119e6-adee-4355-b43c-88cd17987399 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:31:55.629135 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-e913dddd-80ad-49e5-89d4-de28681df8bd tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80763e09d44c475ea2425b22874e9612', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fef02a1dd77946a2ac0e0414b557435f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:31:55.636960 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-e913dddd-80ad-49e5-89d4-de28681df8bd tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] 10.222.0.11 "GET /compute/v2.1/servers/5ddbfaaa-fabf-4324-941c-8868625ffefc" status: 200 len: 1226 microversion: 2.1 time: 0.081977 Nov 17 03:31:55.637516 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 622/1281] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:31:55 2021] GET /compute/v2.1/servers/5ddbfaaa-fabf-4324-941c-8868625ffefc => generated 1226 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:31:55.648685 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-80a119e6-adee-4355-b43c-88cd17987399 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] 10.222.0.11 "GET /compute/v2.1/servers/a49437df-3059-4528-8328-2f3471d5fb45/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043667 Nov 17 03:31:55.649251 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 660/1282] 10.222.0.11 () {58 vars in 1301 bytes} [Wed Nov 17 03:31:55 2021] GET /compute/v2.1/servers/a49437df-3059-4528-8328-2f3471d5fb45/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 17 03:31:55.650702 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-c51d7511-273b-4f21-8b48-7a084c66d485 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:31:55.651308 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-c51d7511-273b-4f21-8b48-7a084c66d485 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] [instance: 0698dc5b-5f47-46c4-ace8-f5e891a964a0] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:31:55.657258 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-c51d7511-273b-4f21-8b48-7a084c66d485 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:31:55.657704 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-c51d7511-273b-4f21-8b48-7a084c66d485 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:31:55.658559 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-c51d7511-273b-4f21-8b48-7a084c66d485 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:31:55.658980 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-c51d7511-273b-4f21-8b48-7a084c66d485 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:31:55.804573 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-c51d7511-273b-4f21-8b48-7a084c66d485 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '163b2f24a72649ac8084be1cac32fa09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e123e9b86124c93a7fc2db9984e7466', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:31:55.813157 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-c51d7511-273b-4f21-8b48-7a084c66d485 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] 10.222.0.11 "GET /compute/v2.1/servers/0698dc5b-5f47-46c4-ace8-f5e891a964a0" status: 200 len: 1565 microversion: 2.1 time: 0.174589 Nov 17 03:31:55.813660 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 623/1283] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:31:55 2021] GET /compute/v2.1/servers/0698dc5b-5f47-46c4-ace8-f5e891a964a0 => generated 1565 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:31:56.221153 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-11ba7655-c841-462f-ab04-b2d90f223df2 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:31:56.221967 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-11ba7655-c841-462f-ab04-b2d90f223df2 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] [instance: 5d54db85-b991-4890-abaa-952413baa2e7] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:31:56.228393 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-11ba7655-c841-462f-ab04-b2d90f223df2 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:31:56.228859 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-11ba7655-c841-462f-ab04-b2d90f223df2 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:31:56.229724 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-11ba7655-c841-462f-ab04-b2d90f223df2 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:31:56.230150 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-11ba7655-c841-462f-ab04-b2d90f223df2 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:31:56.260365 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-11ba7655-c841-462f-ab04-b2d90f223df2 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] 10.222.0.11 "GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043216 Nov 17 03:31:56.260936 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 661/1284] 10.222.0.11 () {60 vars in 1342 bytes} [Wed Nov 17 03:31:56 2021] GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 17 03:31:56.654409 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-a9db6a06-2575-4824-bc82-852a03de2a32 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:31:56.654986 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-a9db6a06-2575-4824-bc82-852a03de2a32 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] [instance: 5ddbfaaa-fabf-4324-941c-8868625ffefc] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:31:56.659515 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-8b5f004b-0ffe-4248-9194-2411642877f2 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:31:56.660421 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-8b5f004b-0ffe-4248-9194-2411642877f2 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] [instance: a49437df-3059-4528-8328-2f3471d5fb45] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:31:56.661491 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-a9db6a06-2575-4824-bc82-852a03de2a32 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:31:56.661919 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-a9db6a06-2575-4824-bc82-852a03de2a32 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:31:56.662698 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-a9db6a06-2575-4824-bc82-852a03de2a32 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:31:56.663137 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-a9db6a06-2575-4824-bc82-852a03de2a32 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:31:56.666786 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-8b5f004b-0ffe-4248-9194-2411642877f2 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:31:56.667232 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-8b5f004b-0ffe-4248-9194-2411642877f2 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:31:56.667995 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-8b5f004b-0ffe-4248-9194-2411642877f2 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:31:56.668416 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-8b5f004b-0ffe-4248-9194-2411642877f2 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:31:56.697476 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-8b5f004b-0ffe-4248-9194-2411642877f2 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] 10.222.0.11 "GET /compute/v2.1/servers/a49437df-3059-4528-8328-2f3471d5fb45/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041867 Nov 17 03:31:56.698034 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 662/1285] 10.222.0.11 () {58 vars in 1301 bytes} [Wed Nov 17 03:31:56 2021] GET /compute/v2.1/servers/a49437df-3059-4528-8328-2f3471d5fb45/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 17 03:31:56.726201 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-a9db6a06-2575-4824-bc82-852a03de2a32 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80763e09d44c475ea2425b22874e9612', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fef02a1dd77946a2ac0e0414b557435f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:31:56.737909 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-a9db6a06-2575-4824-bc82-852a03de2a32 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] 10.222.0.11 "GET /compute/v2.1/servers/5ddbfaaa-fabf-4324-941c-8868625ffefc" status: 200 len: 1226 microversion: 2.1 time: 0.087200 Nov 17 03:31:56.738474 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 624/1286] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:31:56 2021] GET /compute/v2.1/servers/5ddbfaaa-fabf-4324-941c-8868625ffefc => generated 1226 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:31:56.835797 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-1fc151d1-ce30-4bb3-9e71-51a24d4ad00a tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:31:56.836996 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-1fc151d1-ce30-4bb3-9e71-51a24d4ad00a tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] [instance: 0698dc5b-5f47-46c4-ace8-f5e891a964a0] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:31:56.847123 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-1fc151d1-ce30-4bb3-9e71-51a24d4ad00a tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:31:56.847865 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-1fc151d1-ce30-4bb3-9e71-51a24d4ad00a tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:31:56.849188 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-1fc151d1-ce30-4bb3-9e71-51a24d4ad00a tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:31:56.849877 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-1fc151d1-ce30-4bb3-9e71-51a24d4ad00a tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:31:56.995722 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-1fc151d1-ce30-4bb3-9e71-51a24d4ad00a tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '163b2f24a72649ac8084be1cac32fa09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e123e9b86124c93a7fc2db9984e7466', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:31:57.005616 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-1fc151d1-ce30-4bb3-9e71-51a24d4ad00a tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] 10.222.0.11 "GET /compute/v2.1/servers/0698dc5b-5f47-46c4-ace8-f5e891a964a0" status: 200 len: 1565 microversion: 2.1 time: 0.177525 Nov 17 03:31:57.006179 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 663/1287] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:31:56 2021] GET /compute/v2.1/servers/0698dc5b-5f47-46c4-ace8-f5e891a964a0 => generated 1565 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:31:57.275092 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-c536b651-a6c5-4530-b36f-e6084593b878 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:31:57.276075 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-c536b651-a6c5-4530-b36f-e6084593b878 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] [instance: 5d54db85-b991-4890-abaa-952413baa2e7] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:31:57.284404 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-c536b651-a6c5-4530-b36f-e6084593b878 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:31:57.284842 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-c536b651-a6c5-4530-b36f-e6084593b878 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:31:57.285632 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-c536b651-a6c5-4530-b36f-e6084593b878 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:31:57.286058 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-c536b651-a6c5-4530-b36f-e6084593b878 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:31:57.316607 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-c536b651-a6c5-4530-b36f-e6084593b878 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] 10.222.0.11 "GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047180 Nov 17 03:31:57.317191 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 625/1288] 10.222.0.11 () {60 vars in 1342 bytes} [Wed Nov 17 03:31:57 2021] GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 17 03:31:57.713201 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-95ab8f64-25dc-421b-be54-87e1ab5dbf8c tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:31:57.714678 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-95ab8f64-25dc-421b-be54-87e1ab5dbf8c tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] [instance: a49437df-3059-4528-8328-2f3471d5fb45] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:31:57.724801 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-95ab8f64-25dc-421b-be54-87e1ab5dbf8c tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:31:57.725619 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-95ab8f64-25dc-421b-be54-87e1ab5dbf8c tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:31:57.727020 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-95ab8f64-25dc-421b-be54-87e1ab5dbf8c tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:31:57.727770 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-95ab8f64-25dc-421b-be54-87e1ab5dbf8c tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:31:57.759249 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-37838f1b-0f27-44f1-82a3-b1612ee78a10 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:31:57.759829 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-95ab8f64-25dc-421b-be54-87e1ab5dbf8c tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] 10.222.0.11 "GET /compute/v2.1/servers/a49437df-3059-4528-8328-2f3471d5fb45/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052653 Nov 17 03:31:57.763309 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-37838f1b-0f27-44f1-82a3-b1612ee78a10 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] [instance: 5ddbfaaa-fabf-4324-941c-8868625ffefc] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:31:57.763437 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 664/1289] 10.222.0.11 () {58 vars in 1301 bytes} [Wed Nov 17 03:31:57 2021] GET /compute/v2.1/servers/a49437df-3059-4528-8328-2f3471d5fb45/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 17 03:31:57.766636 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-37838f1b-0f27-44f1-82a3-b1612ee78a10 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:31:57.767078 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-37838f1b-0f27-44f1-82a3-b1612ee78a10 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:31:57.767884 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-37838f1b-0f27-44f1-82a3-b1612ee78a10 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:31:57.768394 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-37838f1b-0f27-44f1-82a3-b1612ee78a10 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:31:57.837177 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-37838f1b-0f27-44f1-82a3-b1612ee78a10 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80763e09d44c475ea2425b22874e9612', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fef02a1dd77946a2ac0e0414b557435f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:31:57.845338 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-37838f1b-0f27-44f1-82a3-b1612ee78a10 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] 10.222.0.11 "GET /compute/v2.1/servers/5ddbfaaa-fabf-4324-941c-8868625ffefc" status: 200 len: 1226 microversion: 2.1 time: 0.089671 Nov 17 03:31:57.846066 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 626/1290] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:31:57 2021] GET /compute/v2.1/servers/5ddbfaaa-fabf-4324-941c-8868625ffefc => generated 1226 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:31:58.027508 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-e73a0d1e-4e62-49ab-9883-9fe20c5ebab7 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:31:58.028129 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-e73a0d1e-4e62-49ab-9883-9fe20c5ebab7 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] [instance: 0698dc5b-5f47-46c4-ace8-f5e891a964a0] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:31:58.034675 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-e73a0d1e-4e62-49ab-9883-9fe20c5ebab7 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:31:58.035114 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-e73a0d1e-4e62-49ab-9883-9fe20c5ebab7 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:31:58.035861 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-e73a0d1e-4e62-49ab-9883-9fe20c5ebab7 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:31:58.036282 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-e73a0d1e-4e62-49ab-9883-9fe20c5ebab7 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:31:58.174973 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-e73a0d1e-4e62-49ab-9883-9fe20c5ebab7 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '163b2f24a72649ac8084be1cac32fa09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e123e9b86124c93a7fc2db9984e7466', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:31:58.183189 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-e73a0d1e-4e62-49ab-9883-9fe20c5ebab7 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] 10.222.0.11 "GET /compute/v2.1/servers/0698dc5b-5f47-46c4-ace8-f5e891a964a0" status: 200 len: 1565 microversion: 2.1 time: 0.159370 Nov 17 03:31:58.183756 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 665/1291] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:31:58 2021] GET /compute/v2.1/servers/0698dc5b-5f47-46c4-ace8-f5e891a964a0 => generated 1565 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:31:58.332426 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-29fcc17b-07f0-4cbf-9926-070984dacb54 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:31:58.333421 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-29fcc17b-07f0-4cbf-9926-070984dacb54 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] [instance: 5d54db85-b991-4890-abaa-952413baa2e7] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:31:58.340458 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-29fcc17b-07f0-4cbf-9926-070984dacb54 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:31:58.341042 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-29fcc17b-07f0-4cbf-9926-070984dacb54 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:31:58.341935 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-29fcc17b-07f0-4cbf-9926-070984dacb54 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:31:58.342436 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-29fcc17b-07f0-4cbf-9926-070984dacb54 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:31:58.374601 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-29fcc17b-07f0-4cbf-9926-070984dacb54 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] 10.222.0.11 "GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.048056 Nov 17 03:31:58.375165 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 627/1292] 10.222.0.11 () {60 vars in 1342 bytes} [Wed Nov 17 03:31:58 2021] GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 17 03:31:58.775328 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-15ef2c31-94b3-408b-817e-81334009bac3 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:31:58.776830 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-15ef2c31-94b3-408b-817e-81334009bac3 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] [instance: a49437df-3059-4528-8328-2f3471d5fb45] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:31:58.787511 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-15ef2c31-94b3-408b-817e-81334009bac3 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:31:58.788243 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-15ef2c31-94b3-408b-817e-81334009bac3 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:31:58.789552 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-15ef2c31-94b3-408b-817e-81334009bac3 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:31:58.790263 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-15ef2c31-94b3-408b-817e-81334009bac3 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:31:58.824355 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-15ef2c31-94b3-408b-817e-81334009bac3 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] 10.222.0.11 "GET /compute/v2.1/servers/a49437df-3059-4528-8328-2f3471d5fb45/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.055767 Nov 17 03:31:58.825094 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 666/1293] 10.222.0.11 () {58 vars in 1301 bytes} [Wed Nov 17 03:31:58 2021] GET /compute/v2.1/servers/a49437df-3059-4528-8328-2f3471d5fb45/os-volume_attachments => generated 197 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 17 03:31:58.865551 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-d0ca91be-5869-4c0c-a618-629fd35643a7 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:31:58.866842 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-d0ca91be-5869-4c0c-a618-629fd35643a7 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] [instance: 5ddbfaaa-fabf-4324-941c-8868625ffefc] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:31:58.877250 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-d0ca91be-5869-4c0c-a618-629fd35643a7 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:31:58.878003 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-d0ca91be-5869-4c0c-a618-629fd35643a7 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:31:58.878958 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-d0ca91be-5869-4c0c-a618-629fd35643a7 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:31:58.879387 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-d0ca91be-5869-4c0c-a618-629fd35643a7 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:31:58.938584 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-d0ca91be-5869-4c0c-a618-629fd35643a7 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80763e09d44c475ea2425b22874e9612', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fef02a1dd77946a2ac0e0414b557435f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:31:58.946193 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-d0ca91be-5869-4c0c-a618-629fd35643a7 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] 10.222.0.11 "GET /compute/v2.1/servers/5ddbfaaa-fabf-4324-941c-8868625ffefc" status: 200 len: 1226 microversion: 2.1 time: 0.086888 Nov 17 03:31:58.946792 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 628/1294] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:31:58 2021] GET /compute/v2.1/servers/5ddbfaaa-fabf-4324-941c-8868625ffefc => generated 1226 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:31:59.204329 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-dd9eaf11-3e15-470b-a9d4-e3ed85dd343d tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:31:59.205374 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-dd9eaf11-3e15-470b-a9d4-e3ed85dd343d tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] [instance: 0698dc5b-5f47-46c4-ace8-f5e891a964a0] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:31:59.215741 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-dd9eaf11-3e15-470b-a9d4-e3ed85dd343d tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:31:59.216500 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-dd9eaf11-3e15-470b-a9d4-e3ed85dd343d tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:31:59.217837 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-dd9eaf11-3e15-470b-a9d4-e3ed85dd343d tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:31:59.218567 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-dd9eaf11-3e15-470b-a9d4-e3ed85dd343d tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:31:59.358397 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-dd9eaf11-3e15-470b-a9d4-e3ed85dd343d tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '163b2f24a72649ac8084be1cac32fa09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e123e9b86124c93a7fc2db9984e7466', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:31:59.366400 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-dd9eaf11-3e15-470b-a9d4-e3ed85dd343d tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] 10.222.0.11 "GET /compute/v2.1/servers/0698dc5b-5f47-46c4-ace8-f5e891a964a0" status: 200 len: 1565 microversion: 2.1 time: 0.168266 Nov 17 03:31:59.367096 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 667/1295] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:31:59 2021] GET /compute/v2.1/servers/0698dc5b-5f47-46c4-ace8-f5e891a964a0 => generated 1565 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:31:59.385516 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-55ec8b76-efd2-4014-872a-857b29da4395 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:31:59.386417 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-55ec8b76-efd2-4014-872a-857b29da4395 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] [instance: 5d54db85-b991-4890-abaa-952413baa2e7] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:31:59.392409 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-55ec8b76-efd2-4014-872a-857b29da4395 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:31:59.392890 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-55ec8b76-efd2-4014-872a-857b29da4395 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:31:59.393776 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-55ec8b76-efd2-4014-872a-857b29da4395 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:31:59.394265 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-55ec8b76-efd2-4014-872a-857b29da4395 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:31:59.423180 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-55ec8b76-efd2-4014-872a-857b29da4395 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] 10.222.0.11 "GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041624 Nov 17 03:31:59.423723 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 629/1296] 10.222.0.11 () {60 vars in 1342 bytes} [Wed Nov 17 03:31:59 2021] GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 17 03:31:59.836129 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-a03f7454-6642-4aeb-b212-85fcaac8814f tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:31:59.837075 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-a03f7454-6642-4aeb-b212-85fcaac8814f tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] [instance: a49437df-3059-4528-8328-2f3471d5fb45] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:31:59.843688 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-a03f7454-6642-4aeb-b212-85fcaac8814f tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:31:59.844137 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-a03f7454-6642-4aeb-b212-85fcaac8814f tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:31:59.844943 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-a03f7454-6642-4aeb-b212-85fcaac8814f tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:31:59.845377 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-a03f7454-6642-4aeb-b212-85fcaac8814f tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:31:59.874529 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-a03f7454-6642-4aeb-b212-85fcaac8814f tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] 10.222.0.11 "GET /compute/v2.1/servers/a49437df-3059-4528-8328-2f3471d5fb45/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042247 Nov 17 03:31:59.875086 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 668/1297] 10.222.0.11 () {58 vars in 1301 bytes} [Wed Nov 17 03:31:59 2021] GET /compute/v2.1/servers/a49437df-3059-4528-8328-2f3471d5fb45/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 17 03:31:59.966920 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-0ffe0b85-10fe-40fd-9b9a-23b43c2e3869 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:31:59.967778 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-0ffe0b85-10fe-40fd-9b9a-23b43c2e3869 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] [instance: 5ddbfaaa-fabf-4324-941c-8868625ffefc] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:31:59.976075 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-0ffe0b85-10fe-40fd-9b9a-23b43c2e3869 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:31:59.976552 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-0ffe0b85-10fe-40fd-9b9a-23b43c2e3869 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:31:59.977361 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-0ffe0b85-10fe-40fd-9b9a-23b43c2e3869 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:31:59.977807 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-0ffe0b85-10fe-40fd-9b9a-23b43c2e3869 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:32:00.041168 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-0ffe0b85-10fe-40fd-9b9a-23b43c2e3869 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80763e09d44c475ea2425b22874e9612', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fef02a1dd77946a2ac0e0414b557435f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:32:00.048931 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-0ffe0b85-10fe-40fd-9b9a-23b43c2e3869 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] 10.222.0.11 "GET /compute/v2.1/servers/5ddbfaaa-fabf-4324-941c-8868625ffefc" status: 200 len: 1226 microversion: 2.1 time: 0.088272 Nov 17 03:32:00.049721 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 630/1298] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:31:59 2021] GET /compute/v2.1/servers/5ddbfaaa-fabf-4324-941c-8868625ffefc => generated 1226 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:32:00.390667 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-7224a841-9b3a-4f95-b3b4-b1bf7f7a9629 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:32:00.391704 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-7224a841-9b3a-4f95-b3b4-b1bf7f7a9629 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] [instance: 0698dc5b-5f47-46c4-ace8-f5e891a964a0] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:32:00.402313 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-7224a841-9b3a-4f95-b3b4-b1bf7f7a9629 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:32:00.403172 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-7224a841-9b3a-4f95-b3b4-b1bf7f7a9629 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:32:00.404580 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-7224a841-9b3a-4f95-b3b4-b1bf7f7a9629 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:32:00.405682 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-7224a841-9b3a-4f95-b3b4-b1bf7f7a9629 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:32:00.434805 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-a461d3ca-a970-454e-bdc2-594e7a3ce06f tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:32:00.435722 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-a461d3ca-a970-454e-bdc2-594e7a3ce06f tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] [instance: 5d54db85-b991-4890-abaa-952413baa2e7] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:32:00.442304 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-a461d3ca-a970-454e-bdc2-594e7a3ce06f tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:32:00.442762 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-a461d3ca-a970-454e-bdc2-594e7a3ce06f tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:32:00.443550 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-a461d3ca-a970-454e-bdc2-594e7a3ce06f tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:32:00.443985 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-a461d3ca-a970-454e-bdc2-594e7a3ce06f tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:32:00.473909 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-a461d3ca-a970-454e-bdc2-594e7a3ce06f tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] 10.222.0.11 "GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043236 Nov 17 03:32:00.474464 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 631/1299] 10.222.0.11 () {60 vars in 1342 bytes} [Wed Nov 17 03:32:00 2021] GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 17 03:32:00.543655 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-7224a841-9b3a-4f95-b3b4-b1bf7f7a9629 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '163b2f24a72649ac8084be1cac32fa09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e123e9b86124c93a7fc2db9984e7466', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:32:00.556563 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-7224a841-9b3a-4f95-b3b4-b1bf7f7a9629 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] 10.222.0.11 "GET /compute/v2.1/servers/0698dc5b-5f47-46c4-ace8-f5e891a964a0" status: 200 len: 1565 microversion: 2.1 time: 0.171825 Nov 17 03:32:00.557497 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 669/1300] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:32:00 2021] GET /compute/v2.1/servers/0698dc5b-5f47-46c4-ace8-f5e891a964a0 => generated 1565 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:32:00.886592 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-143c518c-2168-448a-acf0-aa9d21736d0f tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:32:00.887629 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-143c518c-2168-448a-acf0-aa9d21736d0f tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] [instance: a49437df-3059-4528-8328-2f3471d5fb45] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:32:00.895177 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-143c518c-2168-448a-acf0-aa9d21736d0f tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:32:00.895620 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-143c518c-2168-448a-acf0-aa9d21736d0f tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:32:00.896383 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-143c518c-2168-448a-acf0-aa9d21736d0f tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:32:00.896821 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-143c518c-2168-448a-acf0-aa9d21736d0f tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:32:00.928733 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-143c518c-2168-448a-acf0-aa9d21736d0f tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] 10.222.0.11 "GET /compute/v2.1/servers/a49437df-3059-4528-8328-2f3471d5fb45/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046409 Nov 17 03:32:00.929317 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 632/1301] 10.222.0.11 () {58 vars in 1301 bytes} [Wed Nov 17 03:32:00 2021] GET /compute/v2.1/servers/a49437df-3059-4528-8328-2f3471d5fb45/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 17 03:32:01.068469 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-002cad8a-e664-4f01-b1d2-9dcb78833461 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:32:01.069115 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-002cad8a-e664-4f01-b1d2-9dcb78833461 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] [instance: 5ddbfaaa-fabf-4324-941c-8868625ffefc] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:32:01.075918 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-002cad8a-e664-4f01-b1d2-9dcb78833461 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:32:01.076366 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-002cad8a-e664-4f01-b1d2-9dcb78833461 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:32:01.077164 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-002cad8a-e664-4f01-b1d2-9dcb78833461 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:32:01.077589 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-002cad8a-e664-4f01-b1d2-9dcb78833461 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:32:01.142911 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-002cad8a-e664-4f01-b1d2-9dcb78833461 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80763e09d44c475ea2425b22874e9612', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fef02a1dd77946a2ac0e0414b557435f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:32:01.151090 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-002cad8a-e664-4f01-b1d2-9dcb78833461 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] 10.222.0.11 "GET /compute/v2.1/servers/5ddbfaaa-fabf-4324-941c-8868625ffefc" status: 200 len: 1226 microversion: 2.1 time: 0.087750 Nov 17 03:32:01.151662 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 670/1302] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:32:01 2021] GET /compute/v2.1/servers/5ddbfaaa-fabf-4324-941c-8868625ffefc => generated 1226 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:32:01.489107 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-cbee4f6e-8f8c-44d7-827e-17d4f9020d65 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:32:01.490092 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-cbee4f6e-8f8c-44d7-827e-17d4f9020d65 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] [instance: 5d54db85-b991-4890-abaa-952413baa2e7] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:32:01.497737 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-cbee4f6e-8f8c-44d7-827e-17d4f9020d65 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:32:01.498256 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-cbee4f6e-8f8c-44d7-827e-17d4f9020d65 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:32:01.499147 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-cbee4f6e-8f8c-44d7-827e-17d4f9020d65 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:32:01.499646 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-cbee4f6e-8f8c-44d7-827e-17d4f9020d65 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:32:01.533047 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-cbee4f6e-8f8c-44d7-827e-17d4f9020d65 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] 10.222.0.11 "GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.050241 Nov 17 03:32:01.533602 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 633/1303] 10.222.0.11 () {60 vars in 1342 bytes} [Wed Nov 17 03:32:01 2021] GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 17 03:32:01.577321 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-a7a9f719-9b80-498d-8098-bd828d5334b8 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:32:01.577929 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-a7a9f719-9b80-498d-8098-bd828d5334b8 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] [instance: 0698dc5b-5f47-46c4-ace8-f5e891a964a0] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:32:01.584230 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-a7a9f719-9b80-498d-8098-bd828d5334b8 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:32:01.584669 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-a7a9f719-9b80-498d-8098-bd828d5334b8 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:32:01.585448 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-a7a9f719-9b80-498d-8098-bd828d5334b8 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:32:01.585874 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-a7a9f719-9b80-498d-8098-bd828d5334b8 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:32:01.722636 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-a7a9f719-9b80-498d-8098-bd828d5334b8 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '163b2f24a72649ac8084be1cac32fa09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e123e9b86124c93a7fc2db9984e7466', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:32:01.730142 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-a7a9f719-9b80-498d-8098-bd828d5334b8 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] 10.222.0.11 "GET /compute/v2.1/servers/0698dc5b-5f47-46c4-ace8-f5e891a964a0" status: 200 len: 1565 microversion: 2.1 time: 0.156514 Nov 17 03:32:01.730719 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 671/1304] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:32:01 2021] GET /compute/v2.1/servers/0698dc5b-5f47-46c4-ace8-f5e891a964a0 => generated 1565 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 17 03:32:01.943582 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-3e40793a-2142-460f-b264-3711509a698c tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:32:01.944840 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-3e40793a-2142-460f-b264-3711509a698c tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] [instance: a49437df-3059-4528-8328-2f3471d5fb45] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:32:01.953246 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-3e40793a-2142-460f-b264-3711509a698c tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:32:01.953866 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-3e40793a-2142-460f-b264-3711509a698c tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:32:01.954924 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-3e40793a-2142-460f-b264-3711509a698c tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:32:01.955540 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-3e40793a-2142-460f-b264-3711509a698c tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:32:01.989529 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-3e40793a-2142-460f-b264-3711509a698c tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] 10.222.0.11 "GET /compute/v2.1/servers/a49437df-3059-4528-8328-2f3471d5fb45/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051447 Nov 17 03:32:01.990078 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 634/1305] 10.222.0.11 () {58 vars in 1301 bytes} [Wed Nov 17 03:32:01 2021] GET /compute/v2.1/servers/a49437df-3059-4528-8328-2f3471d5fb45/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 17 03:32:02.171823 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-4458ebce-c64a-4116-89bf-5d1902648d54 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:32:02.172934 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-4458ebce-c64a-4116-89bf-5d1902648d54 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] [instance: 5ddbfaaa-fabf-4324-941c-8868625ffefc] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:32:02.184451 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-4458ebce-c64a-4116-89bf-5d1902648d54 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:32:02.185296 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-4458ebce-c64a-4116-89bf-5d1902648d54 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:32:02.186561 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-4458ebce-c64a-4116-89bf-5d1902648d54 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:32:02.187271 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-4458ebce-c64a-4116-89bf-5d1902648d54 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:32:02.259287 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-4458ebce-c64a-4116-89bf-5d1902648d54 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80763e09d44c475ea2425b22874e9612', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fef02a1dd77946a2ac0e0414b557435f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:32:02.270198 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-4458ebce-c64a-4116-89bf-5d1902648d54 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] 10.222.0.11 "GET /compute/v2.1/servers/5ddbfaaa-fabf-4324-941c-8868625ffefc" status: 200 len: 1226 microversion: 2.1 time: 0.104610 Nov 17 03:32:02.270765 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 672/1306] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:32:02 2021] GET /compute/v2.1/servers/5ddbfaaa-fabf-4324-941c-8868625ffefc => generated 1226 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:32:02.549172 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-d95a2934-4a07-4706-9351-bf300c44a762 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:32:02.550519 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-d95a2934-4a07-4706-9351-bf300c44a762 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] [instance: 5d54db85-b991-4890-abaa-952413baa2e7] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:32:02.557820 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-d95a2934-4a07-4706-9351-bf300c44a762 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:32:02.558267 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-d95a2934-4a07-4706-9351-bf300c44a762 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:32:02.559055 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-d95a2934-4a07-4706-9351-bf300c44a762 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:32:02.559472 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-d95a2934-4a07-4706-9351-bf300c44a762 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:32:02.588982 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-d95a2934-4a07-4706-9351-bf300c44a762 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] 10.222.0.11 "GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046469 Nov 17 03:32:02.589536 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 635/1307] 10.222.0.11 () {60 vars in 1342 bytes} [Wed Nov 17 03:32:02 2021] GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 17 03:32:02.751417 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-51347cd3-7b68-4846-8c8d-94c3f64aa6fe tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:32:02.752417 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-51347cd3-7b68-4846-8c8d-94c3f64aa6fe tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] [instance: 0698dc5b-5f47-46c4-ace8-f5e891a964a0] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:32:02.759921 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-51347cd3-7b68-4846-8c8d-94c3f64aa6fe tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:32:02.760385 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-51347cd3-7b68-4846-8c8d-94c3f64aa6fe tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:32:02.761225 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-51347cd3-7b68-4846-8c8d-94c3f64aa6fe tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:32:02.761705 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-51347cd3-7b68-4846-8c8d-94c3f64aa6fe tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:32:02.898911 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-51347cd3-7b68-4846-8c8d-94c3f64aa6fe tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '163b2f24a72649ac8084be1cac32fa09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e123e9b86124c93a7fc2db9984e7466', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:32:02.906741 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-51347cd3-7b68-4846-8c8d-94c3f64aa6fe tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] 10.222.0.11 "GET /compute/v2.1/servers/0698dc5b-5f47-46c4-ace8-f5e891a964a0" status: 200 len: 1565 microversion: 2.1 time: 0.161519 Nov 17 03:32:02.907309 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 673/1308] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:32:02 2021] GET /compute/v2.1/servers/0698dc5b-5f47-46c4-ace8-f5e891a964a0 => generated 1565 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:32:03.005008 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-a2277e0f-acc8-4310-b425-9c6fe89c4b89 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:32:03.006451 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-a2277e0f-acc8-4310-b425-9c6fe89c4b89 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] [instance: a49437df-3059-4528-8328-2f3471d5fb45] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:32:03.016507 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-a2277e0f-acc8-4310-b425-9c6fe89c4b89 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:32:03.017369 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-a2277e0f-acc8-4310-b425-9c6fe89c4b89 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:32:03.018643 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-a2277e0f-acc8-4310-b425-9c6fe89c4b89 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:32:03.019397 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-a2277e0f-acc8-4310-b425-9c6fe89c4b89 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:32:03.050152 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-a2277e0f-acc8-4310-b425-9c6fe89c4b89 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] 10.222.0.11 "GET /compute/v2.1/servers/a49437df-3059-4528-8328-2f3471d5fb45/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051410 Nov 17 03:32:03.050698 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 636/1309] 10.222.0.11 () {58 vars in 1301 bytes} [Wed Nov 17 03:32:02 2021] GET /compute/v2.1/servers/a49437df-3059-4528-8328-2f3471d5fb45/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 17 03:32:03.295681 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-c9b83d8f-2246-48b8-adf8-46bf7fc01247 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:32:03.296655 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-c9b83d8f-2246-48b8-adf8-46bf7fc01247 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] [instance: 5ddbfaaa-fabf-4324-941c-8868625ffefc] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:32:03.307703 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-c9b83d8f-2246-48b8-adf8-46bf7fc01247 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:32:03.308442 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-c9b83d8f-2246-48b8-adf8-46bf7fc01247 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:32:03.309743 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-c9b83d8f-2246-48b8-adf8-46bf7fc01247 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:32:03.310444 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-c9b83d8f-2246-48b8-adf8-46bf7fc01247 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:32:03.377101 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-c9b83d8f-2246-48b8-adf8-46bf7fc01247 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80763e09d44c475ea2425b22874e9612', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fef02a1dd77946a2ac0e0414b557435f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:32:03.385046 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-c9b83d8f-2246-48b8-adf8-46bf7fc01247 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] 10.222.0.11 "GET /compute/v2.1/servers/5ddbfaaa-fabf-4324-941c-8868625ffefc" status: 200 len: 1226 microversion: 2.1 time: 0.095642 Nov 17 03:32:03.385610 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 674/1310] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:32:03 2021] GET /compute/v2.1/servers/5ddbfaaa-fabf-4324-941c-8868625ffefc => generated 1226 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:32:03.604259 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-df4fe46b-e423-4a57-ba7d-48f5f0b83ed1 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:32:03.605367 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-df4fe46b-e423-4a57-ba7d-48f5f0b83ed1 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] [instance: 5d54db85-b991-4890-abaa-952413baa2e7] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:32:03.614022 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-df4fe46b-e423-4a57-ba7d-48f5f0b83ed1 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:32:03.614606 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-df4fe46b-e423-4a57-ba7d-48f5f0b83ed1 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:32:03.615614 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-df4fe46b-e423-4a57-ba7d-48f5f0b83ed1 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:32:03.616175 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-df4fe46b-e423-4a57-ba7d-48f5f0b83ed1 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:32:03.648794 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-df4fe46b-e423-4a57-ba7d-48f5f0b83ed1 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] 10.222.0.11 "GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.050258 Nov 17 03:32:03.649361 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 637/1311] 10.222.0.11 () {60 vars in 1342 bytes} [Wed Nov 17 03:32:03 2021] GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 17 03:32:03.928067 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-a48c87e0-40d1-4c3b-864c-e949b4e51225 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:32:03.928821 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-a48c87e0-40d1-4c3b-864c-e949b4e51225 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] [instance: 0698dc5b-5f47-46c4-ace8-f5e891a964a0] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:32:03.936213 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-a48c87e0-40d1-4c3b-864c-e949b4e51225 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:32:03.936702 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-a48c87e0-40d1-4c3b-864c-e949b4e51225 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:32:03.937580 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-a48c87e0-40d1-4c3b-864c-e949b4e51225 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:32:03.938053 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-a48c87e0-40d1-4c3b-864c-e949b4e51225 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:32:04.068310 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-457837f6-e995-4c49-84d6-fb17943f013a tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:32:04.069555 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-457837f6-e995-4c49-84d6-fb17943f013a tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] [instance: a49437df-3059-4528-8328-2f3471d5fb45] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:32:04.075741 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-457837f6-e995-4c49-84d6-fb17943f013a tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:32:04.076174 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-457837f6-e995-4c49-84d6-fb17943f013a tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:32:04.076988 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-457837f6-e995-4c49-84d6-fb17943f013a tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:32:04.077417 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-457837f6-e995-4c49-84d6-fb17943f013a tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:32:04.094993 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-a48c87e0-40d1-4c3b-864c-e949b4e51225 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '163b2f24a72649ac8084be1cac32fa09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e123e9b86124c93a7fc2db9984e7466', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:32:04.102647 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-a48c87e0-40d1-4c3b-864c-e949b4e51225 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] 10.222.0.11 "GET /compute/v2.1/servers/0698dc5b-5f47-46c4-ace8-f5e891a964a0" status: 200 len: 1565 microversion: 2.1 time: 0.180918 Nov 17 03:32:04.103221 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 675/1312] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:32:03 2021] GET /compute/v2.1/servers/0698dc5b-5f47-46c4-ace8-f5e891a964a0 => generated 1565 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:32:04.108043 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-457837f6-e995-4c49-84d6-fb17943f013a tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] 10.222.0.11 "GET /compute/v2.1/servers/a49437df-3059-4528-8328-2f3471d5fb45/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043418 Nov 17 03:32:04.108644 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 638/1313] 10.222.0.11 () {58 vars in 1301 bytes} [Wed Nov 17 03:32:04 2021] GET /compute/v2.1/servers/a49437df-3059-4528-8328-2f3471d5fb45/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 17 03:32:04.406273 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-aedbf398-39a5-4d60-9274-f826c51fcf21 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:32:04.407249 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-aedbf398-39a5-4d60-9274-f826c51fcf21 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] [instance: 5ddbfaaa-fabf-4324-941c-8868625ffefc] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:32:04.418734 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-aedbf398-39a5-4d60-9274-f826c51fcf21 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:32:04.419450 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-aedbf398-39a5-4d60-9274-f826c51fcf21 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:32:04.420718 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-aedbf398-39a5-4d60-9274-f826c51fcf21 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:32:04.421475 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-aedbf398-39a5-4d60-9274-f826c51fcf21 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:32:04.484726 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-aedbf398-39a5-4d60-9274-f826c51fcf21 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80763e09d44c475ea2425b22874e9612', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fef02a1dd77946a2ac0e0414b557435f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:32:04.493168 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-aedbf398-39a5-4d60-9274-f826c51fcf21 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] 10.222.0.11 "GET /compute/v2.1/servers/5ddbfaaa-fabf-4324-941c-8868625ffefc" status: 200 len: 1226 microversion: 2.1 time: 0.093062 Nov 17 03:32:04.493736 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 676/1314] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:32:04 2021] GET /compute/v2.1/servers/5ddbfaaa-fabf-4324-941c-8868625ffefc => generated 1226 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:32:04.664376 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-df7eaf2f-2734-447f-8924-396229f2e00e tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:32:04.665728 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-df7eaf2f-2734-447f-8924-396229f2e00e tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] [instance: 5d54db85-b991-4890-abaa-952413baa2e7] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:32:04.676173 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-df7eaf2f-2734-447f-8924-396229f2e00e tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:32:04.676967 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-df7eaf2f-2734-447f-8924-396229f2e00e tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:32:04.678251 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-df7eaf2f-2734-447f-8924-396229f2e00e tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:32:04.678678 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-df7eaf2f-2734-447f-8924-396229f2e00e tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:32:04.708236 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-df7eaf2f-2734-447f-8924-396229f2e00e tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] 10.222.0.11 "GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.050380 Nov 17 03:32:04.708791 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 639/1315] 10.222.0.11 () {60 vars in 1342 bytes} [Wed Nov 17 03:32:04 2021] GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 17 03:32:05.119752 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-d37a80b8-67a9-4192-8533-d2ac7738a7d3 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:32:05.120027 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-471f7a53-8f1f-45fa-bb5a-ba259019612c tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:32:05.120355 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-d37a80b8-67a9-4192-8533-d2ac7738a7d3 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] [instance: 0698dc5b-5f47-46c4-ace8-f5e891a964a0] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:32:05.120816 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-471f7a53-8f1f-45fa-bb5a-ba259019612c tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] [instance: a49437df-3059-4528-8328-2f3471d5fb45] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:32:05.127235 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-d37a80b8-67a9-4192-8533-d2ac7738a7d3 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:32:05.127427 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-471f7a53-8f1f-45fa-bb5a-ba259019612c tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:32:05.127686 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-d37a80b8-67a9-4192-8533-d2ac7738a7d3 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:32:05.127864 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-471f7a53-8f1f-45fa-bb5a-ba259019612c tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:32:05.128457 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-d37a80b8-67a9-4192-8533-d2ac7738a7d3 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:32:05.128601 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-471f7a53-8f1f-45fa-bb5a-ba259019612c tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:32:05.128948 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-471f7a53-8f1f-45fa-bb5a-ba259019612c tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:32:05.129091 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-d37a80b8-67a9-4192-8533-d2ac7738a7d3 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:32:05.158629 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-471f7a53-8f1f-45fa-bb5a-ba259019612c tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] 10.222.0.11 "GET /compute/v2.1/servers/a49437df-3059-4528-8328-2f3471d5fb45/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042431 Nov 17 03:32:05.159188 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 640/1316] 10.222.0.11 () {58 vars in 1301 bytes} [Wed Nov 17 03:32:05 2021] GET /compute/v2.1/servers/a49437df-3059-4528-8328-2f3471d5fb45/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 17 03:32:05.266766 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-d37a80b8-67a9-4192-8533-d2ac7738a7d3 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '163b2f24a72649ac8084be1cac32fa09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e123e9b86124c93a7fc2db9984e7466', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:32:05.275722 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-d37a80b8-67a9-4192-8533-d2ac7738a7d3 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] 10.222.0.11 "GET /compute/v2.1/servers/0698dc5b-5f47-46c4-ace8-f5e891a964a0" status: 200 len: 1565 microversion: 2.1 time: 0.159683 Nov 17 03:32:05.276327 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 677/1317] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:32:05 2021] GET /compute/v2.1/servers/0698dc5b-5f47-46c4-ace8-f5e891a964a0 => generated 1565 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:32:05.514366 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-aa5ea4cd-7b99-46d9-9417-9f791fb4ed9f tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:32:05.515398 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-aa5ea4cd-7b99-46d9-9417-9f791fb4ed9f tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] [instance: 5ddbfaaa-fabf-4324-941c-8868625ffefc] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:32:05.524586 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-aa5ea4cd-7b99-46d9-9417-9f791fb4ed9f tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:32:05.525070 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-aa5ea4cd-7b99-46d9-9417-9f791fb4ed9f tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:32:05.525852 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-aa5ea4cd-7b99-46d9-9417-9f791fb4ed9f tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:32:05.526283 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-aa5ea4cd-7b99-46d9-9417-9f791fb4ed9f tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:32:05.590126 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-aa5ea4cd-7b99-46d9-9417-9f791fb4ed9f tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80763e09d44c475ea2425b22874e9612', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fef02a1dd77946a2ac0e0414b557435f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:32:05.601583 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-aa5ea4cd-7b99-46d9-9417-9f791fb4ed9f tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] 10.222.0.11 "GET /compute/v2.1/servers/5ddbfaaa-fabf-4324-941c-8868625ffefc" status: 200 len: 1226 microversion: 2.1 time: 0.093414 Nov 17 03:32:05.602270 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 641/1318] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:32:05 2021] GET /compute/v2.1/servers/5ddbfaaa-fabf-4324-941c-8868625ffefc => generated 1226 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:32:05.723878 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-9b1e8fab-be6a-4b1b-b5c3-133663ba41d9 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:32:05.725313 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-9b1e8fab-be6a-4b1b-b5c3-133663ba41d9 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] [instance: 5d54db85-b991-4890-abaa-952413baa2e7] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:32:05.732316 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-9b1e8fab-be6a-4b1b-b5c3-133663ba41d9 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:32:05.732811 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-9b1e8fab-be6a-4b1b-b5c3-133663ba41d9 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:32:05.733640 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-9b1e8fab-be6a-4b1b-b5c3-133663ba41d9 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:32:05.734099 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-9b1e8fab-be6a-4b1b-b5c3-133663ba41d9 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:32:05.764573 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-9b1e8fab-be6a-4b1b-b5c3-133663ba41d9 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] 10.222.0.11 "GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046932 Nov 17 03:32:05.765097 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 678/1319] 10.222.0.11 () {60 vars in 1342 bytes} [Wed Nov 17 03:32:05 2021] GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 17 03:32:06.174352 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-76b71a1f-337a-49e0-a537-d4d8038138ce tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:32:06.175891 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-76b71a1f-337a-49e0-a537-d4d8038138ce tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] [instance: a49437df-3059-4528-8328-2f3471d5fb45] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:32:06.183570 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-76b71a1f-337a-49e0-a537-d4d8038138ce tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:32:06.183974 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-76b71a1f-337a-49e0-a537-d4d8038138ce tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:32:06.184747 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-76b71a1f-337a-49e0-a537-d4d8038138ce tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:32:06.185206 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-76b71a1f-337a-49e0-a537-d4d8038138ce tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:32:06.213881 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-76b71a1f-337a-49e0-a537-d4d8038138ce tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] 10.222.0.11 "GET /compute/v2.1/servers/a49437df-3059-4528-8328-2f3471d5fb45/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045783 Nov 17 03:32:06.214431 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 642/1320] 10.222.0.11 () {58 vars in 1301 bytes} [Wed Nov 17 03:32:06 2021] GET /compute/v2.1/servers/a49437df-3059-4528-8328-2f3471d5fb45/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 17 03:32:06.293597 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-5f569dce-6c1a-4d54-850e-2615b42d74f4 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:32:06.294202 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-5f569dce-6c1a-4d54-850e-2615b42d74f4 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] [instance: 0698dc5b-5f47-46c4-ace8-f5e891a964a0] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:32:06.300497 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-5f569dce-6c1a-4d54-850e-2615b42d74f4 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:32:06.300980 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-5f569dce-6c1a-4d54-850e-2615b42d74f4 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:32:06.301739 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-5f569dce-6c1a-4d54-850e-2615b42d74f4 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:32:06.302164 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-5f569dce-6c1a-4d54-850e-2615b42d74f4 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:32:06.445461 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-5f569dce-6c1a-4d54-850e-2615b42d74f4 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '163b2f24a72649ac8084be1cac32fa09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e123e9b86124c93a7fc2db9984e7466', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:32:06.453299 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-5f569dce-6c1a-4d54-850e-2615b42d74f4 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] 10.222.0.11 "GET /compute/v2.1/servers/0698dc5b-5f47-46c4-ace8-f5e891a964a0" status: 200 len: 1565 microversion: 2.1 time: 0.163403 Nov 17 03:32:06.453859 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 679/1321] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:32:06 2021] GET /compute/v2.1/servers/0698dc5b-5f47-46c4-ace8-f5e891a964a0 => generated 1565 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:32:06.622772 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-cccb5a69-001c-4fa4-b352-8f9e371b5bad tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:32:06.623776 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-cccb5a69-001c-4fa4-b352-8f9e371b5bad tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] [instance: 5ddbfaaa-fabf-4324-941c-8868625ffefc] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:32:06.633365 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-cccb5a69-001c-4fa4-b352-8f9e371b5bad tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:32:06.633739 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-cccb5a69-001c-4fa4-b352-8f9e371b5bad tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:32:06.634520 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-cccb5a69-001c-4fa4-b352-8f9e371b5bad tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:32:06.634945 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-cccb5a69-001c-4fa4-b352-8f9e371b5bad tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:32:06.695079 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-cccb5a69-001c-4fa4-b352-8f9e371b5bad tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80763e09d44c475ea2425b22874e9612', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fef02a1dd77946a2ac0e0414b557435f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:32:06.702679 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-cccb5a69-001c-4fa4-b352-8f9e371b5bad tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] 10.222.0.11 "GET /compute/v2.1/servers/5ddbfaaa-fabf-4324-941c-8868625ffefc" status: 200 len: 1226 microversion: 2.1 time: 0.086421 Nov 17 03:32:06.703249 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 643/1322] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:32:06 2021] GET /compute/v2.1/servers/5ddbfaaa-fabf-4324-941c-8868625ffefc => generated 1226 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:32:06.780684 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-775e1f7a-d30e-479d-a0a0-8c6c28bc022d tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:32:06.782188 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-775e1f7a-d30e-479d-a0a0-8c6c28bc022d tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] [instance: 5d54db85-b991-4890-abaa-952413baa2e7] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:32:06.792688 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-775e1f7a-d30e-479d-a0a0-8c6c28bc022d tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:32:06.793474 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-775e1f7a-d30e-479d-a0a0-8c6c28bc022d tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:32:06.794739 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-775e1f7a-d30e-479d-a0a0-8c6c28bc022d tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:32:06.795455 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-775e1f7a-d30e-479d-a0a0-8c6c28bc022d tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:32:06.827810 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-775e1f7a-d30e-479d-a0a0-8c6c28bc022d tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] 10.222.0.11 "GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.053471 Nov 17 03:32:06.828348 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 680/1323] 10.222.0.11 () {60 vars in 1342 bytes} [Wed Nov 17 03:32:06 2021] GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 17 03:32:07.230001 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-04106631-d9fc-48bd-8975-07ea54c48fc4 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:32:07.231516 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-04106631-d9fc-48bd-8975-07ea54c48fc4 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] [instance: a49437df-3059-4528-8328-2f3471d5fb45] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:32:07.242657 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-04106631-d9fc-48bd-8975-07ea54c48fc4 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:32:07.243394 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-04106631-d9fc-48bd-8975-07ea54c48fc4 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:32:07.244664 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-04106631-d9fc-48bd-8975-07ea54c48fc4 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:32:07.245522 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-04106631-d9fc-48bd-8975-07ea54c48fc4 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:32:07.280376 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-04106631-d9fc-48bd-8975-07ea54c48fc4 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] 10.222.0.11 "GET /compute/v2.1/servers/a49437df-3059-4528-8328-2f3471d5fb45/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.057003 Nov 17 03:32:07.280975 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 644/1324] 10.222.0.11 () {58 vars in 1301 bytes} [Wed Nov 17 03:32:07 2021] GET /compute/v2.1/servers/a49437df-3059-4528-8328-2f3471d5fb45/os-volume_attachments => generated 197 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 17 03:32:07.471608 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-efb2264d-76d0-4cf9-add4-1d74dc3ce8eb tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:32:07.472149 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-efb2264d-76d0-4cf9-add4-1d74dc3ce8eb tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] [instance: 0698dc5b-5f47-46c4-ace8-f5e891a964a0] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:32:07.479132 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-efb2264d-76d0-4cf9-add4-1d74dc3ce8eb tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:32:07.479576 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-efb2264d-76d0-4cf9-add4-1d74dc3ce8eb tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:32:07.480343 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-efb2264d-76d0-4cf9-add4-1d74dc3ce8eb tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:32:07.480766 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-efb2264d-76d0-4cf9-add4-1d74dc3ce8eb tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:32:07.620137 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-efb2264d-76d0-4cf9-add4-1d74dc3ce8eb tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '163b2f24a72649ac8084be1cac32fa09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e123e9b86124c93a7fc2db9984e7466', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:32:07.628318 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-efb2264d-76d0-4cf9-add4-1d74dc3ce8eb tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] 10.222.0.11 "GET /compute/v2.1/servers/0698dc5b-5f47-46c4-ace8-f5e891a964a0" status: 200 len: 1565 microversion: 2.1 time: 0.160561 Nov 17 03:32:07.628870 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 681/1325] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:32:07 2021] GET /compute/v2.1/servers/0698dc5b-5f47-46c4-ace8-f5e891a964a0 => generated 1565 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:32:07.722514 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-577352e6-e307-47b0-ab03-4b6e6c219c7f tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:32:07.723512 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-577352e6-e307-47b0-ab03-4b6e6c219c7f tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] [instance: 5ddbfaaa-fabf-4324-941c-8868625ffefc] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:32:07.733421 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-577352e6-e307-47b0-ab03-4b6e6c219c7f tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:32:07.734114 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-577352e6-e307-47b0-ab03-4b6e6c219c7f tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:32:07.735326 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-577352e6-e307-47b0-ab03-4b6e6c219c7f tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:32:07.735953 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-577352e6-e307-47b0-ab03-4b6e6c219c7f tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:32:07.799745 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-577352e6-e307-47b0-ab03-4b6e6c219c7f tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80763e09d44c475ea2425b22874e9612', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fef02a1dd77946a2ac0e0414b557435f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:32:07.811385 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-577352e6-e307-47b0-ab03-4b6e6c219c7f tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] 10.222.0.11 "GET /compute/v2.1/servers/5ddbfaaa-fabf-4324-941c-8868625ffefc" status: 200 len: 1226 microversion: 2.1 time: 0.094517 Nov 17 03:32:07.812197 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 645/1326] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:32:07 2021] GET /compute/v2.1/servers/5ddbfaaa-fabf-4324-941c-8868625ffefc => generated 1226 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:32:07.846575 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-a6f3a862-1034-442b-a870-8e3232638353 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:32:07.847567 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-a6f3a862-1034-442b-a870-8e3232638353 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] [instance: 5d54db85-b991-4890-abaa-952413baa2e7] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:32:07.854302 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-a6f3a862-1034-442b-a870-8e3232638353 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:32:07.854740 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-a6f3a862-1034-442b-a870-8e3232638353 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:32:07.855502 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-a6f3a862-1034-442b-a870-8e3232638353 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:32:07.855930 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-a6f3a862-1034-442b-a870-8e3232638353 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:32:07.885245 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-a6f3a862-1034-442b-a870-8e3232638353 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] 10.222.0.11 "GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.048809 Nov 17 03:32:07.885793 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 682/1327] 10.222.0.11 () {60 vars in 1342 bytes} [Wed Nov 17 03:32:07 2021] GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 17 03:32:08.295762 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-ed76ccc7-e2b4-4156-94c6-26c7d6966d50 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:32:08.297272 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-ed76ccc7-e2b4-4156-94c6-26c7d6966d50 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] [instance: a49437df-3059-4528-8328-2f3471d5fb45] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:32:08.306671 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-ed76ccc7-e2b4-4156-94c6-26c7d6966d50 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:32:08.307101 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-ed76ccc7-e2b4-4156-94c6-26c7d6966d50 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:32:08.307867 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-ed76ccc7-e2b4-4156-94c6-26c7d6966d50 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:32:08.308291 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-ed76ccc7-e2b4-4156-94c6-26c7d6966d50 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:32:08.336651 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-ed76ccc7-e2b4-4156-94c6-26c7d6966d50 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] 10.222.0.11 "GET /compute/v2.1/servers/a49437df-3059-4528-8328-2f3471d5fb45/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047112 Nov 17 03:32:08.337148 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 646/1328] 10.222.0.11 () {58 vars in 1301 bytes} [Wed Nov 17 03:32:08 2021] GET /compute/v2.1/servers/a49437df-3059-4528-8328-2f3471d5fb45/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 17 03:32:08.649815 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-b0cb26db-1396-4a8c-ab95-f83f952d054e tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:32:08.650689 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-b0cb26db-1396-4a8c-ab95-f83f952d054e tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] [instance: 0698dc5b-5f47-46c4-ace8-f5e891a964a0] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:32:08.660600 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-b0cb26db-1396-4a8c-ab95-f83f952d054e tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:32:08.661383 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-b0cb26db-1396-4a8c-ab95-f83f952d054e tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:32:08.662804 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-b0cb26db-1396-4a8c-ab95-f83f952d054e tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:32:08.663261 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-b0cb26db-1396-4a8c-ab95-f83f952d054e tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:32:08.809125 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-b0cb26db-1396-4a8c-ab95-f83f952d054e tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '163b2f24a72649ac8084be1cac32fa09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e123e9b86124c93a7fc2db9984e7466', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:32:08.819728 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-b0cb26db-1396-4a8c-ab95-f83f952d054e tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] 10.222.0.11 "GET /compute/v2.1/servers/0698dc5b-5f47-46c4-ace8-f5e891a964a0" status: 200 len: 1565 microversion: 2.1 time: 0.176180 Nov 17 03:32:08.820304 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 683/1329] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:32:08 2021] GET /compute/v2.1/servers/0698dc5b-5f47-46c4-ace8-f5e891a964a0 => generated 1565 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:32:08.829661 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-1de450d8-0fdd-4353-9fce-99eba3d999bc tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:32:08.830296 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-1de450d8-0fdd-4353-9fce-99eba3d999bc tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] [instance: 5ddbfaaa-fabf-4324-941c-8868625ffefc] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:32:08.836736 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-1de450d8-0fdd-4353-9fce-99eba3d999bc tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:32:08.837209 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-1de450d8-0fdd-4353-9fce-99eba3d999bc tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:32:08.837978 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-1de450d8-0fdd-4353-9fce-99eba3d999bc tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:32:08.838405 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-1de450d8-0fdd-4353-9fce-99eba3d999bc tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:32:08.898876 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-f53ac507-5c96-4f35-922d-6323fc779983 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:32:08.899982 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-f53ac507-5c96-4f35-922d-6323fc779983 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] [instance: 5d54db85-b991-4890-abaa-952413baa2e7] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:32:08.902665 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-1de450d8-0fdd-4353-9fce-99eba3d999bc tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80763e09d44c475ea2425b22874e9612', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fef02a1dd77946a2ac0e0414b557435f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:32:08.906216 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-f53ac507-5c96-4f35-922d-6323fc779983 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:32:08.906654 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-f53ac507-5c96-4f35-922d-6323fc779983 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:32:08.907422 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-f53ac507-5c96-4f35-922d-6323fc779983 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:32:08.907850 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-f53ac507-5c96-4f35-922d-6323fc779983 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:32:08.910522 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-1de450d8-0fdd-4353-9fce-99eba3d999bc tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] 10.222.0.11 "GET /compute/v2.1/servers/5ddbfaaa-fabf-4324-941c-8868625ffefc" status: 200 len: 1226 microversion: 2.1 time: 0.084522 Nov 17 03:32:08.912216 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 647/1330] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:32:08 2021] GET /compute/v2.1/servers/5ddbfaaa-fabf-4324-941c-8868625ffefc => generated 1226 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:32:08.937524 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-f53ac507-5c96-4f35-922d-6323fc779983 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] 10.222.0.11 "GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042617 Nov 17 03:32:08.938054 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 684/1331] 10.222.0.11 () {60 vars in 1342 bytes} [Wed Nov 17 03:32:08 2021] GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 17 03:32:09.352148 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-c6d30103-0304-48bd-93bc-07a544515d95 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:32:09.353074 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-c6d30103-0304-48bd-93bc-07a544515d95 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] [instance: a49437df-3059-4528-8328-2f3471d5fb45] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:32:09.360052 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-c6d30103-0304-48bd-93bc-07a544515d95 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:32:09.360493 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-c6d30103-0304-48bd-93bc-07a544515d95 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:32:09.361311 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-c6d30103-0304-48bd-93bc-07a544515d95 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:32:09.361739 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-c6d30103-0304-48bd-93bc-07a544515d95 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:32:09.390828 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-c6d30103-0304-48bd-93bc-07a544515d95 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] 10.222.0.11 "GET /compute/v2.1/servers/a49437df-3059-4528-8328-2f3471d5fb45/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043559 Nov 17 03:32:09.391384 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 648/1332] 10.222.0.11 () {58 vars in 1301 bytes} [Wed Nov 17 03:32:09 2021] GET /compute/v2.1/servers/a49437df-3059-4528-8328-2f3471d5fb45/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 17 03:32:09.838638 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-12b2f3e7-2b54-464f-83b9-9da936cd9716 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:32:09.839244 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-12b2f3e7-2b54-464f-83b9-9da936cd9716 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] [instance: 0698dc5b-5f47-46c4-ace8-f5e891a964a0] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:32:09.845463 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-12b2f3e7-2b54-464f-83b9-9da936cd9716 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:32:09.845916 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-12b2f3e7-2b54-464f-83b9-9da936cd9716 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:32:09.846681 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-12b2f3e7-2b54-464f-83b9-9da936cd9716 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:32:09.847115 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-12b2f3e7-2b54-464f-83b9-9da936cd9716 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:32:09.927031 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-f277c9a8-3621-4e30-821e-8530a9aae0c5 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:32:09.927545 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-f277c9a8-3621-4e30-821e-8530a9aae0c5 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] [instance: 5ddbfaaa-fabf-4324-941c-8868625ffefc] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:32:09.934598 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-f277c9a8-3621-4e30-821e-8530a9aae0c5 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:32:09.935051 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-f277c9a8-3621-4e30-821e-8530a9aae0c5 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:32:09.935862 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-f277c9a8-3621-4e30-821e-8530a9aae0c5 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:32:09.936318 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-f277c9a8-3621-4e30-821e-8530a9aae0c5 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:32:09.986027 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-12b2f3e7-2b54-464f-83b9-9da936cd9716 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '163b2f24a72649ac8084be1cac32fa09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e123e9b86124c93a7fc2db9984e7466', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:32:09.993490 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-12b2f3e7-2b54-464f-83b9-9da936cd9716 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] 10.222.0.11 "GET /compute/v2.1/servers/0698dc5b-5f47-46c4-ace8-f5e891a964a0" status: 200 len: 1565 microversion: 2.1 time: 0.158833 Nov 17 03:32:09.994060 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 685/1333] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:32:09 2021] GET /compute/v2.1/servers/0698dc5b-5f47-46c4-ace8-f5e891a964a0 => generated 1565 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:32:09.995186 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-f277c9a8-3621-4e30-821e-8530a9aae0c5 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80763e09d44c475ea2425b22874e9612', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fef02a1dd77946a2ac0e0414b557435f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:32:09.998414 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-a17f2f57-4627-4613-b228-636e9238cf7f tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:32:09.999330 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-a17f2f57-4627-4613-b228-636e9238cf7f tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] [instance: 5d54db85-b991-4890-abaa-952413baa2e7] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:32:10.003406 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-f277c9a8-3621-4e30-821e-8530a9aae0c5 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] 10.222.0.11 "GET /compute/v2.1/servers/5ddbfaaa-fabf-4324-941c-8868625ffefc" status: 200 len: 1226 microversion: 2.1 time: 0.080209 Nov 17 03:32:10.004057 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 649/1334] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:32:09 2021] GET /compute/v2.1/servers/5ddbfaaa-fabf-4324-941c-8868625ffefc => generated 1226 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:32:10.005096 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-a17f2f57-4627-4613-b228-636e9238cf7f tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:32:10.005533 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-a17f2f57-4627-4613-b228-636e9238cf7f tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:32:10.006292 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-a17f2f57-4627-4613-b228-636e9238cf7f tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:32:10.006798 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-a17f2f57-4627-4613-b228-636e9238cf7f tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:32:10.034972 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-a17f2f57-4627-4613-b228-636e9238cf7f tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] 10.222.0.11 "GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.039922 Nov 17 03:32:10.035522 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 686/1335] 10.222.0.11 () {60 vars in 1342 bytes} [Wed Nov 17 03:32:09 2021] GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 17 03:32:10.403429 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-56ab16b7-81c8-4368-a7e5-295b3d5a39e9 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:32:10.404559 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-56ab16b7-81c8-4368-a7e5-295b3d5a39e9 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] [instance: a49437df-3059-4528-8328-2f3471d5fb45] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:32:10.411371 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-56ab16b7-81c8-4368-a7e5-295b3d5a39e9 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:32:10.411824 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-56ab16b7-81c8-4368-a7e5-295b3d5a39e9 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:32:10.412663 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-56ab16b7-81c8-4368-a7e5-295b3d5a39e9 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:32:10.413144 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-56ab16b7-81c8-4368-a7e5-295b3d5a39e9 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:32:10.442899 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-56ab16b7-81c8-4368-a7e5-295b3d5a39e9 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] 10.222.0.11 "GET /compute/v2.1/servers/a49437df-3059-4528-8328-2f3471d5fb45/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043725 Nov 17 03:32:10.443430 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 650/1336] 10.222.0.11 () {58 vars in 1301 bytes} [Wed Nov 17 03:32:10 2021] GET /compute/v2.1/servers/a49437df-3059-4528-8328-2f3471d5fb45/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 17 03:32:11.014956 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-ad2f2a29-67ea-441c-90aa-3fc507f1746e tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:32:11.016113 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-ad2f2a29-67ea-441c-90aa-3fc507f1746e tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] [instance: 0698dc5b-5f47-46c4-ace8-f5e891a964a0] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:32:11.024044 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-1318fc98-fec7-476d-88e2-8d6a5e211e21 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:32:11.025363 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-1318fc98-fec7-476d-88e2-8d6a5e211e21 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] [instance: 5ddbfaaa-fabf-4324-941c-8868625ffefc] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:32:11.027072 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-ad2f2a29-67ea-441c-90aa-3fc507f1746e tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:32:11.028068 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-ad2f2a29-67ea-441c-90aa-3fc507f1746e tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:32:11.029202 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-ad2f2a29-67ea-441c-90aa-3fc507f1746e tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:32:11.029925 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-ad2f2a29-67ea-441c-90aa-3fc507f1746e tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:32:11.037701 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-1318fc98-fec7-476d-88e2-8d6a5e211e21 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:32:11.037701 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-1318fc98-fec7-476d-88e2-8d6a5e211e21 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:32:11.037701 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-1318fc98-fec7-476d-88e2-8d6a5e211e21 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:32:11.038338 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-1318fc98-fec7-476d-88e2-8d6a5e211e21 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:32:11.097618 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-1318fc98-fec7-476d-88e2-8d6a5e211e21 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80763e09d44c475ea2425b22874e9612', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fef02a1dd77946a2ac0e0414b557435f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:32:11.105243 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-1318fc98-fec7-476d-88e2-8d6a5e211e21 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] 10.222.0.11 "GET /compute/v2.1/servers/5ddbfaaa-fabf-4324-941c-8868625ffefc" status: 200 len: 1226 microversion: 2.1 time: 0.087175 Nov 17 03:32:11.105826 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 651/1337] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:32:11 2021] GET /compute/v2.1/servers/5ddbfaaa-fabf-4324-941c-8868625ffefc => generated 1226 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:32:11.110315 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-ba31f822-c7fd-4f12-a754-e3cd48eb8c4b tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:32:11.111221 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-ba31f822-c7fd-4f12-a754-e3cd48eb8c4b tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] [instance: 5d54db85-b991-4890-abaa-952413baa2e7] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:32:11.117533 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-ba31f822-c7fd-4f12-a754-e3cd48eb8c4b tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:32:11.117990 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-ba31f822-c7fd-4f12-a754-e3cd48eb8c4b tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:32:11.118774 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-ba31f822-c7fd-4f12-a754-e3cd48eb8c4b tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:32:11.119207 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-ba31f822-c7fd-4f12-a754-e3cd48eb8c4b tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:32:11.147986 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-ba31f822-c7fd-4f12-a754-e3cd48eb8c4b tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] 10.222.0.11 "GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041034 Nov 17 03:32:11.148597 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 652/1338] 10.222.0.11 () {60 vars in 1342 bytes} [Wed Nov 17 03:32:11 2021] GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 17 03:32:11.167301 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-ad2f2a29-67ea-441c-90aa-3fc507f1746e tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '163b2f24a72649ac8084be1cac32fa09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e123e9b86124c93a7fc2db9984e7466', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:32:11.174623 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-ad2f2a29-67ea-441c-90aa-3fc507f1746e tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] 10.222.0.11 "GET /compute/v2.1/servers/0698dc5b-5f47-46c4-ace8-f5e891a964a0" status: 200 len: 1565 microversion: 2.1 time: 0.166087 Nov 17 03:32:11.175165 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 687/1339] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:32:11 2021] GET /compute/v2.1/servers/0698dc5b-5f47-46c4-ace8-f5e891a964a0 => generated 1565 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:32:11.456708 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-e37cded3-4fde-406f-9c2d-fa69ba041548 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:32:11.457838 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-e37cded3-4fde-406f-9c2d-fa69ba041548 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] [instance: a49437df-3059-4528-8328-2f3471d5fb45] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:32:11.465453 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-e37cded3-4fde-406f-9c2d-fa69ba041548 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:32:11.465948 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-e37cded3-4fde-406f-9c2d-fa69ba041548 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:32:11.466751 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-e37cded3-4fde-406f-9c2d-fa69ba041548 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:32:11.467182 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-e37cded3-4fde-406f-9c2d-fa69ba041548 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:32:11.496542 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-e37cded3-4fde-406f-9c2d-fa69ba041548 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] 10.222.0.11 "GET /compute/v2.1/servers/a49437df-3059-4528-8328-2f3471d5fb45/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046074 Nov 17 03:32:11.497390 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 653/1340] 10.222.0.11 () {58 vars in 1301 bytes} [Wed Nov 17 03:32:11 2021] GET /compute/v2.1/servers/a49437df-3059-4528-8328-2f3471d5fb45/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 17 03:32:12.125254 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-fb6a9c13-174f-4a46-a7f5-f502ad2b4ceb tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:32:12.126229 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-fb6a9c13-174f-4a46-a7f5-f502ad2b4ceb tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] [instance: 5ddbfaaa-fabf-4324-941c-8868625ffefc] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:32:12.136528 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-fb6a9c13-174f-4a46-a7f5-f502ad2b4ceb tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:32:12.137599 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-fb6a9c13-174f-4a46-a7f5-f502ad2b4ceb tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:32:12.138952 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-fb6a9c13-174f-4a46-a7f5-f502ad2b4ceb tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:32:12.139508 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-fb6a9c13-174f-4a46-a7f5-f502ad2b4ceb tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:32:12.161313 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-e43acf27-9216-476e-a5e6-dd52dd2722f5 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:32:12.163442 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-e43acf27-9216-476e-a5e6-dd52dd2722f5 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] [instance: 5d54db85-b991-4890-abaa-952413baa2e7] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:32:12.173535 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-e43acf27-9216-476e-a5e6-dd52dd2722f5 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:32:12.175052 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-e43acf27-9216-476e-a5e6-dd52dd2722f5 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:32:12.176602 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-e43acf27-9216-476e-a5e6-dd52dd2722f5 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:32:12.178913 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-e43acf27-9216-476e-a5e6-dd52dd2722f5 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:32:12.205343 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-fb6a9c13-174f-4a46-a7f5-f502ad2b4ceb tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80763e09d44c475ea2425b22874e9612', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fef02a1dd77946a2ac0e0414b557435f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:32:12.212989 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-e43acf27-9216-476e-a5e6-dd52dd2722f5 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] 10.222.0.11 "GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.057328 Nov 17 03:32:12.213784 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-fb6a9c13-174f-4a46-a7f5-f502ad2b4ceb tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] 10.222.0.11 "GET /compute/v2.1/servers/5ddbfaaa-fabf-4324-941c-8868625ffefc" status: 200 len: 1226 microversion: 2.1 time: 0.094543 Nov 17 03:32:12.213998 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 654/1341] 10.222.0.11 () {60 vars in 1342 bytes} [Wed Nov 17 03:32:12 2021] GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7/os-volume_attachments => generated 197 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 17 03:32:12.218204 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-0bc612c2-9664-4b9f-a7d1-a27244c396f8 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:32:12.218803 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-0bc612c2-9664-4b9f-a7d1-a27244c396f8 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] [instance: 0698dc5b-5f47-46c4-ace8-f5e891a964a0] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:32:12.220896 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 688/1342] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:32:12 2021] GET /compute/v2.1/servers/5ddbfaaa-fabf-4324-941c-8868625ffefc => generated 1226 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:32:12.224769 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-0bc612c2-9664-4b9f-a7d1-a27244c396f8 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:32:12.225239 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-0bc612c2-9664-4b9f-a7d1-a27244c396f8 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:32:12.226005 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-0bc612c2-9664-4b9f-a7d1-a27244c396f8 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:32:12.226460 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-0bc612c2-9664-4b9f-a7d1-a27244c396f8 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:32:12.382391 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-0bc612c2-9664-4b9f-a7d1-a27244c396f8 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '163b2f24a72649ac8084be1cac32fa09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e123e9b86124c93a7fc2db9984e7466', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:32:12.390840 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-0bc612c2-9664-4b9f-a7d1-a27244c396f8 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] 10.222.0.11 "GET /compute/v2.1/servers/0698dc5b-5f47-46c4-ace8-f5e891a964a0" status: 200 len: 1565 microversion: 2.1 time: 0.175956 Nov 17 03:32:12.391401 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 655/1343] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:32:12 2021] GET /compute/v2.1/servers/0698dc5b-5f47-46c4-ace8-f5e891a964a0 => generated 1565 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:32:12.510965 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-698f7912-3ac7-4253-a460-69117bdb1901 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:32:12.512095 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-698f7912-3ac7-4253-a460-69117bdb1901 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] [instance: a49437df-3059-4528-8328-2f3471d5fb45] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:32:12.518642 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-698f7912-3ac7-4253-a460-69117bdb1901 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:32:12.519197 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-698f7912-3ac7-4253-a460-69117bdb1901 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:32:12.519977 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-698f7912-3ac7-4253-a460-69117bdb1901 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:32:12.520399 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-698f7912-3ac7-4253-a460-69117bdb1901 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:32:12.551060 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-698f7912-3ac7-4253-a460-69117bdb1901 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] 10.222.0.11 "GET /compute/v2.1/servers/a49437df-3059-4528-8328-2f3471d5fb45/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045051 Nov 17 03:32:12.551843 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 689/1344] 10.222.0.11 () {58 vars in 1301 bytes} [Wed Nov 17 03:32:12 2021] GET /compute/v2.1/servers/a49437df-3059-4528-8328-2f3471d5fb45/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 17 03:32:13.228543 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-4070c528-c08b-4d86-9001-46556cf7a697 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:32:13.229602 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-4070c528-c08b-4d86-9001-46556cf7a697 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] [instance: 5d54db85-b991-4890-abaa-952413baa2e7] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:32:13.232675 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-2b955b14-3d59-457e-8a9d-b2566d25801a tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:32:13.233393 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-2b955b14-3d59-457e-8a9d-b2566d25801a tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] [instance: 5ddbfaaa-fabf-4324-941c-8868625ffefc] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:32:13.236926 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-4070c528-c08b-4d86-9001-46556cf7a697 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:32:13.237350 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-4070c528-c08b-4d86-9001-46556cf7a697 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:32:13.238210 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-4070c528-c08b-4d86-9001-46556cf7a697 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:32:13.238684 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-4070c528-c08b-4d86-9001-46556cf7a697 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:32:13.240672 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-2b955b14-3d59-457e-8a9d-b2566d25801a tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:32:13.241209 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-2b955b14-3d59-457e-8a9d-b2566d25801a tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:32:13.242052 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-2b955b14-3d59-457e-8a9d-b2566d25801a tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:32:13.242526 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-2b955b14-3d59-457e-8a9d-b2566d25801a tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:32:13.271324 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-4070c528-c08b-4d86-9001-46556cf7a697 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] 10.222.0.11 "GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.048921 Nov 17 03:32:13.275375 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 656/1345] 10.222.0.11 () {60 vars in 1342 bytes} [Wed Nov 17 03:32:13 2021] GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 17 03:32:13.308330 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-2b955b14-3d59-457e-8a9d-b2566d25801a tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80763e09d44c475ea2425b22874e9612', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fef02a1dd77946a2ac0e0414b557435f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:32:13.320147 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-2b955b14-3d59-457e-8a9d-b2566d25801a tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] 10.222.0.11 "GET /compute/v2.1/servers/5ddbfaaa-fabf-4324-941c-8868625ffefc" status: 200 len: 1226 microversion: 2.1 time: 0.091371 Nov 17 03:32:13.320969 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 690/1346] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:32:13 2021] GET /compute/v2.1/servers/5ddbfaaa-fabf-4324-941c-8868625ffefc => generated 1226 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:32:13.413874 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-62cd4863-d5fb-4808-add3-41df4b28e8bf tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:32:13.414537 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-62cd4863-d5fb-4808-add3-41df4b28e8bf tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] [instance: 0698dc5b-5f47-46c4-ace8-f5e891a964a0] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:32:13.422322 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-62cd4863-d5fb-4808-add3-41df4b28e8bf tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:32:13.422795 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-62cd4863-d5fb-4808-add3-41df4b28e8bf tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:32:13.423608 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-62cd4863-d5fb-4808-add3-41df4b28e8bf tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:32:13.424184 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-62cd4863-d5fb-4808-add3-41df4b28e8bf tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:32:13.563903 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-f1288450-f05c-4518-bd60-6371828e2a1e tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:32:13.564839 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-f1288450-f05c-4518-bd60-6371828e2a1e tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] [instance: a49437df-3059-4528-8328-2f3471d5fb45] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:32:13.570836 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-62cd4863-d5fb-4808-add3-41df4b28e8bf tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '163b2f24a72649ac8084be1cac32fa09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e123e9b86124c93a7fc2db9984e7466', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:32:13.571003 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-f1288450-f05c-4518-bd60-6371828e2a1e tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:32:13.571423 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-f1288450-f05c-4518-bd60-6371828e2a1e tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:32:13.572188 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-f1288450-f05c-4518-bd60-6371828e2a1e tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:32:13.572647 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-f1288450-f05c-4518-bd60-6371828e2a1e tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:32:13.578550 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-62cd4863-d5fb-4808-add3-41df4b28e8bf tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] 10.222.0.11 "GET /compute/v2.1/servers/0698dc5b-5f47-46c4-ace8-f5e891a964a0" status: 200 len: 1565 microversion: 2.1 time: 0.168659 Nov 17 03:32:13.579128 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 657/1347] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:32:13 2021] GET /compute/v2.1/servers/0698dc5b-5f47-46c4-ace8-f5e891a964a0 => generated 1565 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:32:13.602227 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-f1288450-f05c-4518-bd60-6371828e2a1e tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] 10.222.0.11 "GET /compute/v2.1/servers/a49437df-3059-4528-8328-2f3471d5fb45/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042226 Nov 17 03:32:13.602779 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 691/1348] 10.222.0.11 () {58 vars in 1301 bytes} [Wed Nov 17 03:32:13 2021] GET /compute/v2.1/servers/a49437df-3059-4528-8328-2f3471d5fb45/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 17 03:32:14.287338 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-0c808257-539d-4f98-9648-150d4ee16046 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:32:14.288828 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-0c808257-539d-4f98-9648-150d4ee16046 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] [instance: 5d54db85-b991-4890-abaa-952413baa2e7] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:32:14.299951 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-0c808257-539d-4f98-9648-150d4ee16046 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:32:14.300706 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-0c808257-539d-4f98-9648-150d4ee16046 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:32:14.302050 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-0c808257-539d-4f98-9648-150d4ee16046 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:32:14.302788 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-0c808257-539d-4f98-9648-150d4ee16046 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:32:14.333650 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-0c808257-539d-4f98-9648-150d4ee16046 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] 10.222.0.11 "GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.052732 Nov 17 03:32:14.334096 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 658/1349] 10.222.0.11 () {60 vars in 1342 bytes} [Wed Nov 17 03:32:14 2021] GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 17 03:32:14.337565 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-029446c1-9007-46e0-a310-65b51410eee3 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:32:14.338174 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-029446c1-9007-46e0-a310-65b51410eee3 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] [instance: 5ddbfaaa-fabf-4324-941c-8868625ffefc] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:32:14.345147 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-029446c1-9007-46e0-a310-65b51410eee3 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:32:14.345604 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-029446c1-9007-46e0-a310-65b51410eee3 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:32:14.346379 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-029446c1-9007-46e0-a310-65b51410eee3 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:32:14.346824 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-029446c1-9007-46e0-a310-65b51410eee3 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:32:14.595689 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-458b18c8-aee1-4903-9917-09e029f178cf tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:32:14.596335 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-458b18c8-aee1-4903-9917-09e029f178cf tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] [instance: 0698dc5b-5f47-46c4-ace8-f5e891a964a0] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:32:14.603246 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-458b18c8-aee1-4903-9917-09e029f178cf tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:32:14.603694 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-458b18c8-aee1-4903-9917-09e029f178cf tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:32:14.604483 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-458b18c8-aee1-4903-9917-09e029f178cf tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:32:14.604946 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-458b18c8-aee1-4903-9917-09e029f178cf tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:32:14.627795 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-029446c1-9007-46e0-a310-65b51410eee3 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80763e09d44c475ea2425b22874e9612', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fef02a1dd77946a2ac0e0414b557435f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:32:14.635725 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-029446c1-9007-46e0-a310-65b51410eee3 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] 10.222.0.11 "GET /compute/v2.1/servers/5ddbfaaa-fabf-4324-941c-8868625ffefc" status: 200 len: 1226 microversion: 2.1 time: 0.302071 Nov 17 03:32:14.636301 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 692/1350] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:32:14 2021] GET /compute/v2.1/servers/5ddbfaaa-fabf-4324-941c-8868625ffefc => generated 1226 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:32:14.640934 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-474ee160-7094-4d9f-84fe-378e334a19b3 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:32:14.641854 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-474ee160-7094-4d9f-84fe-378e334a19b3 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] [instance: a49437df-3059-4528-8328-2f3471d5fb45] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:32:14.647711 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-474ee160-7094-4d9f-84fe-378e334a19b3 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:32:14.648173 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-474ee160-7094-4d9f-84fe-378e334a19b3 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:32:14.648998 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-474ee160-7094-4d9f-84fe-378e334a19b3 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:32:14.649436 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-474ee160-7094-4d9f-84fe-378e334a19b3 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:32:14.678869 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-474ee160-7094-4d9f-84fe-378e334a19b3 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] 10.222.0.11 "GET /compute/v2.1/servers/a49437df-3059-4528-8328-2f3471d5fb45/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041241 Nov 17 03:32:14.679442 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 693/1351] 10.222.0.11 () {58 vars in 1301 bytes} [Wed Nov 17 03:32:14 2021] GET /compute/v2.1/servers/a49437df-3059-4528-8328-2f3471d5fb45/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 17 03:32:14.752056 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-458b18c8-aee1-4903-9917-09e029f178cf tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '163b2f24a72649ac8084be1cac32fa09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e123e9b86124c93a7fc2db9984e7466', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:32:14.762398 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-458b18c8-aee1-4903-9917-09e029f178cf tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] 10.222.0.11 "GET /compute/v2.1/servers/0698dc5b-5f47-46c4-ace8-f5e891a964a0" status: 200 len: 1565 microversion: 2.1 time: 0.170529 Nov 17 03:32:14.763040 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 659/1352] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:32:14 2021] GET /compute/v2.1/servers/0698dc5b-5f47-46c4-ace8-f5e891a964a0 => generated 1565 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:32:15.345840 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-38d613a1-11e4-432a-86cf-b15cd3b0bb07 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:32:15.346831 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-38d613a1-11e4-432a-86cf-b15cd3b0bb07 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] [instance: 5d54db85-b991-4890-abaa-952413baa2e7] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:32:15.353341 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-38d613a1-11e4-432a-86cf-b15cd3b0bb07 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:32:15.353808 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-38d613a1-11e4-432a-86cf-b15cd3b0bb07 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:32:15.354590 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-38d613a1-11e4-432a-86cf-b15cd3b0bb07 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:32:15.355021 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-38d613a1-11e4-432a-86cf-b15cd3b0bb07 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:32:15.383894 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-38d613a1-11e4-432a-86cf-b15cd3b0bb07 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] 10.222.0.11 "GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042407 Nov 17 03:32:15.384477 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 694/1353] 10.222.0.11 () {60 vars in 1342 bytes} [Wed Nov 17 03:32:15 2021] GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 17 03:32:15.656483 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-72051228-8113-4cbf-bd5a-58fe2e634b26 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:32:15.657402 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-72051228-8113-4cbf-bd5a-58fe2e634b26 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] [instance: 5ddbfaaa-fabf-4324-941c-8868625ffefc] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:32:15.667290 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-72051228-8113-4cbf-bd5a-58fe2e634b26 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:32:15.668016 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-72051228-8113-4cbf-bd5a-58fe2e634b26 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:32:15.669324 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-72051228-8113-4cbf-bd5a-58fe2e634b26 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:32:15.670049 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-72051228-8113-4cbf-bd5a-58fe2e634b26 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:32:15.690904 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-30580fe2-7fb3-448e-87db-571c094af030 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:32:15.691818 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-30580fe2-7fb3-448e-87db-571c094af030 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] [instance: a49437df-3059-4528-8328-2f3471d5fb45] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:32:15.698074 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-30580fe2-7fb3-448e-87db-571c094af030 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:32:15.698525 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-30580fe2-7fb3-448e-87db-571c094af030 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:32:15.699302 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-30580fe2-7fb3-448e-87db-571c094af030 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:32:15.699765 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-30580fe2-7fb3-448e-87db-571c094af030 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:32:15.730703 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-30580fe2-7fb3-448e-87db-571c094af030 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] 10.222.0.11 "GET /compute/v2.1/servers/a49437df-3059-4528-8328-2f3471d5fb45/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043540 Nov 17 03:32:15.731779 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 695/1354] 10.222.0.11 () {58 vars in 1301 bytes} [Wed Nov 17 03:32:15 2021] GET /compute/v2.1/servers/a49437df-3059-4528-8328-2f3471d5fb45/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 17 03:32:15.734597 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-72051228-8113-4cbf-bd5a-58fe2e634b26 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80763e09d44c475ea2425b22874e9612', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fef02a1dd77946a2ac0e0414b557435f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:32:15.745173 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-72051228-8113-4cbf-bd5a-58fe2e634b26 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] 10.222.0.11 "GET /compute/v2.1/servers/5ddbfaaa-fabf-4324-941c-8868625ffefc" status: 200 len: 1226 microversion: 2.1 time: 0.095122 Nov 17 03:32:15.745744 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 660/1355] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:32:15 2021] GET /compute/v2.1/servers/5ddbfaaa-fabf-4324-941c-8868625ffefc => generated 1226 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:32:15.781799 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-37c66174-c978-4eb7-9740-e95a7db749d9 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:32:15.782577 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-37c66174-c978-4eb7-9740-e95a7db749d9 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] [instance: 0698dc5b-5f47-46c4-ace8-f5e891a964a0] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:32:15.791624 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-37c66174-c978-4eb7-9740-e95a7db749d9 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:32:15.792211 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-37c66174-c978-4eb7-9740-e95a7db749d9 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:32:15.793370 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-37c66174-c978-4eb7-9740-e95a7db749d9 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:32:15.793942 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-37c66174-c978-4eb7-9740-e95a7db749d9 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:32:15.936842 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-37c66174-c978-4eb7-9740-e95a7db749d9 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '163b2f24a72649ac8084be1cac32fa09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e123e9b86124c93a7fc2db9984e7466', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:32:15.949177 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-37c66174-c978-4eb7-9740-e95a7db749d9 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] 10.222.0.11 "GET /compute/v2.1/servers/0698dc5b-5f47-46c4-ace8-f5e891a964a0" status: 200 len: 1565 microversion: 2.1 time: 0.172735 Nov 17 03:32:15.950030 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 696/1356] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:32:15 2021] GET /compute/v2.1/servers/0698dc5b-5f47-46c4-ace8-f5e891a964a0 => generated 1565 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:32:16.399295 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-5c491f85-381d-4b58-8222-6066d207784a tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:32:16.400403 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-5c491f85-381d-4b58-8222-6066d207784a tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] [instance: 5d54db85-b991-4890-abaa-952413baa2e7] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:32:16.407199 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-5c491f85-381d-4b58-8222-6066d207784a tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:32:16.407688 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-5c491f85-381d-4b58-8222-6066d207784a tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:32:16.408499 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-5c491f85-381d-4b58-8222-6066d207784a tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:32:16.409000 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-5c491f85-381d-4b58-8222-6066d207784a tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:32:16.440709 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-5c491f85-381d-4b58-8222-6066d207784a tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] 10.222.0.11 "GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047995 Nov 17 03:32:16.441319 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 661/1357] 10.222.0.11 () {60 vars in 1342 bytes} [Wed Nov 17 03:32:16 2021] GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 17 03:32:16.742027 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-c17aa135-033f-4fd1-807e-35db71710345 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:32:16.743107 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-c17aa135-033f-4fd1-807e-35db71710345 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] [instance: a49437df-3059-4528-8328-2f3471d5fb45] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:32:16.751159 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-c17aa135-033f-4fd1-807e-35db71710345 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:32:16.751607 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-c17aa135-033f-4fd1-807e-35db71710345 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:32:16.752381 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-c17aa135-033f-4fd1-807e-35db71710345 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:32:16.752859 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-c17aa135-033f-4fd1-807e-35db71710345 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:32:16.762880 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-a47a7253-aa75-4c91-9854-b543378d032a tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:32:16.763735 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-a47a7253-aa75-4c91-9854-b543378d032a tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] [instance: 5ddbfaaa-fabf-4324-941c-8868625ffefc] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:32:16.769939 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-a47a7253-aa75-4c91-9854-b543378d032a tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:32:16.770356 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-a47a7253-aa75-4c91-9854-b543378d032a tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:32:16.771183 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-a47a7253-aa75-4c91-9854-b543378d032a tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:32:16.771581 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-a47a7253-aa75-4c91-9854-b543378d032a tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:32:16.783716 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-c17aa135-033f-4fd1-807e-35db71710345 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] 10.222.0.11 "GET /compute/v2.1/servers/a49437df-3059-4528-8328-2f3471d5fb45/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045439 Nov 17 03:32:16.784278 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 697/1358] 10.222.0.11 () {58 vars in 1301 bytes} [Wed Nov 17 03:32:16 2021] GET /compute/v2.1/servers/a49437df-3059-4528-8328-2f3471d5fb45/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 17 03:32:16.832460 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-a47a7253-aa75-4c91-9854-b543378d032a tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80763e09d44c475ea2425b22874e9612', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fef02a1dd77946a2ac0e0414b557435f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:32:16.840975 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-a47a7253-aa75-4c91-9854-b543378d032a tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] 10.222.0.11 "GET /compute/v2.1/servers/5ddbfaaa-fabf-4324-941c-8868625ffefc" status: 200 len: 1226 microversion: 2.1 time: 0.082068 Nov 17 03:32:16.841531 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 662/1359] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:32:16 2021] GET /compute/v2.1/servers/5ddbfaaa-fabf-4324-941c-8868625ffefc => generated 1226 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:32:16.971379 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-ddffbc4f-59d1-4810-820a-a5605fe7c6ab tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:32:16.972099 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-ddffbc4f-59d1-4810-820a-a5605fe7c6ab tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] [instance: 0698dc5b-5f47-46c4-ace8-f5e891a964a0] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:32:16.978642 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-ddffbc4f-59d1-4810-820a-a5605fe7c6ab tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:32:16.979091 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-ddffbc4f-59d1-4810-820a-a5605fe7c6ab tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:32:16.979956 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-ddffbc4f-59d1-4810-820a-a5605fe7c6ab tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:32:16.980371 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-ddffbc4f-59d1-4810-820a-a5605fe7c6ab tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:32:17.133066 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-ddffbc4f-59d1-4810-820a-a5605fe7c6ab tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '163b2f24a72649ac8084be1cac32fa09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e123e9b86124c93a7fc2db9984e7466', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:32:17.144845 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-ddffbc4f-59d1-4810-820a-a5605fe7c6ab tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] 10.222.0.11 "GET /compute/v2.1/servers/0698dc5b-5f47-46c4-ace8-f5e891a964a0" status: 200 len: 1565 microversion: 2.1 time: 0.176945 Nov 17 03:32:17.145678 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 698/1360] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:32:16 2021] GET /compute/v2.1/servers/0698dc5b-5f47-46c4-ace8-f5e891a964a0 => generated 1565 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:32:17.456651 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-7fa7fd79-97f5-494c-87af-d6d1e0f10c06 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:32:17.458155 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-7fa7fd79-97f5-494c-87af-d6d1e0f10c06 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] [instance: 5d54db85-b991-4890-abaa-952413baa2e7] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:32:17.468299 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-7fa7fd79-97f5-494c-87af-d6d1e0f10c06 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:32:17.469122 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-7fa7fd79-97f5-494c-87af-d6d1e0f10c06 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:32:17.470370 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-7fa7fd79-97f5-494c-87af-d6d1e0f10c06 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:32:17.471079 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-7fa7fd79-97f5-494c-87af-d6d1e0f10c06 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:32:17.503178 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-7fa7fd79-97f5-494c-87af-d6d1e0f10c06 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] 10.222.0.11 "GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.052912 Nov 17 03:32:17.503726 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 663/1361] 10.222.0.11 () {60 vars in 1342 bytes} [Wed Nov 17 03:32:17 2021] GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 17 03:32:17.799735 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-d3daf35b-61c2-4d00-9a49-65c55b59c8e2 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:32:17.801335 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-d3daf35b-61c2-4d00-9a49-65c55b59c8e2 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] [instance: a49437df-3059-4528-8328-2f3471d5fb45] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:32:17.812447 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-d3daf35b-61c2-4d00-9a49-65c55b59c8e2 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:32:17.813254 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-d3daf35b-61c2-4d00-9a49-65c55b59c8e2 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:32:17.814513 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-d3daf35b-61c2-4d00-9a49-65c55b59c8e2 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:32:17.815235 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-d3daf35b-61c2-4d00-9a49-65c55b59c8e2 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:32:17.847273 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-d3daf35b-61c2-4d00-9a49-65c55b59c8e2 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] 10.222.0.11 "GET /compute/v2.1/servers/a49437df-3059-4528-8328-2f3471d5fb45/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053878 Nov 17 03:32:17.847829 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 699/1362] 10.222.0.11 () {58 vars in 1301 bytes} [Wed Nov 17 03:32:17 2021] GET /compute/v2.1/servers/a49437df-3059-4528-8328-2f3471d5fb45/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 17 03:32:17.857798 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-d347c21d-5bb0-475e-89d6-e5a985e67f2d tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:32:17.858398 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-d347c21d-5bb0-475e-89d6-e5a985e67f2d tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] [instance: 5ddbfaaa-fabf-4324-941c-8868625ffefc] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:32:17.864843 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-d347c21d-5bb0-475e-89d6-e5a985e67f2d tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:32:17.865325 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-d347c21d-5bb0-475e-89d6-e5a985e67f2d tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:32:17.866090 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-d347c21d-5bb0-475e-89d6-e5a985e67f2d tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:32:17.866518 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-d347c21d-5bb0-475e-89d6-e5a985e67f2d tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:32:17.932707 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-d347c21d-5bb0-475e-89d6-e5a985e67f2d tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80763e09d44c475ea2425b22874e9612', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fef02a1dd77946a2ac0e0414b557435f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:32:17.943283 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-d347c21d-5bb0-475e-89d6-e5a985e67f2d tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] 10.222.0.11 "GET /compute/v2.1/servers/5ddbfaaa-fabf-4324-941c-8868625ffefc" status: 200 len: 1226 microversion: 2.1 time: 0.088916 Nov 17 03:32:17.944047 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 664/1363] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:32:17 2021] GET /compute/v2.1/servers/5ddbfaaa-fabf-4324-941c-8868625ffefc => generated 1226 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:32:18.165626 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-b3a1d9a1-5bbe-4c83-826b-a347c7e5049e tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:32:18.167197 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-b3a1d9a1-5bbe-4c83-826b-a347c7e5049e tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] [instance: 0698dc5b-5f47-46c4-ace8-f5e891a964a0] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:32:18.179872 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-b3a1d9a1-5bbe-4c83-826b-a347c7e5049e tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:32:18.180758 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-b3a1d9a1-5bbe-4c83-826b-a347c7e5049e tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:32:18.181601 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-b3a1d9a1-5bbe-4c83-826b-a347c7e5049e tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:32:18.182023 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-b3a1d9a1-5bbe-4c83-826b-a347c7e5049e tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:32:18.324375 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-b3a1d9a1-5bbe-4c83-826b-a347c7e5049e tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '163b2f24a72649ac8084be1cac32fa09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e123e9b86124c93a7fc2db9984e7466', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:32:18.332270 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-b3a1d9a1-5bbe-4c83-826b-a347c7e5049e tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] 10.222.0.11 "GET /compute/v2.1/servers/0698dc5b-5f47-46c4-ace8-f5e891a964a0" status: 200 len: 1565 microversion: 2.1 time: 0.173209 Nov 17 03:32:18.332862 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 700/1364] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:32:18 2021] GET /compute/v2.1/servers/0698dc5b-5f47-46c4-ace8-f5e891a964a0 => generated 1565 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:32:18.519721 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-283ce920-4762-4a29-b13b-39cc27d79c48 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:32:18.521431 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-283ce920-4762-4a29-b13b-39cc27d79c48 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] [instance: 5d54db85-b991-4890-abaa-952413baa2e7] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:32:18.531692 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-283ce920-4762-4a29-b13b-39cc27d79c48 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:32:18.532440 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-283ce920-4762-4a29-b13b-39cc27d79c48 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:32:18.533744 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-283ce920-4762-4a29-b13b-39cc27d79c48 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:32:18.534468 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-283ce920-4762-4a29-b13b-39cc27d79c48 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:32:18.566153 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-283ce920-4762-4a29-b13b-39cc27d79c48 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] 10.222.0.11 "GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.052920 Nov 17 03:32:18.566706 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 665/1365] 10.222.0.11 () {60 vars in 1342 bytes} [Wed Nov 17 03:32:18 2021] GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 17 03:32:18.859395 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-a48142e0-a3d7-4c28-8ecc-67de37e5e69a tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:32:18.860304 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-a48142e0-a3d7-4c28-8ecc-67de37e5e69a tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] [instance: a49437df-3059-4528-8328-2f3471d5fb45] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:32:18.867020 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-a48142e0-a3d7-4c28-8ecc-67de37e5e69a tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:32:18.867463 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-a48142e0-a3d7-4c28-8ecc-67de37e5e69a tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:32:18.868227 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-a48142e0-a3d7-4c28-8ecc-67de37e5e69a tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:32:18.868655 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-a48142e0-a3d7-4c28-8ecc-67de37e5e69a tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:32:18.898202 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-a48142e0-a3d7-4c28-8ecc-67de37e5e69a tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] 10.222.0.11 "GET /compute/v2.1/servers/a49437df-3059-4528-8328-2f3471d5fb45/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042715 Nov 17 03:32:18.898980 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 701/1366] 10.222.0.11 () {58 vars in 1301 bytes} [Wed Nov 17 03:32:18 2021] GET /compute/v2.1/servers/a49437df-3059-4528-8328-2f3471d5fb45/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 17 03:32:18.968416 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-fa146916-a916-4175-81a0-cc04e3033659 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:32:18.969510 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-fa146916-a916-4175-81a0-cc04e3033659 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] [instance: 5ddbfaaa-fabf-4324-941c-8868625ffefc] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:32:18.980230 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-fa146916-a916-4175-81a0-cc04e3033659 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:32:18.981165 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-fa146916-a916-4175-81a0-cc04e3033659 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:32:18.981872 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-fa146916-a916-4175-81a0-cc04e3033659 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:32:18.982311 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-fa146916-a916-4175-81a0-cc04e3033659 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:32:19.052560 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-fa146916-a916-4175-81a0-cc04e3033659 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80763e09d44c475ea2425b22874e9612', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fef02a1dd77946a2ac0e0414b557435f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:32:19.061150 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-fa146916-a916-4175-81a0-cc04e3033659 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] 10.222.0.11 "GET /compute/v2.1/servers/5ddbfaaa-fabf-4324-941c-8868625ffefc" status: 200 len: 1226 microversion: 2.1 time: 0.099613 Nov 17 03:32:19.061700 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 666/1367] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:32:18 2021] GET /compute/v2.1/servers/5ddbfaaa-fabf-4324-941c-8868625ffefc => generated 1226 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:32:19.353077 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-3bd79319-f71a-4c80-a752-9a4fb1c8e7bc tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:32:19.354199 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-3bd79319-f71a-4c80-a752-9a4fb1c8e7bc tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] [instance: 0698dc5b-5f47-46c4-ace8-f5e891a964a0] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:32:19.363768 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-3bd79319-f71a-4c80-a752-9a4fb1c8e7bc tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:32:19.364449 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-3bd79319-f71a-4c80-a752-9a4fb1c8e7bc tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:32:19.366017 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-3bd79319-f71a-4c80-a752-9a4fb1c8e7bc tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:32:19.366402 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-3bd79319-f71a-4c80-a752-9a4fb1c8e7bc tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:32:19.506742 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-3bd79319-f71a-4c80-a752-9a4fb1c8e7bc tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '163b2f24a72649ac8084be1cac32fa09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e123e9b86124c93a7fc2db9984e7466', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:32:19.518034 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-3bd79319-f71a-4c80-a752-9a4fb1c8e7bc tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] 10.222.0.11 "GET /compute/v2.1/servers/0698dc5b-5f47-46c4-ace8-f5e891a964a0" status: 200 len: 1565 microversion: 2.1 time: 0.170524 Nov 17 03:32:19.518827 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 702/1368] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:32:19 2021] GET /compute/v2.1/servers/0698dc5b-5f47-46c4-ace8-f5e891a964a0 => generated 1565 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:32:19.581729 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-e2fcb2b9-3ba7-4eb2-8ff5-ddab3531cd58 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:32:19.583208 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-e2fcb2b9-3ba7-4eb2-8ff5-ddab3531cd58 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] [instance: 5d54db85-b991-4890-abaa-952413baa2e7] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:32:19.592368 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-e2fcb2b9-3ba7-4eb2-8ff5-ddab3531cd58 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:32:19.592885 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-e2fcb2b9-3ba7-4eb2-8ff5-ddab3531cd58 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:32:19.593654 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-e2fcb2b9-3ba7-4eb2-8ff5-ddab3531cd58 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:32:19.594115 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-e2fcb2b9-3ba7-4eb2-8ff5-ddab3531cd58 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:32:19.634921 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-e2fcb2b9-3ba7-4eb2-8ff5-ddab3531cd58 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] 10.222.0.11 "GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.059144 Nov 17 03:32:19.635503 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 667/1369] 10.222.0.11 () {60 vars in 1342 bytes} [Wed Nov 17 03:32:19 2021] GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7/os-volume_attachments => generated 197 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 17 03:32:19.914260 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-0d897f89-7b66-44ee-98c6-8f5364b13995 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:32:19.915612 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-0d897f89-7b66-44ee-98c6-8f5364b13995 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] [instance: a49437df-3059-4528-8328-2f3471d5fb45] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:32:19.924178 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-0d897f89-7b66-44ee-98c6-8f5364b13995 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:32:19.924626 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-0d897f89-7b66-44ee-98c6-8f5364b13995 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:32:19.925443 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-0d897f89-7b66-44ee-98c6-8f5364b13995 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:32:19.925877 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-0d897f89-7b66-44ee-98c6-8f5364b13995 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:32:19.955780 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-0d897f89-7b66-44ee-98c6-8f5364b13995 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] 10.222.0.11 "GET /compute/v2.1/servers/a49437df-3059-4528-8328-2f3471d5fb45/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048057 Nov 17 03:32:19.956331 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 703/1370] 10.222.0.11 () {58 vars in 1301 bytes} [Wed Nov 17 03:32:19 2021] GET /compute/v2.1/servers/a49437df-3059-4528-8328-2f3471d5fb45/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 17 03:32:20.081516 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-1b966168-9bc2-42bc-b050-75a3892547d8 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:32:20.082131 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-1b966168-9bc2-42bc-b050-75a3892547d8 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] [instance: 5ddbfaaa-fabf-4324-941c-8868625ffefc] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:32:20.088805 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-1b966168-9bc2-42bc-b050-75a3892547d8 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:32:20.089282 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-1b966168-9bc2-42bc-b050-75a3892547d8 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:32:20.090050 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-1b966168-9bc2-42bc-b050-75a3892547d8 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:32:20.090475 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-1b966168-9bc2-42bc-b050-75a3892547d8 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:32:20.151409 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-1b966168-9bc2-42bc-b050-75a3892547d8 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80763e09d44c475ea2425b22874e9612', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fef02a1dd77946a2ac0e0414b557435f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:32:20.159374 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-1b966168-9bc2-42bc-b050-75a3892547d8 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] 10.222.0.11 "GET /compute/v2.1/servers/5ddbfaaa-fabf-4324-941c-8868625ffefc" status: 200 len: 1226 microversion: 2.1 time: 0.081576 Nov 17 03:32:20.159939 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 668/1371] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:32:20 2021] GET /compute/v2.1/servers/5ddbfaaa-fabf-4324-941c-8868625ffefc => generated 1226 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:32:20.539209 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-9c29be26-6bd3-4d80-b476-735b8d246e57 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:32:20.540167 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-9c29be26-6bd3-4d80-b476-735b8d246e57 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] [instance: 0698dc5b-5f47-46c4-ace8-f5e891a964a0] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:32:20.548336 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-9c29be26-6bd3-4d80-b476-735b8d246e57 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:32:20.548764 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-9c29be26-6bd3-4d80-b476-735b8d246e57 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:32:20.549564 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-9c29be26-6bd3-4d80-b476-735b8d246e57 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:32:20.549989 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-9c29be26-6bd3-4d80-b476-735b8d246e57 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:32:20.647933 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-7e999768-1b63-4b24-9c1b-8d676cb0fa49 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:32:20.648867 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-7e999768-1b63-4b24-9c1b-8d676cb0fa49 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] [instance: 5d54db85-b991-4890-abaa-952413baa2e7] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:32:20.656103 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-7e999768-1b63-4b24-9c1b-8d676cb0fa49 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:32:20.656591 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-7e999768-1b63-4b24-9c1b-8d676cb0fa49 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:32:20.657511 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-7e999768-1b63-4b24-9c1b-8d676cb0fa49 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:32:20.657944 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-7e999768-1b63-4b24-9c1b-8d676cb0fa49 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:32:20.688863 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-7e999768-1b63-4b24-9c1b-8d676cb0fa49 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] 10.222.0.11 "GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044704 Nov 17 03:32:20.689649 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 669/1372] 10.222.0.11 () {60 vars in 1342 bytes} [Wed Nov 17 03:32:20 2021] GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 17 03:32:20.701023 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-9c29be26-6bd3-4d80-b476-735b8d246e57 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '163b2f24a72649ac8084be1cac32fa09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e123e9b86124c93a7fc2db9984e7466', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:32:20.709213 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-9c29be26-6bd3-4d80-b476-735b8d246e57 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] 10.222.0.11 "GET /compute/v2.1/servers/0698dc5b-5f47-46c4-ace8-f5e891a964a0" status: 200 len: 1565 microversion: 2.1 time: 0.176300 Nov 17 03:32:20.709766 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 704/1373] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:32:20 2021] GET /compute/v2.1/servers/0698dc5b-5f47-46c4-ace8-f5e891a964a0 => generated 1565 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:32:20.971948 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-489940bb-f8f2-453f-918c-499be5bf9588 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:32:20.973310 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-489940bb-f8f2-453f-918c-499be5bf9588 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] [instance: a49437df-3059-4528-8328-2f3471d5fb45] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:32:20.984149 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-489940bb-f8f2-453f-918c-499be5bf9588 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:32:20.984938 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-489940bb-f8f2-453f-918c-499be5bf9588 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:32:20.986311 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-489940bb-f8f2-453f-918c-499be5bf9588 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:32:20.987095 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-489940bb-f8f2-453f-918c-499be5bf9588 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:32:21.021373 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-489940bb-f8f2-453f-918c-499be5bf9588 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] 10.222.0.11 "GET /compute/v2.1/servers/a49437df-3059-4528-8328-2f3471d5fb45/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.056353 Nov 17 03:32:21.021927 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 670/1374] 10.222.0.11 () {58 vars in 1301 bytes} [Wed Nov 17 03:32:20 2021] GET /compute/v2.1/servers/a49437df-3059-4528-8328-2f3471d5fb45/os-volume_attachments => generated 197 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 17 03:32:21.179680 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-1a44e729-f1ea-4b90-adb2-97cd08ace3c5 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:32:21.181105 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-1a44e729-f1ea-4b90-adb2-97cd08ace3c5 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] [instance: 5ddbfaaa-fabf-4324-941c-8868625ffefc] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:32:21.191907 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-1a44e729-f1ea-4b90-adb2-97cd08ace3c5 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:32:21.192715 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-1a44e729-f1ea-4b90-adb2-97cd08ace3c5 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:32:21.194105 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-1a44e729-f1ea-4b90-adb2-97cd08ace3c5 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:32:21.194820 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-1a44e729-f1ea-4b90-adb2-97cd08ace3c5 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:32:21.258269 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-1a44e729-f1ea-4b90-adb2-97cd08ace3c5 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80763e09d44c475ea2425b22874e9612', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fef02a1dd77946a2ac0e0414b557435f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:32:21.266673 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-1a44e729-f1ea-4b90-adb2-97cd08ace3c5 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] 10.222.0.11 "GET /compute/v2.1/servers/5ddbfaaa-fabf-4324-941c-8868625ffefc" status: 200 len: 1226 microversion: 2.1 time: 0.093106 Nov 17 03:32:21.267246 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 705/1375] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:32:21 2021] GET /compute/v2.1/servers/5ddbfaaa-fabf-4324-941c-8868625ffefc => generated 1226 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:32:21.701004 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-de44a57b-d181-4d1e-817a-ea775f663e0f tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:32:21.701918 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-de44a57b-d181-4d1e-817a-ea775f663e0f tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] [instance: 5d54db85-b991-4890-abaa-952413baa2e7] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:32:21.708841 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-de44a57b-d181-4d1e-817a-ea775f663e0f tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:32:21.709355 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-de44a57b-d181-4d1e-817a-ea775f663e0f tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:32:21.710076 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-de44a57b-d181-4d1e-817a-ea775f663e0f tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:32:21.710502 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-de44a57b-d181-4d1e-817a-ea775f663e0f tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:32:21.729086 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-8a3a755d-407b-4034-af55-cde3d4ece552 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:32:21.729811 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-8a3a755d-407b-4034-af55-cde3d4ece552 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] [instance: 0698dc5b-5f47-46c4-ace8-f5e891a964a0] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:32:21.736138 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-8a3a755d-407b-4034-af55-cde3d4ece552 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:32:21.736575 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-8a3a755d-407b-4034-af55-cde3d4ece552 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:32:21.737362 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-8a3a755d-407b-4034-af55-cde3d4ece552 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:32:21.737785 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-8a3a755d-407b-4034-af55-cde3d4ece552 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:32:21.739758 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-de44a57b-d181-4d1e-817a-ea775f663e0f tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] 10.222.0.11 "GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042660 Nov 17 03:32:21.740312 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 671/1376] 10.222.0.11 () {60 vars in 1342 bytes} [Wed Nov 17 03:32:21 2021] GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 17 03:32:21.872635 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-8a3a755d-407b-4034-af55-cde3d4ece552 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '163b2f24a72649ac8084be1cac32fa09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e123e9b86124c93a7fc2db9984e7466', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:32:21.885214 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-8a3a755d-407b-4034-af55-cde3d4ece552 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] 10.222.0.11 "GET /compute/v2.1/servers/0698dc5b-5f47-46c4-ace8-f5e891a964a0" status: 200 len: 1565 microversion: 2.1 time: 0.159390 Nov 17 03:32:21.885917 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 706/1377] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:32:21 2021] GET /compute/v2.1/servers/0698dc5b-5f47-46c4-ace8-f5e891a964a0 => generated 1565 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:32:22.036860 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-daaa665b-a56c-4675-a46e-6b0b4cccd7b0 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:32:22.038329 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-daaa665b-a56c-4675-a46e-6b0b4cccd7b0 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] [instance: a49437df-3059-4528-8328-2f3471d5fb45] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:32:22.047071 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-daaa665b-a56c-4675-a46e-6b0b4cccd7b0 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:32:22.047523 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-daaa665b-a56c-4675-a46e-6b0b4cccd7b0 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:32:22.048293 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-daaa665b-a56c-4675-a46e-6b0b4cccd7b0 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:32:22.048727 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-daaa665b-a56c-4675-a46e-6b0b4cccd7b0 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:32:22.078775 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-daaa665b-a56c-4675-a46e-6b0b4cccd7b0 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] 10.222.0.11 "GET /compute/v2.1/servers/a49437df-3059-4528-8328-2f3471d5fb45/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048254 Nov 17 03:32:22.079338 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 672/1378] 10.222.0.11 () {58 vars in 1301 bytes} [Wed Nov 17 03:32:22 2021] GET /compute/v2.1/servers/a49437df-3059-4528-8328-2f3471d5fb45/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 17 03:32:22.286758 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-ffa72cc4-8b59-4b04-9250-e3f273cb5bd6 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:32:22.287710 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-ffa72cc4-8b59-4b04-9250-e3f273cb5bd6 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] [instance: 5ddbfaaa-fabf-4324-941c-8868625ffefc] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:32:22.298733 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-ffa72cc4-8b59-4b04-9250-e3f273cb5bd6 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:32:22.299537 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-ffa72cc4-8b59-4b04-9250-e3f273cb5bd6 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:32:22.300861 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-ffa72cc4-8b59-4b04-9250-e3f273cb5bd6 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:32:22.301567 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-ffa72cc4-8b59-4b04-9250-e3f273cb5bd6 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:32:22.369120 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-ffa72cc4-8b59-4b04-9250-e3f273cb5bd6 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80763e09d44c475ea2425b22874e9612', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fef02a1dd77946a2ac0e0414b557435f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:32:22.376962 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-ffa72cc4-8b59-4b04-9250-e3f273cb5bd6 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] 10.222.0.11 "GET /compute/v2.1/servers/5ddbfaaa-fabf-4324-941c-8868625ffefc" status: 200 len: 1226 microversion: 2.1 time: 0.096596 Nov 17 03:32:22.377522 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 707/1379] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:32:22 2021] GET /compute/v2.1/servers/5ddbfaaa-fabf-4324-941c-8868625ffefc => generated 1226 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:32:22.757280 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-687c6cee-518b-4473-97d2-4a985a2c03fd tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:32:22.758779 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-687c6cee-518b-4473-97d2-4a985a2c03fd tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] [instance: 5d54db85-b991-4890-abaa-952413baa2e7] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:32:22.767342 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-687c6cee-518b-4473-97d2-4a985a2c03fd tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:32:22.767789 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-687c6cee-518b-4473-97d2-4a985a2c03fd tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:32:22.768557 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-687c6cee-518b-4473-97d2-4a985a2c03fd tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:32:22.769031 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-687c6cee-518b-4473-97d2-4a985a2c03fd tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:32:22.804067 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-687c6cee-518b-4473-97d2-4a985a2c03fd tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] 10.222.0.11 "GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.053923 Nov 17 03:32:22.804787 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 673/1380] 10.222.0.11 () {60 vars in 1342 bytes} [Wed Nov 17 03:32:22 2021] GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 17 03:32:22.907508 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-a96115fd-403f-4bfb-b1e0-3451f35dfdec tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:32:22.908510 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-a96115fd-403f-4bfb-b1e0-3451f35dfdec tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] [instance: 0698dc5b-5f47-46c4-ace8-f5e891a964a0] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:32:22.918752 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-a96115fd-403f-4bfb-b1e0-3451f35dfdec tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:32:22.919753 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-a96115fd-403f-4bfb-b1e0-3451f35dfdec tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:32:22.920536 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-a96115fd-403f-4bfb-b1e0-3451f35dfdec tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:32:22.921082 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-a96115fd-403f-4bfb-b1e0-3451f35dfdec tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:32:23.060901 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-a96115fd-403f-4bfb-b1e0-3451f35dfdec tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '163b2f24a72649ac8084be1cac32fa09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e123e9b86124c93a7fc2db9984e7466', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:32:23.068487 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-a96115fd-403f-4bfb-b1e0-3451f35dfdec tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] 10.222.0.11 "GET /compute/v2.1/servers/0698dc5b-5f47-46c4-ace8-f5e891a964a0" status: 200 len: 1565 microversion: 2.1 time: 0.167628 Nov 17 03:32:23.069110 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 708/1381] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:32:22 2021] GET /compute/v2.1/servers/0698dc5b-5f47-46c4-ace8-f5e891a964a0 => generated 1565 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:32:23.089791 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-56c7c81c-ed47-4c8e-9d26-50ede9fdba98 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:32:23.090731 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-56c7c81c-ed47-4c8e-9d26-50ede9fdba98 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] [instance: a49437df-3059-4528-8328-2f3471d5fb45] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:32:23.097358 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-56c7c81c-ed47-4c8e-9d26-50ede9fdba98 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:32:23.097803 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-56c7c81c-ed47-4c8e-9d26-50ede9fdba98 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:32:23.098567 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-56c7c81c-ed47-4c8e-9d26-50ede9fdba98 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:32:23.098994 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-56c7c81c-ed47-4c8e-9d26-50ede9fdba98 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:32:23.127268 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-56c7c81c-ed47-4c8e-9d26-50ede9fdba98 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] 10.222.0.11 "GET /compute/v2.1/servers/a49437df-3059-4528-8328-2f3471d5fb45/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041250 Nov 17 03:32:23.127813 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 674/1382] 10.222.0.11 () {58 vars in 1301 bytes} [Wed Nov 17 03:32:23 2021] GET /compute/v2.1/servers/a49437df-3059-4528-8328-2f3471d5fb45/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 17 03:32:23.398193 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-855169bd-dedd-4b2b-813c-d0519f3704bf tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:32:23.399070 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-855169bd-dedd-4b2b-813c-d0519f3704bf tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] [instance: 5ddbfaaa-fabf-4324-941c-8868625ffefc] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:32:23.409908 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-855169bd-dedd-4b2b-813c-d0519f3704bf tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:32:23.410649 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-855169bd-dedd-4b2b-813c-d0519f3704bf tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:32:23.411972 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-855169bd-dedd-4b2b-813c-d0519f3704bf tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:32:23.412681 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-855169bd-dedd-4b2b-813c-d0519f3704bf tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:32:23.475718 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-855169bd-dedd-4b2b-813c-d0519f3704bf tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80763e09d44c475ea2425b22874e9612', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fef02a1dd77946a2ac0e0414b557435f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:32:23.483387 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-855169bd-dedd-4b2b-813c-d0519f3704bf tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] 10.222.0.11 "GET /compute/v2.1/servers/5ddbfaaa-fabf-4324-941c-8868625ffefc" status: 200 len: 1226 microversion: 2.1 time: 0.091574 Nov 17 03:32:23.483948 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 709/1383] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:32:23 2021] GET /compute/v2.1/servers/5ddbfaaa-fabf-4324-941c-8868625ffefc => generated 1226 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:32:23.822005 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-fec04d63-ad6a-4fa8-84b4-9b96029a55ba tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:32:23.823506 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-fec04d63-ad6a-4fa8-84b4-9b96029a55ba tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] [instance: 5d54db85-b991-4890-abaa-952413baa2e7] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:32:23.833882 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-fec04d63-ad6a-4fa8-84b4-9b96029a55ba tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:32:23.834813 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-fec04d63-ad6a-4fa8-84b4-9b96029a55ba tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:32:23.836310 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-fec04d63-ad6a-4fa8-84b4-9b96029a55ba tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:32:23.837348 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-fec04d63-ad6a-4fa8-84b4-9b96029a55ba tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:32:23.868337 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-fec04d63-ad6a-4fa8-84b4-9b96029a55ba tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] 10.222.0.11 "GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.052710 Nov 17 03:32:23.868924 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 675/1384] 10.222.0.11 () {60 vars in 1342 bytes} [Wed Nov 17 03:32:23 2021] GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 17 03:32:24.086296 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-dd28a186-09ac-4267-9e53-131b00671b94 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:32:24.086931 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-dd28a186-09ac-4267-9e53-131b00671b94 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] [instance: 0698dc5b-5f47-46c4-ace8-f5e891a964a0] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:32:24.093634 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-dd28a186-09ac-4267-9e53-131b00671b94 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:32:24.094077 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-dd28a186-09ac-4267-9e53-131b00671b94 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:32:24.094844 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-dd28a186-09ac-4267-9e53-131b00671b94 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:32:24.095269 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-dd28a186-09ac-4267-9e53-131b00671b94 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:32:24.138858 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-acc9da77-1383-4841-ba8b-8da312a0ef97 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:32:24.139767 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-acc9da77-1383-4841-ba8b-8da312a0ef97 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] [instance: a49437df-3059-4528-8328-2f3471d5fb45] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:32:24.146044 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-acc9da77-1383-4841-ba8b-8da312a0ef97 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:32:24.146486 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-acc9da77-1383-4841-ba8b-8da312a0ef97 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:32:24.147262 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-acc9da77-1383-4841-ba8b-8da312a0ef97 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:32:24.147688 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-acc9da77-1383-4841-ba8b-8da312a0ef97 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:32:24.177226 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-acc9da77-1383-4841-ba8b-8da312a0ef97 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] 10.222.0.11 "GET /compute/v2.1/servers/a49437df-3059-4528-8328-2f3471d5fb45/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042160 Nov 17 03:32:24.177774 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 676/1385] 10.222.0.11 () {58 vars in 1301 bytes} [Wed Nov 17 03:32:24 2021] GET /compute/v2.1/servers/a49437df-3059-4528-8328-2f3471d5fb45/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 17 03:32:24.241569 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-dd28a186-09ac-4267-9e53-131b00671b94 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '163b2f24a72649ac8084be1cac32fa09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e123e9b86124c93a7fc2db9984e7466', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:32:24.252854 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-dd28a186-09ac-4267-9e53-131b00671b94 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] 10.222.0.11 "GET /compute/v2.1/servers/0698dc5b-5f47-46c4-ace8-f5e891a964a0" status: 200 len: 1565 microversion: 2.1 time: 0.169920 Nov 17 03:32:24.253691 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 710/1386] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:32:24 2021] GET /compute/v2.1/servers/0698dc5b-5f47-46c4-ace8-f5e891a964a0 => generated 1565 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:32:24.503962 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-cecba5f3-240a-4eaf-90f1-1aa9b4dc84a7 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:32:24.505024 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-cecba5f3-240a-4eaf-90f1-1aa9b4dc84a7 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] [instance: 5ddbfaaa-fabf-4324-941c-8868625ffefc] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:32:24.515550 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-cecba5f3-240a-4eaf-90f1-1aa9b4dc84a7 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:32:24.516300 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-cecba5f3-240a-4eaf-90f1-1aa9b4dc84a7 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:32:24.518584 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-cecba5f3-240a-4eaf-90f1-1aa9b4dc84a7 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:32:24.519318 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-cecba5f3-240a-4eaf-90f1-1aa9b4dc84a7 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:32:24.585172 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-cecba5f3-240a-4eaf-90f1-1aa9b4dc84a7 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80763e09d44c475ea2425b22874e9612', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fef02a1dd77946a2ac0e0414b557435f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:32:24.593233 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-cecba5f3-240a-4eaf-90f1-1aa9b4dc84a7 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] 10.222.0.11 "GET /compute/v2.1/servers/5ddbfaaa-fabf-4324-941c-8868625ffefc" status: 200 len: 1226 microversion: 2.1 time: 0.096412 Nov 17 03:32:24.593814 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 677/1387] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:32:24 2021] GET /compute/v2.1/servers/5ddbfaaa-fabf-4324-941c-8868625ffefc => generated 1226 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:32:24.882511 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-ca5af75e-12c8-49cf-9f03-5de2ee473778 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:32:24.883618 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-ca5af75e-12c8-49cf-9f03-5de2ee473778 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] [instance: 5d54db85-b991-4890-abaa-952413baa2e7] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:32:24.891893 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-ca5af75e-12c8-49cf-9f03-5de2ee473778 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:32:24.892338 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-ca5af75e-12c8-49cf-9f03-5de2ee473778 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:32:24.893128 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-ca5af75e-12c8-49cf-9f03-5de2ee473778 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:32:24.893564 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-ca5af75e-12c8-49cf-9f03-5de2ee473778 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:32:24.922834 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-ca5af75e-12c8-49cf-9f03-5de2ee473778 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] 10.222.0.11 "GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045527 Nov 17 03:32:24.923381 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 711/1388] 10.222.0.11 () {60 vars in 1342 bytes} [Wed Nov 17 03:32:24 2021] GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 17 03:32:25.193779 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-f38baa52-757a-4df7-84c9-39f49d41364f tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:32:25.195151 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-f38baa52-757a-4df7-84c9-39f49d41364f tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] [instance: a49437df-3059-4528-8328-2f3471d5fb45] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:32:25.204662 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-f38baa52-757a-4df7-84c9-39f49d41364f tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:32:25.205147 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-f38baa52-757a-4df7-84c9-39f49d41364f tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:32:25.205895 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-f38baa52-757a-4df7-84c9-39f49d41364f tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:32:25.206347 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-f38baa52-757a-4df7-84c9-39f49d41364f tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:32:25.237307 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-f38baa52-757a-4df7-84c9-39f49d41364f tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] 10.222.0.11 "GET /compute/v2.1/servers/a49437df-3059-4528-8328-2f3471d5fb45/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049958 Nov 17 03:32:25.237880 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 678/1389] 10.222.0.11 () {58 vars in 1301 bytes} [Wed Nov 17 03:32:25 2021] GET /compute/v2.1/servers/a49437df-3059-4528-8328-2f3471d5fb45/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 17 03:32:25.277480 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-ce6986c3-1243-42a4-9fc1-a2a9d1b333f8 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:32:25.278434 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-ce6986c3-1243-42a4-9fc1-a2a9d1b333f8 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] [instance: 0698dc5b-5f47-46c4-ace8-f5e891a964a0] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:32:25.285259 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-ce6986c3-1243-42a4-9fc1-a2a9d1b333f8 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:32:25.285704 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-ce6986c3-1243-42a4-9fc1-a2a9d1b333f8 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:32:25.286471 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-ce6986c3-1243-42a4-9fc1-a2a9d1b333f8 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:32:25.286894 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-ce6986c3-1243-42a4-9fc1-a2a9d1b333f8 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:32:25.421179 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-ce6986c3-1243-42a4-9fc1-a2a9d1b333f8 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '163b2f24a72649ac8084be1cac32fa09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e123e9b86124c93a7fc2db9984e7466', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:32:25.428541 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-ce6986c3-1243-42a4-9fc1-a2a9d1b333f8 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] 10.222.0.11 "GET /compute/v2.1/servers/0698dc5b-5f47-46c4-ace8-f5e891a964a0" status: 200 len: 1565 microversion: 2.1 time: 0.157096 Nov 17 03:32:25.429138 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 712/1390] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:32:25 2021] GET /compute/v2.1/servers/0698dc5b-5f47-46c4-ace8-f5e891a964a0 => generated 1565 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:32:25.611551 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-8e0eb388-d229-4c29-b0e7-c3a27330e5af tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:32:25.612160 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-8e0eb388-d229-4c29-b0e7-c3a27330e5af tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] [instance: 5ddbfaaa-fabf-4324-941c-8868625ffefc] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:32:25.618967 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-8e0eb388-d229-4c29-b0e7-c3a27330e5af tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:32:25.619418 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-8e0eb388-d229-4c29-b0e7-c3a27330e5af tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:32:25.620193 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-8e0eb388-d229-4c29-b0e7-c3a27330e5af tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:32:25.620635 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-8e0eb388-d229-4c29-b0e7-c3a27330e5af tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:32:25.681173 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-8e0eb388-d229-4c29-b0e7-c3a27330e5af tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80763e09d44c475ea2425b22874e9612', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fef02a1dd77946a2ac0e0414b557435f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:32:25.689168 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-8e0eb388-d229-4c29-b0e7-c3a27330e5af tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] 10.222.0.11 "GET /compute/v2.1/servers/5ddbfaaa-fabf-4324-941c-8868625ffefc" status: 200 len: 1226 microversion: 2.1 time: 0.081704 Nov 17 03:32:25.689744 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 679/1391] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:32:25 2021] GET /compute/v2.1/servers/5ddbfaaa-fabf-4324-941c-8868625ffefc => generated 1226 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:32:25.935463 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-db5a9b5f-630a-4bfc-93db-a13d42eece5a tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:32:25.936251 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-db5a9b5f-630a-4bfc-93db-a13d42eece5a tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] [instance: 5d54db85-b991-4890-abaa-952413baa2e7] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:32:25.943457 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-db5a9b5f-630a-4bfc-93db-a13d42eece5a tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:32:25.943914 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-db5a9b5f-630a-4bfc-93db-a13d42eece5a tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:32:25.944695 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-db5a9b5f-630a-4bfc-93db-a13d42eece5a tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:32:25.945170 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-db5a9b5f-630a-4bfc-93db-a13d42eece5a tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:32:25.975233 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-db5a9b5f-630a-4bfc-93db-a13d42eece5a tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] 10.222.0.11 "GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043768 Nov 17 03:32:25.975784 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 713/1392] 10.222.0.11 () {60 vars in 1342 bytes} [Wed Nov 17 03:32:25 2021] GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 17 03:32:26.251830 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-6aa371f5-f017-44be-af6e-9e3dc832cbe4 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:32:26.252660 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-6aa371f5-f017-44be-af6e-9e3dc832cbe4 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] [instance: a49437df-3059-4528-8328-2f3471d5fb45] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:32:26.259805 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-6aa371f5-f017-44be-af6e-9e3dc832cbe4 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:32:26.260595 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-6aa371f5-f017-44be-af6e-9e3dc832cbe4 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:32:26.261999 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-6aa371f5-f017-44be-af6e-9e3dc832cbe4 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:32:26.262539 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-6aa371f5-f017-44be-af6e-9e3dc832cbe4 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:32:26.297395 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-6aa371f5-f017-44be-af6e-9e3dc832cbe4 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] 10.222.0.11 "GET /compute/v2.1/servers/a49437df-3059-4528-8328-2f3471d5fb45/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051008 Nov 17 03:32:26.297949 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 680/1393] 10.222.0.11 () {58 vars in 1301 bytes} [Wed Nov 17 03:32:26 2021] GET /compute/v2.1/servers/a49437df-3059-4528-8328-2f3471d5fb45/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 17 03:32:26.503583 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-86fed1d2-4c4a-4749-b5b8-cdf96070af55 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:32:26.504192 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-86fed1d2-4c4a-4749-b5b8-cdf96070af55 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] [instance: 0698dc5b-5f47-46c4-ace8-f5e891a964a0] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:32:26.510677 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-86fed1d2-4c4a-4749-b5b8-cdf96070af55 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:32:26.511119 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-86fed1d2-4c4a-4749-b5b8-cdf96070af55 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:32:26.511883 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-86fed1d2-4c4a-4749-b5b8-cdf96070af55 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:32:26.512312 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-86fed1d2-4c4a-4749-b5b8-cdf96070af55 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:32:26.576323 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 17 03:32:26.576823 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: Wed Nov 17 03:32:26 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Nov 17 03:32:26.664558 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-86fed1d2-4c4a-4749-b5b8-cdf96070af55 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '163b2f24a72649ac8084be1cac32fa09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e123e9b86124c93a7fc2db9984e7466', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:32:26.673459 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-86fed1d2-4c4a-4749-b5b8-cdf96070af55 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] 10.222.0.11 "GET /compute/v2.1/servers/0698dc5b-5f47-46c4-ace8-f5e891a964a0" status: 200 len: 1565 microversion: 2.1 time: 0.230701 Nov 17 03:32:26.674016 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 714/1394] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:32:26 2021] GET /compute/v2.1/servers/0698dc5b-5f47-46c4-ace8-f5e891a964a0 => generated 1565 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:32:26.708598 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-d3409794-a56b-4af9-82bd-5aefb483efc5 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:32:26.709250 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-d3409794-a56b-4af9-82bd-5aefb483efc5 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] [instance: 5ddbfaaa-fabf-4324-941c-8868625ffefc] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:32:26.716804 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-d3409794-a56b-4af9-82bd-5aefb483efc5 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:32:26.717291 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-d3409794-a56b-4af9-82bd-5aefb483efc5 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:32:26.718056 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-d3409794-a56b-4af9-82bd-5aefb483efc5 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:32:26.718512 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-d3409794-a56b-4af9-82bd-5aefb483efc5 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:32:26.789906 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-d3409794-a56b-4af9-82bd-5aefb483efc5 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80763e09d44c475ea2425b22874e9612', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fef02a1dd77946a2ac0e0414b557435f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:32:26.800544 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-d3409794-a56b-4af9-82bd-5aefb483efc5 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] 10.222.0.11 "GET /compute/v2.1/servers/5ddbfaaa-fabf-4324-941c-8868625ffefc" status: 200 len: 1226 microversion: 2.1 time: 0.097189 Nov 17 03:32:26.801156 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 681/1395] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:32:26 2021] GET /compute/v2.1/servers/5ddbfaaa-fabf-4324-941c-8868625ffefc => generated 1226 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:32:26.990370 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-87d36507-8fca-44ae-ab7d-6930db71cb3a tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:32:26.991343 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-87d36507-8fca-44ae-ab7d-6930db71cb3a tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] [instance: 5d54db85-b991-4890-abaa-952413baa2e7] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:32:26.998715 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-87d36507-8fca-44ae-ab7d-6930db71cb3a tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:32:26.999199 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-87d36507-8fca-44ae-ab7d-6930db71cb3a tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:32:26.999982 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-87d36507-8fca-44ae-ab7d-6930db71cb3a tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:32:27.000408 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-87d36507-8fca-44ae-ab7d-6930db71cb3a tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:32:27.030770 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-87d36507-8fca-44ae-ab7d-6930db71cb3a tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] 10.222.0.11 "GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045390 Nov 17 03:32:27.031354 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 715/1396] 10.222.0.11 () {60 vars in 1342 bytes} [Wed Nov 17 03:32:26 2021] GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 17 03:32:27.314663 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-87db04b2-33ad-4074-956c-0af86d4d6f01 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:32:27.316078 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-87db04b2-33ad-4074-956c-0af86d4d6f01 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] [instance: a49437df-3059-4528-8328-2f3471d5fb45] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:32:27.326442 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-87db04b2-33ad-4074-956c-0af86d4d6f01 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:32:27.327227 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-87db04b2-33ad-4074-956c-0af86d4d6f01 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:32:27.328194 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-87db04b2-33ad-4074-956c-0af86d4d6f01 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:32:27.328632 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-87db04b2-33ad-4074-956c-0af86d4d6f01 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:32:27.364090 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-87db04b2-33ad-4074-956c-0af86d4d6f01 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] 10.222.0.11 "GET /compute/v2.1/servers/a49437df-3059-4528-8328-2f3471d5fb45/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.055428 Nov 17 03:32:27.364888 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 682/1397] 10.222.0.11 () {58 vars in 1301 bytes} [Wed Nov 17 03:32:27 2021] GET /compute/v2.1/servers/a49437df-3059-4528-8328-2f3471d5fb45/os-volume_attachments => generated 197 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 17 03:32:27.694127 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-eee119dc-1e8f-4337-a268-21c4f3789d6a tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:32:27.694972 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-eee119dc-1e8f-4337-a268-21c4f3789d6a tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] [instance: 0698dc5b-5f47-46c4-ace8-f5e891a964a0] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:32:27.701587 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-eee119dc-1e8f-4337-a268-21c4f3789d6a tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:32:27.702039 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-eee119dc-1e8f-4337-a268-21c4f3789d6a tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:32:27.702815 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-eee119dc-1e8f-4337-a268-21c4f3789d6a tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:32:27.703250 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-eee119dc-1e8f-4337-a268-21c4f3789d6a tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:32:27.821684 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-bc283c58-df96-4988-995e-2a77a08f3e4b tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:32:27.822322 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-bc283c58-df96-4988-995e-2a77a08f3e4b tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] [instance: 5ddbfaaa-fabf-4324-941c-8868625ffefc] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:32:27.828504 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-bc283c58-df96-4988-995e-2a77a08f3e4b tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:32:27.828980 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-bc283c58-df96-4988-995e-2a77a08f3e4b tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:32:27.829750 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-bc283c58-df96-4988-995e-2a77a08f3e4b tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:32:27.830175 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-bc283c58-df96-4988-995e-2a77a08f3e4b tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:32:27.853313 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-eee119dc-1e8f-4337-a268-21c4f3789d6a tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '163b2f24a72649ac8084be1cac32fa09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e123e9b86124c93a7fc2db9984e7466', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:32:27.861587 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-eee119dc-1e8f-4337-a268-21c4f3789d6a tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] 10.222.0.11 "GET /compute/v2.1/servers/0698dc5b-5f47-46c4-ace8-f5e891a964a0" status: 200 len: 1565 microversion: 2.1 time: 0.173097 Nov 17 03:32:27.862156 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 716/1398] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:32:27 2021] GET /compute/v2.1/servers/0698dc5b-5f47-46c4-ace8-f5e891a964a0 => generated 1565 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:32:27.892239 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-bc283c58-df96-4988-995e-2a77a08f3e4b tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80763e09d44c475ea2425b22874e9612', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fef02a1dd77946a2ac0e0414b557435f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:32:27.899619 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-bc283c58-df96-4988-995e-2a77a08f3e4b tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] 10.222.0.11 "GET /compute/v2.1/servers/5ddbfaaa-fabf-4324-941c-8868625ffefc" status: 200 len: 1226 microversion: 2.1 time: 0.081672 Nov 17 03:32:27.900177 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 683/1399] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:32:27 2021] GET /compute/v2.1/servers/5ddbfaaa-fabf-4324-941c-8868625ffefc => generated 1226 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:32:28.048331 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-305805ae-0771-410a-994c-f35b0eac62bb tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:32:28.049385 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-305805ae-0771-410a-994c-f35b0eac62bb tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] [instance: 5d54db85-b991-4890-abaa-952413baa2e7] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:32:28.057363 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-305805ae-0771-410a-994c-f35b0eac62bb tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:32:28.057894 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-305805ae-0771-410a-994c-f35b0eac62bb tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:32:28.058765 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-305805ae-0771-410a-994c-f35b0eac62bb tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:32:28.059245 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-305805ae-0771-410a-994c-f35b0eac62bb tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:32:28.094374 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-305805ae-0771-410a-994c-f35b0eac62bb tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] 10.222.0.11 "GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.051244 Nov 17 03:32:28.094934 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 717/1400] 10.222.0.11 () {60 vars in 1342 bytes} [Wed Nov 17 03:32:28 2021] GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 17 03:32:28.381342 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-257852c9-55b7-4e17-972b-8c49ec292405 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:32:28.382712 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-257852c9-55b7-4e17-972b-8c49ec292405 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] [instance: a49437df-3059-4528-8328-2f3471d5fb45] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:32:28.393363 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-257852c9-55b7-4e17-972b-8c49ec292405 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:32:28.394105 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-257852c9-55b7-4e17-972b-8c49ec292405 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:32:28.395377 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-257852c9-55b7-4e17-972b-8c49ec292405 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:32:28.396103 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-257852c9-55b7-4e17-972b-8c49ec292405 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:32:28.428146 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-257852c9-55b7-4e17-972b-8c49ec292405 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] 10.222.0.11 "GET /compute/v2.1/servers/a49437df-3059-4528-8328-2f3471d5fb45/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053442 Nov 17 03:32:28.428693 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 684/1401] 10.222.0.11 () {58 vars in 1301 bytes} [Wed Nov 17 03:32:28 2021] GET /compute/v2.1/servers/a49437df-3059-4528-8328-2f3471d5fb45/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 17 03:32:28.879042 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-5eedab67-4106-49c6-9fc8-a4ff2a224298 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:32:28.879665 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-5eedab67-4106-49c6-9fc8-a4ff2a224298 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] [instance: 0698dc5b-5f47-46c4-ace8-f5e891a964a0] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:32:28.886184 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-5eedab67-4106-49c6-9fc8-a4ff2a224298 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:32:28.886637 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-5eedab67-4106-49c6-9fc8-a4ff2a224298 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:32:28.887411 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-5eedab67-4106-49c6-9fc8-a4ff2a224298 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:32:28.887843 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-5eedab67-4106-49c6-9fc8-a4ff2a224298 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:32:28.915334 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-6ed20d8c-4160-4578-bc1d-cc8af2a2745b tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:32:28.916010 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-6ed20d8c-4160-4578-bc1d-cc8af2a2745b tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] [instance: 5ddbfaaa-fabf-4324-941c-8868625ffefc] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:32:28.922304 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-6ed20d8c-4160-4578-bc1d-cc8af2a2745b tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:32:28.922748 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-6ed20d8c-4160-4578-bc1d-cc8af2a2745b tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:32:28.923519 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-6ed20d8c-4160-4578-bc1d-cc8af2a2745b tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:32:28.923941 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-6ed20d8c-4160-4578-bc1d-cc8af2a2745b tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:32:28.983827 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-6ed20d8c-4160-4578-bc1d-cc8af2a2745b tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80763e09d44c475ea2425b22874e9612', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fef02a1dd77946a2ac0e0414b557435f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:32:28.991584 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-6ed20d8c-4160-4578-bc1d-cc8af2a2745b tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] 10.222.0.11 "GET /compute/v2.1/servers/5ddbfaaa-fabf-4324-941c-8868625ffefc" status: 200 len: 1226 microversion: 2.1 time: 0.079891 Nov 17 03:32:28.992135 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 685/1402] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:32:28 2021] GET /compute/v2.1/servers/5ddbfaaa-fabf-4324-941c-8868625ffefc => generated 1226 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:32:29.022576 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-5eedab67-4106-49c6-9fc8-a4ff2a224298 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '163b2f24a72649ac8084be1cac32fa09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e123e9b86124c93a7fc2db9984e7466', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:32:29.030819 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-5eedab67-4106-49c6-9fc8-a4ff2a224298 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] 10.222.0.11 "GET /compute/v2.1/servers/0698dc5b-5f47-46c4-ace8-f5e891a964a0" status: 200 len: 1565 microversion: 2.1 time: 0.155594 Nov 17 03:32:29.031422 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 718/1403] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:32:28 2021] GET /compute/v2.1/servers/0698dc5b-5f47-46c4-ace8-f5e891a964a0 => generated 1565 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:32:29.110870 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-d840d21b-ea41-4593-b780-6b1f0d82cd3c tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:32:29.112108 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-d840d21b-ea41-4593-b780-6b1f0d82cd3c tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] [instance: 5d54db85-b991-4890-abaa-952413baa2e7] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:32:29.121674 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-d840d21b-ea41-4593-b780-6b1f0d82cd3c tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:32:29.122333 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-d840d21b-ea41-4593-b780-6b1f0d82cd3c tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:32:29.123296 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-d840d21b-ea41-4593-b780-6b1f0d82cd3c tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:32:29.123727 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-d840d21b-ea41-4593-b780-6b1f0d82cd3c tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:32:29.152384 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-d840d21b-ea41-4593-b780-6b1f0d82cd3c tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] 10.222.0.11 "GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047564 Nov 17 03:32:29.152876 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 686/1404] 10.222.0.11 () {60 vars in 1342 bytes} [Wed Nov 17 03:32:29 2021] GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 17 03:32:29.440692 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-bf32962e-3d14-4023-a411-4a0f05a8d3bf tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:32:29.441575 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-bf32962e-3d14-4023-a411-4a0f05a8d3bf tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] [instance: a49437df-3059-4528-8328-2f3471d5fb45] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:32:29.448661 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-bf32962e-3d14-4023-a411-4a0f05a8d3bf tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:32:29.449180 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-bf32962e-3d14-4023-a411-4a0f05a8d3bf tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:32:29.450036 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-bf32962e-3d14-4023-a411-4a0f05a8d3bf tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:32:29.450507 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-bf32962e-3d14-4023-a411-4a0f05a8d3bf tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:32:29.480950 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-bf32962e-3d14-4023-a411-4a0f05a8d3bf tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] 10.222.0.11 "GET /compute/v2.1/servers/a49437df-3059-4528-8328-2f3471d5fb45/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044827 Nov 17 03:32:29.481504 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 719/1405] 10.222.0.11 () {58 vars in 1301 bytes} [Wed Nov 17 03:32:29 2021] GET /compute/v2.1/servers/a49437df-3059-4528-8328-2f3471d5fb45/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 17 03:32:30.012020 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-fe036e4d-d262-459c-83e6-e8b6a670bedc tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:32:30.013230 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-fe036e4d-d262-459c-83e6-e8b6a670bedc tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] [instance: 5ddbfaaa-fabf-4324-941c-8868625ffefc] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:32:30.024229 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-fe036e4d-d262-459c-83e6-e8b6a670bedc tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:32:30.025206 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-fe036e4d-d262-459c-83e6-e8b6a670bedc tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:32:30.026846 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-fe036e4d-d262-459c-83e6-e8b6a670bedc tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:32:30.027566 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-fe036e4d-d262-459c-83e6-e8b6a670bedc tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:32:30.047600 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-cdb740a6-86ee-4cd1-bc04-1879d4d32e3e tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:32:30.048300 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-cdb740a6-86ee-4cd1-bc04-1879d4d32e3e tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] [instance: 0698dc5b-5f47-46c4-ace8-f5e891a964a0] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:32:30.054657 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-cdb740a6-86ee-4cd1-bc04-1879d4d32e3e tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:32:30.055573 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-cdb740a6-86ee-4cd1-bc04-1879d4d32e3e tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:32:30.056379 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-cdb740a6-86ee-4cd1-bc04-1879d4d32e3e tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:32:30.056848 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-cdb740a6-86ee-4cd1-bc04-1879d4d32e3e tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:32:30.089392 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-fe036e4d-d262-459c-83e6-e8b6a670bedc tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80763e09d44c475ea2425b22874e9612', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fef02a1dd77946a2ac0e0414b557435f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:32:30.097825 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-fe036e4d-d262-459c-83e6-e8b6a670bedc tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] 10.222.0.11 "GET /compute/v2.1/servers/5ddbfaaa-fabf-4324-941c-8868625ffefc" status: 200 len: 1226 microversion: 2.1 time: 0.091914 Nov 17 03:32:30.098447 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 687/1406] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:32:30 2021] GET /compute/v2.1/servers/5ddbfaaa-fabf-4324-941c-8868625ffefc => generated 1226 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:32:30.163578 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-39bd41a8-dfca-49ba-8f8f-429748ecd257 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:32:30.164494 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-39bd41a8-dfca-49ba-8f8f-429748ecd257 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] [instance: 5d54db85-b991-4890-abaa-952413baa2e7] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:32:30.170975 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-39bd41a8-dfca-49ba-8f8f-429748ecd257 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:32:30.171429 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-39bd41a8-dfca-49ba-8f8f-429748ecd257 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:32:30.172214 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-39bd41a8-dfca-49ba-8f8f-429748ecd257 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:32:30.172644 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-39bd41a8-dfca-49ba-8f8f-429748ecd257 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:32:30.198150 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-cdb740a6-86ee-4cd1-bc04-1879d4d32e3e tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '163b2f24a72649ac8084be1cac32fa09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e123e9b86124c93a7fc2db9984e7466', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:32:30.202332 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-39bd41a8-dfca-49ba-8f8f-429748ecd257 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] 10.222.0.11 "GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042527 Nov 17 03:32:30.202914 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 688/1407] 10.222.0.11 () {60 vars in 1342 bytes} [Wed Nov 17 03:32:30 2021] GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 17 03:32:30.206294 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-cdb740a6-86ee-4cd1-bc04-1879d4d32e3e tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] 10.222.0.11 "GET /compute/v2.1/servers/0698dc5b-5f47-46c4-ace8-f5e891a964a0" status: 200 len: 1565 microversion: 2.1 time: 0.162553 Nov 17 03:32:30.206853 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 720/1408] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:32:30 2021] GET /compute/v2.1/servers/0698dc5b-5f47-46c4-ace8-f5e891a964a0 => generated 1565 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:32:30.495897 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-c8710522-69ab-4844-a269-65d1de7e9f54 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:32:30.496985 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-c8710522-69ab-4844-a269-65d1de7e9f54 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] [instance: a49437df-3059-4528-8328-2f3471d5fb45] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:32:30.504024 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-c8710522-69ab-4844-a269-65d1de7e9f54 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:32:30.504464 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-c8710522-69ab-4844-a269-65d1de7e9f54 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:32:30.505282 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-c8710522-69ab-4844-a269-65d1de7e9f54 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:32:30.505711 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-c8710522-69ab-4844-a269-65d1de7e9f54 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:32:30.536254 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-c8710522-69ab-4844-a269-65d1de7e9f54 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] 10.222.0.11 "GET /compute/v2.1/servers/a49437df-3059-4528-8328-2f3471d5fb45/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046288 Nov 17 03:32:30.536809 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 689/1409] 10.222.0.11 () {58 vars in 1301 bytes} [Wed Nov 17 03:32:30 2021] GET /compute/v2.1/servers/a49437df-3059-4528-8328-2f3471d5fb45/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 17 03:32:31.118743 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-6c0560b4-a2ac-49a7-8d77-38af72301d68 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:32:31.119709 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-6c0560b4-a2ac-49a7-8d77-38af72301d68 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] [instance: 5ddbfaaa-fabf-4324-941c-8868625ffefc] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:32:31.130689 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-6c0560b4-a2ac-49a7-8d77-38af72301d68 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:32:31.131422 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-6c0560b4-a2ac-49a7-8d77-38af72301d68 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:32:31.132680 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-6c0560b4-a2ac-49a7-8d77-38af72301d68 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:32:31.133440 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-6c0560b4-a2ac-49a7-8d77-38af72301d68 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:32:31.195211 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-6c0560b4-a2ac-49a7-8d77-38af72301d68 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80763e09d44c475ea2425b22874e9612', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fef02a1dd77946a2ac0e0414b557435f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:32:31.203978 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-6c0560b4-a2ac-49a7-8d77-38af72301d68 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] 10.222.0.11 "GET /compute/v2.1/servers/5ddbfaaa-fabf-4324-941c-8868625ffefc" status: 200 len: 1226 microversion: 2.1 time: 0.091120 Nov 17 03:32:31.204834 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 721/1410] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:32:31 2021] GET /compute/v2.1/servers/5ddbfaaa-fabf-4324-941c-8868625ffefc => generated 1226 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:32:31.214332 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-63a6a708-433b-4318-b48c-211bc5eb4e08 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:32:31.215234 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-63a6a708-433b-4318-b48c-211bc5eb4e08 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] [instance: 5d54db85-b991-4890-abaa-952413baa2e7] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:32:31.221741 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-63a6a708-433b-4318-b48c-211bc5eb4e08 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:32:31.222176 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-63a6a708-433b-4318-b48c-211bc5eb4e08 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:32:31.222943 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-63a6a708-433b-4318-b48c-211bc5eb4e08 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:32:31.223158 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-f6615e58-ff6e-4870-a4a4-516a274de533 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:32:31.223322 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-63a6a708-433b-4318-b48c-211bc5eb4e08 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:32:31.223767 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-f6615e58-ff6e-4870-a4a4-516a274de533 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] [instance: 0698dc5b-5f47-46c4-ace8-f5e891a964a0] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:32:31.230040 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-f6615e58-ff6e-4870-a4a4-516a274de533 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:32:31.230481 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-f6615e58-ff6e-4870-a4a4-516a274de533 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:32:31.231239 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-f6615e58-ff6e-4870-a4a4-516a274de533 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:32:31.231674 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-f6615e58-ff6e-4870-a4a4-516a274de533 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:32:31.252484 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-63a6a708-433b-4318-b48c-211bc5eb4e08 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] 10.222.0.11 "GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041931 Nov 17 03:32:31.253063 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 690/1411] 10.222.0.11 () {60 vars in 1342 bytes} [Wed Nov 17 03:32:31 2021] GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 17 03:32:31.365490 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-f6615e58-ff6e-4870-a4a4-516a274de533 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '163b2f24a72649ac8084be1cac32fa09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e123e9b86124c93a7fc2db9984e7466', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:32:31.373335 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-f6615e58-ff6e-4870-a4a4-516a274de533 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] 10.222.0.11 "GET /compute/v2.1/servers/0698dc5b-5f47-46c4-ace8-f5e891a964a0" status: 200 len: 1565 microversion: 2.1 time: 0.153774 Nov 17 03:32:31.373910 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 722/1412] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:32:31 2021] GET /compute/v2.1/servers/0698dc5b-5f47-46c4-ace8-f5e891a964a0 => generated 1565 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:32:31.547691 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-fb859a7b-948d-4105-bd7b-cfe0077dc5e9 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:32:31.548598 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-fb859a7b-948d-4105-bd7b-cfe0077dc5e9 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] [instance: a49437df-3059-4528-8328-2f3471d5fb45] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:32:31.555097 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-fb859a7b-948d-4105-bd7b-cfe0077dc5e9 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:32:31.555910 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-fb859a7b-948d-4105-bd7b-cfe0077dc5e9 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:32:31.556682 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-fb859a7b-948d-4105-bd7b-cfe0077dc5e9 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:32:31.557142 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-fb859a7b-948d-4105-bd7b-cfe0077dc5e9 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:32:31.586235 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-fb859a7b-948d-4105-bd7b-cfe0077dc5e9 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] 10.222.0.11 "GET /compute/v2.1/servers/a49437df-3059-4528-8328-2f3471d5fb45/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042346 Nov 17 03:32:31.586704 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 691/1413] 10.222.0.11 () {58 vars in 1301 bytes} [Wed Nov 17 03:32:31 2021] GET /compute/v2.1/servers/a49437df-3059-4528-8328-2f3471d5fb45/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 17 03:32:32.225980 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-018f3264-d190-4443-8e94-ff1313298193 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:32:32.227071 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-018f3264-d190-4443-8e94-ff1313298193 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] [instance: 5ddbfaaa-fabf-4324-941c-8868625ffefc] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:32:32.237985 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-018f3264-d190-4443-8e94-ff1313298193 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:32:32.238726 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-018f3264-d190-4443-8e94-ff1313298193 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:32:32.239987 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-018f3264-d190-4443-8e94-ff1313298193 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:32:32.240696 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-018f3264-d190-4443-8e94-ff1313298193 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:32:32.264548 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-1782c262-b1f0-4664-821b-33d89e193073 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:32:32.265478 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-1782c262-b1f0-4664-821b-33d89e193073 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] [instance: 5d54db85-b991-4890-abaa-952413baa2e7] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:32:32.272134 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-1782c262-b1f0-4664-821b-33d89e193073 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:32:32.272587 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-1782c262-b1f0-4664-821b-33d89e193073 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:32:32.273583 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-1782c262-b1f0-4664-821b-33d89e193073 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:32:32.274059 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-1782c262-b1f0-4664-821b-33d89e193073 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:32:32.306014 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-1782c262-b1f0-4664-821b-33d89e193073 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] 10.222.0.11 "GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045152 Nov 17 03:32:32.307005 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 692/1414] 10.222.0.11 () {60 vars in 1342 bytes} [Wed Nov 17 03:32:32 2021] GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 17 03:32:32.309085 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-018f3264-d190-4443-8e94-ff1313298193 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80763e09d44c475ea2425b22874e9612', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fef02a1dd77946a2ac0e0414b557435f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:32:32.319705 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-018f3264-d190-4443-8e94-ff1313298193 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] 10.222.0.11 "GET /compute/v2.1/servers/5ddbfaaa-fabf-4324-941c-8868625ffefc" status: 200 len: 1226 microversion: 2.1 time: 0.099679 Nov 17 03:32:32.320208 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 723/1415] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:32:32 2021] GET /compute/v2.1/servers/5ddbfaaa-fabf-4324-941c-8868625ffefc => generated 1226 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:32:32.391367 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-62fa137c-30b2-4114-b3b9-8886e6c6c2ed tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:32:32.392087 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-62fa137c-30b2-4114-b3b9-8886e6c6c2ed tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] [instance: 0698dc5b-5f47-46c4-ace8-f5e891a964a0] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:32:32.399833 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-62fa137c-30b2-4114-b3b9-8886e6c6c2ed tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:32:32.400350 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-62fa137c-30b2-4114-b3b9-8886e6c6c2ed tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:32:32.401307 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-62fa137c-30b2-4114-b3b9-8886e6c6c2ed tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:32:32.401816 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-62fa137c-30b2-4114-b3b9-8886e6c6c2ed tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:32:32.541928 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-62fa137c-30b2-4114-b3b9-8886e6c6c2ed tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '163b2f24a72649ac8084be1cac32fa09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e123e9b86124c93a7fc2db9984e7466', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:32:32.550140 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-62fa137c-30b2-4114-b3b9-8886e6c6c2ed tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] 10.222.0.11 "GET /compute/v2.1/servers/0698dc5b-5f47-46c4-ace8-f5e891a964a0" status: 200 len: 1565 microversion: 2.1 time: 0.163256 Nov 17 03:32:32.550708 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 693/1416] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:32:32 2021] GET /compute/v2.1/servers/0698dc5b-5f47-46c4-ace8-f5e891a964a0 => generated 1565 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:32:32.598176 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-d37238c9-c1cd-4711-95d5-b61d06de0864 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:32:32.599023 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-d37238c9-c1cd-4711-95d5-b61d06de0864 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] [instance: a49437df-3059-4528-8328-2f3471d5fb45] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:32:32.605712 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-d37238c9-c1cd-4711-95d5-b61d06de0864 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:32:32.606155 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-d37238c9-c1cd-4711-95d5-b61d06de0864 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:32:32.606921 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-d37238c9-c1cd-4711-95d5-b61d06de0864 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:32:32.607584 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-d37238c9-c1cd-4711-95d5-b61d06de0864 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:32:32.637272 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-d37238c9-c1cd-4711-95d5-b61d06de0864 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] 10.222.0.11 "GET /compute/v2.1/servers/a49437df-3059-4528-8328-2f3471d5fb45/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042978 Nov 17 03:32:32.637815 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 724/1417] 10.222.0.11 () {58 vars in 1301 bytes} [Wed Nov 17 03:32:32 2021] GET /compute/v2.1/servers/a49437df-3059-4528-8328-2f3471d5fb45/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 17 03:32:33.321233 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-2f56ea20-5611-4459-b123-8e6bbd5bf011 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:32:33.322561 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-2f56ea20-5611-4459-b123-8e6bbd5bf011 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] [instance: 5d54db85-b991-4890-abaa-952413baa2e7] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:32:33.331043 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-2f56ea20-5611-4459-b123-8e6bbd5bf011 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:32:33.331540 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-2f56ea20-5611-4459-b123-8e6bbd5bf011 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:32:33.332290 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-2f56ea20-5611-4459-b123-8e6bbd5bf011 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:32:33.332723 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-2f56ea20-5611-4459-b123-8e6bbd5bf011 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:32:33.336725 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-0bf31f26-b3e5-45c8-8c60-5b09a0e166d2 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:32:33.337431 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-0bf31f26-b3e5-45c8-8c60-5b09a0e166d2 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] [instance: 5ddbfaaa-fabf-4324-941c-8868625ffefc] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:32:33.343924 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-0bf31f26-b3e5-45c8-8c60-5b09a0e166d2 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:32:33.344361 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-0bf31f26-b3e5-45c8-8c60-5b09a0e166d2 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:32:33.345160 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-0bf31f26-b3e5-45c8-8c60-5b09a0e166d2 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:32:33.345588 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-0bf31f26-b3e5-45c8-8c60-5b09a0e166d2 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:32:33.363222 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-2f56ea20-5611-4459-b123-8e6bbd5bf011 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] 10.222.0.11 "GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.048519 Nov 17 03:32:33.363889 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 694/1418] 10.222.0.11 () {60 vars in 1342 bytes} [Wed Nov 17 03:32:33 2021] GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 17 03:32:33.405633 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-0bf31f26-b3e5-45c8-8c60-5b09a0e166d2 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80763e09d44c475ea2425b22874e9612', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fef02a1dd77946a2ac0e0414b557435f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:32:33.413465 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-0bf31f26-b3e5-45c8-8c60-5b09a0e166d2 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] 10.222.0.11 "GET /compute/v2.1/servers/5ddbfaaa-fabf-4324-941c-8868625ffefc" status: 200 len: 1226 microversion: 2.1 time: 0.080480 Nov 17 03:32:33.414046 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 725/1419] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:32:33 2021] GET /compute/v2.1/servers/5ddbfaaa-fabf-4324-941c-8868625ffefc => generated 1226 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:32:33.571748 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-1e6b5125-a43c-4419-b612-1a595608f6ed tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:32:33.572585 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-1e6b5125-a43c-4419-b612-1a595608f6ed tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] [instance: 0698dc5b-5f47-46c4-ace8-f5e891a964a0] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:32:33.582811 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-1e6b5125-a43c-4419-b612-1a595608f6ed tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:32:33.583561 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-1e6b5125-a43c-4419-b612-1a595608f6ed tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:32:33.584909 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-1e6b5125-a43c-4419-b612-1a595608f6ed tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:32:33.585644 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-1e6b5125-a43c-4419-b612-1a595608f6ed tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:32:33.649374 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-b5acd4dd-5af0-4e76-be52-ad72065eedab tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:32:33.650328 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-b5acd4dd-5af0-4e76-be52-ad72065eedab tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] [instance: a49437df-3059-4528-8328-2f3471d5fb45] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:32:33.656811 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-b5acd4dd-5af0-4e76-be52-ad72065eedab tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:32:33.657286 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-b5acd4dd-5af0-4e76-be52-ad72065eedab tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:32:33.658061 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-b5acd4dd-5af0-4e76-be52-ad72065eedab tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:32:33.658493 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-b5acd4dd-5af0-4e76-be52-ad72065eedab tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:32:33.692067 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-b5acd4dd-5af0-4e76-be52-ad72065eedab tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] 10.222.0.11 "GET /compute/v2.1/servers/a49437df-3059-4528-8328-2f3471d5fb45/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046487 Nov 17 03:32:33.692641 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 726/1420] 10.222.0.11 () {58 vars in 1301 bytes} [Wed Nov 17 03:32:33 2021] GET /compute/v2.1/servers/a49437df-3059-4528-8328-2f3471d5fb45/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 17 03:32:33.734190 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-1e6b5125-a43c-4419-b612-1a595608f6ed tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '163b2f24a72649ac8084be1cac32fa09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e123e9b86124c93a7fc2db9984e7466', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:32:33.743542 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-1e6b5125-a43c-4419-b612-1a595608f6ed tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] 10.222.0.11 "GET /compute/v2.1/servers/0698dc5b-5f47-46c4-ace8-f5e891a964a0" status: 200 len: 1565 microversion: 2.1 time: 0.178041 Nov 17 03:32:33.744109 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 695/1421] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:32:33 2021] GET /compute/v2.1/servers/0698dc5b-5f47-46c4-ace8-f5e891a964a0 => generated 1565 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:32:34.377941 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-e1c491c1-2462-49ae-9e99-0173d4de54b2 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:32:34.378941 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-e1c491c1-2462-49ae-9e99-0173d4de54b2 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] [instance: 5d54db85-b991-4890-abaa-952413baa2e7] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:32:34.387856 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-e1c491c1-2462-49ae-9e99-0173d4de54b2 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:32:34.388580 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-e1c491c1-2462-49ae-9e99-0173d4de54b2 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:32:34.389657 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-e1c491c1-2462-49ae-9e99-0173d4de54b2 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:32:34.390235 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-e1c491c1-2462-49ae-9e99-0173d4de54b2 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:32:34.422798 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-e1c491c1-2462-49ae-9e99-0173d4de54b2 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] 10.222.0.11 "GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.050623 Nov 17 03:32:34.423345 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 727/1422] 10.222.0.11 () {60 vars in 1342 bytes} [Wed Nov 17 03:32:34 2021] GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 17 03:32:34.432140 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-2ffeb65c-79c1-463b-81fe-7494c0d38a1f tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:32:34.432842 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-2ffeb65c-79c1-463b-81fe-7494c0d38a1f tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] [instance: 5ddbfaaa-fabf-4324-941c-8868625ffefc] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:32:34.440404 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-2ffeb65c-79c1-463b-81fe-7494c0d38a1f tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:32:34.440872 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-2ffeb65c-79c1-463b-81fe-7494c0d38a1f tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:32:34.441642 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-2ffeb65c-79c1-463b-81fe-7494c0d38a1f tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:32:34.442072 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-2ffeb65c-79c1-463b-81fe-7494c0d38a1f tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:32:34.446442 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 17 03:32:34.446587 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: Wed Nov 17 03:32:34 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/5ddbfaaa-fabf-4324-941c-8868625ffefc (ip 10.222.0.11) !!! Nov 17 03:32:34.521121 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-2ffeb65c-79c1-463b-81fe-7494c0d38a1f tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80763e09d44c475ea2425b22874e9612', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fef02a1dd77946a2ac0e0414b557435f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:32:34.529559 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-2ffeb65c-79c1-463b-81fe-7494c0d38a1f tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] 10.222.0.11 "GET /compute/v2.1/servers/5ddbfaaa-fabf-4324-941c-8868625ffefc" status: 200 len: 1226 microversion: 2.1 time: 0.102877 Nov 17 03:32:34.530206 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 696/1423] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:32:34 2021] GET /compute/v2.1/servers/5ddbfaaa-fabf-4324-941c-8868625ffefc => generated 1226 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:32:34.663258 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 17 03:32:34.663523 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: Wed Nov 17 03:32:34 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Nov 17 03:32:34.704394 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-0958bbdc-750f-4fee-85d0-0e2e9b299db7 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:32:34.705359 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-0958bbdc-750f-4fee-85d0-0e2e9b299db7 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] [instance: a49437df-3059-4528-8328-2f3471d5fb45] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:32:34.711866 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-0958bbdc-750f-4fee-85d0-0e2e9b299db7 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:32:34.712323 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-0958bbdc-750f-4fee-85d0-0e2e9b299db7 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:32:34.713164 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-0958bbdc-750f-4fee-85d0-0e2e9b299db7 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:32:34.713600 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-0958bbdc-750f-4fee-85d0-0e2e9b299db7 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:32:34.743269 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-0958bbdc-750f-4fee-85d0-0e2e9b299db7 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] 10.222.0.11 "GET /compute/v2.1/servers/a49437df-3059-4528-8328-2f3471d5fb45/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042897 Nov 17 03:32:34.743822 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 728/1424] 10.222.0.11 () {58 vars in 1301 bytes} [Wed Nov 17 03:32:34 2021] GET /compute/v2.1/servers/a49437df-3059-4528-8328-2f3471d5fb45/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 17 03:32:34.760289 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-9517b84f-dc24-4c8b-84f3-a4a7acbc9243 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:32:34.760939 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-9517b84f-dc24-4c8b-84f3-a4a7acbc9243 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] [instance: 0698dc5b-5f47-46c4-ace8-f5e891a964a0] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:32:34.767855 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-9517b84f-dc24-4c8b-84f3-a4a7acbc9243 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:32:34.768312 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-9517b84f-dc24-4c8b-84f3-a4a7acbc9243 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:32:34.769136 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-9517b84f-dc24-4c8b-84f3-a4a7acbc9243 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:32:34.769573 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-9517b84f-dc24-4c8b-84f3-a4a7acbc9243 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:32:34.916000 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-9517b84f-dc24-4c8b-84f3-a4a7acbc9243 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '163b2f24a72649ac8084be1cac32fa09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e123e9b86124c93a7fc2db9984e7466', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:32:34.924140 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-9517b84f-dc24-4c8b-84f3-a4a7acbc9243 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] 10.222.0.11 "GET /compute/v2.1/servers/0698dc5b-5f47-46c4-ace8-f5e891a964a0" status: 200 len: 1565 microversion: 2.1 time: 0.167514 Nov 17 03:32:34.924710 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 697/1425] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:32:34 2021] GET /compute/v2.1/servers/0698dc5b-5f47-46c4-ace8-f5e891a964a0 => generated 1565 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:32:35.439788 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-6b53b70e-ad19-45b4-a8c3-b30a515991e7 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:32:35.441176 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-6b53b70e-ad19-45b4-a8c3-b30a515991e7 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] [instance: 5d54db85-b991-4890-abaa-952413baa2e7] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:32:35.452118 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-6b53b70e-ad19-45b4-a8c3-b30a515991e7 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:32:35.452573 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-6b53b70e-ad19-45b4-a8c3-b30a515991e7 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:32:35.453383 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-6b53b70e-ad19-45b4-a8c3-b30a515991e7 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:32:35.453819 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-6b53b70e-ad19-45b4-a8c3-b30a515991e7 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:32:35.484183 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-6b53b70e-ad19-45b4-a8c3-b30a515991e7 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] 10.222.0.11 "GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.051776 Nov 17 03:32:35.484744 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 729/1426] 10.222.0.11 () {60 vars in 1342 bytes} [Wed Nov 17 03:32:35 2021] GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 17 03:32:35.547263 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-73dc5af0-b2a3-4164-b0c2-694d73e162c9 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:32:35.547964 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-73dc5af0-b2a3-4164-b0c2-694d73e162c9 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] [instance: 5ddbfaaa-fabf-4324-941c-8868625ffefc] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:32:35.556138 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-73dc5af0-b2a3-4164-b0c2-694d73e162c9 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:32:35.556640 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-73dc5af0-b2a3-4164-b0c2-694d73e162c9 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:32:35.557566 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-73dc5af0-b2a3-4164-b0c2-694d73e162c9 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:32:35.558037 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-73dc5af0-b2a3-4164-b0c2-694d73e162c9 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:32:35.620448 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-73dc5af0-b2a3-4164-b0c2-694d73e162c9 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80763e09d44c475ea2425b22874e9612', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fef02a1dd77946a2ac0e0414b557435f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:32:35.628566 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-73dc5af0-b2a3-4164-b0c2-694d73e162c9 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] 10.222.0.11 "GET /compute/v2.1/servers/5ddbfaaa-fabf-4324-941c-8868625ffefc" status: 200 len: 1226 microversion: 2.1 time: 0.085879 Nov 17 03:32:35.629175 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 698/1427] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:32:35 2021] GET /compute/v2.1/servers/5ddbfaaa-fabf-4324-941c-8868625ffefc => generated 1226 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:32:35.759300 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-9433cf83-b128-49fe-8844-1a7d90cf3cb8 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:32:35.760799 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-9433cf83-b128-49fe-8844-1a7d90cf3cb8 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] [instance: a49437df-3059-4528-8328-2f3471d5fb45] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:32:35.771279 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-9433cf83-b128-49fe-8844-1a7d90cf3cb8 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:32:35.772017 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-9433cf83-b128-49fe-8844-1a7d90cf3cb8 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:32:35.773340 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-9433cf83-b128-49fe-8844-1a7d90cf3cb8 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:32:35.774054 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-9433cf83-b128-49fe-8844-1a7d90cf3cb8 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:32:35.805042 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-9433cf83-b128-49fe-8844-1a7d90cf3cb8 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] 10.222.0.11 "GET /compute/v2.1/servers/a49437df-3059-4528-8328-2f3471d5fb45/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052114 Nov 17 03:32:35.805924 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 730/1428] 10.222.0.11 () {58 vars in 1301 bytes} [Wed Nov 17 03:32:35 2021] GET /compute/v2.1/servers/a49437df-3059-4528-8328-2f3471d5fb45/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 17 03:32:35.947135 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-c9a1ce05-0c76-461a-9d71-334b0e1e4585 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:32:35.948142 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-c9a1ce05-0c76-461a-9d71-334b0e1e4585 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] [instance: 0698dc5b-5f47-46c4-ace8-f5e891a964a0] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:32:35.959394 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-c9a1ce05-0c76-461a-9d71-334b0e1e4585 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:32:35.960137 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-c9a1ce05-0c76-461a-9d71-334b0e1e4585 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:32:35.961459 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-c9a1ce05-0c76-461a-9d71-334b0e1e4585 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:32:35.962190 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-c9a1ce05-0c76-461a-9d71-334b0e1e4585 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:32:36.116567 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-c9a1ce05-0c76-461a-9d71-334b0e1e4585 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '163b2f24a72649ac8084be1cac32fa09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e123e9b86124c93a7fc2db9984e7466', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:32:36.125127 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-c9a1ce05-0c76-461a-9d71-334b0e1e4585 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] 10.222.0.11 "GET /compute/v2.1/servers/0698dc5b-5f47-46c4-ace8-f5e891a964a0" status: 200 len: 1565 microversion: 2.1 time: 0.184141 Nov 17 03:32:36.125702 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 699/1429] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:32:35 2021] GET /compute/v2.1/servers/0698dc5b-5f47-46c4-ace8-f5e891a964a0 => generated 1565 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:32:36.495810 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-fcae46f1-e758-4fb0-84bc-5e2508f658e1 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:32:36.496713 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-fcae46f1-e758-4fb0-84bc-5e2508f658e1 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] [instance: 5d54db85-b991-4890-abaa-952413baa2e7] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:32:36.504045 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-fcae46f1-e758-4fb0-84bc-5e2508f658e1 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:32:36.504475 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-fcae46f1-e758-4fb0-84bc-5e2508f658e1 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:32:36.505472 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-fcae46f1-e758-4fb0-84bc-5e2508f658e1 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:32:36.506039 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-fcae46f1-e758-4fb0-84bc-5e2508f658e1 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:32:36.538593 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-fcae46f1-e758-4fb0-84bc-5e2508f658e1 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] 10.222.0.11 "GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046514 Nov 17 03:32:36.539155 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 731/1430] 10.222.0.11 () {60 vars in 1342 bytes} [Wed Nov 17 03:32:36 2021] GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 17 03:32:36.649365 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-06a287a6-dc3a-47d3-a47c-57080a44b658 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:32:36.649996 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-06a287a6-dc3a-47d3-a47c-57080a44b658 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] [instance: 5ddbfaaa-fabf-4324-941c-8868625ffefc] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:32:36.656308 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-06a287a6-dc3a-47d3-a47c-57080a44b658 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:32:36.656748 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-06a287a6-dc3a-47d3-a47c-57080a44b658 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:32:36.657629 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-06a287a6-dc3a-47d3-a47c-57080a44b658 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:32:36.658052 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-06a287a6-dc3a-47d3-a47c-57080a44b658 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:32:36.724724 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-06a287a6-dc3a-47d3-a47c-57080a44b658 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80763e09d44c475ea2425b22874e9612', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fef02a1dd77946a2ac0e0414b557435f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:32:36.732029 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-06a287a6-dc3a-47d3-a47c-57080a44b658 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] 10.222.0.11 "GET /compute/v2.1/servers/5ddbfaaa-fabf-4324-941c-8868625ffefc" status: 200 len: 1226 microversion: 2.1 time: 0.086657 Nov 17 03:32:36.732613 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 700/1431] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:32:36 2021] GET /compute/v2.1/servers/5ddbfaaa-fabf-4324-941c-8868625ffefc => generated 1226 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:32:36.821238 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-84d2fafc-3890-4f44-ae1b-ae85c775a0b7 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:32:36.822690 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-84d2fafc-3890-4f44-ae1b-ae85c775a0b7 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] [instance: a49437df-3059-4528-8328-2f3471d5fb45] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:32:36.830699 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-84d2fafc-3890-4f44-ae1b-ae85c775a0b7 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:32:36.831141 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-84d2fafc-3890-4f44-ae1b-ae85c775a0b7 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:32:36.831899 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-84d2fafc-3890-4f44-ae1b-ae85c775a0b7 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:32:36.832325 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-84d2fafc-3890-4f44-ae1b-ae85c775a0b7 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:32:36.864180 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-84d2fafc-3890-4f44-ae1b-ae85c775a0b7 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] 10.222.0.11 "GET /compute/v2.1/servers/a49437df-3059-4528-8328-2f3471d5fb45/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049424 Nov 17 03:32:36.864729 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 732/1432] 10.222.0.11 () {58 vars in 1301 bytes} [Wed Nov 17 03:32:36 2021] GET /compute/v2.1/servers/a49437df-3059-4528-8328-2f3471d5fb45/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 17 03:32:37.143795 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-9ea55e47-4bba-408c-8306-e62bc02ae63d tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:32:37.144398 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-9ea55e47-4bba-408c-8306-e62bc02ae63d tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] [instance: 0698dc5b-5f47-46c4-ace8-f5e891a964a0] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:32:37.150617 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-9ea55e47-4bba-408c-8306-e62bc02ae63d tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:32:37.151059 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-9ea55e47-4bba-408c-8306-e62bc02ae63d tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:32:37.151815 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-9ea55e47-4bba-408c-8306-e62bc02ae63d tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:32:37.152248 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-9ea55e47-4bba-408c-8306-e62bc02ae63d tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:32:37.293503 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-9ea55e47-4bba-408c-8306-e62bc02ae63d tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '163b2f24a72649ac8084be1cac32fa09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e123e9b86124c93a7fc2db9984e7466', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:32:37.303332 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-9ea55e47-4bba-408c-8306-e62bc02ae63d tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] 10.222.0.11 "GET /compute/v2.1/servers/0698dc5b-5f47-46c4-ace8-f5e891a964a0" status: 200 len: 1565 microversion: 2.1 time: 0.163477 Nov 17 03:32:37.303907 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 701/1433] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:32:37 2021] GET /compute/v2.1/servers/0698dc5b-5f47-46c4-ace8-f5e891a964a0 => generated 1565 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:32:37.553012 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-16eab4b0-20c7-473a-957a-b33d24468b0f tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:32:37.554324 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-16eab4b0-20c7-473a-957a-b33d24468b0f tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] [instance: 5d54db85-b991-4890-abaa-952413baa2e7] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:32:37.563586 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-16eab4b0-20c7-473a-957a-b33d24468b0f tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:32:37.564180 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-16eab4b0-20c7-473a-957a-b33d24468b0f tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:32:37.565251 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-16eab4b0-20c7-473a-957a-b33d24468b0f tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:32:37.565823 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-16eab4b0-20c7-473a-957a-b33d24468b0f tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:32:37.598766 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-16eab4b0-20c7-473a-957a-b33d24468b0f tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] 10.222.0.11 "GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.050825 Nov 17 03:32:37.599237 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 733/1434] 10.222.0.11 () {60 vars in 1342 bytes} [Wed Nov 17 03:32:37 2021] GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 17 03:32:37.748757 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-03419433-411d-49c3-a1eb-88804e06b2c2 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:32:37.749812 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-03419433-411d-49c3-a1eb-88804e06b2c2 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] [instance: 5ddbfaaa-fabf-4324-941c-8868625ffefc] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:32:37.756429 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-03419433-411d-49c3-a1eb-88804e06b2c2 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:32:37.756920 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-03419433-411d-49c3-a1eb-88804e06b2c2 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:32:37.757676 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-03419433-411d-49c3-a1eb-88804e06b2c2 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:32:37.758134 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-03419433-411d-49c3-a1eb-88804e06b2c2 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:32:37.821779 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-03419433-411d-49c3-a1eb-88804e06b2c2 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80763e09d44c475ea2425b22874e9612', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fef02a1dd77946a2ac0e0414b557435f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:32:37.829616 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-03419433-411d-49c3-a1eb-88804e06b2c2 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] 10.222.0.11 "GET /compute/v2.1/servers/5ddbfaaa-fabf-4324-941c-8868625ffefc" status: 200 len: 1226 microversion: 2.1 time: 0.084593 Nov 17 03:32:37.830224 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 702/1435] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:32:37 2021] GET /compute/v2.1/servers/5ddbfaaa-fabf-4324-941c-8868625ffefc => generated 1226 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:32:37.875753 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-90d08848-6d4d-4811-8035-93d1cf66bb35 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:32:37.876677 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-90d08848-6d4d-4811-8035-93d1cf66bb35 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] [instance: a49437df-3059-4528-8328-2f3471d5fb45] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:32:37.882631 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-90d08848-6d4d-4811-8035-93d1cf66bb35 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:32:37.883113 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-90d08848-6d4d-4811-8035-93d1cf66bb35 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:32:37.883884 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-90d08848-6d4d-4811-8035-93d1cf66bb35 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:32:37.884326 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-90d08848-6d4d-4811-8035-93d1cf66bb35 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:32:37.914764 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-90d08848-6d4d-4811-8035-93d1cf66bb35 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] 10.222.0.11 "GET /compute/v2.1/servers/a49437df-3059-4528-8328-2f3471d5fb45/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042971 Nov 17 03:32:37.915347 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 734/1436] 10.222.0.11 () {58 vars in 1301 bytes} [Wed Nov 17 03:32:37 2021] GET /compute/v2.1/servers/a49437df-3059-4528-8328-2f3471d5fb45/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 17 03:32:38.324993 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-c2e4ac6c-ed52-4a3e-b234-0e654b118111 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:32:38.326032 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-c2e4ac6c-ed52-4a3e-b234-0e654b118111 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] [instance: 0698dc5b-5f47-46c4-ace8-f5e891a964a0] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:32:38.336703 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-c2e4ac6c-ed52-4a3e-b234-0e654b118111 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:32:38.337516 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-c2e4ac6c-ed52-4a3e-b234-0e654b118111 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:32:38.338779 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-c2e4ac6c-ed52-4a3e-b234-0e654b118111 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:32:38.339492 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-c2e4ac6c-ed52-4a3e-b234-0e654b118111 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:32:38.477646 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-c2e4ac6c-ed52-4a3e-b234-0e654b118111 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '163b2f24a72649ac8084be1cac32fa09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e123e9b86124c93a7fc2db9984e7466', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:32:38.490000 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-c2e4ac6c-ed52-4a3e-b234-0e654b118111 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] 10.222.0.11 "GET /compute/v2.1/servers/0698dc5b-5f47-46c4-ace8-f5e891a964a0" status: 200 len: 1565 microversion: 2.1 time: 0.170902 Nov 17 03:32:38.490770 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 703/1437] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:32:38 2021] GET /compute/v2.1/servers/0698dc5b-5f47-46c4-ace8-f5e891a964a0 => generated 1565 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:32:38.614622 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-21c12436-93e9-4933-8095-b7843b432457 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:32:38.615944 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-21c12436-93e9-4933-8095-b7843b432457 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] [instance: 5d54db85-b991-4890-abaa-952413baa2e7] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:32:38.625948 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-21c12436-93e9-4933-8095-b7843b432457 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:32:38.626395 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-21c12436-93e9-4933-8095-b7843b432457 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:32:38.627167 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-21c12436-93e9-4933-8095-b7843b432457 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:32:38.627593 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-21c12436-93e9-4933-8095-b7843b432457 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:32:38.657034 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-21c12436-93e9-4933-8095-b7843b432457 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] 10.222.0.11 "GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.049020 Nov 17 03:32:38.657575 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 735/1438] 10.222.0.11 () {60 vars in 1342 bytes} [Wed Nov 17 03:32:38 2021] GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 17 03:32:38.850663 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-bec614bd-ea14-40a0-a52a-ea83c4c30cc6 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:32:38.851655 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-bec614bd-ea14-40a0-a52a-ea83c4c30cc6 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] [instance: 5ddbfaaa-fabf-4324-941c-8868625ffefc] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:32:38.860970 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-bec614bd-ea14-40a0-a52a-ea83c4c30cc6 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:32:38.861422 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-bec614bd-ea14-40a0-a52a-ea83c4c30cc6 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:32:38.862195 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-bec614bd-ea14-40a0-a52a-ea83c4c30cc6 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:32:38.862627 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-bec614bd-ea14-40a0-a52a-ea83c4c30cc6 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:32:38.928264 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-8b4911ad-fa31-4d5e-935c-92529c4c5e9c tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:32:38.929125 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-8b4911ad-fa31-4d5e-935c-92529c4c5e9c tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] [instance: a49437df-3059-4528-8328-2f3471d5fb45] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:32:38.931410 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-bec614bd-ea14-40a0-a52a-ea83c4c30cc6 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80763e09d44c475ea2425b22874e9612', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fef02a1dd77946a2ac0e0414b557435f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:32:38.935686 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-8b4911ad-fa31-4d5e-935c-92529c4c5e9c tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:32:38.936137 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-8b4911ad-fa31-4d5e-935c-92529c4c5e9c tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:32:38.936951 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-8b4911ad-fa31-4d5e-935c-92529c4c5e9c tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:32:38.937577 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-8b4911ad-fa31-4d5e-935c-92529c4c5e9c tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:32:38.938927 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-bec614bd-ea14-40a0-a52a-ea83c4c30cc6 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] 10.222.0.11 "GET /compute/v2.1/servers/5ddbfaaa-fabf-4324-941c-8868625ffefc" status: 200 len: 1226 microversion: 2.1 time: 0.094441 Nov 17 03:32:38.939562 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 704/1439] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:32:38 2021] GET /compute/v2.1/servers/5ddbfaaa-fabf-4324-941c-8868625ffefc => generated 1226 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:32:38.968870 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-8b4911ad-fa31-4d5e-935c-92529c4c5e9c tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] 10.222.0.11 "GET /compute/v2.1/servers/a49437df-3059-4528-8328-2f3471d5fb45/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044528 Nov 17 03:32:38.969424 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 736/1440] 10.222.0.11 () {58 vars in 1301 bytes} [Wed Nov 17 03:32:38 2021] GET /compute/v2.1/servers/a49437df-3059-4528-8328-2f3471d5fb45/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 17 03:32:39.514507 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-7bdc278a-b6ac-4e75-ad23-219b1f8db9fe tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:32:39.515547 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-7bdc278a-b6ac-4e75-ad23-219b1f8db9fe tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] [instance: 0698dc5b-5f47-46c4-ace8-f5e891a964a0] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:32:39.522188 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-7bdc278a-b6ac-4e75-ad23-219b1f8db9fe tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:32:39.522653 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-7bdc278a-b6ac-4e75-ad23-219b1f8db9fe tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:32:39.523454 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-7bdc278a-b6ac-4e75-ad23-219b1f8db9fe tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:32:39.523903 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-7bdc278a-b6ac-4e75-ad23-219b1f8db9fe tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:32:39.667607 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-7bdc278a-b6ac-4e75-ad23-219b1f8db9fe tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '163b2f24a72649ac8084be1cac32fa09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e123e9b86124c93a7fc2db9984e7466', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:32:39.668760 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-373d70ba-7b35-41cd-b842-7700b09898c6 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:32:39.669865 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-373d70ba-7b35-41cd-b842-7700b09898c6 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] [instance: 5d54db85-b991-4890-abaa-952413baa2e7] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:32:39.675225 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-7bdc278a-b6ac-4e75-ad23-219b1f8db9fe tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] 10.222.0.11 "GET /compute/v2.1/servers/0698dc5b-5f47-46c4-ace8-f5e891a964a0" status: 200 len: 1565 microversion: 2.1 time: 0.166838 Nov 17 03:32:39.675770 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 705/1441] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:32:39 2021] GET /compute/v2.1/servers/0698dc5b-5f47-46c4-ace8-f5e891a964a0 => generated 1565 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:32:39.676940 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-373d70ba-7b35-41cd-b842-7700b09898c6 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:32:39.676940 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-373d70ba-7b35-41cd-b842-7700b09898c6 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:32:39.677580 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-373d70ba-7b35-41cd-b842-7700b09898c6 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:32:39.678011 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-373d70ba-7b35-41cd-b842-7700b09898c6 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:32:39.708315 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-373d70ba-7b35-41cd-b842-7700b09898c6 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] 10.222.0.11 "GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043327 Nov 17 03:32:39.708867 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 737/1442] 10.222.0.11 () {60 vars in 1342 bytes} [Wed Nov 17 03:32:39 2021] GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 17 03:32:39.959276 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-5f604361-3a99-4a42-ae76-8075ff3deec7 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:32:39.960153 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-5f604361-3a99-4a42-ae76-8075ff3deec7 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] [instance: 5ddbfaaa-fabf-4324-941c-8868625ffefc] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:32:39.969813 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-5f604361-3a99-4a42-ae76-8075ff3deec7 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:32:39.970253 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-5f604361-3a99-4a42-ae76-8075ff3deec7 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:32:39.971018 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-5f604361-3a99-4a42-ae76-8075ff3deec7 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:32:39.971448 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-5f604361-3a99-4a42-ae76-8075ff3deec7 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:32:39.980462 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-a1000071-181f-4ed9-ac48-338563d73b86 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:32:39.981396 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-a1000071-181f-4ed9-ac48-338563d73b86 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] [instance: a49437df-3059-4528-8328-2f3471d5fb45] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:32:39.987737 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-a1000071-181f-4ed9-ac48-338563d73b86 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:32:39.988177 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-a1000071-181f-4ed9-ac48-338563d73b86 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:32:39.988984 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-a1000071-181f-4ed9-ac48-338563d73b86 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:32:39.989412 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-a1000071-181f-4ed9-ac48-338563d73b86 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:32:40.019088 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-a1000071-181f-4ed9-ac48-338563d73b86 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] 10.222.0.11 "GET /compute/v2.1/servers/a49437df-3059-4528-8328-2f3471d5fb45/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042269 Nov 17 03:32:40.019654 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 738/1443] 10.222.0.11 () {58 vars in 1301 bytes} [Wed Nov 17 03:32:39 2021] GET /compute/v2.1/servers/a49437df-3059-4528-8328-2f3471d5fb45/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 17 03:32:40.031409 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-5f604361-3a99-4a42-ae76-8075ff3deec7 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80763e09d44c475ea2425b22874e9612', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fef02a1dd77946a2ac0e0414b557435f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:32:40.038932 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-5f604361-3a99-4a42-ae76-8075ff3deec7 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] 10.222.0.11 "GET /compute/v2.1/servers/5ddbfaaa-fabf-4324-941c-8868625ffefc" status: 200 len: 1226 microversion: 2.1 time: 0.085926 Nov 17 03:32:40.039500 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 706/1444] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:32:39 2021] GET /compute/v2.1/servers/5ddbfaaa-fabf-4324-941c-8868625ffefc => generated 1226 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:32:40.696965 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-b953394f-efdd-4472-882a-5543bfbc2b4c tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:32:40.697921 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-b953394f-efdd-4472-882a-5543bfbc2b4c tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] [instance: 0698dc5b-5f47-46c4-ace8-f5e891a964a0] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:32:40.708431 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-b953394f-efdd-4472-882a-5543bfbc2b4c tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:32:40.709244 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-b953394f-efdd-4472-882a-5543bfbc2b4c tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:32:40.710533 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-b953394f-efdd-4472-882a-5543bfbc2b4c tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:32:40.711261 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-b953394f-efdd-4472-882a-5543bfbc2b4c tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:32:40.722304 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-a73020e2-c90a-482a-a470-51ed7d952e53 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:32:40.723215 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-a73020e2-c90a-482a-a470-51ed7d952e53 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] [instance: 5d54db85-b991-4890-abaa-952413baa2e7] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:32:40.729408 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-a73020e2-c90a-482a-a470-51ed7d952e53 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:32:40.729874 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-a73020e2-c90a-482a-a470-51ed7d952e53 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:32:40.730634 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-a73020e2-c90a-482a-a470-51ed7d952e53 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:32:40.731063 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-a73020e2-c90a-482a-a470-51ed7d952e53 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:32:40.760824 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-a73020e2-c90a-482a-a470-51ed7d952e53 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] 10.222.0.11 "GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043745 Nov 17 03:32:40.761400 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 707/1445] 10.222.0.11 () {60 vars in 1342 bytes} [Wed Nov 17 03:32:40 2021] GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 17 03:32:40.849378 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-b953394f-efdd-4472-882a-5543bfbc2b4c tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '163b2f24a72649ac8084be1cac32fa09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e123e9b86124c93a7fc2db9984e7466', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:32:40.857411 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-b953394f-efdd-4472-882a-5543bfbc2b4c tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] 10.222.0.11 "GET /compute/v2.1/servers/0698dc5b-5f47-46c4-ace8-f5e891a964a0" status: 200 len: 1565 microversion: 2.1 time: 0.166930 Nov 17 03:32:40.857956 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 739/1446] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:32:40 2021] GET /compute/v2.1/servers/0698dc5b-5f47-46c4-ace8-f5e891a964a0 => generated 1565 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:32:41.034567 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-c0f9d119-7f7b-4bf3-97e6-511843ce3746 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:32:41.036064 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-c0f9d119-7f7b-4bf3-97e6-511843ce3746 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] [instance: a49437df-3059-4528-8328-2f3471d5fb45] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:32:41.046820 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-c0f9d119-7f7b-4bf3-97e6-511843ce3746 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:32:41.047218 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-c0f9d119-7f7b-4bf3-97e6-511843ce3746 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:32:41.047989 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-c0f9d119-7f7b-4bf3-97e6-511843ce3746 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:32:41.048421 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-c0f9d119-7f7b-4bf3-97e6-511843ce3746 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:32:41.057909 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-4cf76a85-0a1e-4eb3-bc85-d1723af9562c tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:32:41.058486 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-4cf76a85-0a1e-4eb3-bc85-d1723af9562c tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] [instance: 5ddbfaaa-fabf-4324-941c-8868625ffefc] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:32:41.064754 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-4cf76a85-0a1e-4eb3-bc85-d1723af9562c tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:32:41.065224 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-4cf76a85-0a1e-4eb3-bc85-d1723af9562c tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:32:41.065997 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-4cf76a85-0a1e-4eb3-bc85-d1723af9562c tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:32:41.066443 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-4cf76a85-0a1e-4eb3-bc85-d1723af9562c tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:32:41.079840 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-c0f9d119-7f7b-4bf3-97e6-511843ce3746 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] 10.222.0.11 "GET /compute/v2.1/servers/a49437df-3059-4528-8328-2f3471d5fb45/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051599 Nov 17 03:32:41.080395 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 708/1447] 10.222.0.11 () {58 vars in 1301 bytes} [Wed Nov 17 03:32:41 2021] GET /compute/v2.1/servers/a49437df-3059-4528-8328-2f3471d5fb45/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 17 03:32:41.126220 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-4cf76a85-0a1e-4eb3-bc85-d1723af9562c tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80763e09d44c475ea2425b22874e9612', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fef02a1dd77946a2ac0e0414b557435f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:32:41.134421 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-4cf76a85-0a1e-4eb3-bc85-d1723af9562c tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] 10.222.0.11 "GET /compute/v2.1/servers/5ddbfaaa-fabf-4324-941c-8868625ffefc" status: 200 len: 1226 microversion: 2.1 time: 0.080554 Nov 17 03:32:41.134988 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 740/1448] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:32:41 2021] GET /compute/v2.1/servers/5ddbfaaa-fabf-4324-941c-8868625ffefc => generated 1226 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:32:41.776819 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-29343778-42eb-487a-a4ab-bea4b8144caa tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:32:41.778317 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-29343778-42eb-487a-a4ab-bea4b8144caa tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] [instance: 5d54db85-b991-4890-abaa-952413baa2e7] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:32:41.788531 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-29343778-42eb-487a-a4ab-bea4b8144caa tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:32:41.789330 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-29343778-42eb-487a-a4ab-bea4b8144caa tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:32:41.790602 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-29343778-42eb-487a-a4ab-bea4b8144caa tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:32:41.791321 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-29343778-42eb-487a-a4ab-bea4b8144caa tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:32:41.824217 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-29343778-42eb-487a-a4ab-bea4b8144caa tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] 10.222.0.11 "GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.053971 Nov 17 03:32:41.824769 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 709/1449] 10.222.0.11 () {60 vars in 1342 bytes} [Wed Nov 17 03:32:41 2021] GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 17 03:32:41.876577 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-e6245fce-c16e-44ca-901f-c0029c1c4ac9 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:32:41.877198 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-e6245fce-c16e-44ca-901f-c0029c1c4ac9 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] [instance: 0698dc5b-5f47-46c4-ace8-f5e891a964a0] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:32:41.885367 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-e6245fce-c16e-44ca-901f-c0029c1c4ac9 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:32:41.885846 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-e6245fce-c16e-44ca-901f-c0029c1c4ac9 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:32:41.886782 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-e6245fce-c16e-44ca-901f-c0029c1c4ac9 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:32:41.887312 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-e6245fce-c16e-44ca-901f-c0029c1c4ac9 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:32:42.042487 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-e6245fce-c16e-44ca-901f-c0029c1c4ac9 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '163b2f24a72649ac8084be1cac32fa09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e123e9b86124c93a7fc2db9984e7466', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:32:42.052035 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-e6245fce-c16e-44ca-901f-c0029c1c4ac9 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] 10.222.0.11 "GET /compute/v2.1/servers/0698dc5b-5f47-46c4-ace8-f5e891a964a0" status: 200 len: 1565 microversion: 2.1 time: 0.180452 Nov 17 03:32:42.052614 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 741/1450] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:32:41 2021] GET /compute/v2.1/servers/0698dc5b-5f47-46c4-ace8-f5e891a964a0 => generated 1565 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:32:42.090485 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-c9cd74c4-aaf0-467a-a95b-7df48008cd88 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:32:42.091391 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-c9cd74c4-aaf0-467a-a95b-7df48008cd88 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] [instance: a49437df-3059-4528-8328-2f3471d5fb45] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:32:42.098029 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-c9cd74c4-aaf0-467a-a95b-7df48008cd88 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:32:42.098473 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-c9cd74c4-aaf0-467a-a95b-7df48008cd88 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:32:42.099235 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-c9cd74c4-aaf0-467a-a95b-7df48008cd88 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:32:42.099662 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-c9cd74c4-aaf0-467a-a95b-7df48008cd88 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:32:42.128064 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-c9cd74c4-aaf0-467a-a95b-7df48008cd88 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] 10.222.0.11 "GET /compute/v2.1/servers/a49437df-3059-4528-8328-2f3471d5fb45/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041357 Nov 17 03:32:42.128611 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 710/1451] 10.222.0.11 () {58 vars in 1301 bytes} [Wed Nov 17 03:32:42 2021] GET /compute/v2.1/servers/a49437df-3059-4528-8328-2f3471d5fb45/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 17 03:32:42.154279 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-2fd11032-a963-4c7c-a16d-178b5a8f9966 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:32:42.155135 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-2fd11032-a963-4c7c-a16d-178b5a8f9966 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] [instance: 5ddbfaaa-fabf-4324-941c-8868625ffefc] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:32:42.161919 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-2fd11032-a963-4c7c-a16d-178b5a8f9966 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:32:42.162368 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-2fd11032-a963-4c7c-a16d-178b5a8f9966 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:32:42.163141 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-2fd11032-a963-4c7c-a16d-178b5a8f9966 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:32:42.163578 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-2fd11032-a963-4c7c-a16d-178b5a8f9966 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:32:42.231078 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-2fd11032-a963-4c7c-a16d-178b5a8f9966 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80763e09d44c475ea2425b22874e9612', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fef02a1dd77946a2ac0e0414b557435f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:32:42.238981 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-2fd11032-a963-4c7c-a16d-178b5a8f9966 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] 10.222.0.11 "GET /compute/v2.1/servers/5ddbfaaa-fabf-4324-941c-8868625ffefc" status: 200 len: 1226 microversion: 2.1 time: 0.090758 Nov 17 03:32:42.239486 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 742/1452] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:32:42 2021] GET /compute/v2.1/servers/5ddbfaaa-fabf-4324-941c-8868625ffefc => generated 1226 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:32:42.840558 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-484d7ab1-dee2-48f5-a8b1-9bc85e1c7703 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:32:42.842126 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-484d7ab1-dee2-48f5-a8b1-9bc85e1c7703 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] [instance: 5d54db85-b991-4890-abaa-952413baa2e7] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:32:42.849384 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-484d7ab1-dee2-48f5-a8b1-9bc85e1c7703 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:32:42.849832 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-484d7ab1-dee2-48f5-a8b1-9bc85e1c7703 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:32:42.850602 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-484d7ab1-dee2-48f5-a8b1-9bc85e1c7703 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:32:42.851032 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-484d7ab1-dee2-48f5-a8b1-9bc85e1c7703 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:32:42.882062 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-484d7ab1-dee2-48f5-a8b1-9bc85e1c7703 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] 10.222.0.11 "GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.048035 Nov 17 03:32:42.882616 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 711/1453] 10.222.0.11 () {60 vars in 1342 bytes} [Wed Nov 17 03:32:42 2021] GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 17 03:32:43.070382 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-fd4dd9df-7cbd-46ff-842d-584f72a3d311 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:32:43.070988 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-fd4dd9df-7cbd-46ff-842d-584f72a3d311 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] [instance: 0698dc5b-5f47-46c4-ace8-f5e891a964a0] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:32:43.077806 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-fd4dd9df-7cbd-46ff-842d-584f72a3d311 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:32:43.078467 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-fd4dd9df-7cbd-46ff-842d-584f72a3d311 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:32:43.079246 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-fd4dd9df-7cbd-46ff-842d-584f72a3d311 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:32:43.079683 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-fd4dd9df-7cbd-46ff-842d-584f72a3d311 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:32:43.141809 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-fe287b71-a81f-4ef9-8ea0-a01327658c44 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:32:43.142585 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-fe287b71-a81f-4ef9-8ea0-a01327658c44 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] [instance: a49437df-3059-4528-8328-2f3471d5fb45] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:32:43.148906 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-fe287b71-a81f-4ef9-8ea0-a01327658c44 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:32:43.149381 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-fe287b71-a81f-4ef9-8ea0-a01327658c44 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:32:43.150363 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-fe287b71-a81f-4ef9-8ea0-a01327658c44 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:32:43.150790 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-fe287b71-a81f-4ef9-8ea0-a01327658c44 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:32:43.181541 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-fe287b71-a81f-4ef9-8ea0-a01327658c44 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] 10.222.0.11 "GET /compute/v2.1/servers/a49437df-3059-4528-8328-2f3471d5fb45/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043647 Nov 17 03:32:43.182105 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 712/1454] 10.222.0.11 () {58 vars in 1301 bytes} [Wed Nov 17 03:32:43 2021] GET /compute/v2.1/servers/a49437df-3059-4528-8328-2f3471d5fb45/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 17 03:32:43.215309 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-fd4dd9df-7cbd-46ff-842d-584f72a3d311 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '163b2f24a72649ac8084be1cac32fa09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e123e9b86124c93a7fc2db9984e7466', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:32:43.222857 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-fd4dd9df-7cbd-46ff-842d-584f72a3d311 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] 10.222.0.11 "GET /compute/v2.1/servers/0698dc5b-5f47-46c4-ace8-f5e891a964a0" status: 200 len: 1565 microversion: 2.1 time: 0.156257 Nov 17 03:32:43.223412 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 743/1455] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:32:43 2021] GET /compute/v2.1/servers/0698dc5b-5f47-46c4-ace8-f5e891a964a0 => generated 1565 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:32:43.257628 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-13952757-fbd2-4918-9dd4-bec4ec21a148 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:32:43.258452 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-13952757-fbd2-4918-9dd4-bec4ec21a148 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] [instance: 5ddbfaaa-fabf-4324-941c-8868625ffefc] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:32:43.266842 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-13952757-fbd2-4918-9dd4-bec4ec21a148 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:32:43.267324 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-13952757-fbd2-4918-9dd4-bec4ec21a148 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:32:43.268091 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-13952757-fbd2-4918-9dd4-bec4ec21a148 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:32:43.268518 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-13952757-fbd2-4918-9dd4-bec4ec21a148 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:32:43.329740 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-13952757-fbd2-4918-9dd4-bec4ec21a148 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80763e09d44c475ea2425b22874e9612', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fef02a1dd77946a2ac0e0414b557435f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:32:43.338671 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-13952757-fbd2-4918-9dd4-bec4ec21a148 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] 10.222.0.11 "GET /compute/v2.1/servers/5ddbfaaa-fabf-4324-941c-8868625ffefc" status: 200 len: 1226 microversion: 2.1 time: 0.086629 Nov 17 03:32:43.339883 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 713/1456] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:32:43 2021] GET /compute/v2.1/servers/5ddbfaaa-fabf-4324-941c-8868625ffefc => generated 1226 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:32:43.899992 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-16775bc4-81a7-43f8-8ade-3f8dd88cc4e8 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:32:43.901525 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-16775bc4-81a7-43f8-8ade-3f8dd88cc4e8 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] [instance: 5d54db85-b991-4890-abaa-952413baa2e7] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:32:43.909659 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-16775bc4-81a7-43f8-8ade-3f8dd88cc4e8 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:32:43.910114 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-16775bc4-81a7-43f8-8ade-3f8dd88cc4e8 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:32:43.910892 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-16775bc4-81a7-43f8-8ade-3f8dd88cc4e8 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:32:43.911330 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-16775bc4-81a7-43f8-8ade-3f8dd88cc4e8 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:32:43.941636 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-16775bc4-81a7-43f8-8ade-3f8dd88cc4e8 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] 10.222.0.11 "GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.048035 Nov 17 03:32:43.942158 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 744/1457] 10.222.0.11 () {60 vars in 1342 bytes} [Wed Nov 17 03:32:43 2021] GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 17 03:32:44.197570 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-3a5dc464-c462-418d-9bf3-5e1f1f662b6f tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:32:44.198957 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-3a5dc464-c462-418d-9bf3-5e1f1f662b6f tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] [instance: a49437df-3059-4528-8328-2f3471d5fb45] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:32:44.207315 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-3a5dc464-c462-418d-9bf3-5e1f1f662b6f tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:32:44.207756 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-3a5dc464-c462-418d-9bf3-5e1f1f662b6f tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:32:44.208517 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-3a5dc464-c462-418d-9bf3-5e1f1f662b6f tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:32:44.208985 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-3a5dc464-c462-418d-9bf3-5e1f1f662b6f tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:32:44.238471 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-3a5dc464-c462-418d-9bf3-5e1f1f662b6f tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] 10.222.0.11 "GET /compute/v2.1/servers/a49437df-3059-4528-8328-2f3471d5fb45/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047369 Nov 17 03:32:44.239028 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 714/1458] 10.222.0.11 () {58 vars in 1301 bytes} [Wed Nov 17 03:32:44 2021] GET /compute/v2.1/servers/a49437df-3059-4528-8328-2f3471d5fb45/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 17 03:32:44.239645 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-ad3597da-e101-4cc6-88af-bca211434091 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:32:44.240235 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-ad3597da-e101-4cc6-88af-bca211434091 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] [instance: 0698dc5b-5f47-46c4-ace8-f5e891a964a0] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:32:44.246976 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-ad3597da-e101-4cc6-88af-bca211434091 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:32:44.247417 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-ad3597da-e101-4cc6-88af-bca211434091 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:32:44.248162 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-ad3597da-e101-4cc6-88af-bca211434091 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:32:44.248586 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-ad3597da-e101-4cc6-88af-bca211434091 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:32:44.356360 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-c6a0ed51-5037-4e1b-99e2-e35de4d20b7c tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:32:44.356998 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-c6a0ed51-5037-4e1b-99e2-e35de4d20b7c tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] [instance: 5ddbfaaa-fabf-4324-941c-8868625ffefc] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:32:44.363126 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-c6a0ed51-5037-4e1b-99e2-e35de4d20b7c tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:32:44.363563 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-c6a0ed51-5037-4e1b-99e2-e35de4d20b7c tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:32:44.364324 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-c6a0ed51-5037-4e1b-99e2-e35de4d20b7c tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:32:44.364755 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-c6a0ed51-5037-4e1b-99e2-e35de4d20b7c tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:32:44.389333 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-ad3597da-e101-4cc6-88af-bca211434091 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '163b2f24a72649ac8084be1cac32fa09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e123e9b86124c93a7fc2db9984e7466', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:32:44.397194 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-ad3597da-e101-4cc6-88af-bca211434091 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] 10.222.0.11 "GET /compute/v2.1/servers/0698dc5b-5f47-46c4-ace8-f5e891a964a0" status: 200 len: 1565 microversion: 2.1 time: 0.161259 Nov 17 03:32:44.397737 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 745/1459] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:32:44 2021] GET /compute/v2.1/servers/0698dc5b-5f47-46c4-ace8-f5e891a964a0 => generated 1565 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:32:44.424304 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-c6a0ed51-5037-4e1b-99e2-e35de4d20b7c tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80763e09d44c475ea2425b22874e9612', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fef02a1dd77946a2ac0e0414b557435f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:32:44.432364 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-c6a0ed51-5037-4e1b-99e2-e35de4d20b7c tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] 10.222.0.11 "GET /compute/v2.1/servers/5ddbfaaa-fabf-4324-941c-8868625ffefc" status: 200 len: 1226 microversion: 2.1 time: 0.079724 Nov 17 03:32:44.433103 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 715/1460] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:32:44 2021] GET /compute/v2.1/servers/5ddbfaaa-fabf-4324-941c-8868625ffefc => generated 1226 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 17 03:32:44.957020 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-bc6d2e6a-bfd1-422d-ac35-784e33ad3671 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:32:44.958218 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-bc6d2e6a-bfd1-422d-ac35-784e33ad3671 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] [instance: 5d54db85-b991-4890-abaa-952413baa2e7] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:32:44.966465 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-bc6d2e6a-bfd1-422d-ac35-784e33ad3671 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:32:44.967069 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-bc6d2e6a-bfd1-422d-ac35-784e33ad3671 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:32:44.968106 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-bc6d2e6a-bfd1-422d-ac35-784e33ad3671 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:32:44.968731 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-bc6d2e6a-bfd1-422d-ac35-784e33ad3671 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:32:45.002036 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-bc6d2e6a-bfd1-422d-ac35-784e33ad3671 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] 10.222.0.11 "GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.050831 Nov 17 03:32:45.002589 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 746/1461] 10.222.0.11 () {60 vars in 1342 bytes} [Wed Nov 17 03:32:44 2021] GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 17 03:32:45.254269 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-7b922589-47a6-4ed0-b496-c9e06f18d97c tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:32:45.255754 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-7b922589-47a6-4ed0-b496-c9e06f18d97c tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] [instance: a49437df-3059-4528-8328-2f3471d5fb45] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:32:45.266171 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-7b922589-47a6-4ed0-b496-c9e06f18d97c tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:32:45.266907 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-7b922589-47a6-4ed0-b496-c9e06f18d97c tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:32:45.268172 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-7b922589-47a6-4ed0-b496-c9e06f18d97c tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:32:45.268987 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-7b922589-47a6-4ed0-b496-c9e06f18d97c tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:32:45.303253 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-7b922589-47a6-4ed0-b496-c9e06f18d97c tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] 10.222.0.11 "GET /compute/v2.1/servers/a49437df-3059-4528-8328-2f3471d5fb45/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.055583 Nov 17 03:32:45.303804 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 716/1462] 10.222.0.11 () {58 vars in 1301 bytes} [Wed Nov 17 03:32:45 2021] GET /compute/v2.1/servers/a49437df-3059-4528-8328-2f3471d5fb45/os-volume_attachments => generated 197 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 17 03:32:45.416915 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-08cb6863-c4b6-4d3f-a9c8-a913051bd5f9 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:32:45.417871 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-08cb6863-c4b6-4d3f-a9c8-a913051bd5f9 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] [instance: 0698dc5b-5f47-46c4-ace8-f5e891a964a0] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:32:45.425982 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-08cb6863-c4b6-4d3f-a9c8-a913051bd5f9 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:32:45.426431 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-08cb6863-c4b6-4d3f-a9c8-a913051bd5f9 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:32:45.427209 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-08cb6863-c4b6-4d3f-a9c8-a913051bd5f9 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:32:45.427671 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-08cb6863-c4b6-4d3f-a9c8-a913051bd5f9 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:32:45.449636 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-96c762b2-1c67-4ec7-9be3-76f5fe693604 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:32:45.450239 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-96c762b2-1c67-4ec7-9be3-76f5fe693604 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] [instance: 5ddbfaaa-fabf-4324-941c-8868625ffefc] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:32:45.456809 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-96c762b2-1c67-4ec7-9be3-76f5fe693604 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:32:45.457276 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-96c762b2-1c67-4ec7-9be3-76f5fe693604 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:32:45.458048 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-96c762b2-1c67-4ec7-9be3-76f5fe693604 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:32:45.458473 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-96c762b2-1c67-4ec7-9be3-76f5fe693604 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:32:45.518083 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-96c762b2-1c67-4ec7-9be3-76f5fe693604 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80763e09d44c475ea2425b22874e9612', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fef02a1dd77946a2ac0e0414b557435f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:32:45.525822 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-96c762b2-1c67-4ec7-9be3-76f5fe693604 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] 10.222.0.11 "GET /compute/v2.1/servers/5ddbfaaa-fabf-4324-941c-8868625ffefc" status: 200 len: 1226 microversion: 2.1 time: 0.079966 Nov 17 03:32:45.526439 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 717/1463] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:32:45 2021] GET /compute/v2.1/servers/5ddbfaaa-fabf-4324-941c-8868625ffefc => generated 1226 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:32:45.564454 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-08cb6863-c4b6-4d3f-a9c8-a913051bd5f9 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '163b2f24a72649ac8084be1cac32fa09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e123e9b86124c93a7fc2db9984e7466', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:32:45.572344 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-08cb6863-c4b6-4d3f-a9c8-a913051bd5f9 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] 10.222.0.11 "GET /compute/v2.1/servers/0698dc5b-5f47-46c4-ace8-f5e891a964a0" status: 200 len: 1565 microversion: 2.1 time: 0.161075 Nov 17 03:32:45.572941 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 747/1464] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:32:45 2021] GET /compute/v2.1/servers/0698dc5b-5f47-46c4-ace8-f5e891a964a0 => generated 1565 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:32:46.017908 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-1aa7dd6d-66ab-4e2b-bca7-aca1b055cbb2 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:32:46.019364 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-1aa7dd6d-66ab-4e2b-bca7-aca1b055cbb2 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] [instance: 5d54db85-b991-4890-abaa-952413baa2e7] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:32:46.029702 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-1aa7dd6d-66ab-4e2b-bca7-aca1b055cbb2 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:32:46.030434 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-1aa7dd6d-66ab-4e2b-bca7-aca1b055cbb2 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:32:46.031446 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-1aa7dd6d-66ab-4e2b-bca7-aca1b055cbb2 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:32:46.031869 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-1aa7dd6d-66ab-4e2b-bca7-aca1b055cbb2 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:32:46.061484 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-1aa7dd6d-66ab-4e2b-bca7-aca1b055cbb2 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] 10.222.0.11 "GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.049973 Nov 17 03:32:46.062161 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 718/1465] 10.222.0.11 () {60 vars in 1342 bytes} [Wed Nov 17 03:32:46 2021] GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 17 03:32:46.318411 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-6e045186-5be9-4371-9efc-5f9cfa7a2478 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:32:46.319549 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-6e045186-5be9-4371-9efc-5f9cfa7a2478 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] [instance: a49437df-3059-4528-8328-2f3471d5fb45] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:32:46.328267 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-6e045186-5be9-4371-9efc-5f9cfa7a2478 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:32:46.328702 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-6e045186-5be9-4371-9efc-5f9cfa7a2478 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:32:46.329499 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-6e045186-5be9-4371-9efc-5f9cfa7a2478 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:32:46.329920 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-6e045186-5be9-4371-9efc-5f9cfa7a2478 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:32:46.359474 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-6e045186-5be9-4371-9efc-5f9cfa7a2478 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] 10.222.0.11 "GET /compute/v2.1/servers/a49437df-3059-4528-8328-2f3471d5fb45/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046614 Nov 17 03:32:46.360044 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 748/1466] 10.222.0.11 () {58 vars in 1301 bytes} [Wed Nov 17 03:32:46 2021] GET /compute/v2.1/servers/a49437df-3059-4528-8328-2f3471d5fb45/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 17 03:32:46.546005 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-6f5ad01d-4fd8-4eb6-a69e-abc6ed606fae tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:32:46.547161 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-6f5ad01d-4fd8-4eb6-a69e-abc6ed606fae tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] [instance: 5ddbfaaa-fabf-4324-941c-8868625ffefc] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:32:46.557642 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-6f5ad01d-4fd8-4eb6-a69e-abc6ed606fae tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:32:46.558331 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-6f5ad01d-4fd8-4eb6-a69e-abc6ed606fae tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:32:46.559498 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-6f5ad01d-4fd8-4eb6-a69e-abc6ed606fae tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:32:46.560162 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-6f5ad01d-4fd8-4eb6-a69e-abc6ed606fae tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:32:46.591406 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-e413d041-2c74-43d0-b502-80bc678227fe tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:32:46.591953 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-e413d041-2c74-43d0-b502-80bc678227fe tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] [instance: 0698dc5b-5f47-46c4-ace8-f5e891a964a0] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:32:46.598763 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-e413d041-2c74-43d0-b502-80bc678227fe tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:32:46.599307 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-e413d041-2c74-43d0-b502-80bc678227fe tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:32:46.600140 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-e413d041-2c74-43d0-b502-80bc678227fe tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:32:46.600635 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-e413d041-2c74-43d0-b502-80bc678227fe tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:32:46.619903 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-6f5ad01d-4fd8-4eb6-a69e-abc6ed606fae tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80763e09d44c475ea2425b22874e9612', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fef02a1dd77946a2ac0e0414b557435f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:32:46.627731 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-6f5ad01d-4fd8-4eb6-a69e-abc6ed606fae tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] 10.222.0.11 "GET /compute/v2.1/servers/5ddbfaaa-fabf-4324-941c-8868625ffefc" status: 200 len: 1226 microversion: 2.1 time: 0.087608 Nov 17 03:32:46.628305 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 719/1467] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:32:46 2021] GET /compute/v2.1/servers/5ddbfaaa-fabf-4324-941c-8868625ffefc => generated 1226 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:32:46.741385 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-e413d041-2c74-43d0-b502-80bc678227fe tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '163b2f24a72649ac8084be1cac32fa09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e123e9b86124c93a7fc2db9984e7466', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:32:46.752818 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-e413d041-2c74-43d0-b502-80bc678227fe tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] 10.222.0.11 "GET /compute/v2.1/servers/0698dc5b-5f47-46c4-ace8-f5e891a964a0" status: 200 len: 1565 microversion: 2.1 time: 0.165157 Nov 17 03:32:46.753494 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 749/1468] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:32:46 2021] GET /compute/v2.1/servers/0698dc5b-5f47-46c4-ace8-f5e891a964a0 => generated 1565 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:32:47.077552 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-95abf7ba-55f5-48d6-b9db-461552252430 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:32:47.079020 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-95abf7ba-55f5-48d6-b9db-461552252430 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] [instance: 5d54db85-b991-4890-abaa-952413baa2e7] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:32:47.086095 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-95abf7ba-55f5-48d6-b9db-461552252430 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:32:47.086545 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-95abf7ba-55f5-48d6-b9db-461552252430 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:32:47.087327 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-95abf7ba-55f5-48d6-b9db-461552252430 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:32:47.087758 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-95abf7ba-55f5-48d6-b9db-461552252430 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:32:47.118101 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-95abf7ba-55f5-48d6-b9db-461552252430 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] 10.222.0.11 "GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047138 Nov 17 03:32:47.118645 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 720/1469] 10.222.0.11 () {60 vars in 1342 bytes} [Wed Nov 17 03:32:47 2021] GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 17 03:32:47.375364 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-3159ff5c-ec76-4b77-a8b2-45b167838352 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:32:47.376810 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-3159ff5c-ec76-4b77-a8b2-45b167838352 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] [instance: a49437df-3059-4528-8328-2f3471d5fb45] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:32:47.383103 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-3159ff5c-ec76-4b77-a8b2-45b167838352 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:32:47.383548 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-3159ff5c-ec76-4b77-a8b2-45b167838352 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:32:47.384314 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-3159ff5c-ec76-4b77-a8b2-45b167838352 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:32:47.384742 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-3159ff5c-ec76-4b77-a8b2-45b167838352 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:32:47.414036 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-3159ff5c-ec76-4b77-a8b2-45b167838352 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] 10.222.0.11 "GET /compute/v2.1/servers/a49437df-3059-4528-8328-2f3471d5fb45/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045129 Nov 17 03:32:47.414588 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 750/1470] 10.222.0.11 () {58 vars in 1301 bytes} [Wed Nov 17 03:32:47 2021] GET /compute/v2.1/servers/a49437df-3059-4528-8328-2f3471d5fb45/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 17 03:32:47.648885 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-b916e4ec-ae10-4c60-81c5-962a29f3d266 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:32:47.649878 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-b916e4ec-ae10-4c60-81c5-962a29f3d266 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] [instance: 5ddbfaaa-fabf-4324-941c-8868625ffefc] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:32:47.660460 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-b916e4ec-ae10-4c60-81c5-962a29f3d266 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:32:47.661250 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-b916e4ec-ae10-4c60-81c5-962a29f3d266 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:32:47.662510 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-b916e4ec-ae10-4c60-81c5-962a29f3d266 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:32:47.663216 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-b916e4ec-ae10-4c60-81c5-962a29f3d266 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:32:47.770712 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-48c441e5-2ba1-4662-ad6c-852735749f07 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:32:47.771354 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-48c441e5-2ba1-4662-ad6c-852735749f07 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] [instance: 0698dc5b-5f47-46c4-ace8-f5e891a964a0] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:32:47.778176 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-48c441e5-2ba1-4662-ad6c-852735749f07 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:32:47.778626 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-48c441e5-2ba1-4662-ad6c-852735749f07 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:32:47.779409 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-48c441e5-2ba1-4662-ad6c-852735749f07 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:32:47.779837 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-48c441e5-2ba1-4662-ad6c-852735749f07 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:32:47.920599 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-48c441e5-2ba1-4662-ad6c-852735749f07 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '163b2f24a72649ac8084be1cac32fa09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e123e9b86124c93a7fc2db9984e7466', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:32:47.928264 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-48c441e5-2ba1-4662-ad6c-852735749f07 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] 10.222.0.11 "GET /compute/v2.1/servers/0698dc5b-5f47-46c4-ace8-f5e891a964a0" status: 200 len: 1565 microversion: 2.1 time: 0.161374 Nov 17 03:32:47.928864 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 751/1471] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:32:47 2021] GET /compute/v2.1/servers/0698dc5b-5f47-46c4-ace8-f5e891a964a0 => generated 1565 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:32:47.969173 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-b916e4ec-ae10-4c60-81c5-962a29f3d266 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80763e09d44c475ea2425b22874e9612', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fef02a1dd77946a2ac0e0414b557435f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:32:47.980978 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-b916e4ec-ae10-4c60-81c5-962a29f3d266 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] 10.222.0.11 "GET /compute/v2.1/servers/5ddbfaaa-fabf-4324-941c-8868625ffefc" status: 200 len: 1226 microversion: 2.1 time: 0.338362 Nov 17 03:32:47.981725 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 721/1472] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:32:47 2021] GET /compute/v2.1/servers/5ddbfaaa-fabf-4324-941c-8868625ffefc => generated 1226 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:32:48.134341 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-83796763-ef4a-4d09-a2df-f5afc143cb25 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:32:48.135813 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-83796763-ef4a-4d09-a2df-f5afc143cb25 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] [instance: 5d54db85-b991-4890-abaa-952413baa2e7] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:32:48.145937 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-83796763-ef4a-4d09-a2df-f5afc143cb25 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:32:48.146706 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-83796763-ef4a-4d09-a2df-f5afc143cb25 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:32:48.148005 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-83796763-ef4a-4d09-a2df-f5afc143cb25 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:32:48.148650 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-83796763-ef4a-4d09-a2df-f5afc143cb25 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:32:48.181097 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-83796763-ef4a-4d09-a2df-f5afc143cb25 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] 10.222.0.11 "GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.053305 Nov 17 03:32:48.181627 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 752/1473] 10.222.0.11 () {60 vars in 1342 bytes} [Wed Nov 17 03:32:48 2021] GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 17 03:32:48.437706 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-b9572f06-8825-4995-a365-6d6cc5797068 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:32:48.439379 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-b9572f06-8825-4995-a365-6d6cc5797068 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] [instance: a49437df-3059-4528-8328-2f3471d5fb45] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:32:48.449411 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-b9572f06-8825-4995-a365-6d6cc5797068 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:32:48.450145 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-b9572f06-8825-4995-a365-6d6cc5797068 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:32:48.451472 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-b9572f06-8825-4995-a365-6d6cc5797068 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:32:48.452174 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-b9572f06-8825-4995-a365-6d6cc5797068 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:32:48.482557 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-b9572f06-8825-4995-a365-6d6cc5797068 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] 10.222.0.11 "GET /compute/v2.1/servers/a49437df-3059-4528-8328-2f3471d5fb45/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.058033 Nov 17 03:32:48.483096 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 722/1474] 10.222.0.11 () {58 vars in 1301 bytes} [Wed Nov 17 03:32:48 2021] GET /compute/v2.1/servers/a49437df-3059-4528-8328-2f3471d5fb45/os-volume_attachments => generated 197 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 17 03:32:48.947920 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-285b8a29-cb83-4c61-a491-f158c1b3a967 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:32:48.948642 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-285b8a29-cb83-4c61-a491-f158c1b3a967 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] [instance: 0698dc5b-5f47-46c4-ace8-f5e891a964a0] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:32:48.956663 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-285b8a29-cb83-4c61-a491-f158c1b3a967 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:32:48.957356 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-285b8a29-cb83-4c61-a491-f158c1b3a967 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:32:48.958275 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-285b8a29-cb83-4c61-a491-f158c1b3a967 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:32:48.958783 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-285b8a29-cb83-4c61-a491-f158c1b3a967 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:32:48.997841 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-56112fa9-2e00-4562-90b0-89b8e61f70cb tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:32:48.998436 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-56112fa9-2e00-4562-90b0-89b8e61f70cb tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] [instance: 5ddbfaaa-fabf-4324-941c-8868625ffefc] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:32:49.005619 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-56112fa9-2e00-4562-90b0-89b8e61f70cb tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:32:49.006069 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-56112fa9-2e00-4562-90b0-89b8e61f70cb tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:32:49.006875 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-56112fa9-2e00-4562-90b0-89b8e61f70cb tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:32:49.007300 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-56112fa9-2e00-4562-90b0-89b8e61f70cb tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:32:49.070413 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-56112fa9-2e00-4562-90b0-89b8e61f70cb tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80763e09d44c475ea2425b22874e9612', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fef02a1dd77946a2ac0e0414b557435f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:32:49.077938 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-56112fa9-2e00-4562-90b0-89b8e61f70cb tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] 10.222.0.11 "GET /compute/v2.1/servers/5ddbfaaa-fabf-4324-941c-8868625ffefc" status: 200 len: 1226 microversion: 2.1 time: 0.083764 Nov 17 03:32:49.078518 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 723/1475] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:32:48 2021] GET /compute/v2.1/servers/5ddbfaaa-fabf-4324-941c-8868625ffefc => generated 1226 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:32:49.100269 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-285b8a29-cb83-4c61-a491-f158c1b3a967 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '163b2f24a72649ac8084be1cac32fa09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e123e9b86124c93a7fc2db9984e7466', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:32:49.108312 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-285b8a29-cb83-4c61-a491-f158c1b3a967 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] 10.222.0.11 "GET /compute/v2.1/servers/0698dc5b-5f47-46c4-ace8-f5e891a964a0" status: 200 len: 1565 microversion: 2.1 time: 0.164780 Nov 17 03:32:49.108906 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 753/1476] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:32:48 2021] GET /compute/v2.1/servers/0698dc5b-5f47-46c4-ace8-f5e891a964a0 => generated 1565 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:32:49.197197 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-e85a9c51-af12-4eb0-ba23-99b934ff0356 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:32:49.198788 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-e85a9c51-af12-4eb0-ba23-99b934ff0356 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] [instance: 5d54db85-b991-4890-abaa-952413baa2e7] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:32:49.207933 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-e85a9c51-af12-4eb0-ba23-99b934ff0356 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:32:49.208377 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-e85a9c51-af12-4eb0-ba23-99b934ff0356 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:32:49.209181 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-e85a9c51-af12-4eb0-ba23-99b934ff0356 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:32:49.209613 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-e85a9c51-af12-4eb0-ba23-99b934ff0356 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:32:49.238294 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-e85a9c51-af12-4eb0-ba23-99b934ff0356 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] 10.222.0.11 "GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047781 Nov 17 03:32:49.238926 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 724/1477] 10.222.0.11 () {60 vars in 1342 bytes} [Wed Nov 17 03:32:49 2021] GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 17 03:32:49.495746 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-41b50f91-ad78-4fbb-8e20-e9f3be68050d tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:32:49.496558 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-41b50f91-ad78-4fbb-8e20-e9f3be68050d tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] [instance: a49437df-3059-4528-8328-2f3471d5fb45] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:32:49.503433 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-41b50f91-ad78-4fbb-8e20-e9f3be68050d tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:32:49.503880 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-41b50f91-ad78-4fbb-8e20-e9f3be68050d tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:32:49.504642 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-41b50f91-ad78-4fbb-8e20-e9f3be68050d tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:32:49.505096 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-41b50f91-ad78-4fbb-8e20-e9f3be68050d tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:32:49.685536 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-41b50f91-ad78-4fbb-8e20-e9f3be68050d tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] 10.222.0.11 "GET /compute/v2.1/servers/a49437df-3059-4528-8328-2f3471d5fb45/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.193700 Nov 17 03:32:49.686084 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 754/1478] 10.222.0.11 () {58 vars in 1301 bytes} [Wed Nov 17 03:32:49 2021] GET /compute/v2.1/servers/a49437df-3059-4528-8328-2f3471d5fb45/os-volume_attachments => generated 197 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 17 03:32:50.095607 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-15f71782-1bc2-4a68-a697-9d87d8dffca9 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:32:50.096222 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-15f71782-1bc2-4a68-a697-9d87d8dffca9 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] [instance: 5ddbfaaa-fabf-4324-941c-8868625ffefc] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:32:50.103217 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-15f71782-1bc2-4a68-a697-9d87d8dffca9 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:32:50.103674 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-15f71782-1bc2-4a68-a697-9d87d8dffca9 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:32:50.104448 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-15f71782-1bc2-4a68-a697-9d87d8dffca9 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:32:50.104919 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-15f71782-1bc2-4a68-a697-9d87d8dffca9 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:32:50.125016 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-b7999f66-95e3-4f7d-ab91-ad2634c3c18d tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:32:50.125716 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-b7999f66-95e3-4f7d-ab91-ad2634c3c18d tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] [instance: 0698dc5b-5f47-46c4-ace8-f5e891a964a0] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:32:50.132512 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-b7999f66-95e3-4f7d-ab91-ad2634c3c18d tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:32:50.132991 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-b7999f66-95e3-4f7d-ab91-ad2634c3c18d tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:32:50.133759 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-b7999f66-95e3-4f7d-ab91-ad2634c3c18d tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:32:50.134206 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-b7999f66-95e3-4f7d-ab91-ad2634c3c18d tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:32:50.164443 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-15f71782-1bc2-4a68-a697-9d87d8dffca9 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80763e09d44c475ea2425b22874e9612', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fef02a1dd77946a2ac0e0414b557435f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:32:50.171991 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-15f71782-1bc2-4a68-a697-9d87d8dffca9 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] 10.222.0.11 "GET /compute/v2.1/servers/5ddbfaaa-fabf-4324-941c-8868625ffefc" status: 200 len: 1226 microversion: 2.1 time: 0.080129 Nov 17 03:32:50.172536 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 725/1479] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:32:50 2021] GET /compute/v2.1/servers/5ddbfaaa-fabf-4324-941c-8868625ffefc => generated 1226 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:32:50.250052 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-777b28ca-ba1f-4a6f-a22d-d1bd65f54502 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:32:50.250997 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-777b28ca-ba1f-4a6f-a22d-d1bd65f54502 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] [instance: 5d54db85-b991-4890-abaa-952413baa2e7] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:32:50.257735 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-777b28ca-ba1f-4a6f-a22d-d1bd65f54502 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:32:50.258185 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-777b28ca-ba1f-4a6f-a22d-d1bd65f54502 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:32:50.258965 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-777b28ca-ba1f-4a6f-a22d-d1bd65f54502 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:32:50.259405 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-777b28ca-ba1f-4a6f-a22d-d1bd65f54502 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:32:50.270994 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-b7999f66-95e3-4f7d-ab91-ad2634c3c18d tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '163b2f24a72649ac8084be1cac32fa09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e123e9b86124c93a7fc2db9984e7466', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:32:50.278309 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-b7999f66-95e3-4f7d-ab91-ad2634c3c18d tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] 10.222.0.11 "GET /compute/v2.1/servers/0698dc5b-5f47-46c4-ace8-f5e891a964a0" status: 200 len: 1565 microversion: 2.1 time: 0.157137 Nov 17 03:32:50.278855 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 755/1480] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:32:50 2021] GET /compute/v2.1/servers/0698dc5b-5f47-46c4-ace8-f5e891a964a0 => generated 1565 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:32:50.289773 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-777b28ca-ba1f-4a6f-a22d-d1bd65f54502 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] 10.222.0.11 "GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043535 Nov 17 03:32:50.290333 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 726/1481] 10.222.0.11 () {60 vars in 1342 bytes} [Wed Nov 17 03:32:50 2021] GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 17 03:32:50.701511 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-1428fac9-70b2-4b3b-aef9-39df68fb500d tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:32:50.702987 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-1428fac9-70b2-4b3b-aef9-39df68fb500d tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] [instance: a49437df-3059-4528-8328-2f3471d5fb45] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:32:50.712377 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-1428fac9-70b2-4b3b-aef9-39df68fb500d tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:32:50.712869 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-1428fac9-70b2-4b3b-aef9-39df68fb500d tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:32:50.713639 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-1428fac9-70b2-4b3b-aef9-39df68fb500d tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:32:50.714074 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-1428fac9-70b2-4b3b-aef9-39df68fb500d tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:32:50.743124 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-1428fac9-70b2-4b3b-aef9-39df68fb500d tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] 10.222.0.11 "GET /compute/v2.1/servers/a49437df-3059-4528-8328-2f3471d5fb45/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048107 Nov 17 03:32:50.743649 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 756/1482] 10.222.0.11 () {58 vars in 1301 bytes} [Wed Nov 17 03:32:50 2021] GET /compute/v2.1/servers/a49437df-3059-4528-8328-2f3471d5fb45/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 17 03:32:51.193410 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-5fe4c254-220c-4dfe-8bbf-37caa4883b5c tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:32:51.194068 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-5fe4c254-220c-4dfe-8bbf-37caa4883b5c tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] [instance: 5ddbfaaa-fabf-4324-941c-8868625ffefc] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:32:51.201454 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-5fe4c254-220c-4dfe-8bbf-37caa4883b5c tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:32:51.201950 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-5fe4c254-220c-4dfe-8bbf-37caa4883b5c tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:32:51.202801 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-5fe4c254-220c-4dfe-8bbf-37caa4883b5c tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:32:51.203282 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-5fe4c254-220c-4dfe-8bbf-37caa4883b5c tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:32:51.268105 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-5fe4c254-220c-4dfe-8bbf-37caa4883b5c tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80763e09d44c475ea2425b22874e9612', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fef02a1dd77946a2ac0e0414b557435f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:32:51.275759 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-5fe4c254-220c-4dfe-8bbf-37caa4883b5c tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] 10.222.0.11 "GET /compute/v2.1/servers/5ddbfaaa-fabf-4324-941c-8868625ffefc" status: 200 len: 1226 microversion: 2.1 time: 0.088545 Nov 17 03:32:51.276313 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 727/1483] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:32:51 2021] GET /compute/v2.1/servers/5ddbfaaa-fabf-4324-941c-8868625ffefc => generated 1226 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:32:51.295269 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-073b2207-0c7b-4596-a5ca-d20580c15b25 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:32:51.295850 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-073b2207-0c7b-4596-a5ca-d20580c15b25 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] [instance: 0698dc5b-5f47-46c4-ace8-f5e891a964a0] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:32:51.301069 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-eb950e15-6eb8-4dfa-93b8-28957e9c8ca5 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:32:51.301952 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-eb950e15-6eb8-4dfa-93b8-28957e9c8ca5 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] [instance: 5d54db85-b991-4890-abaa-952413baa2e7] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:32:51.302276 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-073b2207-0c7b-4596-a5ca-d20580c15b25 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:32:51.302886 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-073b2207-0c7b-4596-a5ca-d20580c15b25 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:32:51.303666 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-073b2207-0c7b-4596-a5ca-d20580c15b25 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:32:51.304089 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-073b2207-0c7b-4596-a5ca-d20580c15b25 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:32:51.308696 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-eb950e15-6eb8-4dfa-93b8-28957e9c8ca5 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:32:51.309186 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-eb950e15-6eb8-4dfa-93b8-28957e9c8ca5 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:32:51.310020 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-eb950e15-6eb8-4dfa-93b8-28957e9c8ca5 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:32:51.310405 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-eb950e15-6eb8-4dfa-93b8-28957e9c8ca5 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:32:51.339304 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-eb950e15-6eb8-4dfa-93b8-28957e9c8ca5 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] 10.222.0.11 "GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041831 Nov 17 03:32:51.339881 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 728/1484] 10.222.0.11 () {60 vars in 1342 bytes} [Wed Nov 17 03:32:51 2021] GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 17 03:32:51.437621 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-073b2207-0c7b-4596-a5ca-d20580c15b25 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '163b2f24a72649ac8084be1cac32fa09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e123e9b86124c93a7fc2db9984e7466', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:32:51.449602 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-073b2207-0c7b-4596-a5ca-d20580c15b25 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] 10.222.0.11 "GET /compute/v2.1/servers/0698dc5b-5f47-46c4-ace8-f5e891a964a0" status: 200 len: 1565 microversion: 2.1 time: 0.157703 Nov 17 03:32:51.450325 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 757/1485] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:32:51 2021] GET /compute/v2.1/servers/0698dc5b-5f47-46c4-ace8-f5e891a964a0 => generated 1565 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:32:51.757416 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-b4549c26-b10b-4cf5-84a4-226af90611a6 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:32:51.758335 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-b4549c26-b10b-4cf5-84a4-226af90611a6 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] [instance: a49437df-3059-4528-8328-2f3471d5fb45] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:32:51.764809 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-b4549c26-b10b-4cf5-84a4-226af90611a6 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:32:51.765272 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-b4549c26-b10b-4cf5-84a4-226af90611a6 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:32:51.766040 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-b4549c26-b10b-4cf5-84a4-226af90611a6 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:32:51.766465 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-b4549c26-b10b-4cf5-84a4-226af90611a6 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:32:51.801396 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-b4549c26-b10b-4cf5-84a4-226af90611a6 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] 10.222.0.11 "GET /compute/v2.1/servers/a49437df-3059-4528-8328-2f3471d5fb45/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049943 Nov 17 03:32:51.801950 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 729/1486] 10.222.0.11 () {58 vars in 1301 bytes} [Wed Nov 17 03:32:51 2021] GET /compute/v2.1/servers/a49437df-3059-4528-8328-2f3471d5fb45/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 17 03:32:52.296462 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-c65de155-f957-4e16-9abd-beaec2c44818 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:32:52.297504 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-c65de155-f957-4e16-9abd-beaec2c44818 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] [instance: 5ddbfaaa-fabf-4324-941c-8868625ffefc] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:32:52.306451 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-c65de155-f957-4e16-9abd-beaec2c44818 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:32:52.306900 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-c65de155-f957-4e16-9abd-beaec2c44818 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:32:52.307667 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-c65de155-f957-4e16-9abd-beaec2c44818 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:32:52.308093 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-c65de155-f957-4e16-9abd-beaec2c44818 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:32:52.351146 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-edfc2097-cb59-46ad-b04a-9bc828668747 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:32:52.351961 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-edfc2097-cb59-46ad-b04a-9bc828668747 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] [instance: 5d54db85-b991-4890-abaa-952413baa2e7] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:32:52.358744 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-edfc2097-cb59-46ad-b04a-9bc828668747 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:32:52.359196 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-edfc2097-cb59-46ad-b04a-9bc828668747 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:32:52.359973 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-edfc2097-cb59-46ad-b04a-9bc828668747 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:32:52.360403 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-edfc2097-cb59-46ad-b04a-9bc828668747 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:32:52.368963 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-c65de155-f957-4e16-9abd-beaec2c44818 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80763e09d44c475ea2425b22874e9612', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fef02a1dd77946a2ac0e0414b557435f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:32:52.377312 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-c65de155-f957-4e16-9abd-beaec2c44818 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] 10.222.0.11 "GET /compute/v2.1/servers/5ddbfaaa-fabf-4324-941c-8868625ffefc" status: 200 len: 1226 microversion: 2.1 time: 0.086459 Nov 17 03:32:52.377312 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 758/1487] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:32:52 2021] GET /compute/v2.1/servers/5ddbfaaa-fabf-4324-941c-8868625ffefc => generated 1226 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:32:52.390993 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-edfc2097-cb59-46ad-b04a-9bc828668747 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] 10.222.0.11 "GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043701 Nov 17 03:32:52.391541 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 730/1488] 10.222.0.11 () {60 vars in 1342 bytes} [Wed Nov 17 03:32:52 2021] GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 17 03:32:52.473528 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-8a4a203e-efb5-482e-9b7c-a7931de540ac tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:32:52.474421 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-8a4a203e-efb5-482e-9b7c-a7931de540ac tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] [instance: 0698dc5b-5f47-46c4-ace8-f5e891a964a0] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:32:52.481397 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-8a4a203e-efb5-482e-9b7c-a7931de540ac tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:32:52.481889 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-8a4a203e-efb5-482e-9b7c-a7931de540ac tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:32:52.482742 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-8a4a203e-efb5-482e-9b7c-a7931de540ac tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:32:52.483212 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-8a4a203e-efb5-482e-9b7c-a7931de540ac tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:32:52.627082 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-8a4a203e-efb5-482e-9b7c-a7931de540ac tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '163b2f24a72649ac8084be1cac32fa09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e123e9b86124c93a7fc2db9984e7466', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:32:52.635292 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-8a4a203e-efb5-482e-9b7c-a7931de540ac tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] 10.222.0.11 "GET /compute/v2.1/servers/0698dc5b-5f47-46c4-ace8-f5e891a964a0" status: 200 len: 1565 microversion: 2.1 time: 0.167897 Nov 17 03:32:52.635877 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 759/1489] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:32:52 2021] GET /compute/v2.1/servers/0698dc5b-5f47-46c4-ace8-f5e891a964a0 => generated 1565 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:32:52.817704 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-10cb69f4-90a1-4b92-93ec-924f76130746 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:32:52.819366 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-10cb69f4-90a1-4b92-93ec-924f76130746 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] [instance: a49437df-3059-4528-8328-2f3471d5fb45] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:32:52.829774 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-10cb69f4-90a1-4b92-93ec-924f76130746 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:32:52.830516 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-10cb69f4-90a1-4b92-93ec-924f76130746 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:32:52.831796 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-10cb69f4-90a1-4b92-93ec-924f76130746 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:32:52.832525 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-10cb69f4-90a1-4b92-93ec-924f76130746 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:32:52.862500 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-10cb69f4-90a1-4b92-93ec-924f76130746 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] 10.222.0.11 "GET /compute/v2.1/servers/a49437df-3059-4528-8328-2f3471d5fb45/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051244 Nov 17 03:32:52.863051 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 731/1490] 10.222.0.11 () {58 vars in 1301 bytes} [Wed Nov 17 03:32:52 2021] GET /compute/v2.1/servers/a49437df-3059-4528-8328-2f3471d5fb45/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 17 03:32:53.397854 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-f150e4ec-8f36-478e-bfd7-179b446d46e2 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:32:53.398715 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-f150e4ec-8f36-478e-bfd7-179b446d46e2 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] [instance: 5ddbfaaa-fabf-4324-941c-8868625ffefc] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:32:53.406949 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-17567ffa-8bdf-4235-bbb2-6de7b8e1ecf0 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:32:53.408415 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-17567ffa-8bdf-4235-bbb2-6de7b8e1ecf0 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] [instance: 5d54db85-b991-4890-abaa-952413baa2e7] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:32:53.409428 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-f150e4ec-8f36-478e-bfd7-179b446d46e2 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:32:53.410135 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-f150e4ec-8f36-478e-bfd7-179b446d46e2 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:32:53.411560 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-f150e4ec-8f36-478e-bfd7-179b446d46e2 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:32:53.411986 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-f150e4ec-8f36-478e-bfd7-179b446d46e2 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:32:53.415940 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-17567ffa-8bdf-4235-bbb2-6de7b8e1ecf0 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:32:53.416384 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-17567ffa-8bdf-4235-bbb2-6de7b8e1ecf0 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:32:53.417181 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-17567ffa-8bdf-4235-bbb2-6de7b8e1ecf0 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:32:53.417643 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-17567ffa-8bdf-4235-bbb2-6de7b8e1ecf0 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:32:53.447328 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-17567ffa-8bdf-4235-bbb2-6de7b8e1ecf0 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] 10.222.0.11 "GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046710 Nov 17 03:32:53.447894 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 732/1491] 10.222.0.11 () {60 vars in 1342 bytes} [Wed Nov 17 03:32:53 2021] GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 17 03:32:53.473845 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-f150e4ec-8f36-478e-bfd7-179b446d46e2 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80763e09d44c475ea2425b22874e9612', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fef02a1dd77946a2ac0e0414b557435f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:32:53.481415 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-f150e4ec-8f36-478e-bfd7-179b446d46e2 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] 10.222.0.11 "GET /compute/v2.1/servers/5ddbfaaa-fabf-4324-941c-8868625ffefc" status: 200 len: 1226 microversion: 2.1 time: 0.090254 Nov 17 03:32:53.481966 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 760/1492] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:32:53 2021] GET /compute/v2.1/servers/5ddbfaaa-fabf-4324-941c-8868625ffefc => generated 1226 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:32:53.656015 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-e1b24041-3651-43da-b266-29971d8e3b2d tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:32:53.656724 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-e1b24041-3651-43da-b266-29971d8e3b2d tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] [instance: 0698dc5b-5f47-46c4-ace8-f5e891a964a0] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:32:53.666308 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-e1b24041-3651-43da-b266-29971d8e3b2d tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:32:53.666952 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-e1b24041-3651-43da-b266-29971d8e3b2d tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:32:53.668082 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-e1b24041-3651-43da-b266-29971d8e3b2d tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:32:53.668730 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-e1b24041-3651-43da-b266-29971d8e3b2d tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:32:53.814194 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-e1b24041-3651-43da-b266-29971d8e3b2d tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '163b2f24a72649ac8084be1cac32fa09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e123e9b86124c93a7fc2db9984e7466', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:32:53.826301 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-e1b24041-3651-43da-b266-29971d8e3b2d tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] 10.222.0.11 "GET /compute/v2.1/servers/0698dc5b-5f47-46c4-ace8-f5e891a964a0" status: 200 len: 1565 microversion: 2.1 time: 0.176323 Nov 17 03:32:53.827145 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 733/1493] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:32:53 2021] GET /compute/v2.1/servers/0698dc5b-5f47-46c4-ace8-f5e891a964a0 => generated 1565 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:32:53.874575 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-e540cd63-97b2-41e9-9796-e13d617f861b tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:32:53.875493 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-e540cd63-97b2-41e9-9796-e13d617f861b tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] [instance: a49437df-3059-4528-8328-2f3471d5fb45] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:32:53.882152 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-e540cd63-97b2-41e9-9796-e13d617f861b tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:32:53.882601 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-e540cd63-97b2-41e9-9796-e13d617f861b tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:32:53.883376 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-e540cd63-97b2-41e9-9796-e13d617f861b tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:32:53.883806 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-e540cd63-97b2-41e9-9796-e13d617f861b tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:32:53.914167 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-e540cd63-97b2-41e9-9796-e13d617f861b tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] 10.222.0.11 "GET /compute/v2.1/servers/a49437df-3059-4528-8328-2f3471d5fb45/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043359 Nov 17 03:32:53.914643 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 761/1494] 10.222.0.11 () {58 vars in 1301 bytes} [Wed Nov 17 03:32:53 2021] GET /compute/v2.1/servers/a49437df-3059-4528-8328-2f3471d5fb45/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 17 03:32:54.461725 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-9dec0c02-9fa0-448b-86c4-76e44fced0df tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:32:54.462879 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-9dec0c02-9fa0-448b-86c4-76e44fced0df tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] [instance: 5d54db85-b991-4890-abaa-952413baa2e7] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:32:54.470990 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-9dec0c02-9fa0-448b-86c4-76e44fced0df tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:32:54.471555 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-9dec0c02-9fa0-448b-86c4-76e44fced0df tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:32:54.472515 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-9dec0c02-9fa0-448b-86c4-76e44fced0df tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:32:54.473093 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-9dec0c02-9fa0-448b-86c4-76e44fced0df tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:32:54.498134 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-e10fe051-7748-4845-91c4-82c21052e90e tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:32:54.498703 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-e10fe051-7748-4845-91c4-82c21052e90e tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] [instance: 5ddbfaaa-fabf-4324-941c-8868625ffefc] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:32:54.505311 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-e10fe051-7748-4845-91c4-82c21052e90e tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:32:54.505758 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-e10fe051-7748-4845-91c4-82c21052e90e tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:32:54.506531 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-e10fe051-7748-4845-91c4-82c21052e90e tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:32:54.506960 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-e10fe051-7748-4845-91c4-82c21052e90e tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:32:54.507175 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-9dec0c02-9fa0-448b-86c4-76e44fced0df tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] 10.222.0.11 "GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.051224 Nov 17 03:32:54.507767 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 734/1495] 10.222.0.11 () {60 vars in 1342 bytes} [Wed Nov 17 03:32:54 2021] GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 17 03:32:54.566143 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-e10fe051-7748-4845-91c4-82c21052e90e tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80763e09d44c475ea2425b22874e9612', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fef02a1dd77946a2ac0e0414b557435f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:32:54.577673 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-e10fe051-7748-4845-91c4-82c21052e90e tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] 10.222.0.11 "GET /compute/v2.1/servers/5ddbfaaa-fabf-4324-941c-8868625ffefc" status: 200 len: 1226 microversion: 2.1 time: 0.083194 Nov 17 03:32:54.578239 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 762/1496] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:32:54 2021] GET /compute/v2.1/servers/5ddbfaaa-fabf-4324-941c-8868625ffefc => generated 1226 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:32:54.847373 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-47d19d3e-466e-4337-bbd0-7ceaa26b463f tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:32:54.848362 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-47d19d3e-466e-4337-bbd0-7ceaa26b463f tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] [instance: 0698dc5b-5f47-46c4-ace8-f5e891a964a0] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:32:54.858547 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-47d19d3e-466e-4337-bbd0-7ceaa26b463f tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:32:54.859284 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-47d19d3e-466e-4337-bbd0-7ceaa26b463f tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:32:54.860539 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-47d19d3e-466e-4337-bbd0-7ceaa26b463f tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:32:54.861299 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-47d19d3e-466e-4337-bbd0-7ceaa26b463f tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:32:54.925113 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-28dd5063-d953-4946-81b9-f110f089aa9b tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:32:54.926021 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-28dd5063-d953-4946-81b9-f110f089aa9b tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] [instance: a49437df-3059-4528-8328-2f3471d5fb45] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:32:54.932448 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-28dd5063-d953-4946-81b9-f110f089aa9b tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:32:54.932917 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-28dd5063-d953-4946-81b9-f110f089aa9b tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:32:54.933673 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-28dd5063-d953-4946-81b9-f110f089aa9b tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:32:54.934183 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-28dd5063-d953-4946-81b9-f110f089aa9b tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:32:54.963432 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-28dd5063-d953-4946-81b9-f110f089aa9b tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] 10.222.0.11 "GET /compute/v2.1/servers/a49437df-3059-4528-8328-2f3471d5fb45/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042044 Nov 17 03:32:54.963993 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 763/1497] 10.222.0.11 () {58 vars in 1301 bytes} [Wed Nov 17 03:32:54 2021] GET /compute/v2.1/servers/a49437df-3059-4528-8328-2f3471d5fb45/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 17 03:32:55.002994 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-47d19d3e-466e-4337-bbd0-7ceaa26b463f tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '163b2f24a72649ac8084be1cac32fa09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e123e9b86124c93a7fc2db9984e7466', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:32:55.010818 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-47d19d3e-466e-4337-bbd0-7ceaa26b463f tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] 10.222.0.11 "GET /compute/v2.1/servers/0698dc5b-5f47-46c4-ace8-f5e891a964a0" status: 200 len: 1565 microversion: 2.1 time: 0.169591 Nov 17 03:32:55.011392 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 735/1498] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:32:54 2021] GET /compute/v2.1/servers/0698dc5b-5f47-46c4-ace8-f5e891a964a0 => generated 1565 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:32:55.523239 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-2fe17adc-b22f-4a45-b829-1d8651995b0a tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:32:55.524312 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-2fe17adc-b22f-4a45-b829-1d8651995b0a tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] [instance: 5d54db85-b991-4890-abaa-952413baa2e7] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:32:55.532085 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-2fe17adc-b22f-4a45-b829-1d8651995b0a tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:32:55.532615 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-2fe17adc-b22f-4a45-b829-1d8651995b0a tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:32:55.533567 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-2fe17adc-b22f-4a45-b829-1d8651995b0a tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:32:55.534074 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-2fe17adc-b22f-4a45-b829-1d8651995b0a tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:32:55.570106 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-2fe17adc-b22f-4a45-b829-1d8651995b0a tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] 10.222.0.11 "GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.053482 Nov 17 03:32:55.570656 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 764/1499] 10.222.0.11 () {60 vars in 1342 bytes} [Wed Nov 17 03:32:55 2021] GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 17 03:32:55.596816 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-d6e90feb-dc02-42da-91e2-4a9ad80c5363 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:32:55.597456 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-d6e90feb-dc02-42da-91e2-4a9ad80c5363 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] [instance: 5ddbfaaa-fabf-4324-941c-8868625ffefc] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:32:55.604239 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-d6e90feb-dc02-42da-91e2-4a9ad80c5363 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:32:55.604695 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-d6e90feb-dc02-42da-91e2-4a9ad80c5363 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:32:55.605513 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-d6e90feb-dc02-42da-91e2-4a9ad80c5363 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:32:55.605947 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-d6e90feb-dc02-42da-91e2-4a9ad80c5363 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:32:55.674504 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-d6e90feb-dc02-42da-91e2-4a9ad80c5363 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80763e09d44c475ea2425b22874e9612', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fef02a1dd77946a2ac0e0414b557435f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:32:55.684825 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-d6e90feb-dc02-42da-91e2-4a9ad80c5363 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] 10.222.0.11 "GET /compute/v2.1/servers/5ddbfaaa-fabf-4324-941c-8868625ffefc" status: 200 len: 1226 microversion: 2.1 time: 0.091716 Nov 17 03:32:55.685411 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 736/1500] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:32:55 2021] GET /compute/v2.1/servers/5ddbfaaa-fabf-4324-941c-8868625ffefc => generated 1226 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:32:55.978259 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-c21472af-3bd2-4c3f-bb09-09e3354fe12c tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:32:55.979112 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-c21472af-3bd2-4c3f-bb09-09e3354fe12c tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] [instance: a49437df-3059-4528-8328-2f3471d5fb45] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:32:55.985548 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-c21472af-3bd2-4c3f-bb09-09e3354fe12c tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:32:55.985994 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-c21472af-3bd2-4c3f-bb09-09e3354fe12c tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:32:55.986755 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-c21472af-3bd2-4c3f-bb09-09e3354fe12c tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:32:55.987186 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-c21472af-3bd2-4c3f-bb09-09e3354fe12c tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:32:56.019806 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-c21472af-3bd2-4c3f-bb09-09e3354fe12c tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] 10.222.0.11 "GET /compute/v2.1/servers/a49437df-3059-4528-8328-2f3471d5fb45/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046862 Nov 17 03:32:56.020350 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 765/1501] 10.222.0.11 () {58 vars in 1301 bytes} [Wed Nov 17 03:32:55 2021] GET /compute/v2.1/servers/a49437df-3059-4528-8328-2f3471d5fb45/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 17 03:32:56.029403 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-15b36fd9-5bfa-4bde-979b-2a555a02b4a1 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:32:56.030252 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-15b36fd9-5bfa-4bde-979b-2a555a02b4a1 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] [instance: 0698dc5b-5f47-46c4-ace8-f5e891a964a0] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:32:56.039618 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-15b36fd9-5bfa-4bde-979b-2a555a02b4a1 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:32:56.040078 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-15b36fd9-5bfa-4bde-979b-2a555a02b4a1 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:32:56.040900 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-15b36fd9-5bfa-4bde-979b-2a555a02b4a1 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:32:56.041336 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-15b36fd9-5bfa-4bde-979b-2a555a02b4a1 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:32:56.189077 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-15b36fd9-5bfa-4bde-979b-2a555a02b4a1 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '163b2f24a72649ac8084be1cac32fa09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e123e9b86124c93a7fc2db9984e7466', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:32:56.196968 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-15b36fd9-5bfa-4bde-979b-2a555a02b4a1 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] 10.222.0.11 "GET /compute/v2.1/servers/0698dc5b-5f47-46c4-ace8-f5e891a964a0" status: 200 len: 1565 microversion: 2.1 time: 0.173055 Nov 17 03:32:56.197529 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 737/1502] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:32:56 2021] GET /compute/v2.1/servers/0698dc5b-5f47-46c4-ace8-f5e891a964a0 => generated 1565 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:32:56.588115 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-4a616731-34dc-4948-8759-0e5a1719f81c tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:32:56.589641 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-4a616731-34dc-4948-8759-0e5a1719f81c tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] [instance: 5d54db85-b991-4890-abaa-952413baa2e7] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:32:56.600672 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-4a616731-34dc-4948-8759-0e5a1719f81c tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:32:56.601636 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-4a616731-34dc-4948-8759-0e5a1719f81c tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:32:56.602105 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-4a616731-34dc-4948-8759-0e5a1719f81c tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:32:56.602530 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-4a616731-34dc-4948-8759-0e5a1719f81c tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:32:56.632937 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-4a616731-34dc-4948-8759-0e5a1719f81c tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] 10.222.0.11 "GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.053200 Nov 17 03:32:56.633472 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 766/1503] 10.222.0.11 () {60 vars in 1342 bytes} [Wed Nov 17 03:32:56 2021] GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 17 03:32:56.701245 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-993808a7-c58e-482d-a7ee-ab75f22aecd7 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:32:56.701846 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-993808a7-c58e-482d-a7ee-ab75f22aecd7 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] [instance: 5ddbfaaa-fabf-4324-941c-8868625ffefc] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:32:56.708565 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-993808a7-c58e-482d-a7ee-ab75f22aecd7 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:32:56.709046 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-993808a7-c58e-482d-a7ee-ab75f22aecd7 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:32:56.709827 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-993808a7-c58e-482d-a7ee-ab75f22aecd7 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:32:56.710438 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-993808a7-c58e-482d-a7ee-ab75f22aecd7 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:32:56.769968 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-993808a7-c58e-482d-a7ee-ab75f22aecd7 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80763e09d44c475ea2425b22874e9612', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fef02a1dd77946a2ac0e0414b557435f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:32:56.777764 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-993808a7-c58e-482d-a7ee-ab75f22aecd7 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] 10.222.0.11 "GET /compute/v2.1/servers/5ddbfaaa-fabf-4324-941c-8868625ffefc" status: 200 len: 1226 microversion: 2.1 time: 0.080226 Nov 17 03:32:56.778337 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 738/1504] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:32:56 2021] GET /compute/v2.1/servers/5ddbfaaa-fabf-4324-941c-8868625ffefc => generated 1226 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:32:57.035642 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-a595dec3-1564-4008-8c71-9643545e2133 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:32:57.037162 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-a595dec3-1564-4008-8c71-9643545e2133 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] [instance: a49437df-3059-4528-8328-2f3471d5fb45] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:32:57.047443 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-a595dec3-1564-4008-8c71-9643545e2133 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:32:57.048185 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-a595dec3-1564-4008-8c71-9643545e2133 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:32:57.049527 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-a595dec3-1564-4008-8c71-9643545e2133 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:32:57.050242 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-a595dec3-1564-4008-8c71-9643545e2133 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:32:57.087220 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-a595dec3-1564-4008-8c71-9643545e2133 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] 10.222.0.11 "GET /compute/v2.1/servers/a49437df-3059-4528-8328-2f3471d5fb45/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.058002 Nov 17 03:32:57.087776 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 767/1505] 10.222.0.11 () {58 vars in 1301 bytes} [Wed Nov 17 03:32:57 2021] GET /compute/v2.1/servers/a49437df-3059-4528-8328-2f3471d5fb45/os-volume_attachments => generated 197 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 17 03:32:57.218111 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-41dc513f-e032-41f7-a89f-57e6a2930e2d tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:32:57.219139 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-41dc513f-e032-41f7-a89f-57e6a2930e2d tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] [instance: 0698dc5b-5f47-46c4-ace8-f5e891a964a0] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:32:57.229438 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-41dc513f-e032-41f7-a89f-57e6a2930e2d tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:32:57.230187 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-41dc513f-e032-41f7-a89f-57e6a2930e2d tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:32:57.231454 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-41dc513f-e032-41f7-a89f-57e6a2930e2d tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:32:57.232172 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-41dc513f-e032-41f7-a89f-57e6a2930e2d tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:32:57.366342 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-41dc513f-e032-41f7-a89f-57e6a2930e2d tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '163b2f24a72649ac8084be1cac32fa09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e123e9b86124c93a7fc2db9984e7466', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:32:57.374481 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-41dc513f-e032-41f7-a89f-57e6a2930e2d tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] 10.222.0.11 "GET /compute/v2.1/servers/0698dc5b-5f47-46c4-ace8-f5e891a964a0" status: 200 len: 1565 microversion: 2.1 time: 0.162577 Nov 17 03:32:57.375043 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 739/1506] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:32:57 2021] GET /compute/v2.1/servers/0698dc5b-5f47-46c4-ace8-f5e891a964a0 => generated 1565 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:32:57.648668 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-54166b82-a009-4c8d-bbb1-780cf584c59f tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:32:57.649479 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-54166b82-a009-4c8d-bbb1-780cf584c59f tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] [instance: 5d54db85-b991-4890-abaa-952413baa2e7] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:32:57.656173 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-54166b82-a009-4c8d-bbb1-780cf584c59f tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:32:57.656695 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-54166b82-a009-4c8d-bbb1-780cf584c59f tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:32:57.657397 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-54166b82-a009-4c8d-bbb1-780cf584c59f tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:32:57.657825 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-54166b82-a009-4c8d-bbb1-780cf584c59f tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:32:57.687402 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-54166b82-a009-4c8d-bbb1-780cf584c59f tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] 10.222.0.11 "GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044844 Nov 17 03:32:57.687942 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 768/1507] 10.222.0.11 () {60 vars in 1342 bytes} [Wed Nov 17 03:32:57 2021] GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 17 03:32:57.798578 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-9bb6b0b5-4b78-4a69-a232-c8fa983901b3 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:32:57.799629 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-9bb6b0b5-4b78-4a69-a232-c8fa983901b3 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] [instance: 5ddbfaaa-fabf-4324-941c-8868625ffefc] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:32:57.808512 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-9bb6b0b5-4b78-4a69-a232-c8fa983901b3 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:32:57.808999 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-9bb6b0b5-4b78-4a69-a232-c8fa983901b3 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:32:57.809772 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-9bb6b0b5-4b78-4a69-a232-c8fa983901b3 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:32:57.810201 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-9bb6b0b5-4b78-4a69-a232-c8fa983901b3 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:32:57.883128 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-9bb6b0b5-4b78-4a69-a232-c8fa983901b3 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80763e09d44c475ea2425b22874e9612', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fef02a1dd77946a2ac0e0414b557435f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:32:57.891287 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-9bb6b0b5-4b78-4a69-a232-c8fa983901b3 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] 10.222.0.11 "GET /compute/v2.1/servers/5ddbfaaa-fabf-4324-941c-8868625ffefc" status: 200 len: 1226 microversion: 2.1 time: 0.098908 Nov 17 03:32:57.891882 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 740/1508] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:32:57 2021] GET /compute/v2.1/servers/5ddbfaaa-fabf-4324-941c-8868625ffefc => generated 1226 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:32:58.099741 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-91d22862-8e1d-4ca5-a189-ee1636f9b2fb tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:32:58.100732 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-91d22862-8e1d-4ca5-a189-ee1636f9b2fb tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] [instance: a49437df-3059-4528-8328-2f3471d5fb45] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:32:58.107357 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-91d22862-8e1d-4ca5-a189-ee1636f9b2fb tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:32:58.107801 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-91d22862-8e1d-4ca5-a189-ee1636f9b2fb tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:32:58.108568 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-91d22862-8e1d-4ca5-a189-ee1636f9b2fb tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:32:58.109034 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-91d22862-8e1d-4ca5-a189-ee1636f9b2fb tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:32:58.139906 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-91d22862-8e1d-4ca5-a189-ee1636f9b2fb tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] 10.222.0.11 "GET /compute/v2.1/servers/a49437df-3059-4528-8328-2f3471d5fb45/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043954 Nov 17 03:32:58.140446 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 769/1509] 10.222.0.11 () {58 vars in 1301 bytes} [Wed Nov 17 03:32:58 2021] GET /compute/v2.1/servers/a49437df-3059-4528-8328-2f3471d5fb45/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 17 03:32:58.395923 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-b64f5dd1-ff7a-4182-a649-d951b4cef584 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:32:58.396836 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-b64f5dd1-ff7a-4182-a649-d951b4cef584 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] [instance: 0698dc5b-5f47-46c4-ace8-f5e891a964a0] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:32:58.403753 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-b64f5dd1-ff7a-4182-a649-d951b4cef584 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:32:58.404203 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-b64f5dd1-ff7a-4182-a649-d951b4cef584 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:32:58.405031 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-b64f5dd1-ff7a-4182-a649-d951b4cef584 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:32:58.405461 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-b64f5dd1-ff7a-4182-a649-d951b4cef584 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:32:58.549699 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-b64f5dd1-ff7a-4182-a649-d951b4cef584 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '163b2f24a72649ac8084be1cac32fa09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e123e9b86124c93a7fc2db9984e7466', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:32:58.558379 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-b64f5dd1-ff7a-4182-a649-d951b4cef584 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] 10.222.0.11 "GET /compute/v2.1/servers/0698dc5b-5f47-46c4-ace8-f5e891a964a0" status: 200 len: 1565 microversion: 2.1 time: 0.168872 Nov 17 03:32:58.558946 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 741/1510] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:32:58 2021] GET /compute/v2.1/servers/0698dc5b-5f47-46c4-ace8-f5e891a964a0 => generated 1565 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:32:58.703356 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-41a11614-041a-41df-8a02-c920b07d0d82 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:32:58.704691 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-41a11614-041a-41df-8a02-c920b07d0d82 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] [instance: 5d54db85-b991-4890-abaa-952413baa2e7] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:32:58.713576 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-41a11614-041a-41df-8a02-c920b07d0d82 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:32:58.714025 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-41a11614-041a-41df-8a02-c920b07d0d82 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:32:58.714795 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-41a11614-041a-41df-8a02-c920b07d0d82 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:32:58.715226 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-41a11614-041a-41df-8a02-c920b07d0d82 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:32:58.744958 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-41a11614-041a-41df-8a02-c920b07d0d82 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] 10.222.0.11 "GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.048161 Nov 17 03:32:58.745510 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 770/1511] 10.222.0.11 () {60 vars in 1342 bytes} [Wed Nov 17 03:32:58 2021] GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 17 03:32:58.912017 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-3c4bafb0-6e35-4313-adca-8451c4a20255 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:32:58.913058 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-3c4bafb0-6e35-4313-adca-8451c4a20255 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] [instance: 5ddbfaaa-fabf-4324-941c-8868625ffefc] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:32:58.920281 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-3c4bafb0-6e35-4313-adca-8451c4a20255 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:32:58.920732 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-3c4bafb0-6e35-4313-adca-8451c4a20255 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:32:58.921606 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-3c4bafb0-6e35-4313-adca-8451c4a20255 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:32:58.922041 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-3c4bafb0-6e35-4313-adca-8451c4a20255 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:32:58.981783 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-3c4bafb0-6e35-4313-adca-8451c4a20255 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80763e09d44c475ea2425b22874e9612', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fef02a1dd77946a2ac0e0414b557435f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:32:58.989829 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-3c4bafb0-6e35-4313-adca-8451c4a20255 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] 10.222.0.11 "GET /compute/v2.1/servers/5ddbfaaa-fabf-4324-941c-8868625ffefc" status: 200 len: 1226 microversion: 2.1 time: 0.084074 Nov 17 03:32:58.990411 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 742/1512] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:32:58 2021] GET /compute/v2.1/servers/5ddbfaaa-fabf-4324-941c-8868625ffefc => generated 1226 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:32:59.153492 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-eb649b6c-af87-487b-a767-d286f53cd7a5 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:32:59.154398 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-eb649b6c-af87-487b-a767-d286f53cd7a5 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] [instance: a49437df-3059-4528-8328-2f3471d5fb45] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:32:59.160858 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-eb649b6c-af87-487b-a767-d286f53cd7a5 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:32:59.161309 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-eb649b6c-af87-487b-a767-d286f53cd7a5 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:32:59.162079 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-eb649b6c-af87-487b-a767-d286f53cd7a5 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:32:59.162514 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-eb649b6c-af87-487b-a767-d286f53cd7a5 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:32:59.193133 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-eb649b6c-af87-487b-a767-d286f53cd7a5 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] 10.222.0.11 "GET /compute/v2.1/servers/a49437df-3059-4528-8328-2f3471d5fb45/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043562 Nov 17 03:32:59.193674 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 771/1513] 10.222.0.11 () {58 vars in 1301 bytes} [Wed Nov 17 03:32:59 2021] GET /compute/v2.1/servers/a49437df-3059-4528-8328-2f3471d5fb45/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 17 03:32:59.580018 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-dc27491e-9f54-4a3a-8ca3-1f5105385747 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:32:59.581083 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-dc27491e-9f54-4a3a-8ca3-1f5105385747 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] [instance: 0698dc5b-5f47-46c4-ace8-f5e891a964a0] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:32:59.591804 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-dc27491e-9f54-4a3a-8ca3-1f5105385747 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:32:59.592554 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-dc27491e-9f54-4a3a-8ca3-1f5105385747 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:32:59.593895 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-dc27491e-9f54-4a3a-8ca3-1f5105385747 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:32:59.594618 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-dc27491e-9f54-4a3a-8ca3-1f5105385747 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:32:59.741025 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-dc27491e-9f54-4a3a-8ca3-1f5105385747 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '163b2f24a72649ac8084be1cac32fa09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e123e9b86124c93a7fc2db9984e7466', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:32:59.750929 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-dc27491e-9f54-4a3a-8ca3-1f5105385747 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] 10.222.0.11 "GET /compute/v2.1/servers/0698dc5b-5f47-46c4-ace8-f5e891a964a0" status: 200 len: 1565 microversion: 2.1 time: 0.177129 Nov 17 03:32:59.751504 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 743/1514] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:32:59 2021] GET /compute/v2.1/servers/0698dc5b-5f47-46c4-ace8-f5e891a964a0 => generated 1565 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 17 03:32:59.755594 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-e6915aba-ff61-4623-8b4c-8e466a4b37f3 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:32:59.756502 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-e6915aba-ff61-4623-8b4c-8e466a4b37f3 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] [instance: 5d54db85-b991-4890-abaa-952413baa2e7] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:32:59.763252 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-e6915aba-ff61-4623-8b4c-8e466a4b37f3 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:32:59.763692 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-e6915aba-ff61-4623-8b4c-8e466a4b37f3 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:32:59.764498 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-e6915aba-ff61-4623-8b4c-8e466a4b37f3 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:32:59.764925 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-e6915aba-ff61-4623-8b4c-8e466a4b37f3 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:32:59.794094 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-e6915aba-ff61-4623-8b4c-8e466a4b37f3 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] 10.222.0.11 "GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042252 Nov 17 03:32:59.794641 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 772/1515] 10.222.0.11 () {60 vars in 1342 bytes} [Wed Nov 17 03:32:59 2021] GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 17 03:33:00.010571 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-f0d6163c-6543-4320-ae27-8166a017bfcb tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:33:00.011570 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-f0d6163c-6543-4320-ae27-8166a017bfcb tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] [instance: 5ddbfaaa-fabf-4324-941c-8868625ffefc] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:33:00.023038 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-f0d6163c-6543-4320-ae27-8166a017bfcb tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:33:00.024081 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-f0d6163c-6543-4320-ae27-8166a017bfcb tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:33:00.024995 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-f0d6163c-6543-4320-ae27-8166a017bfcb tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:33:00.025428 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-f0d6163c-6543-4320-ae27-8166a017bfcb tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:33:00.087914 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-f0d6163c-6543-4320-ae27-8166a017bfcb tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80763e09d44c475ea2425b22874e9612', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fef02a1dd77946a2ac0e0414b557435f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:33:00.095865 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-f0d6163c-6543-4320-ae27-8166a017bfcb tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] 10.222.0.11 "GET /compute/v2.1/servers/5ddbfaaa-fabf-4324-941c-8868625ffefc" status: 200 len: 1226 microversion: 2.1 time: 0.091643 Nov 17 03:33:00.096436 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 744/1516] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:33:00 2021] GET /compute/v2.1/servers/5ddbfaaa-fabf-4324-941c-8868625ffefc => generated 1226 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:33:00.208573 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-b2689b6b-4546-42fe-bdab-805a4bc8a5a9 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:33:00.210075 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-b2689b6b-4546-42fe-bdab-805a4bc8a5a9 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] [instance: a49437df-3059-4528-8328-2f3471d5fb45] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:33:00.217271 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-b2689b6b-4546-42fe-bdab-805a4bc8a5a9 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:33:00.217722 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-b2689b6b-4546-42fe-bdab-805a4bc8a5a9 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:33:00.218479 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-b2689b6b-4546-42fe-bdab-805a4bc8a5a9 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:33:00.218904 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-b2689b6b-4546-42fe-bdab-805a4bc8a5a9 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:33:00.248474 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-b2689b6b-4546-42fe-bdab-805a4bc8a5a9 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] 10.222.0.11 "GET /compute/v2.1/servers/a49437df-3059-4528-8328-2f3471d5fb45/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046253 Nov 17 03:33:00.249054 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 773/1517] 10.222.0.11 () {58 vars in 1301 bytes} [Wed Nov 17 03:33:00 2021] GET /compute/v2.1/servers/a49437df-3059-4528-8328-2f3471d5fb45/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 17 03:33:00.773023 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-03c993e9-e423-48bd-8a7a-9fc0fc88327d tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:33:00.774215 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-03c993e9-e423-48bd-8a7a-9fc0fc88327d tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] [instance: 0698dc5b-5f47-46c4-ace8-f5e891a964a0] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:33:00.781523 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-03c993e9-e423-48bd-8a7a-9fc0fc88327d tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:33:00.782024 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-03c993e9-e423-48bd-8a7a-9fc0fc88327d tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:33:00.782873 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-03c993e9-e423-48bd-8a7a-9fc0fc88327d tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:33:00.783358 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-03c993e9-e423-48bd-8a7a-9fc0fc88327d tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:33:00.807087 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-6fbe4e2a-8fb3-426e-b977-e4b2931c2d2f tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:33:00.807990 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-6fbe4e2a-8fb3-426e-b977-e4b2931c2d2f tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] [instance: 5d54db85-b991-4890-abaa-952413baa2e7] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:33:00.814780 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-6fbe4e2a-8fb3-426e-b977-e4b2931c2d2f tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:33:00.815209 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-6fbe4e2a-8fb3-426e-b977-e4b2931c2d2f tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:33:00.815993 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-6fbe4e2a-8fb3-426e-b977-e4b2931c2d2f tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:33:00.816439 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-6fbe4e2a-8fb3-426e-b977-e4b2931c2d2f tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:33:00.846670 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-6fbe4e2a-8fb3-426e-b977-e4b2931c2d2f tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] 10.222.0.11 "GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044206 Nov 17 03:33:00.847464 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 774/1518] 10.222.0.11 () {60 vars in 1342 bytes} [Wed Nov 17 03:33:00 2021] GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 17 03:33:00.924675 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-03c993e9-e423-48bd-8a7a-9fc0fc88327d tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '163b2f24a72649ac8084be1cac32fa09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e123e9b86124c93a7fc2db9984e7466', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:33:00.932770 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-03c993e9-e423-48bd-8a7a-9fc0fc88327d tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] 10.222.0.11 "GET /compute/v2.1/servers/0698dc5b-5f47-46c4-ace8-f5e891a964a0" status: 200 len: 1565 microversion: 2.1 time: 0.166009 Nov 17 03:33:00.933317 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 745/1519] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:33:00 2021] GET /compute/v2.1/servers/0698dc5b-5f47-46c4-ace8-f5e891a964a0 => generated 1565 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:33:01.112902 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-4f2741e8-69ba-49d5-9ad3-d5bdcee73c17 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:33:01.113536 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-4f2741e8-69ba-49d5-9ad3-d5bdcee73c17 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] [instance: 5ddbfaaa-fabf-4324-941c-8868625ffefc] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:33:01.120376 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-4f2741e8-69ba-49d5-9ad3-d5bdcee73c17 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:33:01.120839 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-4f2741e8-69ba-49d5-9ad3-d5bdcee73c17 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:33:01.121620 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-4f2741e8-69ba-49d5-9ad3-d5bdcee73c17 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:33:01.122038 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-4f2741e8-69ba-49d5-9ad3-d5bdcee73c17 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:33:01.189512 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-4f2741e8-69ba-49d5-9ad3-d5bdcee73c17 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80763e09d44c475ea2425b22874e9612', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fef02a1dd77946a2ac0e0414b557435f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:33:01.200049 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-4f2741e8-69ba-49d5-9ad3-d5bdcee73c17 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] 10.222.0.11 "GET /compute/v2.1/servers/5ddbfaaa-fabf-4324-941c-8868625ffefc" status: 200 len: 1226 microversion: 2.1 time: 0.090872 Nov 17 03:33:01.200609 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 775/1520] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:33:01 2021] GET /compute/v2.1/servers/5ddbfaaa-fabf-4324-941c-8868625ffefc => generated 1226 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:33:01.261707 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-12277ac5-6ada-495d-abc8-c2bc6e6c3018 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:33:01.262849 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-12277ac5-6ada-495d-abc8-c2bc6e6c3018 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] [instance: a49437df-3059-4528-8328-2f3471d5fb45] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:33:01.271234 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-12277ac5-6ada-495d-abc8-c2bc6e6c3018 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:33:01.271784 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-12277ac5-6ada-495d-abc8-c2bc6e6c3018 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:33:01.272734 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-12277ac5-6ada-495d-abc8-c2bc6e6c3018 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:33:01.273305 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-12277ac5-6ada-495d-abc8-c2bc6e6c3018 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:33:01.307018 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-12277ac5-6ada-495d-abc8-c2bc6e6c3018 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] 10.222.0.11 "GET /compute/v2.1/servers/a49437df-3059-4528-8328-2f3471d5fb45/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050612 Nov 17 03:33:01.307563 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 746/1521] 10.222.0.11 () {58 vars in 1301 bytes} [Wed Nov 17 03:33:01 2021] GET /compute/v2.1/servers/a49437df-3059-4528-8328-2f3471d5fb45/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 17 03:33:01.859837 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-85ceaf0a-a930-4c47-b328-9320d4493b7a tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:33:01.861008 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-85ceaf0a-a930-4c47-b328-9320d4493b7a tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] [instance: 5d54db85-b991-4890-abaa-952413baa2e7] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:33:01.869188 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-85ceaf0a-a930-4c47-b328-9320d4493b7a tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:33:01.869755 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-85ceaf0a-a930-4c47-b328-9320d4493b7a tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:33:01.870759 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-85ceaf0a-a930-4c47-b328-9320d4493b7a tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:33:01.871304 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-85ceaf0a-a930-4c47-b328-9320d4493b7a tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:33:01.902845 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-85ceaf0a-a930-4c47-b328-9320d4493b7a tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] 10.222.0.11 "GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047834 Nov 17 03:33:01.903392 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 776/1522] 10.222.0.11 () {60 vars in 1342 bytes} [Wed Nov 17 03:33:01 2021] GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 17 03:33:01.959632 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-b7316ed0-0729-4724-9fb8-9d7e99ab0163 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:33:01.960498 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-b7316ed0-0729-4724-9fb8-9d7e99ab0163 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] [instance: 0698dc5b-5f47-46c4-ace8-f5e891a964a0] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:33:01.970456 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-b7316ed0-0729-4724-9fb8-9d7e99ab0163 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:33:01.971332 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-b7316ed0-0729-4724-9fb8-9d7e99ab0163 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:33:01.972599 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-b7316ed0-0729-4724-9fb8-9d7e99ab0163 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:33:01.973367 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-b7316ed0-0729-4724-9fb8-9d7e99ab0163 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:33:02.217224 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-f1747c86-57c9-49db-b7f7-68332aa062fa tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:33:02.217831 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-f1747c86-57c9-49db-b7f7-68332aa062fa tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] [instance: 5ddbfaaa-fabf-4324-941c-8868625ffefc] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:33:02.224006 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-f1747c86-57c9-49db-b7f7-68332aa062fa tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:33:02.224447 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-f1747c86-57c9-49db-b7f7-68332aa062fa tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:33:02.225257 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-f1747c86-57c9-49db-b7f7-68332aa062fa tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:33:02.225680 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-f1747c86-57c9-49db-b7f7-68332aa062fa tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:33:02.270504 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-b7316ed0-0729-4724-9fb8-9d7e99ab0163 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '163b2f24a72649ac8084be1cac32fa09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e123e9b86124c93a7fc2db9984e7466', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:33:02.278156 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-b7316ed0-0729-4724-9fb8-9d7e99ab0163 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] 10.222.0.11 "GET /compute/v2.1/servers/0698dc5b-5f47-46c4-ace8-f5e891a964a0" status: 200 len: 1565 microversion: 2.1 time: 0.324825 Nov 17 03:33:02.278691 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 747/1523] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:33:01 2021] GET /compute/v2.1/servers/0698dc5b-5f47-46c4-ace8-f5e891a964a0 => generated 1565 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:33:02.284488 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-f1747c86-57c9-49db-b7f7-68332aa062fa tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80763e09d44c475ea2425b22874e9612', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fef02a1dd77946a2ac0e0414b557435f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:33:02.292076 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-f1747c86-57c9-49db-b7f7-68332aa062fa tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] 10.222.0.11 "GET /compute/v2.1/servers/5ddbfaaa-fabf-4324-941c-8868625ffefc" status: 200 len: 1226 microversion: 2.1 time: 0.078703 Nov 17 03:33:02.292623 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 777/1524] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:33:02 2021] GET /compute/v2.1/servers/5ddbfaaa-fabf-4324-941c-8868625ffefc => generated 1226 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:33:02.318312 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-98eedd00-a527-4c69-9178-9b1cc8b9e630 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:33:02.319209 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-98eedd00-a527-4c69-9178-9b1cc8b9e630 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] [instance: a49437df-3059-4528-8328-2f3471d5fb45] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:33:02.326837 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-98eedd00-a527-4c69-9178-9b1cc8b9e630 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:33:02.327446 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-98eedd00-a527-4c69-9178-9b1cc8b9e630 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:33:02.328520 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-98eedd00-a527-4c69-9178-9b1cc8b9e630 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:33:02.328982 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-98eedd00-a527-4c69-9178-9b1cc8b9e630 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:33:02.360301 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-98eedd00-a527-4c69-9178-9b1cc8b9e630 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] 10.222.0.11 "GET /compute/v2.1/servers/a49437df-3059-4528-8328-2f3471d5fb45/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045604 Nov 17 03:33:02.360873 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 748/1525] 10.222.0.11 () {58 vars in 1301 bytes} [Wed Nov 17 03:33:02 2021] GET /compute/v2.1/servers/a49437df-3059-4528-8328-2f3471d5fb45/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 17 03:33:02.918651 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-f68ccd4b-45f5-4de1-9152-d45d464dc1f8 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:33:02.920112 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-f68ccd4b-45f5-4de1-9152-d45d464dc1f8 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] [instance: 5d54db85-b991-4890-abaa-952413baa2e7] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:33:02.931004 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-f68ccd4b-45f5-4de1-9152-d45d464dc1f8 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:33:02.931464 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-f68ccd4b-45f5-4de1-9152-d45d464dc1f8 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:33:02.932227 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-f68ccd4b-45f5-4de1-9152-d45d464dc1f8 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:33:02.932654 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-f68ccd4b-45f5-4de1-9152-d45d464dc1f8 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:33:02.961659 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-f68ccd4b-45f5-4de1-9152-d45d464dc1f8 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] 10.222.0.11 "GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.049647 Nov 17 03:33:02.962193 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 778/1526] 10.222.0.11 () {60 vars in 1342 bytes} [Wed Nov 17 03:33:02 2021] GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 17 03:33:03.299543 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-4a4587b5-f7de-448a-86e8-be54842d0a59 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:33:03.300556 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-4a4587b5-f7de-448a-86e8-be54842d0a59 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] [instance: 0698dc5b-5f47-46c4-ace8-f5e891a964a0] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:33:03.311731 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-4a4587b5-f7de-448a-86e8-be54842d0a59 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:33:03.312461 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-4a4587b5-f7de-448a-86e8-be54842d0a59 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:33:03.313083 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-c848cc54-ebf1-4514-91ff-ef75b2e03600 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:33:03.313778 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-4a4587b5-f7de-448a-86e8-be54842d0a59 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:33:03.314086 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-c848cc54-ebf1-4514-91ff-ef75b2e03600 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] [instance: 5ddbfaaa-fabf-4324-941c-8868625ffefc] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:33:03.314483 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-4a4587b5-f7de-448a-86e8-be54842d0a59 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:33:03.322813 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-c848cc54-ebf1-4514-91ff-ef75b2e03600 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:33:03.323255 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-c848cc54-ebf1-4514-91ff-ef75b2e03600 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:33:03.324027 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-c848cc54-ebf1-4514-91ff-ef75b2e03600 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:33:03.324462 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-c848cc54-ebf1-4514-91ff-ef75b2e03600 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:33:03.386314 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-c848cc54-ebf1-4514-91ff-ef75b2e03600 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80763e09d44c475ea2425b22874e9612', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fef02a1dd77946a2ac0e0414b557435f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:33:03.394098 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-c848cc54-ebf1-4514-91ff-ef75b2e03600 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] 10.222.0.11 "GET /compute/v2.1/servers/5ddbfaaa-fabf-4324-941c-8868625ffefc" status: 200 len: 1226 microversion: 2.1 time: 0.087389 Nov 17 03:33:03.394668 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 779/1527] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:33:03 2021] GET /compute/v2.1/servers/5ddbfaaa-fabf-4324-941c-8868625ffefc => generated 1226 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:33:03.399050 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-3c6f4107-ff3f-4d94-9e10-09735e293fa0 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:33:03.399958 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-3c6f4107-ff3f-4d94-9e10-09735e293fa0 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] [instance: a49437df-3059-4528-8328-2f3471d5fb45] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:33:03.406257 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-3c6f4107-ff3f-4d94-9e10-09735e293fa0 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:33:03.406702 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-3c6f4107-ff3f-4d94-9e10-09735e293fa0 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:33:03.407472 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-3c6f4107-ff3f-4d94-9e10-09735e293fa0 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:33:03.407901 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-3c6f4107-ff3f-4d94-9e10-09735e293fa0 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:33:03.438034 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-3c6f4107-ff3f-4d94-9e10-09735e293fa0 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] 10.222.0.11 "GET /compute/v2.1/servers/a49437df-3059-4528-8328-2f3471d5fb45/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042295 Nov 17 03:33:03.438612 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 780/1528] 10.222.0.11 () {58 vars in 1301 bytes} [Wed Nov 17 03:33:03 2021] GET /compute/v2.1/servers/a49437df-3059-4528-8328-2f3471d5fb45/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 17 03:33:03.459037 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-4a4587b5-f7de-448a-86e8-be54842d0a59 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '163b2f24a72649ac8084be1cac32fa09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e123e9b86124c93a7fc2db9984e7466', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:33:03.466724 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-4a4587b5-f7de-448a-86e8-be54842d0a59 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] 10.222.0.11 "GET /compute/v2.1/servers/0698dc5b-5f47-46c4-ace8-f5e891a964a0" status: 200 len: 1565 microversion: 2.1 time: 0.173554 Nov 17 03:33:03.467269 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 749/1529] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:33:03 2021] GET /compute/v2.1/servers/0698dc5b-5f47-46c4-ace8-f5e891a964a0 => generated 1565 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:33:03.976982 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-68abb76f-78de-4699-b363-b9a77a3ba615 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:33:03.977872 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-68abb76f-78de-4699-b363-b9a77a3ba615 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] [instance: 5d54db85-b991-4890-abaa-952413baa2e7] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:33:03.984621 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-68abb76f-78de-4699-b363-b9a77a3ba615 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:33:03.985095 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-68abb76f-78de-4699-b363-b9a77a3ba615 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:33:03.985863 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-68abb76f-78de-4699-b363-b9a77a3ba615 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:33:03.986292 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-68abb76f-78de-4699-b363-b9a77a3ba615 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:33:04.016451 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-68abb76f-78de-4699-b363-b9a77a3ba615 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] 10.222.0.11 "GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045922 Nov 17 03:33:04.017060 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 781/1530] 10.222.0.11 () {60 vars in 1342 bytes} [Wed Nov 17 03:33:03 2021] GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 17 03:33:04.414878 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-11b1ba50-33ad-478d-b1e2-09248fd24a27 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:33:04.416204 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-11b1ba50-33ad-478d-b1e2-09248fd24a27 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] [instance: 5ddbfaaa-fabf-4324-941c-8868625ffefc] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:33:04.426736 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-11b1ba50-33ad-478d-b1e2-09248fd24a27 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:33:04.427496 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-11b1ba50-33ad-478d-b1e2-09248fd24a27 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:33:04.428834 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-11b1ba50-33ad-478d-b1e2-09248fd24a27 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:33:04.429553 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-11b1ba50-33ad-478d-b1e2-09248fd24a27 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:33:04.449654 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-57087405-21c7-4d32-b5ee-4d5e5e608697 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:33:04.450625 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-57087405-21c7-4d32-b5ee-4d5e5e608697 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] [instance: a49437df-3059-4528-8328-2f3471d5fb45] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:33:04.457007 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-57087405-21c7-4d32-b5ee-4d5e5e608697 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:33:04.457446 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-57087405-21c7-4d32-b5ee-4d5e5e608697 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:33:04.458245 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-57087405-21c7-4d32-b5ee-4d5e5e608697 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:33:04.458681 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-57087405-21c7-4d32-b5ee-4d5e5e608697 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:33:04.490104 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-57087405-21c7-4d32-b5ee-4d5e5e608697 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] 10.222.0.11 "GET /compute/v2.1/servers/a49437df-3059-4528-8328-2f3471d5fb45/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044209 Nov 17 03:33:04.490674 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 782/1531] 10.222.0.11 () {58 vars in 1301 bytes} [Wed Nov 17 03:33:04 2021] GET /compute/v2.1/servers/a49437df-3059-4528-8328-2f3471d5fb45/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 17 03:33:04.491713 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-11b1ba50-33ad-478d-b1e2-09248fd24a27 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80763e09d44c475ea2425b22874e9612', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fef02a1dd77946a2ac0e0414b557435f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:33:04.495002 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-72239209-f7b0-4d77-8251-a47681f90902 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:33:04.495573 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-72239209-f7b0-4d77-8251-a47681f90902 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] [instance: 0698dc5b-5f47-46c4-ace8-f5e891a964a0] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:33:04.500163 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-11b1ba50-33ad-478d-b1e2-09248fd24a27 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] 10.222.0.11 "GET /compute/v2.1/servers/5ddbfaaa-fabf-4324-941c-8868625ffefc" status: 200 len: 1226 microversion: 2.1 time: 0.091477 Nov 17 03:33:04.500656 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 750/1532] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:33:04 2021] GET /compute/v2.1/servers/5ddbfaaa-fabf-4324-941c-8868625ffefc => generated 1226 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:33:04.501408 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-72239209-f7b0-4d77-8251-a47681f90902 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:33:04.501857 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-72239209-f7b0-4d77-8251-a47681f90902 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:33:04.502606 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-72239209-f7b0-4d77-8251-a47681f90902 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:33:04.503051 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-72239209-f7b0-4d77-8251-a47681f90902 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:33:04.639212 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-72239209-f7b0-4d77-8251-a47681f90902 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '163b2f24a72649ac8084be1cac32fa09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e123e9b86124c93a7fc2db9984e7466', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:33:04.650249 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-72239209-f7b0-4d77-8251-a47681f90902 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] 10.222.0.11 "GET /compute/v2.1/servers/0698dc5b-5f47-46c4-ace8-f5e891a964a0" status: 200 len: 1565 microversion: 2.1 time: 0.158635 Nov 17 03:33:04.650806 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 783/1533] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:33:04 2021] GET /compute/v2.1/servers/0698dc5b-5f47-46c4-ace8-f5e891a964a0 => generated 1565 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:33:05.032824 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-f1a8c4c9-30da-4fd5-986f-96544feec080 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:33:05.034321 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-f1a8c4c9-30da-4fd5-986f-96544feec080 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] [instance: 5d54db85-b991-4890-abaa-952413baa2e7] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:33:05.042568 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-f1a8c4c9-30da-4fd5-986f-96544feec080 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:33:05.043010 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-f1a8c4c9-30da-4fd5-986f-96544feec080 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:33:05.043769 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-f1a8c4c9-30da-4fd5-986f-96544feec080 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:33:05.044189 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-f1a8c4c9-30da-4fd5-986f-96544feec080 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:33:05.074426 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-f1a8c4c9-30da-4fd5-986f-96544feec080 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] 10.222.0.11 "GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047945 Nov 17 03:33:05.074968 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 751/1534] 10.222.0.11 () {60 vars in 1342 bytes} [Wed Nov 17 03:33:05 2021] GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 17 03:33:05.505940 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-7b3e5a03-4357-4b9a-9fea-2fb326c76a40 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:33:05.507479 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-7b3e5a03-4357-4b9a-9fea-2fb326c76a40 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] [instance: a49437df-3059-4528-8328-2f3471d5fb45] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:33:05.514676 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-7b3e5a03-4357-4b9a-9fea-2fb326c76a40 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:33:05.515137 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-7b3e5a03-4357-4b9a-9fea-2fb326c76a40 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:33:05.515912 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-7b3e5a03-4357-4b9a-9fea-2fb326c76a40 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:33:05.516346 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-7b3e5a03-4357-4b9a-9fea-2fb326c76a40 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:33:05.516638 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-fbaad744-8f9f-4096-a553-e992c6f4f5ef tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:33:05.517268 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-fbaad744-8f9f-4096-a553-e992c6f4f5ef tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] [instance: 5ddbfaaa-fabf-4324-941c-8868625ffefc] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:33:05.524183 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-fbaad744-8f9f-4096-a553-e992c6f4f5ef tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:33:05.524695 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-fbaad744-8f9f-4096-a553-e992c6f4f5ef tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:33:05.525493 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-fbaad744-8f9f-4096-a553-e992c6f4f5ef tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:33:05.525918 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-fbaad744-8f9f-4096-a553-e992c6f4f5ef tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:33:05.549334 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-7b3e5a03-4357-4b9a-9fea-2fb326c76a40 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] 10.222.0.11 "GET /compute/v2.1/servers/a49437df-3059-4528-8328-2f3471d5fb45/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049828 Nov 17 03:33:05.549894 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 784/1535] 10.222.0.11 () {58 vars in 1301 bytes} [Wed Nov 17 03:33:05 2021] GET /compute/v2.1/servers/a49437df-3059-4528-8328-2f3471d5fb45/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 17 03:33:05.585925 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-fbaad744-8f9f-4096-a553-e992c6f4f5ef tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80763e09d44c475ea2425b22874e9612', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fef02a1dd77946a2ac0e0414b557435f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:33:05.593918 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-fbaad744-8f9f-4096-a553-e992c6f4f5ef tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] 10.222.0.11 "GET /compute/v2.1/servers/5ddbfaaa-fabf-4324-941c-8868625ffefc" status: 200 len: 1226 microversion: 2.1 time: 0.080873 Nov 17 03:33:05.594466 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 752/1536] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:33:05 2021] GET /compute/v2.1/servers/5ddbfaaa-fabf-4324-941c-8868625ffefc => generated 1226 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:33:05.668005 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-55f96673-9d05-4854-8564-f98a5dd9b9d7 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:33:05.668609 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-55f96673-9d05-4854-8564-f98a5dd9b9d7 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] [instance: 0698dc5b-5f47-46c4-ace8-f5e891a964a0] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:33:05.675356 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-55f96673-9d05-4854-8564-f98a5dd9b9d7 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:33:05.675800 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-55f96673-9d05-4854-8564-f98a5dd9b9d7 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:33:05.676557 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-55f96673-9d05-4854-8564-f98a5dd9b9d7 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:33:05.677088 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-55f96673-9d05-4854-8564-f98a5dd9b9d7 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:33:05.820753 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-55f96673-9d05-4854-8564-f98a5dd9b9d7 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '163b2f24a72649ac8084be1cac32fa09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e123e9b86124c93a7fc2db9984e7466', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:33:05.828917 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-55f96673-9d05-4854-8564-f98a5dd9b9d7 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] 10.222.0.11 "GET /compute/v2.1/servers/0698dc5b-5f47-46c4-ace8-f5e891a964a0" status: 200 len: 1565 microversion: 2.1 time: 0.165050 Nov 17 03:33:05.829504 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 785/1537] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:33:05 2021] GET /compute/v2.1/servers/0698dc5b-5f47-46c4-ace8-f5e891a964a0 => generated 1565 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:33:06.088959 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-a602abcd-810e-4f21-a191-c5499ea919a7 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:33:06.089865 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-a602abcd-810e-4f21-a191-c5499ea919a7 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] [instance: 5d54db85-b991-4890-abaa-952413baa2e7] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:33:06.096453 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-a602abcd-810e-4f21-a191-c5499ea919a7 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:33:06.096920 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-a602abcd-810e-4f21-a191-c5499ea919a7 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:33:06.097844 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-a602abcd-810e-4f21-a191-c5499ea919a7 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:33:06.098283 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-a602abcd-810e-4f21-a191-c5499ea919a7 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:33:06.127320 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-a602abcd-810e-4f21-a191-c5499ea919a7 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] 10.222.0.11 "GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043406 Nov 17 03:33:06.127851 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 753/1538] 10.222.0.11 () {60 vars in 1342 bytes} [Wed Nov 17 03:33:06 2021] GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 17 03:33:06.565448 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-acbebf5b-0a6d-4476-af2b-fecaa5b32fdb tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:33:06.566969 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-acbebf5b-0a6d-4476-af2b-fecaa5b32fdb tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] [instance: a49437df-3059-4528-8328-2f3471d5fb45] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:33:06.575120 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-acbebf5b-0a6d-4476-af2b-fecaa5b32fdb tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:33:06.575568 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-acbebf5b-0a6d-4476-af2b-fecaa5b32fdb tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:33:06.576348 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-acbebf5b-0a6d-4476-af2b-fecaa5b32fdb tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:33:06.576810 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-acbebf5b-0a6d-4476-af2b-fecaa5b32fdb tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:33:06.606256 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-acbebf5b-0a6d-4476-af2b-fecaa5b32fdb tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] 10.222.0.11 "GET /compute/v2.1/servers/a49437df-3059-4528-8328-2f3471d5fb45/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047165 Nov 17 03:33:06.606806 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 786/1539] 10.222.0.11 () {58 vars in 1301 bytes} [Wed Nov 17 03:33:06 2021] GET /compute/v2.1/servers/a49437df-3059-4528-8328-2f3471d5fb45/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 17 03:33:06.610779 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-699ca28d-0c6d-4478-ba4e-ec1956321eb0 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:33:06.611382 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-699ca28d-0c6d-4478-ba4e-ec1956321eb0 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] [instance: 5ddbfaaa-fabf-4324-941c-8868625ffefc] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:33:06.617902 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-699ca28d-0c6d-4478-ba4e-ec1956321eb0 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:33:06.618535 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-699ca28d-0c6d-4478-ba4e-ec1956321eb0 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:33:06.619290 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-699ca28d-0c6d-4478-ba4e-ec1956321eb0 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:33:06.619719 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-699ca28d-0c6d-4478-ba4e-ec1956321eb0 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:33:06.688230 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-699ca28d-0c6d-4478-ba4e-ec1956321eb0 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80763e09d44c475ea2425b22874e9612', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fef02a1dd77946a2ac0e0414b557435f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:33:06.696346 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-699ca28d-0c6d-4478-ba4e-ec1956321eb0 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] 10.222.0.11 "GET /compute/v2.1/servers/5ddbfaaa-fabf-4324-941c-8868625ffefc" status: 200 len: 1226 microversion: 2.1 time: 0.089016 Nov 17 03:33:06.700284 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 754/1540] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:33:06 2021] GET /compute/v2.1/servers/5ddbfaaa-fabf-4324-941c-8868625ffefc => generated 1226 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:33:06.850732 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-df84334a-e851-4c52-ae47-f59d5aa899bd tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:33:06.851610 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-df84334a-e851-4c52-ae47-f59d5aa899bd tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] [instance: 0698dc5b-5f47-46c4-ace8-f5e891a964a0] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:33:06.861919 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-df84334a-e851-4c52-ae47-f59d5aa899bd tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:33:06.862683 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-df84334a-e851-4c52-ae47-f59d5aa899bd tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:33:06.863959 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-df84334a-e851-4c52-ae47-f59d5aa899bd tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:33:06.864678 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-df84334a-e851-4c52-ae47-f59d5aa899bd tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:33:07.008740 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-df84334a-e851-4c52-ae47-f59d5aa899bd tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '163b2f24a72649ac8084be1cac32fa09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e123e9b86124c93a7fc2db9984e7466', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:33:07.016237 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-df84334a-e851-4c52-ae47-f59d5aa899bd tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] 10.222.0.11 "GET /compute/v2.1/servers/0698dc5b-5f47-46c4-ace8-f5e891a964a0" status: 200 len: 1565 microversion: 2.1 time: 0.171876 Nov 17 03:33:07.016898 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 787/1541] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:33:06 2021] GET /compute/v2.1/servers/0698dc5b-5f47-46c4-ace8-f5e891a964a0 => generated 1565 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:33:07.142912 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-256f0b5c-5d2c-4602-9dcd-5beab1114b4a tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:33:07.144252 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-256f0b5c-5d2c-4602-9dcd-5beab1114b4a tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] [instance: 5d54db85-b991-4890-abaa-952413baa2e7] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:33:07.155858 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-256f0b5c-5d2c-4602-9dcd-5beab1114b4a tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:33:07.156655 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-256f0b5c-5d2c-4602-9dcd-5beab1114b4a tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:33:07.158069 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-256f0b5c-5d2c-4602-9dcd-5beab1114b4a tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:33:07.158782 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-256f0b5c-5d2c-4602-9dcd-5beab1114b4a tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:33:07.190751 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-256f0b5c-5d2c-4602-9dcd-5beab1114b4a tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] 10.222.0.11 "GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.054300 Nov 17 03:33:07.191295 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 755/1542] 10.222.0.11 () {60 vars in 1342 bytes} [Wed Nov 17 03:33:07 2021] GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 17 03:33:07.620005 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-67062400-3647-4a20-b7ba-3fea938f4fd0 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:33:07.620978 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-67062400-3647-4a20-b7ba-3fea938f4fd0 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] [instance: a49437df-3059-4528-8328-2f3471d5fb45] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:33:07.627905 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-67062400-3647-4a20-b7ba-3fea938f4fd0 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:33:07.628352 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-67062400-3647-4a20-b7ba-3fea938f4fd0 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:33:07.629185 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-67062400-3647-4a20-b7ba-3fea938f4fd0 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:33:07.629629 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-67062400-3647-4a20-b7ba-3fea938f4fd0 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:33:07.663344 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-67062400-3647-4a20-b7ba-3fea938f4fd0 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] 10.222.0.11 "GET /compute/v2.1/servers/a49437df-3059-4528-8328-2f3471d5fb45/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048044 Nov 17 03:33:07.663900 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 788/1543] 10.222.0.11 () {58 vars in 1301 bytes} [Wed Nov 17 03:33:07 2021] GET /compute/v2.1/servers/a49437df-3059-4528-8328-2f3471d5fb45/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 17 03:33:07.713974 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-59e884c8-a254-46a0-a565-f50c4cb649f3 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:33:07.714578 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-59e884c8-a254-46a0-a565-f50c4cb649f3 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] [instance: 5ddbfaaa-fabf-4324-941c-8868625ffefc] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:33:07.721138 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-59e884c8-a254-46a0-a565-f50c4cb649f3 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:33:07.721581 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-59e884c8-a254-46a0-a565-f50c4cb649f3 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:33:07.722345 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-59e884c8-a254-46a0-a565-f50c4cb649f3 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:33:07.722765 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-59e884c8-a254-46a0-a565-f50c4cb649f3 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:33:07.782864 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-59e884c8-a254-46a0-a565-f50c4cb649f3 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80763e09d44c475ea2425b22874e9612', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fef02a1dd77946a2ac0e0414b557435f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:33:07.790925 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-59e884c8-a254-46a0-a565-f50c4cb649f3 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] 10.222.0.11 "GET /compute/v2.1/servers/5ddbfaaa-fabf-4324-941c-8868625ffefc" status: 200 len: 1226 microversion: 2.1 time: 0.081405 Nov 17 03:33:07.791484 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 756/1544] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:33:07 2021] GET /compute/v2.1/servers/5ddbfaaa-fabf-4324-941c-8868625ffefc => generated 1226 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:33:08.037431 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-57009a67-5632-44de-be1e-163da44da58b tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:33:08.038423 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-57009a67-5632-44de-be1e-163da44da58b tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] [instance: 0698dc5b-5f47-46c4-ace8-f5e891a964a0] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:33:08.045461 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-57009a67-5632-44de-be1e-163da44da58b tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:33:08.045911 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-57009a67-5632-44de-be1e-163da44da58b tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:33:08.046675 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-57009a67-5632-44de-be1e-163da44da58b tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:33:08.047102 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-57009a67-5632-44de-be1e-163da44da58b tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:33:08.195624 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-57009a67-5632-44de-be1e-163da44da58b tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '163b2f24a72649ac8084be1cac32fa09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e123e9b86124c93a7fc2db9984e7466', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:33:08.202690 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-8f8e12da-eab9-4f97-a4da-3e918d3a11f2 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:33:08.203751 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-8f8e12da-eab9-4f97-a4da-3e918d3a11f2 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] [instance: 5d54db85-b991-4890-abaa-952413baa2e7] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:33:08.203912 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-57009a67-5632-44de-be1e-163da44da58b tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] 10.222.0.11 "GET /compute/v2.1/servers/0698dc5b-5f47-46c4-ace8-f5e891a964a0" status: 200 len: 1565 microversion: 2.1 time: 0.172489 Nov 17 03:33:08.204304 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 789/1545] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:33:08 2021] GET /compute/v2.1/servers/0698dc5b-5f47-46c4-ace8-f5e891a964a0 => generated 1565 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:33:08.210377 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-8f8e12da-eab9-4f97-a4da-3e918d3a11f2 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:33:08.210825 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-8f8e12da-eab9-4f97-a4da-3e918d3a11f2 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:33:08.211726 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-8f8e12da-eab9-4f97-a4da-3e918d3a11f2 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:33:08.212193 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-8f8e12da-eab9-4f97-a4da-3e918d3a11f2 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:33:08.241260 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-8f8e12da-eab9-4f97-a4da-3e918d3a11f2 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] 10.222.0.11 "GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042420 Nov 17 03:33:08.241805 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 757/1546] 10.222.0.11 () {60 vars in 1342 bytes} [Wed Nov 17 03:33:08 2021] GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 17 03:33:08.680992 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-32dca1ff-4e76-4b97-a9cb-690ab968cc13 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:33:08.682462 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-32dca1ff-4e76-4b97-a9cb-690ab968cc13 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] [instance: a49437df-3059-4528-8328-2f3471d5fb45] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:33:08.693012 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-32dca1ff-4e76-4b97-a9cb-690ab968cc13 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:33:08.693750 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-32dca1ff-4e76-4b97-a9cb-690ab968cc13 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:33:08.695014 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-32dca1ff-4e76-4b97-a9cb-690ab968cc13 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:33:08.695836 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-32dca1ff-4e76-4b97-a9cb-690ab968cc13 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:33:08.725519 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-32dca1ff-4e76-4b97-a9cb-690ab968cc13 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] 10.222.0.11 "GET /compute/v2.1/servers/a49437df-3059-4528-8328-2f3471d5fb45/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051430 Nov 17 03:33:08.726058 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 790/1547] 10.222.0.11 () {58 vars in 1301 bytes} [Wed Nov 17 03:33:08 2021] GET /compute/v2.1/servers/a49437df-3059-4528-8328-2f3471d5fb45/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 17 03:33:08.812639 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-3a8c53ec-a6cf-4ea2-a642-48584def6fd4 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:33:08.813669 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-3a8c53ec-a6cf-4ea2-a642-48584def6fd4 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] [instance: 5ddbfaaa-fabf-4324-941c-8868625ffefc] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:33:08.823105 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-3a8c53ec-a6cf-4ea2-a642-48584def6fd4 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:33:08.823552 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-3a8c53ec-a6cf-4ea2-a642-48584def6fd4 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:33:08.824312 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-3a8c53ec-a6cf-4ea2-a642-48584def6fd4 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:33:08.824738 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-3a8c53ec-a6cf-4ea2-a642-48584def6fd4 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:33:08.889509 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-3a8c53ec-a6cf-4ea2-a642-48584def6fd4 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80763e09d44c475ea2425b22874e9612', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fef02a1dd77946a2ac0e0414b557435f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:33:08.897163 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-3a8c53ec-a6cf-4ea2-a642-48584def6fd4 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] 10.222.0.11 "GET /compute/v2.1/servers/5ddbfaaa-fabf-4324-941c-8868625ffefc" status: 200 len: 1226 microversion: 2.1 time: 0.090980 Nov 17 03:33:08.897708 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 758/1548] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:33:08 2021] GET /compute/v2.1/servers/5ddbfaaa-fabf-4324-941c-8868625ffefc => generated 1226 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:33:09.227201 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-a6b8b1b4-2b62-40db-9977-ab7af5005013 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:33:09.227846 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-a6b8b1b4-2b62-40db-9977-ab7af5005013 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] [instance: 0698dc5b-5f47-46c4-ace8-f5e891a964a0] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:33:09.234747 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-a6b8b1b4-2b62-40db-9977-ab7af5005013 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:33:09.235202 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-a6b8b1b4-2b62-40db-9977-ab7af5005013 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:33:09.235975 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-a6b8b1b4-2b62-40db-9977-ab7af5005013 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:33:09.236404 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-a6b8b1b4-2b62-40db-9977-ab7af5005013 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:33:09.255262 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-12945d4a-9592-4ce9-8f03-1c056fea4009 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:33:09.256180 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-12945d4a-9592-4ce9-8f03-1c056fea4009 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] [instance: 5d54db85-b991-4890-abaa-952413baa2e7] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:33:09.262345 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-12945d4a-9592-4ce9-8f03-1c056fea4009 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:33:09.262800 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-12945d4a-9592-4ce9-8f03-1c056fea4009 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:33:09.263585 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-12945d4a-9592-4ce9-8f03-1c056fea4009 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:33:09.264022 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-12945d4a-9592-4ce9-8f03-1c056fea4009 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:33:09.294253 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-12945d4a-9592-4ce9-8f03-1c056fea4009 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] 10.222.0.11 "GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043743 Nov 17 03:33:09.295118 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 759/1549] 10.222.0.11 () {60 vars in 1342 bytes} [Wed Nov 17 03:33:09 2021] GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 17 03:33:09.382085 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-a6b8b1b4-2b62-40db-9977-ab7af5005013 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '163b2f24a72649ac8084be1cac32fa09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e123e9b86124c93a7fc2db9984e7466', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:33:09.390348 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-a6b8b1b4-2b62-40db-9977-ab7af5005013 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] 10.222.0.11 "GET /compute/v2.1/servers/0698dc5b-5f47-46c4-ace8-f5e891a964a0" status: 200 len: 1565 microversion: 2.1 time: 0.169495 Nov 17 03:33:09.390929 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 791/1550] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:33:09 2021] GET /compute/v2.1/servers/0698dc5b-5f47-46c4-ace8-f5e891a964a0 => generated 1565 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:33:09.737746 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-558c0c79-f85a-4f83-b696-0a55b84bc62f tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:33:09.738668 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-558c0c79-f85a-4f83-b696-0a55b84bc62f tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] [instance: a49437df-3059-4528-8328-2f3471d5fb45] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:33:09.745262 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-558c0c79-f85a-4f83-b696-0a55b84bc62f tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:33:09.745715 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-558c0c79-f85a-4f83-b696-0a55b84bc62f tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:33:09.746497 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-558c0c79-f85a-4f83-b696-0a55b84bc62f tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:33:09.746934 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-558c0c79-f85a-4f83-b696-0a55b84bc62f tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:33:09.777287 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-558c0c79-f85a-4f83-b696-0a55b84bc62f tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] 10.222.0.11 "GET /compute/v2.1/servers/a49437df-3059-4528-8328-2f3471d5fb45/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043329 Nov 17 03:33:09.777831 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 760/1551] 10.222.0.11 () {58 vars in 1301 bytes} [Wed Nov 17 03:33:09 2021] GET /compute/v2.1/servers/a49437df-3059-4528-8328-2f3471d5fb45/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 17 03:33:09.918456 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-836ec39d-90c2-408f-ae57-aea68d1f5acc tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:33:09.919457 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-836ec39d-90c2-408f-ae57-aea68d1f5acc tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] [instance: 5ddbfaaa-fabf-4324-941c-8868625ffefc] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:33:09.930499 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-836ec39d-90c2-408f-ae57-aea68d1f5acc tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:33:09.930947 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-836ec39d-90c2-408f-ae57-aea68d1f5acc tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:33:09.931728 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-836ec39d-90c2-408f-ae57-aea68d1f5acc tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:33:09.932173 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-836ec39d-90c2-408f-ae57-aea68d1f5acc tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:33:09.999531 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-836ec39d-90c2-408f-ae57-aea68d1f5acc tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80763e09d44c475ea2425b22874e9612', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fef02a1dd77946a2ac0e0414b557435f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:33:10.007768 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-836ec39d-90c2-408f-ae57-aea68d1f5acc tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] 10.222.0.11 "GET /compute/v2.1/servers/5ddbfaaa-fabf-4324-941c-8868625ffefc" status: 200 len: 1226 microversion: 2.1 time: 0.095222 Nov 17 03:33:10.008375 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 792/1552] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:33:09 2021] GET /compute/v2.1/servers/5ddbfaaa-fabf-4324-941c-8868625ffefc => generated 1226 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:33:10.313257 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-04189c56-7881-45d4-8586-497a3525b13b tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:33:10.314766 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-04189c56-7881-45d4-8586-497a3525b13b tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] [instance: 5d54db85-b991-4890-abaa-952413baa2e7] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:33:10.325530 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-04189c56-7881-45d4-8586-497a3525b13b tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:33:10.325976 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-04189c56-7881-45d4-8586-497a3525b13b tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:33:10.326755 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-04189c56-7881-45d4-8586-497a3525b13b tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:33:10.327182 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-04189c56-7881-45d4-8586-497a3525b13b tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:33:10.357874 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-04189c56-7881-45d4-8586-497a3525b13b tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] 10.222.0.11 "GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.053308 Nov 17 03:33:10.358416 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 761/1553] 10.222.0.11 () {60 vars in 1342 bytes} [Wed Nov 17 03:33:10 2021] GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 17 03:33:10.407985 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-b1e9a90b-d04c-4888-841f-d2ecbea264ae tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:33:10.408679 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-b1e9a90b-d04c-4888-841f-d2ecbea264ae tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] [instance: 0698dc5b-5f47-46c4-ace8-f5e891a964a0] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:33:10.415580 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-b1e9a90b-d04c-4888-841f-d2ecbea264ae tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:33:10.416118 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-b1e9a90b-d04c-4888-841f-d2ecbea264ae tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:33:10.416919 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-b1e9a90b-d04c-4888-841f-d2ecbea264ae tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:33:10.417461 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-b1e9a90b-d04c-4888-841f-d2ecbea264ae tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:33:10.557072 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-b1e9a90b-d04c-4888-841f-d2ecbea264ae tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '163b2f24a72649ac8084be1cac32fa09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e123e9b86124c93a7fc2db9984e7466', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:33:10.565488 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-b1e9a90b-d04c-4888-841f-d2ecbea264ae tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] 10.222.0.11 "GET /compute/v2.1/servers/0698dc5b-5f47-46c4-ace8-f5e891a964a0" status: 200 len: 1565 microversion: 2.1 time: 0.161118 Nov 17 03:33:10.565973 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 793/1554] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:33:10 2021] GET /compute/v2.1/servers/0698dc5b-5f47-46c4-ace8-f5e891a964a0 => generated 1565 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:33:10.792286 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-f8cdcd15-11ee-4c56-a46e-4ce569a0c769 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:33:10.793435 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-f8cdcd15-11ee-4c56-a46e-4ce569a0c769 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] [instance: a49437df-3059-4528-8328-2f3471d5fb45] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:33:10.801442 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-f8cdcd15-11ee-4c56-a46e-4ce569a0c769 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:33:10.802009 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-f8cdcd15-11ee-4c56-a46e-4ce569a0c769 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:33:10.802967 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-f8cdcd15-11ee-4c56-a46e-4ce569a0c769 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:33:10.803511 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-f8cdcd15-11ee-4c56-a46e-4ce569a0c769 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:33:10.837237 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-f8cdcd15-11ee-4c56-a46e-4ce569a0c769 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] 10.222.0.11 "GET /compute/v2.1/servers/a49437df-3059-4528-8328-2f3471d5fb45/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050587 Nov 17 03:33:10.837819 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 762/1555] 10.222.0.11 () {58 vars in 1301 bytes} [Wed Nov 17 03:33:10 2021] GET /compute/v2.1/servers/a49437df-3059-4528-8328-2f3471d5fb45/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 17 03:33:11.029144 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-881edff1-90b5-421c-97d6-3730d6cc5ee5 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:33:11.030143 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-881edff1-90b5-421c-97d6-3730d6cc5ee5 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] [instance: 5ddbfaaa-fabf-4324-941c-8868625ffefc] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:33:11.040533 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-881edff1-90b5-421c-97d6-3730d6cc5ee5 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:33:11.041019 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-881edff1-90b5-421c-97d6-3730d6cc5ee5 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:33:11.041798 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-881edff1-90b5-421c-97d6-3730d6cc5ee5 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:33:11.042230 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-881edff1-90b5-421c-97d6-3730d6cc5ee5 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:33:11.106123 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-881edff1-90b5-421c-97d6-3730d6cc5ee5 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80763e09d44c475ea2425b22874e9612', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fef02a1dd77946a2ac0e0414b557435f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:33:11.113829 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-881edff1-90b5-421c-97d6-3730d6cc5ee5 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] 10.222.0.11 "GET /compute/v2.1/servers/5ddbfaaa-fabf-4324-941c-8868625ffefc" status: 200 len: 1226 microversion: 2.1 time: 0.091743 Nov 17 03:33:11.114387 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 794/1556] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:33:11 2021] GET /compute/v2.1/servers/5ddbfaaa-fabf-4324-941c-8868625ffefc => generated 1226 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:33:11.371648 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-61cf61bc-77e6-4eac-b0cc-95a88ace1358 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:33:11.372610 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-61cf61bc-77e6-4eac-b0cc-95a88ace1358 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] [instance: 5d54db85-b991-4890-abaa-952413baa2e7] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:33:11.379028 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-61cf61bc-77e6-4eac-b0cc-95a88ace1358 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:33:11.379477 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-61cf61bc-77e6-4eac-b0cc-95a88ace1358 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:33:11.380245 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-61cf61bc-77e6-4eac-b0cc-95a88ace1358 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:33:11.380677 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-61cf61bc-77e6-4eac-b0cc-95a88ace1358 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:33:11.410918 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-61cf61bc-77e6-4eac-b0cc-95a88ace1358 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] 10.222.0.11 "GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043529 Nov 17 03:33:11.411464 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 763/1557] 10.222.0.11 () {60 vars in 1342 bytes} [Wed Nov 17 03:33:11 2021] GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 17 03:33:11.586475 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-cca3d64c-9f60-40b3-885f-d33093618297 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:33:11.587491 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-cca3d64c-9f60-40b3-885f-d33093618297 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] [instance: 0698dc5b-5f47-46c4-ace8-f5e891a964a0] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:33:11.598107 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-cca3d64c-9f60-40b3-885f-d33093618297 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:33:11.598846 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-cca3d64c-9f60-40b3-885f-d33093618297 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:33:11.600104 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-cca3d64c-9f60-40b3-885f-d33093618297 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:33:11.600829 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-cca3d64c-9f60-40b3-885f-d33093618297 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:33:11.755613 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-cca3d64c-9f60-40b3-885f-d33093618297 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '163b2f24a72649ac8084be1cac32fa09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e123e9b86124c93a7fc2db9984e7466', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:33:11.763700 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-cca3d64c-9f60-40b3-885f-d33093618297 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] 10.222.0.11 "GET /compute/v2.1/servers/0698dc5b-5f47-46c4-ace8-f5e891a964a0" status: 200 len: 1565 microversion: 2.1 time: 0.183542 Nov 17 03:33:11.764256 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 795/1558] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:33:11 2021] GET /compute/v2.1/servers/0698dc5b-5f47-46c4-ace8-f5e891a964a0 => generated 1565 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:33:11.853561 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-c8f991d0-4494-431b-96b7-802c52611bde tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:33:11.854478 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-c8f991d0-4494-431b-96b7-802c52611bde tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] [instance: a49437df-3059-4528-8328-2f3471d5fb45] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:33:11.860933 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-c8f991d0-4494-431b-96b7-802c52611bde tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:33:11.861384 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-c8f991d0-4494-431b-96b7-802c52611bde tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:33:11.862199 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-c8f991d0-4494-431b-96b7-802c52611bde tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:33:11.862633 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-c8f991d0-4494-431b-96b7-802c52611bde tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:33:11.891921 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-c8f991d0-4494-431b-96b7-802c52611bde tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] 10.222.0.11 "GET /compute/v2.1/servers/a49437df-3059-4528-8328-2f3471d5fb45/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043978 Nov 17 03:33:11.892466 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 764/1559] 10.222.0.11 () {58 vars in 1301 bytes} [Wed Nov 17 03:33:11 2021] GET /compute/v2.1/servers/a49437df-3059-4528-8328-2f3471d5fb45/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 17 03:33:12.130763 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-bf39775a-e878-45ab-b85e-64fba5904c56 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:33:12.131371 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-bf39775a-e878-45ab-b85e-64fba5904c56 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] [instance: 5ddbfaaa-fabf-4324-941c-8868625ffefc] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:33:12.137445 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-bf39775a-e878-45ab-b85e-64fba5904c56 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:33:12.137891 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-bf39775a-e878-45ab-b85e-64fba5904c56 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:33:12.138659 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-bf39775a-e878-45ab-b85e-64fba5904c56 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:33:12.139095 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-bf39775a-e878-45ab-b85e-64fba5904c56 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:33:12.201211 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-bf39775a-e878-45ab-b85e-64fba5904c56 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80763e09d44c475ea2425b22874e9612', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fef02a1dd77946a2ac0e0414b557435f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:33:12.212671 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-bf39775a-e878-45ab-b85e-64fba5904c56 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] 10.222.0.11 "GET /compute/v2.1/servers/5ddbfaaa-fabf-4324-941c-8868625ffefc" status: 200 len: 1226 microversion: 2.1 time: 0.085637 Nov 17 03:33:12.213334 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 796/1560] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:33:12 2021] GET /compute/v2.1/servers/5ddbfaaa-fabf-4324-941c-8868625ffefc => generated 1226 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:33:12.424518 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-8bdf1ff0-ef8d-4ad9-a0ad-15cca9092b1f tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:33:12.425399 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-8bdf1ff0-ef8d-4ad9-a0ad-15cca9092b1f tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] [instance: 5d54db85-b991-4890-abaa-952413baa2e7] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:33:12.432420 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-8bdf1ff0-ef8d-4ad9-a0ad-15cca9092b1f tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:33:12.432891 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-8bdf1ff0-ef8d-4ad9-a0ad-15cca9092b1f tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:33:12.433666 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-8bdf1ff0-ef8d-4ad9-a0ad-15cca9092b1f tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:33:12.434095 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-8bdf1ff0-ef8d-4ad9-a0ad-15cca9092b1f tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:33:12.463471 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-8bdf1ff0-ef8d-4ad9-a0ad-15cca9092b1f tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] 10.222.0.11 "GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042830 Nov 17 03:33:12.464325 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 765/1561] 10.222.0.11 () {60 vars in 1342 bytes} [Wed Nov 17 03:33:12 2021] GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 17 03:33:12.782099 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-45bf8b06-2d68-46b6-aad9-daa18982e2bf tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:33:12.782700 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-45bf8b06-2d68-46b6-aad9-daa18982e2bf tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] [instance: 0698dc5b-5f47-46c4-ace8-f5e891a964a0] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:33:12.792195 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-45bf8b06-2d68-46b6-aad9-daa18982e2bf tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:33:12.792837 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-45bf8b06-2d68-46b6-aad9-daa18982e2bf tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:33:12.794024 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-45bf8b06-2d68-46b6-aad9-daa18982e2bf tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:33:12.794615 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-45bf8b06-2d68-46b6-aad9-daa18982e2bf tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:33:12.903598 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-378a1b67-ffbc-42d2-a394-6a31d1a3f9b1 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:33:12.904529 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-378a1b67-ffbc-42d2-a394-6a31d1a3f9b1 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] [instance: a49437df-3059-4528-8328-2f3471d5fb45] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:33:12.910823 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-378a1b67-ffbc-42d2-a394-6a31d1a3f9b1 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:33:12.911270 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-378a1b67-ffbc-42d2-a394-6a31d1a3f9b1 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:33:12.912038 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-378a1b67-ffbc-42d2-a394-6a31d1a3f9b1 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:33:12.912473 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-378a1b67-ffbc-42d2-a394-6a31d1a3f9b1 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:33:12.938835 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-45bf8b06-2d68-46b6-aad9-daa18982e2bf tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '163b2f24a72649ac8084be1cac32fa09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e123e9b86124c93a7fc2db9984e7466', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:33:12.944234 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-378a1b67-ffbc-42d2-a394-6a31d1a3f9b1 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] 10.222.0.11 "GET /compute/v2.1/servers/a49437df-3059-4528-8328-2f3471d5fb45/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044429 Nov 17 03:33:12.944797 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 766/1562] 10.222.0.11 () {58 vars in 1301 bytes} [Wed Nov 17 03:33:12 2021] GET /compute/v2.1/servers/a49437df-3059-4528-8328-2f3471d5fb45/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 17 03:33:12.946243 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-45bf8b06-2d68-46b6-aad9-daa18982e2bf tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] 10.222.0.11 "GET /compute/v2.1/servers/0698dc5b-5f47-46c4-ace8-f5e891a964a0" status: 200 len: 1565 microversion: 2.1 time: 0.168748 Nov 17 03:33:12.946843 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 797/1563] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:33:12 2021] GET /compute/v2.1/servers/0698dc5b-5f47-46c4-ace8-f5e891a964a0 => generated 1565 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:33:13.231009 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-b928bf7b-b9d3-4f65-84fd-78ac850fd456 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:33:13.231665 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-b928bf7b-b9d3-4f65-84fd-78ac850fd456 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] [instance: 5ddbfaaa-fabf-4324-941c-8868625ffefc] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:33:13.238730 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-b928bf7b-b9d3-4f65-84fd-78ac850fd456 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:33:13.239220 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-b928bf7b-b9d3-4f65-84fd-78ac850fd456 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:33:13.240071 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-b928bf7b-b9d3-4f65-84fd-78ac850fd456 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:33:13.240539 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-b928bf7b-b9d3-4f65-84fd-78ac850fd456 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:33:13.307945 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-b928bf7b-b9d3-4f65-84fd-78ac850fd456 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80763e09d44c475ea2425b22874e9612', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fef02a1dd77946a2ac0e0414b557435f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:33:13.316139 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-b928bf7b-b9d3-4f65-84fd-78ac850fd456 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] 10.222.0.11 "GET /compute/v2.1/servers/5ddbfaaa-fabf-4324-941c-8868625ffefc" status: 200 len: 1226 microversion: 2.1 time: 0.089624 Nov 17 03:33:13.316610 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 767/1564] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:33:13 2021] GET /compute/v2.1/servers/5ddbfaaa-fabf-4324-941c-8868625ffefc => generated 1226 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:33:13.477255 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-814ae5fd-3a9f-4a85-8842-2d376e921fef tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:33:13.478526 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-814ae5fd-3a9f-4a85-8842-2d376e921fef tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] [instance: 5d54db85-b991-4890-abaa-952413baa2e7] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:33:13.486362 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-814ae5fd-3a9f-4a85-8842-2d376e921fef tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:33:13.486906 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-814ae5fd-3a9f-4a85-8842-2d376e921fef tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:33:13.487856 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-814ae5fd-3a9f-4a85-8842-2d376e921fef tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:33:13.488305 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-814ae5fd-3a9f-4a85-8842-2d376e921fef tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:33:13.527994 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-814ae5fd-3a9f-4a85-8842-2d376e921fef tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] 10.222.0.11 "GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.055766 Nov 17 03:33:13.528549 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 798/1565] 10.222.0.11 () {60 vars in 1342 bytes} [Wed Nov 17 03:33:13 2021] GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7/os-volume_attachments => generated 197 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 17 03:33:13.960186 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-5c4a6ee6-daef-4d5e-9ae7-6444c444de38 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:33:13.961947 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-5c4a6ee6-daef-4d5e-9ae7-6444c444de38 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] [instance: a49437df-3059-4528-8328-2f3471d5fb45] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:33:13.966738 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-534fe7f2-f57b-44b2-a45a-34028bfb87bf tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:33:13.967747 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-534fe7f2-f57b-44b2-a45a-34028bfb87bf tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] [instance: 0698dc5b-5f47-46c4-ace8-f5e891a964a0] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:33:13.973615 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-5c4a6ee6-daef-4d5e-9ae7-6444c444de38 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:33:13.974349 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-5c4a6ee6-daef-4d5e-9ae7-6444c444de38 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:33:13.975798 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-5c4a6ee6-daef-4d5e-9ae7-6444c444de38 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:33:13.976521 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-5c4a6ee6-daef-4d5e-9ae7-6444c444de38 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:33:13.977908 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-534fe7f2-f57b-44b2-a45a-34028bfb87bf tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:33:13.978362 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-534fe7f2-f57b-44b2-a45a-34028bfb87bf tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:33:13.979260 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-534fe7f2-f57b-44b2-a45a-34028bfb87bf tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:33:13.979695 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-534fe7f2-f57b-44b2-a45a-34028bfb87bf tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:33:14.006525 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-5c4a6ee6-daef-4d5e-9ae7-6444c444de38 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] 10.222.0.11 "GET /compute/v2.1/servers/a49437df-3059-4528-8328-2f3471d5fb45/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052713 Nov 17 03:33:14.007294 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 768/1566] 10.222.0.11 () {58 vars in 1301 bytes} [Wed Nov 17 03:33:13 2021] GET /compute/v2.1/servers/a49437df-3059-4528-8328-2f3471d5fb45/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 17 03:33:14.122155 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-534fe7f2-f57b-44b2-a45a-34028bfb87bf tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '163b2f24a72649ac8084be1cac32fa09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e123e9b86124c93a7fc2db9984e7466', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:33:14.133934 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-534fe7f2-f57b-44b2-a45a-34028bfb87bf tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] 10.222.0.11 "GET /compute/v2.1/servers/0698dc5b-5f47-46c4-ace8-f5e891a964a0" status: 200 len: 1565 microversion: 2.1 time: 0.172926 Nov 17 03:33:14.134678 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 799/1567] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:33:13 2021] GET /compute/v2.1/servers/0698dc5b-5f47-46c4-ace8-f5e891a964a0 => generated 1565 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:33:14.336820 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-75acea78-1e18-4929-a5f3-a0b4852872e3 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:33:14.337477 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-75acea78-1e18-4929-a5f3-a0b4852872e3 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] [instance: 5ddbfaaa-fabf-4324-941c-8868625ffefc] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:33:14.343916 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-75acea78-1e18-4929-a5f3-a0b4852872e3 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:33:14.344405 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-75acea78-1e18-4929-a5f3-a0b4852872e3 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:33:14.345225 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-75acea78-1e18-4929-a5f3-a0b4852872e3 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:33:14.345663 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-75acea78-1e18-4929-a5f3-a0b4852872e3 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:33:14.405215 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-75acea78-1e18-4929-a5f3-a0b4852872e3 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80763e09d44c475ea2425b22874e9612', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fef02a1dd77946a2ac0e0414b557435f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:33:14.413097 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-75acea78-1e18-4929-a5f3-a0b4852872e3 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] 10.222.0.11 "GET /compute/v2.1/servers/5ddbfaaa-fabf-4324-941c-8868625ffefc" status: 200 len: 1226 microversion: 2.1 time: 0.082427 Nov 17 03:33:14.413664 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 769/1568] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:33:14 2021] GET /compute/v2.1/servers/5ddbfaaa-fabf-4324-941c-8868625ffefc => generated 1226 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:33:14.545407 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-d7fe457c-1764-4696-882b-81b0196a3fd9 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:33:14.546895 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-d7fe457c-1764-4696-882b-81b0196a3fd9 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] [instance: 5d54db85-b991-4890-abaa-952413baa2e7] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:33:14.557795 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-d7fe457c-1764-4696-882b-81b0196a3fd9 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:33:14.558540 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-d7fe457c-1764-4696-882b-81b0196a3fd9 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:33:14.559860 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-d7fe457c-1764-4696-882b-81b0196a3fd9 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:33:14.560544 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-d7fe457c-1764-4696-882b-81b0196a3fd9 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:33:14.594531 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-d7fe457c-1764-4696-882b-81b0196a3fd9 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] 10.222.0.11 "GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.055512 Nov 17 03:33:14.594999 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 800/1569] 10.222.0.11 () {60 vars in 1342 bytes} [Wed Nov 17 03:33:14 2021] GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7/os-volume_attachments => generated 197 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 17 03:33:15.022292 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-dbd9f4a0-13ce-4238-9013-771240654426 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:33:15.023798 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-dbd9f4a0-13ce-4238-9013-771240654426 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] [instance: a49437df-3059-4528-8328-2f3471d5fb45] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:33:15.030419 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-dbd9f4a0-13ce-4238-9013-771240654426 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:33:15.030859 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-dbd9f4a0-13ce-4238-9013-771240654426 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:33:15.031626 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-dbd9f4a0-13ce-4238-9013-771240654426 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:33:15.032056 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-dbd9f4a0-13ce-4238-9013-771240654426 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:33:15.061364 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-dbd9f4a0-13ce-4238-9013-771240654426 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] 10.222.0.11 "GET /compute/v2.1/servers/a49437df-3059-4528-8328-2f3471d5fb45/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045380 Nov 17 03:33:15.061918 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 770/1570] 10.222.0.11 () {58 vars in 1301 bytes} [Wed Nov 17 03:33:15 2021] GET /compute/v2.1/servers/a49437df-3059-4528-8328-2f3471d5fb45/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 17 03:33:15.151690 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-392d37af-2f44-470c-9e9d-6db9ed8a2f9c tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:33:15.152323 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-392d37af-2f44-470c-9e9d-6db9ed8a2f9c tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] [instance: 0698dc5b-5f47-46c4-ace8-f5e891a964a0] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:33:15.159092 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-392d37af-2f44-470c-9e9d-6db9ed8a2f9c tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:33:15.159543 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-392d37af-2f44-470c-9e9d-6db9ed8a2f9c tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:33:15.160306 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-392d37af-2f44-470c-9e9d-6db9ed8a2f9c tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:33:15.160742 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-392d37af-2f44-470c-9e9d-6db9ed8a2f9c tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:33:15.307224 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-392d37af-2f44-470c-9e9d-6db9ed8a2f9c tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '163b2f24a72649ac8084be1cac32fa09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e123e9b86124c93a7fc2db9984e7466', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:33:15.318844 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-392d37af-2f44-470c-9e9d-6db9ed8a2f9c tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] 10.222.0.11 "GET /compute/v2.1/servers/0698dc5b-5f47-46c4-ace8-f5e891a964a0" status: 200 len: 1565 microversion: 2.1 time: 0.171100 Nov 17 03:33:15.319648 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 801/1571] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:33:15 2021] GET /compute/v2.1/servers/0698dc5b-5f47-46c4-ace8-f5e891a964a0 => generated 1565 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:33:15.432296 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-85b9dce3-6985-4a87-aa11-b0866645a09b tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:33:15.433089 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-85b9dce3-6985-4a87-aa11-b0866645a09b tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] [instance: 5ddbfaaa-fabf-4324-941c-8868625ffefc] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:33:15.441084 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-85b9dce3-6985-4a87-aa11-b0866645a09b tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:33:15.441641 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-85b9dce3-6985-4a87-aa11-b0866645a09b tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:33:15.442590 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-85b9dce3-6985-4a87-aa11-b0866645a09b tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:33:15.443125 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-85b9dce3-6985-4a87-aa11-b0866645a09b tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:33:15.503572 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-85b9dce3-6985-4a87-aa11-b0866645a09b tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80763e09d44c475ea2425b22874e9612', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fef02a1dd77946a2ac0e0414b557435f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:33:15.511291 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-85b9dce3-6985-4a87-aa11-b0866645a09b tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] 10.222.0.11 "GET /compute/v2.1/servers/5ddbfaaa-fabf-4324-941c-8868625ffefc" status: 200 len: 1226 microversion: 2.1 time: 0.084174 Nov 17 03:33:15.511846 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 771/1572] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:33:15 2021] GET /compute/v2.1/servers/5ddbfaaa-fabf-4324-941c-8868625ffefc => generated 1226 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:33:15.610453 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-8e333b38-c4e0-45c8-adec-fe39a10d67b7 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:33:15.611804 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-8e333b38-c4e0-45c8-adec-fe39a10d67b7 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] [instance: 5d54db85-b991-4890-abaa-952413baa2e7] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:33:15.620321 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-8e333b38-c4e0-45c8-adec-fe39a10d67b7 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:33:15.620763 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-8e333b38-c4e0-45c8-adec-fe39a10d67b7 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:33:15.621561 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-8e333b38-c4e0-45c8-adec-fe39a10d67b7 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:33:15.621992 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-8e333b38-c4e0-45c8-adec-fe39a10d67b7 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:33:15.653519 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-8e333b38-c4e0-45c8-adec-fe39a10d67b7 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] 10.222.0.11 "GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.049862 Nov 17 03:33:15.654070 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 802/1573] 10.222.0.11 () {60 vars in 1342 bytes} [Wed Nov 17 03:33:15 2021] GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 17 03:33:16.075171 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-f7728b04-6f66-4699-b3bb-6aa15d1c3d58 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:33:16.076087 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-f7728b04-6f66-4699-b3bb-6aa15d1c3d58 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] [instance: a49437df-3059-4528-8328-2f3471d5fb45] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:33:16.082924 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-f7728b04-6f66-4699-b3bb-6aa15d1c3d58 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:33:16.083370 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-f7728b04-6f66-4699-b3bb-6aa15d1c3d58 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:33:16.084143 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-f7728b04-6f66-4699-b3bb-6aa15d1c3d58 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:33:16.084570 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-f7728b04-6f66-4699-b3bb-6aa15d1c3d58 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:33:16.114554 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-f7728b04-6f66-4699-b3bb-6aa15d1c3d58 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] 10.222.0.11 "GET /compute/v2.1/servers/a49437df-3059-4528-8328-2f3471d5fb45/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043848 Nov 17 03:33:16.115097 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 772/1574] 10.222.0.11 () {58 vars in 1301 bytes} [Wed Nov 17 03:33:16 2021] GET /compute/v2.1/servers/a49437df-3059-4528-8328-2f3471d5fb45/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 17 03:33:16.340284 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-d7928cf1-04d5-45c9-b7ea-ae0f637f0689 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:33:16.341092 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-d7928cf1-04d5-45c9-b7ea-ae0f637f0689 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] [instance: 0698dc5b-5f47-46c4-ace8-f5e891a964a0] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:33:16.351403 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-d7928cf1-04d5-45c9-b7ea-ae0f637f0689 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:33:16.352546 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-d7928cf1-04d5-45c9-b7ea-ae0f637f0689 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:33:16.353379 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-d7928cf1-04d5-45c9-b7ea-ae0f637f0689 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:33:16.353817 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-d7928cf1-04d5-45c9-b7ea-ae0f637f0689 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:33:16.502586 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-d7928cf1-04d5-45c9-b7ea-ae0f637f0689 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '163b2f24a72649ac8084be1cac32fa09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e123e9b86124c93a7fc2db9984e7466', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:33:16.514853 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-d7928cf1-04d5-45c9-b7ea-ae0f637f0689 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] 10.222.0.11 "GET /compute/v2.1/servers/0698dc5b-5f47-46c4-ace8-f5e891a964a0" status: 200 len: 1565 microversion: 2.1 time: 0.181586 Nov 17 03:33:16.515809 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 803/1575] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:33:16 2021] GET /compute/v2.1/servers/0698dc5b-5f47-46c4-ace8-f5e891a964a0 => generated 1565 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:33:16.528393 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-8200691c-0458-4b3f-ac42-a30186813e8b tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:33:16.529111 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-8200691c-0458-4b3f-ac42-a30186813e8b tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] [instance: 5ddbfaaa-fabf-4324-941c-8868625ffefc] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:33:16.535590 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-8200691c-0458-4b3f-ac42-a30186813e8b tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:33:16.536037 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-8200691c-0458-4b3f-ac42-a30186813e8b tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:33:16.536812 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-8200691c-0458-4b3f-ac42-a30186813e8b tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:33:16.537267 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-8200691c-0458-4b3f-ac42-a30186813e8b tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:33:16.602027 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-8200691c-0458-4b3f-ac42-a30186813e8b tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80763e09d44c475ea2425b22874e9612', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fef02a1dd77946a2ac0e0414b557435f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:33:16.609371 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-8200691c-0458-4b3f-ac42-a30186813e8b tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] 10.222.0.11 "GET /compute/v2.1/servers/5ddbfaaa-fabf-4324-941c-8868625ffefc" status: 200 len: 1226 microversion: 2.1 time: 0.084757 Nov 17 03:33:16.609933 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 773/1576] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:33:16 2021] GET /compute/v2.1/servers/5ddbfaaa-fabf-4324-941c-8868625ffefc => generated 1226 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:33:16.671622 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-8d55e44f-68df-42a8-943d-72d8cfd97ebd tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:33:16.673212 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-8d55e44f-68df-42a8-943d-72d8cfd97ebd tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] [instance: 5d54db85-b991-4890-abaa-952413baa2e7] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:33:16.682579 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-8d55e44f-68df-42a8-943d-72d8cfd97ebd tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:33:16.683024 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-8d55e44f-68df-42a8-943d-72d8cfd97ebd tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:33:16.683793 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-8d55e44f-68df-42a8-943d-72d8cfd97ebd tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:33:16.684227 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-8d55e44f-68df-42a8-943d-72d8cfd97ebd tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:33:16.713576 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-8d55e44f-68df-42a8-943d-72d8cfd97ebd tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] 10.222.0.11 "GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.049409 Nov 17 03:33:16.714137 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 804/1577] 10.222.0.11 () {60 vars in 1342 bytes} [Wed Nov 17 03:33:16 2021] GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 17 03:33:17.126962 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-9d7ff728-a5f6-4a10-a2fb-1e90ddf0292f tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:33:17.127900 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-9d7ff728-a5f6-4a10-a2fb-1e90ddf0292f tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] [instance: a49437df-3059-4528-8328-2f3471d5fb45] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:33:17.134922 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-9d7ff728-a5f6-4a10-a2fb-1e90ddf0292f tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:33:17.135345 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-9d7ff728-a5f6-4a10-a2fb-1e90ddf0292f tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:33:17.136115 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-9d7ff728-a5f6-4a10-a2fb-1e90ddf0292f tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:33:17.136540 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-9d7ff728-a5f6-4a10-a2fb-1e90ddf0292f tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:33:17.166456 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-9d7ff728-a5f6-4a10-a2fb-1e90ddf0292f tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] 10.222.0.11 "GET /compute/v2.1/servers/a49437df-3059-4528-8328-2f3471d5fb45/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043510 Nov 17 03:33:17.166917 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 774/1578] 10.222.0.11 () {58 vars in 1301 bytes} [Wed Nov 17 03:33:17 2021] GET /compute/v2.1/servers/a49437df-3059-4528-8328-2f3471d5fb45/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 17 03:33:17.539179 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-3ff474b4-32c2-43b5-a9a3-ca8337c348d2 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:33:17.540064 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-3ff474b4-32c2-43b5-a9a3-ca8337c348d2 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] [instance: 0698dc5b-5f47-46c4-ace8-f5e891a964a0] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:33:17.547379 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-3ff474b4-32c2-43b5-a9a3-ca8337c348d2 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:33:17.547858 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-3ff474b4-32c2-43b5-a9a3-ca8337c348d2 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:33:17.548674 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-3ff474b4-32c2-43b5-a9a3-ca8337c348d2 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:33:17.549169 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-3ff474b4-32c2-43b5-a9a3-ca8337c348d2 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:33:17.626854 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-b2be3b01-e73e-4167-9638-f9039028a56f tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:33:17.627459 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-b2be3b01-e73e-4167-9638-f9039028a56f tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] [instance: 5ddbfaaa-fabf-4324-941c-8868625ffefc] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:33:17.633623 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-b2be3b01-e73e-4167-9638-f9039028a56f tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:33:17.634068 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-b2be3b01-e73e-4167-9638-f9039028a56f tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:33:17.634835 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-b2be3b01-e73e-4167-9638-f9039028a56f tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:33:17.635260 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-b2be3b01-e73e-4167-9638-f9039028a56f tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:33:17.683737 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-3ff474b4-32c2-43b5-a9a3-ca8337c348d2 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '163b2f24a72649ac8084be1cac32fa09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e123e9b86124c93a7fc2db9984e7466', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:33:17.691230 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-3ff474b4-32c2-43b5-a9a3-ca8337c348d2 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] 10.222.0.11 "GET /compute/v2.1/servers/0698dc5b-5f47-46c4-ace8-f5e891a964a0" status: 200 len: 1565 microversion: 2.1 time: 0.158373 Nov 17 03:33:17.692664 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 805/1579] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:33:17 2021] GET /compute/v2.1/servers/0698dc5b-5f47-46c4-ace8-f5e891a964a0 => generated 1565 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:33:17.695693 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-b2be3b01-e73e-4167-9638-f9039028a56f tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80763e09d44c475ea2425b22874e9612', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fef02a1dd77946a2ac0e0414b557435f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:33:17.703136 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-b2be3b01-e73e-4167-9638-f9039028a56f tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] 10.222.0.11 "GET /compute/v2.1/servers/5ddbfaaa-fabf-4324-941c-8868625ffefc" status: 200 len: 1226 microversion: 2.1 time: 0.079926 Nov 17 03:33:17.703685 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 775/1580] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:33:17 2021] GET /compute/v2.1/servers/5ddbfaaa-fabf-4324-941c-8868625ffefc => generated 1226 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:33:17.725318 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-924f2eae-a8b7-417a-83b4-6931a3b887c6 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:33:17.726229 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-924f2eae-a8b7-417a-83b4-6931a3b887c6 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] [instance: 5d54db85-b991-4890-abaa-952413baa2e7] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:33:17.732517 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-924f2eae-a8b7-417a-83b4-6931a3b887c6 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:33:17.733005 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-924f2eae-a8b7-417a-83b4-6931a3b887c6 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:33:17.733776 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-924f2eae-a8b7-417a-83b4-6931a3b887c6 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:33:17.734207 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-924f2eae-a8b7-417a-83b4-6931a3b887c6 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:33:17.762011 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-924f2eae-a8b7-417a-83b4-6931a3b887c6 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] 10.222.0.11 "GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.040571 Nov 17 03:33:17.762555 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 806/1581] 10.222.0.11 () {60 vars in 1342 bytes} [Wed Nov 17 03:33:17 2021] GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 17 03:33:18.181419 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-7def0dc8-5278-434b-96d5-0ad90448ebd7 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:33:18.182468 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-7def0dc8-5278-434b-96d5-0ad90448ebd7 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] [instance: a49437df-3059-4528-8328-2f3471d5fb45] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:33:18.190289 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-7def0dc8-5278-434b-96d5-0ad90448ebd7 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:33:18.190806 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-7def0dc8-5278-434b-96d5-0ad90448ebd7 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:33:18.191802 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-7def0dc8-5278-434b-96d5-0ad90448ebd7 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:33:18.192295 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-7def0dc8-5278-434b-96d5-0ad90448ebd7 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:33:18.228896 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-7def0dc8-5278-434b-96d5-0ad90448ebd7 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] 10.222.0.11 "GET /compute/v2.1/servers/a49437df-3059-4528-8328-2f3471d5fb45/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053962 Nov 17 03:33:18.229457 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 776/1582] 10.222.0.11 () {58 vars in 1301 bytes} [Wed Nov 17 03:33:18 2021] GET /compute/v2.1/servers/a49437df-3059-4528-8328-2f3471d5fb45/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 17 03:33:18.713825 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-b8d9ce6f-fdae-41a5-a004-d7926e980d9e tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:33:18.714564 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-b8d9ce6f-fdae-41a5-a004-d7926e980d9e tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] [instance: 0698dc5b-5f47-46c4-ace8-f5e891a964a0] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:33:18.721817 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-6eaaab65-44ec-49f6-a1c9-d83adb452d1e tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:33:18.722760 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-6eaaab65-44ec-49f6-a1c9-d83adb452d1e tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] [instance: 5ddbfaaa-fabf-4324-941c-8868625ffefc] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:33:18.722959 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-b8d9ce6f-fdae-41a5-a004-d7926e980d9e tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:33:18.723329 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-b8d9ce6f-fdae-41a5-a004-d7926e980d9e tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:33:18.724301 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-b8d9ce6f-fdae-41a5-a004-d7926e980d9e tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:33:18.724900 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-b8d9ce6f-fdae-41a5-a004-d7926e980d9e tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:33:18.730035 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-6eaaab65-44ec-49f6-a1c9-d83adb452d1e tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:33:18.730622 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-6eaaab65-44ec-49f6-a1c9-d83adb452d1e tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:33:18.731542 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-6eaaab65-44ec-49f6-a1c9-d83adb452d1e tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:33:18.732118 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-6eaaab65-44ec-49f6-a1c9-d83adb452d1e tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:33:18.799050 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-6eaaab65-44ec-49f6-a1c9-d83adb452d1e tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80763e09d44c475ea2425b22874e9612', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fef02a1dd77946a2ac0e0414b557435f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:33:18.806927 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-6eaaab65-44ec-49f6-a1c9-d83adb452d1e tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] 10.222.0.11 "GET /compute/v2.1/servers/5ddbfaaa-fabf-4324-941c-8868625ffefc" status: 200 len: 1226 microversion: 2.1 time: 0.089695 Nov 17 03:33:18.807461 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 777/1583] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:33:18 2021] GET /compute/v2.1/servers/5ddbfaaa-fabf-4324-941c-8868625ffefc => generated 1226 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:33:18.812339 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-9a2a2a3f-4f67-4367-b565-5c22c90a845b tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:33:18.812764 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-9a2a2a3f-4f67-4367-b565-5c22c90a845b tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] [instance: 5d54db85-b991-4890-abaa-952413baa2e7] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:33:18.818509 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-9a2a2a3f-4f67-4367-b565-5c22c90a845b tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:33:18.818954 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-9a2a2a3f-4f67-4367-b565-5c22c90a845b tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:33:18.819681 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-9a2a2a3f-4f67-4367-b565-5c22c90a845b tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:33:18.820129 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-9a2a2a3f-4f67-4367-b565-5c22c90a845b tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:33:18.851661 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-9a2a2a3f-4f67-4367-b565-5c22c90a845b tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] 10.222.0.11 "GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043118 Nov 17 03:33:18.852283 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 778/1584] 10.222.0.11 () {60 vars in 1342 bytes} [Wed Nov 17 03:33:18 2021] GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 17 03:33:18.874563 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-b8d9ce6f-fdae-41a5-a004-d7926e980d9e tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '163b2f24a72649ac8084be1cac32fa09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e123e9b86124c93a7fc2db9984e7466', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:33:18.881933 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-b8d9ce6f-fdae-41a5-a004-d7926e980d9e tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] 10.222.0.11 "GET /compute/v2.1/servers/0698dc5b-5f47-46c4-ace8-f5e891a964a0" status: 200 len: 1565 microversion: 2.1 time: 0.174288 Nov 17 03:33:18.882522 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 807/1585] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:33:18 2021] GET /compute/v2.1/servers/0698dc5b-5f47-46c4-ace8-f5e891a964a0 => generated 1565 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:33:19.244801 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-3806610b-28b0-4685-a1c2-6479d1774190 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:33:19.246265 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-3806610b-28b0-4685-a1c2-6479d1774190 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] [instance: a49437df-3059-4528-8328-2f3471d5fb45] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:33:19.256191 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-3806610b-28b0-4685-a1c2-6479d1774190 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:33:19.257032 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-3806610b-28b0-4685-a1c2-6479d1774190 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:33:19.258589 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-3806610b-28b0-4685-a1c2-6479d1774190 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:33:19.259042 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-3806610b-28b0-4685-a1c2-6479d1774190 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:33:19.288145 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-3806610b-28b0-4685-a1c2-6479d1774190 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] 10.222.0.11 "GET /compute/v2.1/servers/a49437df-3059-4528-8328-2f3471d5fb45/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049685 Nov 17 03:33:19.288701 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 779/1586] 10.222.0.11 () {58 vars in 1301 bytes} [Wed Nov 17 03:33:19 2021] GET /compute/v2.1/servers/a49437df-3059-4528-8328-2f3471d5fb45/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 17 03:33:19.827478 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-4fe88a53-b460-4bfe-804b-78f8d27ae06d tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:33:19.828178 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-4fe88a53-b460-4bfe-804b-78f8d27ae06d tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] [instance: 5ddbfaaa-fabf-4324-941c-8868625ffefc] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:33:19.838332 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-4fe88a53-b460-4bfe-804b-78f8d27ae06d tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:33:19.838977 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-4fe88a53-b460-4bfe-804b-78f8d27ae06d tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:33:19.839918 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-4fe88a53-b460-4bfe-804b-78f8d27ae06d tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:33:19.840425 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-4fe88a53-b460-4bfe-804b-78f8d27ae06d tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:33:19.863646 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-d8e28d2f-cfe1-4611-835d-2b57a7489b3c tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:33:19.864554 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-d8e28d2f-cfe1-4611-835d-2b57a7489b3c tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] [instance: 5d54db85-b991-4890-abaa-952413baa2e7] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:33:19.872893 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-d8e28d2f-cfe1-4611-835d-2b57a7489b3c tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:33:19.873495 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-d8e28d2f-cfe1-4611-835d-2b57a7489b3c tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:33:19.874282 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-d8e28d2f-cfe1-4611-835d-2b57a7489b3c tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:33:19.874891 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-d8e28d2f-cfe1-4611-835d-2b57a7489b3c tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:33:19.905512 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-d8e28d2f-cfe1-4611-835d-2b57a7489b3c tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] 10.222.0.11 "GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045238 Nov 17 03:33:19.905974 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 780/1587] 10.222.0.11 () {60 vars in 1342 bytes} [Wed Nov 17 03:33:19 2021] GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 17 03:33:19.907472 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-4fe88a53-b460-4bfe-804b-78f8d27ae06d tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80763e09d44c475ea2425b22874e9612', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fef02a1dd77946a2ac0e0414b557435f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:33:19.910279 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-e3440502-fe37-42cf-b91b-5298023c95c4 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:33:19.910880 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-e3440502-fe37-42cf-b91b-5298023c95c4 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] [instance: 0698dc5b-5f47-46c4-ace8-f5e891a964a0] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:33:19.915321 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-4fe88a53-b460-4bfe-804b-78f8d27ae06d tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] 10.222.0.11 "GET /compute/v2.1/servers/5ddbfaaa-fabf-4324-941c-8868625ffefc" status: 200 len: 1226 microversion: 2.1 time: 0.093524 Nov 17 03:33:19.916204 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 808/1588] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:33:19 2021] GET /compute/v2.1/servers/5ddbfaaa-fabf-4324-941c-8868625ffefc => generated 1226 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:33:19.916759 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-e3440502-fe37-42cf-b91b-5298023c95c4 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:33:19.917301 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-e3440502-fe37-42cf-b91b-5298023c95c4 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:33:19.918078 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-e3440502-fe37-42cf-b91b-5298023c95c4 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:33:19.918501 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-e3440502-fe37-42cf-b91b-5298023c95c4 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:33:20.059879 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-e3440502-fe37-42cf-b91b-5298023c95c4 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '163b2f24a72649ac8084be1cac32fa09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e123e9b86124c93a7fc2db9984e7466', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:33:20.069878 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-e3440502-fe37-42cf-b91b-5298023c95c4 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] 10.222.0.11 "GET /compute/v2.1/servers/0698dc5b-5f47-46c4-ace8-f5e891a964a0" status: 200 len: 1565 microversion: 2.1 time: 0.162640 Nov 17 03:33:20.070697 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 781/1589] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:33:19 2021] GET /compute/v2.1/servers/0698dc5b-5f47-46c4-ace8-f5e891a964a0 => generated 1565 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:33:20.305310 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-053824b2-0335-4271-bfb4-961ef2ca185e tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:33:20.306658 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-053824b2-0335-4271-bfb4-961ef2ca185e tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] [instance: a49437df-3059-4528-8328-2f3471d5fb45] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:33:20.313453 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-053824b2-0335-4271-bfb4-961ef2ca185e tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:33:20.313903 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-053824b2-0335-4271-bfb4-961ef2ca185e tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:33:20.314673 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-053824b2-0335-4271-bfb4-961ef2ca185e tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:33:20.315106 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-053824b2-0335-4271-bfb4-961ef2ca185e tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:33:20.346615 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-053824b2-0335-4271-bfb4-961ef2ca185e tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] 10.222.0.11 "GET /compute/v2.1/servers/a49437df-3059-4528-8328-2f3471d5fb45/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048477 Nov 17 03:33:20.347165 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 809/1590] 10.222.0.11 () {58 vars in 1301 bytes} [Wed Nov 17 03:33:20 2021] GET /compute/v2.1/servers/a49437df-3059-4528-8328-2f3471d5fb45/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 17 03:33:20.919339 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-52964acc-52ce-4ed5-9aec-974762f8efef tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:33:20.920434 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-52964acc-52ce-4ed5-9aec-974762f8efef tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] [instance: 5d54db85-b991-4890-abaa-952413baa2e7] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:33:20.930759 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-52964acc-52ce-4ed5-9aec-974762f8efef tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:33:20.931250 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-52964acc-52ce-4ed5-9aec-974762f8efef tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:33:20.932042 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-52964acc-52ce-4ed5-9aec-974762f8efef tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:33:20.932483 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-52964acc-52ce-4ed5-9aec-974762f8efef tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:33:20.938420 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-8d216420-8b25-4e90-aa77-d899c4d73050 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:33:20.939602 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-8d216420-8b25-4e90-aa77-d899c4d73050 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] [instance: 5ddbfaaa-fabf-4324-941c-8868625ffefc] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:33:20.946165 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-8d216420-8b25-4e90-aa77-d899c4d73050 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:33:20.946751 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-8d216420-8b25-4e90-aa77-d899c4d73050 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:33:20.947531 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-8d216420-8b25-4e90-aa77-d899c4d73050 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:33:20.947958 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-8d216420-8b25-4e90-aa77-d899c4d73050 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:33:20.962606 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-52964acc-52ce-4ed5-9aec-974762f8efef tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] 10.222.0.11 "GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.049480 Nov 17 03:33:20.963176 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 782/1591] 10.222.0.11 () {60 vars in 1342 bytes} [Wed Nov 17 03:33:20 2021] GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 17 03:33:21.007942 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-8d216420-8b25-4e90-aa77-d899c4d73050 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80763e09d44c475ea2425b22874e9612', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fef02a1dd77946a2ac0e0414b557435f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:33:21.018713 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-8d216420-8b25-4e90-aa77-d899c4d73050 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] 10.222.0.11 "GET /compute/v2.1/servers/5ddbfaaa-fabf-4324-941c-8868625ffefc" status: 200 len: 1226 microversion: 2.1 time: 0.083914 Nov 17 03:33:21.019285 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 810/1592] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:33:20 2021] GET /compute/v2.1/servers/5ddbfaaa-fabf-4324-941c-8868625ffefc => generated 1226 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:33:21.087780 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-1048905a-f1ea-4fe5-9e2e-c87bc971bb9d tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:33:21.088420 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-1048905a-f1ea-4fe5-9e2e-c87bc971bb9d tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] [instance: 0698dc5b-5f47-46c4-ace8-f5e891a964a0] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:33:21.094886 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-1048905a-f1ea-4fe5-9e2e-c87bc971bb9d tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:33:21.095334 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-1048905a-f1ea-4fe5-9e2e-c87bc971bb9d tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:33:21.096101 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-1048905a-f1ea-4fe5-9e2e-c87bc971bb9d tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:33:21.096538 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-1048905a-f1ea-4fe5-9e2e-c87bc971bb9d tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:33:21.238187 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-1048905a-f1ea-4fe5-9e2e-c87bc971bb9d tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '163b2f24a72649ac8084be1cac32fa09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e123e9b86124c93a7fc2db9984e7466', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:33:21.250050 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-1048905a-f1ea-4fe5-9e2e-c87bc971bb9d tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] 10.222.0.11 "GET /compute/v2.1/servers/0698dc5b-5f47-46c4-ace8-f5e891a964a0" status: 200 len: 1565 microversion: 2.1 time: 0.166145 Nov 17 03:33:21.250893 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 783/1593] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:33:21 2021] GET /compute/v2.1/servers/0698dc5b-5f47-46c4-ace8-f5e891a964a0 => generated 1565 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:33:21.363582 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-45a27ab4-655f-4bcf-bbcd-169b9049cd14 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:33:21.365116 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-45a27ab4-655f-4bcf-bbcd-169b9049cd14 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] [instance: a49437df-3059-4528-8328-2f3471d5fb45] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:33:21.375330 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-45a27ab4-655f-4bcf-bbcd-169b9049cd14 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:33:21.376093 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-45a27ab4-655f-4bcf-bbcd-169b9049cd14 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:33:21.377422 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-45a27ab4-655f-4bcf-bbcd-169b9049cd14 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:33:21.378146 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-45a27ab4-655f-4bcf-bbcd-169b9049cd14 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:33:21.409571 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-45a27ab4-655f-4bcf-bbcd-169b9049cd14 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] 10.222.0.11 "GET /compute/v2.1/servers/a49437df-3059-4528-8328-2f3471d5fb45/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052400 Nov 17 03:33:21.410115 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 811/1594] 10.222.0.11 () {58 vars in 1301 bytes} [Wed Nov 17 03:33:21 2021] GET /compute/v2.1/servers/a49437df-3059-4528-8328-2f3471d5fb45/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 17 03:33:21.978179 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-090f678e-db89-4ade-ac1d-7bb67d522187 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:33:21.978992 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-090f678e-db89-4ade-ac1d-7bb67d522187 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] [instance: 5d54db85-b991-4890-abaa-952413baa2e7] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:33:21.985675 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-090f678e-db89-4ade-ac1d-7bb67d522187 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:33:21.986123 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-090f678e-db89-4ade-ac1d-7bb67d522187 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:33:21.986886 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-090f678e-db89-4ade-ac1d-7bb67d522187 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:33:21.987310 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-090f678e-db89-4ade-ac1d-7bb67d522187 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:33:22.016601 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-090f678e-db89-4ade-ac1d-7bb67d522187 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] 10.222.0.11 "GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045065 Nov 17 03:33:22.017172 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 784/1595] 10.222.0.11 () {60 vars in 1342 bytes} [Wed Nov 17 03:33:21 2021] GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 17 03:33:22.035443 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-638a131f-39a0-4b39-b300-12c54563f32f tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:33:22.036080 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-638a131f-39a0-4b39-b300-12c54563f32f tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] [instance: 5ddbfaaa-fabf-4324-941c-8868625ffefc] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:33:22.042564 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-638a131f-39a0-4b39-b300-12c54563f32f tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:33:22.043014 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-638a131f-39a0-4b39-b300-12c54563f32f tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:33:22.043782 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-638a131f-39a0-4b39-b300-12c54563f32f tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:33:22.044242 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-638a131f-39a0-4b39-b300-12c54563f32f tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:33:22.106571 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-638a131f-39a0-4b39-b300-12c54563f32f tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80763e09d44c475ea2425b22874e9612', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fef02a1dd77946a2ac0e0414b557435f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:33:22.114455 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-638a131f-39a0-4b39-b300-12c54563f32f tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] 10.222.0.11 "GET /compute/v2.1/servers/5ddbfaaa-fabf-4324-941c-8868625ffefc" status: 200 len: 1226 microversion: 2.1 time: 0.082732 Nov 17 03:33:22.115007 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 812/1596] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:33:22 2021] GET /compute/v2.1/servers/5ddbfaaa-fabf-4324-941c-8868625ffefc => generated 1226 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:33:22.276920 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-ae71763b-b6fc-4738-9e28-a89894819d2b tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:33:22.277912 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-ae71763b-b6fc-4738-9e28-a89894819d2b tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] [instance: 0698dc5b-5f47-46c4-ace8-f5e891a964a0] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:33:22.288086 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-ae71763b-b6fc-4738-9e28-a89894819d2b tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:33:22.288958 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-ae71763b-b6fc-4738-9e28-a89894819d2b tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:33:22.290301 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-ae71763b-b6fc-4738-9e28-a89894819d2b tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:33:22.290793 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-ae71763b-b6fc-4738-9e28-a89894819d2b tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:33:22.421037 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-41813bcb-2709-447d-a748-383ddcd1423e tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:33:22.422004 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-41813bcb-2709-447d-a748-383ddcd1423e tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] [instance: a49437df-3059-4528-8328-2f3471d5fb45] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:33:22.426426 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-ae71763b-b6fc-4738-9e28-a89894819d2b tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '163b2f24a72649ac8084be1cac32fa09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e123e9b86124c93a7fc2db9984e7466', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:33:22.428249 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-41813bcb-2709-447d-a748-383ddcd1423e tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:33:22.428707 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-41813bcb-2709-447d-a748-383ddcd1423e tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:33:22.429513 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-41813bcb-2709-447d-a748-383ddcd1423e tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:33:22.430300 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-41813bcb-2709-447d-a748-383ddcd1423e tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:33:22.434855 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-ae71763b-b6fc-4738-9e28-a89894819d2b tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] 10.222.0.11 "GET /compute/v2.1/servers/0698dc5b-5f47-46c4-ace8-f5e891a964a0" status: 200 len: 1565 microversion: 2.1 time: 0.164231 Nov 17 03:33:22.435463 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 785/1597] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:33:22 2021] GET /compute/v2.1/servers/0698dc5b-5f47-46c4-ace8-f5e891a964a0 => generated 1565 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:33:22.461101 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-41813bcb-2709-447d-a748-383ddcd1423e tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] 10.222.0.11 "GET /compute/v2.1/servers/a49437df-3059-4528-8328-2f3471d5fb45/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043845 Nov 17 03:33:22.461665 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 813/1598] 10.222.0.11 () {58 vars in 1301 bytes} [Wed Nov 17 03:33:22 2021] GET /compute/v2.1/servers/a49437df-3059-4528-8328-2f3471d5fb45/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 17 03:33:23.032349 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-6bae829d-af3b-4ab6-a312-251c9fc0ec06 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:33:23.033860 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-6bae829d-af3b-4ab6-a312-251c9fc0ec06 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] [instance: 5d54db85-b991-4890-abaa-952413baa2e7] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:33:23.042900 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-6bae829d-af3b-4ab6-a312-251c9fc0ec06 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:33:23.043337 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-6bae829d-af3b-4ab6-a312-251c9fc0ec06 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:33:23.044107 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-6bae829d-af3b-4ab6-a312-251c9fc0ec06 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:33:23.044533 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-6bae829d-af3b-4ab6-a312-251c9fc0ec06 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:33:23.075659 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-6bae829d-af3b-4ab6-a312-251c9fc0ec06 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] 10.222.0.11 "GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.049604 Nov 17 03:33:23.076414 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 786/1599] 10.222.0.11 () {60 vars in 1342 bytes} [Wed Nov 17 03:33:23 2021] GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 17 03:33:23.135501 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-410a4acb-5a29-4630-9071-cf09f480b5a4 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:33:23.136669 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-410a4acb-5a29-4630-9071-cf09f480b5a4 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] [instance: 5ddbfaaa-fabf-4324-941c-8868625ffefc] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:33:23.147445 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-410a4acb-5a29-4630-9071-cf09f480b5a4 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:33:23.148305 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-410a4acb-5a29-4630-9071-cf09f480b5a4 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:33:23.150114 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-410a4acb-5a29-4630-9071-cf09f480b5a4 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:33:23.150553 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-410a4acb-5a29-4630-9071-cf09f480b5a4 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:33:23.220229 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-410a4acb-5a29-4630-9071-cf09f480b5a4 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80763e09d44c475ea2425b22874e9612', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fef02a1dd77946a2ac0e0414b557435f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:33:23.228722 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-410a4acb-5a29-4630-9071-cf09f480b5a4 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] 10.222.0.11 "GET /compute/v2.1/servers/5ddbfaaa-fabf-4324-941c-8868625ffefc" status: 200 len: 1226 microversion: 2.1 time: 0.100083 Nov 17 03:33:23.229327 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 814/1600] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:33:23 2021] GET /compute/v2.1/servers/5ddbfaaa-fabf-4324-941c-8868625ffefc => generated 1226 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:33:23.456178 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-f474206d-d371-4541-98df-b71e471dec36 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:33:23.457103 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-f474206d-d371-4541-98df-b71e471dec36 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] [instance: 0698dc5b-5f47-46c4-ace8-f5e891a964a0] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:33:23.465564 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-f474206d-d371-4541-98df-b71e471dec36 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:33:23.466015 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-f474206d-d371-4541-98df-b71e471dec36 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:33:23.466784 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-f474206d-d371-4541-98df-b71e471dec36 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:33:23.467216 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-f474206d-d371-4541-98df-b71e471dec36 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:33:23.472876 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-aa9f4ed5-0c67-4cc3-b595-5c0cf70744f0 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:33:23.473878 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-aa9f4ed5-0c67-4cc3-b595-5c0cf70744f0 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] [instance: a49437df-3059-4528-8328-2f3471d5fb45] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:33:23.480209 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-aa9f4ed5-0c67-4cc3-b595-5c0cf70744f0 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:33:23.480651 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-aa9f4ed5-0c67-4cc3-b595-5c0cf70744f0 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:33:23.481472 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-aa9f4ed5-0c67-4cc3-b595-5c0cf70744f0 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:33:23.481898 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-aa9f4ed5-0c67-4cc3-b595-5c0cf70744f0 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:33:23.513054 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-aa9f4ed5-0c67-4cc3-b595-5c0cf70744f0 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] 10.222.0.11 "GET /compute/v2.1/servers/a49437df-3059-4528-8328-2f3471d5fb45/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043819 Nov 17 03:33:23.513694 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 815/1601] 10.222.0.11 () {58 vars in 1301 bytes} [Wed Nov 17 03:33:23 2021] GET /compute/v2.1/servers/a49437df-3059-4528-8328-2f3471d5fb45/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 17 03:33:23.610057 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-f474206d-d371-4541-98df-b71e471dec36 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '163b2f24a72649ac8084be1cac32fa09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e123e9b86124c93a7fc2db9984e7466', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:33:23.621509 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-f474206d-d371-4541-98df-b71e471dec36 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] 10.222.0.11 "GET /compute/v2.1/servers/0698dc5b-5f47-46c4-ace8-f5e891a964a0" status: 200 len: 1565 microversion: 2.1 time: 0.171537 Nov 17 03:33:23.622246 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 787/1602] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:33:23 2021] GET /compute/v2.1/servers/0698dc5b-5f47-46c4-ace8-f5e891a964a0 => generated 1565 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:33:24.090357 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-43cb386c-afe6-4773-98b1-ab405097d1a0 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:33:24.091283 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-43cb386c-afe6-4773-98b1-ab405097d1a0 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] [instance: 5d54db85-b991-4890-abaa-952413baa2e7] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:33:24.097795 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-43cb386c-afe6-4773-98b1-ab405097d1a0 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:33:24.098250 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-43cb386c-afe6-4773-98b1-ab405097d1a0 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:33:24.099027 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-43cb386c-afe6-4773-98b1-ab405097d1a0 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:33:24.099459 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-43cb386c-afe6-4773-98b1-ab405097d1a0 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:33:24.129694 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-43cb386c-afe6-4773-98b1-ab405097d1a0 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] 10.222.0.11 "GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043719 Nov 17 03:33:24.130245 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 816/1603] 10.222.0.11 () {60 vars in 1342 bytes} [Wed Nov 17 03:33:24 2021] GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 17 03:33:24.249238 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-58986fb3-06b6-456b-8469-cde5dd455592 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:33:24.250287 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-58986fb3-06b6-456b-8469-cde5dd455592 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] [instance: 5ddbfaaa-fabf-4324-941c-8868625ffefc] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:33:24.260294 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-58986fb3-06b6-456b-8469-cde5dd455592 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:33:24.260732 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-58986fb3-06b6-456b-8469-cde5dd455592 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:33:24.261536 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-58986fb3-06b6-456b-8469-cde5dd455592 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:33:24.261961 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-58986fb3-06b6-456b-8469-cde5dd455592 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:33:24.332669 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-58986fb3-06b6-456b-8469-cde5dd455592 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80763e09d44c475ea2425b22874e9612', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fef02a1dd77946a2ac0e0414b557435f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:33:24.342391 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-58986fb3-06b6-456b-8469-cde5dd455592 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] 10.222.0.11 "GET /compute/v2.1/servers/5ddbfaaa-fabf-4324-941c-8868625ffefc" status: 200 len: 1226 microversion: 2.1 time: 0.099183 Nov 17 03:33:24.343125 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 788/1604] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:33:24 2021] GET /compute/v2.1/servers/5ddbfaaa-fabf-4324-941c-8868625ffefc => generated 1226 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:33:24.528851 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-8bc23919-aa12-4359-bb4e-27577e518590 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:33:24.530374 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-8bc23919-aa12-4359-bb4e-27577e518590 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] [instance: a49437df-3059-4528-8328-2f3471d5fb45] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:33:24.540715 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-8bc23919-aa12-4359-bb4e-27577e518590 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:33:24.541195 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-8bc23919-aa12-4359-bb4e-27577e518590 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:33:24.541965 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-8bc23919-aa12-4359-bb4e-27577e518590 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:33:24.542398 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-8bc23919-aa12-4359-bb4e-27577e518590 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:33:24.573186 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-8bc23919-aa12-4359-bb4e-27577e518590 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] 10.222.0.11 "GET /compute/v2.1/servers/a49437df-3059-4528-8328-2f3471d5fb45/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050757 Nov 17 03:33:24.573748 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 817/1605] 10.222.0.11 () {58 vars in 1301 bytes} [Wed Nov 17 03:33:24 2021] GET /compute/v2.1/servers/a49437df-3059-4528-8328-2f3471d5fb45/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 17 03:33:24.646539 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-51870833-610a-4b36-a7be-2d93283712af tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:33:24.647419 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-51870833-610a-4b36-a7be-2d93283712af tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] [instance: 0698dc5b-5f47-46c4-ace8-f5e891a964a0] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:33:24.654810 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-51870833-610a-4b36-a7be-2d93283712af tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:33:24.655256 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-51870833-610a-4b36-a7be-2d93283712af tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:33:24.656025 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-51870833-610a-4b36-a7be-2d93283712af tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:33:24.656455 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-51870833-610a-4b36-a7be-2d93283712af tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:33:24.791734 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-51870833-610a-4b36-a7be-2d93283712af tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '163b2f24a72649ac8084be1cac32fa09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e123e9b86124c93a7fc2db9984e7466', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:33:24.801956 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-51870833-610a-4b36-a7be-2d93283712af tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] 10.222.0.11 "GET /compute/v2.1/servers/0698dc5b-5f47-46c4-ace8-f5e891a964a0" status: 200 len: 1565 microversion: 2.1 time: 0.161284 Nov 17 03:33:24.802839 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 789/1606] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:33:24 2021] GET /compute/v2.1/servers/0698dc5b-5f47-46c4-ace8-f5e891a964a0 => generated 1565 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:33:25.145741 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-9c13770f-7ec0-47fb-95f9-436349526fe9 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:33:25.147216 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-9c13770f-7ec0-47fb-95f9-436349526fe9 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] [instance: 5d54db85-b991-4890-abaa-952413baa2e7] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:33:25.157829 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-9c13770f-7ec0-47fb-95f9-436349526fe9 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:33:25.158528 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-9c13770f-7ec0-47fb-95f9-436349526fe9 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:33:25.159804 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-9c13770f-7ec0-47fb-95f9-436349526fe9 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:33:25.160524 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-9c13770f-7ec0-47fb-95f9-436349526fe9 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:33:25.192003 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-9c13770f-7ec0-47fb-95f9-436349526fe9 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] 10.222.0.11 "GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.052621 Nov 17 03:33:25.192551 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 818/1607] 10.222.0.11 () {60 vars in 1342 bytes} [Wed Nov 17 03:33:25 2021] GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 17 03:33:25.364194 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-97d505f0-2f96-43ac-9e91-c424d8d64196 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:33:25.364809 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-97d505f0-2f96-43ac-9e91-c424d8d64196 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] [instance: 5ddbfaaa-fabf-4324-941c-8868625ffefc] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:33:25.374304 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-97d505f0-2f96-43ac-9e91-c424d8d64196 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:33:25.375066 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-97d505f0-2f96-43ac-9e91-c424d8d64196 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:33:25.376286 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-97d505f0-2f96-43ac-9e91-c424d8d64196 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:33:25.377036 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-97d505f0-2f96-43ac-9e91-c424d8d64196 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:33:25.447981 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-97d505f0-2f96-43ac-9e91-c424d8d64196 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80763e09d44c475ea2425b22874e9612', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fef02a1dd77946a2ac0e0414b557435f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:33:25.455821 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-97d505f0-2f96-43ac-9e91-c424d8d64196 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] 10.222.0.11 "GET /compute/v2.1/servers/5ddbfaaa-fabf-4324-941c-8868625ffefc" status: 200 len: 1226 microversion: 2.1 time: 0.095841 Nov 17 03:33:25.456381 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 790/1608] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:33:25 2021] GET /compute/v2.1/servers/5ddbfaaa-fabf-4324-941c-8868625ffefc => generated 1226 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:33:25.588240 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-b70d774a-0dea-4d92-b1b7-899c1a176709 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:33:25.589204 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-b70d774a-0dea-4d92-b1b7-899c1a176709 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] [instance: a49437df-3059-4528-8328-2f3471d5fb45] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:33:25.596143 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-b70d774a-0dea-4d92-b1b7-899c1a176709 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:33:25.596597 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-b70d774a-0dea-4d92-b1b7-899c1a176709 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:33:25.597408 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-b70d774a-0dea-4d92-b1b7-899c1a176709 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:33:25.597840 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-b70d774a-0dea-4d92-b1b7-899c1a176709 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:33:25.627882 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-b70d774a-0dea-4d92-b1b7-899c1a176709 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] 10.222.0.11 "GET /compute/v2.1/servers/a49437df-3059-4528-8328-2f3471d5fb45/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045413 Nov 17 03:33:25.628355 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 819/1609] 10.222.0.11 () {58 vars in 1301 bytes} [Wed Nov 17 03:33:25 2021] GET /compute/v2.1/servers/a49437df-3059-4528-8328-2f3471d5fb45/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 17 03:33:25.824726 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-672cf97e-b4af-4806-a0db-87a6ad3bcda7 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:33:25.825763 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-672cf97e-b4af-4806-a0db-87a6ad3bcda7 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] [instance: 0698dc5b-5f47-46c4-ace8-f5e891a964a0] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:33:25.836483 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-672cf97e-b4af-4806-a0db-87a6ad3bcda7 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:33:25.837245 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-672cf97e-b4af-4806-a0db-87a6ad3bcda7 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:33:25.837987 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-672cf97e-b4af-4806-a0db-87a6ad3bcda7 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:33:25.838431 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-672cf97e-b4af-4806-a0db-87a6ad3bcda7 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:33:25.992098 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-672cf97e-b4af-4806-a0db-87a6ad3bcda7 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '163b2f24a72649ac8084be1cac32fa09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e123e9b86124c93a7fc2db9984e7466', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:33:26.000614 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-672cf97e-b4af-4806-a0db-87a6ad3bcda7 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] 10.222.0.11 "GET /compute/v2.1/servers/0698dc5b-5f47-46c4-ace8-f5e891a964a0" status: 200 len: 1565 microversion: 2.1 time: 0.182423 Nov 17 03:33:26.001210 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 791/1610] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:33:25 2021] GET /compute/v2.1/servers/0698dc5b-5f47-46c4-ace8-f5e891a964a0 => generated 1565 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:33:26.206642 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-55c324c3-1d72-4239-a312-9ef7dd223173 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:33:26.207776 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-55c324c3-1d72-4239-a312-9ef7dd223173 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] [instance: 5d54db85-b991-4890-abaa-952413baa2e7] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:33:26.216946 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-55c324c3-1d72-4239-a312-9ef7dd223173 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:33:26.217544 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-55c324c3-1d72-4239-a312-9ef7dd223173 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:33:26.218747 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-55c324c3-1d72-4239-a312-9ef7dd223173 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:33:26.219297 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-55c324c3-1d72-4239-a312-9ef7dd223173 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:33:26.251426 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-55c324c3-1d72-4239-a312-9ef7dd223173 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] 10.222.0.11 "GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.050881 Nov 17 03:33:26.251967 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 820/1611] 10.222.0.11 () {60 vars in 1342 bytes} [Wed Nov 17 03:33:26 2021] GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 17 03:33:26.476628 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-ff1db783-7f7a-497e-b03b-f18b2d788c4a tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:33:26.477582 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-ff1db783-7f7a-497e-b03b-f18b2d788c4a tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] [instance: 5ddbfaaa-fabf-4324-941c-8868625ffefc] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:33:26.487810 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-ff1db783-7f7a-497e-b03b-f18b2d788c4a tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:33:26.488549 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-ff1db783-7f7a-497e-b03b-f18b2d788c4a tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:33:26.489866 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-ff1db783-7f7a-497e-b03b-f18b2d788c4a tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:33:26.490575 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-ff1db783-7f7a-497e-b03b-f18b2d788c4a tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:33:26.552258 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-ff1db783-7f7a-497e-b03b-f18b2d788c4a tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80763e09d44c475ea2425b22874e9612', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fef02a1dd77946a2ac0e0414b557435f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:33:26.560308 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-ff1db783-7f7a-497e-b03b-f18b2d788c4a tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] 10.222.0.11 "GET /compute/v2.1/servers/5ddbfaaa-fabf-4324-941c-8868625ffefc" status: 200 len: 1226 microversion: 2.1 time: 0.089956 Nov 17 03:33:26.560891 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 792/1612] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:33:26 2021] GET /compute/v2.1/servers/5ddbfaaa-fabf-4324-941c-8868625ffefc => generated 1226 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:33:26.643955 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-6d433d97-3527-424e-8edf-d6f491ec593b tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:33:26.645473 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-6d433d97-3527-424e-8edf-d6f491ec593b tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] [instance: a49437df-3059-4528-8328-2f3471d5fb45] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:33:26.654243 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-6d433d97-3527-424e-8edf-d6f491ec593b tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:33:26.654693 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-6d433d97-3527-424e-8edf-d6f491ec593b tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:33:26.655470 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-6d433d97-3527-424e-8edf-d6f491ec593b tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:33:26.655903 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-6d433d97-3527-424e-8edf-d6f491ec593b tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:33:26.685330 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-6d433d97-3527-424e-8edf-d6f491ec593b tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] 10.222.0.11 "GET /compute/v2.1/servers/a49437df-3059-4528-8328-2f3471d5fb45/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047686 Nov 17 03:33:26.685872 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 821/1613] 10.222.0.11 () {58 vars in 1301 bytes} [Wed Nov 17 03:33:26 2021] GET /compute/v2.1/servers/a49437df-3059-4528-8328-2f3471d5fb45/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 17 03:33:27.022647 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-3ed97e10-ff48-4d3a-904f-f93a248e11f9 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:33:27.023645 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-3ed97e10-ff48-4d3a-904f-f93a248e11f9 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] [instance: 0698dc5b-5f47-46c4-ace8-f5e891a964a0] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:33:27.034282 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-3ed97e10-ff48-4d3a-904f-f93a248e11f9 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:33:27.035023 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-3ed97e10-ff48-4d3a-904f-f93a248e11f9 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:33:27.036289 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-3ed97e10-ff48-4d3a-904f-f93a248e11f9 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:33:27.037051 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-3ed97e10-ff48-4d3a-904f-f93a248e11f9 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:33:27.186967 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-3ed97e10-ff48-4d3a-904f-f93a248e11f9 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '163b2f24a72649ac8084be1cac32fa09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e123e9b86124c93a7fc2db9984e7466', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:33:27.195146 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-3ed97e10-ff48-4d3a-904f-f93a248e11f9 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] 10.222.0.11 "GET /compute/v2.1/servers/0698dc5b-5f47-46c4-ace8-f5e891a964a0" status: 200 len: 1565 microversion: 2.1 time: 0.178832 Nov 17 03:33:27.195703 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 793/1614] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:33:27 2021] GET /compute/v2.1/servers/0698dc5b-5f47-46c4-ace8-f5e891a964a0 => generated 1565 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:33:27.267753 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-db65e0f4-95d5-47a6-bcc4-d3f0b7b06025 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:33:27.269279 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-db65e0f4-95d5-47a6-bcc4-d3f0b7b06025 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] [instance: 5d54db85-b991-4890-abaa-952413baa2e7] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:33:27.278139 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-db65e0f4-95d5-47a6-bcc4-d3f0b7b06025 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:33:27.278526 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-db65e0f4-95d5-47a6-bcc4-d3f0b7b06025 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:33:27.279308 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-db65e0f4-95d5-47a6-bcc4-d3f0b7b06025 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:33:27.279748 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-db65e0f4-95d5-47a6-bcc4-d3f0b7b06025 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:33:27.314487 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-db65e0f4-95d5-47a6-bcc4-d3f0b7b06025 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] 10.222.0.11 "GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.053003 Nov 17 03:33:27.315714 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 822/1615] 10.222.0.11 () {60 vars in 1342 bytes} [Wed Nov 17 03:33:27 2021] GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 17 03:33:27.583834 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-7a0feb37-e177-425f-806b-6276cc23d5a1 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:33:27.584447 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-7a0feb37-e177-425f-806b-6276cc23d5a1 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] [instance: 5ddbfaaa-fabf-4324-941c-8868625ffefc] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:33:27.591231 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-7a0feb37-e177-425f-806b-6276cc23d5a1 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:33:27.591673 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-7a0feb37-e177-425f-806b-6276cc23d5a1 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:33:27.592578 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-7a0feb37-e177-425f-806b-6276cc23d5a1 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:33:27.593017 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-7a0feb37-e177-425f-806b-6276cc23d5a1 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:33:27.661234 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-7a0feb37-e177-425f-806b-6276cc23d5a1 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80763e09d44c475ea2425b22874e9612', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fef02a1dd77946a2ac0e0414b557435f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:33:27.669279 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-7a0feb37-e177-425f-806b-6276cc23d5a1 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] 10.222.0.11 "GET /compute/v2.1/servers/5ddbfaaa-fabf-4324-941c-8868625ffefc" status: 200 len: 1226 microversion: 2.1 time: 0.090881 Nov 17 03:33:27.669877 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 794/1616] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:33:27 2021] GET /compute/v2.1/servers/5ddbfaaa-fabf-4324-941c-8868625ffefc => generated 1226 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:33:27.697542 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-a94b90d7-1c73-458a-ba4e-b08c99306513 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:33:27.698548 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-a94b90d7-1c73-458a-ba4e-b08c99306513 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] [instance: a49437df-3059-4528-8328-2f3471d5fb45] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:33:27.707698 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-a94b90d7-1c73-458a-ba4e-b08c99306513 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:33:27.708154 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-a94b90d7-1c73-458a-ba4e-b08c99306513 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:33:27.709655 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-a94b90d7-1c73-458a-ba4e-b08c99306513 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:33:27.710093 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-a94b90d7-1c73-458a-ba4e-b08c99306513 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:33:27.742295 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-a94b90d7-1c73-458a-ba4e-b08c99306513 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] 10.222.0.11 "GET /compute/v2.1/servers/a49437df-3059-4528-8328-2f3471d5fb45/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049156 Nov 17 03:33:27.742871 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 823/1617] 10.222.0.11 () {58 vars in 1301 bytes} [Wed Nov 17 03:33:27 2021] GET /compute/v2.1/servers/a49437df-3059-4528-8328-2f3471d5fb45/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 17 03:33:28.215063 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-69ebba49-aa89-462e-bceb-7d80f14e1ee5 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:33:28.215680 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-69ebba49-aa89-462e-bceb-7d80f14e1ee5 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] [instance: 0698dc5b-5f47-46c4-ace8-f5e891a964a0] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:33:28.222248 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-69ebba49-aa89-462e-bceb-7d80f14e1ee5 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:33:28.222697 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-69ebba49-aa89-462e-bceb-7d80f14e1ee5 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:33:28.223597 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-69ebba49-aa89-462e-bceb-7d80f14e1ee5 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:33:28.224075 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-69ebba49-aa89-462e-bceb-7d80f14e1ee5 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:33:28.327463 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-7440840e-7b1c-4c13-80ac-3ac4167d7fa1 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:33:28.328430 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-7440840e-7b1c-4c13-80ac-3ac4167d7fa1 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] [instance: 5d54db85-b991-4890-abaa-952413baa2e7] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:33:28.335377 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-7440840e-7b1c-4c13-80ac-3ac4167d7fa1 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:33:28.335836 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-7440840e-7b1c-4c13-80ac-3ac4167d7fa1 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:33:28.336606 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-7440840e-7b1c-4c13-80ac-3ac4167d7fa1 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:33:28.337095 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-7440840e-7b1c-4c13-80ac-3ac4167d7fa1 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:33:28.374247 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-7440840e-7b1c-4c13-80ac-3ac4167d7fa1 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] 10.222.0.11 "GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.050701 Nov 17 03:33:28.374818 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 824/1618] 10.222.0.11 () {60 vars in 1342 bytes} [Wed Nov 17 03:33:28 2021] GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 17 03:33:28.387096 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-69ebba49-aa89-462e-bceb-7d80f14e1ee5 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '163b2f24a72649ac8084be1cac32fa09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e123e9b86124c93a7fc2db9984e7466', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:33:28.396383 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-69ebba49-aa89-462e-bceb-7d80f14e1ee5 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] 10.222.0.11 "GET /compute/v2.1/servers/0698dc5b-5f47-46c4-ace8-f5e891a964a0" status: 200 len: 1565 microversion: 2.1 time: 0.186430 Nov 17 03:33:28.396985 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 795/1619] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:33:28 2021] GET /compute/v2.1/servers/0698dc5b-5f47-46c4-ace8-f5e891a964a0 => generated 1565 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:33:28.688437 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-b4412b8d-8297-4666-8f4b-d7e887432bef tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:33:28.689161 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-b4412b8d-8297-4666-8f4b-d7e887432bef tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] [instance: 5ddbfaaa-fabf-4324-941c-8868625ffefc] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:33:28.697581 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-b4412b8d-8297-4666-8f4b-d7e887432bef tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:33:28.698195 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-b4412b8d-8297-4666-8f4b-d7e887432bef tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:33:28.698777 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-b4412b8d-8297-4666-8f4b-d7e887432bef tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:33:28.699216 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-b4412b8d-8297-4666-8f4b-d7e887432bef tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:33:28.754461 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-7893794a-f650-4799-abc4-dbe4d1f44bce tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:33:28.755388 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-7893794a-f650-4799-abc4-dbe4d1f44bce tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] [instance: a49437df-3059-4528-8328-2f3471d5fb45] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:33:28.761940 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-7893794a-f650-4799-abc4-dbe4d1f44bce tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:33:28.762579 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-7893794a-f650-4799-abc4-dbe4d1f44bce tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:33:28.763166 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-7893794a-f650-4799-abc4-dbe4d1f44bce tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:33:28.763598 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-7893794a-f650-4799-abc4-dbe4d1f44bce tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:33:28.765045 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-b4412b8d-8297-4666-8f4b-d7e887432bef tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80763e09d44c475ea2425b22874e9612', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fef02a1dd77946a2ac0e0414b557435f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:33:28.773076 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-b4412b8d-8297-4666-8f4b-d7e887432bef tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] 10.222.0.11 "GET /compute/v2.1/servers/5ddbfaaa-fabf-4324-941c-8868625ffefc" status: 200 len: 1226 microversion: 2.1 time: 0.089785 Nov 17 03:33:28.773643 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 825/1620] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:33:28 2021] GET /compute/v2.1/servers/5ddbfaaa-fabf-4324-941c-8868625ffefc => generated 1226 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:33:28.793195 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-7893794a-f650-4799-abc4-dbe4d1f44bce tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] 10.222.0.11 "GET /compute/v2.1/servers/a49437df-3059-4528-8328-2f3471d5fb45/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042627 Nov 17 03:33:28.793756 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 796/1621] 10.222.0.11 () {58 vars in 1301 bytes} [Wed Nov 17 03:33:28 2021] GET /compute/v2.1/servers/a49437df-3059-4528-8328-2f3471d5fb45/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 17 03:33:29.389888 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-c0170f98-c91e-485e-ae0c-2ed4ab810dbc tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:33:29.390720 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-c0170f98-c91e-485e-ae0c-2ed4ab810dbc tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] [instance: 5d54db85-b991-4890-abaa-952413baa2e7] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:33:29.397322 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-c0170f98-c91e-485e-ae0c-2ed4ab810dbc tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:33:29.397770 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-c0170f98-c91e-485e-ae0c-2ed4ab810dbc tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:33:29.398547 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-c0170f98-c91e-485e-ae0c-2ed4ab810dbc tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:33:29.398978 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-c0170f98-c91e-485e-ae0c-2ed4ab810dbc tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:33:29.414474 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-7d7739bd-eee1-4f7e-a123-663867350f3f tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:33:29.415198 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-7d7739bd-eee1-4f7e-a123-663867350f3f tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] [instance: 0698dc5b-5f47-46c4-ace8-f5e891a964a0] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:33:29.421510 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-7d7739bd-eee1-4f7e-a123-663867350f3f tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:33:29.422034 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-7d7739bd-eee1-4f7e-a123-663867350f3f tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:33:29.422873 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-7d7739bd-eee1-4f7e-a123-663867350f3f tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:33:29.423373 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-7d7739bd-eee1-4f7e-a123-663867350f3f tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:33:29.428456 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-c0170f98-c91e-485e-ae0c-2ed4ab810dbc tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] 10.222.0.11 "GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042672 Nov 17 03:33:29.429059 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 826/1622] 10.222.0.11 () {60 vars in 1342 bytes} [Wed Nov 17 03:33:29 2021] GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 17 03:33:29.568940 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-7d7739bd-eee1-4f7e-a123-663867350f3f tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '163b2f24a72649ac8084be1cac32fa09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e123e9b86124c93a7fc2db9984e7466', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:33:29.580182 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-7d7739bd-eee1-4f7e-a123-663867350f3f tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] 10.222.0.11 "GET /compute/v2.1/servers/0698dc5b-5f47-46c4-ace8-f5e891a964a0" status: 200 len: 1565 microversion: 2.1 time: 0.169340 Nov 17 03:33:29.580912 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 797/1623] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:33:29 2021] GET /compute/v2.1/servers/0698dc5b-5f47-46c4-ace8-f5e891a964a0 => generated 1565 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:33:29.793570 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-033c7919-7ff8-4cc0-bd00-26c7cffd2f26 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:33:29.794597 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-033c7919-7ff8-4cc0-bd00-26c7cffd2f26 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] [instance: 5ddbfaaa-fabf-4324-941c-8868625ffefc] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:33:29.805434 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-033c7919-7ff8-4cc0-bd00-26c7cffd2f26 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:33:29.806185 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-033c7919-7ff8-4cc0-bd00-26c7cffd2f26 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:33:29.807458 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-033c7919-7ff8-4cc0-bd00-26c7cffd2f26 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:33:29.807884 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-033c7919-7ff8-4cc0-bd00-26c7cffd2f26 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:33:29.808047 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-3d7483c9-96d2-4ab6-9e5c-868e0d094dc5 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:33:29.808988 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-3d7483c9-96d2-4ab6-9e5c-868e0d094dc5 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] [instance: a49437df-3059-4528-8328-2f3471d5fb45] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:33:29.814853 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-3d7483c9-96d2-4ab6-9e5c-868e0d094dc5 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:33:29.815304 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-3d7483c9-96d2-4ab6-9e5c-868e0d094dc5 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:33:29.816069 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-3d7483c9-96d2-4ab6-9e5c-868e0d094dc5 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:33:29.816507 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-3d7483c9-96d2-4ab6-9e5c-868e0d094dc5 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:33:29.846036 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-3d7483c9-96d2-4ab6-9e5c-868e0d094dc5 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] 10.222.0.11 "GET /compute/v2.1/servers/a49437df-3059-4528-8328-2f3471d5fb45/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044168 Nov 17 03:33:29.846566 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 798/1624] 10.222.0.11 () {58 vars in 1301 bytes} [Wed Nov 17 03:33:29 2021] GET /compute/v2.1/servers/a49437df-3059-4528-8328-2f3471d5fb45/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 17 03:33:29.871968 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-033c7919-7ff8-4cc0-bd00-26c7cffd2f26 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80763e09d44c475ea2425b22874e9612', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fef02a1dd77946a2ac0e0414b557435f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:33:29.879836 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-033c7919-7ff8-4cc0-bd00-26c7cffd2f26 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] 10.222.0.11 "GET /compute/v2.1/servers/5ddbfaaa-fabf-4324-941c-8868625ffefc" status: 200 len: 1226 microversion: 2.1 time: 0.092602 Nov 17 03:33:29.880399 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 827/1625] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:33:29 2021] GET /compute/v2.1/servers/5ddbfaaa-fabf-4324-941c-8868625ffefc => generated 1226 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:33:30.442013 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-e9ed9f57-9dd4-44ab-98fb-33e04b92675b tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:33:30.442835 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-e9ed9f57-9dd4-44ab-98fb-33e04b92675b tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] [instance: 5d54db85-b991-4890-abaa-952413baa2e7] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:33:30.450531 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-e9ed9f57-9dd4-44ab-98fb-33e04b92675b tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:33:30.450981 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-e9ed9f57-9dd4-44ab-98fb-33e04b92675b tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:33:30.451754 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-e9ed9f57-9dd4-44ab-98fb-33e04b92675b tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:33:30.452193 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-e9ed9f57-9dd4-44ab-98fb-33e04b92675b tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:33:30.484140 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-e9ed9f57-9dd4-44ab-98fb-33e04b92675b tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] 10.222.0.11 "GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046066 Nov 17 03:33:30.484728 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 799/1626] 10.222.0.11 () {60 vars in 1342 bytes} [Wed Nov 17 03:33:30 2021] GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 17 03:33:30.599471 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-95a3fa36-669d-4a13-b116-6f0015994990 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:33:30.600173 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-95a3fa36-669d-4a13-b116-6f0015994990 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] [instance: 0698dc5b-5f47-46c4-ace8-f5e891a964a0] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:33:30.607042 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-95a3fa36-669d-4a13-b116-6f0015994990 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:33:30.607490 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-95a3fa36-669d-4a13-b116-6f0015994990 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:33:30.608250 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-95a3fa36-669d-4a13-b116-6f0015994990 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:33:30.608680 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-95a3fa36-669d-4a13-b116-6f0015994990 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:33:30.749724 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-95a3fa36-669d-4a13-b116-6f0015994990 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '163b2f24a72649ac8084be1cac32fa09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e123e9b86124c93a7fc2db9984e7466', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:33:30.757194 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-95a3fa36-669d-4a13-b116-6f0015994990 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] 10.222.0.11 "GET /compute/v2.1/servers/0698dc5b-5f47-46c4-ace8-f5e891a964a0" status: 200 len: 1565 microversion: 2.1 time: 0.161867 Nov 17 03:33:30.757730 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 828/1627] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:33:30 2021] GET /compute/v2.1/servers/0698dc5b-5f47-46c4-ace8-f5e891a964a0 => generated 1565 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:33:30.858759 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-33b7d2ce-9939-4545-adbc-6c1d1cfb74c9 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:33:30.859671 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-33b7d2ce-9939-4545-adbc-6c1d1cfb74c9 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] [instance: a49437df-3059-4528-8328-2f3471d5fb45] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:33:30.866291 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-33b7d2ce-9939-4545-adbc-6c1d1cfb74c9 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:33:30.866736 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-33b7d2ce-9939-4545-adbc-6c1d1cfb74c9 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:33:30.867499 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-33b7d2ce-9939-4545-adbc-6c1d1cfb74c9 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:33:30.867926 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-33b7d2ce-9939-4545-adbc-6c1d1cfb74c9 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:33:30.896817 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-0e5ba014-c011-4676-a7a9-680f9ac5e2a3 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:33:30.897428 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-0e5ba014-c011-4676-a7a9-680f9ac5e2a3 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] [instance: 5ddbfaaa-fabf-4324-941c-8868625ffefc] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:33:30.897543 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-33b7d2ce-9939-4545-adbc-6c1d1cfb74c9 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] 10.222.0.11 "GET /compute/v2.1/servers/a49437df-3059-4528-8328-2f3471d5fb45/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042599 Nov 17 03:33:30.898167 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 800/1628] 10.222.0.11 () {58 vars in 1301 bytes} [Wed Nov 17 03:33:30 2021] GET /compute/v2.1/servers/a49437df-3059-4528-8328-2f3471d5fb45/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 17 03:33:30.904386 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-0e5ba014-c011-4676-a7a9-680f9ac5e2a3 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:33:30.904827 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-0e5ba014-c011-4676-a7a9-680f9ac5e2a3 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:33:30.905629 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-0e5ba014-c011-4676-a7a9-680f9ac5e2a3 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:33:30.906057 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-0e5ba014-c011-4676-a7a9-680f9ac5e2a3 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:33:30.976927 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-0e5ba014-c011-4676-a7a9-680f9ac5e2a3 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80763e09d44c475ea2425b22874e9612', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fef02a1dd77946a2ac0e0414b557435f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:33:30.989119 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-0e5ba014-c011-4676-a7a9-680f9ac5e2a3 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] 10.222.0.11 "GET /compute/v2.1/servers/5ddbfaaa-fabf-4324-941c-8868625ffefc" status: 200 len: 1226 microversion: 2.1 time: 0.095719 Nov 17 03:33:30.989894 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 829/1629] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:33:30 2021] GET /compute/v2.1/servers/5ddbfaaa-fabf-4324-941c-8868625ffefc => generated 1226 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:33:31.500358 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-6633cf6c-9998-4f2f-95dc-2b3ac92f9762 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:33:31.501885 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-6633cf6c-9998-4f2f-95dc-2b3ac92f9762 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] [instance: 5d54db85-b991-4890-abaa-952413baa2e7] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:33:31.511602 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-6633cf6c-9998-4f2f-95dc-2b3ac92f9762 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:33:31.512050 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-6633cf6c-9998-4f2f-95dc-2b3ac92f9762 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:33:31.512828 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-6633cf6c-9998-4f2f-95dc-2b3ac92f9762 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:33:31.513293 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-6633cf6c-9998-4f2f-95dc-2b3ac92f9762 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:33:31.543784 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-6633cf6c-9998-4f2f-95dc-2b3ac92f9762 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] 10.222.0.11 "GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.050058 Nov 17 03:33:31.544330 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 801/1630] 10.222.0.11 () {60 vars in 1342 bytes} [Wed Nov 17 03:33:31 2021] GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 17 03:33:31.774914 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-e7151342-f69c-427e-8fba-3316d58a1931 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:33:31.775640 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-e7151342-f69c-427e-8fba-3316d58a1931 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] [instance: 0698dc5b-5f47-46c4-ace8-f5e891a964a0] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:33:31.782075 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-e7151342-f69c-427e-8fba-3316d58a1931 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:33:31.782544 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-e7151342-f69c-427e-8fba-3316d58a1931 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:33:31.783296 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-e7151342-f69c-427e-8fba-3316d58a1931 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:33:31.783741 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-e7151342-f69c-427e-8fba-3316d58a1931 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:33:31.909110 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-ea21e71c-6fff-4c07-b5c8-15be5009caa8 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:33:31.910016 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-ea21e71c-6fff-4c07-b5c8-15be5009caa8 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] [instance: a49437df-3059-4528-8328-2f3471d5fb45] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:33:31.916151 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-ea21e71c-6fff-4c07-b5c8-15be5009caa8 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:33:31.916632 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-ea21e71c-6fff-4c07-b5c8-15be5009caa8 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:33:31.917442 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-ea21e71c-6fff-4c07-b5c8-15be5009caa8 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:33:31.917930 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-ea21e71c-6fff-4c07-b5c8-15be5009caa8 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:33:31.934604 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-e7151342-f69c-427e-8fba-3316d58a1931 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '163b2f24a72649ac8084be1cac32fa09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e123e9b86124c93a7fc2db9984e7466', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:33:31.941966 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-e7151342-f69c-427e-8fba-3316d58a1931 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] 10.222.0.11 "GET /compute/v2.1/servers/0698dc5b-5f47-46c4-ace8-f5e891a964a0" status: 200 len: 1565 microversion: 2.1 time: 0.170844 Nov 17 03:33:31.942499 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 830/1631] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:33:31 2021] GET /compute/v2.1/servers/0698dc5b-5f47-46c4-ace8-f5e891a964a0 => generated 1565 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:33:31.948944 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-ea21e71c-6fff-4c07-b5c8-15be5009caa8 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] 10.222.0.11 "GET /compute/v2.1/servers/a49437df-3059-4528-8328-2f3471d5fb45/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043646 Nov 17 03:33:31.949496 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 802/1632] 10.222.0.11 () {58 vars in 1301 bytes} [Wed Nov 17 03:33:31 2021] GET /compute/v2.1/servers/a49437df-3059-4528-8328-2f3471d5fb45/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 17 03:33:32.011320 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-b7189a1d-3fc3-4988-8d4e-2e153c690ffa tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:33:32.012324 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-b7189a1d-3fc3-4988-8d4e-2e153c690ffa tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] [instance: 5ddbfaaa-fabf-4324-941c-8868625ffefc] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:33:32.022746 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-b7189a1d-3fc3-4988-8d4e-2e153c690ffa tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:33:32.023498 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-b7189a1d-3fc3-4988-8d4e-2e153c690ffa tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:33:32.024846 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-b7189a1d-3fc3-4988-8d4e-2e153c690ffa tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:33:32.025737 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-b7189a1d-3fc3-4988-8d4e-2e153c690ffa tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:33:32.089023 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-b7189a1d-3fc3-4988-8d4e-2e153c690ffa tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80763e09d44c475ea2425b22874e9612', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fef02a1dd77946a2ac0e0414b557435f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:33:32.096681 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-b7189a1d-3fc3-4988-8d4e-2e153c690ffa tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] 10.222.0.11 "GET /compute/v2.1/servers/5ddbfaaa-fabf-4324-941c-8868625ffefc" status: 200 len: 1226 microversion: 2.1 time: 0.091837 Nov 17 03:33:32.097286 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 831/1633] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:33:32 2021] GET /compute/v2.1/servers/5ddbfaaa-fabf-4324-941c-8868625ffefc => generated 1226 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:33:32.559969 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-d63a1f28-6e8a-4324-abb3-b3a55701d5a7 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:33:32.561129 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-d63a1f28-6e8a-4324-abb3-b3a55701d5a7 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] [instance: 5d54db85-b991-4890-abaa-952413baa2e7] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:33:32.569240 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-d63a1f28-6e8a-4324-abb3-b3a55701d5a7 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:33:32.569800 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-d63a1f28-6e8a-4324-abb3-b3a55701d5a7 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:33:32.570764 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-d63a1f28-6e8a-4324-abb3-b3a55701d5a7 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:33:32.571303 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-d63a1f28-6e8a-4324-abb3-b3a55701d5a7 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:33:32.606484 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-d63a1f28-6e8a-4324-abb3-b3a55701d5a7 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] 10.222.0.11 "GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.053239 Nov 17 03:33:32.607012 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 803/1634] 10.222.0.11 () {60 vars in 1342 bytes} [Wed Nov 17 03:33:32 2021] GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 17 03:33:32.962522 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-ba7ed49b-7dbd-4a7b-84dd-8d3a80827046 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:33:32.963679 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-ba7ed49b-7dbd-4a7b-84dd-8d3a80827046 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] [instance: 0698dc5b-5f47-46c4-ace8-f5e891a964a0] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:33:32.965563 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-3288ebf6-5735-43d1-ad9c-8b2b79d96fcb tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:33:32.967983 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-3288ebf6-5735-43d1-ad9c-8b2b79d96fcb tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] [instance: a49437df-3059-4528-8328-2f3471d5fb45] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:33:32.976823 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-ba7ed49b-7dbd-4a7b-84dd-8d3a80827046 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:33:32.977636 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-ba7ed49b-7dbd-4a7b-84dd-8d3a80827046 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:33:32.979185 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-ba7ed49b-7dbd-4a7b-84dd-8d3a80827046 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:33:32.979714 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-ba7ed49b-7dbd-4a7b-84dd-8d3a80827046 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:33:32.979898 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-3288ebf6-5735-43d1-ad9c-8b2b79d96fcb tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:33:32.980374 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-3288ebf6-5735-43d1-ad9c-8b2b79d96fcb tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:33:32.981193 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-3288ebf6-5735-43d1-ad9c-8b2b79d96fcb tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:33:32.981625 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-3288ebf6-5735-43d1-ad9c-8b2b79d96fcb tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:33:33.012443 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-3288ebf6-5735-43d1-ad9c-8b2b79d96fcb tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] 10.222.0.11 "GET /compute/v2.1/servers/a49437df-3059-4528-8328-2f3471d5fb45/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.054017 Nov 17 03:33:33.013066 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 804/1635] 10.222.0.11 () {58 vars in 1301 bytes} [Wed Nov 17 03:33:32 2021] GET /compute/v2.1/servers/a49437df-3059-4528-8328-2f3471d5fb45/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 17 03:33:33.113493 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-60d02423-ff70-439f-b700-42499eb75ade tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:33:33.114080 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-ba7ed49b-7dbd-4a7b-84dd-8d3a80827046 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '163b2f24a72649ac8084be1cac32fa09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e123e9b86124c93a7fc2db9984e7466', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:33:33.114291 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-60d02423-ff70-439f-b700-42499eb75ade tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] [instance: 5ddbfaaa-fabf-4324-941c-8868625ffefc] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:33:33.120009 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-60d02423-ff70-439f-b700-42499eb75ade tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:33:33.120487 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-60d02423-ff70-439f-b700-42499eb75ade tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:33:33.121286 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-60d02423-ff70-439f-b700-42499eb75ade tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:33:33.121717 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-60d02423-ff70-439f-b700-42499eb75ade tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:33:33.122092 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-ba7ed49b-7dbd-4a7b-84dd-8d3a80827046 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] 10.222.0.11 "GET /compute/v2.1/servers/0698dc5b-5f47-46c4-ace8-f5e891a964a0" status: 200 len: 1565 microversion: 2.1 time: 0.165911 Nov 17 03:33:33.122628 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 832/1636] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:33:32 2021] GET /compute/v2.1/servers/0698dc5b-5f47-46c4-ace8-f5e891a964a0 => generated 1565 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:33:33.181980 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-60d02423-ff70-439f-b700-42499eb75ade tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80763e09d44c475ea2425b22874e9612', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fef02a1dd77946a2ac0e0414b557435f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:33:33.190186 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-60d02423-ff70-439f-b700-42499eb75ade tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] 10.222.0.11 "GET /compute/v2.1/servers/5ddbfaaa-fabf-4324-941c-8868625ffefc" status: 200 len: 1226 microversion: 2.1 time: 0.080374 Nov 17 03:33:33.190747 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 805/1637] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:33:33 2021] GET /compute/v2.1/servers/5ddbfaaa-fabf-4324-941c-8868625ffefc => generated 1226 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:33:33.623497 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-bb86d851-1710-450b-b333-ccf633154ef7 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:33:33.625045 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-bb86d851-1710-450b-b333-ccf633154ef7 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] [instance: 5d54db85-b991-4890-abaa-952413baa2e7] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:33:33.635149 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-bb86d851-1710-450b-b333-ccf633154ef7 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:33:33.635668 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-bb86d851-1710-450b-b333-ccf633154ef7 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:33:33.636284 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-bb86d851-1710-450b-b333-ccf633154ef7 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:33:33.636711 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-bb86d851-1710-450b-b333-ccf633154ef7 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:33:33.665202 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-bb86d851-1710-450b-b333-ccf633154ef7 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] 10.222.0.11 "GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.048305 Nov 17 03:33:33.665731 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 833/1638] 10.222.0.11 () {60 vars in 1342 bytes} [Wed Nov 17 03:33:33 2021] GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 17 03:33:34.027035 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-4ee21ab9-8816-44d2-92f3-7fb1ce152968 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:33:34.028092 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-4ee21ab9-8816-44d2-92f3-7fb1ce152968 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] [instance: a49437df-3059-4528-8328-2f3471d5fb45] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:33:34.035788 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-4ee21ab9-8816-44d2-92f3-7fb1ce152968 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:33:34.036315 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-4ee21ab9-8816-44d2-92f3-7fb1ce152968 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:33:34.037264 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-4ee21ab9-8816-44d2-92f3-7fb1ce152968 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:33:34.037774 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-4ee21ab9-8816-44d2-92f3-7fb1ce152968 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:33:34.070889 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-4ee21ab9-8816-44d2-92f3-7fb1ce152968 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] 10.222.0.11 "GET /compute/v2.1/servers/a49437df-3059-4528-8328-2f3471d5fb45/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049737 Nov 17 03:33:34.071446 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 806/1639] 10.222.0.11 () {58 vars in 1301 bytes} [Wed Nov 17 03:33:34 2021] GET /compute/v2.1/servers/a49437df-3059-4528-8328-2f3471d5fb45/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 17 03:33:34.142478 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-ca7457ae-8d5e-4892-854a-d246eb81efb6 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:33:34.143515 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-ca7457ae-8d5e-4892-854a-d246eb81efb6 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] [instance: 0698dc5b-5f47-46c4-ace8-f5e891a964a0] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:33:34.152885 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-ca7457ae-8d5e-4892-854a-d246eb81efb6 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:33:34.153289 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-ca7457ae-8d5e-4892-854a-d246eb81efb6 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:33:34.154043 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-ca7457ae-8d5e-4892-854a-d246eb81efb6 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:33:34.154455 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-ca7457ae-8d5e-4892-854a-d246eb81efb6 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:33:34.206746 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-f57d5bf3-3e67-4f96-a106-8ab28c435108 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:33:34.207348 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-f57d5bf3-3e67-4f96-a106-8ab28c435108 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] [instance: 5ddbfaaa-fabf-4324-941c-8868625ffefc] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:33:34.214061 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-f57d5bf3-3e67-4f96-a106-8ab28c435108 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:33:34.214501 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-f57d5bf3-3e67-4f96-a106-8ab28c435108 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:33:34.215241 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-f57d5bf3-3e67-4f96-a106-8ab28c435108 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:33:34.215672 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-f57d5bf3-3e67-4f96-a106-8ab28c435108 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:33:34.275756 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-f57d5bf3-3e67-4f96-a106-8ab28c435108 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80763e09d44c475ea2425b22874e9612', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fef02a1dd77946a2ac0e0414b557435f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:33:34.283643 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-f57d5bf3-3e67-4f96-a106-8ab28c435108 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] 10.222.0.11 "GET /compute/v2.1/servers/5ddbfaaa-fabf-4324-941c-8868625ffefc" status: 200 len: 1226 microversion: 2.1 time: 0.080451 Nov 17 03:33:34.284145 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 807/1640] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:33:34 2021] GET /compute/v2.1/servers/5ddbfaaa-fabf-4324-941c-8868625ffefc => generated 1226 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:33:34.299484 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-ca7457ae-8d5e-4892-854a-d246eb81efb6 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '163b2f24a72649ac8084be1cac32fa09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e123e9b86124c93a7fc2db9984e7466', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:33:34.307345 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-ca7457ae-8d5e-4892-854a-d246eb81efb6 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] 10.222.0.11 "GET /compute/v2.1/servers/0698dc5b-5f47-46c4-ace8-f5e891a964a0" status: 200 len: 1565 microversion: 2.1 time: 0.170982 Nov 17 03:33:34.307917 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 834/1641] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:33:34 2021] GET /compute/v2.1/servers/0698dc5b-5f47-46c4-ace8-f5e891a964a0 => generated 1565 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:33:34.681720 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-45abd0c3-97a9-4eae-9d5e-147eb8928c09 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:33:34.682656 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-45abd0c3-97a9-4eae-9d5e-147eb8928c09 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] [instance: 5d54db85-b991-4890-abaa-952413baa2e7] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:33:34.689464 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-45abd0c3-97a9-4eae-9d5e-147eb8928c09 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:33:34.689907 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-45abd0c3-97a9-4eae-9d5e-147eb8928c09 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:33:34.690676 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-45abd0c3-97a9-4eae-9d5e-147eb8928c09 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:33:34.691104 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-45abd0c3-97a9-4eae-9d5e-147eb8928c09 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:33:34.720985 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-45abd0c3-97a9-4eae-9d5e-147eb8928c09 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] 10.222.0.11 "GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046246 Nov 17 03:33:34.721518 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 808/1642] 10.222.0.11 () {60 vars in 1342 bytes} [Wed Nov 17 03:33:34 2021] GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 17 03:33:35.085590 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-46d3a4db-2900-4d33-916d-e0550eb984f7 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:33:35.086842 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-46d3a4db-2900-4d33-916d-e0550eb984f7 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] [instance: a49437df-3059-4528-8328-2f3471d5fb45] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:33:35.095617 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-46d3a4db-2900-4d33-916d-e0550eb984f7 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:33:35.096238 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-46d3a4db-2900-4d33-916d-e0550eb984f7 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:33:35.097895 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-46d3a4db-2900-4d33-916d-e0550eb984f7 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:33:35.098361 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-46d3a4db-2900-4d33-916d-e0550eb984f7 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:33:35.128494 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-46d3a4db-2900-4d33-916d-e0550eb984f7 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] 10.222.0.11 "GET /compute/v2.1/servers/a49437df-3059-4528-8328-2f3471d5fb45/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049014 Nov 17 03:33:35.129084 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 835/1643] 10.222.0.11 () {58 vars in 1301 bytes} [Wed Nov 17 03:33:35 2021] GET /compute/v2.1/servers/a49437df-3059-4528-8328-2f3471d5fb45/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 17 03:33:35.304121 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-59ff6306-b9f7-44b0-9ff9-f76afd398d89 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:33:35.305541 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-59ff6306-b9f7-44b0-9ff9-f76afd398d89 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] [instance: 5ddbfaaa-fabf-4324-941c-8868625ffefc] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:33:35.316840 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-59ff6306-b9f7-44b0-9ff9-f76afd398d89 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:33:35.317481 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-59ff6306-b9f7-44b0-9ff9-f76afd398d89 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:33:35.318801 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-59ff6306-b9f7-44b0-9ff9-f76afd398d89 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:33:35.319520 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-59ff6306-b9f7-44b0-9ff9-f76afd398d89 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:33:35.325844 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-3b5d38b9-cf86-491f-aac4-cb313ab1b25c tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:33:35.326480 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-3b5d38b9-cf86-491f-aac4-cb313ab1b25c tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] [instance: 0698dc5b-5f47-46c4-ace8-f5e891a964a0] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:33:35.333117 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-3b5d38b9-cf86-491f-aac4-cb313ab1b25c tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:33:35.333564 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-3b5d38b9-cf86-491f-aac4-cb313ab1b25c tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:33:35.334331 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-3b5d38b9-cf86-491f-aac4-cb313ab1b25c tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:33:35.334730 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-3b5d38b9-cf86-491f-aac4-cb313ab1b25c tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:33:35.380370 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-59ff6306-b9f7-44b0-9ff9-f76afd398d89 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80763e09d44c475ea2425b22874e9612', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fef02a1dd77946a2ac0e0414b557435f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:33:35.388507 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-59ff6306-b9f7-44b0-9ff9-f76afd398d89 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] 10.222.0.11 "GET /compute/v2.1/servers/5ddbfaaa-fabf-4324-941c-8868625ffefc" status: 200 len: 1226 microversion: 2.1 time: 0.090515 Nov 17 03:33:35.389111 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 809/1644] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:33:35 2021] GET /compute/v2.1/servers/5ddbfaaa-fabf-4324-941c-8868625ffefc => generated 1226 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:33:35.468496 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-3b5d38b9-cf86-491f-aac4-cb313ab1b25c tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '163b2f24a72649ac8084be1cac32fa09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e123e9b86124c93a7fc2db9984e7466', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:33:35.480283 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-3b5d38b9-cf86-491f-aac4-cb313ab1b25c tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] 10.222.0.11 "GET /compute/v2.1/servers/0698dc5b-5f47-46c4-ace8-f5e891a964a0" status: 200 len: 1565 microversion: 2.1 time: 0.158158 Nov 17 03:33:35.481179 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 836/1645] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:33:35 2021] GET /compute/v2.1/servers/0698dc5b-5f47-46c4-ace8-f5e891a964a0 => generated 1565 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:33:35.738071 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-ba45e1ec-d70f-4888-a38a-39d3c47853ee tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:33:35.739605 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-ba45e1ec-d70f-4888-a38a-39d3c47853ee tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] [instance: 5d54db85-b991-4890-abaa-952413baa2e7] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:33:35.747862 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-ba45e1ec-d70f-4888-a38a-39d3c47853ee tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:33:35.748307 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-ba45e1ec-d70f-4888-a38a-39d3c47853ee tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:33:35.749126 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-ba45e1ec-d70f-4888-a38a-39d3c47853ee tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:33:35.749561 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-ba45e1ec-d70f-4888-a38a-39d3c47853ee tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:33:35.782470 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-ba45e1ec-d70f-4888-a38a-39d3c47853ee tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] 10.222.0.11 "GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.050690 Nov 17 03:33:35.783181 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 810/1646] 10.222.0.11 () {60 vars in 1342 bytes} [Wed Nov 17 03:33:35 2021] GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 17 03:33:36.143949 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-082e49f1-6f41-4fdd-bc41-e8eab6edff23 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:33:36.145757 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-082e49f1-6f41-4fdd-bc41-e8eab6edff23 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] [instance: a49437df-3059-4528-8328-2f3471d5fb45] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:33:36.156088 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-082e49f1-6f41-4fdd-bc41-e8eab6edff23 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:33:36.156853 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-082e49f1-6f41-4fdd-bc41-e8eab6edff23 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:33:36.158712 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-082e49f1-6f41-4fdd-bc41-e8eab6edff23 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:33:36.159425 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-082e49f1-6f41-4fdd-bc41-e8eab6edff23 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:33:36.192472 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-082e49f1-6f41-4fdd-bc41-e8eab6edff23 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] 10.222.0.11 "GET /compute/v2.1/servers/a49437df-3059-4528-8328-2f3471d5fb45/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.054794 Nov 17 03:33:36.193049 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 837/1647] 10.222.0.11 () {58 vars in 1301 bytes} [Wed Nov 17 03:33:36 2021] GET /compute/v2.1/servers/a49437df-3059-4528-8328-2f3471d5fb45/os-volume_attachments => generated 197 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 17 03:33:36.409930 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-39803df5-ac78-4bfe-9112-e03328abda77 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:33:36.410802 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-39803df5-ac78-4bfe-9112-e03328abda77 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] [instance: 5ddbfaaa-fabf-4324-941c-8868625ffefc] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:33:36.422052 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-39803df5-ac78-4bfe-9112-e03328abda77 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:33:36.422795 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-39803df5-ac78-4bfe-9112-e03328abda77 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:33:36.424064 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-39803df5-ac78-4bfe-9112-e03328abda77 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:33:36.424828 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-39803df5-ac78-4bfe-9112-e03328abda77 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:33:36.488656 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-39803df5-ac78-4bfe-9112-e03328abda77 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80763e09d44c475ea2425b22874e9612', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fef02a1dd77946a2ac0e0414b557435f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:33:36.497765 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-39803df5-ac78-4bfe-9112-e03328abda77 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] 10.222.0.11 "GET /compute/v2.1/servers/5ddbfaaa-fabf-4324-941c-8868625ffefc" status: 200 len: 1226 microversion: 2.1 time: 0.094207 Nov 17 03:33:36.498367 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 811/1648] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:33:36 2021] GET /compute/v2.1/servers/5ddbfaaa-fabf-4324-941c-8868625ffefc => generated 1226 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:33:36.502964 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-b4ba39b8-1b81-498a-9f45-0cf64b158d66 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:33:36.503624 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-b4ba39b8-1b81-498a-9f45-0cf64b158d66 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] [instance: 0698dc5b-5f47-46c4-ace8-f5e891a964a0] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:33:36.510205 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-b4ba39b8-1b81-498a-9f45-0cf64b158d66 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:33:36.510791 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-b4ba39b8-1b81-498a-9f45-0cf64b158d66 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:33:36.511564 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-b4ba39b8-1b81-498a-9f45-0cf64b158d66 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:33:36.511990 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-b4ba39b8-1b81-498a-9f45-0cf64b158d66 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:33:36.651560 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-b4ba39b8-1b81-498a-9f45-0cf64b158d66 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '163b2f24a72649ac8084be1cac32fa09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e123e9b86124c93a7fc2db9984e7466', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:33:36.664068 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-b4ba39b8-1b81-498a-9f45-0cf64b158d66 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] 10.222.0.11 "GET /compute/v2.1/servers/0698dc5b-5f47-46c4-ace8-f5e891a964a0" status: 200 len: 1565 microversion: 2.1 time: 0.164327 Nov 17 03:33:36.664875 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 838/1649] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:33:36 2021] GET /compute/v2.1/servers/0698dc5b-5f47-46c4-ace8-f5e891a964a0 => generated 1565 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 17 03:33:36.800231 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-155c2bbb-250c-4d1d-9398-84786a6c45cf tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:33:36.801711 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-155c2bbb-250c-4d1d-9398-84786a6c45cf tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] [instance: 5d54db85-b991-4890-abaa-952413baa2e7] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:33:36.812552 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-155c2bbb-250c-4d1d-9398-84786a6c45cf tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:33:36.813417 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-155c2bbb-250c-4d1d-9398-84786a6c45cf tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:33:36.814700 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-155c2bbb-250c-4d1d-9398-84786a6c45cf tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:33:36.815424 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-155c2bbb-250c-4d1d-9398-84786a6c45cf tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:33:36.847942 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-155c2bbb-250c-4d1d-9398-84786a6c45cf tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] 10.222.0.11 "GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.054268 Nov 17 03:33:36.848490 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 812/1650] 10.222.0.11 () {60 vars in 1342 bytes} [Wed Nov 17 03:33:36 2021] GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 17 03:33:37.208747 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-5b0e70e8-ddca-42c7-92b9-fdf456dc3c9a tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:33:37.210233 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-5b0e70e8-ddca-42c7-92b9-fdf456dc3c9a tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] [instance: a49437df-3059-4528-8328-2f3471d5fb45] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:33:37.218230 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-5b0e70e8-ddca-42c7-92b9-fdf456dc3c9a tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:33:37.218686 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-5b0e70e8-ddca-42c7-92b9-fdf456dc3c9a tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:33:37.219455 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-5b0e70e8-ddca-42c7-92b9-fdf456dc3c9a tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:33:37.219894 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-5b0e70e8-ddca-42c7-92b9-fdf456dc3c9a tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:33:37.250483 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-5b0e70e8-ddca-42c7-92b9-fdf456dc3c9a tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] 10.222.0.11 "GET /compute/v2.1/servers/a49437df-3059-4528-8328-2f3471d5fb45/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048135 Nov 17 03:33:37.251030 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 839/1651] 10.222.0.11 () {58 vars in 1301 bytes} [Wed Nov 17 03:33:37 2021] GET /compute/v2.1/servers/a49437df-3059-4528-8328-2f3471d5fb45/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 17 03:33:37.518712 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-8ca63769-c1cc-450c-b0ec-03ec577d9fe8 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:33:37.519706 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-8ca63769-c1cc-450c-b0ec-03ec577d9fe8 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] [instance: 5ddbfaaa-fabf-4324-941c-8868625ffefc] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:33:37.530826 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-8ca63769-c1cc-450c-b0ec-03ec577d9fe8 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:33:37.531530 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-8ca63769-c1cc-450c-b0ec-03ec577d9fe8 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:33:37.532860 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-8ca63769-c1cc-450c-b0ec-03ec577d9fe8 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:33:37.533627 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-8ca63769-c1cc-450c-b0ec-03ec577d9fe8 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:33:37.596283 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-8ca63769-c1cc-450c-b0ec-03ec577d9fe8 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80763e09d44c475ea2425b22874e9612', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fef02a1dd77946a2ac0e0414b557435f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:33:37.604961 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-8ca63769-c1cc-450c-b0ec-03ec577d9fe8 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] 10.222.0.11 "GET /compute/v2.1/servers/5ddbfaaa-fabf-4324-941c-8868625ffefc" status: 200 len: 1226 microversion: 2.1 time: 0.092535 Nov 17 03:33:37.605528 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 813/1652] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:33:37 2021] GET /compute/v2.1/servers/5ddbfaaa-fabf-4324-941c-8868625ffefc => generated 1226 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:33:37.684447 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-4fb4d72e-5bca-4682-9e24-02be66560b8d tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:33:37.685082 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-4fb4d72e-5bca-4682-9e24-02be66560b8d tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] [instance: 0698dc5b-5f47-46c4-ace8-f5e891a964a0] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:33:37.691937 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-4fb4d72e-5bca-4682-9e24-02be66560b8d tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:33:37.692384 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-4fb4d72e-5bca-4682-9e24-02be66560b8d tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:33:37.693158 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-4fb4d72e-5bca-4682-9e24-02be66560b8d tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:33:37.693828 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-4fb4d72e-5bca-4682-9e24-02be66560b8d tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:33:37.836606 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-4fb4d72e-5bca-4682-9e24-02be66560b8d tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '163b2f24a72649ac8084be1cac32fa09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e123e9b86124c93a7fc2db9984e7466', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:33:37.847482 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-4fb4d72e-5bca-4682-9e24-02be66560b8d tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] 10.222.0.11 "GET /compute/v2.1/servers/0698dc5b-5f47-46c4-ace8-f5e891a964a0" status: 200 len: 1565 microversion: 2.1 time: 0.167463 Nov 17 03:33:37.848294 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 840/1653] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:33:37 2021] GET /compute/v2.1/servers/0698dc5b-5f47-46c4-ace8-f5e891a964a0 => generated 1565 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:33:37.862384 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-3af72998-d049-4620-b183-1e8de9a03183 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:33:37.863835 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-3af72998-d049-4620-b183-1e8de9a03183 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] [instance: 5d54db85-b991-4890-abaa-952413baa2e7] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:33:37.871897 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-3af72998-d049-4620-b183-1e8de9a03183 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:33:37.872345 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-3af72998-d049-4620-b183-1e8de9a03183 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:33:37.873144 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-3af72998-d049-4620-b183-1e8de9a03183 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:33:37.873668 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-3af72998-d049-4620-b183-1e8de9a03183 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:33:37.903375 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-3af72998-d049-4620-b183-1e8de9a03183 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] 10.222.0.11 "GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047263 Nov 17 03:33:37.903915 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 814/1654] 10.222.0.11 () {60 vars in 1342 bytes} [Wed Nov 17 03:33:37 2021] GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 17 03:33:38.264557 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-9885013e-894d-4f5a-bba7-489f13a37f1e tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:33:38.265758 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-9885013e-894d-4f5a-bba7-489f13a37f1e tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] [instance: a49437df-3059-4528-8328-2f3471d5fb45] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:33:38.273730 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-9885013e-894d-4f5a-bba7-489f13a37f1e tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:33:38.274309 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-9885013e-894d-4f5a-bba7-489f13a37f1e tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:33:38.275317 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-9885013e-894d-4f5a-bba7-489f13a37f1e tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:33:38.275903 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-9885013e-894d-4f5a-bba7-489f13a37f1e tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:33:38.309974 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-9885013e-894d-4f5a-bba7-489f13a37f1e tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] 10.222.0.11 "GET /compute/v2.1/servers/a49437df-3059-4528-8328-2f3471d5fb45/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050499 Nov 17 03:33:38.310423 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 841/1655] 10.222.0.11 () {58 vars in 1301 bytes} [Wed Nov 17 03:33:38 2021] GET /compute/v2.1/servers/a49437df-3059-4528-8328-2f3471d5fb45/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 17 03:33:38.623732 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-ee63f94f-c180-4e0f-9487-e5131fff6a63 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:33:38.624324 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-ee63f94f-c180-4e0f-9487-e5131fff6a63 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] [instance: 5ddbfaaa-fabf-4324-941c-8868625ffefc] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:33:38.631455 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-ee63f94f-c180-4e0f-9487-e5131fff6a63 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:33:38.631931 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-ee63f94f-c180-4e0f-9487-e5131fff6a63 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:33:38.632747 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-ee63f94f-c180-4e0f-9487-e5131fff6a63 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:33:38.633245 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-ee63f94f-c180-4e0f-9487-e5131fff6a63 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:33:38.708650 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-ee63f94f-c180-4e0f-9487-e5131fff6a63 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80763e09d44c475ea2425b22874e9612', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fef02a1dd77946a2ac0e0414b557435f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:33:38.719080 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-ee63f94f-c180-4e0f-9487-e5131fff6a63 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] 10.222.0.11 "GET /compute/v2.1/servers/5ddbfaaa-fabf-4324-941c-8868625ffefc" status: 200 len: 1226 microversion: 2.1 time: 0.099388 Nov 17 03:33:38.719651 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 815/1656] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:33:38 2021] GET /compute/v2.1/servers/5ddbfaaa-fabf-4324-941c-8868625ffefc => generated 1226 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:33:38.871029 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-fd0b9606-0d06-4a7f-9767-914739a4202d tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:33:38.871805 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-fd0b9606-0d06-4a7f-9767-914739a4202d tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] [instance: 0698dc5b-5f47-46c4-ace8-f5e891a964a0] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:33:38.881132 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-fd0b9606-0d06-4a7f-9767-914739a4202d tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:33:38.881650 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-fd0b9606-0d06-4a7f-9767-914739a4202d tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:33:38.882701 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-fd0b9606-0d06-4a7f-9767-914739a4202d tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:33:38.883294 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-fd0b9606-0d06-4a7f-9767-914739a4202d tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:33:38.916854 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-3804d0af-56f3-4d14-828f-db0c44e9d690 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:33:38.917823 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-3804d0af-56f3-4d14-828f-db0c44e9d690 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] [instance: 5d54db85-b991-4890-abaa-952413baa2e7] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:33:38.924074 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-3804d0af-56f3-4d14-828f-db0c44e9d690 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:33:38.924518 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-3804d0af-56f3-4d14-828f-db0c44e9d690 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:33:38.925337 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-3804d0af-56f3-4d14-828f-db0c44e9d690 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:33:38.925776 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-3804d0af-56f3-4d14-828f-db0c44e9d690 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:33:38.956917 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-3804d0af-56f3-4d14-828f-db0c44e9d690 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] 10.222.0.11 "GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044194 Nov 17 03:33:38.957468 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 816/1657] 10.222.0.11 () {60 vars in 1342 bytes} [Wed Nov 17 03:33:38 2021] GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 17 03:33:39.020292 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-fd0b9606-0d06-4a7f-9767-914739a4202d tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '163b2f24a72649ac8084be1cac32fa09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e123e9b86124c93a7fc2db9984e7466', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:33:39.031653 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-fd0b9606-0d06-4a7f-9767-914739a4202d tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] 10.222.0.11 "GET /compute/v2.1/servers/0698dc5b-5f47-46c4-ace8-f5e891a964a0" status: 200 len: 1565 microversion: 2.1 time: 0.165435 Nov 17 03:33:39.032393 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 842/1658] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:33:38 2021] GET /compute/v2.1/servers/0698dc5b-5f47-46c4-ace8-f5e891a964a0 => generated 1565 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:33:39.321381 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-310b1b40-6a7b-4235-9e15-9691462f0f0e tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:33:39.322354 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-310b1b40-6a7b-4235-9e15-9691462f0f0e tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] [instance: a49437df-3059-4528-8328-2f3471d5fb45] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:33:39.328633 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-310b1b40-6a7b-4235-9e15-9691462f0f0e tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:33:39.329138 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-310b1b40-6a7b-4235-9e15-9691462f0f0e tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:33:39.329908 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-310b1b40-6a7b-4235-9e15-9691462f0f0e tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:33:39.330327 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-310b1b40-6a7b-4235-9e15-9691462f0f0e tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:33:39.358706 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-310b1b40-6a7b-4235-9e15-9691462f0f0e tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] 10.222.0.11 "GET /compute/v2.1/servers/a49437df-3059-4528-8328-2f3471d5fb45/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041132 Nov 17 03:33:39.359254 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 817/1659] 10.222.0.11 () {58 vars in 1301 bytes} [Wed Nov 17 03:33:39 2021] GET /compute/v2.1/servers/a49437df-3059-4528-8328-2f3471d5fb45/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 17 03:33:39.739634 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-a4102491-1c53-4446-9920-470c234e3138 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:33:39.740637 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-a4102491-1c53-4446-9920-470c234e3138 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] [instance: 5ddbfaaa-fabf-4324-941c-8868625ffefc] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:33:39.751661 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-a4102491-1c53-4446-9920-470c234e3138 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:33:39.752409 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-a4102491-1c53-4446-9920-470c234e3138 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:33:39.753774 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-a4102491-1c53-4446-9920-470c234e3138 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:33:39.754536 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-a4102491-1c53-4446-9920-470c234e3138 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:33:39.816081 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-a4102491-1c53-4446-9920-470c234e3138 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80763e09d44c475ea2425b22874e9612', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fef02a1dd77946a2ac0e0414b557435f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:33:39.824202 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-a4102491-1c53-4446-9920-470c234e3138 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] 10.222.0.11 "GET /compute/v2.1/servers/5ddbfaaa-fabf-4324-941c-8868625ffefc" status: 200 len: 1226 microversion: 2.1 time: 0.090717 Nov 17 03:33:39.824797 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 843/1660] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:33:39 2021] GET /compute/v2.1/servers/5ddbfaaa-fabf-4324-941c-8868625ffefc => generated 1226 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:33:39.971746 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-3c65cd2b-422e-4a0c-8a78-a433f79b432d tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:33:39.973258 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-3c65cd2b-422e-4a0c-8a78-a433f79b432d tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] [instance: 5d54db85-b991-4890-abaa-952413baa2e7] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:33:39.983995 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-3c65cd2b-422e-4a0c-8a78-a433f79b432d tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:33:39.984601 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-3c65cd2b-422e-4a0c-8a78-a433f79b432d tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:33:39.985925 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-3c65cd2b-422e-4a0c-8a78-a433f79b432d tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:33:39.986649 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-3c65cd2b-422e-4a0c-8a78-a433f79b432d tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:33:40.018141 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-3c65cd2b-422e-4a0c-8a78-a433f79b432d tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] 10.222.0.11 "GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.052750 Nov 17 03:33:40.018673 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 818/1661] 10.222.0.11 () {60 vars in 1342 bytes} [Wed Nov 17 03:33:39 2021] GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 17 03:33:40.050917 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-dfec9c16-3570-49e0-856c-22aaf81dd2e9 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:33:40.051305 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-dfec9c16-3570-49e0-856c-22aaf81dd2e9 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] [instance: 0698dc5b-5f47-46c4-ace8-f5e891a964a0] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:33:40.063094 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-dfec9c16-3570-49e0-856c-22aaf81dd2e9 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:33:40.063544 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-dfec9c16-3570-49e0-856c-22aaf81dd2e9 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:33:40.064328 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-dfec9c16-3570-49e0-856c-22aaf81dd2e9 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:33:40.064754 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-dfec9c16-3570-49e0-856c-22aaf81dd2e9 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:33:40.201350 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-dfec9c16-3570-49e0-856c-22aaf81dd2e9 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '163b2f24a72649ac8084be1cac32fa09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e123e9b86124c93a7fc2db9984e7466', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:33:40.209593 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-dfec9c16-3570-49e0-856c-22aaf81dd2e9 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] 10.222.0.11 "GET /compute/v2.1/servers/0698dc5b-5f47-46c4-ace8-f5e891a964a0" status: 200 len: 1565 microversion: 2.1 time: 0.163681 Nov 17 03:33:40.210167 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 844/1662] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:33:40 2021] GET /compute/v2.1/servers/0698dc5b-5f47-46c4-ace8-f5e891a964a0 => generated 1565 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:33:40.374257 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-2943c1c9-e13a-4476-a3fb-3a87956a8280 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:33:40.375782 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-2943c1c9-e13a-4476-a3fb-3a87956a8280 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] [instance: a49437df-3059-4528-8328-2f3471d5fb45] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:33:40.385606 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-2943c1c9-e13a-4476-a3fb-3a87956a8280 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:33:40.386051 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-2943c1c9-e13a-4476-a3fb-3a87956a8280 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:33:40.386822 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-2943c1c9-e13a-4476-a3fb-3a87956a8280 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:33:40.387256 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-2943c1c9-e13a-4476-a3fb-3a87956a8280 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:33:40.417228 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-2943c1c9-e13a-4476-a3fb-3a87956a8280 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] 10.222.0.11 "GET /compute/v2.1/servers/a49437df-3059-4528-8328-2f3471d5fb45/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049327 Nov 17 03:33:40.417795 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 819/1663] 10.222.0.11 () {58 vars in 1301 bytes} [Wed Nov 17 03:33:40 2021] GET /compute/v2.1/servers/a49437df-3059-4528-8328-2f3471d5fb45/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 17 03:33:40.845863 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-6d5f68bd-d195-4bf0-8cee-e7bf4901bc82 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:33:40.846917 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-6d5f68bd-d195-4bf0-8cee-e7bf4901bc82 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] [instance: 5ddbfaaa-fabf-4324-941c-8868625ffefc] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:33:40.857118 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-6d5f68bd-d195-4bf0-8cee-e7bf4901bc82 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:33:40.857856 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-6d5f68bd-d195-4bf0-8cee-e7bf4901bc82 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:33:40.859545 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-6d5f68bd-d195-4bf0-8cee-e7bf4901bc82 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:33:40.860269 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-6d5f68bd-d195-4bf0-8cee-e7bf4901bc82 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:33:40.925322 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-6d5f68bd-d195-4bf0-8cee-e7bf4901bc82 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80763e09d44c475ea2425b22874e9612', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fef02a1dd77946a2ac0e0414b557435f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:33:40.938404 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-6d5f68bd-d195-4bf0-8cee-e7bf4901bc82 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] 10.222.0.11 "GET /compute/v2.1/servers/5ddbfaaa-fabf-4324-941c-8868625ffefc" status: 200 len: 1226 microversion: 2.1 time: 0.099064 Nov 17 03:33:40.939267 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 845/1664] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:33:40 2021] GET /compute/v2.1/servers/5ddbfaaa-fabf-4324-941c-8868625ffefc => generated 1226 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:33:41.032684 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-3254122d-be02-4db0-99a9-cd4ebf18aa7f tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:33:41.034510 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-3254122d-be02-4db0-99a9-cd4ebf18aa7f tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] [instance: 5d54db85-b991-4890-abaa-952413baa2e7] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:33:41.041459 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-3254122d-be02-4db0-99a9-cd4ebf18aa7f tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:33:41.041906 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-3254122d-be02-4db0-99a9-cd4ebf18aa7f tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:33:41.042784 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-3254122d-be02-4db0-99a9-cd4ebf18aa7f tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:33:41.043562 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-3254122d-be02-4db0-99a9-cd4ebf18aa7f tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:33:41.076072 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-3254122d-be02-4db0-99a9-cd4ebf18aa7f tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] 10.222.0.11 "GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.049300 Nov 17 03:33:41.076627 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 820/1665] 10.222.0.11 () {60 vars in 1342 bytes} [Wed Nov 17 03:33:41 2021] GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 17 03:33:41.230752 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-4ad96bbb-bcbf-44c7-8068-579e878c308f tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:33:41.231646 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-4ad96bbb-bcbf-44c7-8068-579e878c308f tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] [instance: 0698dc5b-5f47-46c4-ace8-f5e891a964a0] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:33:41.242613 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-4ad96bbb-bcbf-44c7-8068-579e878c308f tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:33:41.243351 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-4ad96bbb-bcbf-44c7-8068-579e878c308f tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:33:41.244690 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-4ad96bbb-bcbf-44c7-8068-579e878c308f tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:33:41.245532 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-4ad96bbb-bcbf-44c7-8068-579e878c308f tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:33:41.396749 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-4ad96bbb-bcbf-44c7-8068-579e878c308f tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '163b2f24a72649ac8084be1cac32fa09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e123e9b86124c93a7fc2db9984e7466', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:33:41.405135 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-4ad96bbb-bcbf-44c7-8068-579e878c308f tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] 10.222.0.11 "GET /compute/v2.1/servers/0698dc5b-5f47-46c4-ace8-f5e891a964a0" status: 200 len: 1565 microversion: 2.1 time: 0.180673 Nov 17 03:33:41.405751 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 846/1666] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:33:41 2021] GET /compute/v2.1/servers/0698dc5b-5f47-46c4-ace8-f5e891a964a0 => generated 1565 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:33:41.431043 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-d26bb9bd-3c12-4f91-9ba0-9303753fe22d tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:33:41.432138 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-d26bb9bd-3c12-4f91-9ba0-9303753fe22d tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] [instance: a49437df-3059-4528-8328-2f3471d5fb45] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:33:41.438581 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-d26bb9bd-3c12-4f91-9ba0-9303753fe22d tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:33:41.439032 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-d26bb9bd-3c12-4f91-9ba0-9303753fe22d tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:33:41.439818 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-d26bb9bd-3c12-4f91-9ba0-9303753fe22d tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:33:41.440256 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-d26bb9bd-3c12-4f91-9ba0-9303753fe22d tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:33:41.472202 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-d26bb9bd-3c12-4f91-9ba0-9303753fe22d tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] 10.222.0.11 "GET /compute/v2.1/servers/a49437df-3059-4528-8328-2f3471d5fb45/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046950 Nov 17 03:33:41.473000 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 821/1667] 10.222.0.11 () {58 vars in 1301 bytes} [Wed Nov 17 03:33:41 2021] GET /compute/v2.1/servers/a49437df-3059-4528-8328-2f3471d5fb45/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 17 03:33:41.962412 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-3ea5a5ce-b25d-4968-b9cc-1d0a985f8698 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:33:41.963447 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-3ea5a5ce-b25d-4968-b9cc-1d0a985f8698 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] [instance: 5ddbfaaa-fabf-4324-941c-8868625ffefc] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:33:41.973966 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-3ea5a5ce-b25d-4968-b9cc-1d0a985f8698 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:33:41.974746 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-3ea5a5ce-b25d-4968-b9cc-1d0a985f8698 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:33:41.976012 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-3ea5a5ce-b25d-4968-b9cc-1d0a985f8698 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:33:41.976727 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-3ea5a5ce-b25d-4968-b9cc-1d0a985f8698 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:33:42.052235 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-3ea5a5ce-b25d-4968-b9cc-1d0a985f8698 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80763e09d44c475ea2425b22874e9612', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fef02a1dd77946a2ac0e0414b557435f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:33:42.061124 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-3ea5a5ce-b25d-4968-b9cc-1d0a985f8698 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] 10.222.0.11 "GET /compute/v2.1/servers/5ddbfaaa-fabf-4324-941c-8868625ffefc" status: 200 len: 1226 microversion: 2.1 time: 0.104892 Nov 17 03:33:42.061694 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 847/1668] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:33:41 2021] GET /compute/v2.1/servers/5ddbfaaa-fabf-4324-941c-8868625ffefc => generated 1226 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:33:42.087549 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-45475cc7-8d39-45c5-9391-dd520604622a tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:33:42.088480 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-45475cc7-8d39-45c5-9391-dd520604622a tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] [instance: 5d54db85-b991-4890-abaa-952413baa2e7] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:33:42.095127 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-45475cc7-8d39-45c5-9391-dd520604622a tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:33:42.095563 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-45475cc7-8d39-45c5-9391-dd520604622a tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:33:42.096325 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-45475cc7-8d39-45c5-9391-dd520604622a tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:33:42.096756 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-45475cc7-8d39-45c5-9391-dd520604622a tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:33:42.126474 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-45475cc7-8d39-45c5-9391-dd520604622a tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] 10.222.0.11 "GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042703 Nov 17 03:33:42.127032 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 822/1669] 10.222.0.11 () {60 vars in 1342 bytes} [Wed Nov 17 03:33:42 2021] GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 17 03:33:42.426548 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-2d78be14-6573-4a46-a7ca-484cf659d9de tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:33:42.427427 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-2d78be14-6573-4a46-a7ca-484cf659d9de tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] [instance: 0698dc5b-5f47-46c4-ace8-f5e891a964a0] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:33:42.436570 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-2d78be14-6573-4a46-a7ca-484cf659d9de tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:33:42.437050 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-2d78be14-6573-4a46-a7ca-484cf659d9de tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:33:42.437828 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-2d78be14-6573-4a46-a7ca-484cf659d9de tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:33:42.438261 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-2d78be14-6573-4a46-a7ca-484cf659d9de tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:33:42.484214 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-adec390b-3495-43f6-b4c2-c9fade11bab2 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:33:42.485152 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-adec390b-3495-43f6-b4c2-c9fade11bab2 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] [instance: a49437df-3059-4528-8328-2f3471d5fb45] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:33:42.491426 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-adec390b-3495-43f6-b4c2-c9fade11bab2 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:33:42.492006 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-adec390b-3495-43f6-b4c2-c9fade11bab2 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:33:42.492803 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-adec390b-3495-43f6-b4c2-c9fade11bab2 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:33:42.493238 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-adec390b-3495-43f6-b4c2-c9fade11bab2 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:33:42.523064 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-adec390b-3495-43f6-b4c2-c9fade11bab2 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] 10.222.0.11 "GET /compute/v2.1/servers/a49437df-3059-4528-8328-2f3471d5fb45/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042921 Nov 17 03:33:42.523636 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 823/1670] 10.222.0.11 () {58 vars in 1301 bytes} [Wed Nov 17 03:33:42 2021] GET /compute/v2.1/servers/a49437df-3059-4528-8328-2f3471d5fb45/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 17 03:33:42.578198 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-2d78be14-6573-4a46-a7ca-484cf659d9de tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '163b2f24a72649ac8084be1cac32fa09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e123e9b86124c93a7fc2db9984e7466', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:33:42.586029 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-2d78be14-6573-4a46-a7ca-484cf659d9de tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] 10.222.0.11 "GET /compute/v2.1/servers/0698dc5b-5f47-46c4-ace8-f5e891a964a0" status: 200 len: 1565 microversion: 2.1 time: 0.165833 Nov 17 03:33:42.586590 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 848/1671] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:33:42 2021] GET /compute/v2.1/servers/0698dc5b-5f47-46c4-ace8-f5e891a964a0 => generated 1565 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:33:43.081216 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-c61d4494-4328-4135-a56b-22901ae7aa18 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:33:43.082064 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-c61d4494-4328-4135-a56b-22901ae7aa18 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] [instance: 5ddbfaaa-fabf-4324-941c-8868625ffefc] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:33:43.090172 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-c61d4494-4328-4135-a56b-22901ae7aa18 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:33:43.090766 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-c61d4494-4328-4135-a56b-22901ae7aa18 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:33:43.091362 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-c61d4494-4328-4135-a56b-22901ae7aa18 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:33:43.091793 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-c61d4494-4328-4135-a56b-22901ae7aa18 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:33:43.138688 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-80f9c8d9-2c16-465e-a156-c3a852f79540 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:33:43.139613 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-80f9c8d9-2c16-465e-a156-c3a852f79540 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] [instance: 5d54db85-b991-4890-abaa-952413baa2e7] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:33:43.145570 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-80f9c8d9-2c16-465e-a156-c3a852f79540 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:33:43.146006 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-80f9c8d9-2c16-465e-a156-c3a852f79540 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:33:43.146772 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-80f9c8d9-2c16-465e-a156-c3a852f79540 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:33:43.147201 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-80f9c8d9-2c16-465e-a156-c3a852f79540 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:33:43.154810 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-c61d4494-4328-4135-a56b-22901ae7aa18 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80763e09d44c475ea2425b22874e9612', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fef02a1dd77946a2ac0e0414b557435f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:33:43.162402 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-c61d4494-4328-4135-a56b-22901ae7aa18 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] 10.222.0.11 "GET /compute/v2.1/servers/5ddbfaaa-fabf-4324-941c-8868625ffefc" status: 200 len: 1226 microversion: 2.1 time: 0.086864 Nov 17 03:33:43.163191 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 824/1672] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:33:43 2021] GET /compute/v2.1/servers/5ddbfaaa-fabf-4324-941c-8868625ffefc => generated 1226 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:33:43.177886 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-80f9c8d9-2c16-465e-a156-c3a852f79540 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] 10.222.0.11 "GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043411 Nov 17 03:33:43.178447 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 849/1673] 10.222.0.11 () {60 vars in 1342 bytes} [Wed Nov 17 03:33:43 2021] GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 17 03:33:43.538616 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-92e43292-7a39-4696-a0c0-d46416ad3b42 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:33:43.540080 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-92e43292-7a39-4696-a0c0-d46416ad3b42 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] [instance: a49437df-3059-4528-8328-2f3471d5fb45] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:33:43.547328 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-92e43292-7a39-4696-a0c0-d46416ad3b42 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:33:43.547768 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-92e43292-7a39-4696-a0c0-d46416ad3b42 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:33:43.548531 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-92e43292-7a39-4696-a0c0-d46416ad3b42 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:33:43.549004 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-92e43292-7a39-4696-a0c0-d46416ad3b42 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:33:43.578567 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-92e43292-7a39-4696-a0c0-d46416ad3b42 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] 10.222.0.11 "GET /compute/v2.1/servers/a49437df-3059-4528-8328-2f3471d5fb45/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046312 Nov 17 03:33:43.579109 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 825/1674] 10.222.0.11 () {58 vars in 1301 bytes} [Wed Nov 17 03:33:43 2021] GET /compute/v2.1/servers/a49437df-3059-4528-8328-2f3471d5fb45/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 17 03:33:43.603026 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-f83e7ae2-b1aa-48f3-b60e-beb9f08cbe5d tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:33:43.603676 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-f83e7ae2-b1aa-48f3-b60e-beb9f08cbe5d tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] [instance: 0698dc5b-5f47-46c4-ace8-f5e891a964a0] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:33:43.610978 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-f83e7ae2-b1aa-48f3-b60e-beb9f08cbe5d tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:33:43.611360 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-f83e7ae2-b1aa-48f3-b60e-beb9f08cbe5d tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:33:43.612135 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-f83e7ae2-b1aa-48f3-b60e-beb9f08cbe5d tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:33:43.612569 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-f83e7ae2-b1aa-48f3-b60e-beb9f08cbe5d tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:33:43.757655 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-f83e7ae2-b1aa-48f3-b60e-beb9f08cbe5d tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '163b2f24a72649ac8084be1cac32fa09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e123e9b86124c93a7fc2db9984e7466', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:33:43.765787 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-f83e7ae2-b1aa-48f3-b60e-beb9f08cbe5d tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] 10.222.0.11 "GET /compute/v2.1/servers/0698dc5b-5f47-46c4-ace8-f5e891a964a0" status: 200 len: 1565 microversion: 2.1 time: 0.166402 Nov 17 03:33:43.766359 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 850/1675] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:33:43 2021] GET /compute/v2.1/servers/0698dc5b-5f47-46c4-ace8-f5e891a964a0 => generated 1565 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:33:44.182911 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-47f40bef-5692-4b15-92bc-f5f6810e8c91 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:33:44.184217 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-47f40bef-5692-4b15-92bc-f5f6810e8c91 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] [instance: 5ddbfaaa-fabf-4324-941c-8868625ffefc] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:33:44.193859 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-6c432be2-5896-4f4c-ad3d-1967d4eaa85b tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:33:44.194610 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-47f40bef-5692-4b15-92bc-f5f6810e8c91 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:33:44.195330 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-6c432be2-5896-4f4c-ad3d-1967d4eaa85b tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] [instance: 5d54db85-b991-4890-abaa-952413baa2e7] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:33:44.195588 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-47f40bef-5692-4b15-92bc-f5f6810e8c91 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:33:44.196585 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-47f40bef-5692-4b15-92bc-f5f6810e8c91 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:33:44.197347 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-47f40bef-5692-4b15-92bc-f5f6810e8c91 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:33:44.203356 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-6c432be2-5896-4f4c-ad3d-1967d4eaa85b tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:33:44.203806 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-6c432be2-5896-4f4c-ad3d-1967d4eaa85b tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:33:44.204589 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-6c432be2-5896-4f4c-ad3d-1967d4eaa85b tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:33:44.205068 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-6c432be2-5896-4f4c-ad3d-1967d4eaa85b tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:33:44.234352 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-6c432be2-5896-4f4c-ad3d-1967d4eaa85b tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] 10.222.0.11 "GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046937 Nov 17 03:33:44.235143 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 851/1676] 10.222.0.11 () {60 vars in 1342 bytes} [Wed Nov 17 03:33:44 2021] GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 17 03:33:44.257859 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-47f40bef-5692-4b15-92bc-f5f6810e8c91 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80763e09d44c475ea2425b22874e9612', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fef02a1dd77946a2ac0e0414b557435f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:33:44.265422 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-47f40bef-5692-4b15-92bc-f5f6810e8c91 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] 10.222.0.11 "GET /compute/v2.1/servers/5ddbfaaa-fabf-4324-941c-8868625ffefc" status: 200 len: 1226 microversion: 2.1 time: 0.089164 Nov 17 03:33:44.265945 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 826/1677] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:33:44 2021] GET /compute/v2.1/servers/5ddbfaaa-fabf-4324-941c-8868625ffefc => generated 1226 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:33:44.593868 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-3540027c-112f-41a7-ae48-775d69d3d592 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:33:44.595002 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-3540027c-112f-41a7-ae48-775d69d3d592 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] [instance: a49437df-3059-4528-8328-2f3471d5fb45] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:33:44.602895 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-3540027c-112f-41a7-ae48-775d69d3d592 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:33:44.603457 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-3540027c-112f-41a7-ae48-775d69d3d592 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:33:44.604419 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-3540027c-112f-41a7-ae48-775d69d3d592 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:33:44.605259 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-3540027c-112f-41a7-ae48-775d69d3d592 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:33:44.638382 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-3540027c-112f-41a7-ae48-775d69d3d592 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] 10.222.0.11 "GET /compute/v2.1/servers/a49437df-3059-4528-8328-2f3471d5fb45/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050462 Nov 17 03:33:44.638934 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 852/1678] 10.222.0.11 () {58 vars in 1301 bytes} [Wed Nov 17 03:33:44 2021] GET /compute/v2.1/servers/a49437df-3059-4528-8328-2f3471d5fb45/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 17 03:33:44.787522 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-8a52cdf5-9e8f-4547-9110-1af0cd1027a2 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:33:44.788711 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-8a52cdf5-9e8f-4547-9110-1af0cd1027a2 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] [instance: 0698dc5b-5f47-46c4-ace8-f5e891a964a0] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:33:44.796384 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-8a52cdf5-9e8f-4547-9110-1af0cd1027a2 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:33:44.796868 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-8a52cdf5-9e8f-4547-9110-1af0cd1027a2 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:33:44.797644 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-8a52cdf5-9e8f-4547-9110-1af0cd1027a2 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:33:44.798088 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-8a52cdf5-9e8f-4547-9110-1af0cd1027a2 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:33:44.938940 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-8a52cdf5-9e8f-4547-9110-1af0cd1027a2 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '163b2f24a72649ac8084be1cac32fa09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e123e9b86124c93a7fc2db9984e7466', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:33:44.946869 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-8a52cdf5-9e8f-4547-9110-1af0cd1027a2 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] 10.222.0.11 "GET /compute/v2.1/servers/0698dc5b-5f47-46c4-ace8-f5e891a964a0" status: 200 len: 1565 microversion: 2.1 time: 0.165494 Nov 17 03:33:44.947432 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 827/1679] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:33:44 2021] GET /compute/v2.1/servers/0698dc5b-5f47-46c4-ace8-f5e891a964a0 => generated 1565 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:33:45.251071 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-06367712-ed3a-47a8-a1d2-2710a5d429f2 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:33:45.252490 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-06367712-ed3a-47a8-a1d2-2710a5d429f2 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] [instance: 5d54db85-b991-4890-abaa-952413baa2e7] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:33:45.263073 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-06367712-ed3a-47a8-a1d2-2710a5d429f2 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:33:45.263804 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-06367712-ed3a-47a8-a1d2-2710a5d429f2 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:33:45.265199 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-06367712-ed3a-47a8-a1d2-2710a5d429f2 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:33:45.265946 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-06367712-ed3a-47a8-a1d2-2710a5d429f2 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:33:45.282522 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-e860f6f5-1f77-42e2-8649-3d1ca21a8ade tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:33:45.283244 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-e860f6f5-1f77-42e2-8649-3d1ca21a8ade tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] [instance: 5ddbfaaa-fabf-4324-941c-8868625ffefc] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:33:45.290052 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-e860f6f5-1f77-42e2-8649-3d1ca21a8ade tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:33:45.290498 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-e860f6f5-1f77-42e2-8649-3d1ca21a8ade tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:33:45.291298 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-e860f6f5-1f77-42e2-8649-3d1ca21a8ade tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:33:45.291724 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-e860f6f5-1f77-42e2-8649-3d1ca21a8ade tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:33:45.300357 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-06367712-ed3a-47a8-a1d2-2710a5d429f2 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] 10.222.0.11 "GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.056486 Nov 17 03:33:45.300984 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 853/1680] 10.222.0.11 () {60 vars in 1342 bytes} [Wed Nov 17 03:33:45 2021] GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7/os-volume_attachments => generated 197 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 17 03:33:45.355161 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-e860f6f5-1f77-42e2-8649-3d1ca21a8ade tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80763e09d44c475ea2425b22874e9612', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fef02a1dd77946a2ac0e0414b557435f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:33:45.362781 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-e860f6f5-1f77-42e2-8649-3d1ca21a8ade tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] 10.222.0.11 "GET /compute/v2.1/servers/5ddbfaaa-fabf-4324-941c-8868625ffefc" status: 200 len: 1226 microversion: 2.1 time: 0.084016 Nov 17 03:33:45.363364 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 828/1681] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:33:45 2021] GET /compute/v2.1/servers/5ddbfaaa-fabf-4324-941c-8868625ffefc => generated 1226 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:33:45.656142 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-cacdf91b-5d0b-438b-93c7-320ccf24485d tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:33:45.657642 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-cacdf91b-5d0b-438b-93c7-320ccf24485d tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] [instance: a49437df-3059-4528-8328-2f3471d5fb45] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:33:45.668103 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-cacdf91b-5d0b-438b-93c7-320ccf24485d tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:33:45.668625 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-cacdf91b-5d0b-438b-93c7-320ccf24485d tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:33:45.669432 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-cacdf91b-5d0b-438b-93c7-320ccf24485d tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:33:45.669933 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-cacdf91b-5d0b-438b-93c7-320ccf24485d tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:33:45.700387 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-cacdf91b-5d0b-438b-93c7-320ccf24485d tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] 10.222.0.11 "GET /compute/v2.1/servers/a49437df-3059-4528-8328-2f3471d5fb45/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051050 Nov 17 03:33:45.700953 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 854/1682] 10.222.0.11 () {58 vars in 1301 bytes} [Wed Nov 17 03:33:45 2021] GET /compute/v2.1/servers/a49437df-3059-4528-8328-2f3471d5fb45/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 17 03:33:45.967542 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-e7b60360-73a9-4093-8eb9-c66dd505cb78 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:33:45.968293 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-e7b60360-73a9-4093-8eb9-c66dd505cb78 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] [instance: 0698dc5b-5f47-46c4-ace8-f5e891a964a0] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:33:45.976590 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-e7b60360-73a9-4093-8eb9-c66dd505cb78 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:33:45.977197 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-e7b60360-73a9-4093-8eb9-c66dd505cb78 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:33:45.978218 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-e7b60360-73a9-4093-8eb9-c66dd505cb78 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:33:45.978801 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-e7b60360-73a9-4093-8eb9-c66dd505cb78 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:33:46.116507 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-e7b60360-73a9-4093-8eb9-c66dd505cb78 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '163b2f24a72649ac8084be1cac32fa09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e123e9b86124c93a7fc2db9984e7466', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:33:46.128523 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-e7b60360-73a9-4093-8eb9-c66dd505cb78 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] 10.222.0.11 "GET /compute/v2.1/servers/0698dc5b-5f47-46c4-ace8-f5e891a964a0" status: 200 len: 1565 microversion: 2.1 time: 0.166389 Nov 17 03:33:46.129367 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 829/1683] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:33:45 2021] GET /compute/v2.1/servers/0698dc5b-5f47-46c4-ace8-f5e891a964a0 => generated 1565 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:33:46.316229 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-1b60a8a1-f9a7-4c6c-8174-66def6a8c839 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:33:46.317764 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-1b60a8a1-f9a7-4c6c-8174-66def6a8c839 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] [instance: 5d54db85-b991-4890-abaa-952413baa2e7] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:33:46.326751 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-1b60a8a1-f9a7-4c6c-8174-66def6a8c839 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:33:46.327202 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-1b60a8a1-f9a7-4c6c-8174-66def6a8c839 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:33:46.327965 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-1b60a8a1-f9a7-4c6c-8174-66def6a8c839 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:33:46.328390 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-1b60a8a1-f9a7-4c6c-8174-66def6a8c839 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:33:46.357612 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-1b60a8a1-f9a7-4c6c-8174-66def6a8c839 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] 10.222.0.11 "GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047803 Nov 17 03:33:46.358158 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 855/1684] 10.222.0.11 () {60 vars in 1342 bytes} [Wed Nov 17 03:33:46 2021] GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 17 03:33:46.382758 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-dbff4b70-6b1d-4b5d-b223-4624d0685634 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:33:46.383721 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-dbff4b70-6b1d-4b5d-b223-4624d0685634 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] [instance: 5ddbfaaa-fabf-4324-941c-8868625ffefc] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:33:46.391356 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-dbff4b70-6b1d-4b5d-b223-4624d0685634 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:33:46.391806 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-dbff4b70-6b1d-4b5d-b223-4624d0685634 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:33:46.392546 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-dbff4b70-6b1d-4b5d-b223-4624d0685634 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:33:46.393011 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-dbff4b70-6b1d-4b5d-b223-4624d0685634 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:33:46.462094 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-dbff4b70-6b1d-4b5d-b223-4624d0685634 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80763e09d44c475ea2425b22874e9612', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fef02a1dd77946a2ac0e0414b557435f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:33:46.473879 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-dbff4b70-6b1d-4b5d-b223-4624d0685634 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] 10.222.0.11 "GET /compute/v2.1/servers/5ddbfaaa-fabf-4324-941c-8868625ffefc" status: 200 len: 1226 microversion: 2.1 time: 0.096870 Nov 17 03:33:46.474638 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 830/1685] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:33:46 2021] GET /compute/v2.1/servers/5ddbfaaa-fabf-4324-941c-8868625ffefc => generated 1226 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:33:46.715274 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-69f0464c-f697-4f8b-9f00-061df89be341 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:33:46.716085 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-69f0464c-f697-4f8b-9f00-061df89be341 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] [instance: a49437df-3059-4528-8328-2f3471d5fb45] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:33:46.722743 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-69f0464c-f697-4f8b-9f00-061df89be341 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:33:46.723190 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-69f0464c-f697-4f8b-9f00-061df89be341 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:33:46.723958 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-69f0464c-f697-4f8b-9f00-061df89be341 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:33:46.724386 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-69f0464c-f697-4f8b-9f00-061df89be341 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:33:46.754269 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-69f0464c-f697-4f8b-9f00-061df89be341 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] 10.222.0.11 "GET /compute/v2.1/servers/a49437df-3059-4528-8328-2f3471d5fb45/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045163 Nov 17 03:33:46.754818 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 856/1686] 10.222.0.11 () {58 vars in 1301 bytes} [Wed Nov 17 03:33:46 2021] GET /compute/v2.1/servers/a49437df-3059-4528-8328-2f3471d5fb45/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 17 03:33:47.155117 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-6e4f3463-af20-4466-bcde-7f96f9e6f128 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:33:47.156155 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-6e4f3463-af20-4466-bcde-7f96f9e6f128 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] [instance: 0698dc5b-5f47-46c4-ace8-f5e891a964a0] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:33:47.166733 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-6e4f3463-af20-4466-bcde-7f96f9e6f128 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:33:47.167630 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-6e4f3463-af20-4466-bcde-7f96f9e6f128 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:33:47.168649 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-6e4f3463-af20-4466-bcde-7f96f9e6f128 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:33:47.169107 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-6e4f3463-af20-4466-bcde-7f96f9e6f128 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:33:47.316846 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-6e4f3463-af20-4466-bcde-7f96f9e6f128 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '163b2f24a72649ac8084be1cac32fa09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e123e9b86124c93a7fc2db9984e7466', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:33:47.326795 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-6e4f3463-af20-4466-bcde-7f96f9e6f128 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] 10.222.0.11 "GET /compute/v2.1/servers/0698dc5b-5f47-46c4-ace8-f5e891a964a0" status: 200 len: 1565 microversion: 2.1 time: 0.177942 Nov 17 03:33:47.327375 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 831/1687] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:33:47 2021] GET /compute/v2.1/servers/0698dc5b-5f47-46c4-ace8-f5e891a964a0 => generated 1565 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:33:47.371149 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-7c706f3e-dddb-47e9-bdf0-5888ab5c4f88 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:33:47.372084 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-7c706f3e-dddb-47e9-bdf0-5888ab5c4f88 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] [instance: 5d54db85-b991-4890-abaa-952413baa2e7] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:33:47.378175 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-7c706f3e-dddb-47e9-bdf0-5888ab5c4f88 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:33:47.378631 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-7c706f3e-dddb-47e9-bdf0-5888ab5c4f88 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:33:47.379406 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-7c706f3e-dddb-47e9-bdf0-5888ab5c4f88 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:33:47.379842 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-7c706f3e-dddb-47e9-bdf0-5888ab5c4f88 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:33:47.409108 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-7c706f3e-dddb-47e9-bdf0-5888ab5c4f88 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] 10.222.0.11 "GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041732 Nov 17 03:33:47.409661 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 857/1688] 10.222.0.11 () {60 vars in 1342 bytes} [Wed Nov 17 03:33:47 2021] GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 17 03:33:47.496390 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-db47d135-540e-4669-adc9-e1933e38aad8 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:33:47.497129 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-db47d135-540e-4669-adc9-e1933e38aad8 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] [instance: 5ddbfaaa-fabf-4324-941c-8868625ffefc] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:33:47.503831 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-db47d135-540e-4669-adc9-e1933e38aad8 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:33:47.504282 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-db47d135-540e-4669-adc9-e1933e38aad8 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:33:47.505093 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-db47d135-540e-4669-adc9-e1933e38aad8 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:33:47.505519 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-db47d135-540e-4669-adc9-e1933e38aad8 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:33:47.566156 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-db47d135-540e-4669-adc9-e1933e38aad8 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80763e09d44c475ea2425b22874e9612', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fef02a1dd77946a2ac0e0414b557435f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:33:47.574129 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-db47d135-540e-4669-adc9-e1933e38aad8 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] 10.222.0.11 "GET /compute/v2.1/servers/5ddbfaaa-fabf-4324-941c-8868625ffefc" status: 200 len: 1226 microversion: 2.1 time: 0.083976 Nov 17 03:33:47.574917 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 832/1689] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:33:47 2021] GET /compute/v2.1/servers/5ddbfaaa-fabf-4324-941c-8868625ffefc => generated 1226 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:33:47.767351 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-3ddc5500-8e3f-49b9-a9cc-e686a4b69f4f tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:33:47.768429 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-3ddc5500-8e3f-49b9-a9cc-e686a4b69f4f tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] [instance: a49437df-3059-4528-8328-2f3471d5fb45] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:33:47.776325 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-3ddc5500-8e3f-49b9-a9cc-e686a4b69f4f tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:33:47.777156 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-3ddc5500-8e3f-49b9-a9cc-e686a4b69f4f tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:33:47.778094 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-3ddc5500-8e3f-49b9-a9cc-e686a4b69f4f tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:33:47.778604 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-3ddc5500-8e3f-49b9-a9cc-e686a4b69f4f tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:33:47.810801 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-3ddc5500-8e3f-49b9-a9cc-e686a4b69f4f tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] 10.222.0.11 "GET /compute/v2.1/servers/a49437df-3059-4528-8328-2f3471d5fb45/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047954 Nov 17 03:33:47.811345 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 858/1690] 10.222.0.11 () {58 vars in 1301 bytes} [Wed Nov 17 03:33:47 2021] GET /compute/v2.1/servers/a49437df-3059-4528-8328-2f3471d5fb45/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 17 03:33:48.345507 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-ae279668-8c0a-47f5-9f95-32bb5eb67a0f tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:33:48.346090 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-ae279668-8c0a-47f5-9f95-32bb5eb67a0f tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] [instance: 0698dc5b-5f47-46c4-ace8-f5e891a964a0] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:33:48.353515 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-ae279668-8c0a-47f5-9f95-32bb5eb67a0f tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:33:48.354045 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-ae279668-8c0a-47f5-9f95-32bb5eb67a0f tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:33:48.354949 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-ae279668-8c0a-47f5-9f95-32bb5eb67a0f tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:33:48.355455 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-ae279668-8c0a-47f5-9f95-32bb5eb67a0f tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:33:48.422245 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-2d48b66c-6b69-4ac4-a0ff-780504019498 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:33:48.423136 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-2d48b66c-6b69-4ac4-a0ff-780504019498 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] [instance: 5d54db85-b991-4890-abaa-952413baa2e7] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:33:48.429413 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-2d48b66c-6b69-4ac4-a0ff-780504019498 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:33:48.430264 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-2d48b66c-6b69-4ac4-a0ff-780504019498 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:33:48.431045 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-2d48b66c-6b69-4ac4-a0ff-780504019498 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:33:48.431474 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-2d48b66c-6b69-4ac4-a0ff-780504019498 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:33:48.462773 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-2d48b66c-6b69-4ac4-a0ff-780504019498 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] 10.222.0.11 "GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045518 Nov 17 03:33:48.463331 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 859/1691] 10.222.0.11 () {60 vars in 1342 bytes} [Wed Nov 17 03:33:48 2021] GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 17 03:33:48.496012 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-ae279668-8c0a-47f5-9f95-32bb5eb67a0f tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '163b2f24a72649ac8084be1cac32fa09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e123e9b86124c93a7fc2db9984e7466', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:33:48.503930 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-ae279668-8c0a-47f5-9f95-32bb5eb67a0f tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] 10.222.0.11 "GET /compute/v2.1/servers/0698dc5b-5f47-46c4-ace8-f5e891a964a0" status: 200 len: 1565 microversion: 2.1 time: 0.163006 Nov 17 03:33:48.504542 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 833/1692] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:33:48 2021] GET /compute/v2.1/servers/0698dc5b-5f47-46c4-ace8-f5e891a964a0 => generated 1565 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:33:48.594063 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-bed298d7-cf5f-469b-b9d0-f5994b2e61d1 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:33:48.594971 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-bed298d7-cf5f-469b-b9d0-f5994b2e61d1 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] [instance: 5ddbfaaa-fabf-4324-941c-8868625ffefc] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:33:48.603990 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-bed298d7-cf5f-469b-b9d0-f5994b2e61d1 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:33:48.604542 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-bed298d7-cf5f-469b-b9d0-f5994b2e61d1 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:33:48.605907 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-bed298d7-cf5f-469b-b9d0-f5994b2e61d1 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:33:48.606348 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-bed298d7-cf5f-469b-b9d0-f5994b2e61d1 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:33:48.679121 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-bed298d7-cf5f-469b-b9d0-f5994b2e61d1 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80763e09d44c475ea2425b22874e9612', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fef02a1dd77946a2ac0e0414b557435f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:33:48.689967 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-bed298d7-cf5f-469b-b9d0-f5994b2e61d1 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] 10.222.0.11 "GET /compute/v2.1/servers/5ddbfaaa-fabf-4324-941c-8868625ffefc" status: 200 len: 1226 microversion: 2.1 time: 0.101475 Nov 17 03:33:48.690747 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 860/1693] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:33:48 2021] GET /compute/v2.1/servers/5ddbfaaa-fabf-4324-941c-8868625ffefc => generated 1226 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:33:48.827393 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-a664ceb1-d884-4814-be93-74650599b943 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:33:48.828590 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-a664ceb1-d884-4814-be93-74650599b943 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] [instance: a49437df-3059-4528-8328-2f3471d5fb45] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:33:48.836842 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-a664ceb1-d884-4814-be93-74650599b943 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:33:48.837491 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-a664ceb1-d884-4814-be93-74650599b943 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:33:48.838598 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-a664ceb1-d884-4814-be93-74650599b943 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:33:48.840180 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-a664ceb1-d884-4814-be93-74650599b943 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:33:48.874144 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-a664ceb1-d884-4814-be93-74650599b943 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] 10.222.0.11 "GET /compute/v2.1/servers/a49437df-3059-4528-8328-2f3471d5fb45/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053187 Nov 17 03:33:48.874608 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 834/1694] 10.222.0.11 () {58 vars in 1301 bytes} [Wed Nov 17 03:33:48 2021] GET /compute/v2.1/servers/a49437df-3059-4528-8328-2f3471d5fb45/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 17 03:33:49.478523 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-00c82944-74e8-42f1-a83f-a13a7f175527 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:33:49.479885 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-00c82944-74e8-42f1-a83f-a13a7f175527 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] [instance: 5d54db85-b991-4890-abaa-952413baa2e7] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:33:49.486823 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-00c82944-74e8-42f1-a83f-a13a7f175527 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:33:49.487272 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-00c82944-74e8-42f1-a83f-a13a7f175527 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:33:49.488039 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-00c82944-74e8-42f1-a83f-a13a7f175527 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:33:49.488487 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-00c82944-74e8-42f1-a83f-a13a7f175527 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:33:49.518291 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-00c82944-74e8-42f1-a83f-a13a7f175527 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] 10.222.0.11 "GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045689 Nov 17 03:33:49.518832 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 861/1695] 10.222.0.11 () {60 vars in 1342 bytes} [Wed Nov 17 03:33:49 2021] GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 17 03:33:49.520808 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-81cd030a-6696-4df3-aa0e-7fe77b0620d7 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:33:49.521506 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-81cd030a-6696-4df3-aa0e-7fe77b0620d7 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] [instance: 0698dc5b-5f47-46c4-ace8-f5e891a964a0] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:33:49.530686 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-81cd030a-6696-4df3-aa0e-7fe77b0620d7 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:33:49.531286 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-81cd030a-6696-4df3-aa0e-7fe77b0620d7 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:33:49.532400 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-81cd030a-6696-4df3-aa0e-7fe77b0620d7 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:33:49.533054 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-81cd030a-6696-4df3-aa0e-7fe77b0620d7 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:33:49.674008 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-81cd030a-6696-4df3-aa0e-7fe77b0620d7 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '163b2f24a72649ac8084be1cac32fa09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e123e9b86124c93a7fc2db9984e7466', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:33:49.681955 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-81cd030a-6696-4df3-aa0e-7fe77b0620d7 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] 10.222.0.11 "GET /compute/v2.1/servers/0698dc5b-5f47-46c4-ace8-f5e891a964a0" status: 200 len: 1565 microversion: 2.1 time: 0.164967 Nov 17 03:33:49.682492 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 835/1696] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:33:49 2021] GET /compute/v2.1/servers/0698dc5b-5f47-46c4-ace8-f5e891a964a0 => generated 1565 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:33:49.710576 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-5042b50f-f53c-48e2-8b7f-2067bd45a26d tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:33:49.711178 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-5042b50f-f53c-48e2-8b7f-2067bd45a26d tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] [instance: 5ddbfaaa-fabf-4324-941c-8868625ffefc] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:33:49.717482 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-5042b50f-f53c-48e2-8b7f-2067bd45a26d tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:33:49.717924 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-5042b50f-f53c-48e2-8b7f-2067bd45a26d tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:33:49.718709 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-5042b50f-f53c-48e2-8b7f-2067bd45a26d tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:33:49.719131 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-5042b50f-f53c-48e2-8b7f-2067bd45a26d tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:33:49.779683 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-5042b50f-f53c-48e2-8b7f-2067bd45a26d tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80763e09d44c475ea2425b22874e9612', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fef02a1dd77946a2ac0e0414b557435f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:33:49.787931 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-5042b50f-f53c-48e2-8b7f-2067bd45a26d tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] 10.222.0.11 "GET /compute/v2.1/servers/5ddbfaaa-fabf-4324-941c-8868625ffefc" status: 200 len: 1226 microversion: 2.1 time: 0.081022 Nov 17 03:33:49.788476 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 862/1697] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:33:49 2021] GET /compute/v2.1/servers/5ddbfaaa-fabf-4324-941c-8868625ffefc => generated 1226 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 17 03:33:49.889596 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-5815e5d2-c38f-48d0-9870-001ce4b84d6e tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:33:49.890983 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-5815e5d2-c38f-48d0-9870-001ce4b84d6e tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] [instance: a49437df-3059-4528-8328-2f3471d5fb45] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:33:49.900476 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-5815e5d2-c38f-48d0-9870-001ce4b84d6e tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:33:49.901170 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-5815e5d2-c38f-48d0-9870-001ce4b84d6e tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:33:49.902252 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-5815e5d2-c38f-48d0-9870-001ce4b84d6e tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:33:49.902682 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-5815e5d2-c38f-48d0-9870-001ce4b84d6e tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:33:49.932500 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-5815e5d2-c38f-48d0-9870-001ce4b84d6e tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] 10.222.0.11 "GET /compute/v2.1/servers/a49437df-3059-4528-8328-2f3471d5fb45/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049243 Nov 17 03:33:49.933153 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 836/1698] 10.222.0.11 () {58 vars in 1301 bytes} [Wed Nov 17 03:33:49 2021] GET /compute/v2.1/servers/a49437df-3059-4528-8328-2f3471d5fb45/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 17 03:33:50.533876 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-443cb1b9-5d22-4933-91e8-2f2ae6cc577b tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:33:50.535042 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-443cb1b9-5d22-4933-91e8-2f2ae6cc577b tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] [instance: 5d54db85-b991-4890-abaa-952413baa2e7] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:33:50.543530 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-443cb1b9-5d22-4933-91e8-2f2ae6cc577b tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:33:50.544114 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-443cb1b9-5d22-4933-91e8-2f2ae6cc577b tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:33:50.545087 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-443cb1b9-5d22-4933-91e8-2f2ae6cc577b tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:33:50.545620 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-443cb1b9-5d22-4933-91e8-2f2ae6cc577b tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:33:50.578570 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-443cb1b9-5d22-4933-91e8-2f2ae6cc577b tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] 10.222.0.11 "GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.050759 Nov 17 03:33:50.579122 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 863/1699] 10.222.0.11 () {60 vars in 1342 bytes} [Wed Nov 17 03:33:50 2021] GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 17 03:33:50.703058 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-23e1f145-93ba-41f8-8681-03320f558e4d tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:33:50.704023 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-23e1f145-93ba-41f8-8681-03320f558e4d tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] [instance: 0698dc5b-5f47-46c4-ace8-f5e891a964a0] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:33:50.714734 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-23e1f145-93ba-41f8-8681-03320f558e4d tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:33:50.715197 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-23e1f145-93ba-41f8-8681-03320f558e4d tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:33:50.715965 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-23e1f145-93ba-41f8-8681-03320f558e4d tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:33:50.716397 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-23e1f145-93ba-41f8-8681-03320f558e4d tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:33:50.806670 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-ef493651-6502-48fe-87ac-d12934c24f7d tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:33:50.807541 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-ef493651-6502-48fe-87ac-d12934c24f7d tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] [instance: 5ddbfaaa-fabf-4324-941c-8868625ffefc] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:33:50.814728 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-ef493651-6502-48fe-87ac-d12934c24f7d tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:33:50.815170 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-ef493651-6502-48fe-87ac-d12934c24f7d tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:33:50.815963 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-ef493651-6502-48fe-87ac-d12934c24f7d tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:33:50.816499 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-ef493651-6502-48fe-87ac-d12934c24f7d tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:33:50.857312 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-23e1f145-93ba-41f8-8681-03320f558e4d tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '163b2f24a72649ac8084be1cac32fa09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e123e9b86124c93a7fc2db9984e7466', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:33:50.864713 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-23e1f145-93ba-41f8-8681-03320f558e4d tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] 10.222.0.11 "GET /compute/v2.1/servers/0698dc5b-5f47-46c4-ace8-f5e891a964a0" status: 200 len: 1565 microversion: 2.1 time: 0.167855 Nov 17 03:33:50.865317 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 837/1700] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:33:50 2021] GET /compute/v2.1/servers/0698dc5b-5f47-46c4-ace8-f5e891a964a0 => generated 1565 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:33:50.876373 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-ef493651-6502-48fe-87ac-d12934c24f7d tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80763e09d44c475ea2425b22874e9612', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fef02a1dd77946a2ac0e0414b557435f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:33:50.884406 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-ef493651-6502-48fe-87ac-d12934c24f7d tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] 10.222.0.11 "GET /compute/v2.1/servers/5ddbfaaa-fabf-4324-941c-8868625ffefc" status: 200 len: 1226 microversion: 2.1 time: 0.083412 Nov 17 03:33:50.884965 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 864/1701] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:33:50 2021] GET /compute/v2.1/servers/5ddbfaaa-fabf-4324-941c-8868625ffefc => generated 1226 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:33:50.944337 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-a36784be-2079-49db-9d5a-dcb9ab82d4bc tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:33:50.945287 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-a36784be-2079-49db-9d5a-dcb9ab82d4bc tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] [instance: a49437df-3059-4528-8328-2f3471d5fb45] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:33:50.951475 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-a36784be-2079-49db-9d5a-dcb9ab82d4bc tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:33:50.951915 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-a36784be-2079-49db-9d5a-dcb9ab82d4bc tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:33:50.952682 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-a36784be-2079-49db-9d5a-dcb9ab82d4bc tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:33:50.953150 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-a36784be-2079-49db-9d5a-dcb9ab82d4bc tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:33:50.983493 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-a36784be-2079-49db-9d5a-dcb9ab82d4bc tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] 10.222.0.11 "GET /compute/v2.1/servers/a49437df-3059-4528-8328-2f3471d5fb45/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042910 Nov 17 03:33:50.984030 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 838/1702] 10.222.0.11 () {58 vars in 1301 bytes} [Wed Nov 17 03:33:50 2021] GET /compute/v2.1/servers/a49437df-3059-4528-8328-2f3471d5fb45/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 17 03:33:51.594572 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-0adab45f-24e5-4285-9678-5ea5ab0d491e tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:33:51.595920 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-0adab45f-24e5-4285-9678-5ea5ab0d491e tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] [instance: 5d54db85-b991-4890-abaa-952413baa2e7] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:33:51.606048 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-0adab45f-24e5-4285-9678-5ea5ab0d491e tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:33:51.606495 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-0adab45f-24e5-4285-9678-5ea5ab0d491e tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:33:51.607267 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-0adab45f-24e5-4285-9678-5ea5ab0d491e tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:33:51.607702 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-0adab45f-24e5-4285-9678-5ea5ab0d491e tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:33:51.639357 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-0adab45f-24e5-4285-9678-5ea5ab0d491e tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] 10.222.0.11 "GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.051279 Nov 17 03:33:51.639926 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 865/1703] 10.222.0.11 () {60 vars in 1342 bytes} [Wed Nov 17 03:33:51 2021] GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 17 03:33:51.884761 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-8099706d-f845-4f65-ae67-27c58fbcbb84 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:33:51.885488 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-8099706d-f845-4f65-ae67-27c58fbcbb84 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] [instance: 0698dc5b-5f47-46c4-ace8-f5e891a964a0] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:33:51.892806 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-8099706d-f845-4f65-ae67-27c58fbcbb84 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:33:51.893222 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-8099706d-f845-4f65-ae67-27c58fbcbb84 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:33:51.894033 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-8099706d-f845-4f65-ae67-27c58fbcbb84 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:33:51.894456 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-8099706d-f845-4f65-ae67-27c58fbcbb84 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:33:51.900975 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-4863f4f7-05d9-4b80-a7d2-96d58b625b7e tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:33:51.901592 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-4863f4f7-05d9-4b80-a7d2-96d58b625b7e tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] [instance: 5ddbfaaa-fabf-4324-941c-8868625ffefc] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:33:51.908716 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-4863f4f7-05d9-4b80-a7d2-96d58b625b7e tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:33:51.909200 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-4863f4f7-05d9-4b80-a7d2-96d58b625b7e tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:33:51.909978 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-4863f4f7-05d9-4b80-a7d2-96d58b625b7e tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:33:51.910413 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-4863f4f7-05d9-4b80-a7d2-96d58b625b7e tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:33:51.972407 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-4863f4f7-05d9-4b80-a7d2-96d58b625b7e tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80763e09d44c475ea2425b22874e9612', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fef02a1dd77946a2ac0e0414b557435f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:33:51.980149 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-4863f4f7-05d9-4b80-a7d2-96d58b625b7e tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] 10.222.0.11 "GET /compute/v2.1/servers/5ddbfaaa-fabf-4324-941c-8868625ffefc" status: 200 len: 1226 microversion: 2.1 time: 0.082764 Nov 17 03:33:51.980759 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 866/1704] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:33:51 2021] GET /compute/v2.1/servers/5ddbfaaa-fabf-4324-941c-8868625ffefc => generated 1226 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:33:51.996592 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-079cf312-45ab-4d67-9886-07d7616aeee0 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:33:51.997537 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-079cf312-45ab-4d67-9886-07d7616aeee0 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] [instance: a49437df-3059-4528-8328-2f3471d5fb45] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:33:52.003374 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-079cf312-45ab-4d67-9886-07d7616aeee0 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:33:52.003817 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-079cf312-45ab-4d67-9886-07d7616aeee0 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:33:52.004587 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-079cf312-45ab-4d67-9886-07d7616aeee0 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:33:52.005046 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-079cf312-45ab-4d67-9886-07d7616aeee0 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:33:52.029733 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-8099706d-f845-4f65-ae67-27c58fbcbb84 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '163b2f24a72649ac8084be1cac32fa09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e123e9b86124c93a7fc2db9984e7466', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:33:52.033733 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-079cf312-45ab-4d67-9886-07d7616aeee0 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] 10.222.0.11 "GET /compute/v2.1/servers/a49437df-3059-4528-8328-2f3471d5fb45/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040890 Nov 17 03:33:52.034302 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 867/1705] 10.222.0.11 () {58 vars in 1301 bytes} [Wed Nov 17 03:33:51 2021] GET /compute/v2.1/servers/a49437df-3059-4528-8328-2f3471d5fb45/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 17 03:33:52.037150 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-8099706d-f845-4f65-ae67-27c58fbcbb84 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] 10.222.0.11 "GET /compute/v2.1/servers/0698dc5b-5f47-46c4-ace8-f5e891a964a0" status: 200 len: 1565 microversion: 2.1 time: 0.157339 Nov 17 03:33:52.037739 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 839/1706] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:33:51 2021] GET /compute/v2.1/servers/0698dc5b-5f47-46c4-ace8-f5e891a964a0 => generated 1565 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:33:52.654010 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-fe4fb77f-b52e-44a0-9e43-11523a714395 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:33:52.654916 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-fe4fb77f-b52e-44a0-9e43-11523a714395 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] [instance: 5d54db85-b991-4890-abaa-952413baa2e7] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:33:52.661962 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-fe4fb77f-b52e-44a0-9e43-11523a714395 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:33:52.662417 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-fe4fb77f-b52e-44a0-9e43-11523a714395 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:33:52.663191 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-fe4fb77f-b52e-44a0-9e43-11523a714395 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:33:52.663627 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-fe4fb77f-b52e-44a0-9e43-11523a714395 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:33:52.693816 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-fe4fb77f-b52e-44a0-9e43-11523a714395 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] 10.222.0.11 "GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045577 Nov 17 03:33:52.694348 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 868/1707] 10.222.0.11 () {60 vars in 1342 bytes} [Wed Nov 17 03:33:52 2021] GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 17 03:33:52.998654 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-948ebbe0-6e09-4a20-992d-fc29125396d1 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:33:52.999239 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-948ebbe0-6e09-4a20-992d-fc29125396d1 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] [instance: 5ddbfaaa-fabf-4324-941c-8868625ffefc] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:33:53.005868 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-948ebbe0-6e09-4a20-992d-fc29125396d1 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:33:53.006314 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-948ebbe0-6e09-4a20-992d-fc29125396d1 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:33:53.007080 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-948ebbe0-6e09-4a20-992d-fc29125396d1 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:33:53.007502 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-948ebbe0-6e09-4a20-992d-fc29125396d1 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:33:53.045242 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-924d6a3d-f19f-4b33-b085-3b8014aeb3a7 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:33:53.046158 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-924d6a3d-f19f-4b33-b085-3b8014aeb3a7 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] [instance: a49437df-3059-4528-8328-2f3471d5fb45] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:33:53.052432 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-924d6a3d-f19f-4b33-b085-3b8014aeb3a7 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:33:53.053066 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-924d6a3d-f19f-4b33-b085-3b8014aeb3a7 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:33:53.053937 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-924d6a3d-f19f-4b33-b085-3b8014aeb3a7 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:33:53.055279 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-924d6a3d-f19f-4b33-b085-3b8014aeb3a7 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:33:53.075258 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-948ebbe0-6e09-4a20-992d-fc29125396d1 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80763e09d44c475ea2425b22874e9612', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fef02a1dd77946a2ac0e0414b557435f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:33:53.082914 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-948ebbe0-6e09-4a20-992d-fc29125396d1 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] 10.222.0.11 "GET /compute/v2.1/servers/5ddbfaaa-fabf-4324-941c-8868625ffefc" status: 200 len: 1226 microversion: 2.1 time: 0.088859 Nov 17 03:33:53.083533 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 840/1708] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:33:52 2021] GET /compute/v2.1/servers/5ddbfaaa-fabf-4324-941c-8868625ffefc => generated 1226 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:33:53.085244 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-924d6a3d-f19f-4b33-b085-3b8014aeb3a7 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] 10.222.0.11 "GET /compute/v2.1/servers/a49437df-3059-4528-8328-2f3471d5fb45/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043976 Nov 17 03:33:53.085988 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 869/1709] 10.222.0.11 () {58 vars in 1301 bytes} [Wed Nov 17 03:33:53 2021] GET /compute/v2.1/servers/a49437df-3059-4528-8328-2f3471d5fb45/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 17 03:33:53.087740 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-c6a34bc4-0908-4275-a341-ca090ef7b024 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:33:53.088364 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-c6a34bc4-0908-4275-a341-ca090ef7b024 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] [instance: 0698dc5b-5f47-46c4-ace8-f5e891a964a0] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:33:53.094134 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-c6a34bc4-0908-4275-a341-ca090ef7b024 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:33:53.094563 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-c6a34bc4-0908-4275-a341-ca090ef7b024 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:33:53.095328 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-c6a34bc4-0908-4275-a341-ca090ef7b024 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:33:53.095758 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-c6a34bc4-0908-4275-a341-ca090ef7b024 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:33:53.233066 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-c6a34bc4-0908-4275-a341-ca090ef7b024 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '163b2f24a72649ac8084be1cac32fa09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e123e9b86124c93a7fc2db9984e7466', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:33:53.240924 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-c6a34bc4-0908-4275-a341-ca090ef7b024 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] 10.222.0.11 "GET /compute/v2.1/servers/0698dc5b-5f47-46c4-ace8-f5e891a964a0" status: 200 len: 1565 microversion: 2.1 time: 0.156450 Nov 17 03:33:53.241490 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 841/1710] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:33:53 2021] GET /compute/v2.1/servers/0698dc5b-5f47-46c4-ace8-f5e891a964a0 => generated 1565 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:33:53.709544 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-0c33d8e4-26cb-4f16-afad-99664afbeeee tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:33:53.711010 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-0c33d8e4-26cb-4f16-afad-99664afbeeee tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] [instance: 5d54db85-b991-4890-abaa-952413baa2e7] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:33:53.719012 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-0c33d8e4-26cb-4f16-afad-99664afbeeee tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:33:53.719466 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-0c33d8e4-26cb-4f16-afad-99664afbeeee tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:33:53.720235 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-0c33d8e4-26cb-4f16-afad-99664afbeeee tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:33:53.720665 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-0c33d8e4-26cb-4f16-afad-99664afbeeee tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:33:53.751207 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-0c33d8e4-26cb-4f16-afad-99664afbeeee tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] 10.222.0.11 "GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.048127 Nov 17 03:33:53.751760 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 870/1711] 10.222.0.11 () {60 vars in 1342 bytes} [Wed Nov 17 03:33:53 2021] GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 17 03:33:54.097052 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-b8d7c891-6df4-44a6-b11b-717751daf6ad tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:33:54.098004 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-b8d7c891-6df4-44a6-b11b-717751daf6ad tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] [instance: a49437df-3059-4528-8328-2f3471d5fb45] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:33:54.099159 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-20a93bf3-7f61-4bc8-86fa-2144c77e9ac8 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:33:54.099774 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-20a93bf3-7f61-4bc8-86fa-2144c77e9ac8 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] [instance: 5ddbfaaa-fabf-4324-941c-8868625ffefc] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:33:54.104291 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-b8d7c891-6df4-44a6-b11b-717751daf6ad tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:33:54.104737 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-b8d7c891-6df4-44a6-b11b-717751daf6ad tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:33:54.105620 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-b8d7c891-6df4-44a6-b11b-717751daf6ad tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:33:54.106125 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-b8d7c891-6df4-44a6-b11b-717751daf6ad tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:33:54.106658 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-20a93bf3-7f61-4bc8-86fa-2144c77e9ac8 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:33:54.107110 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-20a93bf3-7f61-4bc8-86fa-2144c77e9ac8 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:33:54.107888 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-20a93bf3-7f61-4bc8-86fa-2144c77e9ac8 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:33:54.108321 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-20a93bf3-7f61-4bc8-86fa-2144c77e9ac8 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:33:54.136224 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-b8d7c891-6df4-44a6-b11b-717751daf6ad tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] 10.222.0.11 "GET /compute/v2.1/servers/a49437df-3059-4528-8328-2f3471d5fb45/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043031 Nov 17 03:33:54.136807 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 842/1712] 10.222.0.11 () {58 vars in 1301 bytes} [Wed Nov 17 03:33:54 2021] GET /compute/v2.1/servers/a49437df-3059-4528-8328-2f3471d5fb45/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 17 03:33:54.168707 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-20a93bf3-7f61-4bc8-86fa-2144c77e9ac8 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80763e09d44c475ea2425b22874e9612', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fef02a1dd77946a2ac0e0414b557435f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:33:54.176348 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-20a93bf3-7f61-4bc8-86fa-2144c77e9ac8 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] 10.222.0.11 "GET /compute/v2.1/servers/5ddbfaaa-fabf-4324-941c-8868625ffefc" status: 200 len: 1226 microversion: 2.1 time: 0.080820 Nov 17 03:33:54.176933 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 871/1713] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:33:54 2021] GET /compute/v2.1/servers/5ddbfaaa-fabf-4324-941c-8868625ffefc => generated 1226 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:33:54.263150 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-428d9be6-32c0-47bd-bae0-62b7dab12ac2 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:33:54.264147 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-428d9be6-32c0-47bd-bae0-62b7dab12ac2 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] [instance: 0698dc5b-5f47-46c4-ace8-f5e891a964a0] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:33:54.274213 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-428d9be6-32c0-47bd-bae0-62b7dab12ac2 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:33:54.274963 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-428d9be6-32c0-47bd-bae0-62b7dab12ac2 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:33:54.276242 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-428d9be6-32c0-47bd-bae0-62b7dab12ac2 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:33:54.277003 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-428d9be6-32c0-47bd-bae0-62b7dab12ac2 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:33:54.413029 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-428d9be6-32c0-47bd-bae0-62b7dab12ac2 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '163b2f24a72649ac8084be1cac32fa09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e123e9b86124c93a7fc2db9984e7466', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:33:54.424205 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-428d9be6-32c0-47bd-bae0-62b7dab12ac2 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] 10.222.0.11 "GET /compute/v2.1/servers/0698dc5b-5f47-46c4-ace8-f5e891a964a0" status: 200 len: 1565 microversion: 2.1 time: 0.166953 Nov 17 03:33:54.424948 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 843/1714] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:33:54 2021] GET /compute/v2.1/servers/0698dc5b-5f47-46c4-ace8-f5e891a964a0 => generated 1565 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:33:54.767659 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-9da13345-68e7-4a8e-acbd-67c594a73ac0 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:33:54.769172 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-9da13345-68e7-4a8e-acbd-67c594a73ac0 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] [instance: 5d54db85-b991-4890-abaa-952413baa2e7] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:33:54.779836 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-9da13345-68e7-4a8e-acbd-67c594a73ac0 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:33:54.780585 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-9da13345-68e7-4a8e-acbd-67c594a73ac0 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:33:54.781925 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-9da13345-68e7-4a8e-acbd-67c594a73ac0 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:33:54.782649 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-9da13345-68e7-4a8e-acbd-67c594a73ac0 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:33:54.816395 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-9da13345-68e7-4a8e-acbd-67c594a73ac0 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] 10.222.0.11 "GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.055813 Nov 17 03:33:54.816973 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 872/1715] 10.222.0.11 () {60 vars in 1342 bytes} [Wed Nov 17 03:33:54 2021] GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7/os-volume_attachments => generated 197 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 17 03:33:55.149450 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-205a4d0e-b22d-4514-a74a-9b00c4bffca9 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:33:55.150518 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-205a4d0e-b22d-4514-a74a-9b00c4bffca9 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] [instance: a49437df-3059-4528-8328-2f3471d5fb45] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:33:55.157685 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-205a4d0e-b22d-4514-a74a-9b00c4bffca9 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:33:55.158129 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-205a4d0e-b22d-4514-a74a-9b00c4bffca9 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:33:55.158907 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-205a4d0e-b22d-4514-a74a-9b00c4bffca9 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:33:55.159346 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-205a4d0e-b22d-4514-a74a-9b00c4bffca9 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:33:55.189845 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-205a4d0e-b22d-4514-a74a-9b00c4bffca9 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] 10.222.0.11 "GET /compute/v2.1/servers/a49437df-3059-4528-8328-2f3471d5fb45/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044935 Nov 17 03:33:55.190398 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 844/1716] 10.222.0.11 () {58 vars in 1301 bytes} [Wed Nov 17 03:33:55 2021] GET /compute/v2.1/servers/a49437df-3059-4528-8328-2f3471d5fb45/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 17 03:33:55.193549 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-3da9105a-ce95-4bcd-b7ce-7ad4b6ba1fb6 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:33:55.194170 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-3da9105a-ce95-4bcd-b7ce-7ad4b6ba1fb6 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] [instance: 5ddbfaaa-fabf-4324-941c-8868625ffefc] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:33:55.201101 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-3da9105a-ce95-4bcd-b7ce-7ad4b6ba1fb6 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:33:55.201656 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-3da9105a-ce95-4bcd-b7ce-7ad4b6ba1fb6 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:33:55.202483 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-3da9105a-ce95-4bcd-b7ce-7ad4b6ba1fb6 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:33:55.203172 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-3da9105a-ce95-4bcd-b7ce-7ad4b6ba1fb6 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:33:55.270149 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-3da9105a-ce95-4bcd-b7ce-7ad4b6ba1fb6 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80763e09d44c475ea2425b22874e9612', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fef02a1dd77946a2ac0e0414b557435f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:33:55.282249 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-3da9105a-ce95-4bcd-b7ce-7ad4b6ba1fb6 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] 10.222.0.11 "GET /compute/v2.1/servers/5ddbfaaa-fabf-4324-941c-8868625ffefc" status: 200 len: 1226 microversion: 2.1 time: 0.092088 Nov 17 03:33:55.282983 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 873/1717] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:33:55 2021] GET /compute/v2.1/servers/5ddbfaaa-fabf-4324-941c-8868625ffefc => generated 1226 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:33:55.446269 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-1b1f05c1-7fbc-499b-91f1-0ac206b2439a tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:33:55.447129 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-1b1f05c1-7fbc-499b-91f1-0ac206b2439a tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] [instance: 0698dc5b-5f47-46c4-ace8-f5e891a964a0] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:33:55.454313 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-1b1f05c1-7fbc-499b-91f1-0ac206b2439a tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:33:55.454757 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-1b1f05c1-7fbc-499b-91f1-0ac206b2439a tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:33:55.455532 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-1b1f05c1-7fbc-499b-91f1-0ac206b2439a tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:33:55.455946 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-1b1f05c1-7fbc-499b-91f1-0ac206b2439a tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:33:55.611165 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-1b1f05c1-7fbc-499b-91f1-0ac206b2439a tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '163b2f24a72649ac8084be1cac32fa09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e123e9b86124c93a7fc2db9984e7466', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:33:55.618683 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-1b1f05c1-7fbc-499b-91f1-0ac206b2439a tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] 10.222.0.11 "GET /compute/v2.1/servers/0698dc5b-5f47-46c4-ace8-f5e891a964a0" status: 200 len: 1565 microversion: 2.1 time: 0.178854 Nov 17 03:33:55.619258 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 845/1718] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:33:55 2021] GET /compute/v2.1/servers/0698dc5b-5f47-46c4-ace8-f5e891a964a0 => generated 1565 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:33:55.832022 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-f9d5cfbc-a4c4-456e-a98b-120a72469fac tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:33:55.833549 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-f9d5cfbc-a4c4-456e-a98b-120a72469fac tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] [instance: 5d54db85-b991-4890-abaa-952413baa2e7] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:33:55.843268 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-f9d5cfbc-a4c4-456e-a98b-120a72469fac tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:33:55.843740 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-f9d5cfbc-a4c4-456e-a98b-120a72469fac tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:33:55.844516 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-f9d5cfbc-a4c4-456e-a98b-120a72469fac tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:33:55.844997 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-f9d5cfbc-a4c4-456e-a98b-120a72469fac tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:33:55.876071 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-f9d5cfbc-a4c4-456e-a98b-120a72469fac tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] 10.222.0.11 "GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.050424 Nov 17 03:33:55.876627 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 874/1719] 10.222.0.11 () {60 vars in 1342 bytes} [Wed Nov 17 03:33:55 2021] GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 17 03:33:56.201807 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-60bf6795-c229-4778-8f22-cb250b97f54d tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:33:56.202831 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-60bf6795-c229-4778-8f22-cb250b97f54d tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] [instance: a49437df-3059-4528-8328-2f3471d5fb45] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:33:56.209790 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-60bf6795-c229-4778-8f22-cb250b97f54d tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:33:56.210229 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-60bf6795-c229-4778-8f22-cb250b97f54d tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:33:56.211001 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-60bf6795-c229-4778-8f22-cb250b97f54d tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:33:56.211441 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-60bf6795-c229-4778-8f22-cb250b97f54d tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:33:56.242083 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-60bf6795-c229-4778-8f22-cb250b97f54d tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] 10.222.0.11 "GET /compute/v2.1/servers/a49437df-3059-4528-8328-2f3471d5fb45/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044156 Nov 17 03:33:56.242651 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 846/1720] 10.222.0.11 () {58 vars in 1301 bytes} [Wed Nov 17 03:33:56 2021] GET /compute/v2.1/servers/a49437df-3059-4528-8328-2f3471d5fb45/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 17 03:33:56.306630 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-b7fcb177-1564-4adb-9493-33672a107946 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:33:56.307625 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-b7fcb177-1564-4adb-9493-33672a107946 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] [instance: 5ddbfaaa-fabf-4324-941c-8868625ffefc] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:33:56.318303 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-b7fcb177-1564-4adb-9493-33672a107946 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:33:56.318930 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-b7fcb177-1564-4adb-9493-33672a107946 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:33:56.320186 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-b7fcb177-1564-4adb-9493-33672a107946 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:33:56.320931 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-b7fcb177-1564-4adb-9493-33672a107946 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:33:56.385271 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-b7fcb177-1564-4adb-9493-33672a107946 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80763e09d44c475ea2425b22874e9612', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fef02a1dd77946a2ac0e0414b557435f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:33:56.392920 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-b7fcb177-1564-4adb-9493-33672a107946 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] 10.222.0.11 "GET /compute/v2.1/servers/5ddbfaaa-fabf-4324-941c-8868625ffefc" status: 200 len: 1226 microversion: 2.1 time: 0.092824 Nov 17 03:33:56.393486 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 875/1721] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:33:56 2021] GET /compute/v2.1/servers/5ddbfaaa-fabf-4324-941c-8868625ffefc => generated 1226 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:33:56.636924 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-4457fa20-71e4-4135-91e5-70b7bf7f18d4 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:33:56.637456 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-4457fa20-71e4-4135-91e5-70b7bf7f18d4 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] [instance: 0698dc5b-5f47-46c4-ace8-f5e891a964a0] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:33:56.644007 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-4457fa20-71e4-4135-91e5-70b7bf7f18d4 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:33:56.644451 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-4457fa20-71e4-4135-91e5-70b7bf7f18d4 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:33:56.645247 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-4457fa20-71e4-4135-91e5-70b7bf7f18d4 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:33:56.645670 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-4457fa20-71e4-4135-91e5-70b7bf7f18d4 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:33:56.800624 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-4457fa20-71e4-4135-91e5-70b7bf7f18d4 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '163b2f24a72649ac8084be1cac32fa09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e123e9b86124c93a7fc2db9984e7466', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:33:56.809112 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-4457fa20-71e4-4135-91e5-70b7bf7f18d4 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] 10.222.0.11 "GET /compute/v2.1/servers/0698dc5b-5f47-46c4-ace8-f5e891a964a0" status: 200 len: 1565 microversion: 2.1 time: 0.176251 Nov 17 03:33:56.809711 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 847/1722] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:33:56 2021] GET /compute/v2.1/servers/0698dc5b-5f47-46c4-ace8-f5e891a964a0 => generated 1565 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:33:56.893709 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-3aac08f4-35b2-4e7d-82b5-586038e44d6a tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:33:56.895042 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-3aac08f4-35b2-4e7d-82b5-586038e44d6a tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] [instance: 5d54db85-b991-4890-abaa-952413baa2e7] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:33:56.905920 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-3aac08f4-35b2-4e7d-82b5-586038e44d6a tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:33:56.906649 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-3aac08f4-35b2-4e7d-82b5-586038e44d6a tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:33:56.907928 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-3aac08f4-35b2-4e7d-82b5-586038e44d6a tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:33:56.908632 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-3aac08f4-35b2-4e7d-82b5-586038e44d6a tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:33:56.942392 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-3aac08f4-35b2-4e7d-82b5-586038e44d6a tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] 10.222.0.11 "GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.055402 Nov 17 03:33:56.942958 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 876/1723] 10.222.0.11 () {60 vars in 1342 bytes} [Wed Nov 17 03:33:56 2021] GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7/os-volume_attachments => generated 197 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 17 03:33:57.257828 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-c22fd576-cc74-46e2-9b43-083c0738859b tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:33:57.259289 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-c22fd576-cc74-46e2-9b43-083c0738859b tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] [instance: a49437df-3059-4528-8328-2f3471d5fb45] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:33:57.270100 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-c22fd576-cc74-46e2-9b43-083c0738859b tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:33:57.270836 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-c22fd576-cc74-46e2-9b43-083c0738859b tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:33:57.272102 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-c22fd576-cc74-46e2-9b43-083c0738859b tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:33:57.272858 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-c22fd576-cc74-46e2-9b43-083c0738859b tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:33:57.306186 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-c22fd576-cc74-46e2-9b43-083c0738859b tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] 10.222.0.11 "GET /compute/v2.1/servers/a49437df-3059-4528-8328-2f3471d5fb45/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.054658 Nov 17 03:33:57.306734 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 848/1724] 10.222.0.11 () {58 vars in 1301 bytes} [Wed Nov 17 03:33:57 2021] GET /compute/v2.1/servers/a49437df-3059-4528-8328-2f3471d5fb45/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 17 03:33:57.417512 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-9a583edf-851b-4fde-8ae9-2d7408dc7978 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:33:57.418525 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-9a583edf-851b-4fde-8ae9-2d7408dc7978 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] [instance: 5ddbfaaa-fabf-4324-941c-8868625ffefc] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:33:57.428842 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-9a583edf-851b-4fde-8ae9-2d7408dc7978 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:33:57.429586 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-9a583edf-851b-4fde-8ae9-2d7408dc7978 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:33:57.431312 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-9a583edf-851b-4fde-8ae9-2d7408dc7978 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:33:57.432082 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-9a583edf-851b-4fde-8ae9-2d7408dc7978 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:33:57.494863 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-9a583edf-851b-4fde-8ae9-2d7408dc7978 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80763e09d44c475ea2425b22874e9612', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fef02a1dd77946a2ac0e0414b557435f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:33:57.502821 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-9a583edf-851b-4fde-8ae9-2d7408dc7978 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] 10.222.0.11 "GET /compute/v2.1/servers/5ddbfaaa-fabf-4324-941c-8868625ffefc" status: 200 len: 1226 microversion: 2.1 time: 0.091524 Nov 17 03:33:57.503388 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 877/1725] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:33:57 2021] GET /compute/v2.1/servers/5ddbfaaa-fabf-4324-941c-8868625ffefc => generated 1226 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:33:57.826489 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-67893c25-60cb-4dad-a33d-7399e5b7d74b tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:33:57.827099 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-67893c25-60cb-4dad-a33d-7399e5b7d74b tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] [instance: 0698dc5b-5f47-46c4-ace8-f5e891a964a0] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:33:57.833528 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-67893c25-60cb-4dad-a33d-7399e5b7d74b tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:33:57.833990 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-67893c25-60cb-4dad-a33d-7399e5b7d74b tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:33:57.834757 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-67893c25-60cb-4dad-a33d-7399e5b7d74b tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:33:57.835196 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-67893c25-60cb-4dad-a33d-7399e5b7d74b tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:33:57.953543 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-dab3ef03-14b1-48ab-a545-a533d1b0e3a8 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:33:57.954448 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-dab3ef03-14b1-48ab-a545-a533d1b0e3a8 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] [instance: 5d54db85-b991-4890-abaa-952413baa2e7] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:33:57.960726 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-dab3ef03-14b1-48ab-a545-a533d1b0e3a8 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:33:57.961208 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-dab3ef03-14b1-48ab-a545-a533d1b0e3a8 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:33:57.962019 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-dab3ef03-14b1-48ab-a545-a533d1b0e3a8 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:33:57.962444 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-dab3ef03-14b1-48ab-a545-a533d1b0e3a8 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:33:57.973253 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-67893c25-60cb-4dad-a33d-7399e5b7d74b tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '163b2f24a72649ac8084be1cac32fa09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e123e9b86124c93a7fc2db9984e7466', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:33:57.980867 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-67893c25-60cb-4dad-a33d-7399e5b7d74b tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] 10.222.0.11 "GET /compute/v2.1/servers/0698dc5b-5f47-46c4-ace8-f5e891a964a0" status: 200 len: 1565 microversion: 2.1 time: 0.158154 Nov 17 03:33:57.981594 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 849/1726] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:33:57 2021] GET /compute/v2.1/servers/0698dc5b-5f47-46c4-ace8-f5e891a964a0 => generated 1565 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:33:57.992995 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-dab3ef03-14b1-48ab-a545-a533d1b0e3a8 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] 10.222.0.11 "GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043174 Nov 17 03:33:57.993537 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 878/1727] 10.222.0.11 () {60 vars in 1342 bytes} [Wed Nov 17 03:33:57 2021] GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 17 03:33:58.321339 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-0fa18ba9-063c-4d18-ab70-60cff3a4d1d0 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:33:58.322806 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-0fa18ba9-063c-4d18-ab70-60cff3a4d1d0 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] [instance: a49437df-3059-4528-8328-2f3471d5fb45] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:33:58.330512 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-0fa18ba9-063c-4d18-ab70-60cff3a4d1d0 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:33:58.330969 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-0fa18ba9-063c-4d18-ab70-60cff3a4d1d0 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:33:58.331742 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-0fa18ba9-063c-4d18-ab70-60cff3a4d1d0 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:33:58.332179 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-0fa18ba9-063c-4d18-ab70-60cff3a4d1d0 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:33:58.361885 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-0fa18ba9-063c-4d18-ab70-60cff3a4d1d0 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] 10.222.0.11 "GET /compute/v2.1/servers/a49437df-3059-4528-8328-2f3471d5fb45/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047077 Nov 17 03:33:58.362440 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 850/1728] 10.222.0.11 () {58 vars in 1301 bytes} [Wed Nov 17 03:33:58 2021] GET /compute/v2.1/servers/a49437df-3059-4528-8328-2f3471d5fb45/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 17 03:33:58.523723 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-a4ca5adf-12d7-46ae-acfb-f47bb377e096 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:33:58.524713 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-a4ca5adf-12d7-46ae-acfb-f47bb377e096 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] [instance: 5ddbfaaa-fabf-4324-941c-8868625ffefc] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:33:58.534894 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-a4ca5adf-12d7-46ae-acfb-f47bb377e096 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:33:58.535648 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-a4ca5adf-12d7-46ae-acfb-f47bb377e096 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:33:58.537044 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-a4ca5adf-12d7-46ae-acfb-f47bb377e096 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:33:58.537809 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-a4ca5adf-12d7-46ae-acfb-f47bb377e096 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:33:58.601946 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-a4ca5adf-12d7-46ae-acfb-f47bb377e096 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80763e09d44c475ea2425b22874e9612', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fef02a1dd77946a2ac0e0414b557435f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:33:58.609693 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-a4ca5adf-12d7-46ae-acfb-f47bb377e096 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] 10.222.0.11 "GET /compute/v2.1/servers/5ddbfaaa-fabf-4324-941c-8868625ffefc" status: 200 len: 1226 microversion: 2.1 time: 0.092210 Nov 17 03:33:58.610253 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 879/1729] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:33:58 2021] GET /compute/v2.1/servers/5ddbfaaa-fabf-4324-941c-8868625ffefc => generated 1226 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:33:59.002139 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-db8e5bae-0325-473d-b710-7756195891cb tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:33:59.003039 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-db8e5bae-0325-473d-b710-7756195891cb tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] [instance: 0698dc5b-5f47-46c4-ace8-f5e891a964a0] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:33:59.008248 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-87b962c2-c58e-441a-994d-e53b284cec35 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:33:59.009787 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-87b962c2-c58e-441a-994d-e53b284cec35 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] [instance: 5d54db85-b991-4890-abaa-952413baa2e7] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:33:59.013171 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-db8e5bae-0325-473d-b710-7756195891cb tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:33:59.013620 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-db8e5bae-0325-473d-b710-7756195891cb tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:33:59.014394 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-db8e5bae-0325-473d-b710-7756195891cb tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:33:59.014826 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-db8e5bae-0325-473d-b710-7756195891cb tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:33:59.017694 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-87b962c2-c58e-441a-994d-e53b284cec35 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:33:59.018158 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-87b962c2-c58e-441a-994d-e53b284cec35 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:33:59.018927 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-87b962c2-c58e-441a-994d-e53b284cec35 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:33:59.019365 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-87b962c2-c58e-441a-994d-e53b284cec35 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:33:59.051662 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-87b962c2-c58e-441a-994d-e53b284cec35 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] 10.222.0.11 "GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.049608 Nov 17 03:33:59.053800 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 880/1730] 10.222.0.11 () {60 vars in 1342 bytes} [Wed Nov 17 03:33:59 2021] GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 17 03:33:59.152645 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-db8e5bae-0325-473d-b710-7756195891cb tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '163b2f24a72649ac8084be1cac32fa09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e123e9b86124c93a7fc2db9984e7466', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:33:59.160452 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-db8e5bae-0325-473d-b710-7756195891cb tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] 10.222.0.11 "GET /compute/v2.1/servers/0698dc5b-5f47-46c4-ace8-f5e891a964a0" status: 200 len: 1565 microversion: 2.1 time: 0.165027 Nov 17 03:33:59.161123 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 851/1731] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:33:58 2021] GET /compute/v2.1/servers/0698dc5b-5f47-46c4-ace8-f5e891a964a0 => generated 1565 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:33:59.376512 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-1127952c-8d74-4a8a-8c44-6c202224f8e8 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:33:59.377897 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-1127952c-8d74-4a8a-8c44-6c202224f8e8 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] [instance: a49437df-3059-4528-8328-2f3471d5fb45] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:33:59.385397 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-1127952c-8d74-4a8a-8c44-6c202224f8e8 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:33:59.385869 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-1127952c-8d74-4a8a-8c44-6c202224f8e8 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:33:59.386658 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-1127952c-8d74-4a8a-8c44-6c202224f8e8 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:33:59.387098 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-1127952c-8d74-4a8a-8c44-6c202224f8e8 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:33:59.417897 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-1127952c-8d74-4a8a-8c44-6c202224f8e8 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] 10.222.0.11 "GET /compute/v2.1/servers/a49437df-3059-4528-8328-2f3471d5fb45/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046647 Nov 17 03:33:59.418452 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 881/1732] 10.222.0.11 () {58 vars in 1301 bytes} [Wed Nov 17 03:33:59 2021] GET /compute/v2.1/servers/a49437df-3059-4528-8328-2f3471d5fb45/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 17 03:33:59.629905 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-edc23d60-8d20-460b-b1eb-a04be3bbfdf1 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:33:59.630757 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-edc23d60-8d20-460b-b1eb-a04be3bbfdf1 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] [instance: 5ddbfaaa-fabf-4324-941c-8868625ffefc] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:33:59.641605 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-edc23d60-8d20-460b-b1eb-a04be3bbfdf1 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:33:59.642305 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-edc23d60-8d20-460b-b1eb-a04be3bbfdf1 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:33:59.643608 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-edc23d60-8d20-460b-b1eb-a04be3bbfdf1 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:33:59.644319 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-edc23d60-8d20-460b-b1eb-a04be3bbfdf1 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:33:59.708036 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-edc23d60-8d20-460b-b1eb-a04be3bbfdf1 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80763e09d44c475ea2425b22874e9612', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fef02a1dd77946a2ac0e0414b557435f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:33:59.716488 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-edc23d60-8d20-460b-b1eb-a04be3bbfdf1 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] 10.222.0.11 "GET /compute/v2.1/servers/5ddbfaaa-fabf-4324-941c-8868625ffefc" status: 200 len: 1226 microversion: 2.1 time: 0.092748 Nov 17 03:33:59.717081 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 852/1733] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:33:59 2021] GET /compute/v2.1/servers/5ddbfaaa-fabf-4324-941c-8868625ffefc => generated 1226 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:34:00.063700 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-11da5dea-8364-40a8-a94e-be4c4316f0d9 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:34:00.064631 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-11da5dea-8364-40a8-a94e-be4c4316f0d9 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] [instance: 5d54db85-b991-4890-abaa-952413baa2e7] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:34:00.071436 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-11da5dea-8364-40a8-a94e-be4c4316f0d9 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:34:00.071909 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-11da5dea-8364-40a8-a94e-be4c4316f0d9 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:34:00.072678 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-11da5dea-8364-40a8-a94e-be4c4316f0d9 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:34:00.073151 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-11da5dea-8364-40a8-a94e-be4c4316f0d9 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:34:00.102195 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-11da5dea-8364-40a8-a94e-be4c4316f0d9 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] 10.222.0.11 "GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042891 Nov 17 03:34:00.102749 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 882/1734] 10.222.0.11 () {60 vars in 1342 bytes} [Wed Nov 17 03:34:00 2021] GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 17 03:34:00.184132 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-567ce606-a0a5-4e07-bd7c-8c1ae3742e69 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:34:00.184978 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-567ce606-a0a5-4e07-bd7c-8c1ae3742e69 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] [instance: 0698dc5b-5f47-46c4-ace8-f5e891a964a0] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:34:00.191920 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-567ce606-a0a5-4e07-bd7c-8c1ae3742e69 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:34:00.192395 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-567ce606-a0a5-4e07-bd7c-8c1ae3742e69 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:34:00.193238 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-567ce606-a0a5-4e07-bd7c-8c1ae3742e69 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:34:00.193691 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-567ce606-a0a5-4e07-bd7c-8c1ae3742e69 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:34:00.332338 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-567ce606-a0a5-4e07-bd7c-8c1ae3742e69 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '163b2f24a72649ac8084be1cac32fa09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e123e9b86124c93a7fc2db9984e7466', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:34:00.339754 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-567ce606-a0a5-4e07-bd7c-8c1ae3742e69 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] 10.222.0.11 "GET /compute/v2.1/servers/0698dc5b-5f47-46c4-ace8-f5e891a964a0" status: 200 len: 1565 microversion: 2.1 time: 0.162134 Nov 17 03:34:00.340315 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 853/1735] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:34:00 2021] GET /compute/v2.1/servers/0698dc5b-5f47-46c4-ace8-f5e891a964a0 => generated 1565 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:34:00.433084 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-973b182d-b453-425a-a9ca-4aecd288b85d tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:34:00.434420 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-973b182d-b453-425a-a9ca-4aecd288b85d tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] [instance: a49437df-3059-4528-8328-2f3471d5fb45] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:34:00.441034 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-973b182d-b453-425a-a9ca-4aecd288b85d tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:34:00.441496 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-973b182d-b453-425a-a9ca-4aecd288b85d tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:34:00.442247 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-973b182d-b453-425a-a9ca-4aecd288b85d tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:34:00.442669 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-973b182d-b453-425a-a9ca-4aecd288b85d tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:34:00.472769 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-973b182d-b453-425a-a9ca-4aecd288b85d tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] 10.222.0.11 "GET /compute/v2.1/servers/a49437df-3059-4528-8328-2f3471d5fb45/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046070 Nov 17 03:34:00.473360 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 883/1736] 10.222.0.11 () {58 vars in 1301 bytes} [Wed Nov 17 03:34:00 2021] GET /compute/v2.1/servers/a49437df-3059-4528-8328-2f3471d5fb45/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 17 03:34:00.738004 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-57953ef9-219a-4fef-9f19-aa460c5640f8 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:34:00.738904 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-57953ef9-219a-4fef-9f19-aa460c5640f8 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] [instance: 5ddbfaaa-fabf-4324-941c-8868625ffefc] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:34:00.750350 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-57953ef9-219a-4fef-9f19-aa460c5640f8 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:34:00.751085 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-57953ef9-219a-4fef-9f19-aa460c5640f8 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:34:00.752397 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-57953ef9-219a-4fef-9f19-aa460c5640f8 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:34:00.753431 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-57953ef9-219a-4fef-9f19-aa460c5640f8 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:34:00.834350 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-57953ef9-219a-4fef-9f19-aa460c5640f8 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80763e09d44c475ea2425b22874e9612', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fef02a1dd77946a2ac0e0414b557435f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:34:00.842586 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-57953ef9-219a-4fef-9f19-aa460c5640f8 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] 10.222.0.11 "GET /compute/v2.1/servers/5ddbfaaa-fabf-4324-941c-8868625ffefc" status: 200 len: 1226 microversion: 2.1 time: 0.111599 Nov 17 03:34:00.843135 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 854/1737] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:34:00 2021] GET /compute/v2.1/servers/5ddbfaaa-fabf-4324-941c-8868625ffefc => generated 1226 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:34:01.114195 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-19bb9801-d4b8-4a3a-9ea4-38095f348cca tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:34:01.115228 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-19bb9801-d4b8-4a3a-9ea4-38095f348cca tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] [instance: 5d54db85-b991-4890-abaa-952413baa2e7] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:34:01.122131 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-19bb9801-d4b8-4a3a-9ea4-38095f348cca tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:34:01.122579 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-19bb9801-d4b8-4a3a-9ea4-38095f348cca tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:34:01.123299 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-19bb9801-d4b8-4a3a-9ea4-38095f348cca tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:34:01.123757 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-19bb9801-d4b8-4a3a-9ea4-38095f348cca tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:34:01.154157 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-19bb9801-d4b8-4a3a-9ea4-38095f348cca tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] 10.222.0.11 "GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043522 Nov 17 03:34:01.155176 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 884/1738] 10.222.0.11 () {60 vars in 1342 bytes} [Wed Nov 17 03:34:01 2021] GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 17 03:34:01.359258 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-91700c91-43bf-4807-84e7-ab1bd8004722 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:34:01.359769 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-91700c91-43bf-4807-84e7-ab1bd8004722 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] [instance: 0698dc5b-5f47-46c4-ace8-f5e891a964a0] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:34:01.366458 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-91700c91-43bf-4807-84e7-ab1bd8004722 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:34:01.366905 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-91700c91-43bf-4807-84e7-ab1bd8004722 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:34:01.367671 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-91700c91-43bf-4807-84e7-ab1bd8004722 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:34:01.368096 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-91700c91-43bf-4807-84e7-ab1bd8004722 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:34:01.483852 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-ae6971b7-35e2-43c3-9fd7-4dab88e29646 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:34:01.484809 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-ae6971b7-35e2-43c3-9fd7-4dab88e29646 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] [instance: a49437df-3059-4528-8328-2f3471d5fb45] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:34:01.491148 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-ae6971b7-35e2-43c3-9fd7-4dab88e29646 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:34:01.491595 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-ae6971b7-35e2-43c3-9fd7-4dab88e29646 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:34:01.492373 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-ae6971b7-35e2-43c3-9fd7-4dab88e29646 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:34:01.492801 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-ae6971b7-35e2-43c3-9fd7-4dab88e29646 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:34:01.514676 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-91700c91-43bf-4807-84e7-ab1bd8004722 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '163b2f24a72649ac8084be1cac32fa09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e123e9b86124c93a7fc2db9984e7466', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:34:01.522438 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-91700c91-43bf-4807-84e7-ab1bd8004722 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] 10.222.0.11 "GET /compute/v2.1/servers/0698dc5b-5f47-46c4-ace8-f5e891a964a0" status: 200 len: 1565 microversion: 2.1 time: 0.167863 Nov 17 03:34:01.523025 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 855/1739] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:34:01 2021] GET /compute/v2.1/servers/0698dc5b-5f47-46c4-ace8-f5e891a964a0 => generated 1565 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:34:01.523169 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-ae6971b7-35e2-43c3-9fd7-4dab88e29646 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] 10.222.0.11 "GET /compute/v2.1/servers/a49437df-3059-4528-8328-2f3471d5fb45/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043216 Nov 17 03:34:01.523617 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 885/1740] 10.222.0.11 () {58 vars in 1301 bytes} [Wed Nov 17 03:34:01 2021] GET /compute/v2.1/servers/a49437df-3059-4528-8328-2f3471d5fb45/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 17 03:34:01.862456 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-62d1a768-f9bc-4671-86d2-d2fd2bee701c tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:34:01.863466 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-62d1a768-f9bc-4671-86d2-d2fd2bee701c tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] [instance: 5ddbfaaa-fabf-4324-941c-8868625ffefc] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:34:01.873734 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-62d1a768-f9bc-4671-86d2-d2fd2bee701c tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:34:01.874178 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-62d1a768-f9bc-4671-86d2-d2fd2bee701c tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:34:01.874954 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-62d1a768-f9bc-4671-86d2-d2fd2bee701c tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:34:01.875385 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-62d1a768-f9bc-4671-86d2-d2fd2bee701c tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:34:01.945621 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-62d1a768-f9bc-4671-86d2-d2fd2bee701c tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80763e09d44c475ea2425b22874e9612', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fef02a1dd77946a2ac0e0414b557435f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:34:01.953776 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-62d1a768-f9bc-4671-86d2-d2fd2bee701c tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] 10.222.0.11 "GET /compute/v2.1/servers/5ddbfaaa-fabf-4324-941c-8868625ffefc" status: 200 len: 1226 microversion: 2.1 time: 0.097527 Nov 17 03:34:01.954358 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 856/1741] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:34:01 2021] GET /compute/v2.1/servers/5ddbfaaa-fabf-4324-941c-8868625ffefc => generated 1226 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:34:02.171502 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-5d683e69-0287-4f1e-9326-feb348509b4b tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:34:02.172614 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-5d683e69-0287-4f1e-9326-feb348509b4b tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] [instance: 5d54db85-b991-4890-abaa-952413baa2e7] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:34:02.181154 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-5d683e69-0287-4f1e-9326-feb348509b4b tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:34:02.181716 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-5d683e69-0287-4f1e-9326-feb348509b4b tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:34:02.182672 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-5d683e69-0287-4f1e-9326-feb348509b4b tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:34:02.183210 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-5d683e69-0287-4f1e-9326-feb348509b4b tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:34:02.216765 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-5d683e69-0287-4f1e-9326-feb348509b4b tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] 10.222.0.11 "GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.051670 Nov 17 03:34:02.217346 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 886/1742] 10.222.0.11 () {60 vars in 1342 bytes} [Wed Nov 17 03:34:02 2021] GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 17 03:34:02.539224 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-6533f205-0731-476c-93bd-3375b9e9e984 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:34:02.540161 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-6533f205-0731-476c-93bd-3375b9e9e984 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] [instance: a49437df-3059-4528-8328-2f3471d5fb45] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:34:02.541057 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-e9d99826-f025-43ab-a4e1-1166d07f7731 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:34:02.541789 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-e9d99826-f025-43ab-a4e1-1166d07f7731 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] [instance: 0698dc5b-5f47-46c4-ace8-f5e891a964a0] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:34:02.547231 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-6533f205-0731-476c-93bd-3375b9e9e984 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:34:02.547656 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-6533f205-0731-476c-93bd-3375b9e9e984 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:34:02.548198 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-e9d99826-f025-43ab-a4e1-1166d07f7731 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:34:02.548441 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-6533f205-0731-476c-93bd-3375b9e9e984 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:34:02.548642 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-e9d99826-f025-43ab-a4e1-1166d07f7731 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:34:02.548904 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-6533f205-0731-476c-93bd-3375b9e9e984 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:34:02.549453 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-e9d99826-f025-43ab-a4e1-1166d07f7731 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:34:02.549879 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-e9d99826-f025-43ab-a4e1-1166d07f7731 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:34:02.578565 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-6533f205-0731-476c-93bd-3375b9e9e984 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] 10.222.0.11 "GET /compute/v2.1/servers/a49437df-3059-4528-8328-2f3471d5fb45/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043684 Nov 17 03:34:02.579136 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 857/1743] 10.222.0.11 () {58 vars in 1301 bytes} [Wed Nov 17 03:34:02 2021] GET /compute/v2.1/servers/a49437df-3059-4528-8328-2f3471d5fb45/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 17 03:34:02.682481 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-e9d99826-f025-43ab-a4e1-1166d07f7731 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '163b2f24a72649ac8084be1cac32fa09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e123e9b86124c93a7fc2db9984e7466', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:34:02.690316 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-e9d99826-f025-43ab-a4e1-1166d07f7731 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] 10.222.0.11 "GET /compute/v2.1/servers/0698dc5b-5f47-46c4-ace8-f5e891a964a0" status: 200 len: 1565 microversion: 2.1 time: 0.153166 Nov 17 03:34:02.690898 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 887/1744] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:34:02 2021] GET /compute/v2.1/servers/0698dc5b-5f47-46c4-ace8-f5e891a964a0 => generated 1565 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:34:02.974406 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-0727743a-03b1-417e-b17c-9f3dfd0ab50f tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:34:02.975269 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-0727743a-03b1-417e-b17c-9f3dfd0ab50f tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] [instance: 5ddbfaaa-fabf-4324-941c-8868625ffefc] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:34:02.984395 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-0727743a-03b1-417e-b17c-9f3dfd0ab50f tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:34:02.984932 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-0727743a-03b1-417e-b17c-9f3dfd0ab50f tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:34:02.985700 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-0727743a-03b1-417e-b17c-9f3dfd0ab50f tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:34:02.986126 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-0727743a-03b1-417e-b17c-9f3dfd0ab50f tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:34:03.050331 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-0727743a-03b1-417e-b17c-9f3dfd0ab50f tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80763e09d44c475ea2425b22874e9612', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fef02a1dd77946a2ac0e0414b557435f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:34:03.058587 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-0727743a-03b1-417e-b17c-9f3dfd0ab50f tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] 10.222.0.11 "GET /compute/v2.1/servers/5ddbfaaa-fabf-4324-941c-8868625ffefc" status: 200 len: 1226 microversion: 2.1 time: 0.090437 Nov 17 03:34:03.059166 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 858/1745] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:34:02 2021] GET /compute/v2.1/servers/5ddbfaaa-fabf-4324-941c-8868625ffefc => generated 1226 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:34:03.233525 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-a8eebe85-7e0a-4fd0-8bb5-410a21b7ab46 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:34:03.234778 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-a8eebe85-7e0a-4fd0-8bb5-410a21b7ab46 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] [instance: 5d54db85-b991-4890-abaa-952413baa2e7] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:34:03.245664 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-a8eebe85-7e0a-4fd0-8bb5-410a21b7ab46 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:34:03.246385 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-a8eebe85-7e0a-4fd0-8bb5-410a21b7ab46 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:34:03.247639 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-a8eebe85-7e0a-4fd0-8bb5-410a21b7ab46 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:34:03.248094 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-a8eebe85-7e0a-4fd0-8bb5-410a21b7ab46 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:34:03.277617 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-a8eebe85-7e0a-4fd0-8bb5-410a21b7ab46 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] 10.222.0.11 "GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.051398 Nov 17 03:34:03.278596 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 888/1746] 10.222.0.11 () {60 vars in 1342 bytes} [Wed Nov 17 03:34:03 2021] GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 17 03:34:03.594820 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-8a0c20db-7168-4fe8-a4ce-f11434e323f6 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:34:03.598937 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-8a0c20db-7168-4fe8-a4ce-f11434e323f6 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] [instance: a49437df-3059-4528-8328-2f3471d5fb45] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:34:03.608162 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-8a0c20db-7168-4fe8-a4ce-f11434e323f6 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:34:03.608615 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-8a0c20db-7168-4fe8-a4ce-f11434e323f6 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:34:03.609415 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-8a0c20db-7168-4fe8-a4ce-f11434e323f6 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:34:03.609847 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-8a0c20db-7168-4fe8-a4ce-f11434e323f6 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:34:03.644680 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-8a0c20db-7168-4fe8-a4ce-f11434e323f6 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] 10.222.0.11 "GET /compute/v2.1/servers/a49437df-3059-4528-8328-2f3471d5fb45/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.056912 Nov 17 03:34:03.645261 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 859/1747] 10.222.0.11 () {58 vars in 1301 bytes} [Wed Nov 17 03:34:03 2021] GET /compute/v2.1/servers/a49437df-3059-4528-8328-2f3471d5fb45/os-volume_attachments => generated 197 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 17 03:34:03.710949 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-8b79e78c-c5de-40a0-b719-7830f3dd3b8d tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:34:03.711973 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-8b79e78c-c5de-40a0-b719-7830f3dd3b8d tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] [instance: 0698dc5b-5f47-46c4-ace8-f5e891a964a0] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:34:03.722666 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-8b79e78c-c5de-40a0-b719-7830f3dd3b8d tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:34:03.723425 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-8b79e78c-c5de-40a0-b719-7830f3dd3b8d tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:34:03.724715 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-8b79e78c-c5de-40a0-b719-7830f3dd3b8d tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:34:03.725503 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-8b79e78c-c5de-40a0-b719-7830f3dd3b8d tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:34:03.873445 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-8b79e78c-c5de-40a0-b719-7830f3dd3b8d tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '163b2f24a72649ac8084be1cac32fa09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e123e9b86124c93a7fc2db9984e7466', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:34:03.881169 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-8b79e78c-c5de-40a0-b719-7830f3dd3b8d tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] 10.222.0.11 "GET /compute/v2.1/servers/0698dc5b-5f47-46c4-ace8-f5e891a964a0" status: 200 len: 1565 microversion: 2.1 time: 0.176257 Nov 17 03:34:03.881732 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 889/1748] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:34:03 2021] GET /compute/v2.1/servers/0698dc5b-5f47-46c4-ace8-f5e891a964a0 => generated 1565 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:34:04.076474 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-f6187aa7-4c4e-4937-aeaa-75467dc43891 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:34:04.077115 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-f6187aa7-4c4e-4937-aeaa-75467dc43891 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] [instance: 5ddbfaaa-fabf-4324-941c-8868625ffefc] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:34:04.084117 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-f6187aa7-4c4e-4937-aeaa-75467dc43891 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:34:04.084563 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-f6187aa7-4c4e-4937-aeaa-75467dc43891 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:34:04.085377 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-f6187aa7-4c4e-4937-aeaa-75467dc43891 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:34:04.085801 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-f6187aa7-4c4e-4937-aeaa-75467dc43891 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:34:04.145766 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-f6187aa7-4c4e-4937-aeaa-75467dc43891 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80763e09d44c475ea2425b22874e9612', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fef02a1dd77946a2ac0e0414b557435f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:34:04.153807 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-f6187aa7-4c4e-4937-aeaa-75467dc43891 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] 10.222.0.11 "GET /compute/v2.1/servers/5ddbfaaa-fabf-4324-941c-8868625ffefc" status: 200 len: 1226 microversion: 2.1 time: 0.081181 Nov 17 03:34:04.154383 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 860/1749] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:34:04 2021] GET /compute/v2.1/servers/5ddbfaaa-fabf-4324-941c-8868625ffefc => generated 1226 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:34:04.293250 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-65ebb695-5315-445a-8f58-faa6deb73705 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:34:04.294362 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-65ebb695-5315-445a-8f58-faa6deb73705 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] [instance: 5d54db85-b991-4890-abaa-952413baa2e7] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:34:04.301081 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-65ebb695-5315-445a-8f58-faa6deb73705 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:34:04.301542 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-65ebb695-5315-445a-8f58-faa6deb73705 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:34:04.302320 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-65ebb695-5315-445a-8f58-faa6deb73705 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:34:04.302752 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-65ebb695-5315-445a-8f58-faa6deb73705 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:34:04.332718 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-65ebb695-5315-445a-8f58-faa6deb73705 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] 10.222.0.11 "GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045814 Nov 17 03:34:04.333311 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 890/1750] 10.222.0.11 () {60 vars in 1342 bytes} [Wed Nov 17 03:34:04 2021] GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 17 03:34:04.660276 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-806ad42f-560c-4fd3-9994-e10541bb9b67 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:34:04.661801 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-806ad42f-560c-4fd3-9994-e10541bb9b67 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] [instance: a49437df-3059-4528-8328-2f3471d5fb45] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:34:04.672192 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-806ad42f-560c-4fd3-9994-e10541bb9b67 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:34:04.673012 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-806ad42f-560c-4fd3-9994-e10541bb9b67 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:34:04.674305 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-806ad42f-560c-4fd3-9994-e10541bb9b67 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:34:04.675033 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-806ad42f-560c-4fd3-9994-e10541bb9b67 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:34:04.708160 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-806ad42f-560c-4fd3-9994-e10541bb9b67 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] 10.222.0.11 "GET /compute/v2.1/servers/a49437df-3059-4528-8328-2f3471d5fb45/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.054467 Nov 17 03:34:04.708708 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 861/1751] 10.222.0.11 () {58 vars in 1301 bytes} [Wed Nov 17 03:34:04 2021] GET /compute/v2.1/servers/a49437df-3059-4528-8328-2f3471d5fb45/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 17 03:34:04.902056 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-bcf329c4-cb90-44ce-8706-e7be88cdf8aa tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:34:04.903061 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-bcf329c4-cb90-44ce-8706-e7be88cdf8aa tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] [instance: 0698dc5b-5f47-46c4-ace8-f5e891a964a0] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:34:04.910585 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-bcf329c4-cb90-44ce-8706-e7be88cdf8aa tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:34:04.910996 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-bcf329c4-cb90-44ce-8706-e7be88cdf8aa tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:34:04.911807 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-bcf329c4-cb90-44ce-8706-e7be88cdf8aa tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:34:04.912265 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-bcf329c4-cb90-44ce-8706-e7be88cdf8aa tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:34:05.054176 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-bcf329c4-cb90-44ce-8706-e7be88cdf8aa tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '163b2f24a72649ac8084be1cac32fa09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e123e9b86124c93a7fc2db9984e7466', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:34:05.062388 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-bcf329c4-cb90-44ce-8706-e7be88cdf8aa tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] 10.222.0.11 "GET /compute/v2.1/servers/0698dc5b-5f47-46c4-ace8-f5e891a964a0" status: 200 len: 1565 microversion: 2.1 time: 0.166506 Nov 17 03:34:05.063101 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 891/1752] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:34:04 2021] GET /compute/v2.1/servers/0698dc5b-5f47-46c4-ace8-f5e891a964a0 => generated 1565 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:34:05.174513 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-f5c3f376-a2bf-441d-9692-f9fc27ff51a0 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:34:05.175170 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-f5c3f376-a2bf-441d-9692-f9fc27ff51a0 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] [instance: 5ddbfaaa-fabf-4324-941c-8868625ffefc] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:34:05.185062 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-f5c3f376-a2bf-441d-9692-f9fc27ff51a0 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:34:05.185657 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-f5c3f376-a2bf-441d-9692-f9fc27ff51a0 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:34:05.187062 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-f5c3f376-a2bf-441d-9692-f9fc27ff51a0 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:34:05.187694 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-f5c3f376-a2bf-441d-9692-f9fc27ff51a0 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:34:05.259023 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-f5c3f376-a2bf-441d-9692-f9fc27ff51a0 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80763e09d44c475ea2425b22874e9612', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fef02a1dd77946a2ac0e0414b557435f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:34:05.268562 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-f5c3f376-a2bf-441d-9692-f9fc27ff51a0 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] 10.222.0.11 "GET /compute/v2.1/servers/5ddbfaaa-fabf-4324-941c-8868625ffefc" status: 200 len: 1226 microversion: 2.1 time: 0.100178 Nov 17 03:34:05.269177 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 862/1753] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:34:05 2021] GET /compute/v2.1/servers/5ddbfaaa-fabf-4324-941c-8868625ffefc => generated 1226 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:34:05.346322 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-205db0ac-50e0-45c5-9243-be04aba77a79 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:34:05.347455 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-205db0ac-50e0-45c5-9243-be04aba77a79 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] [instance: 5d54db85-b991-4890-abaa-952413baa2e7] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:34:05.355551 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-205db0ac-50e0-45c5-9243-be04aba77a79 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:34:05.356070 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-205db0ac-50e0-45c5-9243-be04aba77a79 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:34:05.357117 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-205db0ac-50e0-45c5-9243-be04aba77a79 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:34:05.357609 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-205db0ac-50e0-45c5-9243-be04aba77a79 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:34:05.390423 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-205db0ac-50e0-45c5-9243-be04aba77a79 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] 10.222.0.11 "GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.049400 Nov 17 03:34:05.390980 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 892/1754] 10.222.0.11 () {60 vars in 1342 bytes} [Wed Nov 17 03:34:05 2021] GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 17 03:34:05.723787 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-cb537e3e-1ecb-4e97-b9e8-7ff408690076 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:34:05.725385 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-cb537e3e-1ecb-4e97-b9e8-7ff408690076 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] [instance: a49437df-3059-4528-8328-2f3471d5fb45] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:34:05.734657 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-cb537e3e-1ecb-4e97-b9e8-7ff408690076 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:34:05.735137 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-cb537e3e-1ecb-4e97-b9e8-7ff408690076 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:34:05.735902 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-cb537e3e-1ecb-4e97-b9e8-7ff408690076 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:34:05.736326 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-cb537e3e-1ecb-4e97-b9e8-7ff408690076 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:34:05.766675 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-cb537e3e-1ecb-4e97-b9e8-7ff408690076 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] 10.222.0.11 "GET /compute/v2.1/servers/a49437df-3059-4528-8328-2f3471d5fb45/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049384 Nov 17 03:34:05.767232 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 863/1755] 10.222.0.11 () {58 vars in 1301 bytes} [Wed Nov 17 03:34:05 2021] GET /compute/v2.1/servers/a49437df-3059-4528-8328-2f3471d5fb45/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 17 03:34:06.083878 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-a01ecd03-5025-4540-8ebc-e8bee6e9f820 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:34:06.084510 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-a01ecd03-5025-4540-8ebc-e8bee6e9f820 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] [instance: 0698dc5b-5f47-46c4-ace8-f5e891a964a0] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:34:06.091001 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-a01ecd03-5025-4540-8ebc-e8bee6e9f820 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:34:06.091455 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-a01ecd03-5025-4540-8ebc-e8bee6e9f820 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:34:06.092351 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-a01ecd03-5025-4540-8ebc-e8bee6e9f820 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:34:06.092818 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-a01ecd03-5025-4540-8ebc-e8bee6e9f820 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:34:06.233552 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-a01ecd03-5025-4540-8ebc-e8bee6e9f820 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '163b2f24a72649ac8084be1cac32fa09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e123e9b86124c93a7fc2db9984e7466', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:34:06.245469 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-a01ecd03-5025-4540-8ebc-e8bee6e9f820 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] 10.222.0.11 "GET /compute/v2.1/servers/0698dc5b-5f47-46c4-ace8-f5e891a964a0" status: 200 len: 1565 microversion: 2.1 time: 0.165024 Nov 17 03:34:06.246335 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 893/1756] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:34:06 2021] GET /compute/v2.1/servers/0698dc5b-5f47-46c4-ace8-f5e891a964a0 => generated 1565 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:34:06.293124 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-a0e6bf07-2dd4-46f6-ab69-ffc6da6aa195 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:34:06.293919 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-a0e6bf07-2dd4-46f6-ab69-ffc6da6aa195 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] [instance: 5ddbfaaa-fabf-4324-941c-8868625ffefc] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:34:06.306608 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-a0e6bf07-2dd4-46f6-ab69-ffc6da6aa195 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:34:06.307269 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-a0e6bf07-2dd4-46f6-ab69-ffc6da6aa195 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:34:06.308450 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-a0e6bf07-2dd4-46f6-ab69-ffc6da6aa195 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:34:06.309107 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-a0e6bf07-2dd4-46f6-ab69-ffc6da6aa195 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:34:06.370398 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-a0e6bf07-2dd4-46f6-ab69-ffc6da6aa195 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80763e09d44c475ea2425b22874e9612', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fef02a1dd77946a2ac0e0414b557435f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:34:06.378380 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-a0e6bf07-2dd4-46f6-ab69-ffc6da6aa195 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] 10.222.0.11 "GET /compute/v2.1/servers/5ddbfaaa-fabf-4324-941c-8868625ffefc" status: 200 len: 1226 microversion: 2.1 time: 0.092989 Nov 17 03:34:06.378938 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 864/1757] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:34:06 2021] GET /compute/v2.1/servers/5ddbfaaa-fabf-4324-941c-8868625ffefc => generated 1226 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:34:06.402311 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-41a61475-1a8e-4207-b494-f478e11c4c5c tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:34:06.403231 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-41a61475-1a8e-4207-b494-f478e11c4c5c tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] [instance: 5d54db85-b991-4890-abaa-952413baa2e7] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:34:06.410505 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-41a61475-1a8e-4207-b494-f478e11c4c5c tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:34:06.410962 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-41a61475-1a8e-4207-b494-f478e11c4c5c tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:34:06.411738 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-41a61475-1a8e-4207-b494-f478e11c4c5c tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:34:06.412173 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-41a61475-1a8e-4207-b494-f478e11c4c5c tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:34:06.449085 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-41a61475-1a8e-4207-b494-f478e11c4c5c tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] 10.222.0.11 "GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.050575 Nov 17 03:34:06.449645 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 894/1758] 10.222.0.11 () {60 vars in 1342 bytes} [Wed Nov 17 03:34:06 2021] GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 17 03:34:06.778414 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-d5368f8f-21f6-43aa-9afd-fc44245efb88 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:34:06.779324 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-d5368f8f-21f6-43aa-9afd-fc44245efb88 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] [instance: a49437df-3059-4528-8328-2f3471d5fb45] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:34:06.785838 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-d5368f8f-21f6-43aa-9afd-fc44245efb88 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:34:06.786281 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-d5368f8f-21f6-43aa-9afd-fc44245efb88 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:34:06.787043 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-d5368f8f-21f6-43aa-9afd-fc44245efb88 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:34:06.787452 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-d5368f8f-21f6-43aa-9afd-fc44245efb88 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:34:06.817032 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-d5368f8f-21f6-43aa-9afd-fc44245efb88 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] 10.222.0.11 "GET /compute/v2.1/servers/a49437df-3059-4528-8328-2f3471d5fb45/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042383 Nov 17 03:34:06.817575 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 865/1759] 10.222.0.11 () {58 vars in 1301 bytes} [Wed Nov 17 03:34:06 2021] GET /compute/v2.1/servers/a49437df-3059-4528-8328-2f3471d5fb45/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 17 03:34:07.271526 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-c8cb8679-e1c6-4201-9fa4-f76d9578431e tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:34:07.272530 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-c8cb8679-e1c6-4201-9fa4-f76d9578431e tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] [instance: 0698dc5b-5f47-46c4-ace8-f5e891a964a0] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:34:07.282748 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-c8cb8679-e1c6-4201-9fa4-f76d9578431e tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:34:07.283528 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-c8cb8679-e1c6-4201-9fa4-f76d9578431e tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:34:07.284833 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-c8cb8679-e1c6-4201-9fa4-f76d9578431e tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:34:07.285555 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-c8cb8679-e1c6-4201-9fa4-f76d9578431e tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:34:07.395289 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-d4c4a55d-087f-462f-b71b-d69223c7a5c2 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:34:07.395880 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-d4c4a55d-087f-462f-b71b-d69223c7a5c2 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] [instance: 5ddbfaaa-fabf-4324-941c-8868625ffefc] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:34:07.402498 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-d4c4a55d-087f-462f-b71b-d69223c7a5c2 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:34:07.402953 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-d4c4a55d-087f-462f-b71b-d69223c7a5c2 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:34:07.403729 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-d4c4a55d-087f-462f-b71b-d69223c7a5c2 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:34:07.404170 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-d4c4a55d-087f-462f-b71b-d69223c7a5c2 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:34:07.434831 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-c8cb8679-e1c6-4201-9fa4-f76d9578431e tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '163b2f24a72649ac8084be1cac32fa09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e123e9b86124c93a7fc2db9984e7466', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:34:07.442912 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-c8cb8679-e1c6-4201-9fa4-f76d9578431e tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] 10.222.0.11 "GET /compute/v2.1/servers/0698dc5b-5f47-46c4-ace8-f5e891a964a0" status: 200 len: 1565 microversion: 2.1 time: 0.177453 Nov 17 03:34:07.443471 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 895/1760] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:34:07 2021] GET /compute/v2.1/servers/0698dc5b-5f47-46c4-ace8-f5e891a964a0 => generated 1565 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:34:07.460881 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-ceef863e-7276-44e6-ab01-77f065d171a7 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:34:07.461791 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-ceef863e-7276-44e6-ab01-77f065d171a7 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] [instance: 5d54db85-b991-4890-abaa-952413baa2e7] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:34:07.465627 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-d4c4a55d-087f-462f-b71b-d69223c7a5c2 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80763e09d44c475ea2425b22874e9612', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fef02a1dd77946a2ac0e0414b557435f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:34:07.467953 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-ceef863e-7276-44e6-ab01-77f065d171a7 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:34:07.468398 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-ceef863e-7276-44e6-ab01-77f065d171a7 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:34:07.469194 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-ceef863e-7276-44e6-ab01-77f065d171a7 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:34:07.469618 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-ceef863e-7276-44e6-ab01-77f065d171a7 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:34:07.474032 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-d4c4a55d-087f-462f-b71b-d69223c7a5c2 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] 10.222.0.11 "GET /compute/v2.1/servers/5ddbfaaa-fabf-4324-941c-8868625ffefc" status: 200 len: 1226 microversion: 2.1 time: 0.082436 Nov 17 03:34:07.474565 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 866/1761] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:34:07 2021] GET /compute/v2.1/servers/5ddbfaaa-fabf-4324-941c-8868625ffefc => generated 1226 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:34:07.501699 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-ceef863e-7276-44e6-ab01-77f065d171a7 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] 10.222.0.11 "GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044579 Nov 17 03:34:07.502280 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 896/1762] 10.222.0.11 () {60 vars in 1342 bytes} [Wed Nov 17 03:34:07 2021] GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 17 03:34:07.832520 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-fb1ae2c8-c904-4c89-9b8c-28be43cb724b tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:34:07.834081 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-fb1ae2c8-c904-4c89-9b8c-28be43cb724b tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] [instance: a49437df-3059-4528-8328-2f3471d5fb45] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:34:07.844432 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-fb1ae2c8-c904-4c89-9b8c-28be43cb724b tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:34:07.844965 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-fb1ae2c8-c904-4c89-9b8c-28be43cb724b tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:34:07.845756 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-fb1ae2c8-c904-4c89-9b8c-28be43cb724b tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:34:07.846195 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-fb1ae2c8-c904-4c89-9b8c-28be43cb724b tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:34:07.875207 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-fb1ae2c8-c904-4c89-9b8c-28be43cb724b tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] 10.222.0.11 "GET /compute/v2.1/servers/a49437df-3059-4528-8328-2f3471d5fb45/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049315 Nov 17 03:34:07.875768 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 867/1763] 10.222.0.11 () {58 vars in 1301 bytes} [Wed Nov 17 03:34:07 2021] GET /compute/v2.1/servers/a49437df-3059-4528-8328-2f3471d5fb45/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 17 03:34:08.465172 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-850e0fe6-90d2-44f9-93da-45442148c132 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:34:08.466073 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-850e0fe6-90d2-44f9-93da-45442148c132 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] [instance: 0698dc5b-5f47-46c4-ace8-f5e891a964a0] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:34:08.474058 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-850e0fe6-90d2-44f9-93da-45442148c132 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:34:08.474513 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-850e0fe6-90d2-44f9-93da-45442148c132 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:34:08.475286 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-850e0fe6-90d2-44f9-93da-45442148c132 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:34:08.475718 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-850e0fe6-90d2-44f9-93da-45442148c132 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:34:08.490686 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-d425229e-b2a2-47f9-8c34-f29394827fc1 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:34:08.491397 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-d425229e-b2a2-47f9-8c34-f29394827fc1 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] [instance: 5ddbfaaa-fabf-4324-941c-8868625ffefc] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:34:08.498025 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-d425229e-b2a2-47f9-8c34-f29394827fc1 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:34:08.498468 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-d425229e-b2a2-47f9-8c34-f29394827fc1 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:34:08.499328 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-d425229e-b2a2-47f9-8c34-f29394827fc1 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:34:08.499758 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-d425229e-b2a2-47f9-8c34-f29394827fc1 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:34:08.560268 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-d425229e-b2a2-47f9-8c34-f29394827fc1 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80763e09d44c475ea2425b22874e9612', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fef02a1dd77946a2ac0e0414b557435f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:34:08.567963 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-d425229e-b2a2-47f9-8c34-f29394827fc1 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] 10.222.0.11 "GET /compute/v2.1/servers/5ddbfaaa-fabf-4324-941c-8868625ffefc" status: 200 len: 1226 microversion: 2.1 time: 0.080955 Nov 17 03:34:08.568529 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 868/1764] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:34:08 2021] GET /compute/v2.1/servers/5ddbfaaa-fabf-4324-941c-8868625ffefc => generated 1226 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:34:08.573037 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-cd0d1ec7-122b-413e-8dde-8ed276bd7c85 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:34:08.573928 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-cd0d1ec7-122b-413e-8dde-8ed276bd7c85 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] [instance: 5d54db85-b991-4890-abaa-952413baa2e7] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:34:08.580929 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-cd0d1ec7-122b-413e-8dde-8ed276bd7c85 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:34:08.581630 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-cd0d1ec7-122b-413e-8dde-8ed276bd7c85 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:34:08.583470 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-cd0d1ec7-122b-413e-8dde-8ed276bd7c85 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:34:08.583470 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-cd0d1ec7-122b-413e-8dde-8ed276bd7c85 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:34:08.613260 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-850e0fe6-90d2-44f9-93da-45442148c132 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '163b2f24a72649ac8084be1cac32fa09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e123e9b86124c93a7fc2db9984e7466', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:34:08.618413 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-cd0d1ec7-122b-413e-8dde-8ed276bd7c85 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] 10.222.0.11 "GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.048531 Nov 17 03:34:08.619155 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 869/1765] 10.222.0.11 () {60 vars in 1342 bytes} [Wed Nov 17 03:34:08 2021] GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 17 03:34:08.623843 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-850e0fe6-90d2-44f9-93da-45442148c132 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] 10.222.0.11 "GET /compute/v2.1/servers/0698dc5b-5f47-46c4-ace8-f5e891a964a0" status: 200 len: 1565 microversion: 2.1 time: 0.164763 Nov 17 03:34:08.624522 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 897/1766] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:34:08 2021] GET /compute/v2.1/servers/0698dc5b-5f47-46c4-ace8-f5e891a964a0 => generated 1565 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:34:08.888365 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-039bd5bd-1f81-465d-8216-f8bd0936b4fe tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:34:08.889674 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-039bd5bd-1f81-465d-8216-f8bd0936b4fe tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] [instance: a49437df-3059-4528-8328-2f3471d5fb45] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:34:08.897394 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-039bd5bd-1f81-465d-8216-f8bd0936b4fe tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:34:08.897998 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-039bd5bd-1f81-465d-8216-f8bd0936b4fe tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:34:08.899020 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-039bd5bd-1f81-465d-8216-f8bd0936b4fe tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:34:08.899628 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-039bd5bd-1f81-465d-8216-f8bd0936b4fe tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:34:08.933809 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-039bd5bd-1f81-465d-8216-f8bd0936b4fe tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] 10.222.0.11 "GET /compute/v2.1/servers/a49437df-3059-4528-8328-2f3471d5fb45/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050177 Nov 17 03:34:08.934458 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 870/1767] 10.222.0.11 () {58 vars in 1301 bytes} [Wed Nov 17 03:34:08 2021] GET /compute/v2.1/servers/a49437df-3059-4528-8328-2f3471d5fb45/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 17 03:34:09.588635 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-086af2a3-e177-48ab-af88-fe1e92ffce34 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:34:09.589616 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-086af2a3-e177-48ab-af88-fe1e92ffce34 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] [instance: 5ddbfaaa-fabf-4324-941c-8868625ffefc] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:34:09.600337 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-086af2a3-e177-48ab-af88-fe1e92ffce34 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:34:09.601145 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-086af2a3-e177-48ab-af88-fe1e92ffce34 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:34:09.602402 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-086af2a3-e177-48ab-af88-fe1e92ffce34 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:34:09.603153 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-086af2a3-e177-48ab-af88-fe1e92ffce34 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:34:09.631677 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-5cb2e4ef-f7d2-4fab-a7b0-8d193d8ff15b tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:34:09.632580 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-5cb2e4ef-f7d2-4fab-a7b0-8d193d8ff15b tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] [instance: 5d54db85-b991-4890-abaa-952413baa2e7] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:34:09.639221 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-5cb2e4ef-f7d2-4fab-a7b0-8d193d8ff15b tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:34:09.639663 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-5cb2e4ef-f7d2-4fab-a7b0-8d193d8ff15b tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:34:09.640561 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-5cb2e4ef-f7d2-4fab-a7b0-8d193d8ff15b tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:34:09.641197 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-5cb2e4ef-f7d2-4fab-a7b0-8d193d8ff15b tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:34:09.668616 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-086af2a3-e177-48ab-af88-fe1e92ffce34 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80763e09d44c475ea2425b22874e9612', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fef02a1dd77946a2ac0e0414b557435f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:34:09.671215 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-5cb2e4ef-f7d2-4fab-a7b0-8d193d8ff15b tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] 10.222.0.11 "GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043399 Nov 17 03:34:09.671817 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 871/1768] 10.222.0.11 () {60 vars in 1342 bytes} [Wed Nov 17 03:34:09 2021] GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 17 03:34:09.676450 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-d7106465-38cf-4814-b95f-73bd8d6a07b2 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:34:09.676608 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-086af2a3-e177-48ab-af88-fe1e92ffce34 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] 10.222.0.11 "GET /compute/v2.1/servers/5ddbfaaa-fabf-4324-941c-8868625ffefc" status: 200 len: 1226 microversion: 2.1 time: 0.094182 Nov 17 03:34:09.677104 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-d7106465-38cf-4814-b95f-73bd8d6a07b2 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] [instance: 0698dc5b-5f47-46c4-ace8-f5e891a964a0] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:34:09.677437 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 898/1769] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:34:09 2021] GET /compute/v2.1/servers/5ddbfaaa-fabf-4324-941c-8868625ffefc => generated 1226 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:34:09.683570 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-d7106465-38cf-4814-b95f-73bd8d6a07b2 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:34:09.684024 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-d7106465-38cf-4814-b95f-73bd8d6a07b2 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:34:09.684825 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-d7106465-38cf-4814-b95f-73bd8d6a07b2 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:34:09.685549 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-d7106465-38cf-4814-b95f-73bd8d6a07b2 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:34:09.827101 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-d7106465-38cf-4814-b95f-73bd8d6a07b2 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '163b2f24a72649ac8084be1cac32fa09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e123e9b86124c93a7fc2db9984e7466', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:34:09.838433 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-d7106465-38cf-4814-b95f-73bd8d6a07b2 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] 10.222.0.11 "GET /compute/v2.1/servers/0698dc5b-5f47-46c4-ace8-f5e891a964a0" status: 200 len: 1565 microversion: 2.1 time: 0.164982 Nov 17 03:34:09.839186 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 872/1770] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:34:09 2021] GET /compute/v2.1/servers/0698dc5b-5f47-46c4-ace8-f5e891a964a0 => generated 1565 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:34:09.949812 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-1b12c326-3cb5-433f-a4d8-650b9675f913 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:34:09.951286 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-1b12c326-3cb5-433f-a4d8-650b9675f913 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] [instance: a49437df-3059-4528-8328-2f3471d5fb45] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:34:09.961797 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-1b12c326-3cb5-433f-a4d8-650b9675f913 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:34:09.962553 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-1b12c326-3cb5-433f-a4d8-650b9675f913 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:34:09.963831 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-1b12c326-3cb5-433f-a4d8-650b9675f913 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:34:09.964554 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-1b12c326-3cb5-433f-a4d8-650b9675f913 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:34:09.994659 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-1b12c326-3cb5-433f-a4d8-650b9675f913 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] 10.222.0.11 "GET /compute/v2.1/servers/a49437df-3059-4528-8328-2f3471d5fb45/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051280 Nov 17 03:34:09.995203 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 899/1771] 10.222.0.11 () {58 vars in 1301 bytes} [Wed Nov 17 03:34:09 2021] GET /compute/v2.1/servers/a49437df-3059-4528-8328-2f3471d5fb45/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 17 03:34:10.686743 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-65f45d72-70aa-4fcf-85aa-e5294bfbfe3d tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:34:10.688043 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-65f45d72-70aa-4fcf-85aa-e5294bfbfe3d tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] [instance: 5d54db85-b991-4890-abaa-952413baa2e7] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:34:10.693289 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-05c359b1-21ab-4eef-9d12-fe85dfdc72ac tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:34:10.693955 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-05c359b1-21ab-4eef-9d12-fe85dfdc72ac tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] [instance: 5ddbfaaa-fabf-4324-941c-8868625ffefc] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:34:10.694557 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-65f45d72-70aa-4fcf-85aa-e5294bfbfe3d tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:34:10.695004 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-65f45d72-70aa-4fcf-85aa-e5294bfbfe3d tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:34:10.695771 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-65f45d72-70aa-4fcf-85aa-e5294bfbfe3d tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:34:10.696182 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-65f45d72-70aa-4fcf-85aa-e5294bfbfe3d tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:34:10.699800 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-05c359b1-21ab-4eef-9d12-fe85dfdc72ac tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:34:10.700259 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-05c359b1-21ab-4eef-9d12-fe85dfdc72ac tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:34:10.701064 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-05c359b1-21ab-4eef-9d12-fe85dfdc72ac tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:34:10.702407 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-05c359b1-21ab-4eef-9d12-fe85dfdc72ac tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:34:10.726217 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-65f45d72-70aa-4fcf-85aa-e5294bfbfe3d tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] 10.222.0.11 "GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046184 Nov 17 03:34:10.726786 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 873/1772] 10.222.0.11 () {60 vars in 1342 bytes} [Wed Nov 17 03:34:10 2021] GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 17 03:34:10.763009 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-05c359b1-21ab-4eef-9d12-fe85dfdc72ac tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80763e09d44c475ea2425b22874e9612', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fef02a1dd77946a2ac0e0414b557435f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:34:10.770884 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-05c359b1-21ab-4eef-9d12-fe85dfdc72ac tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] 10.222.0.11 "GET /compute/v2.1/servers/5ddbfaaa-fabf-4324-941c-8868625ffefc" status: 200 len: 1226 microversion: 2.1 time: 0.081419 Nov 17 03:34:10.771468 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 900/1773] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:34:10 2021] GET /compute/v2.1/servers/5ddbfaaa-fabf-4324-941c-8868625ffefc => generated 1226 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:34:10.861434 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-8298f198-de04-4e5d-847b-3d0d3256cc98 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:34:10.862449 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-8298f198-de04-4e5d-847b-3d0d3256cc98 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] [instance: 0698dc5b-5f47-46c4-ace8-f5e891a964a0] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:34:10.872451 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-8298f198-de04-4e5d-847b-3d0d3256cc98 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:34:10.873242 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-8298f198-de04-4e5d-847b-3d0d3256cc98 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:34:10.874547 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-8298f198-de04-4e5d-847b-3d0d3256cc98 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:34:10.874990 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-8298f198-de04-4e5d-847b-3d0d3256cc98 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:34:11.007864 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-928dd322-daef-4baf-b10b-7b2a5890ec5c tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:34:11.008808 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-928dd322-daef-4baf-b10b-7b2a5890ec5c tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] [instance: a49437df-3059-4528-8328-2f3471d5fb45] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:34:11.015229 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-928dd322-daef-4baf-b10b-7b2a5890ec5c tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:34:11.015735 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-928dd322-daef-4baf-b10b-7b2a5890ec5c tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:34:11.016921 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-8298f198-de04-4e5d-847b-3d0d3256cc98 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '163b2f24a72649ac8084be1cac32fa09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e123e9b86124c93a7fc2db9984e7466', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:34:11.017099 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-928dd322-daef-4baf-b10b-7b2a5890ec5c tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:34:11.017465 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-928dd322-daef-4baf-b10b-7b2a5890ec5c tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:34:11.026597 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-8298f198-de04-4e5d-847b-3d0d3256cc98 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] 10.222.0.11 "GET /compute/v2.1/servers/0698dc5b-5f47-46c4-ace8-f5e891a964a0" status: 200 len: 1565 microversion: 2.1 time: 0.171059 Nov 17 03:34:11.027416 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 874/1774] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:34:10 2021] GET /compute/v2.1/servers/0698dc5b-5f47-46c4-ace8-f5e891a964a0 => generated 1565 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:34:11.052873 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-928dd322-daef-4baf-b10b-7b2a5890ec5c tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] 10.222.0.11 "GET /compute/v2.1/servers/a49437df-3059-4528-8328-2f3471d5fb45/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048870 Nov 17 03:34:11.053427 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 901/1775] 10.222.0.11 () {58 vars in 1301 bytes} [Wed Nov 17 03:34:11 2021] GET /compute/v2.1/servers/a49437df-3059-4528-8328-2f3471d5fb45/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 17 03:34:11.739835 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-cc9eb23e-83e8-4531-9dde-cd60f0b1b17f tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:34:11.740834 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-cc9eb23e-83e8-4531-9dde-cd60f0b1b17f tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] [instance: 5d54db85-b991-4890-abaa-952413baa2e7] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:34:11.747520 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-cc9eb23e-83e8-4531-9dde-cd60f0b1b17f tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:34:11.747977 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-cc9eb23e-83e8-4531-9dde-cd60f0b1b17f tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:34:11.748753 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-cc9eb23e-83e8-4531-9dde-cd60f0b1b17f tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:34:11.749222 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-cc9eb23e-83e8-4531-9dde-cd60f0b1b17f tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:34:11.778872 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-cc9eb23e-83e8-4531-9dde-cd60f0b1b17f tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] 10.222.0.11 "GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043150 Nov 17 03:34:11.779444 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 875/1776] 10.222.0.11 () {60 vars in 1342 bytes} [Wed Nov 17 03:34:11 2021] GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 17 03:34:11.787472 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-6fde7f76-c57b-4c0c-bfb7-f3e8caf318b5 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:34:11.788086 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-6fde7f76-c57b-4c0c-bfb7-f3e8caf318b5 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] [instance: 5ddbfaaa-fabf-4324-941c-8868625ffefc] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:34:11.794749 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-6fde7f76-c57b-4c0c-bfb7-f3e8caf318b5 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:34:11.795190 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-6fde7f76-c57b-4c0c-bfb7-f3e8caf318b5 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:34:11.795964 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-6fde7f76-c57b-4c0c-bfb7-f3e8caf318b5 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:34:11.796479 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-6fde7f76-c57b-4c0c-bfb7-f3e8caf318b5 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:34:11.855349 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-6fde7f76-c57b-4c0c-bfb7-f3e8caf318b5 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80763e09d44c475ea2425b22874e9612', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fef02a1dd77946a2ac0e0414b557435f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:34:11.863208 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-6fde7f76-c57b-4c0c-bfb7-f3e8caf318b5 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] 10.222.0.11 "GET /compute/v2.1/servers/5ddbfaaa-fabf-4324-941c-8868625ffefc" status: 200 len: 1226 microversion: 2.1 time: 0.079478 Nov 17 03:34:11.863760 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 902/1777] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:34:11 2021] GET /compute/v2.1/servers/5ddbfaaa-fabf-4324-941c-8868625ffefc => generated 1226 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:34:12.044547 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-83669702-2174-4408-abf8-38a99f0fbc4b tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:34:12.045278 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-83669702-2174-4408-abf8-38a99f0fbc4b tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] [instance: 0698dc5b-5f47-46c4-ace8-f5e891a964a0] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:34:12.052050 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-83669702-2174-4408-abf8-38a99f0fbc4b tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:34:12.052575 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-83669702-2174-4408-abf8-38a99f0fbc4b tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:34:12.053525 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-83669702-2174-4408-abf8-38a99f0fbc4b tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:34:12.053952 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-83669702-2174-4408-abf8-38a99f0fbc4b tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:34:12.065083 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-7a18fe2d-bdac-46f9-ac5a-afe96eef5bcb tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:34:12.071074 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-7a18fe2d-bdac-46f9-ac5a-afe96eef5bcb tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] [instance: a49437df-3059-4528-8328-2f3471d5fb45] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:34:12.077822 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-7a18fe2d-bdac-46f9-ac5a-afe96eef5bcb tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:34:12.078053 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-7a18fe2d-bdac-46f9-ac5a-afe96eef5bcb tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:34:12.078760 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-7a18fe2d-bdac-46f9-ac5a-afe96eef5bcb tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:34:12.079191 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-7a18fe2d-bdac-46f9-ac5a-afe96eef5bcb tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:34:12.112806 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-7a18fe2d-bdac-46f9-ac5a-afe96eef5bcb tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] 10.222.0.11 "GET /compute/v2.1/servers/a49437df-3059-4528-8328-2f3471d5fb45/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051498 Nov 17 03:34:12.113798 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 903/1778] 10.222.0.11 () {58 vars in 1301 bytes} [Wed Nov 17 03:34:12 2021] GET /compute/v2.1/servers/a49437df-3059-4528-8328-2f3471d5fb45/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 17 03:34:12.190945 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-83669702-2174-4408-abf8-38a99f0fbc4b tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '163b2f24a72649ac8084be1cac32fa09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e123e9b86124c93a7fc2db9984e7466', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:34:12.198545 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-83669702-2174-4408-abf8-38a99f0fbc4b tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] 10.222.0.11 "GET /compute/v2.1/servers/0698dc5b-5f47-46c4-ace8-f5e891a964a0" status: 200 len: 1565 microversion: 2.1 time: 0.157737 Nov 17 03:34:12.199109 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 876/1779] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:34:12 2021] GET /compute/v2.1/servers/0698dc5b-5f47-46c4-ace8-f5e891a964a0 => generated 1565 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:34:12.792074 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-834262ce-cdcf-41ad-9911-5e9c692e328a tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:34:12.793547 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-834262ce-cdcf-41ad-9911-5e9c692e328a tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] [instance: 5d54db85-b991-4890-abaa-952413baa2e7] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:34:12.800614 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-834262ce-cdcf-41ad-9911-5e9c692e328a tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:34:12.801240 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-834262ce-cdcf-41ad-9911-5e9c692e328a tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:34:12.802020 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-834262ce-cdcf-41ad-9911-5e9c692e328a tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:34:12.802445 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-834262ce-cdcf-41ad-9911-5e9c692e328a tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:34:12.832845 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-834262ce-cdcf-41ad-9911-5e9c692e328a tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] 10.222.0.11 "GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044977 Nov 17 03:34:12.833694 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 904/1780] 10.222.0.11 () {60 vars in 1342 bytes} [Wed Nov 17 03:34:12 2021] GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 17 03:34:12.879563 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-72912bb8-8e2c-4e74-a6a7-de7f26614d94 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:34:12.880244 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-72912bb8-8e2c-4e74-a6a7-de7f26614d94 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] [instance: 5ddbfaaa-fabf-4324-941c-8868625ffefc] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:34:12.886818 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-72912bb8-8e2c-4e74-a6a7-de7f26614d94 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:34:12.887330 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-72912bb8-8e2c-4e74-a6a7-de7f26614d94 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:34:12.888091 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-72912bb8-8e2c-4e74-a6a7-de7f26614d94 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:34:12.888516 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-72912bb8-8e2c-4e74-a6a7-de7f26614d94 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:34:12.949339 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-72912bb8-8e2c-4e74-a6a7-de7f26614d94 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80763e09d44c475ea2425b22874e9612', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fef02a1dd77946a2ac0e0414b557435f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:34:12.960759 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-72912bb8-8e2c-4e74-a6a7-de7f26614d94 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] 10.222.0.11 "GET /compute/v2.1/servers/5ddbfaaa-fabf-4324-941c-8868625ffefc" status: 200 len: 1226 microversion: 2.1 time: 0.084575 Nov 17 03:34:12.961589 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 877/1781] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:34:12 2021] GET /compute/v2.1/servers/5ddbfaaa-fabf-4324-941c-8868625ffefc => generated 1226 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:34:13.127217 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-eb608c17-a686-4b78-8d23-42760cccb680 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:34:13.128237 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-eb608c17-a686-4b78-8d23-42760cccb680 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] [instance: a49437df-3059-4528-8328-2f3471d5fb45] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:34:13.135017 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-eb608c17-a686-4b78-8d23-42760cccb680 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:34:13.135504 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-eb608c17-a686-4b78-8d23-42760cccb680 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:34:13.136350 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-eb608c17-a686-4b78-8d23-42760cccb680 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:34:13.137090 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-eb608c17-a686-4b78-8d23-42760cccb680 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:34:13.172688 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-eb608c17-a686-4b78-8d23-42760cccb680 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] 10.222.0.11 "GET /compute/v2.1/servers/a49437df-3059-4528-8328-2f3471d5fb45/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051406 Nov 17 03:34:13.173272 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 905/1782] 10.222.0.11 () {58 vars in 1301 bytes} [Wed Nov 17 03:34:13 2021] GET /compute/v2.1/servers/a49437df-3059-4528-8328-2f3471d5fb45/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 17 03:34:13.215492 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-b9fdce60-275e-4a3b-935d-5802a074e84b tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:34:13.216090 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-b9fdce60-275e-4a3b-935d-5802a074e84b tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] [instance: 0698dc5b-5f47-46c4-ace8-f5e891a964a0] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:34:13.222634 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-b9fdce60-275e-4a3b-935d-5802a074e84b tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:34:13.223080 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-b9fdce60-275e-4a3b-935d-5802a074e84b tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:34:13.223846 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-b9fdce60-275e-4a3b-935d-5802a074e84b tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:34:13.224274 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-b9fdce60-275e-4a3b-935d-5802a074e84b tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:34:13.363376 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-b9fdce60-275e-4a3b-935d-5802a074e84b tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '163b2f24a72649ac8084be1cac32fa09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e123e9b86124c93a7fc2db9984e7466', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:34:13.371009 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-b9fdce60-275e-4a3b-935d-5802a074e84b tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] 10.222.0.11 "GET /compute/v2.1/servers/0698dc5b-5f47-46c4-ace8-f5e891a964a0" status: 200 len: 1565 microversion: 2.1 time: 0.159365 Nov 17 03:34:13.371549 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 878/1783] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:34:13 2021] GET /compute/v2.1/servers/0698dc5b-5f47-46c4-ace8-f5e891a964a0 => generated 1565 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:34:13.847595 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-d6031b38-5cec-4330-aee9-0d66704703b2 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:34:13.848657 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-d6031b38-5cec-4330-aee9-0d66704703b2 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] [instance: 5d54db85-b991-4890-abaa-952413baa2e7] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:34:13.856515 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-d6031b38-5cec-4330-aee9-0d66704703b2 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:34:13.857248 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-d6031b38-5cec-4330-aee9-0d66704703b2 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:34:13.858153 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-d6031b38-5cec-4330-aee9-0d66704703b2 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:34:13.858794 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-d6031b38-5cec-4330-aee9-0d66704703b2 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:34:13.890742 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-d6031b38-5cec-4330-aee9-0d66704703b2 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] 10.222.0.11 "GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.048051 Nov 17 03:34:13.891295 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 906/1784] 10.222.0.11 () {60 vars in 1342 bytes} [Wed Nov 17 03:34:13 2021] GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 17 03:34:13.985877 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-46d675ce-1679-403d-8e5d-3d1db874aa1f tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:34:13.986642 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-46d675ce-1679-403d-8e5d-3d1db874aa1f tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] [instance: 5ddbfaaa-fabf-4324-941c-8868625ffefc] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:34:13.994748 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-46d675ce-1679-403d-8e5d-3d1db874aa1f tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:34:13.995308 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-46d675ce-1679-403d-8e5d-3d1db874aa1f tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:34:13.996335 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-46d675ce-1679-403d-8e5d-3d1db874aa1f tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:34:13.996906 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-46d675ce-1679-403d-8e5d-3d1db874aa1f tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:34:14.065642 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-46d675ce-1679-403d-8e5d-3d1db874aa1f tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80763e09d44c475ea2425b22874e9612', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fef02a1dd77946a2ac0e0414b557435f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:34:14.073224 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-46d675ce-1679-403d-8e5d-3d1db874aa1f tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] 10.222.0.11 "GET /compute/v2.1/servers/5ddbfaaa-fabf-4324-941c-8868625ffefc" status: 200 len: 1226 microversion: 2.1 time: 0.093245 Nov 17 03:34:14.073780 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 879/1785] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:34:13 2021] GET /compute/v2.1/servers/5ddbfaaa-fabf-4324-941c-8868625ffefc => generated 1226 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:34:14.187999 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-79620c8e-fa52-4508-b5de-ddea7360cb07 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:34:14.189521 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-79620c8e-fa52-4508-b5de-ddea7360cb07 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] [instance: a49437df-3059-4528-8328-2f3471d5fb45] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:34:14.199727 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-79620c8e-fa52-4508-b5de-ddea7360cb07 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:34:14.200473 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-79620c8e-fa52-4508-b5de-ddea7360cb07 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:34:14.201790 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-79620c8e-fa52-4508-b5de-ddea7360cb07 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:34:14.202541 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-79620c8e-fa52-4508-b5de-ddea7360cb07 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:34:14.231289 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-79620c8e-fa52-4508-b5de-ddea7360cb07 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] 10.222.0.11 "GET /compute/v2.1/servers/a49437df-3059-4528-8328-2f3471d5fb45/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049582 Nov 17 03:34:14.231827 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 907/1786] 10.222.0.11 () {58 vars in 1301 bytes} [Wed Nov 17 03:34:14 2021] GET /compute/v2.1/servers/a49437df-3059-4528-8328-2f3471d5fb45/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 17 03:34:14.388391 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-01049110-69bc-449b-9124-ed720e48a2e1 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:34:14.388935 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-01049110-69bc-449b-9124-ed720e48a2e1 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] [instance: 0698dc5b-5f47-46c4-ace8-f5e891a964a0] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:34:14.395678 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-01049110-69bc-449b-9124-ed720e48a2e1 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:34:14.396128 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-01049110-69bc-449b-9124-ed720e48a2e1 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:34:14.396936 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-01049110-69bc-449b-9124-ed720e48a2e1 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:34:14.397369 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-01049110-69bc-449b-9124-ed720e48a2e1 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:34:14.548960 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-01049110-69bc-449b-9124-ed720e48a2e1 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '163b2f24a72649ac8084be1cac32fa09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e123e9b86124c93a7fc2db9984e7466', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:34:14.560270 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-01049110-69bc-449b-9124-ed720e48a2e1 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] 10.222.0.11 "GET /compute/v2.1/servers/0698dc5b-5f47-46c4-ace8-f5e891a964a0" status: 200 len: 1565 microversion: 2.1 time: 0.175340 Nov 17 03:34:14.561161 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 880/1787] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:34:14 2021] GET /compute/v2.1/servers/0698dc5b-5f47-46c4-ace8-f5e891a964a0 => generated 1565 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:34:14.906656 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-a1d2a627-a753-4ef0-a361-5c0965510dbf tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:34:14.908086 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-a1d2a627-a753-4ef0-a361-5c0965510dbf tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] [instance: 5d54db85-b991-4890-abaa-952413baa2e7] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:34:14.918917 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-a1d2a627-a753-4ef0-a361-5c0965510dbf tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:34:14.919681 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-a1d2a627-a753-4ef0-a361-5c0965510dbf tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:34:14.921197 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-a1d2a627-a753-4ef0-a361-5c0965510dbf tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:34:14.921649 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-a1d2a627-a753-4ef0-a361-5c0965510dbf tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:34:14.951015 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-a1d2a627-a753-4ef0-a361-5c0965510dbf tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] 10.222.0.11 "GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.051082 Nov 17 03:34:14.951568 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 908/1788] 10.222.0.11 () {60 vars in 1342 bytes} [Wed Nov 17 03:34:14 2021] GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 17 03:34:15.093180 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-a47768d8-7c04-46e0-a178-76cebe0fded8 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:34:15.093899 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-a47768d8-7c04-46e0-a178-76cebe0fded8 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] [instance: 5ddbfaaa-fabf-4324-941c-8868625ffefc] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:34:15.100730 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-a47768d8-7c04-46e0-a178-76cebe0fded8 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:34:15.101181 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-a47768d8-7c04-46e0-a178-76cebe0fded8 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:34:15.101939 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-a47768d8-7c04-46e0-a178-76cebe0fded8 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:34:15.102367 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-a47768d8-7c04-46e0-a178-76cebe0fded8 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:34:15.163330 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-a47768d8-7c04-46e0-a178-76cebe0fded8 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80763e09d44c475ea2425b22874e9612', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fef02a1dd77946a2ac0e0414b557435f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:34:15.174544 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-a47768d8-7c04-46e0-a178-76cebe0fded8 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] 10.222.0.11 "GET /compute/v2.1/servers/5ddbfaaa-fabf-4324-941c-8868625ffefc" status: 200 len: 1226 microversion: 2.1 time: 0.087149 Nov 17 03:34:15.175452 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 881/1789] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:34:15 2021] GET /compute/v2.1/servers/5ddbfaaa-fabf-4324-941c-8868625ffefc => generated 1226 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:34:15.245150 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-764b4a11-41ba-4642-b57f-c2aedcd358fb tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:34:15.246417 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-764b4a11-41ba-4642-b57f-c2aedcd358fb tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] [instance: a49437df-3059-4528-8328-2f3471d5fb45] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:34:15.253900 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-764b4a11-41ba-4642-b57f-c2aedcd358fb tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:34:15.254345 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-764b4a11-41ba-4642-b57f-c2aedcd358fb tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:34:15.255114 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-764b4a11-41ba-4642-b57f-c2aedcd358fb tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:34:15.255551 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-764b4a11-41ba-4642-b57f-c2aedcd358fb tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:34:15.287720 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-764b4a11-41ba-4642-b57f-c2aedcd358fb tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] 10.222.0.11 "GET /compute/v2.1/servers/a49437df-3059-4528-8328-2f3471d5fb45/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048093 Nov 17 03:34:15.288271 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 909/1790] 10.222.0.11 () {58 vars in 1301 bytes} [Wed Nov 17 03:34:15 2021] GET /compute/v2.1/servers/a49437df-3059-4528-8328-2f3471d5fb45/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 17 03:34:15.580242 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-508d9ae6-0f85-405e-a839-da1a29914178 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:34:15.581026 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-508d9ae6-0f85-405e-a839-da1a29914178 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] [instance: 0698dc5b-5f47-46c4-ace8-f5e891a964a0] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:34:15.588032 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-508d9ae6-0f85-405e-a839-da1a29914178 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:34:15.588520 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-508d9ae6-0f85-405e-a839-da1a29914178 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:34:15.589405 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-508d9ae6-0f85-405e-a839-da1a29914178 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:34:15.589879 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-508d9ae6-0f85-405e-a839-da1a29914178 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:34:15.734902 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-508d9ae6-0f85-405e-a839-da1a29914178 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '163b2f24a72649ac8084be1cac32fa09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e123e9b86124c93a7fc2db9984e7466', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:34:15.742744 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-508d9ae6-0f85-405e-a839-da1a29914178 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] 10.222.0.11 "GET /compute/v2.1/servers/0698dc5b-5f47-46c4-ace8-f5e891a964a0" status: 200 len: 1565 microversion: 2.1 time: 0.167533 Nov 17 03:34:15.743307 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 882/1791] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:34:15 2021] GET /compute/v2.1/servers/0698dc5b-5f47-46c4-ace8-f5e891a964a0 => generated 1565 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:34:15.969817 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-593864d1-93e8-459c-82ff-0df0632db7c4 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:34:15.971183 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-593864d1-93e8-459c-82ff-0df0632db7c4 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] [instance: 5d54db85-b991-4890-abaa-952413baa2e7] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:34:15.982023 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-593864d1-93e8-459c-82ff-0df0632db7c4 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:34:15.982774 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-593864d1-93e8-459c-82ff-0df0632db7c4 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:34:15.984431 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-593864d1-93e8-459c-82ff-0df0632db7c4 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:34:15.984906 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-593864d1-93e8-459c-82ff-0df0632db7c4 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:34:16.013869 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-593864d1-93e8-459c-82ff-0df0632db7c4 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] 10.222.0.11 "GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.051736 Nov 17 03:34:16.014415 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 910/1792] 10.222.0.11 () {60 vars in 1342 bytes} [Wed Nov 17 03:34:15 2021] GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 17 03:34:16.196937 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-13c20884-23a1-4916-9671-8cd21ce8a0d3 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:34:16.197573 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-13c20884-23a1-4916-9671-8cd21ce8a0d3 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] [instance: 5ddbfaaa-fabf-4324-941c-8868625ffefc] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:34:16.203933 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-13c20884-23a1-4916-9671-8cd21ce8a0d3 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:34:16.204378 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-13c20884-23a1-4916-9671-8cd21ce8a0d3 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:34:16.205178 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-13c20884-23a1-4916-9671-8cd21ce8a0d3 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:34:16.205606 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-13c20884-23a1-4916-9671-8cd21ce8a0d3 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:34:16.271982 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-13c20884-23a1-4916-9671-8cd21ce8a0d3 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80763e09d44c475ea2425b22874e9612', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fef02a1dd77946a2ac0e0414b557435f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:34:16.279706 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-13c20884-23a1-4916-9671-8cd21ce8a0d3 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] 10.222.0.11 "GET /compute/v2.1/servers/5ddbfaaa-fabf-4324-941c-8868625ffefc" status: 200 len: 1226 microversion: 2.1 time: 0.086573 Nov 17 03:34:16.280238 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 883/1793] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:34:16 2021] GET /compute/v2.1/servers/5ddbfaaa-fabf-4324-941c-8868625ffefc => generated 1226 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:34:16.301616 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-39e3deb3-ea1f-436f-bf90-1d4cf15a6a8f tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:34:16.302537 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-39e3deb3-ea1f-436f-bf90-1d4cf15a6a8f tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] [instance: a49437df-3059-4528-8328-2f3471d5fb45] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:34:16.309351 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-39e3deb3-ea1f-436f-bf90-1d4cf15a6a8f tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:34:16.309796 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-39e3deb3-ea1f-436f-bf90-1d4cf15a6a8f tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:34:16.310552 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-39e3deb3-ea1f-436f-bf90-1d4cf15a6a8f tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:34:16.310974 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-39e3deb3-ea1f-436f-bf90-1d4cf15a6a8f tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:34:16.339246 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-39e3deb3-ea1f-436f-bf90-1d4cf15a6a8f tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] 10.222.0.11 "GET /compute/v2.1/servers/a49437df-3059-4528-8328-2f3471d5fb45/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041481 Nov 17 03:34:16.339805 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 911/1794] 10.222.0.11 () {58 vars in 1301 bytes} [Wed Nov 17 03:34:16 2021] GET /compute/v2.1/servers/a49437df-3059-4528-8328-2f3471d5fb45/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 17 03:34:16.764682 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-66544893-2943-4bc8-a81f-1b233718aa73 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:34:16.766439 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-66544893-2943-4bc8-a81f-1b233718aa73 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] [instance: 0698dc5b-5f47-46c4-ace8-f5e891a964a0] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:34:16.773236 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-66544893-2943-4bc8-a81f-1b233718aa73 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:34:16.773775 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-66544893-2943-4bc8-a81f-1b233718aa73 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:34:16.774635 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-66544893-2943-4bc8-a81f-1b233718aa73 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:34:16.775075 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-66544893-2943-4bc8-a81f-1b233718aa73 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:34:16.918245 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-66544893-2943-4bc8-a81f-1b233718aa73 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '163b2f24a72649ac8084be1cac32fa09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e123e9b86124c93a7fc2db9984e7466', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:34:16.925870 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-66544893-2943-4bc8-a81f-1b233718aa73 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] 10.222.0.11 "GET /compute/v2.1/servers/0698dc5b-5f47-46c4-ace8-f5e891a964a0" status: 200 len: 1565 microversion: 2.1 time: 0.168660 Nov 17 03:34:16.926425 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 884/1795] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:34:16 2021] GET /compute/v2.1/servers/0698dc5b-5f47-46c4-ace8-f5e891a964a0 => generated 1565 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:34:17.030216 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-196a82e1-fef7-47b2-b8ee-dd55312dd160 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:34:17.031641 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-196a82e1-fef7-47b2-b8ee-dd55312dd160 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] [instance: 5d54db85-b991-4890-abaa-952413baa2e7] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:34:17.038681 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-196a82e1-fef7-47b2-b8ee-dd55312dd160 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:34:17.039125 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-196a82e1-fef7-47b2-b8ee-dd55312dd160 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:34:17.039907 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-196a82e1-fef7-47b2-b8ee-dd55312dd160 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:34:17.040333 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-196a82e1-fef7-47b2-b8ee-dd55312dd160 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:34:17.070769 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-196a82e1-fef7-47b2-b8ee-dd55312dd160 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] 10.222.0.11 "GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047409 Nov 17 03:34:17.071364 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 912/1796] 10.222.0.11 () {60 vars in 1342 bytes} [Wed Nov 17 03:34:17 2021] GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 17 03:34:17.299671 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-eb2d70d4-17e6-462c-8318-d1c9b2587763 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:34:17.300222 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-eb2d70d4-17e6-462c-8318-d1c9b2587763 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] [instance: 5ddbfaaa-fabf-4324-941c-8868625ffefc] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:34:17.307333 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-eb2d70d4-17e6-462c-8318-d1c9b2587763 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:34:17.307757 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-eb2d70d4-17e6-462c-8318-d1c9b2587763 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:34:17.308546 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-eb2d70d4-17e6-462c-8318-d1c9b2587763 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:34:17.309008 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-eb2d70d4-17e6-462c-8318-d1c9b2587763 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:34:17.351094 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-11c29f79-6e0b-45ca-9244-6773e67f63d6 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:34:17.352015 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-11c29f79-6e0b-45ca-9244-6773e67f63d6 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] [instance: a49437df-3059-4528-8328-2f3471d5fb45] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:34:17.358320 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-11c29f79-6e0b-45ca-9244-6773e67f63d6 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:34:17.358772 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-11c29f79-6e0b-45ca-9244-6773e67f63d6 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:34:17.359551 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-11c29f79-6e0b-45ca-9244-6773e67f63d6 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:34:17.360023 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-11c29f79-6e0b-45ca-9244-6773e67f63d6 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:34:17.370632 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-eb2d70d4-17e6-462c-8318-d1c9b2587763 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80763e09d44c475ea2425b22874e9612', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fef02a1dd77946a2ac0e0414b557435f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:34:17.378531 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-eb2d70d4-17e6-462c-8318-d1c9b2587763 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] 10.222.0.11 "GET /compute/v2.1/servers/5ddbfaaa-fabf-4324-941c-8868625ffefc" status: 200 len: 1226 microversion: 2.1 time: 0.084034 Nov 17 03:34:17.379099 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 885/1797] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:34:17 2021] GET /compute/v2.1/servers/5ddbfaaa-fabf-4324-941c-8868625ffefc => generated 1226 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:34:17.391288 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-11c29f79-6e0b-45ca-9244-6773e67f63d6 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] 10.222.0.11 "GET /compute/v2.1/servers/a49437df-3059-4528-8328-2f3471d5fb45/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043927 Nov 17 03:34:17.391840 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 913/1798] 10.222.0.11 () {58 vars in 1301 bytes} [Wed Nov 17 03:34:17 2021] GET /compute/v2.1/servers/a49437df-3059-4528-8328-2f3471d5fb45/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 17 03:34:17.943506 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-d0044886-0135-42cd-8c70-b236621af95f tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:34:17.944129 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-d0044886-0135-42cd-8c70-b236621af95f tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] [instance: 0698dc5b-5f47-46c4-ace8-f5e891a964a0] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:34:17.953213 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-d0044886-0135-42cd-8c70-b236621af95f tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:34:17.954105 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-d0044886-0135-42cd-8c70-b236621af95f tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:34:17.954872 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-d0044886-0135-42cd-8c70-b236621af95f tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:34:17.955296 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-d0044886-0135-42cd-8c70-b236621af95f tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:34:18.082702 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-d7c69703-2b5f-49ea-9a85-ee5e975d4533 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:34:18.083615 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-d7c69703-2b5f-49ea-9a85-ee5e975d4533 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] [instance: 5d54db85-b991-4890-abaa-952413baa2e7] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:34:18.090470 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-d7c69703-2b5f-49ea-9a85-ee5e975d4533 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:34:18.090911 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-d7c69703-2b5f-49ea-9a85-ee5e975d4533 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:34:18.091686 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-d7c69703-2b5f-49ea-9a85-ee5e975d4533 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:34:18.092137 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-d7c69703-2b5f-49ea-9a85-ee5e975d4533 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:34:18.122565 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-d7c69703-2b5f-49ea-9a85-ee5e975d4533 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] 10.222.0.11 "GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043655 Nov 17 03:34:18.123132 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 914/1799] 10.222.0.11 () {60 vars in 1342 bytes} [Wed Nov 17 03:34:18 2021] GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 17 03:34:18.175930 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-d0044886-0135-42cd-8c70-b236621af95f tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '163b2f24a72649ac8084be1cac32fa09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e123e9b86124c93a7fc2db9984e7466', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:34:18.184198 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-d0044886-0135-42cd-8c70-b236621af95f tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] 10.222.0.11 "GET /compute/v2.1/servers/0698dc5b-5f47-46c4-ace8-f5e891a964a0" status: 200 len: 1565 microversion: 2.1 time: 0.244195 Nov 17 03:34:18.184731 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 886/1800] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:34:17 2021] GET /compute/v2.1/servers/0698dc5b-5f47-46c4-ace8-f5e891a964a0 => generated 1565 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:34:18.395220 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-2dac4426-25ca-4b4e-9090-e153f1e2e999 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:34:18.395863 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-2dac4426-25ca-4b4e-9090-e153f1e2e999 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] [instance: 5ddbfaaa-fabf-4324-941c-8868625ffefc] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:34:18.402395 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-2dac4426-25ca-4b4e-9090-e153f1e2e999 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:34:18.402844 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-2dac4426-25ca-4b4e-9090-e153f1e2e999 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:34:18.402999 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-817d26ce-a98a-4772-a16a-373e118e2ad9 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:34:18.403622 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-2dac4426-25ca-4b4e-9090-e153f1e2e999 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:34:18.404058 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-2dac4426-25ca-4b4e-9090-e153f1e2e999 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:34:18.404205 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-817d26ce-a98a-4772-a16a-373e118e2ad9 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] [instance: a49437df-3059-4528-8328-2f3471d5fb45] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:34:18.411134 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-817d26ce-a98a-4772-a16a-373e118e2ad9 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:34:18.411583 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-817d26ce-a98a-4772-a16a-373e118e2ad9 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:34:18.412363 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-817d26ce-a98a-4772-a16a-373e118e2ad9 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:34:18.412810 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-817d26ce-a98a-4772-a16a-373e118e2ad9 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:34:18.443838 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-817d26ce-a98a-4772-a16a-373e118e2ad9 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] 10.222.0.11 "GET /compute/v2.1/servers/a49437df-3059-4528-8328-2f3471d5fb45/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044667 Nov 17 03:34:18.444760 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 887/1801] 10.222.0.11 () {58 vars in 1301 bytes} [Wed Nov 17 03:34:18 2021] GET /compute/v2.1/servers/a49437df-3059-4528-8328-2f3471d5fb45/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 17 03:34:18.466738 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-2dac4426-25ca-4b4e-9090-e153f1e2e999 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80763e09d44c475ea2425b22874e9612', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fef02a1dd77946a2ac0e0414b557435f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:34:18.474227 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-2dac4426-25ca-4b4e-9090-e153f1e2e999 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] 10.222.0.11 "GET /compute/v2.1/servers/5ddbfaaa-fabf-4324-941c-8868625ffefc" status: 200 len: 1226 microversion: 2.1 time: 0.082850 Nov 17 03:34:18.474797 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 915/1802] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:34:18 2021] GET /compute/v2.1/servers/5ddbfaaa-fabf-4324-941c-8868625ffefc => generated 1226 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:34:19.139116 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-56243812-e010-4515-96de-f1529917ba95 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:34:19.140581 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-56243812-e010-4515-96de-f1529917ba95 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] [instance: 5d54db85-b991-4890-abaa-952413baa2e7] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:34:19.150822 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-56243812-e010-4515-96de-f1529917ba95 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:34:19.151556 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-56243812-e010-4515-96de-f1529917ba95 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:34:19.152894 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-56243812-e010-4515-96de-f1529917ba95 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:34:19.153649 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-56243812-e010-4515-96de-f1529917ba95 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:34:19.184993 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-56243812-e010-4515-96de-f1529917ba95 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] 10.222.0.11 "GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.052329 Nov 17 03:34:19.185546 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 888/1803] 10.222.0.11 () {60 vars in 1342 bytes} [Wed Nov 17 03:34:19 2021] GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 17 03:34:19.201471 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-8d83473d-b335-4dba-a65e-ff7364797f24 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:34:19.202091 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-8d83473d-b335-4dba-a65e-ff7364797f24 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] [instance: 0698dc5b-5f47-46c4-ace8-f5e891a964a0] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:34:19.208951 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-8d83473d-b335-4dba-a65e-ff7364797f24 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:34:19.209394 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-8d83473d-b335-4dba-a65e-ff7364797f24 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:34:19.210159 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-8d83473d-b335-4dba-a65e-ff7364797f24 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:34:19.210586 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-8d83473d-b335-4dba-a65e-ff7364797f24 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:34:19.349491 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-8d83473d-b335-4dba-a65e-ff7364797f24 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '163b2f24a72649ac8084be1cac32fa09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e123e9b86124c93a7fc2db9984e7466', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:34:19.362028 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-8d83473d-b335-4dba-a65e-ff7364797f24 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] 10.222.0.11 "GET /compute/v2.1/servers/0698dc5b-5f47-46c4-ace8-f5e891a964a0" status: 200 len: 1565 microversion: 2.1 time: 0.163783 Nov 17 03:34:19.362776 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 916/1804] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:34:19 2021] GET /compute/v2.1/servers/0698dc5b-5f47-46c4-ace8-f5e891a964a0 => generated 1565 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:34:19.456659 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-9fa5e770-b22a-4b73-b04d-d636fb13e863 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:34:19.457691 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-9fa5e770-b22a-4b73-b04d-d636fb13e863 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] [instance: a49437df-3059-4528-8328-2f3471d5fb45] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:34:19.465067 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-9fa5e770-b22a-4b73-b04d-d636fb13e863 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:34:19.465610 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-9fa5e770-b22a-4b73-b04d-d636fb13e863 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:34:19.466540 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-9fa5e770-b22a-4b73-b04d-d636fb13e863 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:34:19.467067 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-9fa5e770-b22a-4b73-b04d-d636fb13e863 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:34:19.491293 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-8dfa89e8-5c1e-45fb-abad-683178021c69 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:34:19.492020 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-8dfa89e8-5c1e-45fb-abad-683178021c69 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] [instance: 5ddbfaaa-fabf-4324-941c-8868625ffefc] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:34:19.498630 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-8dfa89e8-5c1e-45fb-abad-683178021c69 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:34:19.499077 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-8dfa89e8-5c1e-45fb-abad-683178021c69 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:34:19.499219 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-9fa5e770-b22a-4b73-b04d-d636fb13e863 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] 10.222.0.11 "GET /compute/v2.1/servers/a49437df-3059-4528-8328-2f3471d5fb45/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047310 Nov 17 03:34:19.499697 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 889/1805] 10.222.0.11 () {58 vars in 1301 bytes} [Wed Nov 17 03:34:19 2021] GET /compute/v2.1/servers/a49437df-3059-4528-8328-2f3471d5fb45/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 17 03:34:19.499866 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-8dfa89e8-5c1e-45fb-abad-683178021c69 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:34:19.500265 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-8dfa89e8-5c1e-45fb-abad-683178021c69 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:34:19.561067 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-8dfa89e8-5c1e-45fb-abad-683178021c69 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80763e09d44c475ea2425b22874e9612', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fef02a1dd77946a2ac0e0414b557435f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:34:19.569000 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-8dfa89e8-5c1e-45fb-abad-683178021c69 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] 10.222.0.11 "GET /compute/v2.1/servers/5ddbfaaa-fabf-4324-941c-8868625ffefc" status: 200 len: 1226 microversion: 2.1 time: 0.081435 Nov 17 03:34:19.569582 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 917/1806] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:34:19 2021] GET /compute/v2.1/servers/5ddbfaaa-fabf-4324-941c-8868625ffefc => generated 1226 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:34:20.200760 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-ab8b0537-1d4f-47bc-8afc-5ffe591ac618 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:34:20.202371 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-ab8b0537-1d4f-47bc-8afc-5ffe591ac618 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] [instance: 5d54db85-b991-4890-abaa-952413baa2e7] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:34:20.212691 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-ab8b0537-1d4f-47bc-8afc-5ffe591ac618 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:34:20.213438 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-ab8b0537-1d4f-47bc-8afc-5ffe591ac618 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:34:20.214769 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-ab8b0537-1d4f-47bc-8afc-5ffe591ac618 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:34:20.215497 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-ab8b0537-1d4f-47bc-8afc-5ffe591ac618 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:34:20.247863 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-ab8b0537-1d4f-47bc-8afc-5ffe591ac618 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] 10.222.0.11 "GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.053457 Nov 17 03:34:20.248429 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 890/1807] 10.222.0.11 () {60 vars in 1342 bytes} [Wed Nov 17 03:34:20 2021] GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 17 03:34:20.387179 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-b0275e9f-db83-4a3f-a268-a2f2820f1bac tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:34:20.387947 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-b0275e9f-db83-4a3f-a268-a2f2820f1bac tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] [instance: 0698dc5b-5f47-46c4-ace8-f5e891a964a0] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:34:20.395925 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-b0275e9f-db83-4a3f-a268-a2f2820f1bac tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:34:20.396377 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-b0275e9f-db83-4a3f-a268-a2f2820f1bac tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:34:20.397182 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-b0275e9f-db83-4a3f-a268-a2f2820f1bac tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:34:20.397636 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-b0275e9f-db83-4a3f-a268-a2f2820f1bac tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:34:20.510558 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-788f9a93-4e9f-41b9-ac4a-8815fff80855 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:34:20.511488 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-788f9a93-4e9f-41b9-ac4a-8815fff80855 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] [instance: a49437df-3059-4528-8328-2f3471d5fb45] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:34:20.518144 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-788f9a93-4e9f-41b9-ac4a-8815fff80855 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:34:20.518603 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-788f9a93-4e9f-41b9-ac4a-8815fff80855 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:34:20.519368 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-788f9a93-4e9f-41b9-ac4a-8815fff80855 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:34:20.519791 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-788f9a93-4e9f-41b9-ac4a-8815fff80855 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:34:20.547027 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-b0275e9f-db83-4a3f-a268-a2f2820f1bac tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '163b2f24a72649ac8084be1cac32fa09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e123e9b86124c93a7fc2db9984e7466', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:34:20.549959 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-788f9a93-4e9f-41b9-ac4a-8815fff80855 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] 10.222.0.11 "GET /compute/v2.1/servers/a49437df-3059-4528-8328-2f3471d5fb45/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043201 Nov 17 03:34:20.553855 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 891/1808] 10.222.0.11 () {58 vars in 1301 bytes} [Wed Nov 17 03:34:20 2021] GET /compute/v2.1/servers/a49437df-3059-4528-8328-2f3471d5fb45/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 17 03:34:20.555379 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-b0275e9f-db83-4a3f-a268-a2f2820f1bac tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] 10.222.0.11 "GET /compute/v2.1/servers/0698dc5b-5f47-46c4-ace8-f5e891a964a0" status: 200 len: 1565 microversion: 2.1 time: 0.173154 Nov 17 03:34:20.555960 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 918/1809] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:34:20 2021] GET /compute/v2.1/servers/0698dc5b-5f47-46c4-ace8-f5e891a964a0 => generated 1565 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:34:20.585782 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-778db4c4-f0fb-4d80-9357-03fa41119ba2 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:34:20.586391 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-778db4c4-f0fb-4d80-9357-03fa41119ba2 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] [instance: 5ddbfaaa-fabf-4324-941c-8868625ffefc] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:34:20.592726 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-778db4c4-f0fb-4d80-9357-03fa41119ba2 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:34:20.593211 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-778db4c4-f0fb-4d80-9357-03fa41119ba2 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:34:20.593975 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-778db4c4-f0fb-4d80-9357-03fa41119ba2 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:34:20.594408 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-778db4c4-f0fb-4d80-9357-03fa41119ba2 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:34:20.655791 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-778db4c4-f0fb-4d80-9357-03fa41119ba2 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80763e09d44c475ea2425b22874e9612', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fef02a1dd77946a2ac0e0414b557435f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:34:20.663732 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-778db4c4-f0fb-4d80-9357-03fa41119ba2 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] 10.222.0.11 "GET /compute/v2.1/servers/5ddbfaaa-fabf-4324-941c-8868625ffefc" status: 200 len: 1226 microversion: 2.1 time: 0.081622 Nov 17 03:34:20.664301 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 892/1810] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:34:20 2021] GET /compute/v2.1/servers/5ddbfaaa-fabf-4324-941c-8868625ffefc => generated 1226 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:34:21.263834 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-7e614842-bfa9-4fef-b230-c57db03c9cc3 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:34:21.265347 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-7e614842-bfa9-4fef-b230-c57db03c9cc3 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] [instance: 5d54db85-b991-4890-abaa-952413baa2e7] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:34:21.273281 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-7e614842-bfa9-4fef-b230-c57db03c9cc3 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:34:21.273756 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-7e614842-bfa9-4fef-b230-c57db03c9cc3 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:34:21.274524 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-7e614842-bfa9-4fef-b230-c57db03c9cc3 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:34:21.274952 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-7e614842-bfa9-4fef-b230-c57db03c9cc3 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:34:21.304395 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-7e614842-bfa9-4fef-b230-c57db03c9cc3 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] 10.222.0.11 "GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047028 Nov 17 03:34:21.305344 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 919/1811] 10.222.0.11 () {60 vars in 1342 bytes} [Wed Nov 17 03:34:21 2021] GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 17 03:34:21.565947 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-add0f696-9eb1-4558-b517-513fd704d241 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:34:21.566893 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-add0f696-9eb1-4558-b517-513fd704d241 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] [instance: a49437df-3059-4528-8328-2f3471d5fb45] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:34:21.572810 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-01f7f6d1-7f1f-4016-a942-991d4f7ba439 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:34:21.573437 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-01f7f6d1-7f1f-4016-a942-991d4f7ba439 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] [instance: 0698dc5b-5f47-46c4-ace8-f5e891a964a0] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:34:21.573763 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-add0f696-9eb1-4558-b517-513fd704d241 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:34:21.574190 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-add0f696-9eb1-4558-b517-513fd704d241 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:34:21.575000 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-add0f696-9eb1-4558-b517-513fd704d241 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:34:21.575461 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-add0f696-9eb1-4558-b517-513fd704d241 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:34:21.579935 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-01f7f6d1-7f1f-4016-a942-991d4f7ba439 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:34:21.580369 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-01f7f6d1-7f1f-4016-a942-991d4f7ba439 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:34:21.581199 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-01f7f6d1-7f1f-4016-a942-991d4f7ba439 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:34:21.581613 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-01f7f6d1-7f1f-4016-a942-991d4f7ba439 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:34:21.607051 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-add0f696-9eb1-4558-b517-513fd704d241 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] 10.222.0.11 "GET /compute/v2.1/servers/a49437df-3059-4528-8328-2f3471d5fb45/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047662 Nov 17 03:34:21.607644 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 893/1812] 10.222.0.11 () {58 vars in 1301 bytes} [Wed Nov 17 03:34:21 2021] GET /compute/v2.1/servers/a49437df-3059-4528-8328-2f3471d5fb45/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 17 03:34:21.682040 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-b1269449-f4e0-4bef-8820-8cebee4263b9 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:34:21.682730 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-b1269449-f4e0-4bef-8820-8cebee4263b9 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] [instance: 5ddbfaaa-fabf-4324-941c-8868625ffefc] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:34:21.689141 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-b1269449-f4e0-4bef-8820-8cebee4263b9 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:34:21.689591 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-b1269449-f4e0-4bef-8820-8cebee4263b9 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:34:21.690371 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-b1269449-f4e0-4bef-8820-8cebee4263b9 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:34:21.691200 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-b1269449-f4e0-4bef-8820-8cebee4263b9 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:34:21.730221 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-01f7f6d1-7f1f-4016-a942-991d4f7ba439 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '163b2f24a72649ac8084be1cac32fa09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e123e9b86124c93a7fc2db9984e7466', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:34:21.738573 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-01f7f6d1-7f1f-4016-a942-991d4f7ba439 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] 10.222.0.11 "GET /compute/v2.1/servers/0698dc5b-5f47-46c4-ace8-f5e891a964a0" status: 200 len: 1565 microversion: 2.1 time: 0.169216 Nov 17 03:34:21.740395 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 920/1813] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:34:21 2021] GET /compute/v2.1/servers/0698dc5b-5f47-46c4-ace8-f5e891a964a0 => generated 1565 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:34:21.750680 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-b1269449-f4e0-4bef-8820-8cebee4263b9 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80763e09d44c475ea2425b22874e9612', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fef02a1dd77946a2ac0e0414b557435f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:34:21.767094 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-b1269449-f4e0-4bef-8820-8cebee4263b9 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] 10.222.0.11 "GET /compute/v2.1/servers/5ddbfaaa-fabf-4324-941c-8868625ffefc" status: 200 len: 1226 microversion: 2.1 time: 0.089038 Nov 17 03:34:21.767676 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 894/1814] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:34:21 2021] GET /compute/v2.1/servers/5ddbfaaa-fabf-4324-941c-8868625ffefc => generated 1226 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 17 03:34:22.317186 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-72b94105-b315-484c-902f-41c1e581a46b tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:34:22.318011 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-72b94105-b315-484c-902f-41c1e581a46b tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] [instance: 5d54db85-b991-4890-abaa-952413baa2e7] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:34:22.324306 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-72b94105-b315-484c-902f-41c1e581a46b tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:34:22.324749 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-72b94105-b315-484c-902f-41c1e581a46b tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:34:22.325674 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-72b94105-b315-484c-902f-41c1e581a46b tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:34:22.326114 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-72b94105-b315-484c-902f-41c1e581a46b tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:34:22.355919 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-72b94105-b315-484c-902f-41c1e581a46b tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] 10.222.0.11 "GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042981 Nov 17 03:34:22.356462 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 921/1815] 10.222.0.11 () {60 vars in 1342 bytes} [Wed Nov 17 03:34:22 2021] GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 17 03:34:22.622905 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-0d782935-27ed-4962-bbcb-cfaf22da64e8 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:34:22.624266 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-0d782935-27ed-4962-bbcb-cfaf22da64e8 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] [instance: a49437df-3059-4528-8328-2f3471d5fb45] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:34:22.634871 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-0d782935-27ed-4962-bbcb-cfaf22da64e8 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:34:22.635629 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-0d782935-27ed-4962-bbcb-cfaf22da64e8 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:34:22.636960 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-0d782935-27ed-4962-bbcb-cfaf22da64e8 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:34:22.637683 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-0d782935-27ed-4962-bbcb-cfaf22da64e8 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:34:22.669045 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-0d782935-27ed-4962-bbcb-cfaf22da64e8 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] 10.222.0.11 "GET /compute/v2.1/servers/a49437df-3059-4528-8328-2f3471d5fb45/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052812 Nov 17 03:34:22.669587 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 895/1816] 10.222.0.11 () {58 vars in 1301 bytes} [Wed Nov 17 03:34:22 2021] GET /compute/v2.1/servers/a49437df-3059-4528-8328-2f3471d5fb45/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 17 03:34:22.760385 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-6a80f715-164b-4f91-9f97-edc1b03a1991 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:34:22.761422 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-6a80f715-164b-4f91-9f97-edc1b03a1991 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] [instance: 0698dc5b-5f47-46c4-ace8-f5e891a964a0] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:34:22.770928 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-6a80f715-164b-4f91-9f97-edc1b03a1991 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:34:22.771373 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-6a80f715-164b-4f91-9f97-edc1b03a1991 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:34:22.772137 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-6a80f715-164b-4f91-9f97-edc1b03a1991 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:34:22.772567 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-6a80f715-164b-4f91-9f97-edc1b03a1991 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:34:22.783188 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-ff4d12f1-ec80-4704-b6c3-01a7071b3651 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:34:22.783789 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-ff4d12f1-ec80-4704-b6c3-01a7071b3651 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] [instance: 5ddbfaaa-fabf-4324-941c-8868625ffefc] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:34:22.790375 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-ff4d12f1-ec80-4704-b6c3-01a7071b3651 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:34:22.790814 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-ff4d12f1-ec80-4704-b6c3-01a7071b3651 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:34:22.791582 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-ff4d12f1-ec80-4704-b6c3-01a7071b3651 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:34:22.792007 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-ff4d12f1-ec80-4704-b6c3-01a7071b3651 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:34:22.850947 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-ff4d12f1-ec80-4704-b6c3-01a7071b3651 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80763e09d44c475ea2425b22874e9612', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fef02a1dd77946a2ac0e0414b557435f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:34:22.858397 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-ff4d12f1-ec80-4704-b6c3-01a7071b3651 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] 10.222.0.11 "GET /compute/v2.1/servers/5ddbfaaa-fabf-4324-941c-8868625ffefc" status: 200 len: 1226 microversion: 2.1 time: 0.078825 Nov 17 03:34:22.858973 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 896/1817] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:34:22 2021] GET /compute/v2.1/servers/5ddbfaaa-fabf-4324-941c-8868625ffefc => generated 1226 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:34:22.905336 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-6a80f715-164b-4f91-9f97-edc1b03a1991 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '163b2f24a72649ac8084be1cac32fa09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e123e9b86124c93a7fc2db9984e7466', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:34:22.913077 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-6a80f715-164b-4f91-9f97-edc1b03a1991 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] 10.222.0.11 "GET /compute/v2.1/servers/0698dc5b-5f47-46c4-ace8-f5e891a964a0" status: 200 len: 1565 microversion: 2.1 time: 0.158692 Nov 17 03:34:22.913640 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 922/1818] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:34:22 2021] GET /compute/v2.1/servers/0698dc5b-5f47-46c4-ace8-f5e891a964a0 => generated 1565 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:34:23.368299 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-8a995dfd-d9e6-4651-802a-b2a66872dff3 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:34:23.369269 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-8a995dfd-d9e6-4651-802a-b2a66872dff3 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] [instance: 5d54db85-b991-4890-abaa-952413baa2e7] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:34:23.375596 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-8a995dfd-d9e6-4651-802a-b2a66872dff3 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:34:23.376036 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-8a995dfd-d9e6-4651-802a-b2a66872dff3 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:34:23.376871 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-8a995dfd-d9e6-4651-802a-b2a66872dff3 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:34:23.377253 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-8a995dfd-d9e6-4651-802a-b2a66872dff3 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:34:23.407662 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-8a995dfd-d9e6-4651-802a-b2a66872dff3 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] 10.222.0.11 "GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043296 Nov 17 03:34:23.408218 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 897/1819] 10.222.0.11 () {60 vars in 1342 bytes} [Wed Nov 17 03:34:23 2021] GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 17 03:34:23.685191 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-c093903a-1d47-4c45-aabd-b91dbc78953f tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:34:23.686520 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-c093903a-1d47-4c45-aabd-b91dbc78953f tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] [instance: a49437df-3059-4528-8328-2f3471d5fb45] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:34:23.695041 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-c093903a-1d47-4c45-aabd-b91dbc78953f tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:34:23.695487 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-c093903a-1d47-4c45-aabd-b91dbc78953f tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:34:23.696250 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-c093903a-1d47-4c45-aabd-b91dbc78953f tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:34:23.696680 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-c093903a-1d47-4c45-aabd-b91dbc78953f tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:34:23.726577 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-c093903a-1d47-4c45-aabd-b91dbc78953f tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] 10.222.0.11 "GET /compute/v2.1/servers/a49437df-3059-4528-8328-2f3471d5fb45/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048345 Nov 17 03:34:23.727123 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 923/1820] 10.222.0.11 () {58 vars in 1301 bytes} [Wed Nov 17 03:34:23 2021] GET /compute/v2.1/servers/a49437df-3059-4528-8328-2f3471d5fb45/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 17 03:34:23.879280 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-0d7c330b-ab67-4e07-99ab-f0dd1b73bcc6 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:34:23.880039 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-0d7c330b-ab67-4e07-99ab-f0dd1b73bcc6 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] [instance: 5ddbfaaa-fabf-4324-941c-8868625ffefc] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:34:23.887946 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-0d7c330b-ab67-4e07-99ab-f0dd1b73bcc6 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:34:23.888495 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-0d7c330b-ab67-4e07-99ab-f0dd1b73bcc6 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:34:23.889505 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-0d7c330b-ab67-4e07-99ab-f0dd1b73bcc6 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:34:23.890039 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-0d7c330b-ab67-4e07-99ab-f0dd1b73bcc6 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:34:23.930385 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-e24a6e0f-4922-40de-a6a0-618988789045 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:34:23.930986 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-e24a6e0f-4922-40de-a6a0-618988789045 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] [instance: 0698dc5b-5f47-46c4-ace8-f5e891a964a0] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:34:23.937568 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-e24a6e0f-4922-40de-a6a0-618988789045 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:34:23.937931 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-e24a6e0f-4922-40de-a6a0-618988789045 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:34:23.938705 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-e24a6e0f-4922-40de-a6a0-618988789045 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:34:23.939135 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-e24a6e0f-4922-40de-a6a0-618988789045 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:34:23.954515 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-0d7c330b-ab67-4e07-99ab-f0dd1b73bcc6 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80763e09d44c475ea2425b22874e9612', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fef02a1dd77946a2ac0e0414b557435f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:34:23.962899 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-0d7c330b-ab67-4e07-99ab-f0dd1b73bcc6 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] 10.222.0.11 "GET /compute/v2.1/servers/5ddbfaaa-fabf-4324-941c-8868625ffefc" status: 200 len: 1226 microversion: 2.1 time: 0.090389 Nov 17 03:34:23.963444 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 898/1821] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:34:23 2021] GET /compute/v2.1/servers/5ddbfaaa-fabf-4324-941c-8868625ffefc => generated 1226 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:34:24.073804 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-e24a6e0f-4922-40de-a6a0-618988789045 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '163b2f24a72649ac8084be1cac32fa09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e123e9b86124c93a7fc2db9984e7466', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:34:24.081476 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-e24a6e0f-4922-40de-a6a0-618988789045 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] 10.222.0.11 "GET /compute/v2.1/servers/0698dc5b-5f47-46c4-ace8-f5e891a964a0" status: 200 len: 1565 microversion: 2.1 time: 0.154981 Nov 17 03:34:24.082049 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 924/1822] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:34:23 2021] GET /compute/v2.1/servers/0698dc5b-5f47-46c4-ace8-f5e891a964a0 => generated 1565 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 17 03:34:24.423768 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-205748db-5e1a-426d-b80d-551223357582 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:34:24.425542 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-205748db-5e1a-426d-b80d-551223357582 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] [instance: 5d54db85-b991-4890-abaa-952413baa2e7] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:34:24.436441 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-205748db-5e1a-426d-b80d-551223357582 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:34:24.437239 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-205748db-5e1a-426d-b80d-551223357582 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:34:24.438506 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-205748db-5e1a-426d-b80d-551223357582 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:34:24.439208 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-205748db-5e1a-426d-b80d-551223357582 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:34:24.470359 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-205748db-5e1a-426d-b80d-551223357582 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] 10.222.0.11 "GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.053124 Nov 17 03:34:24.470906 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 899/1823] 10.222.0.11 () {60 vars in 1342 bytes} [Wed Nov 17 03:34:24 2021] GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 17 03:34:24.742662 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-5a7241d5-cf99-44ef-bf26-05cd4ba19ab1 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:34:24.744023 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-5a7241d5-cf99-44ef-bf26-05cd4ba19ab1 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] [instance: a49437df-3059-4528-8328-2f3471d5fb45] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:34:24.754273 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-5a7241d5-cf99-44ef-bf26-05cd4ba19ab1 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:34:24.755027 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-5a7241d5-cf99-44ef-bf26-05cd4ba19ab1 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:34:24.756319 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-5a7241d5-cf99-44ef-bf26-05cd4ba19ab1 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:34:24.757108 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-5a7241d5-cf99-44ef-bf26-05cd4ba19ab1 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:34:24.797956 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-5a7241d5-cf99-44ef-bf26-05cd4ba19ab1 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] 10.222.0.11 "GET /compute/v2.1/servers/a49437df-3059-4528-8328-2f3471d5fb45/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.061964 Nov 17 03:34:24.798806 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 925/1824] 10.222.0.11 () {58 vars in 1301 bytes} [Wed Nov 17 03:34:24 2021] GET /compute/v2.1/servers/a49437df-3059-4528-8328-2f3471d5fb45/os-volume_attachments => generated 197 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 17 03:34:24.983624 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-6ad16183-b010-4b2e-8f69-74b27a71be58 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:34:24.984884 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-6ad16183-b010-4b2e-8f69-74b27a71be58 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] [instance: 5ddbfaaa-fabf-4324-941c-8868625ffefc] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:34:24.992415 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-6ad16183-b010-4b2e-8f69-74b27a71be58 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:34:24.992988 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-6ad16183-b010-4b2e-8f69-74b27a71be58 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:34:24.993680 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-6ad16183-b010-4b2e-8f69-74b27a71be58 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:34:24.994112 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-6ad16183-b010-4b2e-8f69-74b27a71be58 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:34:25.069769 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-6ad16183-b010-4b2e-8f69-74b27a71be58 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80763e09d44c475ea2425b22874e9612', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fef02a1dd77946a2ac0e0414b557435f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:34:25.077513 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-6ad16183-b010-4b2e-8f69-74b27a71be58 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] 10.222.0.11 "GET /compute/v2.1/servers/5ddbfaaa-fabf-4324-941c-8868625ffefc" status: 200 len: 1226 microversion: 2.1 time: 0.100035 Nov 17 03:34:25.078078 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 900/1825] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:34:24 2021] GET /compute/v2.1/servers/5ddbfaaa-fabf-4324-941c-8868625ffefc => generated 1226 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:34:25.099087 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-bab4aa0e-b94e-410f-8b65-39fd9c851c41 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:34:25.099700 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-bab4aa0e-b94e-410f-8b65-39fd9c851c41 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] [instance: 0698dc5b-5f47-46c4-ace8-f5e891a964a0] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:34:25.106793 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-bab4aa0e-b94e-410f-8b65-39fd9c851c41 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:34:25.107265 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-bab4aa0e-b94e-410f-8b65-39fd9c851c41 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:34:25.108035 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-bab4aa0e-b94e-410f-8b65-39fd9c851c41 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:34:25.108469 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-bab4aa0e-b94e-410f-8b65-39fd9c851c41 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:34:25.253754 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-bab4aa0e-b94e-410f-8b65-39fd9c851c41 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '163b2f24a72649ac8084be1cac32fa09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e123e9b86124c93a7fc2db9984e7466', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:34:25.261637 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-bab4aa0e-b94e-410f-8b65-39fd9c851c41 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] 10.222.0.11 "GET /compute/v2.1/servers/0698dc5b-5f47-46c4-ace8-f5e891a964a0" status: 200 len: 1565 microversion: 2.1 time: 0.166861 Nov 17 03:34:25.262181 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 926/1826] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:34:25 2021] GET /compute/v2.1/servers/0698dc5b-5f47-46c4-ace8-f5e891a964a0 => generated 1565 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:34:25.487088 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-5b9b3214-7d43-4f0d-b38a-e4d27aa9a28e tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:34:25.488191 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-5b9b3214-7d43-4f0d-b38a-e4d27aa9a28e tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] [instance: 5d54db85-b991-4890-abaa-952413baa2e7] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:34:25.494846 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-5b9b3214-7d43-4f0d-b38a-e4d27aa9a28e tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:34:25.495292 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-5b9b3214-7d43-4f0d-b38a-e4d27aa9a28e tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:34:25.496059 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-5b9b3214-7d43-4f0d-b38a-e4d27aa9a28e tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:34:25.496487 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-5b9b3214-7d43-4f0d-b38a-e4d27aa9a28e tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:34:25.526483 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-5b9b3214-7d43-4f0d-b38a-e4d27aa9a28e tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] 10.222.0.11 "GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045494 Nov 17 03:34:25.527048 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 901/1827] 10.222.0.11 () {60 vars in 1342 bytes} [Wed Nov 17 03:34:25 2021] GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 17 03:34:25.811452 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-d27f705b-58cc-4451-9106-96703e713d27 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:34:25.812374 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-d27f705b-58cc-4451-9106-96703e713d27 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] [instance: a49437df-3059-4528-8328-2f3471d5fb45] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:34:25.819186 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-d27f705b-58cc-4451-9106-96703e713d27 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:34:25.819632 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-d27f705b-58cc-4451-9106-96703e713d27 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:34:25.820395 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-d27f705b-58cc-4451-9106-96703e713d27 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:34:25.820806 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-d27f705b-58cc-4451-9106-96703e713d27 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:34:25.851226 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-d27f705b-58cc-4451-9106-96703e713d27 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] 10.222.0.11 "GET /compute/v2.1/servers/a49437df-3059-4528-8328-2f3471d5fb45/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043581 Nov 17 03:34:25.851795 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 927/1828] 10.222.0.11 () {58 vars in 1301 bytes} [Wed Nov 17 03:34:25 2021] GET /compute/v2.1/servers/a49437df-3059-4528-8328-2f3471d5fb45/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 17 03:34:26.095627 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-6d2cd3a2-a966-461b-91bc-f359ebdbef1b tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:34:26.096234 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-6d2cd3a2-a966-461b-91bc-f359ebdbef1b tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] [instance: 5ddbfaaa-fabf-4324-941c-8868625ffefc] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:34:26.102767 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-6d2cd3a2-a966-461b-91bc-f359ebdbef1b tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:34:26.103212 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-6d2cd3a2-a966-461b-91bc-f359ebdbef1b tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:34:26.103982 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-6d2cd3a2-a966-461b-91bc-f359ebdbef1b tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:34:26.104412 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-6d2cd3a2-a966-461b-91bc-f359ebdbef1b tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:34:26.163693 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-6d2cd3a2-a966-461b-91bc-f359ebdbef1b tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80763e09d44c475ea2425b22874e9612', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fef02a1dd77946a2ac0e0414b557435f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:34:26.171351 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-6d2cd3a2-a966-461b-91bc-f359ebdbef1b tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] 10.222.0.11 "GET /compute/v2.1/servers/5ddbfaaa-fabf-4324-941c-8868625ffefc" status: 200 len: 1226 microversion: 2.1 time: 0.080230 Nov 17 03:34:26.171886 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 902/1829] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:34:26 2021] GET /compute/v2.1/servers/5ddbfaaa-fabf-4324-941c-8868625ffefc => generated 1226 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:34:26.282536 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-af3c0c65-7572-4a54-815e-7099f52680e7 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:34:26.283543 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-af3c0c65-7572-4a54-815e-7099f52680e7 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] [instance: 0698dc5b-5f47-46c4-ace8-f5e891a964a0] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:34:26.294636 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-af3c0c65-7572-4a54-815e-7099f52680e7 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:34:26.295401 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-af3c0c65-7572-4a54-815e-7099f52680e7 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:34:26.296673 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-af3c0c65-7572-4a54-815e-7099f52680e7 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:34:26.297467 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-af3c0c65-7572-4a54-815e-7099f52680e7 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:34:26.433347 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-af3c0c65-7572-4a54-815e-7099f52680e7 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '163b2f24a72649ac8084be1cac32fa09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e123e9b86124c93a7fc2db9984e7466', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:34:26.441633 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-af3c0c65-7572-4a54-815e-7099f52680e7 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] 10.222.0.11 "GET /compute/v2.1/servers/0698dc5b-5f47-46c4-ace8-f5e891a964a0" status: 200 len: 1565 microversion: 2.1 time: 0.165370 Nov 17 03:34:26.442182 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 928/1830] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:34:26 2021] GET /compute/v2.1/servers/0698dc5b-5f47-46c4-ace8-f5e891a964a0 => generated 1565 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:34:26.542188 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-8a20ed9d-e5d6-465a-9899-9fed4130eb1f tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:34:26.543652 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-8a20ed9d-e5d6-465a-9899-9fed4130eb1f tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] [instance: 5d54db85-b991-4890-abaa-952413baa2e7] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:34:26.552729 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-8a20ed9d-e5d6-465a-9899-9fed4130eb1f tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:34:26.553207 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-8a20ed9d-e5d6-465a-9899-9fed4130eb1f tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:34:26.553968 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-8a20ed9d-e5d6-465a-9899-9fed4130eb1f tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:34:26.554396 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-8a20ed9d-e5d6-465a-9899-9fed4130eb1f tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:34:26.585280 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-8a20ed9d-e5d6-465a-9899-9fed4130eb1f tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] 10.222.0.11 "GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.049482 Nov 17 03:34:26.585840 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 903/1831] 10.222.0.11 () {60 vars in 1342 bytes} [Wed Nov 17 03:34:26 2021] GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 17 03:34:26.867277 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-22d6b3b4-e4bc-4d46-8f49-2fc15ba5fed5 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:34:26.868829 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-22d6b3b4-e4bc-4d46-8f49-2fc15ba5fed5 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] [instance: a49437df-3059-4528-8328-2f3471d5fb45] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:34:26.878695 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-22d6b3b4-e4bc-4d46-8f49-2fc15ba5fed5 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:34:26.879148 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-22d6b3b4-e4bc-4d46-8f49-2fc15ba5fed5 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:34:26.879937 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-22d6b3b4-e4bc-4d46-8f49-2fc15ba5fed5 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:34:26.880375 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-22d6b3b4-e4bc-4d46-8f49-2fc15ba5fed5 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:34:26.909285 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-22d6b3b4-e4bc-4d46-8f49-2fc15ba5fed5 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] 10.222.0.11 "GET /compute/v2.1/servers/a49437df-3059-4528-8328-2f3471d5fb45/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048425 Nov 17 03:34:26.909838 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 929/1832] 10.222.0.11 () {58 vars in 1301 bytes} [Wed Nov 17 03:34:26 2021] GET /compute/v2.1/servers/a49437df-3059-4528-8328-2f3471d5fb45/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 17 03:34:27.193651 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-9fab84ef-f76e-4cec-a969-0024a3d0d496 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:34:27.194504 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-9fab84ef-f76e-4cec-a969-0024a3d0d496 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] [instance: 5ddbfaaa-fabf-4324-941c-8868625ffefc] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:34:27.204581 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-9fab84ef-f76e-4cec-a969-0024a3d0d496 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:34:27.205382 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-9fab84ef-f76e-4cec-a969-0024a3d0d496 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:34:27.206975 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-9fab84ef-f76e-4cec-a969-0024a3d0d496 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:34:27.207461 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-9fab84ef-f76e-4cec-a969-0024a3d0d496 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:34:27.276911 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-9fab84ef-f76e-4cec-a969-0024a3d0d496 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80763e09d44c475ea2425b22874e9612', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fef02a1dd77946a2ac0e0414b557435f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:34:27.284162 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-9fab84ef-f76e-4cec-a969-0024a3d0d496 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] 10.222.0.11 "GET /compute/v2.1/servers/5ddbfaaa-fabf-4324-941c-8868625ffefc" status: 200 len: 1226 microversion: 2.1 time: 0.097480 Nov 17 03:34:27.284738 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 904/1833] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:34:27 2021] GET /compute/v2.1/servers/5ddbfaaa-fabf-4324-941c-8868625ffefc => generated 1226 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:34:27.466492 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-048b9f02-a0be-4315-97f1-0197521cb3f3 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:34:27.467157 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-048b9f02-a0be-4315-97f1-0197521cb3f3 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] [instance: 0698dc5b-5f47-46c4-ace8-f5e891a964a0] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:34:27.475335 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-048b9f02-a0be-4315-97f1-0197521cb3f3 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:34:27.475781 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-048b9f02-a0be-4315-97f1-0197521cb3f3 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:34:27.476548 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-048b9f02-a0be-4315-97f1-0197521cb3f3 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:34:27.477016 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-048b9f02-a0be-4315-97f1-0197521cb3f3 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:34:27.597936 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-2f808551-8e6e-4fe2-8bf9-f449c02717ee tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:34:27.598863 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-2f808551-8e6e-4fe2-8bf9-f449c02717ee tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] [instance: 5d54db85-b991-4890-abaa-952413baa2e7] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:34:27.605254 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-2f808551-8e6e-4fe2-8bf9-f449c02717ee tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:34:27.605711 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-2f808551-8e6e-4fe2-8bf9-f449c02717ee tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:34:27.606466 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-2f808551-8e6e-4fe2-8bf9-f449c02717ee tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:34:27.606954 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-2f808551-8e6e-4fe2-8bf9-f449c02717ee tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:34:27.622938 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-048b9f02-a0be-4315-97f1-0197521cb3f3 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '163b2f24a72649ac8084be1cac32fa09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e123e9b86124c93a7fc2db9984e7466', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:34:27.630962 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-048b9f02-a0be-4315-97f1-0197521cb3f3 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] 10.222.0.11 "GET /compute/v2.1/servers/0698dc5b-5f47-46c4-ace8-f5e891a964a0" status: 200 len: 1565 microversion: 2.1 time: 0.169276 Nov 17 03:34:27.631706 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 930/1834] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:34:27 2021] GET /compute/v2.1/servers/0698dc5b-5f47-46c4-ace8-f5e891a964a0 => generated 1565 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:34:27.637048 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-2f808551-8e6e-4fe2-8bf9-f449c02717ee tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] 10.222.0.11 "GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043098 Nov 17 03:34:27.637640 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 905/1835] 10.222.0.11 () {60 vars in 1342 bytes} [Wed Nov 17 03:34:27 2021] GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 17 03:34:27.924942 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-a40610f4-e873-438f-9af4-9a62645cf719 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:34:27.925971 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-a40610f4-e873-438f-9af4-9a62645cf719 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] [instance: a49437df-3059-4528-8328-2f3471d5fb45] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:34:27.932813 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-a40610f4-e873-438f-9af4-9a62645cf719 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:34:27.933269 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-a40610f4-e873-438f-9af4-9a62645cf719 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:34:27.934034 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-a40610f4-e873-438f-9af4-9a62645cf719 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:34:27.934466 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-a40610f4-e873-438f-9af4-9a62645cf719 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:34:27.965420 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-a40610f4-e873-438f-9af4-9a62645cf719 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] 10.222.0.11 "GET /compute/v2.1/servers/a49437df-3059-4528-8328-2f3471d5fb45/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047026 Nov 17 03:34:27.965937 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 931/1836] 10.222.0.11 () {58 vars in 1301 bytes} [Wed Nov 17 03:34:27 2021] GET /compute/v2.1/servers/a49437df-3059-4528-8328-2f3471d5fb45/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 17 03:34:28.306689 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-301896f8-ed89-402c-8515-666d733b4d32 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:34:28.307345 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-301896f8-ed89-402c-8515-666d733b4d32 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] [instance: 5ddbfaaa-fabf-4324-941c-8868625ffefc] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:34:28.314920 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-301896f8-ed89-402c-8515-666d733b4d32 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:34:28.315358 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-301896f8-ed89-402c-8515-666d733b4d32 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:34:28.316226 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-301896f8-ed89-402c-8515-666d733b4d32 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:34:28.316659 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-301896f8-ed89-402c-8515-666d733b4d32 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:34:28.375728 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-301896f8-ed89-402c-8515-666d733b4d32 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80763e09d44c475ea2425b22874e9612', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fef02a1dd77946a2ac0e0414b557435f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:34:28.383415 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-301896f8-ed89-402c-8515-666d733b4d32 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] 10.222.0.11 "GET /compute/v2.1/servers/5ddbfaaa-fabf-4324-941c-8868625ffefc" status: 200 len: 1226 microversion: 2.1 time: 0.081304 Nov 17 03:34:28.383983 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 906/1837] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:34:28 2021] GET /compute/v2.1/servers/5ddbfaaa-fabf-4324-941c-8868625ffefc => generated 1226 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:34:28.649856 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-0adec8bb-3dd6-4c1b-b3e2-c4f71687879d tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:34:28.650331 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-c25c74d7-ab65-48d5-963b-b528dfa9ee72 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:34:28.650797 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-0adec8bb-3dd6-4c1b-b3e2-c4f71687879d tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] [instance: 0698dc5b-5f47-46c4-ace8-f5e891a964a0] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:34:28.651305 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-c25c74d7-ab65-48d5-963b-b528dfa9ee72 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] [instance: 5d54db85-b991-4890-abaa-952413baa2e7] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:34:28.659960 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-0adec8bb-3dd6-4c1b-b3e2-c4f71687879d tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:34:28.660456 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-0adec8bb-3dd6-4c1b-b3e2-c4f71687879d tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:34:28.660589 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-c25c74d7-ab65-48d5-963b-b528dfa9ee72 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:34:28.661717 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-0adec8bb-3dd6-4c1b-b3e2-c4f71687879d tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:34:28.662127 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-0adec8bb-3dd6-4c1b-b3e2-c4f71687879d tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:34:28.662302 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-c25c74d7-ab65-48d5-963b-b528dfa9ee72 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:34:28.662940 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-c25c74d7-ab65-48d5-963b-b528dfa9ee72 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:34:28.663375 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-c25c74d7-ab65-48d5-963b-b528dfa9ee72 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:34:28.701109 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-c25c74d7-ab65-48d5-963b-b528dfa9ee72 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] 10.222.0.11 "GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.056129 Nov 17 03:34:28.701886 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 932/1838] 10.222.0.11 () {60 vars in 1342 bytes} [Wed Nov 17 03:34:28 2021] GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7/os-volume_attachments => generated 197 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 17 03:34:28.805542 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-0adec8bb-3dd6-4c1b-b3e2-c4f71687879d tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '163b2f24a72649ac8084be1cac32fa09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e123e9b86124c93a7fc2db9984e7466', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:34:28.814078 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-0adec8bb-3dd6-4c1b-b3e2-c4f71687879d tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] 10.222.0.11 "GET /compute/v2.1/servers/0698dc5b-5f47-46c4-ace8-f5e891a964a0" status: 200 len: 1565 microversion: 2.1 time: 0.168979 Nov 17 03:34:28.814634 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 907/1839] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:34:28 2021] GET /compute/v2.1/servers/0698dc5b-5f47-46c4-ace8-f5e891a964a0 => generated 1565 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:34:28.977576 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-227ef342-f368-40c4-8fd8-933541b90156 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:34:28.978368 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-227ef342-f368-40c4-8fd8-933541b90156 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] [instance: a49437df-3059-4528-8328-2f3471d5fb45] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:34:28.985309 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-227ef342-f368-40c4-8fd8-933541b90156 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:34:28.985756 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-227ef342-f368-40c4-8fd8-933541b90156 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:34:28.986586 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-227ef342-f368-40c4-8fd8-933541b90156 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:34:28.987010 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-227ef342-f368-40c4-8fd8-933541b90156 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:34:29.021898 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-227ef342-f368-40c4-8fd8-933541b90156 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] 10.222.0.11 "GET /compute/v2.1/servers/a49437df-3059-4528-8328-2f3471d5fb45/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048058 Nov 17 03:34:29.022751 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 933/1840] 10.222.0.11 () {58 vars in 1301 bytes} [Wed Nov 17 03:34:28 2021] GET /compute/v2.1/servers/a49437df-3059-4528-8328-2f3471d5fb45/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 17 03:34:29.400133 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-de10dfa1-f618-4ada-aa78-3b3e467e82a8 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:34:29.400799 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-de10dfa1-f618-4ada-aa78-3b3e467e82a8 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] [instance: 5ddbfaaa-fabf-4324-941c-8868625ffefc] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:34:29.407382 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-de10dfa1-f618-4ada-aa78-3b3e467e82a8 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:34:29.407822 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-de10dfa1-f618-4ada-aa78-3b3e467e82a8 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:34:29.408600 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-de10dfa1-f618-4ada-aa78-3b3e467e82a8 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:34:29.409063 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-de10dfa1-f618-4ada-aa78-3b3e467e82a8 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:34:29.487109 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-de10dfa1-f618-4ada-aa78-3b3e467e82a8 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80763e09d44c475ea2425b22874e9612', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fef02a1dd77946a2ac0e0414b557435f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:34:29.490459 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-de10dfa1-f618-4ada-aa78-3b3e467e82a8 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] 10.222.0.11 "GET /compute/v2.1/servers/5ddbfaaa-fabf-4324-941c-8868625ffefc" status: 200 len: 1226 microversion: 2.1 time: 0.094163 Nov 17 03:34:29.491018 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 908/1841] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:34:29 2021] GET /compute/v2.1/servers/5ddbfaaa-fabf-4324-941c-8868625ffefc => generated 1226 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:34:29.713528 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-26df3ea2-9539-44da-8daf-7cdaea52399a tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:34:29.714346 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-26df3ea2-9539-44da-8daf-7cdaea52399a tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] [instance: 5d54db85-b991-4890-abaa-952413baa2e7] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:34:29.721493 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-26df3ea2-9539-44da-8daf-7cdaea52399a tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:34:29.722186 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-26df3ea2-9539-44da-8daf-7cdaea52399a tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:34:29.722971 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-26df3ea2-9539-44da-8daf-7cdaea52399a tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:34:29.723407 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-26df3ea2-9539-44da-8daf-7cdaea52399a tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:34:29.753024 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-26df3ea2-9539-44da-8daf-7cdaea52399a tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] 10.222.0.11 "GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043478 Nov 17 03:34:29.753616 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 934/1842] 10.222.0.11 () {60 vars in 1342 bytes} [Wed Nov 17 03:34:29 2021] GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 17 03:34:29.835842 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-a5ae91cb-a9a6-4e52-b828-598dbaa958d0 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:34:29.836456 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-a5ae91cb-a9a6-4e52-b828-598dbaa958d0 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] [instance: 0698dc5b-5f47-46c4-ace8-f5e891a964a0] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:34:29.843405 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-a5ae91cb-a9a6-4e52-b828-598dbaa958d0 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:34:29.843929 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-a5ae91cb-a9a6-4e52-b828-598dbaa958d0 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:34:29.844752 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-a5ae91cb-a9a6-4e52-b828-598dbaa958d0 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:34:29.845312 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-a5ae91cb-a9a6-4e52-b828-598dbaa958d0 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:34:29.983705 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-a5ae91cb-a9a6-4e52-b828-598dbaa958d0 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '163b2f24a72649ac8084be1cac32fa09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e123e9b86124c93a7fc2db9984e7466', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:34:29.995000 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-a5ae91cb-a9a6-4e52-b828-598dbaa958d0 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] 10.222.0.11 "GET /compute/v2.1/servers/0698dc5b-5f47-46c4-ace8-f5e891a964a0" status: 200 len: 1565 microversion: 2.1 time: 0.162646 Nov 17 03:34:29.995673 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 909/1843] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:34:29 2021] GET /compute/v2.1/servers/0698dc5b-5f47-46c4-ace8-f5e891a964a0 => generated 1565 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:34:30.035596 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-e9691027-bdd2-455e-8611-3cb6d82f28e8 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:34:30.036556 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-e9691027-bdd2-455e-8611-3cb6d82f28e8 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] [instance: a49437df-3059-4528-8328-2f3471d5fb45] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:34:30.042606 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-e9691027-bdd2-455e-8611-3cb6d82f28e8 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:34:30.043039 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-e9691027-bdd2-455e-8611-3cb6d82f28e8 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:34:30.043816 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-e9691027-bdd2-455e-8611-3cb6d82f28e8 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:34:30.044257 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-e9691027-bdd2-455e-8611-3cb6d82f28e8 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:34:30.075061 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-e9691027-bdd2-455e-8611-3cb6d82f28e8 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] 10.222.0.11 "GET /compute/v2.1/servers/a49437df-3059-4528-8328-2f3471d5fb45/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043328 Nov 17 03:34:30.075624 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 935/1844] 10.222.0.11 () {58 vars in 1301 bytes} [Wed Nov 17 03:34:30 2021] GET /compute/v2.1/servers/a49437df-3059-4528-8328-2f3471d5fb45/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 17 03:34:30.508159 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-94f7ce4d-3d44-4b96-a6ab-5b1c9c4bb13a tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:34:30.508770 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-94f7ce4d-3d44-4b96-a6ab-5b1c9c4bb13a tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] [instance: 5ddbfaaa-fabf-4324-941c-8868625ffefc] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:34:30.515159 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-94f7ce4d-3d44-4b96-a6ab-5b1c9c4bb13a tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:34:30.515601 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-94f7ce4d-3d44-4b96-a6ab-5b1c9c4bb13a tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:34:30.516359 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-94f7ce4d-3d44-4b96-a6ab-5b1c9c4bb13a tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:34:30.516800 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-94f7ce4d-3d44-4b96-a6ab-5b1c9c4bb13a tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:34:30.576532 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-94f7ce4d-3d44-4b96-a6ab-5b1c9c4bb13a tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80763e09d44c475ea2425b22874e9612', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fef02a1dd77946a2ac0e0414b557435f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:34:30.584484 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-94f7ce4d-3d44-4b96-a6ab-5b1c9c4bb13a tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] 10.222.0.11 "GET /compute/v2.1/servers/5ddbfaaa-fabf-4324-941c-8868625ffefc" status: 200 len: 1226 microversion: 2.1 time: 0.080201 Nov 17 03:34:30.585091 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 910/1845] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:34:30 2021] GET /compute/v2.1/servers/5ddbfaaa-fabf-4324-941c-8868625ffefc => generated 1226 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:34:30.770708 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-80d5f107-2659-473b-9f17-3e52d5acf9b7 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:34:30.771512 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-80d5f107-2659-473b-9f17-3e52d5acf9b7 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] [instance: 5d54db85-b991-4890-abaa-952413baa2e7] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:34:30.778741 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-80d5f107-2659-473b-9f17-3e52d5acf9b7 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:34:30.779183 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-80d5f107-2659-473b-9f17-3e52d5acf9b7 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:34:30.779954 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-80d5f107-2659-473b-9f17-3e52d5acf9b7 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:34:30.780382 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-80d5f107-2659-473b-9f17-3e52d5acf9b7 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:34:30.810984 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-80d5f107-2659-473b-9f17-3e52d5acf9b7 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] 10.222.0.11 "GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046389 Nov 17 03:34:30.811547 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 936/1846] 10.222.0.11 () {60 vars in 1342 bytes} [Wed Nov 17 03:34:30 2021] GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 17 03:34:31.015992 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-dc526778-9f88-4deb-b9ef-1e49a95029ef tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:34:31.017103 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-dc526778-9f88-4deb-b9ef-1e49a95029ef tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] [instance: 0698dc5b-5f47-46c4-ace8-f5e891a964a0] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:34:31.024505 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-dc526778-9f88-4deb-b9ef-1e49a95029ef tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:34:31.024922 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-dc526778-9f88-4deb-b9ef-1e49a95029ef tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:34:31.025709 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-dc526778-9f88-4deb-b9ef-1e49a95029ef tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:34:31.026139 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-dc526778-9f88-4deb-b9ef-1e49a95029ef tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:34:31.086482 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-14c01780-20ae-43f6-8f21-f282b705b3ef tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:34:31.087386 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-14c01780-20ae-43f6-8f21-f282b705b3ef tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] [instance: a49437df-3059-4528-8328-2f3471d5fb45] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:34:31.093608 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-14c01780-20ae-43f6-8f21-f282b705b3ef tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:34:31.094055 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-14c01780-20ae-43f6-8f21-f282b705b3ef tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:34:31.094837 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-14c01780-20ae-43f6-8f21-f282b705b3ef tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:34:31.095263 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-14c01780-20ae-43f6-8f21-f282b705b3ef tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:34:31.125991 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-14c01780-20ae-43f6-8f21-f282b705b3ef tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] 10.222.0.11 "GET /compute/v2.1/servers/a49437df-3059-4528-8328-2f3471d5fb45/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043280 Nov 17 03:34:31.126562 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 937/1847] 10.222.0.11 () {58 vars in 1301 bytes} [Wed Nov 17 03:34:31 2021] GET /compute/v2.1/servers/a49437df-3059-4528-8328-2f3471d5fb45/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 17 03:34:31.173419 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-dc526778-9f88-4deb-b9ef-1e49a95029ef tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '163b2f24a72649ac8084be1cac32fa09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e123e9b86124c93a7fc2db9984e7466', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:34:31.183221 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-dc526778-9f88-4deb-b9ef-1e49a95029ef tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] 10.222.0.11 "GET /compute/v2.1/servers/0698dc5b-5f47-46c4-ace8-f5e891a964a0" status: 200 len: 1565 microversion: 2.1 time: 0.173404 Nov 17 03:34:31.183795 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 911/1848] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:34:31 2021] GET /compute/v2.1/servers/0698dc5b-5f47-46c4-ace8-f5e891a964a0 => generated 1565 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:34:31.605651 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-ebcf39e1-9982-4343-9463-98ac5a54290b tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:34:31.606647 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-ebcf39e1-9982-4343-9463-98ac5a54290b tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] [instance: 5ddbfaaa-fabf-4324-941c-8868625ffefc] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:34:31.615441 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-ebcf39e1-9982-4343-9463-98ac5a54290b tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:34:31.615883 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-ebcf39e1-9982-4343-9463-98ac5a54290b tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:34:31.616649 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-ebcf39e1-9982-4343-9463-98ac5a54290b tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:34:31.617104 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-ebcf39e1-9982-4343-9463-98ac5a54290b tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:34:31.687132 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-ebcf39e1-9982-4343-9463-98ac5a54290b tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80763e09d44c475ea2425b22874e9612', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fef02a1dd77946a2ac0e0414b557435f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:34:31.695125 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-ebcf39e1-9982-4343-9463-98ac5a54290b tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] 10.222.0.11 "GET /compute/v2.1/servers/5ddbfaaa-fabf-4324-941c-8868625ffefc" status: 200 len: 1226 microversion: 2.1 time: 0.096009 Nov 17 03:34:31.695706 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 938/1849] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:34:31 2021] GET /compute/v2.1/servers/5ddbfaaa-fabf-4324-941c-8868625ffefc => generated 1226 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:34:31.826538 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-f1a3bc7e-5fd4-4962-be5e-911ce666e88f tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:34:31.827487 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-f1a3bc7e-5fd4-4962-be5e-911ce666e88f tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] [instance: 5d54db85-b991-4890-abaa-952413baa2e7] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:34:31.834150 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-f1a3bc7e-5fd4-4962-be5e-911ce666e88f tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:34:31.834599 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-f1a3bc7e-5fd4-4962-be5e-911ce666e88f tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:34:31.835381 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-f1a3bc7e-5fd4-4962-be5e-911ce666e88f tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:34:31.835819 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-f1a3bc7e-5fd4-4962-be5e-911ce666e88f tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:34:31.865329 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-f1a3bc7e-5fd4-4962-be5e-911ce666e88f tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] 10.222.0.11 "GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042591 Nov 17 03:34:31.866011 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 912/1850] 10.222.0.11 () {60 vars in 1342 bytes} [Wed Nov 17 03:34:31 2021] GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 17 03:34:32.142201 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-e1b95274-9333-44dc-9c33-bb5442f306c3 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:34:32.143576 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-e1b95274-9333-44dc-9c33-bb5442f306c3 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] [instance: a49437df-3059-4528-8328-2f3471d5fb45] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:34:32.154315 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-e1b95274-9333-44dc-9c33-bb5442f306c3 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:34:32.155125 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-e1b95274-9333-44dc-9c33-bb5442f306c3 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:34:32.156400 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-e1b95274-9333-44dc-9c33-bb5442f306c3 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:34:32.158016 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-e1b95274-9333-44dc-9c33-bb5442f306c3 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:34:32.190069 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-e1b95274-9333-44dc-9c33-bb5442f306c3 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] 10.222.0.11 "GET /compute/v2.1/servers/a49437df-3059-4528-8328-2f3471d5fb45/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.054377 Nov 17 03:34:32.191174 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 939/1851] 10.222.0.11 () {58 vars in 1301 bytes} [Wed Nov 17 03:34:32 2021] GET /compute/v2.1/servers/a49437df-3059-4528-8328-2f3471d5fb45/os-volume_attachments => generated 197 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 17 03:34:32.201066 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-d150fead-5cb0-4db8-b647-02d5f1ec217d tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:34:32.201675 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-d150fead-5cb0-4db8-b647-02d5f1ec217d tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] [instance: 0698dc5b-5f47-46c4-ace8-f5e891a964a0] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:34:32.209143 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-d150fead-5cb0-4db8-b647-02d5f1ec217d tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:34:32.209598 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-d150fead-5cb0-4db8-b647-02d5f1ec217d tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:34:32.210382 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-d150fead-5cb0-4db8-b647-02d5f1ec217d tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:34:32.210799 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-d150fead-5cb0-4db8-b647-02d5f1ec217d tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:34:32.362837 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-d150fead-5cb0-4db8-b647-02d5f1ec217d tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '163b2f24a72649ac8084be1cac32fa09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e123e9b86124c93a7fc2db9984e7466', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:34:32.370313 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-d150fead-5cb0-4db8-b647-02d5f1ec217d tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] 10.222.0.11 "GET /compute/v2.1/servers/0698dc5b-5f47-46c4-ace8-f5e891a964a0" status: 200 len: 1565 microversion: 2.1 time: 0.172933 Nov 17 03:34:32.370884 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 913/1852] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:34:32 2021] GET /compute/v2.1/servers/0698dc5b-5f47-46c4-ace8-f5e891a964a0 => generated 1565 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:34:32.716022 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-6566dd2a-3c15-40bd-a610-2aa7cdf58786 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:34:32.717102 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-6566dd2a-3c15-40bd-a610-2aa7cdf58786 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] [instance: 5ddbfaaa-fabf-4324-941c-8868625ffefc] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:34:32.725424 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-6566dd2a-3c15-40bd-a610-2aa7cdf58786 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:34:32.725875 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-6566dd2a-3c15-40bd-a610-2aa7cdf58786 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:34:32.726657 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-6566dd2a-3c15-40bd-a610-2aa7cdf58786 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:34:32.727096 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-6566dd2a-3c15-40bd-a610-2aa7cdf58786 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:34:32.787160 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-6566dd2a-3c15-40bd-a610-2aa7cdf58786 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80763e09d44c475ea2425b22874e9612', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fef02a1dd77946a2ac0e0414b557435f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:34:32.795092 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-6566dd2a-3c15-40bd-a610-2aa7cdf58786 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] 10.222.0.11 "GET /compute/v2.1/servers/5ddbfaaa-fabf-4324-941c-8868625ffefc" status: 200 len: 1226 microversion: 2.1 time: 0.085256 Nov 17 03:34:32.795665 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 940/1853] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:34:32 2021] GET /compute/v2.1/servers/5ddbfaaa-fabf-4324-941c-8868625ffefc => generated 1226 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:34:32.880498 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-7fdcaf72-75c9-4f11-95b6-ac64d0d22014 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:34:32.881659 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-7fdcaf72-75c9-4f11-95b6-ac64d0d22014 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] [instance: 5d54db85-b991-4890-abaa-952413baa2e7] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:34:32.888357 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-7fdcaf72-75c9-4f11-95b6-ac64d0d22014 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:34:32.888807 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-7fdcaf72-75c9-4f11-95b6-ac64d0d22014 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:34:32.889593 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-7fdcaf72-75c9-4f11-95b6-ac64d0d22014 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:34:32.890204 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-7fdcaf72-75c9-4f11-95b6-ac64d0d22014 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:34:32.921187 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-7fdcaf72-75c9-4f11-95b6-ac64d0d22014 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] 10.222.0.11 "GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045495 Nov 17 03:34:32.921768 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 914/1854] 10.222.0.11 () {60 vars in 1342 bytes} [Wed Nov 17 03:34:32 2021] GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 17 03:34:33.203065 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-ac6de7fd-2306-4b3f-9d64-652a91e1e698 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:34:33.204108 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-ac6de7fd-2306-4b3f-9d64-652a91e1e698 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] [instance: a49437df-3059-4528-8328-2f3471d5fb45] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:34:33.211911 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-ac6de7fd-2306-4b3f-9d64-652a91e1e698 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:34:33.212364 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-ac6de7fd-2306-4b3f-9d64-652a91e1e698 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:34:33.213173 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-ac6de7fd-2306-4b3f-9d64-652a91e1e698 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:34:33.213605 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-ac6de7fd-2306-4b3f-9d64-652a91e1e698 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:34:33.245589 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-ac6de7fd-2306-4b3f-9d64-652a91e1e698 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] 10.222.0.11 "GET /compute/v2.1/servers/a49437df-3059-4528-8328-2f3471d5fb45/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046782 Nov 17 03:34:33.246143 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 941/1855] 10.222.0.11 () {58 vars in 1301 bytes} [Wed Nov 17 03:34:33 2021] GET /compute/v2.1/servers/a49437df-3059-4528-8328-2f3471d5fb45/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 17 03:34:33.390687 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-fe5478d8-29b5-4a15-ae78-7a02a8d6e961 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:34:33.391394 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-fe5478d8-29b5-4a15-ae78-7a02a8d6e961 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] [instance: 0698dc5b-5f47-46c4-ace8-f5e891a964a0] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:34:33.401823 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-fe5478d8-29b5-4a15-ae78-7a02a8d6e961 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:34:33.402499 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-fe5478d8-29b5-4a15-ae78-7a02a8d6e961 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:34:33.403706 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-fe5478d8-29b5-4a15-ae78-7a02a8d6e961 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:34:33.404244 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-fe5478d8-29b5-4a15-ae78-7a02a8d6e961 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:34:33.541153 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-fe5478d8-29b5-4a15-ae78-7a02a8d6e961 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '163b2f24a72649ac8084be1cac32fa09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e123e9b86124c93a7fc2db9984e7466', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:34:33.549345 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-fe5478d8-29b5-4a15-ae78-7a02a8d6e961 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] 10.222.0.11 "GET /compute/v2.1/servers/0698dc5b-5f47-46c4-ace8-f5e891a964a0" status: 200 len: 1565 microversion: 2.1 time: 0.164752 Nov 17 03:34:33.550077 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 915/1856] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:34:33 2021] GET /compute/v2.1/servers/0698dc5b-5f47-46c4-ace8-f5e891a964a0 => generated 1565 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:34:33.813199 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-080275de-10af-4d43-83ef-8b0f9c52c1c4 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:34:33.813915 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-080275de-10af-4d43-83ef-8b0f9c52c1c4 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] [instance: 5ddbfaaa-fabf-4324-941c-8868625ffefc] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:34:33.821528 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-080275de-10af-4d43-83ef-8b0f9c52c1c4 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:34:33.822058 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-080275de-10af-4d43-83ef-8b0f9c52c1c4 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:34:33.822999 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-080275de-10af-4d43-83ef-8b0f9c52c1c4 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:34:33.823504 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-080275de-10af-4d43-83ef-8b0f9c52c1c4 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:34:33.885512 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-080275de-10af-4d43-83ef-8b0f9c52c1c4 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80763e09d44c475ea2425b22874e9612', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fef02a1dd77946a2ac0e0414b557435f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:34:33.894286 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-080275de-10af-4d43-83ef-8b0f9c52c1c4 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] 10.222.0.11 "GET /compute/v2.1/servers/5ddbfaaa-fabf-4324-941c-8868625ffefc" status: 200 len: 1226 microversion: 2.1 time: 0.085566 Nov 17 03:34:33.894831 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 942/1857] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:34:33 2021] GET /compute/v2.1/servers/5ddbfaaa-fabf-4324-941c-8868625ffefc => generated 1226 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:34:33.935522 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-67439c10-465d-45b3-bfb8-8cb11a24f414 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:34:33.936421 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-67439c10-465d-45b3-bfb8-8cb11a24f414 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] [instance: 5d54db85-b991-4890-abaa-952413baa2e7] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:34:33.943372 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-67439c10-465d-45b3-bfb8-8cb11a24f414 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:34:33.943818 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-67439c10-465d-45b3-bfb8-8cb11a24f414 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:34:33.944578 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-67439c10-465d-45b3-bfb8-8cb11a24f414 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:34:33.945037 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-67439c10-465d-45b3-bfb8-8cb11a24f414 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:34:33.975663 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-67439c10-465d-45b3-bfb8-8cb11a24f414 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] 10.222.0.11 "GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043947 Nov 17 03:34:33.976201 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 916/1858] 10.222.0.11 () {60 vars in 1342 bytes} [Wed Nov 17 03:34:33 2021] GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 17 03:34:34.261636 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-5e021a01-f5dd-4627-8120-bd51f49f22c6 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:34:34.263126 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-5e021a01-f5dd-4627-8120-bd51f49f22c6 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] [instance: a49437df-3059-4528-8328-2f3471d5fb45] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:34:34.274144 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-5e021a01-f5dd-4627-8120-bd51f49f22c6 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:34:34.274928 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-5e021a01-f5dd-4627-8120-bd51f49f22c6 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:34:34.276173 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-5e021a01-f5dd-4627-8120-bd51f49f22c6 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:34:34.276912 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-5e021a01-f5dd-4627-8120-bd51f49f22c6 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:34:34.324292 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-5e021a01-f5dd-4627-8120-bd51f49f22c6 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] 10.222.0.11 "GET /compute/v2.1/servers/a49437df-3059-4528-8328-2f3471d5fb45/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.068612 Nov 17 03:34:34.324936 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 943/1859] 10.222.0.11 () {58 vars in 1301 bytes} [Wed Nov 17 03:34:34 2021] GET /compute/v2.1/servers/a49437df-3059-4528-8328-2f3471d5fb45/os-volume_attachments => generated 197 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 17 03:34:34.572121 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-577ccb58-969a-4bcb-937c-8a5ac218db0d tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:34:34.573215 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-577ccb58-969a-4bcb-937c-8a5ac218db0d tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] [instance: 0698dc5b-5f47-46c4-ace8-f5e891a964a0] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:34:34.583354 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-577ccb58-969a-4bcb-937c-8a5ac218db0d tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:34:34.583733 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-577ccb58-969a-4bcb-937c-8a5ac218db0d tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:34:34.584506 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-577ccb58-969a-4bcb-937c-8a5ac218db0d tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:34:34.584976 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-577ccb58-969a-4bcb-937c-8a5ac218db0d tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:34:34.736931 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-577ccb58-969a-4bcb-937c-8a5ac218db0d tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '163b2f24a72649ac8084be1cac32fa09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e123e9b86124c93a7fc2db9984e7466', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:34:34.745207 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-577ccb58-969a-4bcb-937c-8a5ac218db0d tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] 10.222.0.11 "GET /compute/v2.1/servers/0698dc5b-5f47-46c4-ace8-f5e891a964a0" status: 200 len: 1565 microversion: 2.1 time: 0.180053 Nov 17 03:34:34.745766 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 917/1860] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:34:34 2021] GET /compute/v2.1/servers/0698dc5b-5f47-46c4-ace8-f5e891a964a0 => generated 1565 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:34:34.916020 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-5bc24158-aae9-4bec-8e80-39b502f4695a tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:34:34.916943 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-5bc24158-aae9-4bec-8e80-39b502f4695a tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] [instance: 5ddbfaaa-fabf-4324-941c-8868625ffefc] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:34:34.927479 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-5bc24158-aae9-4bec-8e80-39b502f4695a tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:34:34.928285 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-5bc24158-aae9-4bec-8e80-39b502f4695a tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:34:34.929999 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-5bc24158-aae9-4bec-8e80-39b502f4695a tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:34:34.931153 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-5bc24158-aae9-4bec-8e80-39b502f4695a tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:34:34.986720 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-423e55ea-e468-4c95-98e2-1a8d60752c58 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:34:34.988048 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-423e55ea-e468-4c95-98e2-1a8d60752c58 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] [instance: 5d54db85-b991-4890-abaa-952413baa2e7] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:34:34.994981 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-423e55ea-e468-4c95-98e2-1a8d60752c58 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:34:34.995194 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-5bc24158-aae9-4bec-8e80-39b502f4695a tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80763e09d44c475ea2425b22874e9612', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fef02a1dd77946a2ac0e0414b557435f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:34:34.995433 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-423e55ea-e468-4c95-98e2-1a8d60752c58 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:34:34.996216 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-423e55ea-e468-4c95-98e2-1a8d60752c58 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:34:34.996648 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-423e55ea-e468-4c95-98e2-1a8d60752c58 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:34:35.004175 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-5bc24158-aae9-4bec-8e80-39b502f4695a tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] 10.222.0.11 "GET /compute/v2.1/servers/5ddbfaaa-fabf-4324-941c-8868625ffefc" status: 200 len: 1226 microversion: 2.1 time: 0.095225 Nov 17 03:34:35.004739 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 944/1861] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:34:34 2021] GET /compute/v2.1/servers/5ddbfaaa-fabf-4324-941c-8868625ffefc => generated 1226 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:34:35.028006 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-423e55ea-e468-4c95-98e2-1a8d60752c58 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] 10.222.0.11 "GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045145 Nov 17 03:34:35.028893 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 918/1862] 10.222.0.11 () {60 vars in 1342 bytes} [Wed Nov 17 03:34:34 2021] GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 17 03:34:35.341479 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-4afb4745-2a74-480a-8ea6-1281c9be87ce tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:34:35.342956 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-4afb4745-2a74-480a-8ea6-1281c9be87ce tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] [instance: a49437df-3059-4528-8328-2f3471d5fb45] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:34:35.353728 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-4afb4745-2a74-480a-8ea6-1281c9be87ce tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:34:35.354446 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-4afb4745-2a74-480a-8ea6-1281c9be87ce tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:34:35.355717 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-4afb4745-2a74-480a-8ea6-1281c9be87ce tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:34:35.356431 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-4afb4745-2a74-480a-8ea6-1281c9be87ce tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:34:35.387800 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-4afb4745-2a74-480a-8ea6-1281c9be87ce tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] 10.222.0.11 "GET /compute/v2.1/servers/a49437df-3059-4528-8328-2f3471d5fb45/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052874 Nov 17 03:34:35.388321 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 945/1863] 10.222.0.11 () {58 vars in 1301 bytes} [Wed Nov 17 03:34:35 2021] GET /compute/v2.1/servers/a49437df-3059-4528-8328-2f3471d5fb45/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 17 03:34:35.766586 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-e2b3450a-d120-4993-ab6f-e555c9a0fa05 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:34:35.767582 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-e2b3450a-d120-4993-ab6f-e555c9a0fa05 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] [instance: 0698dc5b-5f47-46c4-ace8-f5e891a964a0] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:34:35.779024 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-e2b3450a-d120-4993-ab6f-e555c9a0fa05 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:34:35.779755 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-e2b3450a-d120-4993-ab6f-e555c9a0fa05 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:34:35.780690 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-e2b3450a-d120-4993-ab6f-e555c9a0fa05 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:34:35.781485 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-e2b3450a-d120-4993-ab6f-e555c9a0fa05 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:34:35.920482 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-e2b3450a-d120-4993-ab6f-e555c9a0fa05 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '163b2f24a72649ac8084be1cac32fa09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e123e9b86124c93a7fc2db9984e7466', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:34:35.932686 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-e2b3450a-d120-4993-ab6f-e555c9a0fa05 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] 10.222.0.11 "GET /compute/v2.1/servers/0698dc5b-5f47-46c4-ace8-f5e891a964a0" status: 200 len: 1565 microversion: 2.1 time: 0.172069 Nov 17 03:34:35.933443 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 919/1864] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:34:35 2021] GET /compute/v2.1/servers/0698dc5b-5f47-46c4-ace8-f5e891a964a0 => generated 1565 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:34:36.024187 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-4b71e7d7-3b43-404b-be3c-31bb41116eec tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:34:36.024850 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-4b71e7d7-3b43-404b-be3c-31bb41116eec tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] [instance: 5ddbfaaa-fabf-4324-941c-8868625ffefc] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:34:36.032543 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-4b71e7d7-3b43-404b-be3c-31bb41116eec tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:34:36.033145 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-4b71e7d7-3b43-404b-be3c-31bb41116eec tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:34:36.034098 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-4b71e7d7-3b43-404b-be3c-31bb41116eec tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:34:36.034739 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-4b71e7d7-3b43-404b-be3c-31bb41116eec tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:34:36.041627 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-e8012d37-f9c6-4d7d-9c35-8dc1713ba9aa tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:34:36.042751 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-e8012d37-f9c6-4d7d-9c35-8dc1713ba9aa tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] [instance: 5d54db85-b991-4890-abaa-952413baa2e7] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:34:36.050329 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-e8012d37-f9c6-4d7d-9c35-8dc1713ba9aa tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:34:36.050898 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-e8012d37-f9c6-4d7d-9c35-8dc1713ba9aa tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:34:36.052489 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-e8012d37-f9c6-4d7d-9c35-8dc1713ba9aa tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:34:36.053010 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-e8012d37-f9c6-4d7d-9c35-8dc1713ba9aa tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:34:36.086987 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-e8012d37-f9c6-4d7d-9c35-8dc1713ba9aa tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] 10.222.0.11 "GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.050754 Nov 17 03:34:36.087558 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 920/1865] 10.222.0.11 () {60 vars in 1342 bytes} [Wed Nov 17 03:34:36 2021] GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 17 03:34:36.098043 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-4b71e7d7-3b43-404b-be3c-31bb41116eec tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80763e09d44c475ea2425b22874e9612', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fef02a1dd77946a2ac0e0414b557435f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:34:36.105828 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-4b71e7d7-3b43-404b-be3c-31bb41116eec tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] 10.222.0.11 "GET /compute/v2.1/servers/5ddbfaaa-fabf-4324-941c-8868625ffefc" status: 200 len: 1226 microversion: 2.1 time: 0.087464 Nov 17 03:34:36.106355 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 946/1866] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:34:36 2021] GET /compute/v2.1/servers/5ddbfaaa-fabf-4324-941c-8868625ffefc => generated 1226 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:34:36.404081 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-b788d2aa-f178-44c9-9924-61fe99186caa tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:34:36.405480 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-b788d2aa-f178-44c9-9924-61fe99186caa tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] [instance: a49437df-3059-4528-8328-2f3471d5fb45] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:34:36.414365 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-b788d2aa-f178-44c9-9924-61fe99186caa tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:34:36.414818 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-b788d2aa-f178-44c9-9924-61fe99186caa tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:34:36.415609 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-b788d2aa-f178-44c9-9924-61fe99186caa tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:34:36.416034 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-b788d2aa-f178-44c9-9924-61fe99186caa tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:34:36.445736 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-b788d2aa-f178-44c9-9924-61fe99186caa tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] 10.222.0.11 "GET /compute/v2.1/servers/a49437df-3059-4528-8328-2f3471d5fb45/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048177 Nov 17 03:34:36.446290 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 921/1867] 10.222.0.11 () {58 vars in 1301 bytes} [Wed Nov 17 03:34:36 2021] GET /compute/v2.1/servers/a49437df-3059-4528-8328-2f3471d5fb45/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 17 03:34:36.871254 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-c5705283-e360-4186-b9d2-2d4aba319154 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:34:36.872352 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-c5705283-e360-4186-b9d2-2d4aba319154 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] [instance: 15abb40f-daf9-4c4b-ac9c-55f57ee7b938] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:34:36.878747 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-c5705283-e360-4186-b9d2-2d4aba319154 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:34:36.879200 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-c5705283-e360-4186-b9d2-2d4aba319154 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:34:36.879960 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-c5705283-e360-4186-b9d2-2d4aba319154 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:34:36.881079 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-c5705283-e360-4186-b9d2-2d4aba319154 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:34:36.953164 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-e57f9d4f-eceb-4d2a-88d5-4407d54d884c tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:34:36.953719 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-e57f9d4f-eceb-4d2a-88d5-4407d54d884c tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] [instance: 0698dc5b-5f47-46c4-ace8-f5e891a964a0] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:34:36.960370 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-e57f9d4f-eceb-4d2a-88d5-4407d54d884c tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:34:36.960802 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-e57f9d4f-eceb-4d2a-88d5-4407d54d884c tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:34:36.961600 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-e57f9d4f-eceb-4d2a-88d5-4407d54d884c tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:34:36.962028 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-e57f9d4f-eceb-4d2a-88d5-4407d54d884c tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:34:37.111902 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-e57f9d4f-eceb-4d2a-88d5-4407d54d884c tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '163b2f24a72649ac8084be1cac32fa09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e123e9b86124c93a7fc2db9984e7466', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:34:37.119836 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-e57f9d4f-eceb-4d2a-88d5-4407d54d884c tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] 10.222.0.11 "GET /compute/v2.1/servers/0698dc5b-5f47-46c4-ace8-f5e891a964a0" status: 200 len: 1565 microversion: 2.1 time: 0.170431 Nov 17 03:34:37.120398 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 922/1868] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:34:36 2021] GET /compute/v2.1/servers/0698dc5b-5f47-46c4-ace8-f5e891a964a0 => generated 1565 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 17 03:34:37.125001 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-d2853487-3598-4425-8c72-db14b8299656 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:34:37.125907 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-d2853487-3598-4425-8c72-db14b8299656 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] [instance: 5d54db85-b991-4890-abaa-952413baa2e7] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:34:37.132337 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-d2853487-3598-4425-8c72-db14b8299656 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:34:37.132803 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-d2853487-3598-4425-8c72-db14b8299656 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:34:37.133583 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-d2853487-3598-4425-8c72-db14b8299656 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:34:37.134018 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-d2853487-3598-4425-8c72-db14b8299656 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:34:37.164423 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-d2853487-3598-4425-8c72-db14b8299656 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] 10.222.0.11 "GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042943 Nov 17 03:34:37.165005 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 923/1869] 10.222.0.11 () {60 vars in 1342 bytes} [Wed Nov 17 03:34:37 2021] GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 17 03:34:37.169105 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-bd3fbbb6-d84b-41f2-a07c-71b60deca10c tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:34:37.169704 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-bd3fbbb6-d84b-41f2-a07c-71b60deca10c tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] [instance: 5ddbfaaa-fabf-4324-941c-8868625ffefc] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:34:37.175253 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-bd3fbbb6-d84b-41f2-a07c-71b60deca10c tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:34:37.175696 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-bd3fbbb6-d84b-41f2-a07c-71b60deca10c tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:34:37.176455 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-bd3fbbb6-d84b-41f2-a07c-71b60deca10c tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:34:37.176951 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-bd3fbbb6-d84b-41f2-a07c-71b60deca10c tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:34:37.237159 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-bd3fbbb6-d84b-41f2-a07c-71b60deca10c tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80763e09d44c475ea2425b22874e9612', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fef02a1dd77946a2ac0e0414b557435f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:34:37.248414 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-bd3fbbb6-d84b-41f2-a07c-71b60deca10c tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] 10.222.0.11 "GET /compute/v2.1/servers/5ddbfaaa-fabf-4324-941c-8868625ffefc" status: 200 len: 1226 microversion: 2.1 time: 0.082270 Nov 17 03:34:37.249167 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 924/1870] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:34:37 2021] GET /compute/v2.1/servers/5ddbfaaa-fabf-4324-941c-8868625ffefc => generated 1226 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:34:37.462334 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-168baa00-f757-4e33-aa16-8212e52be1a8 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:34:37.463290 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-168baa00-f757-4e33-aa16-8212e52be1a8 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] [instance: a49437df-3059-4528-8328-2f3471d5fb45] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:34:37.469997 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-168baa00-f757-4e33-aa16-8212e52be1a8 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:34:37.470446 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-168baa00-f757-4e33-aa16-8212e52be1a8 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:34:37.471221 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-168baa00-f757-4e33-aa16-8212e52be1a8 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:34:37.471683 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-168baa00-f757-4e33-aa16-8212e52be1a8 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:34:37.501835 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-168baa00-f757-4e33-aa16-8212e52be1a8 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] 10.222.0.11 "GET /compute/v2.1/servers/a49437df-3059-4528-8328-2f3471d5fb45/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045898 Nov 17 03:34:37.502396 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 925/1871] 10.222.0.11 () {58 vars in 1301 bytes} [Wed Nov 17 03:34:37 2021] GET /compute/v2.1/servers/a49437df-3059-4528-8328-2f3471d5fb45/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 17 03:34:37.851441 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-cf57350a-51d9-482e-bd58-f7c33b83b637 tempest-AttachVolumeTestJSON-1651611701 tempest-AttachVolumeTestJSON-1651611701-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:34:37.851933 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-cf57350a-51d9-482e-bd58-f7c33b83b637 tempest-AttachVolumeTestJSON-1651611701 tempest-AttachVolumeTestJSON-1651611701-project] [instance: 5e11ea9c-f66a-4962-b5ca-b95784624824] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:34:37.857865 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-cf57350a-51d9-482e-bd58-f7c33b83b637 tempest-AttachVolumeTestJSON-1651611701 tempest-AttachVolumeTestJSON-1651611701-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:34:37.858310 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-cf57350a-51d9-482e-bd58-f7c33b83b637 tempest-AttachVolumeTestJSON-1651611701 tempest-AttachVolumeTestJSON-1651611701-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:34:37.859072 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-cf57350a-51d9-482e-bd58-f7c33b83b637 tempest-AttachVolumeTestJSON-1651611701 tempest-AttachVolumeTestJSON-1651611701-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:34:37.859466 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-cf57350a-51d9-482e-bd58-f7c33b83b637 tempest-AttachVolumeTestJSON-1651611701 tempest-AttachVolumeTestJSON-1651611701-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:34:37.885379 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-cf57350a-51d9-482e-bd58-f7c33b83b637 tempest-AttachVolumeTestJSON-1651611701 tempest-AttachVolumeTestJSON-1651611701-project] [instance: 5e11ea9c-f66a-4962-b5ca-b95784624824] Going to try to terminate instance {{(pid=115917) delete /opt/stack/nova/nova/compute/api.py:2614}} Nov 17 03:34:37.950654 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: ERROR oslo.messaging._drivers.impl_rabbit [None req-cf57350a-51d9-482e-bd58-f7c33b83b637 tempest-AttachVolumeTestJSON-1651611701 tempest-AttachVolumeTestJSON-1651611701-project] [f0347f10-0ad6-4123-a753-d9b92ea34588] AMQP server on 10.222.0.11:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Nov 17 03:34:38.967547 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO oslo.messaging._drivers.impl_rabbit [None req-cf57350a-51d9-482e-bd58-f7c33b83b637 tempest-AttachVolumeTestJSON-1651611701 tempest-AttachVolumeTestJSON-1651611701-project] [f0347f10-0ad6-4123-a753-d9b92ea34588] Reconnected to AMQP server on 10.222.0.11:5672 via [amqp] client with port 43334. Nov 17 03:34:38.994304 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-cf57350a-51d9-482e-bd58-f7c33b83b637 tempest-AttachVolumeTestJSON-1651611701 tempest-AttachVolumeTestJSON-1651611701-project] 10.222.0.11 "DELETE /compute/v2.1/servers/5e11ea9c-f66a-4962-b5ca-b95784624824" status: 204 len: 0 microversion: 2.1 time: 1.146438 Nov 17 03:34:38.994924 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 926/1872] 10.222.0.11 () {58 vars in 1238 bytes} [Wed Nov 17 03:34:37 2021] DELETE /compute/v2.1/servers/5e11ea9c-f66a-4962-b5ca-b95784624824 => generated 0 bytes in 1148 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 17 03:34:38.999880 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-efac2695-62a6-41cc-bfd9-400c18e40600 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:34:39.000678 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-efac2695-62a6-41cc-bfd9-400c18e40600 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] [instance: 0698dc5b-5f47-46c4-ace8-f5e891a964a0] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:34:39.006626 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-efac2695-62a6-41cc-bfd9-400c18e40600 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:34:39.007081 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-efac2695-62a6-41cc-bfd9-400c18e40600 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:34:39.007863 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-efac2695-62a6-41cc-bfd9-400c18e40600 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:34:39.008303 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-efac2695-62a6-41cc-bfd9-400c18e40600 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:34:39.151267 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-efac2695-62a6-41cc-bfd9-400c18e40600 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '163b2f24a72649ac8084be1cac32fa09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e123e9b86124c93a7fc2db9984e7466', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:34:39.159019 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-efac2695-62a6-41cc-bfd9-400c18e40600 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] 10.222.0.11 "GET /compute/v2.1/servers/0698dc5b-5f47-46c4-ace8-f5e891a964a0" status: 200 len: 1565 microversion: 2.1 time: 0.162961 Nov 17 03:34:39.159583 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 927/1873] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:34:38 2021] GET /compute/v2.1/servers/0698dc5b-5f47-46c4-ace8-f5e891a964a0 => generated 1565 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:34:39.164352 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-8b23de1e-dd71-411a-a220-e5132d2748e6 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:34:39.165305 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-8b23de1e-dd71-411a-a220-e5132d2748e6 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] [instance: 5d54db85-b991-4890-abaa-952413baa2e7] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:34:39.170920 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-8b23de1e-dd71-411a-a220-e5132d2748e6 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:34:39.171367 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-8b23de1e-dd71-411a-a220-e5132d2748e6 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:34:39.172127 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-8b23de1e-dd71-411a-a220-e5132d2748e6 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:34:39.172551 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-8b23de1e-dd71-411a-a220-e5132d2748e6 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:34:39.202272 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-8b23de1e-dd71-411a-a220-e5132d2748e6 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] 10.222.0.11 "GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041692 Nov 17 03:34:39.202823 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 928/1874] 10.222.0.11 () {60 vars in 1342 bytes} [Wed Nov 17 03:34:39 2021] GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 17 03:34:39.207097 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-e2f82fcb-bdef-4df8-b085-35e57145384e tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:34:39.207689 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-e2f82fcb-bdef-4df8-b085-35e57145384e tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] [instance: 5ddbfaaa-fabf-4324-941c-8868625ffefc] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:34:39.213280 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-e2f82fcb-bdef-4df8-b085-35e57145384e tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:34:39.213715 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-e2f82fcb-bdef-4df8-b085-35e57145384e tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:34:39.214470 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-e2f82fcb-bdef-4df8-b085-35e57145384e tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:34:39.214866 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-e2f82fcb-bdef-4df8-b085-35e57145384e tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:34:39.278526 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-e2f82fcb-bdef-4df8-b085-35e57145384e tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80763e09d44c475ea2425b22874e9612', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fef02a1dd77946a2ac0e0414b557435f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:34:39.286038 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-e2f82fcb-bdef-4df8-b085-35e57145384e tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] 10.222.0.11 "GET /compute/v2.1/servers/5ddbfaaa-fabf-4324-941c-8868625ffefc" status: 200 len: 1226 microversion: 2.1 time: 0.082331 Nov 17 03:34:39.287373 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 929/1875] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:34:39 2021] GET /compute/v2.1/servers/5ddbfaaa-fabf-4324-941c-8868625ffefc => generated 1226 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:34:39.291840 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-c60bf278-458d-4815-9694-d981dd7699eb tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:34:39.292738 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-c60bf278-458d-4815-9694-d981dd7699eb tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] [instance: a49437df-3059-4528-8328-2f3471d5fb45] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:34:39.298211 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-c60bf278-458d-4815-9694-d981dd7699eb tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:34:39.298642 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-c60bf278-458d-4815-9694-d981dd7699eb tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:34:39.299425 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-c60bf278-458d-4815-9694-d981dd7699eb tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:34:39.299849 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-c60bf278-458d-4815-9694-d981dd7699eb tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:34:39.329130 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-c60bf278-458d-4815-9694-d981dd7699eb tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] 10.222.0.11 "GET /compute/v2.1/servers/a49437df-3059-4528-8328-2f3471d5fb45/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040673 Nov 17 03:34:39.329699 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 930/1876] 10.222.0.11 () {58 vars in 1301 bytes} [Wed Nov 17 03:34:39 2021] GET /compute/v2.1/servers/a49437df-3059-4528-8328-2f3471d5fb45/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 17 03:34:39.333970 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-6235f841-1125-4f0f-a30c-eaca638e03eb tempest-AttachVolumeTestJSON-1651611701 tempest-AttachVolumeTestJSON-1651611701-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:34:39.334553 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-6235f841-1125-4f0f-a30c-eaca638e03eb tempest-AttachVolumeTestJSON-1651611701 tempest-AttachVolumeTestJSON-1651611701-project] [instance: 5e11ea9c-f66a-4962-b5ca-b95784624824] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:34:39.340416 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-6235f841-1125-4f0f-a30c-eaca638e03eb tempest-AttachVolumeTestJSON-1651611701 tempest-AttachVolumeTestJSON-1651611701-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:34:39.340900 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-6235f841-1125-4f0f-a30c-eaca638e03eb tempest-AttachVolumeTestJSON-1651611701 tempest-AttachVolumeTestJSON-1651611701-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:34:39.341668 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-6235f841-1125-4f0f-a30c-eaca638e03eb tempest-AttachVolumeTestJSON-1651611701 tempest-AttachVolumeTestJSON-1651611701-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:34:39.342096 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-6235f841-1125-4f0f-a30c-eaca638e03eb tempest-AttachVolumeTestJSON-1651611701 tempest-AttachVolumeTestJSON-1651611701-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:34:39.474367 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-6235f841-1125-4f0f-a30c-eaca638e03eb tempest-AttachVolumeTestJSON-1651611701 tempest-AttachVolumeTestJSON-1651611701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1110e625f8f3451aafcdcac96d3e9ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bf44d5ada38487eb55a9f4b7d52862d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:34:39.483649 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-6235f841-1125-4f0f-a30c-eaca638e03eb tempest-AttachVolumeTestJSON-1651611701 tempest-AttachVolumeTestJSON-1651611701-project] 10.222.0.11 "GET /compute/v2.1/servers/5e11ea9c-f66a-4962-b5ca-b95784624824" status: 200 len: 1675 microversion: 2.1 time: 0.152690 Nov 17 03:34:39.484397 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 931/1877] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:34:39 2021] GET /compute/v2.1/servers/5e11ea9c-f66a-4962-b5ca-b95784624824 => generated 1675 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:34:40.175847 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-1d1b82f3-3bb5-4c4f-ad62-39ad197b8933 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:34:40.176663 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-1d1b82f3-3bb5-4c4f-ad62-39ad197b8933 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] [instance: 0698dc5b-5f47-46c4-ace8-f5e891a964a0] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:34:40.183444 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-1d1b82f3-3bb5-4c4f-ad62-39ad197b8933 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:34:40.183969 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-1d1b82f3-3bb5-4c4f-ad62-39ad197b8933 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:34:40.184841 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-1d1b82f3-3bb5-4c4f-ad62-39ad197b8933 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:34:40.185364 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-1d1b82f3-3bb5-4c4f-ad62-39ad197b8933 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:34:40.698616 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-1d1b82f3-3bb5-4c4f-ad62-39ad197b8933 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '163b2f24a72649ac8084be1cac32fa09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e123e9b86124c93a7fc2db9984e7466', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:34:40.706531 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-1d1b82f3-3bb5-4c4f-ad62-39ad197b8933 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] 10.222.0.11 "GET /compute/v2.1/servers/0698dc5b-5f47-46c4-ace8-f5e891a964a0" status: 200 len: 1565 microversion: 2.1 time: 0.534550 Nov 17 03:34:40.707198 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 932/1878] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:34:40 2021] GET /compute/v2.1/servers/0698dc5b-5f47-46c4-ace8-f5e891a964a0 => generated 1565 bytes in 536 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:34:40.711936 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-ea65cddf-95ab-431e-b081-f1c57280eda5 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:34:40.713029 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-ea65cddf-95ab-431e-b081-f1c57280eda5 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] [instance: 5d54db85-b991-4890-abaa-952413baa2e7] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:34:40.718898 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-ea65cddf-95ab-431e-b081-f1c57280eda5 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:34:40.719439 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-ea65cddf-95ab-431e-b081-f1c57280eda5 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:34:40.720395 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-ea65cddf-95ab-431e-b081-f1c57280eda5 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:34:40.720873 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-ea65cddf-95ab-431e-b081-f1c57280eda5 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:34:40.752059 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-ea65cddf-95ab-431e-b081-f1c57280eda5 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] 10.222.0.11 "GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043722 Nov 17 03:34:40.752632 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 933/1879] 10.222.0.11 () {60 vars in 1342 bytes} [Wed Nov 17 03:34:40 2021] GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 17 03:34:40.757197 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-28c39c43-0c89-4f44-9a9b-b1c35b6dd866 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:34:40.758001 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-28c39c43-0c89-4f44-9a9b-b1c35b6dd866 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] [instance: 5ddbfaaa-fabf-4324-941c-8868625ffefc] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:34:40.763913 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-28c39c43-0c89-4f44-9a9b-b1c35b6dd866 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:34:40.764362 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-28c39c43-0c89-4f44-9a9b-b1c35b6dd866 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:34:40.765168 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-28c39c43-0c89-4f44-9a9b-b1c35b6dd866 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:34:40.765599 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-28c39c43-0c89-4f44-9a9b-b1c35b6dd866 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:34:40.831276 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-28c39c43-0c89-4f44-9a9b-b1c35b6dd866 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80763e09d44c475ea2425b22874e9612', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fef02a1dd77946a2ac0e0414b557435f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:34:40.838711 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-28c39c43-0c89-4f44-9a9b-b1c35b6dd866 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] 10.222.0.11 "GET /compute/v2.1/servers/5ddbfaaa-fabf-4324-941c-8868625ffefc" status: 200 len: 1226 microversion: 2.1 time: 0.085092 Nov 17 03:34:40.839277 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 934/1880] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:34:40 2021] GET /compute/v2.1/servers/5ddbfaaa-fabf-4324-941c-8868625ffefc => generated 1226 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:34:40.843648 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-8b2ad687-967b-4d82-b675-36b1ca7f92a9 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:34:40.844661 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-8b2ad687-967b-4d82-b675-36b1ca7f92a9 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] [instance: a49437df-3059-4528-8328-2f3471d5fb45] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:34:40.851395 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-8b2ad687-967b-4d82-b675-36b1ca7f92a9 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:34:40.851841 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-8b2ad687-967b-4d82-b675-36b1ca7f92a9 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:34:40.852622 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-8b2ad687-967b-4d82-b675-36b1ca7f92a9 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:34:40.853084 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-8b2ad687-967b-4d82-b675-36b1ca7f92a9 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:34:40.885398 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-8b2ad687-967b-4d82-b675-36b1ca7f92a9 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] 10.222.0.11 "GET /compute/v2.1/servers/a49437df-3059-4528-8328-2f3471d5fb45/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044996 Nov 17 03:34:40.889446 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 935/1881] 10.222.0.11 () {58 vars in 1301 bytes} [Wed Nov 17 03:34:40 2021] GET /compute/v2.1/servers/a49437df-3059-4528-8328-2f3471d5fb45/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 17 03:34:40.890549 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-226f836e-3660-4cd7-bf4a-30b5ce4622cf tempest-AttachVolumeTestJSON-1651611701 tempest-AttachVolumeTestJSON-1651611701-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:34:40.891216 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-226f836e-3660-4cd7-bf4a-30b5ce4622cf tempest-AttachVolumeTestJSON-1651611701 tempest-AttachVolumeTestJSON-1651611701-project] [instance: 5e11ea9c-f66a-4962-b5ca-b95784624824] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:34:40.897267 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-226f836e-3660-4cd7-bf4a-30b5ce4622cf tempest-AttachVolumeTestJSON-1651611701 tempest-AttachVolumeTestJSON-1651611701-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:34:40.897786 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-226f836e-3660-4cd7-bf4a-30b5ce4622cf tempest-AttachVolumeTestJSON-1651611701 tempest-AttachVolumeTestJSON-1651611701-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:34:40.898638 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-226f836e-3660-4cd7-bf4a-30b5ce4622cf tempest-AttachVolumeTestJSON-1651611701 tempest-AttachVolumeTestJSON-1651611701-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:34:40.899139 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-226f836e-3660-4cd7-bf4a-30b5ce4622cf tempest-AttachVolumeTestJSON-1651611701 tempest-AttachVolumeTestJSON-1651611701-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:34:40.963302 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-226f836e-3660-4cd7-bf4a-30b5ce4622cf tempest-AttachVolumeTestJSON-1651611701 tempest-AttachVolumeTestJSON-1651611701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1110e625f8f3451aafcdcac96d3e9ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bf44d5ada38487eb55a9f4b7d52862d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:34:40.972953 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-226f836e-3660-4cd7-bf4a-30b5ce4622cf tempest-AttachVolumeTestJSON-1651611701 tempest-AttachVolumeTestJSON-1651611701-project] 10.222.0.11 "GET /compute/v2.1/servers/5e11ea9c-f66a-4962-b5ca-b95784624824" status: 200 len: 1607 microversion: 2.1 time: 0.085886 Nov 17 03:34:40.974254 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 936/1882] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:34:40 2021] GET /compute/v2.1/servers/5e11ea9c-f66a-4962-b5ca-b95784624824 => generated 1607 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:34:41.041279 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [req-941ab736-a5a1-4dd6-b8a9-e69506463409 req-6d51a39c-030b-4083-8a8b-d477095c3e57 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5e11ea9c-f66a-4962-b5ca-b95784624824", "name": "network-vif-deleted", "tag": "ec07edc4-f4b6-4df2-82fd-1001703384ca"}]} {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 17 03:34:41.042937 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 17 03:34:41.042937 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: warnings.warn(msg) Nov 17 03:34:41.054183 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [req-941ab736-a5a1-4dd6-b8a9-e69506463409 req-6d51a39c-030b-4083-8a8b-d477095c3e57 service nova] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:34:41.055608 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [req-941ab736-a5a1-4dd6-b8a9-e69506463409 req-6d51a39c-030b-4083-8a8b-d477095c3e57 service nova] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:34:41.073432 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.compute.server_external_events [req-941ab736-a5a1-4dd6-b8a9-e69506463409 req-6d51a39c-030b-4083-8a8b-d477095c3e57 service nova] Creating event network-vif-deleted:ec07edc4-f4b6-4df2-82fd-1001703384ca for instance 5e11ea9c-f66a-4962-b5ca-b95784624824 on hv-cinder-81803 Nov 17 03:34:41.078758 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [req-941ab736-a5a1-4dd6-b8a9-e69506463409 req-6d51a39c-030b-4083-8a8b-d477095c3e57 service nova] 10.222.0.11 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.103549 Nov 17 03:34:41.079562 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 937/1883] 10.222.0.11 () {64 vars in 1317 bytes} [Wed Nov 17 03:34:40 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 17 03:34:41.725184 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-00558edf-d6f6-49cd-a63f-7393e1ccb905 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:34:41.725867 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-00558edf-d6f6-49cd-a63f-7393e1ccb905 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] [instance: 0698dc5b-5f47-46c4-ace8-f5e891a964a0] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:34:41.732319 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-00558edf-d6f6-49cd-a63f-7393e1ccb905 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:34:41.732761 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-00558edf-d6f6-49cd-a63f-7393e1ccb905 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:34:41.733618 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-00558edf-d6f6-49cd-a63f-7393e1ccb905 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:34:41.734036 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-00558edf-d6f6-49cd-a63f-7393e1ccb905 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:34:41.878399 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-00558edf-d6f6-49cd-a63f-7393e1ccb905 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '163b2f24a72649ac8084be1cac32fa09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e123e9b86124c93a7fc2db9984e7466', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:34:41.886173 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-00558edf-d6f6-49cd-a63f-7393e1ccb905 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] 10.222.0.11 "GET /compute/v2.1/servers/0698dc5b-5f47-46c4-ace8-f5e891a964a0" status: 200 len: 1565 microversion: 2.1 time: 0.166025 Nov 17 03:34:41.886737 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 938/1884] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:34:41 2021] GET /compute/v2.1/servers/0698dc5b-5f47-46c4-ace8-f5e891a964a0 => generated 1565 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:34:41.896816 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-b70bde3e-7202-48a6-863e-f4cac24d56ec tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:34:41.897805 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-b70bde3e-7202-48a6-863e-f4cac24d56ec tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] [instance: 5d54db85-b991-4890-abaa-952413baa2e7] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:34:41.905469 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-b70bde3e-7202-48a6-863e-f4cac24d56ec tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:34:41.906021 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-b70bde3e-7202-48a6-863e-f4cac24d56ec tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:34:41.906883 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-b70bde3e-7202-48a6-863e-f4cac24d56ec tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:34:41.907390 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-b70bde3e-7202-48a6-863e-f4cac24d56ec tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:34:41.937484 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-b70bde3e-7202-48a6-863e-f4cac24d56ec tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] 10.222.0.11 "GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044305 Nov 17 03:34:41.938098 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 939/1885] 10.222.0.11 () {60 vars in 1342 bytes} [Wed Nov 17 03:34:41 2021] GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 17 03:34:41.943074 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-8962deee-ea46-428c-9386-e2118aa0a23a tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:34:41.943888 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-8962deee-ea46-428c-9386-e2118aa0a23a tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] [instance: 5ddbfaaa-fabf-4324-941c-8868625ffefc] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:34:41.949929 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-8962deee-ea46-428c-9386-e2118aa0a23a tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:34:41.950408 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-8962deee-ea46-428c-9386-e2118aa0a23a tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:34:41.951160 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-8962deee-ea46-428c-9386-e2118aa0a23a tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:34:41.951616 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-8962deee-ea46-428c-9386-e2118aa0a23a tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:34:42.011827 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-8962deee-ea46-428c-9386-e2118aa0a23a tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80763e09d44c475ea2425b22874e9612', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fef02a1dd77946a2ac0e0414b557435f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:34:42.019766 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-8962deee-ea46-428c-9386-e2118aa0a23a tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] 10.222.0.11 "GET /compute/v2.1/servers/5ddbfaaa-fabf-4324-941c-8868625ffefc" status: 200 len: 1226 microversion: 2.1 time: 0.080253 Nov 17 03:34:42.020368 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 940/1886] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:34:41 2021] GET /compute/v2.1/servers/5ddbfaaa-fabf-4324-941c-8868625ffefc => generated 1226 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:34:42.024890 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-cf9c4897-ad89-4a15-9fcf-f65b370d8ede tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 17 03:34:42.025781 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-cf9c4897-ad89-4a15-9fcf-f65b370d8ede tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] [instance: a49437df-3059-4528-8328-2f3471d5fb45] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:34:42.031414 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-cf9c4897-ad89-4a15-9fcf-f65b370d8ede tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:34:42.031846 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-cf9c4897-ad89-4a15-9fcf-f65b370d8ede tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:34:42.032603 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-cf9c4897-ad89-4a15-9fcf-f65b370d8ede tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:34:42.033057 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-cf9c4897-ad89-4a15-9fcf-f65b370d8ede tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:34:42.132033 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-cf9c4897-ad89-4a15-9fcf-f65b370d8ede tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] 10.222.0.11 "POST /compute/v2.1/servers/a49437df-3059-4528-8328-2f3471d5fb45/action" status: 200 len: 70945 microversion: 2.1 time: 0.109695 Nov 17 03:34:42.132992 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 941/1887] 10.222.0.11 () {60 vars in 1277 bytes} [Wed Nov 17 03:34:42 2021] POST /compute/v2.1/servers/a49437df-3059-4528-8328-2f3471d5fb45/action => generated 70945 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 17 03:34:42.140815 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-dd9e3bf8-1c11-49d2-a13d-a19834b8623e tempest-AttachVolumeTestJSON-1651611701 tempest-AttachVolumeTestJSON-1651611701-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:34:42.141949 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-dd9e3bf8-1c11-49d2-a13d-a19834b8623e tempest-AttachVolumeTestJSON-1651611701 tempest-AttachVolumeTestJSON-1651611701-project] [instance: 5e11ea9c-f66a-4962-b5ca-b95784624824] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:34:42.150930 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-dd9e3bf8-1c11-49d2-a13d-a19834b8623e tempest-AttachVolumeTestJSON-1651611701 tempest-AttachVolumeTestJSON-1651611701-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:34:42.151373 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-dd9e3bf8-1c11-49d2-a13d-a19834b8623e tempest-AttachVolumeTestJSON-1651611701 tempest-AttachVolumeTestJSON-1651611701-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:34:42.152143 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-dd9e3bf8-1c11-49d2-a13d-a19834b8623e tempest-AttachVolumeTestJSON-1651611701 tempest-AttachVolumeTestJSON-1651611701-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:34:42.152575 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-dd9e3bf8-1c11-49d2-a13d-a19834b8623e tempest-AttachVolumeTestJSON-1651611701 tempest-AttachVolumeTestJSON-1651611701-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:34:42.166367 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.wsgi [None req-dd9e3bf8-1c11-49d2-a13d-a19834b8623e tempest-AttachVolumeTestJSON-1651611701 tempest-AttachVolumeTestJSON-1651611701-project] HTTP exception thrown: Instance 5e11ea9c-f66a-4962-b5ca-b95784624824 could not be found. Nov 17 03:34:42.166959 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-dd9e3bf8-1c11-49d2-a13d-a19834b8623e tempest-AttachVolumeTestJSON-1651611701 tempest-AttachVolumeTestJSON-1651611701-project] Returning 404 to user: Instance 5e11ea9c-f66a-4962-b5ca-b95784624824 could not be found. {{(pid=115917) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 17 03:34:42.167763 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-dd9e3bf8-1c11-49d2-a13d-a19834b8623e tempest-AttachVolumeTestJSON-1651611701 tempest-AttachVolumeTestJSON-1651611701-project] 10.222.0.11 "GET /compute/v2.1/servers/5e11ea9c-f66a-4962-b5ca-b95784624824" status: 404 len: 111 microversion: 2.1 time: 0.033393 Nov 17 03:34:42.168278 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 942/1888] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:34:42 2021] GET /compute/v2.1/servers/5e11ea9c-f66a-4962-b5ca-b95784624824 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 17 03:34:42.176179 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-439eb1cc-c654-4e13-bda7-3b3c33b7c902 tempest-AttachVolumeTestJSON-1651611701 tempest-AttachVolumeTestJSON-1651611701-project] Calling method '.version_select at 0x7f9e1d0234c0>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:34:42.200033 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-439eb1cc-c654-4e13-bda7-3b3c33b7c902 tempest-AttachVolumeTestJSON-1651611701 tempest-AttachVolumeTestJSON-1651611701-project] 10.222.0.11 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1131711317" status: 202 len: 0 microversion: 2.1 time: 0.027120 Nov 17 03:34:42.200756 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 943/1889] 10.222.0.11 () {58 vars in 1220 bytes} [Wed Nov 17 03:34:42 2021] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1131711317 => generated 0 bytes in 28 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Nov 17 03:34:42.856971 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-ccedd19a-cad9-4d08-98db-e7a0e2428af9 tempest-AttachVolumeTestJSON-1651611701 tempest-AttachVolumeTestJSON-1651611701-project] Action: 'create', calling method: .version_select at 0x7f9e1da14f70>, body: {"keypair": {"name": "tempest-keypair-725423103"}} {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 17 03:34:42.873681 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.quota [None req-ccedd19a-cad9-4d08-98db-e7a0e2428af9 tempest-AttachVolumeTestJSON-1651611701 tempest-AttachVolumeTestJSON-1651611701-project] Getting quotas for project 2bf44d5ada38487eb55a9f4b7d52862d. Resources: {'key_pairs'} {{(pid=115917) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 17 03:34:42.877974 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.quota [None req-ccedd19a-cad9-4d08-98db-e7a0e2428af9 tempest-AttachVolumeTestJSON-1651611701 tempest-AttachVolumeTestJSON-1651611701-project] Getting quotas for user 1110e625f8f3451aafcdcac96d3e9ae8 and project 2bf44d5ada38487eb55a9f4b7d52862d. Resources: {'key_pairs'} {{(pid=115917) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 17 03:34:42.983233 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.quota [None req-ccedd19a-cad9-4d08-98db-e7a0e2428af9 tempest-AttachVolumeTestJSON-1651611701 tempest-AttachVolumeTestJSON-1651611701-project] Getting quotas for project 2bf44d5ada38487eb55a9f4b7d52862d. Resources: {'key_pairs'} {{(pid=115917) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 17 03:34:42.988876 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.quota [None req-ccedd19a-cad9-4d08-98db-e7a0e2428af9 tempest-AttachVolumeTestJSON-1651611701 tempest-AttachVolumeTestJSON-1651611701-project] Getting quotas for user 1110e625f8f3451aafcdcac96d3e9ae8 and project 2bf44d5ada38487eb55a9f4b7d52862d. Resources: {'key_pairs'} {{(pid=115917) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 17 03:34:43.003483 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-ccedd19a-cad9-4d08-98db-e7a0e2428af9 tempest-AttachVolumeTestJSON-1651611701 tempest-AttachVolumeTestJSON-1651611701-project] 10.222.0.11 "POST /compute/v2.1/os-keypairs" status: 200 len: 2300 microversion: 2.1 time: 0.150772 Nov 17 03:34:43.004133 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 944/1890] 10.222.0.11 () {60 vars in 1157 bytes} [Wed Nov 17 03:34:42 2021] POST /compute/v2.1/os-keypairs => generated 2300 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 17 03:34:43.008806 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-185f1f33-6609-47bc-b1c1-2553f3af7705 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:34:43.009491 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-185f1f33-6609-47bc-b1c1-2553f3af7705 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] [instance: 0698dc5b-5f47-46c4-ace8-f5e891a964a0] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:34:43.015384 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-185f1f33-6609-47bc-b1c1-2553f3af7705 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:34:43.015828 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-185f1f33-6609-47bc-b1c1-2553f3af7705 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:34:43.016610 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-185f1f33-6609-47bc-b1c1-2553f3af7705 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:34:43.017045 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-185f1f33-6609-47bc-b1c1-2553f3af7705 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:34:43.217537 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-185f1f33-6609-47bc-b1c1-2553f3af7705 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '163b2f24a72649ac8084be1cac32fa09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e123e9b86124c93a7fc2db9984e7466', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:34:43.225952 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-185f1f33-6609-47bc-b1c1-2553f3af7705 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] 10.222.0.11 "GET /compute/v2.1/servers/0698dc5b-5f47-46c4-ace8-f5e891a964a0" status: 200 len: 1565 microversion: 2.1 time: 0.220749 Nov 17 03:34:43.226536 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 945/1891] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:34:43 2021] GET /compute/v2.1/servers/0698dc5b-5f47-46c4-ace8-f5e891a964a0 => generated 1565 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:34:43.231250 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-483fc791-1e79-4485-8a58-301b4a7634aa tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:34:43.232159 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-483fc791-1e79-4485-8a58-301b4a7634aa tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] [instance: 5d54db85-b991-4890-abaa-952413baa2e7] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:34:43.238286 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-483fc791-1e79-4485-8a58-301b4a7634aa tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:34:43.238729 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-483fc791-1e79-4485-8a58-301b4a7634aa tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:34:43.239502 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-483fc791-1e79-4485-8a58-301b4a7634aa tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:34:43.240153 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-483fc791-1e79-4485-8a58-301b4a7634aa tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:34:43.270359 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-483fc791-1e79-4485-8a58-301b4a7634aa tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] 10.222.0.11 "GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042777 Nov 17 03:34:43.270967 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 946/1892] 10.222.0.11 () {60 vars in 1342 bytes} [Wed Nov 17 03:34:43 2021] GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 17 03:34:43.275550 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-dab0482d-3b3b-4661-8da5-dbbb261bcb08 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:34:43.276139 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-dab0482d-3b3b-4661-8da5-dbbb261bcb08 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] [instance: 5ddbfaaa-fabf-4324-941c-8868625ffefc] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:34:43.282188 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-dab0482d-3b3b-4661-8da5-dbbb261bcb08 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:34:43.282651 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-dab0482d-3b3b-4661-8da5-dbbb261bcb08 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:34:43.283458 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-dab0482d-3b3b-4661-8da5-dbbb261bcb08 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:34:43.283882 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-dab0482d-3b3b-4661-8da5-dbbb261bcb08 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:34:43.363219 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-dab0482d-3b3b-4661-8da5-dbbb261bcb08 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80763e09d44c475ea2425b22874e9612', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fef02a1dd77946a2ac0e0414b557435f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:34:43.371541 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-dab0482d-3b3b-4661-8da5-dbbb261bcb08 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] 10.222.0.11 "GET /compute/v2.1/servers/5ddbfaaa-fabf-4324-941c-8868625ffefc" status: 200 len: 1226 microversion: 2.1 time: 0.099189 Nov 17 03:34:43.372156 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 947/1893] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:34:43 2021] GET /compute/v2.1/servers/5ddbfaaa-fabf-4324-941c-8868625ffefc => generated 1226 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:34:44.248238 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-ae8ff123-f368-4310-91f2-a2a52e016137 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:34:44.248903 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-ae8ff123-f368-4310-91f2-a2a52e016137 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] [instance: 0698dc5b-5f47-46c4-ace8-f5e891a964a0] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:34:44.255695 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-ae8ff123-f368-4310-91f2-a2a52e016137 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:34:44.256190 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-ae8ff123-f368-4310-91f2-a2a52e016137 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:34:44.257124 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-ae8ff123-f368-4310-91f2-a2a52e016137 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:34:44.257585 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-ae8ff123-f368-4310-91f2-a2a52e016137 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:34:44.395235 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-ae8ff123-f368-4310-91f2-a2a52e016137 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '163b2f24a72649ac8084be1cac32fa09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e123e9b86124c93a7fc2db9984e7466', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:34:44.403117 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-ae8ff123-f368-4310-91f2-a2a52e016137 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] 10.222.0.11 "GET /compute/v2.1/servers/0698dc5b-5f47-46c4-ace8-f5e891a964a0" status: 200 len: 1565 microversion: 2.1 time: 0.163607 Nov 17 03:34:44.403713 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 948/1894] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:34:44 2021] GET /compute/v2.1/servers/0698dc5b-5f47-46c4-ace8-f5e891a964a0 => generated 1565 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:34:44.408015 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-3bd3e89a-a881-4bda-858f-60678bbfc982 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:34:44.408969 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-3bd3e89a-a881-4bda-858f-60678bbfc982 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] [instance: 5d54db85-b991-4890-abaa-952413baa2e7] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:34:44.414249 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-3bd3e89a-a881-4bda-858f-60678bbfc982 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:34:44.414691 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-3bd3e89a-a881-4bda-858f-60678bbfc982 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:34:44.415449 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-3bd3e89a-a881-4bda-858f-60678bbfc982 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:34:44.415881 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-3bd3e89a-a881-4bda-858f-60678bbfc982 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:34:44.446020 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-3bd3e89a-a881-4bda-858f-60678bbfc982 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] 10.222.0.11 "GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041312 Nov 17 03:34:44.446541 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 949/1895] 10.222.0.11 () {60 vars in 1342 bytes} [Wed Nov 17 03:34:44 2021] GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 17 03:34:44.451043 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-d1bd7da6-080e-4394-8834-012f9a48447e tempest-AttachVolumeTestJSON-1651611701 tempest-AttachVolumeTestJSON-1651611701-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1737378227", "imageRef": "7281a37a-6b99-49c1-881a-41604d06bae1", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "1e893e14-8db8-4d97-802f-0f32d0331488"}], "security_groups": [{"name": "tempest-securitygroup--1550207864"}], "key_name": "tempest-keypair-725423103", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 17 03:34:44.562104 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.network.neutron [None req-d1bd7da6-080e-4394-8834-012f9a48447e tempest-AttachVolumeTestJSON-1651611701 tempest-AttachVolumeTestJSON-1651611701-project] validate_networks() for [('1e893e14-8db8-4d97-802f-0f32d0331488', None, None, None, None, None)] {{(pid=115917) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Nov 17 03:34:44.999861 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.virt.hardware [None req-d1bd7da6-080e-4394-8834-012f9a48447e tempest-AttachVolumeTestJSON-1651611701 tempest-AttachVolumeTestJSON-1651611701-project] Flavor limits 0:0:0 {{(pid=115917) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 17 03:34:45.000424 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.virt.hardware [None req-d1bd7da6-080e-4394-8834-012f9a48447e tempest-AttachVolumeTestJSON-1651611701 tempest-AttachVolumeTestJSON-1651611701-project] Image limits 0:0:0 {{(pid=115917) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 17 03:34:45.001021 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.virt.hardware [None req-d1bd7da6-080e-4394-8834-012f9a48447e tempest-AttachVolumeTestJSON-1651611701 tempest-AttachVolumeTestJSON-1651611701-project] Flavor pref 0:0:0 {{(pid=115917) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 17 03:34:45.001624 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.virt.hardware [None req-d1bd7da6-080e-4394-8834-012f9a48447e tempest-AttachVolumeTestJSON-1651611701 tempest-AttachVolumeTestJSON-1651611701-project] Image pref 0:0:0 {{(pid=115917) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 17 03:34:45.002238 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.virt.hardware [None req-d1bd7da6-080e-4394-8834-012f9a48447e tempest-AttachVolumeTestJSON-1651611701 tempest-AttachVolumeTestJSON-1651611701-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=115917) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 17 03:34:45.015721 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-d1bd7da6-080e-4394-8834-012f9a48447e tempest-AttachVolumeTestJSON-1651611701 tempest-AttachVolumeTestJSON-1651611701-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:34:45.016327 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-d1bd7da6-080e-4394-8834-012f9a48447e tempest-AttachVolumeTestJSON-1651611701 tempest-AttachVolumeTestJSON-1651611701-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:34:45.017528 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-d1bd7da6-080e-4394-8834-012f9a48447e tempest-AttachVolumeTestJSON-1651611701 tempest-AttachVolumeTestJSON-1651611701-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:34:45.018104 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-d1bd7da6-080e-4394-8834-012f9a48447e tempest-AttachVolumeTestJSON-1651611701 tempest-AttachVolumeTestJSON-1651611701-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:34:45.036194 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.quota [None req-d1bd7da6-080e-4394-8834-012f9a48447e tempest-AttachVolumeTestJSON-1651611701 tempest-AttachVolumeTestJSON-1651611701-project] Getting quotas for project 2bf44d5ada38487eb55a9f4b7d52862d. Resources: {'instances', 'ram', 'cores'} {{(pid=115917) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 17 03:34:45.040596 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.quota [None req-d1bd7da6-080e-4394-8834-012f9a48447e tempest-AttachVolumeTestJSON-1651611701 tempest-AttachVolumeTestJSON-1651611701-project] Getting quotas for user 1110e625f8f3451aafcdcac96d3e9ae8 and project 2bf44d5ada38487eb55a9f4b7d52862d. Resources: {'instances', 'ram', 'cores'} {{(pid=115917) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 17 03:34:45.052965 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-d1bd7da6-080e-4394-8834-012f9a48447e tempest-AttachVolumeTestJSON-1651611701 tempest-AttachVolumeTestJSON-1651611701-project] Going to run 1 instances... {{(pid=115917) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 17 03:34:45.054192 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-d1bd7da6-080e-4394-8834-012f9a48447e tempest-AttachVolumeTestJSON-1651611701 tempest-AttachVolumeTestJSON-1651611701-project] [instance: 9192e77c-eef4-40f6-85f6-afe009ad232f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='7281a37a-6b99-49c1-881a-41604d06bae1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=115917) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 17 03:34:45.102561 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-d1bd7da6-080e-4394-8834-012f9a48447e tempest-AttachVolumeTestJSON-1651611701 tempest-AttachVolumeTestJSON-1651611701-project] 10.222.0.11 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.654937 Nov 17 03:34:45.103204 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 950/1896] 10.222.0.11 () {60 vars in 1146 bytes} [Wed Nov 17 03:34:44 2021] POST /compute/v2.1/servers => generated 402 bytes in 656 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 17 03:34:45.107622 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-90612580-b23c-453d-ab15-75ba18078b8c tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:34:45.108372 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-90612580-b23c-453d-ab15-75ba18078b8c tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] [instance: 5ddbfaaa-fabf-4324-941c-8868625ffefc] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:34:45.114565 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-90612580-b23c-453d-ab15-75ba18078b8c tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:34:45.115017 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-90612580-b23c-453d-ab15-75ba18078b8c tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:34:45.115890 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-90612580-b23c-453d-ab15-75ba18078b8c tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:34:45.116334 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-90612580-b23c-453d-ab15-75ba18078b8c tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:34:45.181569 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-90612580-b23c-453d-ab15-75ba18078b8c tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80763e09d44c475ea2425b22874e9612', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fef02a1dd77946a2ac0e0414b557435f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:34:45.189157 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-90612580-b23c-453d-ab15-75ba18078b8c tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] 10.222.0.11 "GET /compute/v2.1/servers/5ddbfaaa-fabf-4324-941c-8868625ffefc" status: 200 len: 1226 microversion: 2.1 time: 0.084981 Nov 17 03:34:45.189796 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 951/1897] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:34:45 2021] GET /compute/v2.1/servers/5ddbfaaa-fabf-4324-941c-8868625ffefc => generated 1226 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:34:45.194155 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-e09c3ed1-f393-4979-99c8-274710d4af63 tempest-AttachVolumeTestJSON-1651611701 tempest-AttachVolumeTestJSON-1651611701-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:34:45.194977 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-e09c3ed1-f393-4979-99c8-274710d4af63 tempest-AttachVolumeTestJSON-1651611701 tempest-AttachVolumeTestJSON-1651611701-project] [instance: 9192e77c-eef4-40f6-85f6-afe009ad232f] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:34:45.246054 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-e09c3ed1-f393-4979-99c8-274710d4af63 tempest-AttachVolumeTestJSON-1651611701 tempest-AttachVolumeTestJSON-1651611701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1110e625f8f3451aafcdcac96d3e9ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bf44d5ada38487eb55a9f4b7d52862d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:34:45.253210 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-e09c3ed1-f393-4979-99c8-274710d4af63 tempest-AttachVolumeTestJSON-1651611701 tempest-AttachVolumeTestJSON-1651611701-project] 10.222.0.11 "GET /compute/v2.1/servers/9192e77c-eef4-40f6-85f6-afe009ad232f" status: 200 len: 1237 microversion: 2.1 time: 0.062307 Nov 17 03:34:45.253811 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 952/1898] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:34:45 2021] GET /compute/v2.1/servers/9192e77c-eef4-40f6-85f6-afe009ad232f => generated 1237 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:34:45.420518 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-ffcfdbe4-fc3b-4c0a-a2b9-bfb3dafb3a74 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:34:45.421155 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-ffcfdbe4-fc3b-4c0a-a2b9-bfb3dafb3a74 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] [instance: 0698dc5b-5f47-46c4-ace8-f5e891a964a0] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:34:45.427369 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-ffcfdbe4-fc3b-4c0a-a2b9-bfb3dafb3a74 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:34:45.427810 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-ffcfdbe4-fc3b-4c0a-a2b9-bfb3dafb3a74 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:34:45.428659 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-ffcfdbe4-fc3b-4c0a-a2b9-bfb3dafb3a74 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:34:45.429106 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-ffcfdbe4-fc3b-4c0a-a2b9-bfb3dafb3a74 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:34:45.568873 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-ffcfdbe4-fc3b-4c0a-a2b9-bfb3dafb3a74 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '163b2f24a72649ac8084be1cac32fa09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e123e9b86124c93a7fc2db9984e7466', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:34:45.578098 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-ffcfdbe4-fc3b-4c0a-a2b9-bfb3dafb3a74 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] 10.222.0.11 "GET /compute/v2.1/servers/0698dc5b-5f47-46c4-ace8-f5e891a964a0" status: 200 len: 1565 microversion: 2.1 time: 0.160346 Nov 17 03:34:45.578675 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 953/1899] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:34:45 2021] GET /compute/v2.1/servers/0698dc5b-5f47-46c4-ace8-f5e891a964a0 => generated 1565 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:34:45.583773 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-daf39dd5-6371-44f9-8d60-62e4ccc4503d tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:34:45.584760 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-daf39dd5-6371-44f9-8d60-62e4ccc4503d tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] [instance: 5d54db85-b991-4890-abaa-952413baa2e7] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:34:45.590659 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-daf39dd5-6371-44f9-8d60-62e4ccc4503d tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:34:45.591102 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-daf39dd5-6371-44f9-8d60-62e4ccc4503d tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:34:45.591872 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-daf39dd5-6371-44f9-8d60-62e4ccc4503d tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:34:45.592309 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-daf39dd5-6371-44f9-8d60-62e4ccc4503d tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:34:45.621230 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-daf39dd5-6371-44f9-8d60-62e4ccc4503d tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] 10.222.0.11 "GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041146 Nov 17 03:34:45.621985 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 954/1900] 10.222.0.11 () {60 vars in 1342 bytes} [Wed Nov 17 03:34:45 2021] GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 17 03:34:46.205994 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-c4788188-0028-4762-847d-c0593daf3315 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:34:46.206743 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-c4788188-0028-4762-847d-c0593daf3315 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] [instance: 5ddbfaaa-fabf-4324-941c-8868625ffefc] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:34:46.214195 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-c4788188-0028-4762-847d-c0593daf3315 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:34:46.214654 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-c4788188-0028-4762-847d-c0593daf3315 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:34:46.215833 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-c4788188-0028-4762-847d-c0593daf3315 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:34:46.215973 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-c4788188-0028-4762-847d-c0593daf3315 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:34:46.283944 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-c4788188-0028-4762-847d-c0593daf3315 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80763e09d44c475ea2425b22874e9612', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fef02a1dd77946a2ac0e0414b557435f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:34:46.291939 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-c4788188-0028-4762-847d-c0593daf3315 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] 10.222.0.11 "GET /compute/v2.1/servers/5ddbfaaa-fabf-4324-941c-8868625ffefc" status: 200 len: 1226 microversion: 2.1 time: 0.089649 Nov 17 03:34:46.300910 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 955/1901] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:34:46 2021] GET /compute/v2.1/servers/5ddbfaaa-fabf-4324-941c-8868625ffefc => generated 1226 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:34:46.300910 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-c81b58a6-46d2-47ad-a64a-24c112f41c3f tempest-AttachVolumeTestJSON-1651611701 tempest-AttachVolumeTestJSON-1651611701-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:34:46.300910 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-c81b58a6-46d2-47ad-a64a-24c112f41c3f tempest-AttachVolumeTestJSON-1651611701 tempest-AttachVolumeTestJSON-1651611701-project] [instance: 9192e77c-eef4-40f6-85f6-afe009ad232f] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:34:46.305465 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-c81b58a6-46d2-47ad-a64a-24c112f41c3f tempest-AttachVolumeTestJSON-1651611701 tempest-AttachVolumeTestJSON-1651611701-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:34:46.305929 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-c81b58a6-46d2-47ad-a64a-24c112f41c3f tempest-AttachVolumeTestJSON-1651611701 tempest-AttachVolumeTestJSON-1651611701-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:34:46.306700 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-c81b58a6-46d2-47ad-a64a-24c112f41c3f tempest-AttachVolumeTestJSON-1651611701 tempest-AttachVolumeTestJSON-1651611701-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:34:46.307148 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-c81b58a6-46d2-47ad-a64a-24c112f41c3f tempest-AttachVolumeTestJSON-1651611701 tempest-AttachVolumeTestJSON-1651611701-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:34:46.372674 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-c81b58a6-46d2-47ad-a64a-24c112f41c3f tempest-AttachVolumeTestJSON-1651611701 tempest-AttachVolumeTestJSON-1651611701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1110e625f8f3451aafcdcac96d3e9ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bf44d5ada38487eb55a9f4b7d52862d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:34:46.380617 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-c81b58a6-46d2-47ad-a64a-24c112f41c3f tempest-AttachVolumeTestJSON-1651611701 tempest-AttachVolumeTestJSON-1651611701-project] 10.222.0.11 "GET /compute/v2.1/servers/9192e77c-eef4-40f6-85f6-afe009ad232f" status: 200 len: 1295 microversion: 2.1 time: 0.086951 Nov 17 03:34:46.381434 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 956/1902] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:34:46 2021] GET /compute/v2.1/servers/9192e77c-eef4-40f6-85f6-afe009ad232f => generated 1295 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:34:46.595544 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-c3ef8b56-f7ee-406c-aab4-e434c214ef7a tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:34:46.596154 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-c3ef8b56-f7ee-406c-aab4-e434c214ef7a tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] [instance: 0698dc5b-5f47-46c4-ace8-f5e891a964a0] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:34:46.602071 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-c3ef8b56-f7ee-406c-aab4-e434c214ef7a tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:34:46.602589 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-c3ef8b56-f7ee-406c-aab4-e434c214ef7a tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:34:46.603420 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-c3ef8b56-f7ee-406c-aab4-e434c214ef7a tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:34:46.603854 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-c3ef8b56-f7ee-406c-aab4-e434c214ef7a tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:34:46.827158 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-c3ef8b56-f7ee-406c-aab4-e434c214ef7a tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '163b2f24a72649ac8084be1cac32fa09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e123e9b86124c93a7fc2db9984e7466', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:34:46.834907 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-c3ef8b56-f7ee-406c-aab4-e434c214ef7a tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] 10.222.0.11 "GET /compute/v2.1/servers/0698dc5b-5f47-46c4-ace8-f5e891a964a0" status: 200 len: 1565 microversion: 2.1 time: 0.243047 Nov 17 03:34:46.835721 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 957/1903] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:34:46 2021] GET /compute/v2.1/servers/0698dc5b-5f47-46c4-ace8-f5e891a964a0 => generated 1565 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:34:46.848992 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-df55d084-8dc2-4a5b-b9e4-25fea31764d8 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:34:46.849815 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-df55d084-8dc2-4a5b-b9e4-25fea31764d8 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] [instance: 5d54db85-b991-4890-abaa-952413baa2e7] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:34:46.855891 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-df55d084-8dc2-4a5b-b9e4-25fea31764d8 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:34:46.856323 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-df55d084-8dc2-4a5b-b9e4-25fea31764d8 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:34:46.857125 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-df55d084-8dc2-4a5b-b9e4-25fea31764d8 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:34:46.857558 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-df55d084-8dc2-4a5b-b9e4-25fea31764d8 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:34:46.890461 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-df55d084-8dc2-4a5b-b9e4-25fea31764d8 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] 10.222.0.11 "GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045124 Nov 17 03:34:46.891053 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 958/1904] 10.222.0.11 () {60 vars in 1342 bytes} [Wed Nov 17 03:34:46 2021] GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 17 03:34:47.309186 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-4e81553f-8c2d-45fa-89a2-4afff999b54d tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:34:47.309831 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-4e81553f-8c2d-45fa-89a2-4afff999b54d tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] [instance: 5ddbfaaa-fabf-4324-941c-8868625ffefc] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:34:47.316194 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-4e81553f-8c2d-45fa-89a2-4afff999b54d tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:34:47.316617 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-4e81553f-8c2d-45fa-89a2-4afff999b54d tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:34:47.317436 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-4e81553f-8c2d-45fa-89a2-4afff999b54d tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:34:47.317880 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-4e81553f-8c2d-45fa-89a2-4afff999b54d tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:34:47.384015 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-4e81553f-8c2d-45fa-89a2-4afff999b54d tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80763e09d44c475ea2425b22874e9612', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fef02a1dd77946a2ac0e0414b557435f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:34:47.391554 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-4e81553f-8c2d-45fa-89a2-4afff999b54d tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] 10.222.0.11 "GET /compute/v2.1/servers/5ddbfaaa-fabf-4324-941c-8868625ffefc" status: 200 len: 1226 microversion: 2.1 time: 0.086148 Nov 17 03:34:47.392398 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 959/1905] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:34:47 2021] GET /compute/v2.1/servers/5ddbfaaa-fabf-4324-941c-8868625ffefc => generated 1226 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:34:47.399687 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-ae5570fb-0a1c-4c57-b264-1f6489d28307 tempest-AttachVolumeTestJSON-1651611701 tempest-AttachVolumeTestJSON-1651611701-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:34:47.400433 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-ae5570fb-0a1c-4c57-b264-1f6489d28307 tempest-AttachVolumeTestJSON-1651611701 tempest-AttachVolumeTestJSON-1651611701-project] [instance: 9192e77c-eef4-40f6-85f6-afe009ad232f] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:34:47.407025 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-ae5570fb-0a1c-4c57-b264-1f6489d28307 tempest-AttachVolumeTestJSON-1651611701 tempest-AttachVolumeTestJSON-1651611701-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:34:47.407561 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-ae5570fb-0a1c-4c57-b264-1f6489d28307 tempest-AttachVolumeTestJSON-1651611701 tempest-AttachVolumeTestJSON-1651611701-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:34:47.408492 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-ae5570fb-0a1c-4c57-b264-1f6489d28307 tempest-AttachVolumeTestJSON-1651611701 tempest-AttachVolumeTestJSON-1651611701-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:34:47.409025 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-ae5570fb-0a1c-4c57-b264-1f6489d28307 tempest-AttachVolumeTestJSON-1651611701 tempest-AttachVolumeTestJSON-1651611701-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:34:47.626807 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-ae5570fb-0a1c-4c57-b264-1f6489d28307 tempest-AttachVolumeTestJSON-1651611701 tempest-AttachVolumeTestJSON-1651611701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1110e625f8f3451aafcdcac96d3e9ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bf44d5ada38487eb55a9f4b7d52862d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:34:47.634659 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-ae5570fb-0a1c-4c57-b264-1f6489d28307 tempest-AttachVolumeTestJSON-1651611701 tempest-AttachVolumeTestJSON-1651611701-project] 10.222.0.11 "GET /compute/v2.1/servers/9192e77c-eef4-40f6-85f6-afe009ad232f" status: 200 len: 1363 microversion: 2.1 time: 0.240261 Nov 17 03:34:47.635168 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 960/1906] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:34:47 2021] GET /compute/v2.1/servers/9192e77c-eef4-40f6-85f6-afe009ad232f => generated 1363 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:34:47.708358 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [req-9be6461a-b54d-4708-bf8c-46b0caaf81d9 req-e8c1ca9c-7889-4179-a803-d9302547c44b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9192e77c-eef4-40f6-85f6-afe009ad232f", "tag": "a8f2f0a2-c75a-46ef-9d80-9edfed887be8"}]} {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 17 03:34:47.710561 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 17 03:34:47.710561 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: warnings.warn(msg) Nov 17 03:34:47.721599 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [req-9be6461a-b54d-4708-bf8c-46b0caaf81d9 req-e8c1ca9c-7889-4179-a803-d9302547c44b service nova] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:34:47.722042 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [req-9be6461a-b54d-4708-bf8c-46b0caaf81d9 req-e8c1ca9c-7889-4179-a803-d9302547c44b service nova] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:34:47.734192 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.compute.server_external_events [req-9be6461a-b54d-4708-bf8c-46b0caaf81d9 req-e8c1ca9c-7889-4179-a803-d9302547c44b service nova] Creating event network-changed:a8f2f0a2-c75a-46ef-9d80-9edfed887be8 for instance 9192e77c-eef4-40f6-85f6-afe009ad232f on hv-cinder-81803 Nov 17 03:34:47.739049 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [req-9be6461a-b54d-4708-bf8c-46b0caaf81d9 req-e8c1ca9c-7889-4179-a803-d9302547c44b service nova] 10.222.0.11 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034915 Nov 17 03:34:47.739886 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 961/1907] 10.222.0.11 () {64 vars in 1317 bytes} [Wed Nov 17 03:34:47 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 17 03:34:47.853446 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-99924641-3802-425f-9e0e-7e31ca5cf2fa tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:34:47.854244 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-99924641-3802-425f-9e0e-7e31ca5cf2fa tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] [instance: 0698dc5b-5f47-46c4-ace8-f5e891a964a0] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:34:47.860955 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-99924641-3802-425f-9e0e-7e31ca5cf2fa tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:34:47.861512 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-99924641-3802-425f-9e0e-7e31ca5cf2fa tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:34:47.862395 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-99924641-3802-425f-9e0e-7e31ca5cf2fa tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:34:47.862943 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-99924641-3802-425f-9e0e-7e31ca5cf2fa tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:34:48.093339 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-99924641-3802-425f-9e0e-7e31ca5cf2fa tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '163b2f24a72649ac8084be1cac32fa09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e123e9b86124c93a7fc2db9984e7466', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:34:48.100997 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-99924641-3802-425f-9e0e-7e31ca5cf2fa tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] 10.222.0.11 "GET /compute/v2.1/servers/0698dc5b-5f47-46c4-ace8-f5e891a964a0" status: 200 len: 1565 microversion: 2.1 time: 0.253139 Nov 17 03:34:48.101603 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 962/1908] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:34:47 2021] GET /compute/v2.1/servers/0698dc5b-5f47-46c4-ace8-f5e891a964a0 => generated 1565 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 17 03:34:48.106366 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-24a317d8-974d-420d-8116-21536818af25 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:34:48.107529 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-24a317d8-974d-420d-8116-21536818af25 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] [instance: 5d54db85-b991-4890-abaa-952413baa2e7] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:34:48.113573 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-24a317d8-974d-420d-8116-21536818af25 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:34:48.114049 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-24a317d8-974d-420d-8116-21536818af25 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:34:48.114813 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-24a317d8-974d-420d-8116-21536818af25 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:34:48.115214 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-24a317d8-974d-420d-8116-21536818af25 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:34:48.144399 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-24a317d8-974d-420d-8116-21536818af25 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] 10.222.0.11 "GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041557 Nov 17 03:34:48.144902 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 963/1909] 10.222.0.11 () {60 vars in 1342 bytes} [Wed Nov 17 03:34:48 2021] GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 17 03:34:48.408515 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-7a312f17-5aaf-458b-810e-1708ac18007a tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:34:48.409896 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-7a312f17-5aaf-458b-810e-1708ac18007a tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] [instance: 5ddbfaaa-fabf-4324-941c-8868625ffefc] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:34:48.416493 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-7a312f17-5aaf-458b-810e-1708ac18007a tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:34:48.416978 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-7a312f17-5aaf-458b-810e-1708ac18007a tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:34:48.417761 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-7a312f17-5aaf-458b-810e-1708ac18007a tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:34:48.418198 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-7a312f17-5aaf-458b-810e-1708ac18007a tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:34:48.481761 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-7a312f17-5aaf-458b-810e-1708ac18007a tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80763e09d44c475ea2425b22874e9612', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fef02a1dd77946a2ac0e0414b557435f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:34:48.489327 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-7a312f17-5aaf-458b-810e-1708ac18007a tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] 10.222.0.11 "GET /compute/v2.1/servers/5ddbfaaa-fabf-4324-941c-8868625ffefc" status: 200 len: 1226 microversion: 2.1 time: 0.084552 Nov 17 03:34:48.489862 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 964/1910] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:34:48 2021] GET /compute/v2.1/servers/5ddbfaaa-fabf-4324-941c-8868625ffefc => generated 1226 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 17 03:34:48.651551 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-cb337e0c-355b-4c10-a024-1374cfd8e897 tempest-AttachVolumeTestJSON-1651611701 tempest-AttachVolumeTestJSON-1651611701-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:34:48.652151 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-cb337e0c-355b-4c10-a024-1374cfd8e897 tempest-AttachVolumeTestJSON-1651611701 tempest-AttachVolumeTestJSON-1651611701-project] [instance: 9192e77c-eef4-40f6-85f6-afe009ad232f] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:34:48.658511 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-cb337e0c-355b-4c10-a024-1374cfd8e897 tempest-AttachVolumeTestJSON-1651611701 tempest-AttachVolumeTestJSON-1651611701-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:34:48.659031 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-cb337e0c-355b-4c10-a024-1374cfd8e897 tempest-AttachVolumeTestJSON-1651611701 tempest-AttachVolumeTestJSON-1651611701-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:34:48.659730 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-cb337e0c-355b-4c10-a024-1374cfd8e897 tempest-AttachVolumeTestJSON-1651611701 tempest-AttachVolumeTestJSON-1651611701-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:34:48.660158 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-cb337e0c-355b-4c10-a024-1374cfd8e897 tempest-AttachVolumeTestJSON-1651611701 tempest-AttachVolumeTestJSON-1651611701-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:34:48.864330 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-cb337e0c-355b-4c10-a024-1374cfd8e897 tempest-AttachVolumeTestJSON-1651611701 tempest-AttachVolumeTestJSON-1651611701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1110e625f8f3451aafcdcac96d3e9ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bf44d5ada38487eb55a9f4b7d52862d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:34:48.872646 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-cb337e0c-355b-4c10-a024-1374cfd8e897 tempest-AttachVolumeTestJSON-1651611701 tempest-AttachVolumeTestJSON-1651611701-project] 10.222.0.11 "GET /compute/v2.1/servers/9192e77c-eef4-40f6-85f6-afe009ad232f" status: 200 len: 1363 microversion: 2.1 time: 0.224845 Nov 17 03:34:48.873271 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 965/1911] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:34:48 2021] GET /compute/v2.1/servers/9192e77c-eef4-40f6-85f6-afe009ad232f => generated 1363 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:34:49.122220 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-cd514abb-3436-45b2-8424-8750d1fdf014 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:34:49.123236 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-cd514abb-3436-45b2-8424-8750d1fdf014 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] [instance: 0698dc5b-5f47-46c4-ace8-f5e891a964a0] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:34:49.132753 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-cd514abb-3436-45b2-8424-8750d1fdf014 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:34:49.133251 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-cd514abb-3436-45b2-8424-8750d1fdf014 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:34:49.134032 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-cd514abb-3436-45b2-8424-8750d1fdf014 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:34:49.134457 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-cd514abb-3436-45b2-8424-8750d1fdf014 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:34:49.269318 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-cd514abb-3436-45b2-8424-8750d1fdf014 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '163b2f24a72649ac8084be1cac32fa09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e123e9b86124c93a7fc2db9984e7466', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:34:49.280649 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-cd514abb-3436-45b2-8424-8750d1fdf014 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] 10.222.0.11 "GET /compute/v2.1/servers/0698dc5b-5f47-46c4-ace8-f5e891a964a0" status: 200 len: 1565 microversion: 2.1 time: 0.164435 Nov 17 03:34:49.281523 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 966/1912] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:34:49 2021] GET /compute/v2.1/servers/0698dc5b-5f47-46c4-ace8-f5e891a964a0 => generated 1565 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:34:49.285928 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-7f50a3bc-df97-4d0f-883d-dab920282f26 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:34:49.286834 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-7f50a3bc-df97-4d0f-883d-dab920282f26 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] [instance: 5d54db85-b991-4890-abaa-952413baa2e7] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:34:49.292992 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-7f50a3bc-df97-4d0f-883d-dab920282f26 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:34:49.293452 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-7f50a3bc-df97-4d0f-883d-dab920282f26 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:34:49.294229 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-7f50a3bc-df97-4d0f-883d-dab920282f26 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:34:49.294666 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-7f50a3bc-df97-4d0f-883d-dab920282f26 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:34:49.325389 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-7f50a3bc-df97-4d0f-883d-dab920282f26 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] 10.222.0.11 "GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042691 Nov 17 03:34:49.325815 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 967/1913] 10.222.0.11 () {60 vars in 1342 bytes} [Wed Nov 17 03:34:49 2021] GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 17 03:34:49.506915 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-46cf0ffa-f4dc-424f-9361-1f90af71823b tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:34:49.507630 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-46cf0ffa-f4dc-424f-9361-1f90af71823b tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] [instance: 5ddbfaaa-fabf-4324-941c-8868625ffefc] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:34:49.514157 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-46cf0ffa-f4dc-424f-9361-1f90af71823b tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:34:49.514600 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-46cf0ffa-f4dc-424f-9361-1f90af71823b tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:34:49.515364 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-46cf0ffa-f4dc-424f-9361-1f90af71823b tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:34:49.515787 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-46cf0ffa-f4dc-424f-9361-1f90af71823b tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:34:49.576382 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-46cf0ffa-f4dc-424f-9361-1f90af71823b tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80763e09d44c475ea2425b22874e9612', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fef02a1dd77946a2ac0e0414b557435f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:34:49.584244 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-46cf0ffa-f4dc-424f-9361-1f90af71823b tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] 10.222.0.11 "GET /compute/v2.1/servers/5ddbfaaa-fabf-4324-941c-8868625ffefc" status: 200 len: 1226 microversion: 2.1 time: 0.081278 Nov 17 03:34:49.584909 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 968/1914] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:34:49 2021] GET /compute/v2.1/servers/5ddbfaaa-fabf-4324-941c-8868625ffefc => generated 1226 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:34:49.893722 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-b871569a-456b-47b1-8477-abd52f718097 tempest-AttachVolumeTestJSON-1651611701 tempest-AttachVolumeTestJSON-1651611701-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:34:49.894619 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-b871569a-456b-47b1-8477-abd52f718097 tempest-AttachVolumeTestJSON-1651611701 tempest-AttachVolumeTestJSON-1651611701-project] [instance: 9192e77c-eef4-40f6-85f6-afe009ad232f] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:34:49.905047 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-b871569a-456b-47b1-8477-abd52f718097 tempest-AttachVolumeTestJSON-1651611701 tempest-AttachVolumeTestJSON-1651611701-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:34:49.905812 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-b871569a-456b-47b1-8477-abd52f718097 tempest-AttachVolumeTestJSON-1651611701 tempest-AttachVolumeTestJSON-1651611701-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:34:49.907080 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-b871569a-456b-47b1-8477-abd52f718097 tempest-AttachVolumeTestJSON-1651611701 tempest-AttachVolumeTestJSON-1651611701-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:34:49.907794 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-b871569a-456b-47b1-8477-abd52f718097 tempest-AttachVolumeTestJSON-1651611701 tempest-AttachVolumeTestJSON-1651611701-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:34:50.059040 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-b871569a-456b-47b1-8477-abd52f718097 tempest-AttachVolumeTestJSON-1651611701 tempest-AttachVolumeTestJSON-1651611701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1110e625f8f3451aafcdcac96d3e9ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bf44d5ada38487eb55a9f4b7d52862d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:34:50.069182 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-b871569a-456b-47b1-8477-abd52f718097 tempest-AttachVolumeTestJSON-1651611701 tempest-AttachVolumeTestJSON-1651611701-project] 10.222.0.11 "GET /compute/v2.1/servers/9192e77c-eef4-40f6-85f6-afe009ad232f" status: 200 len: 1363 microversion: 2.1 time: 0.181498 Nov 17 03:34:50.069753 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 969/1915] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:34:49 2021] GET /compute/v2.1/servers/9192e77c-eef4-40f6-85f6-afe009ad232f => generated 1363 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:34:50.301834 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-bacac24c-a5f1-4d0a-9799-95918dd40c1c tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:34:50.302842 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-bacac24c-a5f1-4d0a-9799-95918dd40c1c tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] [instance: 0698dc5b-5f47-46c4-ace8-f5e891a964a0] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:34:50.309931 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-bacac24c-a5f1-4d0a-9799-95918dd40c1c tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:34:50.310375 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-bacac24c-a5f1-4d0a-9799-95918dd40c1c tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:34:50.311140 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-bacac24c-a5f1-4d0a-9799-95918dd40c1c tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:34:50.311566 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-bacac24c-a5f1-4d0a-9799-95918dd40c1c tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:34:50.447132 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-bacac24c-a5f1-4d0a-9799-95918dd40c1c tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '163b2f24a72649ac8084be1cac32fa09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e123e9b86124c93a7fc2db9984e7466', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:34:50.454993 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-bacac24c-a5f1-4d0a-9799-95918dd40c1c tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] 10.222.0.11 "GET /compute/v2.1/servers/0698dc5b-5f47-46c4-ace8-f5e891a964a0" status: 200 len: 1565 microversion: 2.1 time: 0.159228 Nov 17 03:34:50.455562 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 970/1916] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:34:50 2021] GET /compute/v2.1/servers/0698dc5b-5f47-46c4-ace8-f5e891a964a0 => generated 1565 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:34:50.460139 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-1f87583d-8b0e-47b5-bdb8-331c4279f289 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:34:50.461107 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-1f87583d-8b0e-47b5-bdb8-331c4279f289 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] [instance: 5d54db85-b991-4890-abaa-952413baa2e7] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:34:50.466702 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-1f87583d-8b0e-47b5-bdb8-331c4279f289 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:34:50.467176 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-1f87583d-8b0e-47b5-bdb8-331c4279f289 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:34:50.467961 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-1f87583d-8b0e-47b5-bdb8-331c4279f289 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:34:50.468397 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-1f87583d-8b0e-47b5-bdb8-331c4279f289 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:34:50.497547 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-1f87583d-8b0e-47b5-bdb8-331c4279f289 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] 10.222.0.11 "GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.040913 Nov 17 03:34:50.498108 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 971/1917] 10.222.0.11 () {60 vars in 1342 bytes} [Wed Nov 17 03:34:50 2021] GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 17 03:34:50.604880 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-d0eacfa8-122d-4721-b3cf-703028af168e tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:34:50.605944 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-d0eacfa8-122d-4721-b3cf-703028af168e tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] [instance: 5ddbfaaa-fabf-4324-941c-8868625ffefc] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:34:50.616292 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-d0eacfa8-122d-4721-b3cf-703028af168e tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:34:50.617106 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-d0eacfa8-122d-4721-b3cf-703028af168e tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:34:50.618374 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-d0eacfa8-122d-4721-b3cf-703028af168e tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:34:50.619090 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-d0eacfa8-122d-4721-b3cf-703028af168e tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:34:50.682737 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-d0eacfa8-122d-4721-b3cf-703028af168e tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80763e09d44c475ea2425b22874e9612', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fef02a1dd77946a2ac0e0414b557435f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:34:50.690581 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-d0eacfa8-122d-4721-b3cf-703028af168e tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] 10.222.0.11 "GET /compute/v2.1/servers/5ddbfaaa-fabf-4324-941c-8868625ffefc" status: 200 len: 1226 microversion: 2.1 time: 0.091920 Nov 17 03:34:50.691098 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 972/1918] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:34:50 2021] GET /compute/v2.1/servers/5ddbfaaa-fabf-4324-941c-8868625ffefc => generated 1226 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:34:51.087913 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-d34f1a88-c60c-4885-95ab-74b77226b290 tempest-AttachVolumeTestJSON-1651611701 tempest-AttachVolumeTestJSON-1651611701-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:34:51.088552 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-d34f1a88-c60c-4885-95ab-74b77226b290 tempest-AttachVolumeTestJSON-1651611701 tempest-AttachVolumeTestJSON-1651611701-project] [instance: 9192e77c-eef4-40f6-85f6-afe009ad232f] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:34:51.095019 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-d34f1a88-c60c-4885-95ab-74b77226b290 tempest-AttachVolumeTestJSON-1651611701 tempest-AttachVolumeTestJSON-1651611701-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:34:51.095467 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-d34f1a88-c60c-4885-95ab-74b77226b290 tempest-AttachVolumeTestJSON-1651611701 tempest-AttachVolumeTestJSON-1651611701-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:34:51.096240 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-d34f1a88-c60c-4885-95ab-74b77226b290 tempest-AttachVolumeTestJSON-1651611701 tempest-AttachVolumeTestJSON-1651611701-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:34:51.096674 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-d34f1a88-c60c-4885-95ab-74b77226b290 tempest-AttachVolumeTestJSON-1651611701 tempest-AttachVolumeTestJSON-1651611701-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:34:51.238654 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-d34f1a88-c60c-4885-95ab-74b77226b290 tempest-AttachVolumeTestJSON-1651611701 tempest-AttachVolumeTestJSON-1651611701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1110e625f8f3451aafcdcac96d3e9ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bf44d5ada38487eb55a9f4b7d52862d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:34:51.251073 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-d34f1a88-c60c-4885-95ab-74b77226b290 tempest-AttachVolumeTestJSON-1651611701 tempest-AttachVolumeTestJSON-1651611701-project] 10.222.0.11 "GET /compute/v2.1/servers/9192e77c-eef4-40f6-85f6-afe009ad232f" status: 200 len: 1363 microversion: 2.1 time: 0.167234 Nov 17 03:34:51.251869 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 973/1919] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:34:51 2021] GET /compute/v2.1/servers/9192e77c-eef4-40f6-85f6-afe009ad232f => generated 1363 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:34:51.476271 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-95f5bc4b-5820-48e6-a492-59104adee5d5 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:34:51.476930 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-95f5bc4b-5820-48e6-a492-59104adee5d5 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] [instance: 0698dc5b-5f47-46c4-ace8-f5e891a964a0] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:34:51.484443 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-95f5bc4b-5820-48e6-a492-59104adee5d5 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:34:51.485027 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-95f5bc4b-5820-48e6-a492-59104adee5d5 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:34:51.485930 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-95f5bc4b-5820-48e6-a492-59104adee5d5 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:34:51.486439 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-95f5bc4b-5820-48e6-a492-59104adee5d5 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:34:51.623325 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-95f5bc4b-5820-48e6-a492-59104adee5d5 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '163b2f24a72649ac8084be1cac32fa09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e123e9b86124c93a7fc2db9984e7466', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:34:51.631136 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-95f5bc4b-5820-48e6-a492-59104adee5d5 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] 10.222.0.11 "GET /compute/v2.1/servers/0698dc5b-5f47-46c4-ace8-f5e891a964a0" status: 200 len: 1565 microversion: 2.1 time: 0.161016 Nov 17 03:34:51.631722 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 974/1920] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:34:51 2021] GET /compute/v2.1/servers/0698dc5b-5f47-46c4-ace8-f5e891a964a0 => generated 1565 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:34:51.636101 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-9fcdfa5a-16f6-4be1-97ce-babad79bc4b2 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:34:51.637052 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-9fcdfa5a-16f6-4be1-97ce-babad79bc4b2 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] [instance: 5d54db85-b991-4890-abaa-952413baa2e7] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:34:51.642965 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-9fcdfa5a-16f6-4be1-97ce-babad79bc4b2 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:34:51.643412 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-9fcdfa5a-16f6-4be1-97ce-babad79bc4b2 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:34:51.644187 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-9fcdfa5a-16f6-4be1-97ce-babad79bc4b2 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:34:51.644619 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-9fcdfa5a-16f6-4be1-97ce-babad79bc4b2 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:34:51.673520 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-9fcdfa5a-16f6-4be1-97ce-babad79bc4b2 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] 10.222.0.11 "GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.040778 Nov 17 03:34:51.674062 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 975/1921] 10.222.0.11 () {60 vars in 1342 bytes} [Wed Nov 17 03:34:51 2021] GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 17 03:34:51.708159 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-d0e845a2-fba4-479c-8188-79524e8bf5bc tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:34:51.708874 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-d0e845a2-fba4-479c-8188-79524e8bf5bc tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] [instance: 5ddbfaaa-fabf-4324-941c-8868625ffefc] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:34:51.715362 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-d0e845a2-fba4-479c-8188-79524e8bf5bc tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:34:51.715807 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-d0e845a2-fba4-479c-8188-79524e8bf5bc tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:34:51.716717 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-d0e845a2-fba4-479c-8188-79524e8bf5bc tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:34:51.717247 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-d0e845a2-fba4-479c-8188-79524e8bf5bc tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:34:51.775660 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-d0e845a2-fba4-479c-8188-79524e8bf5bc tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80763e09d44c475ea2425b22874e9612', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fef02a1dd77946a2ac0e0414b557435f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:34:51.784386 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-d0e845a2-fba4-479c-8188-79524e8bf5bc tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] 10.222.0.11 "GET /compute/v2.1/servers/5ddbfaaa-fabf-4324-941c-8868625ffefc" status: 200 len: 1226 microversion: 2.1 time: 0.079701 Nov 17 03:34:51.785661 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 976/1922] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:34:51 2021] GET /compute/v2.1/servers/5ddbfaaa-fabf-4324-941c-8868625ffefc => generated 1226 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 17 03:34:52.274808 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-76695c74-f512-40c0-bce5-36869d9dcd8c tempest-AttachVolumeTestJSON-1651611701 tempest-AttachVolumeTestJSON-1651611701-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:34:52.276272 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-76695c74-f512-40c0-bce5-36869d9dcd8c tempest-AttachVolumeTestJSON-1651611701 tempest-AttachVolumeTestJSON-1651611701-project] [instance: 9192e77c-eef4-40f6-85f6-afe009ad232f] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:34:52.286711 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-76695c74-f512-40c0-bce5-36869d9dcd8c tempest-AttachVolumeTestJSON-1651611701 tempest-AttachVolumeTestJSON-1651611701-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:34:52.287465 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-76695c74-f512-40c0-bce5-36869d9dcd8c tempest-AttachVolumeTestJSON-1651611701 tempest-AttachVolumeTestJSON-1651611701-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:34:52.288810 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-76695c74-f512-40c0-bce5-36869d9dcd8c tempest-AttachVolumeTestJSON-1651611701 tempest-AttachVolumeTestJSON-1651611701-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:34:52.289269 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-76695c74-f512-40c0-bce5-36869d9dcd8c tempest-AttachVolumeTestJSON-1651611701 tempest-AttachVolumeTestJSON-1651611701-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:34:52.433184 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-76695c74-f512-40c0-bce5-36869d9dcd8c tempest-AttachVolumeTestJSON-1651611701 tempest-AttachVolumeTestJSON-1651611701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1110e625f8f3451aafcdcac96d3e9ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bf44d5ada38487eb55a9f4b7d52862d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:34:52.440968 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-76695c74-f512-40c0-bce5-36869d9dcd8c tempest-AttachVolumeTestJSON-1651611701 tempest-AttachVolumeTestJSON-1651611701-project] 10.222.0.11 "GET /compute/v2.1/servers/9192e77c-eef4-40f6-85f6-afe009ad232f" status: 200 len: 1363 microversion: 2.1 time: 0.173149 Nov 17 03:34:52.441544 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 977/1923] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:34:52 2021] GET /compute/v2.1/servers/9192e77c-eef4-40f6-85f6-afe009ad232f => generated 1363 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:34:52.651130 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-2ff29b33-2e80-4d96-85b9-f78a2b1d7e0f tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:34:52.651837 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-2ff29b33-2e80-4d96-85b9-f78a2b1d7e0f tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] [instance: 0698dc5b-5f47-46c4-ace8-f5e891a964a0] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:34:52.658998 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-2ff29b33-2e80-4d96-85b9-f78a2b1d7e0f tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:34:52.659524 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-2ff29b33-2e80-4d96-85b9-f78a2b1d7e0f tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:34:52.660350 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-2ff29b33-2e80-4d96-85b9-f78a2b1d7e0f tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:34:52.660821 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-2ff29b33-2e80-4d96-85b9-f78a2b1d7e0f tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:34:52.810004 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-2ff29b33-2e80-4d96-85b9-f78a2b1d7e0f tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '163b2f24a72649ac8084be1cac32fa09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e123e9b86124c93a7fc2db9984e7466', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:34:52.817476 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-2ff29b33-2e80-4d96-85b9-f78a2b1d7e0f tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] 10.222.0.11 "GET /compute/v2.1/servers/0698dc5b-5f47-46c4-ace8-f5e891a964a0" status: 200 len: 1565 microversion: 2.1 time: 0.171652 Nov 17 03:34:52.818046 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 978/1924] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:34:52 2021] GET /compute/v2.1/servers/0698dc5b-5f47-46c4-ace8-f5e891a964a0 => generated 1565 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:34:52.822898 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-779cb112-57d4-418f-9672-e2e6da4f1172 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:34:52.823852 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-779cb112-57d4-418f-9672-e2e6da4f1172 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] [instance: 5d54db85-b991-4890-abaa-952413baa2e7] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:34:52.829503 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-779cb112-57d4-418f-9672-e2e6da4f1172 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:34:52.829953 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-779cb112-57d4-418f-9672-e2e6da4f1172 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:34:52.830726 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-779cb112-57d4-418f-9672-e2e6da4f1172 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:34:52.831158 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-779cb112-57d4-418f-9672-e2e6da4f1172 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:34:52.860692 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-779cb112-57d4-418f-9672-e2e6da4f1172 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] 10.222.0.11 "GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041563 Nov 17 03:34:52.861504 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 979/1925] 10.222.0.11 () {60 vars in 1342 bytes} [Wed Nov 17 03:34:52 2021] GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 17 03:34:52.867306 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-cad976c4-fbba-4f04-aec2-891620cbc239 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:34:52.867974 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-cad976c4-fbba-4f04-aec2-891620cbc239 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] [instance: 5ddbfaaa-fabf-4324-941c-8868625ffefc] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:34:52.873621 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-cad976c4-fbba-4f04-aec2-891620cbc239 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:34:52.874088 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-cad976c4-fbba-4f04-aec2-891620cbc239 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:34:52.874885 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-cad976c4-fbba-4f04-aec2-891620cbc239 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:34:52.875306 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-cad976c4-fbba-4f04-aec2-891620cbc239 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:34:52.936090 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-cad976c4-fbba-4f04-aec2-891620cbc239 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80763e09d44c475ea2425b22874e9612', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fef02a1dd77946a2ac0e0414b557435f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:34:52.943494 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-cad976c4-fbba-4f04-aec2-891620cbc239 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] 10.222.0.11 "GET /compute/v2.1/servers/5ddbfaaa-fabf-4324-941c-8868625ffefc" status: 200 len: 1226 microversion: 2.1 time: 0.080543 Nov 17 03:34:52.944332 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 980/1926] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:34:52 2021] GET /compute/v2.1/servers/5ddbfaaa-fabf-4324-941c-8868625ffefc => generated 1226 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:34:52.949684 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [req-229a8b47-f8b2-4698-ad62-4929a609f9e2 req-a24fa14a-cb59-444f-8985-2f9b4058844e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9192e77c-eef4-40f6-85f6-afe009ad232f", "name": "network-vif-plugged", "status": "completed", "tag": "a8f2f0a2-c75a-46ef-9d80-9edfed887be8"}]} {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 17 03:34:52.951176 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 17 03:34:52.951176 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: warnings.warn(msg) Nov 17 03:34:52.957909 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [req-229a8b47-f8b2-4698-ad62-4929a609f9e2 req-a24fa14a-cb59-444f-8985-2f9b4058844e service nova] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:34:52.958345 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [req-229a8b47-f8b2-4698-ad62-4929a609f9e2 req-a24fa14a-cb59-444f-8985-2f9b4058844e service nova] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:34:52.969242 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.compute.server_external_events [req-229a8b47-f8b2-4698-ad62-4929a609f9e2 req-a24fa14a-cb59-444f-8985-2f9b4058844e service nova] Creating event network-vif-plugged:a8f2f0a2-c75a-46ef-9d80-9edfed887be8 for instance 9192e77c-eef4-40f6-85f6-afe009ad232f on hv-cinder-81803 Nov 17 03:34:52.973991 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [req-229a8b47-f8b2-4698-ad62-4929a609f9e2 req-a24fa14a-cb59-444f-8985-2f9b4058844e service nova] 10.222.0.11 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028096 Nov 17 03:34:52.974582 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 981/1927] 10.222.0.11 () {64 vars in 1317 bytes} [Wed Nov 17 03:34:52 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 17 03:34:53.462697 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-c0a42ae6-a92c-4d03-9908-40540128e057 tempest-AttachVolumeTestJSON-1651611701 tempest-AttachVolumeTestJSON-1651611701-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:34:53.463713 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-c0a42ae6-a92c-4d03-9908-40540128e057 tempest-AttachVolumeTestJSON-1651611701 tempest-AttachVolumeTestJSON-1651611701-project] [instance: 9192e77c-eef4-40f6-85f6-afe009ad232f] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:34:53.474254 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-c0a42ae6-a92c-4d03-9908-40540128e057 tempest-AttachVolumeTestJSON-1651611701 tempest-AttachVolumeTestJSON-1651611701-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:34:53.475010 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-c0a42ae6-a92c-4d03-9908-40540128e057 tempest-AttachVolumeTestJSON-1651611701 tempest-AttachVolumeTestJSON-1651611701-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:34:53.476299 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-c0a42ae6-a92c-4d03-9908-40540128e057 tempest-AttachVolumeTestJSON-1651611701 tempest-AttachVolumeTestJSON-1651611701-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:34:53.477040 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-c0a42ae6-a92c-4d03-9908-40540128e057 tempest-AttachVolumeTestJSON-1651611701 tempest-AttachVolumeTestJSON-1651611701-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:34:53.610632 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-c0a42ae6-a92c-4d03-9908-40540128e057 tempest-AttachVolumeTestJSON-1651611701 tempest-AttachVolumeTestJSON-1651611701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1110e625f8f3451aafcdcac96d3e9ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bf44d5ada38487eb55a9f4b7d52862d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:34:53.622153 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-c0a42ae6-a92c-4d03-9908-40540128e057 tempest-AttachVolumeTestJSON-1651611701 tempest-AttachVolumeTestJSON-1651611701-project] 10.222.0.11 "GET /compute/v2.1/servers/9192e77c-eef4-40f6-85f6-afe009ad232f" status: 200 len: 1363 microversion: 2.1 time: 0.166386 Nov 17 03:34:53.622951 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 982/1928] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:34:53 2021] GET /compute/v2.1/servers/9192e77c-eef4-40f6-85f6-afe009ad232f => generated 1363 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:34:53.833946 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-f905dfdb-5c30-4418-a1cb-4e0e9e403fd2 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:34:53.834572 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-f905dfdb-5c30-4418-a1cb-4e0e9e403fd2 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] [instance: 0698dc5b-5f47-46c4-ace8-f5e891a964a0] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:34:53.844810 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-f905dfdb-5c30-4418-a1cb-4e0e9e403fd2 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:34:53.845299 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-f905dfdb-5c30-4418-a1cb-4e0e9e403fd2 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:34:53.846080 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-f905dfdb-5c30-4418-a1cb-4e0e9e403fd2 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:34:53.846515 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-f905dfdb-5c30-4418-a1cb-4e0e9e403fd2 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:34:54.246430 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-f905dfdb-5c30-4418-a1cb-4e0e9e403fd2 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '163b2f24a72649ac8084be1cac32fa09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e123e9b86124c93a7fc2db9984e7466', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:34:54.254279 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-f905dfdb-5c30-4418-a1cb-4e0e9e403fd2 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] 10.222.0.11 "GET /compute/v2.1/servers/0698dc5b-5f47-46c4-ace8-f5e891a964a0" status: 200 len: 1565 microversion: 2.1 time: 0.424097 Nov 17 03:34:54.254849 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 983/1929] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:34:53 2021] GET /compute/v2.1/servers/0698dc5b-5f47-46c4-ace8-f5e891a964a0 => generated 1565 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:34:54.259277 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-2055f400-d48a-4226-a7b2-042b2288ad43 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:34:54.260147 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-2055f400-d48a-4226-a7b2-042b2288ad43 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] [instance: 5d54db85-b991-4890-abaa-952413baa2e7] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:34:54.266035 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-2055f400-d48a-4226-a7b2-042b2288ad43 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:34:54.266480 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-2055f400-d48a-4226-a7b2-042b2288ad43 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:34:54.267239 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-2055f400-d48a-4226-a7b2-042b2288ad43 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:34:54.267667 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-2055f400-d48a-4226-a7b2-042b2288ad43 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:34:54.300210 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-2055f400-d48a-4226-a7b2-042b2288ad43 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] 10.222.0.11 "GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044332 Nov 17 03:34:54.300770 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 984/1930] 10.222.0.11 () {60 vars in 1342 bytes} [Wed Nov 17 03:34:54 2021] GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 17 03:34:54.305416 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-31ef2230-b6fc-47fe-99f8-47f4c642fa47 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:34:54.306095 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-31ef2230-b6fc-47fe-99f8-47f4c642fa47 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] [instance: 5ddbfaaa-fabf-4324-941c-8868625ffefc] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:34:54.311701 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-31ef2230-b6fc-47fe-99f8-47f4c642fa47 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:34:54.312138 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-31ef2230-b6fc-47fe-99f8-47f4c642fa47 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:34:54.312923 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-31ef2230-b6fc-47fe-99f8-47f4c642fa47 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:34:54.313353 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-31ef2230-b6fc-47fe-99f8-47f4c642fa47 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:34:54.373357 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-31ef2230-b6fc-47fe-99f8-47f4c642fa47 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80763e09d44c475ea2425b22874e9612', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fef02a1dd77946a2ac0e0414b557435f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:34:54.381076 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-31ef2230-b6fc-47fe-99f8-47f4c642fa47 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] 10.222.0.11 "GET /compute/v2.1/servers/5ddbfaaa-fabf-4324-941c-8868625ffefc" status: 200 len: 1226 microversion: 2.1 time: 0.079308 Nov 17 03:34:54.381645 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 985/1931] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:34:54 2021] GET /compute/v2.1/servers/5ddbfaaa-fabf-4324-941c-8868625ffefc => generated 1226 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:34:54.643257 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-01c33aad-9616-4243-b65e-1130364430a8 tempest-AttachVolumeTestJSON-1651611701 tempest-AttachVolumeTestJSON-1651611701-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:34:54.644123 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-01c33aad-9616-4243-b65e-1130364430a8 tempest-AttachVolumeTestJSON-1651611701 tempest-AttachVolumeTestJSON-1651611701-project] [instance: 9192e77c-eef4-40f6-85f6-afe009ad232f] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:34:54.652415 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-01c33aad-9616-4243-b65e-1130364430a8 tempest-AttachVolumeTestJSON-1651611701 tempest-AttachVolumeTestJSON-1651611701-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:34:54.652897 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-01c33aad-9616-4243-b65e-1130364430a8 tempest-AttachVolumeTestJSON-1651611701 tempest-AttachVolumeTestJSON-1651611701-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:34:54.653682 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-01c33aad-9616-4243-b65e-1130364430a8 tempest-AttachVolumeTestJSON-1651611701 tempest-AttachVolumeTestJSON-1651611701-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:34:54.654123 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-01c33aad-9616-4243-b65e-1130364430a8 tempest-AttachVolumeTestJSON-1651611701 tempest-AttachVolumeTestJSON-1651611701-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:34:54.788871 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-01c33aad-9616-4243-b65e-1130364430a8 tempest-AttachVolumeTestJSON-1651611701 tempest-AttachVolumeTestJSON-1651611701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1110e625f8f3451aafcdcac96d3e9ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bf44d5ada38487eb55a9f4b7d52862d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:34:54.796606 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-01c33aad-9616-4243-b65e-1130364430a8 tempest-AttachVolumeTestJSON-1651611701 tempest-AttachVolumeTestJSON-1651611701-project] 10.222.0.11 "GET /compute/v2.1/servers/9192e77c-eef4-40f6-85f6-afe009ad232f" status: 200 len: 1549 microversion: 2.1 time: 0.159640 Nov 17 03:34:54.797216 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 986/1932] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:34:54 2021] GET /compute/v2.1/servers/9192e77c-eef4-40f6-85f6-afe009ad232f => generated 1549 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:34:54.812694 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-f32660d6-0ffa-4a4b-85c2-a813812a338c tempest-AttachVolumeTestJSON-1651611701 tempest-AttachVolumeTestJSON-1651611701-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:34:54.813208 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-f32660d6-0ffa-4a4b-85c2-a813812a338c tempest-AttachVolumeTestJSON-1651611701 tempest-AttachVolumeTestJSON-1651611701-project] [instance: 9192e77c-eef4-40f6-85f6-afe009ad232f] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:34:54.819325 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-f32660d6-0ffa-4a4b-85c2-a813812a338c tempest-AttachVolumeTestJSON-1651611701 tempest-AttachVolumeTestJSON-1651611701-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:34:54.819768 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-f32660d6-0ffa-4a4b-85c2-a813812a338c tempest-AttachVolumeTestJSON-1651611701 tempest-AttachVolumeTestJSON-1651611701-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:34:54.820729 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-f32660d6-0ffa-4a4b-85c2-a813812a338c tempest-AttachVolumeTestJSON-1651611701 tempest-AttachVolumeTestJSON-1651611701-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:34:54.821293 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-f32660d6-0ffa-4a4b-85c2-a813812a338c tempest-AttachVolumeTestJSON-1651611701 tempest-AttachVolumeTestJSON-1651611701-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:34:54.907772 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-f32660d6-0ffa-4a4b-85c2-a813812a338c tempest-AttachVolumeTestJSON-1651611701 tempest-AttachVolumeTestJSON-1651611701-project] 10.222.0.11 "GET /compute/v2.1/servers/9192e77c-eef4-40f6-85f6-afe009ad232f/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.098109 Nov 17 03:34:54.908372 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 987/1933] 10.222.0.11 () {58 vars in 1274 bytes} [Wed Nov 17 03:34:54 2021] GET /compute/v2.1/servers/9192e77c-eef4-40f6-85f6-afe009ad232f/os-interface => generated 284 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 17 03:34:55.271491 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-044f6167-498b-4966-8207-71314cd8f968 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:34:55.272100 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-044f6167-498b-4966-8207-71314cd8f968 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] [instance: 0698dc5b-5f47-46c4-ace8-f5e891a964a0] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:34:55.278916 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-044f6167-498b-4966-8207-71314cd8f968 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:34:55.279390 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-044f6167-498b-4966-8207-71314cd8f968 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:34:55.280165 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-044f6167-498b-4966-8207-71314cd8f968 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:34:55.280593 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-044f6167-498b-4966-8207-71314cd8f968 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:34:55.533830 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-044f6167-498b-4966-8207-71314cd8f968 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '163b2f24a72649ac8084be1cac32fa09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e123e9b86124c93a7fc2db9984e7466', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:34:55.541765 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-044f6167-498b-4966-8207-71314cd8f968 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] 10.222.0.11 "GET /compute/v2.1/servers/0698dc5b-5f47-46c4-ace8-f5e891a964a0" status: 200 len: 1565 microversion: 2.1 time: 0.273999 Nov 17 03:34:55.542342 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 988/1934] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:34:55 2021] GET /compute/v2.1/servers/0698dc5b-5f47-46c4-ace8-f5e891a964a0 => generated 1565 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:34:55.548368 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-753b9e94-93df-4ae6-a699-c1169d0ba690 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:34:55.549288 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-753b9e94-93df-4ae6-a699-c1169d0ba690 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] [instance: 5d54db85-b991-4890-abaa-952413baa2e7] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:34:55.555502 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-753b9e94-93df-4ae6-a699-c1169d0ba690 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:34:55.555946 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-753b9e94-93df-4ae6-a699-c1169d0ba690 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:34:55.556721 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-753b9e94-93df-4ae6-a699-c1169d0ba690 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:34:55.557184 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-753b9e94-93df-4ae6-a699-c1169d0ba690 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:34:55.586061 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-753b9e94-93df-4ae6-a699-c1169d0ba690 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] 10.222.0.11 "GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042598 Nov 17 03:34:55.586667 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 989/1935] 10.222.0.11 () {60 vars in 1342 bytes} [Wed Nov 17 03:34:55 2021] GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 17 03:34:55.593248 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-c24e4821-494c-43f6-b9ea-7736df992108 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:34:55.593837 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-c24e4821-494c-43f6-b9ea-7736df992108 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] [instance: 5ddbfaaa-fabf-4324-941c-8868625ffefc] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:34:55.599543 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-c24e4821-494c-43f6-b9ea-7736df992108 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:34:55.599984 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-c24e4821-494c-43f6-b9ea-7736df992108 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:34:55.600720 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-c24e4821-494c-43f6-b9ea-7736df992108 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:34:55.601192 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-c24e4821-494c-43f6-b9ea-7736df992108 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:34:55.666475 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-c24e4821-494c-43f6-b9ea-7736df992108 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80763e09d44c475ea2425b22874e9612', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fef02a1dd77946a2ac0e0414b557435f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:34:55.674086 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-c24e4821-494c-43f6-b9ea-7736df992108 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] 10.222.0.11 "GET /compute/v2.1/servers/5ddbfaaa-fabf-4324-941c-8868625ffefc" status: 200 len: 1226 microversion: 2.1 time: 0.086478 Nov 17 03:34:55.674653 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 990/1936] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:34:55 2021] GET /compute/v2.1/servers/5ddbfaaa-fabf-4324-941c-8868625ffefc => generated 1226 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:34:55.925402 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-f3f3cbd1-1967-498a-9941-7ec9845af919 tempest-AttachVolumeTestJSON-1651611701 tempest-AttachVolumeTestJSON-1651611701-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 17 03:34:55.926395 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-f3f3cbd1-1967-498a-9941-7ec9845af919 tempest-AttachVolumeTestJSON-1651611701 tempest-AttachVolumeTestJSON-1651611701-project] [instance: 9192e77c-eef4-40f6-85f6-afe009ad232f] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:34:55.933667 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-f3f3cbd1-1967-498a-9941-7ec9845af919 tempest-AttachVolumeTestJSON-1651611701 tempest-AttachVolumeTestJSON-1651611701-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:34:55.934194 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-f3f3cbd1-1967-498a-9941-7ec9845af919 tempest-AttachVolumeTestJSON-1651611701 tempest-AttachVolumeTestJSON-1651611701-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:34:55.935043 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-f3f3cbd1-1967-498a-9941-7ec9845af919 tempest-AttachVolumeTestJSON-1651611701 tempest-AttachVolumeTestJSON-1651611701-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:34:55.935545 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-f3f3cbd1-1967-498a-9941-7ec9845af919 tempest-AttachVolumeTestJSON-1651611701 tempest-AttachVolumeTestJSON-1651611701-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:34:56.019102 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-f3f3cbd1-1967-498a-9941-7ec9845af919 tempest-AttachVolumeTestJSON-1651611701 tempest-AttachVolumeTestJSON-1651611701-project] 10.222.0.11 "POST /compute/v2.1/servers/9192e77c-eef4-40f6-85f6-afe009ad232f/action" status: 200 len: 14 microversion: 2.1 time: 0.097296 Nov 17 03:34:56.019736 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 991/1937] 10.222.0.11 () {60 vars in 1277 bytes} [Wed Nov 17 03:34:55 2021] POST /compute/v2.1/servers/9192e77c-eef4-40f6-85f6-afe009ad232f/action => generated 14 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 17 03:34:56.025318 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [req-a9aa8186-2851-465a-a40e-265143fc9984 req-47d46401-4db1-4ac5-9562-c4e7d7afb024 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9192e77c-eef4-40f6-85f6-afe009ad232f", "tag": "a8f2f0a2-c75a-46ef-9d80-9edfed887be8"}]} {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 17 03:34:56.026810 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 17 03:34:56.026810 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: warnings.warn(msg) Nov 17 03:34:56.034995 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [req-a9aa8186-2851-465a-a40e-265143fc9984 req-47d46401-4db1-4ac5-9562-c4e7d7afb024 service nova] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:34:56.035435 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [req-a9aa8186-2851-465a-a40e-265143fc9984 req-47d46401-4db1-4ac5-9562-c4e7d7afb024 service nova] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:34:56.047638 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.compute.server_external_events [req-a9aa8186-2851-465a-a40e-265143fc9984 req-47d46401-4db1-4ac5-9562-c4e7d7afb024 service nova] Creating event network-changed:a8f2f0a2-c75a-46ef-9d80-9edfed887be8 for instance 9192e77c-eef4-40f6-85f6-afe009ad232f on hv-cinder-81803 Nov 17 03:34:56.056655 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [req-a9aa8186-2851-465a-a40e-265143fc9984 req-47d46401-4db1-4ac5-9562-c4e7d7afb024 service nova] 10.222.0.11 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034892 Nov 17 03:34:56.057371 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 992/1938] 10.222.0.11 () {64 vars in 1317 bytes} [Wed Nov 17 03:34:56 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 17 03:34:56.560091 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-5af0b8a6-6eaa-49c4-a0e2-429ed2d7a239 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:34:56.560801 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-5af0b8a6-6eaa-49c4-a0e2-429ed2d7a239 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] [instance: 0698dc5b-5f47-46c4-ace8-f5e891a964a0] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:34:56.567419 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-5af0b8a6-6eaa-49c4-a0e2-429ed2d7a239 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:34:56.567869 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-5af0b8a6-6eaa-49c4-a0e2-429ed2d7a239 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:34:56.568647 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-5af0b8a6-6eaa-49c4-a0e2-429ed2d7a239 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:34:56.569102 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-5af0b8a6-6eaa-49c4-a0e2-429ed2d7a239 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:34:56.704619 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-5af0b8a6-6eaa-49c4-a0e2-429ed2d7a239 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '163b2f24a72649ac8084be1cac32fa09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e123e9b86124c93a7fc2db9984e7466', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:34:56.713352 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-5af0b8a6-6eaa-49c4-a0e2-429ed2d7a239 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] 10.222.0.11 "GET /compute/v2.1/servers/0698dc5b-5f47-46c4-ace8-f5e891a964a0" status: 200 len: 1565 microversion: 2.1 time: 0.157267 Nov 17 03:34:56.713934 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 993/1939] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:34:56 2021] GET /compute/v2.1/servers/0698dc5b-5f47-46c4-ace8-f5e891a964a0 => generated 1565 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:34:56.718701 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-27ca90df-ba9e-4857-a7d1-71cc05770991 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:34:56.719608 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-27ca90df-ba9e-4857-a7d1-71cc05770991 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] [instance: 5d54db85-b991-4890-abaa-952413baa2e7] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:34:56.725582 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-27ca90df-ba9e-4857-a7d1-71cc05770991 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:34:56.726025 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-27ca90df-ba9e-4857-a7d1-71cc05770991 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:34:56.726879 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-27ca90df-ba9e-4857-a7d1-71cc05770991 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:34:56.727381 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-27ca90df-ba9e-4857-a7d1-71cc05770991 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:34:56.757120 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-27ca90df-ba9e-4857-a7d1-71cc05770991 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] 10.222.0.11 "GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042103 Nov 17 03:34:56.757698 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 994/1940] 10.222.0.11 () {60 vars in 1342 bytes} [Wed Nov 17 03:34:56 2021] GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 17 03:34:56.762208 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-e131a33a-cb7e-4d32-992f-aa45c010c9da tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:34:56.762809 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-e131a33a-cb7e-4d32-992f-aa45c010c9da tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] [instance: 5ddbfaaa-fabf-4324-941c-8868625ffefc] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:34:56.768681 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-e131a33a-cb7e-4d32-992f-aa45c010c9da tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:34:56.769158 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-e131a33a-cb7e-4d32-992f-aa45c010c9da tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:34:56.769925 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-e131a33a-cb7e-4d32-992f-aa45c010c9da tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:34:56.770346 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-e131a33a-cb7e-4d32-992f-aa45c010c9da tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:34:56.836163 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-e131a33a-cb7e-4d32-992f-aa45c010c9da tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80763e09d44c475ea2425b22874e9612', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fef02a1dd77946a2ac0e0414b557435f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:34:56.844114 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-e131a33a-cb7e-4d32-992f-aa45c010c9da tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] 10.222.0.11 "GET /compute/v2.1/servers/5ddbfaaa-fabf-4324-941c-8868625ffefc" status: 200 len: 1226 microversion: 2.1 time: 0.085361 Nov 17 03:34:56.844682 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 995/1941] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:34:56 2021] GET /compute/v2.1/servers/5ddbfaaa-fabf-4324-941c-8868625ffefc => generated 1226 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:34:57.033200 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-19f926aa-b2a9-4f85-923d-e86540780883 tempest-AttachVolumeTestJSON-1651611701 tempest-AttachVolumeTestJSON-1651611701-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 17 03:34:57.035331 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-19f926aa-b2a9-4f85-923d-e86540780883 tempest-AttachVolumeTestJSON-1651611701 tempest-AttachVolumeTestJSON-1651611701-project] [instance: 9192e77c-eef4-40f6-85f6-afe009ad232f] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:34:57.044109 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-19f926aa-b2a9-4f85-923d-e86540780883 tempest-AttachVolumeTestJSON-1651611701 tempest-AttachVolumeTestJSON-1651611701-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:34:57.044566 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-19f926aa-b2a9-4f85-923d-e86540780883 tempest-AttachVolumeTestJSON-1651611701 tempest-AttachVolumeTestJSON-1651611701-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:34:57.045426 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-19f926aa-b2a9-4f85-923d-e86540780883 tempest-AttachVolumeTestJSON-1651611701 tempest-AttachVolumeTestJSON-1651611701-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:34:57.045874 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-19f926aa-b2a9-4f85-923d-e86540780883 tempest-AttachVolumeTestJSON-1651611701 tempest-AttachVolumeTestJSON-1651611701-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:34:57.130428 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-19f926aa-b2a9-4f85-923d-e86540780883 tempest-AttachVolumeTestJSON-1651611701 tempest-AttachVolumeTestJSON-1651611701-project] 10.222.0.11 "POST /compute/v2.1/servers/9192e77c-eef4-40f6-85f6-afe009ad232f/action" status: 200 len: 14 microversion: 2.1 time: 0.103599 Nov 17 03:34:57.131100 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 996/1942] 10.222.0.11 () {60 vars in 1277 bytes} [Wed Nov 17 03:34:57 2021] POST /compute/v2.1/servers/9192e77c-eef4-40f6-85f6-afe009ad232f/action => generated 14 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 17 03:34:57.735360 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-7f86ffbe-426d-4aef-bdc2-9f588f31fc31 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:34:57.736522 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-7f86ffbe-426d-4aef-bdc2-9f588f31fc31 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] [instance: 0698dc5b-5f47-46c4-ace8-f5e891a964a0] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:34:57.746047 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-7f86ffbe-426d-4aef-bdc2-9f588f31fc31 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:34:57.746502 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-7f86ffbe-426d-4aef-bdc2-9f588f31fc31 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:34:57.747291 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-7f86ffbe-426d-4aef-bdc2-9f588f31fc31 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:34:57.747731 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-7f86ffbe-426d-4aef-bdc2-9f588f31fc31 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:34:57.881750 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-7f86ffbe-426d-4aef-bdc2-9f588f31fc31 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '163b2f24a72649ac8084be1cac32fa09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e123e9b86124c93a7fc2db9984e7466', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:34:57.890088 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-7f86ffbe-426d-4aef-bdc2-9f588f31fc31 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] 10.222.0.11 "GET /compute/v2.1/servers/0698dc5b-5f47-46c4-ace8-f5e891a964a0" status: 200 len: 1565 microversion: 2.1 time: 0.161651 Nov 17 03:34:57.890675 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 997/1943] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:34:57 2021] GET /compute/v2.1/servers/0698dc5b-5f47-46c4-ace8-f5e891a964a0 => generated 1565 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:34:57.895195 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-cbef2c7f-480e-4709-b8ed-4baf58e2c62b tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:34:57.896136 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-cbef2c7f-480e-4709-b8ed-4baf58e2c62b tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] [instance: 5d54db85-b991-4890-abaa-952413baa2e7] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:34:57.902689 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-cbef2c7f-480e-4709-b8ed-4baf58e2c62b tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:34:57.903142 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-cbef2c7f-480e-4709-b8ed-4baf58e2c62b tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:34:57.903933 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-cbef2c7f-480e-4709-b8ed-4baf58e2c62b tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:34:57.904372 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-cbef2c7f-480e-4709-b8ed-4baf58e2c62b tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:34:57.938575 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-cbef2c7f-480e-4709-b8ed-4baf58e2c62b tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] 10.222.0.11 "GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046831 Nov 17 03:34:57.939188 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 998/1944] 10.222.0.11 () {60 vars in 1342 bytes} [Wed Nov 17 03:34:57 2021] GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 17 03:34:57.943673 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-85537d7b-8984-47b5-851b-f592b5fa8c0f tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:34:57.944270 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-85537d7b-8984-47b5-851b-f592b5fa8c0f tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] [instance: 5ddbfaaa-fabf-4324-941c-8868625ffefc] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:34:57.950546 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-85537d7b-8984-47b5-851b-f592b5fa8c0f tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:34:57.950998 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-85537d7b-8984-47b5-851b-f592b5fa8c0f tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:34:57.951775 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-85537d7b-8984-47b5-851b-f592b5fa8c0f tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:34:57.952204 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-85537d7b-8984-47b5-851b-f592b5fa8c0f tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:34:58.021890 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-85537d7b-8984-47b5-851b-f592b5fa8c0f tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80763e09d44c475ea2425b22874e9612', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fef02a1dd77946a2ac0e0414b557435f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:34:58.035290 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-85537d7b-8984-47b5-851b-f592b5fa8c0f tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] 10.222.0.11 "GET /compute/v2.1/servers/5ddbfaaa-fabf-4324-941c-8868625ffefc" status: 200 len: 1226 microversion: 2.1 time: 0.094835 Nov 17 03:34:58.036662 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 999/1945] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:34:57 2021] GET /compute/v2.1/servers/5ddbfaaa-fabf-4324-941c-8868625ffefc => generated 1226 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:34:58.144842 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-3fd199ce-5adb-4b17-8385-28205cfb0d0b tempest-AttachVolumeTestJSON-1651611701 tempest-AttachVolumeTestJSON-1651611701-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 17 03:34:58.146405 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-3fd199ce-5adb-4b17-8385-28205cfb0d0b tempest-AttachVolumeTestJSON-1651611701 tempest-AttachVolumeTestJSON-1651611701-project] [instance: 9192e77c-eef4-40f6-85f6-afe009ad232f] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:34:58.157249 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-3fd199ce-5adb-4b17-8385-28205cfb0d0b tempest-AttachVolumeTestJSON-1651611701 tempest-AttachVolumeTestJSON-1651611701-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:34:58.158001 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-3fd199ce-5adb-4b17-8385-28205cfb0d0b tempest-AttachVolumeTestJSON-1651611701 tempest-AttachVolumeTestJSON-1651611701-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:34:58.159276 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-3fd199ce-5adb-4b17-8385-28205cfb0d0b tempest-AttachVolumeTestJSON-1651611701 tempest-AttachVolumeTestJSON-1651611701-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:34:58.160031 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-3fd199ce-5adb-4b17-8385-28205cfb0d0b tempest-AttachVolumeTestJSON-1651611701 tempest-AttachVolumeTestJSON-1651611701-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:34:58.246772 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-3fd199ce-5adb-4b17-8385-28205cfb0d0b tempest-AttachVolumeTestJSON-1651611701 tempest-AttachVolumeTestJSON-1651611701-project] 10.222.0.11 "POST /compute/v2.1/servers/9192e77c-eef4-40f6-85f6-afe009ad232f/action" status: 200 len: 14 microversion: 2.1 time: 0.107522 Nov 17 03:34:58.247456 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 1000/1946] 10.222.0.11 () {60 vars in 1277 bytes} [Wed Nov 17 03:34:58 2021] POST /compute/v2.1/servers/9192e77c-eef4-40f6-85f6-afe009ad232f/action => generated 14 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 17 03:34:58.912290 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-639bef8c-0188-4a4a-b7b6-effea4ea5ad1 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:34:58.913480 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-639bef8c-0188-4a4a-b7b6-effea4ea5ad1 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] [instance: 0698dc5b-5f47-46c4-ace8-f5e891a964a0] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:34:58.921435 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-639bef8c-0188-4a4a-b7b6-effea4ea5ad1 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:34:58.921907 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-639bef8c-0188-4a4a-b7b6-effea4ea5ad1 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:34:58.922715 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-639bef8c-0188-4a4a-b7b6-effea4ea5ad1 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:34:58.923159 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-639bef8c-0188-4a4a-b7b6-effea4ea5ad1 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:34:59.076971 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-639bef8c-0188-4a4a-b7b6-effea4ea5ad1 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '163b2f24a72649ac8084be1cac32fa09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e123e9b86124c93a7fc2db9984e7466', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:34:59.084911 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-639bef8c-0188-4a4a-b7b6-effea4ea5ad1 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] 10.222.0.11 "GET /compute/v2.1/servers/0698dc5b-5f47-46c4-ace8-f5e891a964a0" status: 200 len: 1565 microversion: 2.1 time: 0.179408 Nov 17 03:34:59.085487 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 1001/1947] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:34:58 2021] GET /compute/v2.1/servers/0698dc5b-5f47-46c4-ace8-f5e891a964a0 => generated 1565 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:34:59.090217 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-a847aee2-c587-4800-99c4-7210c442c70c tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:34:59.091118 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-a847aee2-c587-4800-99c4-7210c442c70c tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] [instance: 5d54db85-b991-4890-abaa-952413baa2e7] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:34:59.097083 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-a847aee2-c587-4800-99c4-7210c442c70c tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:34:59.097534 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-a847aee2-c587-4800-99c4-7210c442c70c tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:34:59.098300 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-a847aee2-c587-4800-99c4-7210c442c70c tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:34:59.098734 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-a847aee2-c587-4800-99c4-7210c442c70c tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:34:59.127478 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-a847aee2-c587-4800-99c4-7210c442c70c tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] 10.222.0.11 "GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.040716 Nov 17 03:34:59.128026 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 1002/1948] 10.222.0.11 () {60 vars in 1342 bytes} [Wed Nov 17 03:34:59 2021] GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 17 03:34:59.132091 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-fa71fb78-37b5-4be9-9f8c-fff8546b4cc3 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:34:59.132685 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-fa71fb78-37b5-4be9-9f8c-fff8546b4cc3 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] [instance: 5ddbfaaa-fabf-4324-941c-8868625ffefc] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:34:59.138487 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-fa71fb78-37b5-4be9-9f8c-fff8546b4cc3 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:34:59.138933 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-fa71fb78-37b5-4be9-9f8c-fff8546b4cc3 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:34:59.139689 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-fa71fb78-37b5-4be9-9f8c-fff8546b4cc3 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:34:59.140106 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-fa71fb78-37b5-4be9-9f8c-fff8546b4cc3 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:34:59.198497 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-fa71fb78-37b5-4be9-9f8c-fff8546b4cc3 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80763e09d44c475ea2425b22874e9612', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fef02a1dd77946a2ac0e0414b557435f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:34:59.206657 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-fa71fb78-37b5-4be9-9f8c-fff8546b4cc3 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] 10.222.0.11 "GET /compute/v2.1/servers/5ddbfaaa-fabf-4324-941c-8868625ffefc" status: 200 len: 1226 microversion: 2.1 time: 0.077665 Nov 17 03:34:59.207227 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 1003/1949] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:34:59 2021] GET /compute/v2.1/servers/5ddbfaaa-fabf-4324-941c-8868625ffefc => generated 1226 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:34:59.259587 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-4fec6ee6-413c-4340-914c-97d29f59ec48 tempest-AttachVolumeTestJSON-1651611701 tempest-AttachVolumeTestJSON-1651611701-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 17 03:34:59.260755 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-4fec6ee6-413c-4340-914c-97d29f59ec48 tempest-AttachVolumeTestJSON-1651611701 tempest-AttachVolumeTestJSON-1651611701-project] [instance: 9192e77c-eef4-40f6-85f6-afe009ad232f] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:34:59.269247 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-4fec6ee6-413c-4340-914c-97d29f59ec48 tempest-AttachVolumeTestJSON-1651611701 tempest-AttachVolumeTestJSON-1651611701-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:34:59.269867 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-4fec6ee6-413c-4340-914c-97d29f59ec48 tempest-AttachVolumeTestJSON-1651611701 tempest-AttachVolumeTestJSON-1651611701-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:34:59.271134 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-4fec6ee6-413c-4340-914c-97d29f59ec48 tempest-AttachVolumeTestJSON-1651611701 tempest-AttachVolumeTestJSON-1651611701-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:34:59.271813 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-4fec6ee6-413c-4340-914c-97d29f59ec48 tempest-AttachVolumeTestJSON-1651611701 tempest-AttachVolumeTestJSON-1651611701-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:34:59.357701 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-4fec6ee6-413c-4340-914c-97d29f59ec48 tempest-AttachVolumeTestJSON-1651611701 tempest-AttachVolumeTestJSON-1651611701-project] 10.222.0.11 "POST /compute/v2.1/servers/9192e77c-eef4-40f6-85f6-afe009ad232f/action" status: 200 len: 14 microversion: 2.1 time: 0.102828 Nov 17 03:34:59.358402 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 1004/1950] 10.222.0.11 () {60 vars in 1277 bytes} [Wed Nov 17 03:34:59 2021] POST /compute/v2.1/servers/9192e77c-eef4-40f6-85f6-afe009ad232f/action => generated 14 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 17 03:35:00.102853 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-3f602ad1-388a-4c58-9c50-ff6b611cf4cd tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:35:00.103586 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-3f602ad1-388a-4c58-9c50-ff6b611cf4cd tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] [instance: 0698dc5b-5f47-46c4-ace8-f5e891a964a0] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:35:00.110921 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-3f602ad1-388a-4c58-9c50-ff6b611cf4cd tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:35:00.111370 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-3f602ad1-388a-4c58-9c50-ff6b611cf4cd tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:35:00.112147 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-3f602ad1-388a-4c58-9c50-ff6b611cf4cd tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:35:00.112563 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-3f602ad1-388a-4c58-9c50-ff6b611cf4cd tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:35:00.254158 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-3f602ad1-388a-4c58-9c50-ff6b611cf4cd tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '163b2f24a72649ac8084be1cac32fa09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e123e9b86124c93a7fc2db9984e7466', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:35:00.262054 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-3f602ad1-388a-4c58-9c50-ff6b611cf4cd tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] 10.222.0.11 "GET /compute/v2.1/servers/0698dc5b-5f47-46c4-ace8-f5e891a964a0" status: 200 len: 1565 microversion: 2.1 time: 0.163427 Nov 17 03:35:00.262612 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 1005/1951] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:35:00 2021] GET /compute/v2.1/servers/0698dc5b-5f47-46c4-ace8-f5e891a964a0 => generated 1565 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:35:00.267132 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-6fced83c-5b69-40b6-af84-1ff617ec5e74 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:35:00.268035 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-6fced83c-5b69-40b6-af84-1ff617ec5e74 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] [instance: 5d54db85-b991-4890-abaa-952413baa2e7] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:35:00.273907 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-6fced83c-5b69-40b6-af84-1ff617ec5e74 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:35:00.274415 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-6fced83c-5b69-40b6-af84-1ff617ec5e74 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:35:00.275208 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-6fced83c-5b69-40b6-af84-1ff617ec5e74 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:35:00.275645 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-6fced83c-5b69-40b6-af84-1ff617ec5e74 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:35:00.305097 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-6fced83c-5b69-40b6-af84-1ff617ec5e74 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] 10.222.0.11 "GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.040970 Nov 17 03:35:00.305865 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 1006/1952] 10.222.0.11 () {60 vars in 1342 bytes} [Wed Nov 17 03:35:00 2021] GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 17 03:35:00.310138 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-22335c72-3873-4d15-bbb6-19ee91f3656f tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:35:00.310683 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-22335c72-3873-4d15-bbb6-19ee91f3656f tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] [instance: 5ddbfaaa-fabf-4324-941c-8868625ffefc] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:35:00.316406 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-22335c72-3873-4d15-bbb6-19ee91f3656f tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:35:00.316895 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-22335c72-3873-4d15-bbb6-19ee91f3656f tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:35:00.317665 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-22335c72-3873-4d15-bbb6-19ee91f3656f tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:35:00.318096 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-22335c72-3873-4d15-bbb6-19ee91f3656f tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:35:00.378534 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-22335c72-3873-4d15-bbb6-19ee91f3656f tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80763e09d44c475ea2425b22874e9612', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fef02a1dd77946a2ac0e0414b557435f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:35:00.386534 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-22335c72-3873-4d15-bbb6-19ee91f3656f tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] 10.222.0.11 "GET /compute/v2.1/servers/5ddbfaaa-fabf-4324-941c-8868625ffefc" status: 200 len: 1226 microversion: 2.1 time: 0.079731 Nov 17 03:35:00.387114 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 1007/1953] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:35:00 2021] GET /compute/v2.1/servers/5ddbfaaa-fabf-4324-941c-8868625ffefc => generated 1226 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:35:00.391675 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-3cbece32-fc25-4e8a-9713-c89148fa3c85 tempest-AttachVolumeTestJSON-1651611701 tempest-AttachVolumeTestJSON-1651611701-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 17 03:35:00.392582 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-3cbece32-fc25-4e8a-9713-c89148fa3c85 tempest-AttachVolumeTestJSON-1651611701 tempest-AttachVolumeTestJSON-1651611701-project] [instance: 9192e77c-eef4-40f6-85f6-afe009ad232f] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:35:00.398671 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-3cbece32-fc25-4e8a-9713-c89148fa3c85 tempest-AttachVolumeTestJSON-1651611701 tempest-AttachVolumeTestJSON-1651611701-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:35:00.399122 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-3cbece32-fc25-4e8a-9713-c89148fa3c85 tempest-AttachVolumeTestJSON-1651611701 tempest-AttachVolumeTestJSON-1651611701-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:35:00.399905 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-3cbece32-fc25-4e8a-9713-c89148fa3c85 tempest-AttachVolumeTestJSON-1651611701 tempest-AttachVolumeTestJSON-1651611701-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:35:00.400989 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-3cbece32-fc25-4e8a-9713-c89148fa3c85 tempest-AttachVolumeTestJSON-1651611701 tempest-AttachVolumeTestJSON-1651611701-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:35:00.508055 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-3cbece32-fc25-4e8a-9713-c89148fa3c85 tempest-AttachVolumeTestJSON-1651611701 tempest-AttachVolumeTestJSON-1651611701-project] 10.222.0.11 "POST /compute/v2.1/servers/9192e77c-eef4-40f6-85f6-afe009ad232f/action" status: 200 len: 14 microversion: 2.1 time: 0.119272 Nov 17 03:35:00.508803 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 1008/1954] 10.222.0.11 () {60 vars in 1277 bytes} [Wed Nov 17 03:35:00 2021] POST /compute/v2.1/servers/9192e77c-eef4-40f6-85f6-afe009ad232f/action => generated 14 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 17 03:35:01.284060 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-7f52597b-c324-4ccd-9409-74a399b1d384 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:35:01.285220 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-7f52597b-c324-4ccd-9409-74a399b1d384 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] [instance: 0698dc5b-5f47-46c4-ace8-f5e891a964a0] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:35:01.294178 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-7f52597b-c324-4ccd-9409-74a399b1d384 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:35:01.294626 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-7f52597b-c324-4ccd-9409-74a399b1d384 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:35:01.295409 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-7f52597b-c324-4ccd-9409-74a399b1d384 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:35:01.295861 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-7f52597b-c324-4ccd-9409-74a399b1d384 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:35:01.444941 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-7f52597b-c324-4ccd-9409-74a399b1d384 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '163b2f24a72649ac8084be1cac32fa09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e123e9b86124c93a7fc2db9984e7466', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:35:01.453269 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-7f52597b-c324-4ccd-9409-74a399b1d384 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] 10.222.0.11 "GET /compute/v2.1/servers/0698dc5b-5f47-46c4-ace8-f5e891a964a0" status: 200 len: 1565 microversion: 2.1 time: 0.175823 Nov 17 03:35:01.453846 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 1009/1955] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:35:01 2021] GET /compute/v2.1/servers/0698dc5b-5f47-46c4-ace8-f5e891a964a0 => generated 1565 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:35:01.458474 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-7dac8b55-a01a-4912-bc45-219d16928635 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:35:01.459363 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-7dac8b55-a01a-4912-bc45-219d16928635 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] [instance: 5d54db85-b991-4890-abaa-952413baa2e7] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:35:01.466230 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-7dac8b55-a01a-4912-bc45-219d16928635 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:35:01.466678 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-7dac8b55-a01a-4912-bc45-219d16928635 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:35:01.467627 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-7dac8b55-a01a-4912-bc45-219d16928635 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:35:01.468163 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-7dac8b55-a01a-4912-bc45-219d16928635 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:35:01.499336 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-7dac8b55-a01a-4912-bc45-219d16928635 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] 10.222.0.11 "GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044462 Nov 17 03:35:01.499893 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 1010/1956] 10.222.0.11 () {60 vars in 1342 bytes} [Wed Nov 17 03:35:01 2021] GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 17 03:35:01.504224 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-3321f8c1-473a-4f7e-b340-9961235ac4dd tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:35:01.504818 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-3321f8c1-473a-4f7e-b340-9961235ac4dd tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] [instance: 5ddbfaaa-fabf-4324-941c-8868625ffefc] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:35:01.510751 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-3321f8c1-473a-4f7e-b340-9961235ac4dd tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:35:01.511195 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-3321f8c1-473a-4f7e-b340-9961235ac4dd tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:35:01.511965 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-3321f8c1-473a-4f7e-b340-9961235ac4dd tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:35:01.512396 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-3321f8c1-473a-4f7e-b340-9961235ac4dd tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:35:01.571992 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-3321f8c1-473a-4f7e-b340-9961235ac4dd tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80763e09d44c475ea2425b22874e9612', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fef02a1dd77946a2ac0e0414b557435f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:35:01.579526 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-3321f8c1-473a-4f7e-b340-9961235ac4dd tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] 10.222.0.11 "GET /compute/v2.1/servers/5ddbfaaa-fabf-4324-941c-8868625ffefc" status: 200 len: 1226 microversion: 2.1 time: 0.078623 Nov 17 03:35:01.580095 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 1011/1957] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:35:01 2021] GET /compute/v2.1/servers/5ddbfaaa-fabf-4324-941c-8868625ffefc => generated 1226 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:35:01.584431 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-7fa05eb2-0988-4a0c-8fca-7f334bb713a9 tempest-AttachVolumeTestJSON-1651611701 tempest-AttachVolumeTestJSON-1651611701-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 17 03:35:01.585364 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-7fa05eb2-0988-4a0c-8fca-7f334bb713a9 tempest-AttachVolumeTestJSON-1651611701 tempest-AttachVolumeTestJSON-1651611701-project] [instance: 9192e77c-eef4-40f6-85f6-afe009ad232f] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:35:01.591310 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-7fa05eb2-0988-4a0c-8fca-7f334bb713a9 tempest-AttachVolumeTestJSON-1651611701 tempest-AttachVolumeTestJSON-1651611701-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:35:01.591760 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-7fa05eb2-0988-4a0c-8fca-7f334bb713a9 tempest-AttachVolumeTestJSON-1651611701 tempest-AttachVolumeTestJSON-1651611701-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:35:01.592531 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-7fa05eb2-0988-4a0c-8fca-7f334bb713a9 tempest-AttachVolumeTestJSON-1651611701 tempest-AttachVolumeTestJSON-1651611701-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:35:01.593010 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-7fa05eb2-0988-4a0c-8fca-7f334bb713a9 tempest-AttachVolumeTestJSON-1651611701 tempest-AttachVolumeTestJSON-1651611701-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:35:01.678526 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-7fa05eb2-0988-4a0c-8fca-7f334bb713a9 tempest-AttachVolumeTestJSON-1651611701 tempest-AttachVolumeTestJSON-1651611701-project] 10.222.0.11 "POST /compute/v2.1/servers/9192e77c-eef4-40f6-85f6-afe009ad232f/action" status: 200 len: 14 microversion: 2.1 time: 0.096708 Nov 17 03:35:01.679813 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 1012/1958] 10.222.0.11 () {60 vars in 1277 bytes} [Wed Nov 17 03:35:01 2021] POST /compute/v2.1/servers/9192e77c-eef4-40f6-85f6-afe009ad232f/action => generated 14 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 17 03:35:02.478524 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-333509bc-ee1c-4971-a12e-206d9b7f02ab tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:35:02.479195 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-333509bc-ee1c-4971-a12e-206d9b7f02ab tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] [instance: 0698dc5b-5f47-46c4-ace8-f5e891a964a0] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:35:02.488719 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-333509bc-ee1c-4971-a12e-206d9b7f02ab tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:35:02.489207 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-333509bc-ee1c-4971-a12e-206d9b7f02ab tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:35:02.489998 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-333509bc-ee1c-4971-a12e-206d9b7f02ab tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:35:02.490431 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-333509bc-ee1c-4971-a12e-206d9b7f02ab tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:35:02.637090 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-333509bc-ee1c-4971-a12e-206d9b7f02ab tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '163b2f24a72649ac8084be1cac32fa09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e123e9b86124c93a7fc2db9984e7466', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:35:02.648864 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-333509bc-ee1c-4971-a12e-206d9b7f02ab tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] 10.222.0.11 "GET /compute/v2.1/servers/0698dc5b-5f47-46c4-ace8-f5e891a964a0" status: 200 len: 1565 microversion: 2.1 time: 0.179279 Nov 17 03:35:02.649565 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 1013/1959] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:35:02 2021] GET /compute/v2.1/servers/0698dc5b-5f47-46c4-ace8-f5e891a964a0 => generated 1565 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:35:02.654075 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-4285bef8-e930-4715-a6ed-c02231605563 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:35:02.654977 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-4285bef8-e930-4715-a6ed-c02231605563 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] [instance: 5d54db85-b991-4890-abaa-952413baa2e7] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:35:02.661984 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-4285bef8-e930-4715-a6ed-c02231605563 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:35:02.662665 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-4285bef8-e930-4715-a6ed-c02231605563 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:35:02.664161 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-4285bef8-e930-4715-a6ed-c02231605563 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:35:02.664759 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-4285bef8-e930-4715-a6ed-c02231605563 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:35:02.695745 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-4285bef8-e930-4715-a6ed-c02231605563 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] 10.222.0.11 "GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045061 Nov 17 03:35:02.696178 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 1014/1960] 10.222.0.11 () {60 vars in 1342 bytes} [Wed Nov 17 03:35:02 2021] GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 17 03:35:02.700261 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-47846f85-79c4-4e66-ade9-121098596f1b tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:35:02.700877 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-47846f85-79c4-4e66-ade9-121098596f1b tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] [instance: 5ddbfaaa-fabf-4324-941c-8868625ffefc] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:35:02.706297 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-47846f85-79c4-4e66-ade9-121098596f1b tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:35:02.706766 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-47846f85-79c4-4e66-ade9-121098596f1b tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:35:02.707517 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-47846f85-79c4-4e66-ade9-121098596f1b tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:35:02.707941 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-47846f85-79c4-4e66-ade9-121098596f1b tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:35:02.769742 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-47846f85-79c4-4e66-ade9-121098596f1b tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80763e09d44c475ea2425b22874e9612', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fef02a1dd77946a2ac0e0414b557435f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:35:02.777353 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-47846f85-79c4-4e66-ade9-121098596f1b tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] 10.222.0.11 "GET /compute/v2.1/servers/5ddbfaaa-fabf-4324-941c-8868625ffefc" status: 200 len: 1226 microversion: 2.1 time: 0.080260 Nov 17 03:35:02.777910 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 1015/1961] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:35:02 2021] GET /compute/v2.1/servers/5ddbfaaa-fabf-4324-941c-8868625ffefc => generated 1226 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:35:02.782220 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-110bb2ed-c0ee-4bae-9dfb-530b8e707093 tempest-AttachVolumeTestJSON-1651611701 tempest-AttachVolumeTestJSON-1651611701-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 17 03:35:02.783106 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-110bb2ed-c0ee-4bae-9dfb-530b8e707093 tempest-AttachVolumeTestJSON-1651611701 tempest-AttachVolumeTestJSON-1651611701-project] [instance: 9192e77c-eef4-40f6-85f6-afe009ad232f] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:35:02.789061 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-110bb2ed-c0ee-4bae-9dfb-530b8e707093 tempest-AttachVolumeTestJSON-1651611701 tempest-AttachVolumeTestJSON-1651611701-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:35:02.789511 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-110bb2ed-c0ee-4bae-9dfb-530b8e707093 tempest-AttachVolumeTestJSON-1651611701 tempest-AttachVolumeTestJSON-1651611701-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:35:02.790376 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-110bb2ed-c0ee-4bae-9dfb-530b8e707093 tempest-AttachVolumeTestJSON-1651611701 tempest-AttachVolumeTestJSON-1651611701-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:35:02.790713 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-110bb2ed-c0ee-4bae-9dfb-530b8e707093 tempest-AttachVolumeTestJSON-1651611701 tempest-AttachVolumeTestJSON-1651611701-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:35:02.873805 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-110bb2ed-c0ee-4bae-9dfb-530b8e707093 tempest-AttachVolumeTestJSON-1651611701 tempest-AttachVolumeTestJSON-1651611701-project] 10.222.0.11 "POST /compute/v2.1/servers/9192e77c-eef4-40f6-85f6-afe009ad232f/action" status: 200 len: 14 microversion: 2.1 time: 0.094656 Nov 17 03:35:02.874434 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 1016/1962] 10.222.0.11 () {60 vars in 1277 bytes} [Wed Nov 17 03:35:02 2021] POST /compute/v2.1/servers/9192e77c-eef4-40f6-85f6-afe009ad232f/action => generated 14 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 17 03:35:03.670906 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-f23e5c6f-5af3-4bcf-8d1c-6aeb4d15e9ea tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:35:03.672015 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-f23e5c6f-5af3-4bcf-8d1c-6aeb4d15e9ea tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] [instance: 0698dc5b-5f47-46c4-ace8-f5e891a964a0] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:35:03.682993 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-f23e5c6f-5af3-4bcf-8d1c-6aeb4d15e9ea tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:35:03.683442 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-f23e5c6f-5af3-4bcf-8d1c-6aeb4d15e9ea tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:35:03.684212 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-f23e5c6f-5af3-4bcf-8d1c-6aeb4d15e9ea tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:35:03.684648 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-f23e5c6f-5af3-4bcf-8d1c-6aeb4d15e9ea tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:35:03.824679 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-f23e5c6f-5af3-4bcf-8d1c-6aeb4d15e9ea tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '163b2f24a72649ac8084be1cac32fa09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e123e9b86124c93a7fc2db9984e7466', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:35:03.836215 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-f23e5c6f-5af3-4bcf-8d1c-6aeb4d15e9ea tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] 10.222.0.11 "GET /compute/v2.1/servers/0698dc5b-5f47-46c4-ace8-f5e891a964a0" status: 200 len: 1565 microversion: 2.1 time: 0.172355 Nov 17 03:35:03.836987 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 1017/1963] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:35:03 2021] GET /compute/v2.1/servers/0698dc5b-5f47-46c4-ace8-f5e891a964a0 => generated 1565 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:35:03.841347 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-82b67edf-0a7a-47cf-a629-b4f372492f38 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:35:03.842221 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-82b67edf-0a7a-47cf-a629-b4f372492f38 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] [instance: 5d54db85-b991-4890-abaa-952413baa2e7] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:35:03.848043 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-82b67edf-0a7a-47cf-a629-b4f372492f38 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:35:03.848622 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-82b67edf-0a7a-47cf-a629-b4f372492f38 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:35:03.849582 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-82b67edf-0a7a-47cf-a629-b4f372492f38 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:35:03.850045 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-82b67edf-0a7a-47cf-a629-b4f372492f38 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:35:03.881366 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-82b67edf-0a7a-47cf-a629-b4f372492f38 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] 10.222.0.11 "GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043252 Nov 17 03:35:03.881922 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 1018/1964] 10.222.0.11 () {60 vars in 1342 bytes} [Wed Nov 17 03:35:03 2021] GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 17 03:35:03.886167 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-c8c764e7-719e-449e-83a6-2ca15ffe9f83 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:35:03.886758 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-c8c764e7-719e-449e-83a6-2ca15ffe9f83 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] [instance: 5ddbfaaa-fabf-4324-941c-8868625ffefc] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:35:03.892985 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-c8c764e7-719e-449e-83a6-2ca15ffe9f83 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:35:03.893425 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-c8c764e7-719e-449e-83a6-2ca15ffe9f83 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:35:03.894186 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-c8c764e7-719e-449e-83a6-2ca15ffe9f83 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:35:03.894612 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-c8c764e7-719e-449e-83a6-2ca15ffe9f83 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:35:03.956465 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-c8c764e7-719e-449e-83a6-2ca15ffe9f83 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80763e09d44c475ea2425b22874e9612', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fef02a1dd77946a2ac0e0414b557435f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:35:03.967226 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-c8c764e7-719e-449e-83a6-2ca15ffe9f83 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] 10.222.0.11 "GET /compute/v2.1/servers/5ddbfaaa-fabf-4324-941c-8868625ffefc" status: 200 len: 1226 microversion: 2.1 time: 0.084062 Nov 17 03:35:03.967938 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 1019/1965] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:35:03 2021] GET /compute/v2.1/servers/5ddbfaaa-fabf-4324-941c-8868625ffefc => generated 1226 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:35:03.972189 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-46e5812a-47f6-4a2a-aa0d-ee070ba8cc37 tempest-AttachVolumeTestJSON-1651611701 tempest-AttachVolumeTestJSON-1651611701-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 17 03:35:03.973100 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-46e5812a-47f6-4a2a-aa0d-ee070ba8cc37 tempest-AttachVolumeTestJSON-1651611701 tempest-AttachVolumeTestJSON-1651611701-project] [instance: 9192e77c-eef4-40f6-85f6-afe009ad232f] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:35:03.979252 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-46e5812a-47f6-4a2a-aa0d-ee070ba8cc37 tempest-AttachVolumeTestJSON-1651611701 tempest-AttachVolumeTestJSON-1651611701-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:35:03.979706 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-46e5812a-47f6-4a2a-aa0d-ee070ba8cc37 tempest-AttachVolumeTestJSON-1651611701 tempest-AttachVolumeTestJSON-1651611701-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:35:03.980484 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-46e5812a-47f6-4a2a-aa0d-ee070ba8cc37 tempest-AttachVolumeTestJSON-1651611701 tempest-AttachVolumeTestJSON-1651611701-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:35:03.980981 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-46e5812a-47f6-4a2a-aa0d-ee070ba8cc37 tempest-AttachVolumeTestJSON-1651611701 tempest-AttachVolumeTestJSON-1651611701-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:35:04.070975 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-46e5812a-47f6-4a2a-aa0d-ee070ba8cc37 tempest-AttachVolumeTestJSON-1651611701 tempest-AttachVolumeTestJSON-1651611701-project] 10.222.0.11 "POST /compute/v2.1/servers/9192e77c-eef4-40f6-85f6-afe009ad232f/action" status: 200 len: 14 microversion: 2.1 time: 0.101725 Nov 17 03:35:04.071631 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 1020/1966] 10.222.0.11 () {60 vars in 1277 bytes} [Wed Nov 17 03:35:03 2021] POST /compute/v2.1/servers/9192e77c-eef4-40f6-85f6-afe009ad232f/action => generated 14 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 17 03:35:04.856688 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-5fee8c61-15fa-4f85-8c92-86636f6c780f tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:35:04.857490 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-5fee8c61-15fa-4f85-8c92-86636f6c780f tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] [instance: 0698dc5b-5f47-46c4-ace8-f5e891a964a0] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:35:04.865349 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-5fee8c61-15fa-4f85-8c92-86636f6c780f tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:35:04.865846 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-5fee8c61-15fa-4f85-8c92-86636f6c780f tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:35:04.866694 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-5fee8c61-15fa-4f85-8c92-86636f6c780f tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:35:04.867167 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-5fee8c61-15fa-4f85-8c92-86636f6c780f tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:35:05.010945 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-5fee8c61-15fa-4f85-8c92-86636f6c780f tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '163b2f24a72649ac8084be1cac32fa09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e123e9b86124c93a7fc2db9984e7466', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:35:05.019358 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-5fee8c61-15fa-4f85-8c92-86636f6c780f tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] 10.222.0.11 "GET /compute/v2.1/servers/0698dc5b-5f47-46c4-ace8-f5e891a964a0" status: 200 len: 1565 microversion: 2.1 time: 0.167248 Nov 17 03:35:05.019925 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 1021/1967] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:35:04 2021] GET /compute/v2.1/servers/0698dc5b-5f47-46c4-ace8-f5e891a964a0 => generated 1565 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:35:05.024474 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-caf68a46-ccfd-444a-8318-fa39cfc963e3 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:35:05.025430 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-caf68a46-ccfd-444a-8318-fa39cfc963e3 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] [instance: 5d54db85-b991-4890-abaa-952413baa2e7] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:35:05.033502 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-caf68a46-ccfd-444a-8318-fa39cfc963e3 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:35:05.034112 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-caf68a46-ccfd-444a-8318-fa39cfc963e3 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:35:05.035296 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-caf68a46-ccfd-444a-8318-fa39cfc963e3 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:35:05.035931 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-caf68a46-ccfd-444a-8318-fa39cfc963e3 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:35:05.069706 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-caf68a46-ccfd-444a-8318-fa39cfc963e3 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] 10.222.0.11 "GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.048721 Nov 17 03:35:05.070430 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 1022/1968] 10.222.0.11 () {60 vars in 1342 bytes} [Wed Nov 17 03:35:05 2021] GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 17 03:35:05.074864 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-3e8cbca9-e7da-4acc-b774-f09cfe0efdde tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:35:05.075463 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-3e8cbca9-e7da-4acc-b774-f09cfe0efdde tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] [instance: 5ddbfaaa-fabf-4324-941c-8868625ffefc] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:35:05.081369 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-3e8cbca9-e7da-4acc-b774-f09cfe0efdde tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:35:05.081815 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-3e8cbca9-e7da-4acc-b774-f09cfe0efdde tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:35:05.082585 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-3e8cbca9-e7da-4acc-b774-f09cfe0efdde tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:35:05.083014 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-3e8cbca9-e7da-4acc-b774-f09cfe0efdde tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:35:05.143508 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-3e8cbca9-e7da-4acc-b774-f09cfe0efdde tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80763e09d44c475ea2425b22874e9612', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fef02a1dd77946a2ac0e0414b557435f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:35:05.151737 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-3e8cbca9-e7da-4acc-b774-f09cfe0efdde tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] 10.222.0.11 "GET /compute/v2.1/servers/5ddbfaaa-fabf-4324-941c-8868625ffefc" status: 200 len: 1226 microversion: 2.1 time: 0.080330 Nov 17 03:35:05.152296 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 1023/1969] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:35:05 2021] GET /compute/v2.1/servers/5ddbfaaa-fabf-4324-941c-8868625ffefc => generated 1226 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:35:05.156638 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-87ccecef-3b42-4856-87d4-e1ef6fd4b9ef tempest-AttachVolumeTestJSON-1651611701 tempest-AttachVolumeTestJSON-1651611701-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 17 03:35:05.157569 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-87ccecef-3b42-4856-87d4-e1ef6fd4b9ef tempest-AttachVolumeTestJSON-1651611701 tempest-AttachVolumeTestJSON-1651611701-project] [instance: 9192e77c-eef4-40f6-85f6-afe009ad232f] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:35:05.163166 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-87ccecef-3b42-4856-87d4-e1ef6fd4b9ef tempest-AttachVolumeTestJSON-1651611701 tempest-AttachVolumeTestJSON-1651611701-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:35:05.163618 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-87ccecef-3b42-4856-87d4-e1ef6fd4b9ef tempest-AttachVolumeTestJSON-1651611701 tempest-AttachVolumeTestJSON-1651611701-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:35:05.164901 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-87ccecef-3b42-4856-87d4-e1ef6fd4b9ef tempest-AttachVolumeTestJSON-1651611701 tempest-AttachVolumeTestJSON-1651611701-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:35:05.165336 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-87ccecef-3b42-4856-87d4-e1ef6fd4b9ef tempest-AttachVolumeTestJSON-1651611701 tempest-AttachVolumeTestJSON-1651611701-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:35:05.252044 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-87ccecef-3b42-4856-87d4-e1ef6fd4b9ef tempest-AttachVolumeTestJSON-1651611701 tempest-AttachVolumeTestJSON-1651611701-project] 10.222.0.11 "POST /compute/v2.1/servers/9192e77c-eef4-40f6-85f6-afe009ad232f/action" status: 200 len: 14 microversion: 2.1 time: 0.098119 Nov 17 03:35:05.253011 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 1024/1970] 10.222.0.11 () {60 vars in 1277 bytes} [Wed Nov 17 03:35:05 2021] POST /compute/v2.1/servers/9192e77c-eef4-40f6-85f6-afe009ad232f/action => generated 14 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 17 03:35:06.042533 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-d2c8704e-2795-4af4-bda0-00b1bf10acd6 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:35:06.043677 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-d2c8704e-2795-4af4-bda0-00b1bf10acd6 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] [instance: 0698dc5b-5f47-46c4-ace8-f5e891a964a0] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:35:06.056316 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-d2c8704e-2795-4af4-bda0-00b1bf10acd6 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:35:06.056689 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-d2c8704e-2795-4af4-bda0-00b1bf10acd6 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:35:06.057546 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-d2c8704e-2795-4af4-bda0-00b1bf10acd6 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:35:06.058008 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-d2c8704e-2795-4af4-bda0-00b1bf10acd6 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:35:06.195191 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-d2c8704e-2795-4af4-bda0-00b1bf10acd6 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '163b2f24a72649ac8084be1cac32fa09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e123e9b86124c93a7fc2db9984e7466', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:35:06.202825 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-d2c8704e-2795-4af4-bda0-00b1bf10acd6 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] 10.222.0.11 "GET /compute/v2.1/servers/0698dc5b-5f47-46c4-ace8-f5e891a964a0" status: 200 len: 1565 microversion: 2.1 time: 0.167256 Nov 17 03:35:06.203401 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 1025/1971] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:35:06 2021] GET /compute/v2.1/servers/0698dc5b-5f47-46c4-ace8-f5e891a964a0 => generated 1565 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:35:06.207827 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-b12078dd-022a-49f1-b898-141492b02c72 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:35:06.208837 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-b12078dd-022a-49f1-b898-141492b02c72 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] [instance: 5d54db85-b991-4890-abaa-952413baa2e7] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:35:06.214743 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-b12078dd-022a-49f1-b898-141492b02c72 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:35:06.215218 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-b12078dd-022a-49f1-b898-141492b02c72 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:35:06.215997 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-b12078dd-022a-49f1-b898-141492b02c72 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:35:06.216437 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-b12078dd-022a-49f1-b898-141492b02c72 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:35:06.246285 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-b12078dd-022a-49f1-b898-141492b02c72 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] 10.222.0.11 "GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041852 Nov 17 03:35:06.246842 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 1026/1972] 10.222.0.11 () {60 vars in 1342 bytes} [Wed Nov 17 03:35:06 2021] GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 17 03:35:06.250974 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-d5c0fe89-83f2-41ca-981d-84d1f74cede5 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:35:06.251574 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-d5c0fe89-83f2-41ca-981d-84d1f74cede5 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] [instance: 5ddbfaaa-fabf-4324-941c-8868625ffefc] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:35:06.257475 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-d5c0fe89-83f2-41ca-981d-84d1f74cede5 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:35:06.258013 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-d5c0fe89-83f2-41ca-981d-84d1f74cede5 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:35:06.258783 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-d5c0fe89-83f2-41ca-981d-84d1f74cede5 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:35:06.259221 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-d5c0fe89-83f2-41ca-981d-84d1f74cede5 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:35:06.319033 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-d5c0fe89-83f2-41ca-981d-84d1f74cede5 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80763e09d44c475ea2425b22874e9612', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fef02a1dd77946a2ac0e0414b557435f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:35:06.327208 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-d5c0fe89-83f2-41ca-981d-84d1f74cede5 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] 10.222.0.11 "GET /compute/v2.1/servers/5ddbfaaa-fabf-4324-941c-8868625ffefc" status: 200 len: 1226 microversion: 2.1 time: 0.079431 Nov 17 03:35:06.327775 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 1027/1973] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:35:06 2021] GET /compute/v2.1/servers/5ddbfaaa-fabf-4324-941c-8868625ffefc => generated 1226 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:35:06.332062 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-5ee1f284-01de-4421-8e74-2ebbf34d8ff7 tempest-AttachVolumeTestJSON-1651611701 tempest-AttachVolumeTestJSON-1651611701-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 17 03:35:06.333001 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-5ee1f284-01de-4421-8e74-2ebbf34d8ff7 tempest-AttachVolumeTestJSON-1651611701 tempest-AttachVolumeTestJSON-1651611701-project] [instance: 9192e77c-eef4-40f6-85f6-afe009ad232f] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:35:06.338642 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-5ee1f284-01de-4421-8e74-2ebbf34d8ff7 tempest-AttachVolumeTestJSON-1651611701 tempest-AttachVolumeTestJSON-1651611701-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:35:06.339092 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-5ee1f284-01de-4421-8e74-2ebbf34d8ff7 tempest-AttachVolumeTestJSON-1651611701 tempest-AttachVolumeTestJSON-1651611701-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:35:06.339872 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-5ee1f284-01de-4421-8e74-2ebbf34d8ff7 tempest-AttachVolumeTestJSON-1651611701 tempest-AttachVolumeTestJSON-1651611701-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:35:06.340306 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-5ee1f284-01de-4421-8e74-2ebbf34d8ff7 tempest-AttachVolumeTestJSON-1651611701 tempest-AttachVolumeTestJSON-1651611701-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:35:06.437853 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-5ee1f284-01de-4421-8e74-2ebbf34d8ff7 tempest-AttachVolumeTestJSON-1651611701 tempest-AttachVolumeTestJSON-1651611701-project] 10.222.0.11 "POST /compute/v2.1/servers/9192e77c-eef4-40f6-85f6-afe009ad232f/action" status: 200 len: 7120 microversion: 2.1 time: 0.108397 Nov 17 03:35:06.438847 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 1028/1974] 10.222.0.11 () {60 vars in 1277 bytes} [Wed Nov 17 03:35:06 2021] POST /compute/v2.1/servers/9192e77c-eef4-40f6-85f6-afe009ad232f/action => generated 7120 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:35:07.225583 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-9c86a022-66e7-4aeb-9d1c-00a1a755cff4 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:35:07.226684 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-9c86a022-66e7-4aeb-9d1c-00a1a755cff4 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] [instance: 0698dc5b-5f47-46c4-ace8-f5e891a964a0] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:35:07.234247 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-9c86a022-66e7-4aeb-9d1c-00a1a755cff4 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:35:07.234687 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-9c86a022-66e7-4aeb-9d1c-00a1a755cff4 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:35:07.235449 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-9c86a022-66e7-4aeb-9d1c-00a1a755cff4 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:35:07.235877 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-9c86a022-66e7-4aeb-9d1c-00a1a755cff4 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:35:07.384314 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-9c86a022-66e7-4aeb-9d1c-00a1a755cff4 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '163b2f24a72649ac8084be1cac32fa09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e123e9b86124c93a7fc2db9984e7466', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:35:07.392176 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-9c86a022-66e7-4aeb-9d1c-00a1a755cff4 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] 10.222.0.11 "GET /compute/v2.1/servers/0698dc5b-5f47-46c4-ace8-f5e891a964a0" status: 200 len: 1565 microversion: 2.1 time: 0.173396 Nov 17 03:35:07.392747 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 1029/1975] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:35:07 2021] GET /compute/v2.1/servers/0698dc5b-5f47-46c4-ace8-f5e891a964a0 => generated 1565 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 17 03:35:07.397146 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-fe920392-427e-48f9-a002-65e3f0272951 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:35:07.398043 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-fe920392-427e-48f9-a002-65e3f0272951 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] [instance: 5d54db85-b991-4890-abaa-952413baa2e7] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:35:07.403988 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-fe920392-427e-48f9-a002-65e3f0272951 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:35:07.404439 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-fe920392-427e-48f9-a002-65e3f0272951 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:35:07.405233 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-fe920392-427e-48f9-a002-65e3f0272951 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:35:07.405686 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-fe920392-427e-48f9-a002-65e3f0272951 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:35:07.435345 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-fe920392-427e-48f9-a002-65e3f0272951 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] 10.222.0.11 "GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041559 Nov 17 03:35:07.435895 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 1030/1976] 10.222.0.11 () {60 vars in 1342 bytes} [Wed Nov 17 03:35:07 2021] GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 17 03:35:07.439998 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-0de99732-f390-4efc-9cd1-7fc63cd9a130 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:35:07.440598 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-0de99732-f390-4efc-9cd1-7fc63cd9a130 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] [instance: 5ddbfaaa-fabf-4324-941c-8868625ffefc] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:35:07.446246 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-0de99732-f390-4efc-9cd1-7fc63cd9a130 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:35:07.446695 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-0de99732-f390-4efc-9cd1-7fc63cd9a130 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:35:07.447754 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-0de99732-f390-4efc-9cd1-7fc63cd9a130 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:35:07.448187 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-0de99732-f390-4efc-9cd1-7fc63cd9a130 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:35:07.507103 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-0de99732-f390-4efc-9cd1-7fc63cd9a130 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80763e09d44c475ea2425b22874e9612', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fef02a1dd77946a2ac0e0414b557435f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:35:07.515126 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-0de99732-f390-4efc-9cd1-7fc63cd9a130 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] 10.222.0.11 "GET /compute/v2.1/servers/5ddbfaaa-fabf-4324-941c-8868625ffefc" status: 200 len: 1226 microversion: 2.1 time: 0.078300 Nov 17 03:35:07.515691 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 1031/1977] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:35:07 2021] GET /compute/v2.1/servers/5ddbfaaa-fabf-4324-941c-8868625ffefc => generated 1226 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:35:07.519927 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-cba06b58-c8aa-4539-bf6a-cc97d8df0647 tempest-AttachVolumeTestJSON-1651611701 tempest-AttachVolumeTestJSON-1651611701-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 17 03:35:07.520827 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-cba06b58-c8aa-4539-bf6a-cc97d8df0647 tempest-AttachVolumeTestJSON-1651611701 tempest-AttachVolumeTestJSON-1651611701-project] [instance: 9192e77c-eef4-40f6-85f6-afe009ad232f] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:35:07.527061 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-cba06b58-c8aa-4539-bf6a-cc97d8df0647 tempest-AttachVolumeTestJSON-1651611701 tempest-AttachVolumeTestJSON-1651611701-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:35:07.527511 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-cba06b58-c8aa-4539-bf6a-cc97d8df0647 tempest-AttachVolumeTestJSON-1651611701 tempest-AttachVolumeTestJSON-1651611701-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:35:07.528297 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-cba06b58-c8aa-4539-bf6a-cc97d8df0647 tempest-AttachVolumeTestJSON-1651611701 tempest-AttachVolumeTestJSON-1651611701-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:35:07.528731 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-cba06b58-c8aa-4539-bf6a-cc97d8df0647 tempest-AttachVolumeTestJSON-1651611701 tempest-AttachVolumeTestJSON-1651611701-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:35:07.622707 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-cba06b58-c8aa-4539-bf6a-cc97d8df0647 tempest-AttachVolumeTestJSON-1651611701 tempest-AttachVolumeTestJSON-1651611701-project] 10.222.0.11 "POST /compute/v2.1/servers/9192e77c-eef4-40f6-85f6-afe009ad232f/action" status: 200 len: 16123 microversion: 2.1 time: 0.105585 Nov 17 03:35:07.623357 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 1032/1978] 10.222.0.11 () {60 vars in 1277 bytes} [Wed Nov 17 03:35:07 2021] POST /compute/v2.1/servers/9192e77c-eef4-40f6-85f6-afe009ad232f/action => generated 16123 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 17 03:35:08.414018 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-07ead3f2-c715-4958-9879-3e89b9775ac3 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:35:08.415003 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-07ead3f2-c715-4958-9879-3e89b9775ac3 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] [instance: 0698dc5b-5f47-46c4-ace8-f5e891a964a0] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:35:08.422271 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-07ead3f2-c715-4958-9879-3e89b9775ac3 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:35:08.422744 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-07ead3f2-c715-4958-9879-3e89b9775ac3 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:35:08.423495 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-07ead3f2-c715-4958-9879-3e89b9775ac3 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:35:08.423929 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-07ead3f2-c715-4958-9879-3e89b9775ac3 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:35:08.566614 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-07ead3f2-c715-4958-9879-3e89b9775ac3 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '163b2f24a72649ac8084be1cac32fa09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e123e9b86124c93a7fc2db9984e7466', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:35:08.574254 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-07ead3f2-c715-4958-9879-3e89b9775ac3 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] 10.222.0.11 "GET /compute/v2.1/servers/0698dc5b-5f47-46c4-ace8-f5e891a964a0" status: 200 len: 1565 microversion: 2.1 time: 0.167353 Nov 17 03:35:08.574819 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 1033/1979] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:35:08 2021] GET /compute/v2.1/servers/0698dc5b-5f47-46c4-ace8-f5e891a964a0 => generated 1565 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:35:08.579245 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-6fa40e4e-0ce5-4962-a211-4beaaef2b812 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:35:08.580135 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-6fa40e4e-0ce5-4962-a211-4beaaef2b812 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] [instance: 5d54db85-b991-4890-abaa-952413baa2e7] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:35:08.585950 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-6fa40e4e-0ce5-4962-a211-4beaaef2b812 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:35:08.586408 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-6fa40e4e-0ce5-4962-a211-4beaaef2b812 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:35:08.587174 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-6fa40e4e-0ce5-4962-a211-4beaaef2b812 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:35:08.587627 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-6fa40e4e-0ce5-4962-a211-4beaaef2b812 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:35:08.616181 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-6fa40e4e-0ce5-4962-a211-4beaaef2b812 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] 10.222.0.11 "GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.040382 Nov 17 03:35:08.616739 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 1034/1980] 10.222.0.11 () {60 vars in 1342 bytes} [Wed Nov 17 03:35:08 2021] GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 17 03:35:08.620977 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-5fe28f5f-9ae6-4012-8334-0890f3141e33 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:35:08.621544 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-5fe28f5f-9ae6-4012-8334-0890f3141e33 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] [instance: 5ddbfaaa-fabf-4324-941c-8868625ffefc] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:35:08.627339 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-5fe28f5f-9ae6-4012-8334-0890f3141e33 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:35:08.627780 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-5fe28f5f-9ae6-4012-8334-0890f3141e33 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:35:08.628530 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-5fe28f5f-9ae6-4012-8334-0890f3141e33 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:35:08.629009 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-5fe28f5f-9ae6-4012-8334-0890f3141e33 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:35:08.696571 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-5fe28f5f-9ae6-4012-8334-0890f3141e33 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80763e09d44c475ea2425b22874e9612', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fef02a1dd77946a2ac0e0414b557435f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:35:08.704873 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-5fe28f5f-9ae6-4012-8334-0890f3141e33 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] 10.222.0.11 "GET /compute/v2.1/servers/5ddbfaaa-fabf-4324-941c-8868625ffefc" status: 200 len: 1226 microversion: 2.1 time: 0.087149 Nov 17 03:35:08.705432 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 1035/1981] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:35:08 2021] GET /compute/v2.1/servers/5ddbfaaa-fabf-4324-941c-8868625ffefc => generated 1226 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:35:08.709769 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-d2af62d8-c06b-49a6-8166-702c39beffe4 tempest-AttachVolumeTestJSON-1651611701 tempest-AttachVolumeTestJSON-1651611701-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 17 03:35:08.710666 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-d2af62d8-c06b-49a6-8166-702c39beffe4 tempest-AttachVolumeTestJSON-1651611701 tempest-AttachVolumeTestJSON-1651611701-project] [instance: 9192e77c-eef4-40f6-85f6-afe009ad232f] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:35:08.716644 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-d2af62d8-c06b-49a6-8166-702c39beffe4 tempest-AttachVolumeTestJSON-1651611701 tempest-AttachVolumeTestJSON-1651611701-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:35:08.717136 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-d2af62d8-c06b-49a6-8166-702c39beffe4 tempest-AttachVolumeTestJSON-1651611701 tempest-AttachVolumeTestJSON-1651611701-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:35:08.717907 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-d2af62d8-c06b-49a6-8166-702c39beffe4 tempest-AttachVolumeTestJSON-1651611701 tempest-AttachVolumeTestJSON-1651611701-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:35:08.718342 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-d2af62d8-c06b-49a6-8166-702c39beffe4 tempest-AttachVolumeTestJSON-1651611701 tempest-AttachVolumeTestJSON-1651611701-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:35:08.817654 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-d2af62d8-c06b-49a6-8166-702c39beffe4 tempest-AttachVolumeTestJSON-1651611701 tempest-AttachVolumeTestJSON-1651611701-project] 10.222.0.11 "POST /compute/v2.1/servers/9192e77c-eef4-40f6-85f6-afe009ad232f/action" status: 200 len: 18561 microversion: 2.1 time: 0.110540 Nov 17 03:35:08.818659 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 1036/1982] 10.222.0.11 () {60 vars in 1277 bytes} [Wed Nov 17 03:35:08 2021] POST /compute/v2.1/servers/9192e77c-eef4-40f6-85f6-afe009ad232f/action => generated 18561 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 17 03:35:09.596360 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-5e4f01b2-3c47-46be-9380-2a4d6bf041d1 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:35:09.601190 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-5e4f01b2-3c47-46be-9380-2a4d6bf041d1 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] [instance: 0698dc5b-5f47-46c4-ace8-f5e891a964a0] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:35:09.606740 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-5e4f01b2-3c47-46be-9380-2a4d6bf041d1 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:35:09.607193 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-5e4f01b2-3c47-46be-9380-2a4d6bf041d1 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:35:09.607979 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-5e4f01b2-3c47-46be-9380-2a4d6bf041d1 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:35:09.608415 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-5e4f01b2-3c47-46be-9380-2a4d6bf041d1 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:35:09.746408 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-5e4f01b2-3c47-46be-9380-2a4d6bf041d1 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '163b2f24a72649ac8084be1cac32fa09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e123e9b86124c93a7fc2db9984e7466', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:35:09.753980 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-5e4f01b2-3c47-46be-9380-2a4d6bf041d1 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] 10.222.0.11 "GET /compute/v2.1/servers/0698dc5b-5f47-46c4-ace8-f5e891a964a0" status: 200 len: 1565 microversion: 2.1 time: 0.164412 Nov 17 03:35:09.754517 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 1037/1983] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:35:09 2021] GET /compute/v2.1/servers/0698dc5b-5f47-46c4-ace8-f5e891a964a0 => generated 1565 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:35:09.825488 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-23e51579-3c48-4893-9cf6-0e85e7ebbd45 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:35:09.826550 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-23e51579-3c48-4893-9cf6-0e85e7ebbd45 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] [instance: 5d54db85-b991-4890-abaa-952413baa2e7] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:35:09.834597 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-23e51579-3c48-4893-9cf6-0e85e7ebbd45 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:35:09.835262 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-23e51579-3c48-4893-9cf6-0e85e7ebbd45 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:35:09.836482 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-23e51579-3c48-4893-9cf6-0e85e7ebbd45 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:35:09.837215 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-23e51579-3c48-4893-9cf6-0e85e7ebbd45 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:35:09.874768 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-23e51579-3c48-4893-9cf6-0e85e7ebbd45 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] 10.222.0.11 "GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.119200 Nov 17 03:35:09.875327 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 1038/1984] 10.222.0.11 () {60 vars in 1342 bytes} [Wed Nov 17 03:35:09 2021] GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7/os-volume_attachments => generated 197 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 17 03:35:09.879511 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-fe390742-b5b0-4cb8-8b54-1300d7cff984 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:35:09.880114 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-fe390742-b5b0-4cb8-8b54-1300d7cff984 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] [instance: 5ddbfaaa-fabf-4324-941c-8868625ffefc] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:35:09.886072 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-fe390742-b5b0-4cb8-8b54-1300d7cff984 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:35:09.886522 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-fe390742-b5b0-4cb8-8b54-1300d7cff984 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:35:09.887287 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-fe390742-b5b0-4cb8-8b54-1300d7cff984 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:35:09.887721 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-fe390742-b5b0-4cb8-8b54-1300d7cff984 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:35:09.904760 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 17 03:35:09.905338 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: Wed Nov 17 03:35:09 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/15abb40f-daf9-4c4b-ac9c-55f57ee7b938/os-volume_attachments/a3573201-81ca-4c3f-ac74-4588ea819c9f (ip 10.222.0.11) !!! Nov 17 03:35:09.953973 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-fe390742-b5b0-4cb8-8b54-1300d7cff984 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80763e09d44c475ea2425b22874e9612', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fef02a1dd77946a2ac0e0414b557435f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:35:09.962122 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-fe390742-b5b0-4cb8-8b54-1300d7cff984 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] 10.222.0.11 "GET /compute/v2.1/servers/5ddbfaaa-fabf-4324-941c-8868625ffefc" status: 200 len: 1226 microversion: 2.1 time: 0.085880 Nov 17 03:35:09.962695 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 1039/1985] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:35:09 2021] GET /compute/v2.1/servers/5ddbfaaa-fabf-4324-941c-8868625ffefc => generated 1226 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:35:09.967053 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-596c4671-9118-459c-be44-deaa4bac167c tempest-AttachVolumeTestJSON-1651611701 tempest-AttachVolumeTestJSON-1651611701-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 17 03:35:09.967948 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-596c4671-9118-459c-be44-deaa4bac167c tempest-AttachVolumeTestJSON-1651611701 tempest-AttachVolumeTestJSON-1651611701-project] [instance: 9192e77c-eef4-40f6-85f6-afe009ad232f] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:35:09.975248 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-596c4671-9118-459c-be44-deaa4bac167c tempest-AttachVolumeTestJSON-1651611701 tempest-AttachVolumeTestJSON-1651611701-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:35:09.975903 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-596c4671-9118-459c-be44-deaa4bac167c tempest-AttachVolumeTestJSON-1651611701 tempest-AttachVolumeTestJSON-1651611701-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:35:09.977368 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-596c4671-9118-459c-be44-deaa4bac167c tempest-AttachVolumeTestJSON-1651611701 tempest-AttachVolumeTestJSON-1651611701-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:35:09.978154 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-596c4671-9118-459c-be44-deaa4bac167c tempest-AttachVolumeTestJSON-1651611701 tempest-AttachVolumeTestJSON-1651611701-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:35:10.090466 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-596c4671-9118-459c-be44-deaa4bac167c tempest-AttachVolumeTestJSON-1651611701 tempest-AttachVolumeTestJSON-1651611701-project] 10.222.0.11 "POST /compute/v2.1/servers/9192e77c-eef4-40f6-85f6-afe009ad232f/action" status: 200 len: 21675 microversion: 2.1 time: 0.126466 Nov 17 03:35:10.091134 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 1040/1986] 10.222.0.11 () {60 vars in 1277 bytes} [Wed Nov 17 03:35:09 2021] POST /compute/v2.1/servers/9192e77c-eef4-40f6-85f6-afe009ad232f/action => generated 21675 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 17 03:35:10.775707 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-af91f10c-c031-44fe-82fa-01e7774ab7dc tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:35:10.776571 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-af91f10c-c031-44fe-82fa-01e7774ab7dc tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] [instance: 0698dc5b-5f47-46c4-ace8-f5e891a964a0] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:35:10.785371 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-af91f10c-c031-44fe-82fa-01e7774ab7dc tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:35:10.785918 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-af91f10c-c031-44fe-82fa-01e7774ab7dc tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:35:10.786863 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-af91f10c-c031-44fe-82fa-01e7774ab7dc tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:35:10.787406 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-af91f10c-c031-44fe-82fa-01e7774ab7dc tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:35:10.948676 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-af91f10c-c031-44fe-82fa-01e7774ab7dc tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '163b2f24a72649ac8084be1cac32fa09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e123e9b86124c93a7fc2db9984e7466', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:35:10.959780 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-af91f10c-c031-44fe-82fa-01e7774ab7dc tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] 10.222.0.11 "GET /compute/v2.1/servers/0698dc5b-5f47-46c4-ace8-f5e891a964a0" status: 200 len: 1565 microversion: 2.1 time: 0.190132 Nov 17 03:35:10.960497 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 1041/1987] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:35:10 2021] GET /compute/v2.1/servers/0698dc5b-5f47-46c4-ace8-f5e891a964a0 => generated 1565 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:35:10.965058 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-931b5d5f-df46-4b4d-bcb7-2e2194bad5f0 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:35:10.966013 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-931b5d5f-df46-4b4d-bcb7-2e2194bad5f0 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] [instance: 5d54db85-b991-4890-abaa-952413baa2e7] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:35:10.971627 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-931b5d5f-df46-4b4d-bcb7-2e2194bad5f0 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:35:10.972091 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-931b5d5f-df46-4b4d-bcb7-2e2194bad5f0 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:35:10.972930 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-931b5d5f-df46-4b4d-bcb7-2e2194bad5f0 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:35:10.973371 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-931b5d5f-df46-4b4d-bcb7-2e2194bad5f0 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:35:11.002406 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-931b5d5f-df46-4b4d-bcb7-2e2194bad5f0 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] 10.222.0.11 "GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.040859 Nov 17 03:35:11.002962 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 1042/1988] 10.222.0.11 () {60 vars in 1342 bytes} [Wed Nov 17 03:35:10 2021] GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 17 03:35:11.007012 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-474cae9c-dfd1-4aff-9c4b-6e5dbf736cde tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:35:11.007604 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-474cae9c-dfd1-4aff-9c4b-6e5dbf736cde tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] [instance: 5ddbfaaa-fabf-4324-941c-8868625ffefc] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:35:11.013379 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-474cae9c-dfd1-4aff-9c4b-6e5dbf736cde tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:35:11.013826 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-474cae9c-dfd1-4aff-9c4b-6e5dbf736cde tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:35:11.014587 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-474cae9c-dfd1-4aff-9c4b-6e5dbf736cde tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:35:11.015023 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-474cae9c-dfd1-4aff-9c4b-6e5dbf736cde tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:35:11.077656 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-474cae9c-dfd1-4aff-9c4b-6e5dbf736cde tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80763e09d44c475ea2425b22874e9612', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fef02a1dd77946a2ac0e0414b557435f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:35:11.085657 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-474cae9c-dfd1-4aff-9c4b-6e5dbf736cde tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] 10.222.0.11 "GET /compute/v2.1/servers/5ddbfaaa-fabf-4324-941c-8868625ffefc" status: 200 len: 1226 microversion: 2.1 time: 0.081809 Nov 17 03:35:11.086225 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 1043/1989] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:35:11 2021] GET /compute/v2.1/servers/5ddbfaaa-fabf-4324-941c-8868625ffefc => generated 1226 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:35:11.102631 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-38f5b5bd-4932-439b-a111-eaaebc9da885 tempest-AttachVolumeTestJSON-1651611701 tempest-AttachVolumeTestJSON-1651611701-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 17 03:35:11.103846 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-38f5b5bd-4932-439b-a111-eaaebc9da885 tempest-AttachVolumeTestJSON-1651611701 tempest-AttachVolumeTestJSON-1651611701-project] [instance: 9192e77c-eef4-40f6-85f6-afe009ad232f] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:35:11.109911 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-38f5b5bd-4932-439b-a111-eaaebc9da885 tempest-AttachVolumeTestJSON-1651611701 tempest-AttachVolumeTestJSON-1651611701-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:35:11.110358 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-38f5b5bd-4932-439b-a111-eaaebc9da885 tempest-AttachVolumeTestJSON-1651611701 tempest-AttachVolumeTestJSON-1651611701-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:35:11.111128 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-38f5b5bd-4932-439b-a111-eaaebc9da885 tempest-AttachVolumeTestJSON-1651611701 tempest-AttachVolumeTestJSON-1651611701-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:35:11.111558 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-38f5b5bd-4932-439b-a111-eaaebc9da885 tempest-AttachVolumeTestJSON-1651611701 tempest-AttachVolumeTestJSON-1651611701-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:35:11.210730 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-38f5b5bd-4932-439b-a111-eaaebc9da885 tempest-AttachVolumeTestJSON-1651611701 tempest-AttachVolumeTestJSON-1651611701-project] 10.222.0.11 "POST /compute/v2.1/servers/9192e77c-eef4-40f6-85f6-afe009ad232f/action" status: 200 len: 23235 microversion: 2.1 time: 0.110851 Nov 17 03:35:11.211745 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 1044/1990] 10.222.0.11 () {60 vars in 1277 bytes} [Wed Nov 17 03:35:11 2021] POST /compute/v2.1/servers/9192e77c-eef4-40f6-85f6-afe009ad232f/action => generated 23235 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 17 03:35:11.980892 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-1e9c7da2-1448-4072-9866-e119d669edff tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:35:11.981895 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-1e9c7da2-1448-4072-9866-e119d669edff tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] [instance: 0698dc5b-5f47-46c4-ace8-f5e891a964a0] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:35:11.991473 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-1e9c7da2-1448-4072-9866-e119d669edff tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:35:11.992077 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-1e9c7da2-1448-4072-9866-e119d669edff tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:35:11.993147 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-1e9c7da2-1448-4072-9866-e119d669edff tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:35:11.993759 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-1e9c7da2-1448-4072-9866-e119d669edff tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:35:12.139987 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-1e9c7da2-1448-4072-9866-e119d669edff tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '163b2f24a72649ac8084be1cac32fa09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e123e9b86124c93a7fc2db9984e7466', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:35:12.148668 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-1e9c7da2-1448-4072-9866-e119d669edff tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] 10.222.0.11 "GET /compute/v2.1/servers/0698dc5b-5f47-46c4-ace8-f5e891a964a0" status: 200 len: 1565 microversion: 2.1 time: 0.174366 Nov 17 03:35:12.149270 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 1045/1991] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:35:11 2021] GET /compute/v2.1/servers/0698dc5b-5f47-46c4-ace8-f5e891a964a0 => generated 1565 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:35:12.153708 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-1e606bc6-58bd-43ff-96b1-d7f464d1560a tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:35:12.154598 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-1e606bc6-58bd-43ff-96b1-d7f464d1560a tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] [instance: 5d54db85-b991-4890-abaa-952413baa2e7] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:35:12.160291 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-1e606bc6-58bd-43ff-96b1-d7f464d1560a tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:35:12.160739 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-1e606bc6-58bd-43ff-96b1-d7f464d1560a tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:35:12.161566 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-1e606bc6-58bd-43ff-96b1-d7f464d1560a tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:35:12.161996 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-1e606bc6-58bd-43ff-96b1-d7f464d1560a tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:35:12.191451 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-1e606bc6-58bd-43ff-96b1-d7f464d1560a tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] 10.222.0.11 "GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041137 Nov 17 03:35:12.192003 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 1046/1992] 10.222.0.11 () {60 vars in 1342 bytes} [Wed Nov 17 03:35:12 2021] GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 17 03:35:12.196067 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-b5183b5f-7ec3-41f2-9be6-9fb3559faa20 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:35:12.196661 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-b5183b5f-7ec3-41f2-9be6-9fb3559faa20 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] [instance: 5ddbfaaa-fabf-4324-941c-8868625ffefc] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:35:12.202252 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-b5183b5f-7ec3-41f2-9be6-9fb3559faa20 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:35:12.202697 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-b5183b5f-7ec3-41f2-9be6-9fb3559faa20 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:35:12.203485 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-b5183b5f-7ec3-41f2-9be6-9fb3559faa20 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:35:12.203915 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-b5183b5f-7ec3-41f2-9be6-9fb3559faa20 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:35:12.266548 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-b5183b5f-7ec3-41f2-9be6-9fb3559faa20 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80763e09d44c475ea2425b22874e9612', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fef02a1dd77946a2ac0e0414b557435f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:35:12.274442 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-b5183b5f-7ec3-41f2-9be6-9fb3559faa20 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] 10.222.0.11 "GET /compute/v2.1/servers/5ddbfaaa-fabf-4324-941c-8868625ffefc" status: 200 len: 1226 microversion: 2.1 time: 0.081494 Nov 17 03:35:12.275039 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 1047/1993] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:35:12 2021] GET /compute/v2.1/servers/5ddbfaaa-fabf-4324-941c-8868625ffefc => generated 1226 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:35:12.280110 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-82c7fd36-9bb4-4dab-bc2b-f2f329af667d tempest-AttachVolumeTestJSON-1651611701 tempest-AttachVolumeTestJSON-1651611701-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 17 03:35:12.281024 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-82c7fd36-9bb4-4dab-bc2b-f2f329af667d tempest-AttachVolumeTestJSON-1651611701 tempest-AttachVolumeTestJSON-1651611701-project] [instance: 9192e77c-eef4-40f6-85f6-afe009ad232f] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:35:12.286935 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-82c7fd36-9bb4-4dab-bc2b-f2f329af667d tempest-AttachVolumeTestJSON-1651611701 tempest-AttachVolumeTestJSON-1651611701-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:35:12.287378 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-82c7fd36-9bb4-4dab-bc2b-f2f329af667d tempest-AttachVolumeTestJSON-1651611701 tempest-AttachVolumeTestJSON-1651611701-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:35:12.288139 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-82c7fd36-9bb4-4dab-bc2b-f2f329af667d tempest-AttachVolumeTestJSON-1651611701 tempest-AttachVolumeTestJSON-1651611701-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:35:12.288564 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-82c7fd36-9bb4-4dab-bc2b-f2f329af667d tempest-AttachVolumeTestJSON-1651611701 tempest-AttachVolumeTestJSON-1651611701-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:35:12.395717 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-82c7fd36-9bb4-4dab-bc2b-f2f329af667d tempest-AttachVolumeTestJSON-1651611701 tempest-AttachVolumeTestJSON-1651611701-project] 10.222.0.11 "POST /compute/v2.1/servers/9192e77c-eef4-40f6-85f6-afe009ad232f/action" status: 200 len: 24668 microversion: 2.1 time: 0.118627 Nov 17 03:35:12.396646 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 1048/1994] 10.222.0.11 () {60 vars in 1277 bytes} [Wed Nov 17 03:35:12 2021] POST /compute/v2.1/servers/9192e77c-eef4-40f6-85f6-afe009ad232f/action => generated 24668 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 17 03:35:13.169896 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-1285515e-287d-405d-9858-a13259453386 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:35:13.170602 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-1285515e-287d-405d-9858-a13259453386 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] [instance: 0698dc5b-5f47-46c4-ace8-f5e891a964a0] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:35:13.178757 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-1285515e-287d-405d-9858-a13259453386 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:35:13.179753 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-1285515e-287d-405d-9858-a13259453386 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:35:13.180975 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-1285515e-287d-405d-9858-a13259453386 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:35:13.181690 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-1285515e-287d-405d-9858-a13259453386 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:35:13.376227 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-1285515e-287d-405d-9858-a13259453386 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '163b2f24a72649ac8084be1cac32fa09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e123e9b86124c93a7fc2db9984e7466', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:35:13.385183 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-1285515e-287d-405d-9858-a13259453386 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] 10.222.0.11 "GET /compute/v2.1/servers/0698dc5b-5f47-46c4-ace8-f5e891a964a0" status: 200 len: 1565 microversion: 2.1 time: 0.220784 Nov 17 03:35:13.388153 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 1049/1995] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:35:13 2021] GET /compute/v2.1/servers/0698dc5b-5f47-46c4-ace8-f5e891a964a0 => generated 1565 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:35:13.392698 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-b0357c4e-1851-41a5-8e0e-6fa40df48b28 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:35:13.393634 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-b0357c4e-1851-41a5-8e0e-6fa40df48b28 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] [instance: 5d54db85-b991-4890-abaa-952413baa2e7] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:35:13.399330 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-b0357c4e-1851-41a5-8e0e-6fa40df48b28 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:35:13.399777 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-b0357c4e-1851-41a5-8e0e-6fa40df48b28 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:35:13.401078 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-b0357c4e-1851-41a5-8e0e-6fa40df48b28 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:35:13.401499 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-b0357c4e-1851-41a5-8e0e-6fa40df48b28 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:35:13.433260 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-b0357c4e-1851-41a5-8e0e-6fa40df48b28 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] 10.222.0.11 "GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044008 Nov 17 03:35:13.433821 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 1050/1996] 10.222.0.11 () {60 vars in 1342 bytes} [Wed Nov 17 03:35:13 2021] GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 17 03:35:13.437932 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-34acbcbd-5ead-4d5d-b584-347e341d9f31 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:35:13.438525 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-34acbcbd-5ead-4d5d-b584-347e341d9f31 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] [instance: 5ddbfaaa-fabf-4324-941c-8868625ffefc] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:35:13.444696 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-34acbcbd-5ead-4d5d-b584-347e341d9f31 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:35:13.445167 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-34acbcbd-5ead-4d5d-b584-347e341d9f31 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:35:13.445924 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-34acbcbd-5ead-4d5d-b584-347e341d9f31 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:35:13.446374 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-34acbcbd-5ead-4d5d-b584-347e341d9f31 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:35:13.507549 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-34acbcbd-5ead-4d5d-b584-347e341d9f31 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80763e09d44c475ea2425b22874e9612', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fef02a1dd77946a2ac0e0414b557435f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:35:13.516377 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-34acbcbd-5ead-4d5d-b584-347e341d9f31 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] 10.222.0.11 "GET /compute/v2.1/servers/5ddbfaaa-fabf-4324-941c-8868625ffefc" status: 200 len: 1226 microversion: 2.1 time: 0.081612 Nov 17 03:35:13.516991 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 1051/1997] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:35:13 2021] GET /compute/v2.1/servers/5ddbfaaa-fabf-4324-941c-8868625ffefc => generated 1226 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:35:13.521257 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-5b7a53a5-4cfb-43b0-8987-f8ae69fcce00 tempest-AttachVolumeTestJSON-1651611701 tempest-AttachVolumeTestJSON-1651611701-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 17 03:35:13.522152 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-5b7a53a5-4cfb-43b0-8987-f8ae69fcce00 tempest-AttachVolumeTestJSON-1651611701 tempest-AttachVolumeTestJSON-1651611701-project] [instance: 9192e77c-eef4-40f6-85f6-afe009ad232f] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:35:13.528143 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-5b7a53a5-4cfb-43b0-8987-f8ae69fcce00 tempest-AttachVolumeTestJSON-1651611701 tempest-AttachVolumeTestJSON-1651611701-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:35:13.528593 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-5b7a53a5-4cfb-43b0-8987-f8ae69fcce00 tempest-AttachVolumeTestJSON-1651611701 tempest-AttachVolumeTestJSON-1651611701-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:35:13.529401 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-5b7a53a5-4cfb-43b0-8987-f8ae69fcce00 tempest-AttachVolumeTestJSON-1651611701 tempest-AttachVolumeTestJSON-1651611701-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:35:13.529837 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-5b7a53a5-4cfb-43b0-8987-f8ae69fcce00 tempest-AttachVolumeTestJSON-1651611701 tempest-AttachVolumeTestJSON-1651611701-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:35:13.656262 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-5b7a53a5-4cfb-43b0-8987-f8ae69fcce00 tempest-AttachVolumeTestJSON-1651611701 tempest-AttachVolumeTestJSON-1651611701-project] 10.222.0.11 "POST /compute/v2.1/servers/9192e77c-eef4-40f6-85f6-afe009ad232f/action" status: 200 len: 26286 microversion: 2.1 time: 0.137474 Nov 17 03:35:13.657204 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 1052/1998] 10.222.0.11 () {60 vars in 1277 bytes} [Wed Nov 17 03:35:13 2021] POST /compute/v2.1/servers/9192e77c-eef4-40f6-85f6-afe009ad232f/action => generated 26286 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 17 03:35:14.405999 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-119b541a-cba8-462b-bb1d-723c48cb66dc tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:35:14.406648 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-119b541a-cba8-462b-bb1d-723c48cb66dc tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] [instance: 0698dc5b-5f47-46c4-ace8-f5e891a964a0] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:35:14.414179 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-119b541a-cba8-462b-bb1d-723c48cb66dc tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:35:14.414622 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-119b541a-cba8-462b-bb1d-723c48cb66dc tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:35:14.415394 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-119b541a-cba8-462b-bb1d-723c48cb66dc tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:35:14.415909 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-119b541a-cba8-462b-bb1d-723c48cb66dc tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:35:14.557743 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-119b541a-cba8-462b-bb1d-723c48cb66dc tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '163b2f24a72649ac8084be1cac32fa09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e123e9b86124c93a7fc2db9984e7466', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:35:14.565170 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-119b541a-cba8-462b-bb1d-723c48cb66dc tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] 10.222.0.11 "GET /compute/v2.1/servers/0698dc5b-5f47-46c4-ace8-f5e891a964a0" status: 200 len: 1565 microversion: 2.1 time: 0.163408 Nov 17 03:35:14.565769 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 1053/1999] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:35:14 2021] GET /compute/v2.1/servers/0698dc5b-5f47-46c4-ace8-f5e891a964a0 => generated 1565 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:35:14.570159 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-1529def4-f0c6-4d24-a56e-655bc09fb092 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:35:14.571023 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-1529def4-f0c6-4d24-a56e-655bc09fb092 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] [instance: 5d54db85-b991-4890-abaa-952413baa2e7] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:35:14.577156 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-1529def4-f0c6-4d24-a56e-655bc09fb092 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:35:14.577599 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-1529def4-f0c6-4d24-a56e-655bc09fb092 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:35:14.578359 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-1529def4-f0c6-4d24-a56e-655bc09fb092 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:35:14.578784 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-1529def4-f0c6-4d24-a56e-655bc09fb092 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:35:14.607352 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-1529def4-f0c6-4d24-a56e-655bc09fb092 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] 10.222.0.11 "GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.040582 Nov 17 03:35:14.607892 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 1054/2000] 10.222.0.11 () {60 vars in 1342 bytes} [Wed Nov 17 03:35:14 2021] GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 17 03:35:14.611937 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-5e008060-d3b5-4084-8da6-43534f6d6489 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:35:14.612523 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-5e008060-d3b5-4084-8da6-43534f6d6489 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] [instance: 5ddbfaaa-fabf-4324-941c-8868625ffefc] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:35:14.618049 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-5e008060-d3b5-4084-8da6-43534f6d6489 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:35:14.618500 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-5e008060-d3b5-4084-8da6-43534f6d6489 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:35:14.619328 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-5e008060-d3b5-4084-8da6-43534f6d6489 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:35:14.619754 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-5e008060-d3b5-4084-8da6-43534f6d6489 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:35:14.681982 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-5e008060-d3b5-4084-8da6-43534f6d6489 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80763e09d44c475ea2425b22874e9612', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fef02a1dd77946a2ac0e0414b557435f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:35:14.690391 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-5e008060-d3b5-4084-8da6-43534f6d6489 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] 10.222.0.11 "GET /compute/v2.1/servers/5ddbfaaa-fabf-4324-941c-8868625ffefc" status: 200 len: 1226 microversion: 2.1 time: 0.081559 Nov 17 03:35:14.690955 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 1055/2001] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:35:14 2021] GET /compute/v2.1/servers/5ddbfaaa-fabf-4324-941c-8868625ffefc => generated 1226 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:35:14.695259 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-bd269942-9cbd-4dd2-855e-22ce5d867768 tempest-AttachVolumeTestJSON-1651611701 tempest-AttachVolumeTestJSON-1651611701-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 17 03:35:14.696143 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-bd269942-9cbd-4dd2-855e-22ce5d867768 tempest-AttachVolumeTestJSON-1651611701 tempest-AttachVolumeTestJSON-1651611701-project] [instance: 9192e77c-eef4-40f6-85f6-afe009ad232f] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:35:14.702702 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-bd269942-9cbd-4dd2-855e-22ce5d867768 tempest-AttachVolumeTestJSON-1651611701 tempest-AttachVolumeTestJSON-1651611701-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:35:14.703183 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-bd269942-9cbd-4dd2-855e-22ce5d867768 tempest-AttachVolumeTestJSON-1651611701 tempest-AttachVolumeTestJSON-1651611701-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:35:14.703961 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-bd269942-9cbd-4dd2-855e-22ce5d867768 tempest-AttachVolumeTestJSON-1651611701 tempest-AttachVolumeTestJSON-1651611701-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:35:14.704389 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-bd269942-9cbd-4dd2-855e-22ce5d867768 tempest-AttachVolumeTestJSON-1651611701 tempest-AttachVolumeTestJSON-1651611701-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:35:14.805944 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-bd269942-9cbd-4dd2-855e-22ce5d867768 tempest-AttachVolumeTestJSON-1651611701 tempest-AttachVolumeTestJSON-1651611701-project] 10.222.0.11 "POST /compute/v2.1/servers/9192e77c-eef4-40f6-85f6-afe009ad232f/action" status: 200 len: 27534 microversion: 2.1 time: 0.113325 Nov 17 03:35:14.806946 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 1056/2002] 10.222.0.11 () {60 vars in 1277 bytes} [Wed Nov 17 03:35:14 2021] POST /compute/v2.1/servers/9192e77c-eef4-40f6-85f6-afe009ad232f/action => generated 27534 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 17 03:35:15.587318 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-77b94ebd-776c-43f4-844b-877964518449 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:35:15.589404 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-77b94ebd-776c-43f4-844b-877964518449 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] [instance: 0698dc5b-5f47-46c4-ace8-f5e891a964a0] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:35:15.601073 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-77b94ebd-776c-43f4-844b-877964518449 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:35:15.601790 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-77b94ebd-776c-43f4-844b-877964518449 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:35:15.603095 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-77b94ebd-776c-43f4-844b-877964518449 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:35:15.604220 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-77b94ebd-776c-43f4-844b-877964518449 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:35:15.751313 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-77b94ebd-776c-43f4-844b-877964518449 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '163b2f24a72649ac8084be1cac32fa09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e123e9b86124c93a7fc2db9984e7466', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:35:15.758872 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-77b94ebd-776c-43f4-844b-877964518449 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] 10.222.0.11 "GET /compute/v2.1/servers/0698dc5b-5f47-46c4-ace8-f5e891a964a0" status: 200 len: 1565 microversion: 2.1 time: 0.178316 Nov 17 03:35:15.759555 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 1057/2003] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:35:15 2021] GET /compute/v2.1/servers/0698dc5b-5f47-46c4-ace8-f5e891a964a0 => generated 1565 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:35:15.763933 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-33d7a096-51e4-4e81-b83f-eeb71f8a27cb tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:35:15.764810 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-33d7a096-51e4-4e81-b83f-eeb71f8a27cb tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] [instance: 5d54db85-b991-4890-abaa-952413baa2e7] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:35:15.770406 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-33d7a096-51e4-4e81-b83f-eeb71f8a27cb tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:35:15.770860 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-33d7a096-51e4-4e81-b83f-eeb71f8a27cb tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:35:15.771608 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-33d7a096-51e4-4e81-b83f-eeb71f8a27cb tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:35:15.772060 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-33d7a096-51e4-4e81-b83f-eeb71f8a27cb tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:35:15.802308 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-33d7a096-51e4-4e81-b83f-eeb71f8a27cb tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] 10.222.0.11 "GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041739 Nov 17 03:35:15.802851 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 1058/2004] 10.222.0.11 () {60 vars in 1342 bytes} [Wed Nov 17 03:35:15 2021] GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 17 03:35:15.807354 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-96c645f9-6dc5-422e-92c0-0a470d2c7402 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:35:15.807949 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-96c645f9-6dc5-422e-92c0-0a470d2c7402 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] [instance: 5ddbfaaa-fabf-4324-941c-8868625ffefc] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:35:15.813464 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-96c645f9-6dc5-422e-92c0-0a470d2c7402 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:35:15.813920 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-96c645f9-6dc5-422e-92c0-0a470d2c7402 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:35:15.814675 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-96c645f9-6dc5-422e-92c0-0a470d2c7402 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:35:15.815106 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-96c645f9-6dc5-422e-92c0-0a470d2c7402 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:35:15.873395 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-96c645f9-6dc5-422e-92c0-0a470d2c7402 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80763e09d44c475ea2425b22874e9612', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fef02a1dd77946a2ac0e0414b557435f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:35:15.880858 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-96c645f9-6dc5-422e-92c0-0a470d2c7402 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] 10.222.0.11 "GET /compute/v2.1/servers/5ddbfaaa-fabf-4324-941c-8868625ffefc" status: 200 len: 1226 microversion: 2.1 time: 0.077064 Nov 17 03:35:15.881422 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 1059/2005] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:35:15 2021] GET /compute/v2.1/servers/5ddbfaaa-fabf-4324-941c-8868625ffefc => generated 1226 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:35:15.885776 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-bbf22b75-5128-4fb6-bbee-a50ac3e477b2 tempest-AttachVolumeTestJSON-1651611701 tempest-AttachVolumeTestJSON-1651611701-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 17 03:35:15.886666 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-bbf22b75-5128-4fb6-bbee-a50ac3e477b2 tempest-AttachVolumeTestJSON-1651611701 tempest-AttachVolumeTestJSON-1651611701-project] [instance: 9192e77c-eef4-40f6-85f6-afe009ad232f] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:35:15.892261 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-bbf22b75-5128-4fb6-bbee-a50ac3e477b2 tempest-AttachVolumeTestJSON-1651611701 tempest-AttachVolumeTestJSON-1651611701-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:35:15.892708 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-bbf22b75-5128-4fb6-bbee-a50ac3e477b2 tempest-AttachVolumeTestJSON-1651611701 tempest-AttachVolumeTestJSON-1651611701-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:35:15.893502 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-bbf22b75-5128-4fb6-bbee-a50ac3e477b2 tempest-AttachVolumeTestJSON-1651611701 tempest-AttachVolumeTestJSON-1651611701-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:35:15.893945 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-bbf22b75-5128-4fb6-bbee-a50ac3e477b2 tempest-AttachVolumeTestJSON-1651611701 tempest-AttachVolumeTestJSON-1651611701-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:35:15.988378 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-bbf22b75-5128-4fb6-bbee-a50ac3e477b2 tempest-AttachVolumeTestJSON-1651611701 tempest-AttachVolumeTestJSON-1651611701-project] 10.222.0.11 "POST /compute/v2.1/servers/9192e77c-eef4-40f6-85f6-afe009ad232f/action" status: 200 len: 28034 microversion: 2.1 time: 0.105323 Nov 17 03:35:15.989441 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 1060/2006] 10.222.0.11 () {60 vars in 1277 bytes} [Wed Nov 17 03:35:15 2021] POST /compute/v2.1/servers/9192e77c-eef4-40f6-85f6-afe009ad232f/action => generated 28034 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 17 03:35:16.779994 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-30bf32d8-d2e5-4456-88e1-c15a008d5c9b tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:35:16.780940 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-30bf32d8-d2e5-4456-88e1-c15a008d5c9b tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] [instance: 0698dc5b-5f47-46c4-ace8-f5e891a964a0] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:35:16.790204 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-30bf32d8-d2e5-4456-88e1-c15a008d5c9b tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:35:16.790770 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-30bf32d8-d2e5-4456-88e1-c15a008d5c9b tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:35:16.792021 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-30bf32d8-d2e5-4456-88e1-c15a008d5c9b tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:35:16.792592 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-30bf32d8-d2e5-4456-88e1-c15a008d5c9b tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:35:16.933507 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-30bf32d8-d2e5-4456-88e1-c15a008d5c9b tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '163b2f24a72649ac8084be1cac32fa09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e123e9b86124c93a7fc2db9984e7466', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:35:16.945792 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-30bf32d8-d2e5-4456-88e1-c15a008d5c9b tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] 10.222.0.11 "GET /compute/v2.1/servers/0698dc5b-5f47-46c4-ace8-f5e891a964a0" status: 200 len: 1565 microversion: 2.1 time: 0.171565 Nov 17 03:35:16.946519 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 1061/2007] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:35:16 2021] GET /compute/v2.1/servers/0698dc5b-5f47-46c4-ace8-f5e891a964a0 => generated 1565 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:35:16.953193 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-6b611cf5-a077-4e66-a76e-7caa008a2042 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:35:16.954622 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-6b611cf5-a077-4e66-a76e-7caa008a2042 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] [instance: 5d54db85-b991-4890-abaa-952413baa2e7] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:35:16.963070 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-6b611cf5-a077-4e66-a76e-7caa008a2042 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:35:16.963513 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-6b611cf5-a077-4e66-a76e-7caa008a2042 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:35:16.964276 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-6b611cf5-a077-4e66-a76e-7caa008a2042 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:35:16.964713 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-6b611cf5-a077-4e66-a76e-7caa008a2042 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:35:16.995546 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-6b611cf5-a077-4e66-a76e-7caa008a2042 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] 10.222.0.11 "GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047856 Nov 17 03:35:16.996084 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 1062/2008] 10.222.0.11 () {60 vars in 1342 bytes} [Wed Nov 17 03:35:16 2021] GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 17 03:35:17.000452 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-5f5b71c3-5ca8-4d87-947a-28598fed9823 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:35:17.001071 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-5f5b71c3-5ca8-4d87-947a-28598fed9823 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] [instance: 5ddbfaaa-fabf-4324-941c-8868625ffefc] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:35:17.006983 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-5f5b71c3-5ca8-4d87-947a-28598fed9823 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:35:17.007424 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-5f5b71c3-5ca8-4d87-947a-28598fed9823 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:35:17.008172 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-5f5b71c3-5ca8-4d87-947a-28598fed9823 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:35:17.008597 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-5f5b71c3-5ca8-4d87-947a-28598fed9823 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:35:17.068656 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-5f5b71c3-5ca8-4d87-947a-28598fed9823 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80763e09d44c475ea2425b22874e9612', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fef02a1dd77946a2ac0e0414b557435f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:35:17.076547 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-5f5b71c3-5ca8-4d87-947a-28598fed9823 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] 10.222.0.11 "GET /compute/v2.1/servers/5ddbfaaa-fabf-4324-941c-8868625ffefc" status: 200 len: 1226 microversion: 2.1 time: 0.079542 Nov 17 03:35:17.077140 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 1063/2009] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:35:16 2021] GET /compute/v2.1/servers/5ddbfaaa-fabf-4324-941c-8868625ffefc => generated 1226 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:35:17.081736 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-9456ea18-63e5-4cd1-9523-e8c5953defae tempest-AttachVolumeTestJSON-1651611701 tempest-AttachVolumeTestJSON-1651611701-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 17 03:35:17.082733 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-9456ea18-63e5-4cd1-9523-e8c5953defae tempest-AttachVolumeTestJSON-1651611701 tempest-AttachVolumeTestJSON-1651611701-project] [instance: 9192e77c-eef4-40f6-85f6-afe009ad232f] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:35:17.089484 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-9456ea18-63e5-4cd1-9523-e8c5953defae tempest-AttachVolumeTestJSON-1651611701 tempest-AttachVolumeTestJSON-1651611701-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:35:17.089932 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-9456ea18-63e5-4cd1-9523-e8c5953defae tempest-AttachVolumeTestJSON-1651611701 tempest-AttachVolumeTestJSON-1651611701-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:35:17.090855 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-9456ea18-63e5-4cd1-9523-e8c5953defae tempest-AttachVolumeTestJSON-1651611701 tempest-AttachVolumeTestJSON-1651611701-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:35:17.091318 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-9456ea18-63e5-4cd1-9523-e8c5953defae tempest-AttachVolumeTestJSON-1651611701 tempest-AttachVolumeTestJSON-1651611701-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:35:17.195291 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-9456ea18-63e5-4cd1-9523-e8c5953defae tempest-AttachVolumeTestJSON-1651611701 tempest-AttachVolumeTestJSON-1651611701-project] 10.222.0.11 "POST /compute/v2.1/servers/9192e77c-eef4-40f6-85f6-afe009ad232f/action" status: 200 len: 28177 microversion: 2.1 time: 0.116500 Nov 17 03:35:17.196292 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 1064/2010] 10.222.0.11 () {60 vars in 1277 bytes} [Wed Nov 17 03:35:17 2021] POST /compute/v2.1/servers/9192e77c-eef4-40f6-85f6-afe009ad232f/action => generated 28177 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 17 03:35:17.972476 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-720823b7-d770-4a4c-a120-c1f638e24e21 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:35:17.973651 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-720823b7-d770-4a4c-a120-c1f638e24e21 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] [instance: 0698dc5b-5f47-46c4-ace8-f5e891a964a0] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:35:17.982648 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-720823b7-d770-4a4c-a120-c1f638e24e21 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:35:17.983097 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-720823b7-d770-4a4c-a120-c1f638e24e21 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:35:17.983869 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-720823b7-d770-4a4c-a120-c1f638e24e21 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:35:17.984311 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-720823b7-d770-4a4c-a120-c1f638e24e21 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:35:18.131679 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-720823b7-d770-4a4c-a120-c1f638e24e21 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '163b2f24a72649ac8084be1cac32fa09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e123e9b86124c93a7fc2db9984e7466', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:35:18.140575 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-720823b7-d770-4a4c-a120-c1f638e24e21 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] 10.222.0.11 "GET /compute/v2.1/servers/0698dc5b-5f47-46c4-ace8-f5e891a964a0" status: 200 len: 1565 microversion: 2.1 time: 0.174736 Nov 17 03:35:18.141206 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 1065/2011] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:35:17 2021] GET /compute/v2.1/servers/0698dc5b-5f47-46c4-ace8-f5e891a964a0 => generated 1565 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:35:18.145812 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-f992229f-0625-4500-9693-b89da2494639 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 17 03:35:18.146717 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-f992229f-0625-4500-9693-b89da2494639 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] [instance: 5d54db85-b991-4890-abaa-952413baa2e7] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:35:18.152573 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-f992229f-0625-4500-9693-b89da2494639 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:35:18.153173 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-f992229f-0625-4500-9693-b89da2494639 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:35:18.154230 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-f992229f-0625-4500-9693-b89da2494639 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:35:18.154754 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-f992229f-0625-4500-9693-b89da2494639 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:35:18.263298 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-f992229f-0625-4500-9693-b89da2494639 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] 10.222.0.11 "POST /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7/action" status: 200 len: 38485 microversion: 2.20 time: 0.120771 Nov 17 03:35:18.263988 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 1066/2012] 10.222.0.11 () {62 vars in 1318 bytes} [Wed Nov 17 03:35:18 2021] POST /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7/action => generated 38485 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 17 03:35:18.268922 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-a4e61ed4-7a5b-43f9-b8f5-74fb2799d045 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:35:18.269616 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-a4e61ed4-7a5b-43f9-b8f5-74fb2799d045 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] [instance: 5ddbfaaa-fabf-4324-941c-8868625ffefc] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:35:18.276823 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-a4e61ed4-7a5b-43f9-b8f5-74fb2799d045 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:35:18.277278 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-a4e61ed4-7a5b-43f9-b8f5-74fb2799d045 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:35:18.278058 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-a4e61ed4-7a5b-43f9-b8f5-74fb2799d045 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:35:18.278512 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-a4e61ed4-7a5b-43f9-b8f5-74fb2799d045 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:35:18.339172 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-a4e61ed4-7a5b-43f9-b8f5-74fb2799d045 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80763e09d44c475ea2425b22874e9612', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fef02a1dd77946a2ac0e0414b557435f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:35:18.346943 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-a4e61ed4-7a5b-43f9-b8f5-74fb2799d045 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] 10.222.0.11 "GET /compute/v2.1/servers/5ddbfaaa-fabf-4324-941c-8868625ffefc" status: 200 len: 1226 microversion: 2.1 time: 0.081796 Nov 17 03:35:18.347505 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 1067/2013] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:35:18 2021] GET /compute/v2.1/servers/5ddbfaaa-fabf-4324-941c-8868625ffefc => generated 1226 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:35:18.351878 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-44faf294-1a11-4726-bcf0-a2df22014c28 tempest-AttachVolumeTestJSON-1651611701 tempest-AttachVolumeTestJSON-1651611701-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 17 03:35:18.352767 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-44faf294-1a11-4726-bcf0-a2df22014c28 tempest-AttachVolumeTestJSON-1651611701 tempest-AttachVolumeTestJSON-1651611701-project] [instance: 9192e77c-eef4-40f6-85f6-afe009ad232f] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:35:18.358638 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-44faf294-1a11-4726-bcf0-a2df22014c28 tempest-AttachVolumeTestJSON-1651611701 tempest-AttachVolumeTestJSON-1651611701-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:35:18.359083 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-44faf294-1a11-4726-bcf0-a2df22014c28 tempest-AttachVolumeTestJSON-1651611701 tempest-AttachVolumeTestJSON-1651611701-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:35:18.359840 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-44faf294-1a11-4726-bcf0-a2df22014c28 tempest-AttachVolumeTestJSON-1651611701 tempest-AttachVolumeTestJSON-1651611701-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:35:18.360300 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-44faf294-1a11-4726-bcf0-a2df22014c28 tempest-AttachVolumeTestJSON-1651611701 tempest-AttachVolumeTestJSON-1651611701-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:35:18.453110 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-44faf294-1a11-4726-bcf0-a2df22014c28 tempest-AttachVolumeTestJSON-1651611701 tempest-AttachVolumeTestJSON-1651611701-project] 10.222.0.11 "POST /compute/v2.1/servers/9192e77c-eef4-40f6-85f6-afe009ad232f/action" status: 200 len: 28468 microversion: 2.1 time: 0.103922 Nov 17 03:35:18.454126 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 1068/2014] 10.222.0.11 () {60 vars in 1277 bytes} [Wed Nov 17 03:35:18 2021] POST /compute/v2.1/servers/9192e77c-eef4-40f6-85f6-afe009ad232f/action => generated 28468 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 17 03:35:19.163128 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-b2e26076-fa28-46dc-ac33-c65550deeada tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:35:19.164262 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-b2e26076-fa28-46dc-ac33-c65550deeada tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] [instance: 0698dc5b-5f47-46c4-ace8-f5e891a964a0] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:35:19.177506 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-b2e26076-fa28-46dc-ac33-c65550deeada tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:35:19.178401 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-b2e26076-fa28-46dc-ac33-c65550deeada tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:35:19.180126 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-b2e26076-fa28-46dc-ac33-c65550deeada tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:35:19.180839 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-b2e26076-fa28-46dc-ac33-c65550deeada tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:35:19.321682 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-b2e26076-fa28-46dc-ac33-c65550deeada tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '163b2f24a72649ac8084be1cac32fa09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e123e9b86124c93a7fc2db9984e7466', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:35:19.330576 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-b2e26076-fa28-46dc-ac33-c65550deeada tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] 10.222.0.11 "GET /compute/v2.1/servers/0698dc5b-5f47-46c4-ace8-f5e891a964a0" status: 200 len: 1565 microversion: 2.1 time: 0.174116 Nov 17 03:35:19.331284 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 1069/2015] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:35:19 2021] GET /compute/v2.1/servers/0698dc5b-5f47-46c4-ace8-f5e891a964a0 => generated 1565 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:35:19.363317 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-93c808a8-fbd1-435e-817e-5f1f9f3bd90f tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:35:19.364092 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-93c808a8-fbd1-435e-817e-5f1f9f3bd90f tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] [instance: 5ddbfaaa-fabf-4324-941c-8868625ffefc] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:35:19.370223 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-93c808a8-fbd1-435e-817e-5f1f9f3bd90f tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:35:19.370674 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-93c808a8-fbd1-435e-817e-5f1f9f3bd90f tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:35:19.371440 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-93c808a8-fbd1-435e-817e-5f1f9f3bd90f tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:35:19.371872 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-93c808a8-fbd1-435e-817e-5f1f9f3bd90f tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:35:19.431669 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-93c808a8-fbd1-435e-817e-5f1f9f3bd90f tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80763e09d44c475ea2425b22874e9612', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fef02a1dd77946a2ac0e0414b557435f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:35:19.439828 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-93c808a8-fbd1-435e-817e-5f1f9f3bd90f tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] 10.222.0.11 "GET /compute/v2.1/servers/5ddbfaaa-fabf-4324-941c-8868625ffefc" status: 200 len: 1226 microversion: 2.1 time: 0.079981 Nov 17 03:35:19.440397 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 1070/2016] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:35:19 2021] GET /compute/v2.1/servers/5ddbfaaa-fabf-4324-941c-8868625ffefc => generated 1226 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:35:19.467487 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-eb470872-8e9d-4c79-b887-5475c16e96f7 tempest-AttachVolumeTestJSON-1651611701 tempest-AttachVolumeTestJSON-1651611701-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 17 03:35:19.468861 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-eb470872-8e9d-4c79-b887-5475c16e96f7 tempest-AttachVolumeTestJSON-1651611701 tempest-AttachVolumeTestJSON-1651611701-project] [instance: 9192e77c-eef4-40f6-85f6-afe009ad232f] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:35:19.476555 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-eb470872-8e9d-4c79-b887-5475c16e96f7 tempest-AttachVolumeTestJSON-1651611701 tempest-AttachVolumeTestJSON-1651611701-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:35:19.477232 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-eb470872-8e9d-4c79-b887-5475c16e96f7 tempest-AttachVolumeTestJSON-1651611701 tempest-AttachVolumeTestJSON-1651611701-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:35:19.478376 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-eb470872-8e9d-4c79-b887-5475c16e96f7 tempest-AttachVolumeTestJSON-1651611701 tempest-AttachVolumeTestJSON-1651611701-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:35:19.478802 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-eb470872-8e9d-4c79-b887-5475c16e96f7 tempest-AttachVolumeTestJSON-1651611701 tempest-AttachVolumeTestJSON-1651611701-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:35:19.571348 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-eb470872-8e9d-4c79-b887-5475c16e96f7 tempest-AttachVolumeTestJSON-1651611701 tempest-AttachVolumeTestJSON-1651611701-project] 10.222.0.11 "POST /compute/v2.1/servers/9192e77c-eef4-40f6-85f6-afe009ad232f/action" status: 200 len: 28636 microversion: 2.1 time: 0.107339 Nov 17 03:35:19.572082 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 1071/2017] 10.222.0.11 () {60 vars in 1277 bytes} [Wed Nov 17 03:35:19 2021] POST /compute/v2.1/servers/9192e77c-eef4-40f6-85f6-afe009ad232f/action => generated 28636 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 17 03:35:20.349130 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-1bfe4144-c517-458c-b45d-ced922ddba65 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:35:20.349836 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-1bfe4144-c517-458c-b45d-ced922ddba65 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] [instance: 0698dc5b-5f47-46c4-ace8-f5e891a964a0] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:35:20.356838 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-1bfe4144-c517-458c-b45d-ced922ddba65 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:35:20.357304 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-1bfe4144-c517-458c-b45d-ced922ddba65 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:35:20.358070 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-1bfe4144-c517-458c-b45d-ced922ddba65 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:35:20.358497 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-1bfe4144-c517-458c-b45d-ced922ddba65 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:35:20.494270 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-1bfe4144-c517-458c-b45d-ced922ddba65 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '163b2f24a72649ac8084be1cac32fa09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e123e9b86124c93a7fc2db9984e7466', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:35:20.501830 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-1bfe4144-c517-458c-b45d-ced922ddba65 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] 10.222.0.11 "GET /compute/v2.1/servers/0698dc5b-5f47-46c4-ace8-f5e891a964a0" status: 200 len: 1565 microversion: 2.1 time: 0.156829 Nov 17 03:35:20.502394 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 1072/2018] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:35:20 2021] GET /compute/v2.1/servers/0698dc5b-5f47-46c4-ace8-f5e891a964a0 => generated 1565 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:35:20.506883 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-41d4a7f9-1287-4dbf-8420-4778ce7ef747 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:35:20.507472 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-41d4a7f9-1287-4dbf-8420-4778ce7ef747 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] [instance: 5ddbfaaa-fabf-4324-941c-8868625ffefc] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:35:20.513574 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-41d4a7f9-1287-4dbf-8420-4778ce7ef747 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:35:20.514023 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-41d4a7f9-1287-4dbf-8420-4778ce7ef747 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:35:20.514778 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-41d4a7f9-1287-4dbf-8420-4778ce7ef747 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:35:20.515206 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-41d4a7f9-1287-4dbf-8420-4778ce7ef747 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:35:20.576245 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-41d4a7f9-1287-4dbf-8420-4778ce7ef747 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80763e09d44c475ea2425b22874e9612', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fef02a1dd77946a2ac0e0414b557435f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:35:20.583849 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-41d4a7f9-1287-4dbf-8420-4778ce7ef747 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] 10.222.0.11 "GET /compute/v2.1/servers/5ddbfaaa-fabf-4324-941c-8868625ffefc" status: 200 len: 1226 microversion: 2.1 time: 0.080430 Nov 17 03:35:20.584383 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 1073/2019] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:35:20 2021] GET /compute/v2.1/servers/5ddbfaaa-fabf-4324-941c-8868625ffefc => generated 1226 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:35:20.588949 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-3375837d-0cf2-4637-858f-7a68f3dfa417 tempest-AttachVolumeTestJSON-1651611701 tempest-AttachVolumeTestJSON-1651611701-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 17 03:35:20.589757 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-3375837d-0cf2-4637-858f-7a68f3dfa417 tempest-AttachVolumeTestJSON-1651611701 tempest-AttachVolumeTestJSON-1651611701-project] [instance: 9192e77c-eef4-40f6-85f6-afe009ad232f] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:35:20.595460 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-3375837d-0cf2-4637-858f-7a68f3dfa417 tempest-AttachVolumeTestJSON-1651611701 tempest-AttachVolumeTestJSON-1651611701-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:35:20.595904 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-3375837d-0cf2-4637-858f-7a68f3dfa417 tempest-AttachVolumeTestJSON-1651611701 tempest-AttachVolumeTestJSON-1651611701-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:35:20.596657 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-3375837d-0cf2-4637-858f-7a68f3dfa417 tempest-AttachVolumeTestJSON-1651611701 tempest-AttachVolumeTestJSON-1651611701-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:35:20.597116 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-3375837d-0cf2-4637-858f-7a68f3dfa417 tempest-AttachVolumeTestJSON-1651611701 tempest-AttachVolumeTestJSON-1651611701-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:35:20.697299 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-3375837d-0cf2-4637-858f-7a68f3dfa417 tempest-AttachVolumeTestJSON-1651611701 tempest-AttachVolumeTestJSON-1651611701-project] 10.222.0.11 "POST /compute/v2.1/servers/9192e77c-eef4-40f6-85f6-afe009ad232f/action" status: 200 len: 28636 microversion: 2.1 time: 0.110989 Nov 17 03:35:20.698170 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 1074/2020] 10.222.0.11 () {60 vars in 1277 bytes} [Wed Nov 17 03:35:20 2021] POST /compute/v2.1/servers/9192e77c-eef4-40f6-85f6-afe009ad232f/action => generated 28636 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 17 03:35:21.524129 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-79d0c1d1-1216-46ba-a619-428f6013661b tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:35:21.525318 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-79d0c1d1-1216-46ba-a619-428f6013661b tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] [instance: 0698dc5b-5f47-46c4-ace8-f5e891a964a0] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:35:21.537421 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-79d0c1d1-1216-46ba-a619-428f6013661b tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:35:21.538163 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-79d0c1d1-1216-46ba-a619-428f6013661b tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:35:21.539438 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-79d0c1d1-1216-46ba-a619-428f6013661b tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:35:21.540164 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-79d0c1d1-1216-46ba-a619-428f6013661b tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:35:21.682303 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-79d0c1d1-1216-46ba-a619-428f6013661b tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '163b2f24a72649ac8084be1cac32fa09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e123e9b86124c93a7fc2db9984e7466', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:35:21.690596 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-79d0c1d1-1216-46ba-a619-428f6013661b tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] 10.222.0.11 "GET /compute/v2.1/servers/0698dc5b-5f47-46c4-ace8-f5e891a964a0" status: 200 len: 1565 microversion: 2.1 time: 0.173349 Nov 17 03:35:21.691171 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 1075/2021] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:35:21 2021] GET /compute/v2.1/servers/0698dc5b-5f47-46c4-ace8-f5e891a964a0 => generated 1565 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:35:21.695302 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-6056ce95-3e4f-4611-90fa-7b7b87e1ce00 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:35:21.695894 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-6056ce95-3e4f-4611-90fa-7b7b87e1ce00 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] [instance: 5ddbfaaa-fabf-4324-941c-8868625ffefc] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:35:21.701697 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-6056ce95-3e4f-4611-90fa-7b7b87e1ce00 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:35:21.702138 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-6056ce95-3e4f-4611-90fa-7b7b87e1ce00 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:35:21.702975 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-6056ce95-3e4f-4611-90fa-7b7b87e1ce00 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:35:21.703399 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-6056ce95-3e4f-4611-90fa-7b7b87e1ce00 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:35:21.764872 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-6056ce95-3e4f-4611-90fa-7b7b87e1ce00 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80763e09d44c475ea2425b22874e9612', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fef02a1dd77946a2ac0e0414b557435f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:35:21.772655 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-6056ce95-3e4f-4611-90fa-7b7b87e1ce00 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] 10.222.0.11 "GET /compute/v2.1/servers/5ddbfaaa-fabf-4324-941c-8868625ffefc" status: 200 len: 1226 microversion: 2.1 time: 0.080560 Nov 17 03:35:21.773244 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 1076/2022] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:35:21 2021] GET /compute/v2.1/servers/5ddbfaaa-fabf-4324-941c-8868625ffefc => generated 1226 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:35:21.777750 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-0084dadb-694c-4553-886b-78c57626fb09 tempest-AttachVolumeTestJSON-1651611701 tempest-AttachVolumeTestJSON-1651611701-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 17 03:35:21.778565 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-0084dadb-694c-4553-886b-78c57626fb09 tempest-AttachVolumeTestJSON-1651611701 tempest-AttachVolumeTestJSON-1651611701-project] [instance: 9192e77c-eef4-40f6-85f6-afe009ad232f] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:35:21.784828 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-0084dadb-694c-4553-886b-78c57626fb09 tempest-AttachVolumeTestJSON-1651611701 tempest-AttachVolumeTestJSON-1651611701-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:35:21.785312 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-0084dadb-694c-4553-886b-78c57626fb09 tempest-AttachVolumeTestJSON-1651611701 tempest-AttachVolumeTestJSON-1651611701-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:35:21.786089 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-0084dadb-694c-4553-886b-78c57626fb09 tempest-AttachVolumeTestJSON-1651611701 tempest-AttachVolumeTestJSON-1651611701-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:35:21.786523 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-0084dadb-694c-4553-886b-78c57626fb09 tempest-AttachVolumeTestJSON-1651611701 tempest-AttachVolumeTestJSON-1651611701-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:35:21.878109 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-0084dadb-694c-4553-886b-78c57626fb09 tempest-AttachVolumeTestJSON-1651611701 tempest-AttachVolumeTestJSON-1651611701-project] 10.222.0.11 "POST /compute/v2.1/servers/9192e77c-eef4-40f6-85f6-afe009ad232f/action" status: 200 len: 28636 microversion: 2.1 time: 0.103147 Nov 17 03:35:21.879130 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 1077/2023] 10.222.0.11 () {60 vars in 1277 bytes} [Wed Nov 17 03:35:21 2021] POST /compute/v2.1/servers/9192e77c-eef4-40f6-85f6-afe009ad232f/action => generated 28636 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 17 03:35:22.712607 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-f9a4ec18-5a17-4ac8-b2b4-4cadba178308 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:35:22.713834 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-f9a4ec18-5a17-4ac8-b2b4-4cadba178308 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] [instance: 0698dc5b-5f47-46c4-ace8-f5e891a964a0] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:35:22.721364 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-f9a4ec18-5a17-4ac8-b2b4-4cadba178308 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:35:22.721831 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-f9a4ec18-5a17-4ac8-b2b4-4cadba178308 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:35:22.722630 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-f9a4ec18-5a17-4ac8-b2b4-4cadba178308 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:35:22.723079 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-f9a4ec18-5a17-4ac8-b2b4-4cadba178308 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:35:22.870234 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-f9a4ec18-5a17-4ac8-b2b4-4cadba178308 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '163b2f24a72649ac8084be1cac32fa09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e123e9b86124c93a7fc2db9984e7466', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:35:22.878151 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-f9a4ec18-5a17-4ac8-b2b4-4cadba178308 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] 10.222.0.11 "GET /compute/v2.1/servers/0698dc5b-5f47-46c4-ace8-f5e891a964a0" status: 200 len: 1565 microversion: 2.1 time: 0.172262 Nov 17 03:35:22.878722 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 1078/2024] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:35:22 2021] GET /compute/v2.1/servers/0698dc5b-5f47-46c4-ace8-f5e891a964a0 => generated 1565 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:35:22.882949 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-661d6da2-5715-47ea-b14e-c4b01051d34c tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:35:22.883547 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-661d6da2-5715-47ea-b14e-c4b01051d34c tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] [instance: 5ddbfaaa-fabf-4324-941c-8868625ffefc] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:35:22.889211 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-661d6da2-5715-47ea-b14e-c4b01051d34c tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:35:22.889671 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-661d6da2-5715-47ea-b14e-c4b01051d34c tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:35:22.890440 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-661d6da2-5715-47ea-b14e-c4b01051d34c tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:35:22.890873 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-661d6da2-5715-47ea-b14e-c4b01051d34c tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:35:22.954688 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-661d6da2-5715-47ea-b14e-c4b01051d34c tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80763e09d44c475ea2425b22874e9612', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fef02a1dd77946a2ac0e0414b557435f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:35:22.966355 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-661d6da2-5715-47ea-b14e-c4b01051d34c tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] 10.222.0.11 "GET /compute/v2.1/servers/5ddbfaaa-fabf-4324-941c-8868625ffefc" status: 200 len: 1226 microversion: 2.1 time: 0.086616 Nov 17 03:35:22.966861 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 1079/2025] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:35:22 2021] GET /compute/v2.1/servers/5ddbfaaa-fabf-4324-941c-8868625ffefc => generated 1226 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:35:22.971141 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-6519fc7b-9ab4-4ead-b4c7-3cc47bf37b22 tempest-AttachVolumeTestJSON-1651611701 tempest-AttachVolumeTestJSON-1651611701-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 17 03:35:22.972027 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-6519fc7b-9ab4-4ead-b4c7-3cc47bf37b22 tempest-AttachVolumeTestJSON-1651611701 tempest-AttachVolumeTestJSON-1651611701-project] [instance: 9192e77c-eef4-40f6-85f6-afe009ad232f] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:35:22.978003 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-6519fc7b-9ab4-4ead-b4c7-3cc47bf37b22 tempest-AttachVolumeTestJSON-1651611701 tempest-AttachVolumeTestJSON-1651611701-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:35:22.978454 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-6519fc7b-9ab4-4ead-b4c7-3cc47bf37b22 tempest-AttachVolumeTestJSON-1651611701 tempest-AttachVolumeTestJSON-1651611701-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:35:22.979218 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-6519fc7b-9ab4-4ead-b4c7-3cc47bf37b22 tempest-AttachVolumeTestJSON-1651611701 tempest-AttachVolumeTestJSON-1651611701-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:35:22.980087 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-6519fc7b-9ab4-4ead-b4c7-3cc47bf37b22 tempest-AttachVolumeTestJSON-1651611701 tempest-AttachVolumeTestJSON-1651611701-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:35:23.079319 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-6519fc7b-9ab4-4ead-b4c7-3cc47bf37b22 tempest-AttachVolumeTestJSON-1651611701 tempest-AttachVolumeTestJSON-1651611701-project] 10.222.0.11 "POST /compute/v2.1/servers/9192e77c-eef4-40f6-85f6-afe009ad232f/action" status: 200 len: 29369 microversion: 2.1 time: 0.111179 Nov 17 03:35:23.079974 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 1080/2026] 10.222.0.11 () {60 vars in 1277 bytes} [Wed Nov 17 03:35:22 2021] POST /compute/v2.1/servers/9192e77c-eef4-40f6-85f6-afe009ad232f/action => generated 29369 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 17 03:35:23.900285 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-c209f839-5283-46e7-8f5b-4c0db8f1739c tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:35:23.901446 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-c209f839-5283-46e7-8f5b-4c0db8f1739c tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] [instance: 0698dc5b-5f47-46c4-ace8-f5e891a964a0] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:35:23.912987 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-c209f839-5283-46e7-8f5b-4c0db8f1739c tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:35:23.913731 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-c209f839-5283-46e7-8f5b-4c0db8f1739c tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:35:23.914994 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-c209f839-5283-46e7-8f5b-4c0db8f1739c tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:35:23.915709 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-c209f839-5283-46e7-8f5b-4c0db8f1739c tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:35:24.059899 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-c209f839-5283-46e7-8f5b-4c0db8f1739c tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '163b2f24a72649ac8084be1cac32fa09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e123e9b86124c93a7fc2db9984e7466', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:35:24.068027 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-c209f839-5283-46e7-8f5b-4c0db8f1739c tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] 10.222.0.11 "GET /compute/v2.1/servers/0698dc5b-5f47-46c4-ace8-f5e891a964a0" status: 200 len: 1565 microversion: 2.1 time: 0.174593 Nov 17 03:35:24.068599 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 1081/2027] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:35:23 2021] GET /compute/v2.1/servers/0698dc5b-5f47-46c4-ace8-f5e891a964a0 => generated 1565 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:35:24.072959 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-657dbb19-f77d-4dff-8d9a-837fec0df682 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:35:24.073543 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-657dbb19-f77d-4dff-8d9a-837fec0df682 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] [instance: 5ddbfaaa-fabf-4324-941c-8868625ffefc] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:35:24.080208 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-657dbb19-f77d-4dff-8d9a-837fec0df682 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:35:24.080655 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-657dbb19-f77d-4dff-8d9a-837fec0df682 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:35:24.081467 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-657dbb19-f77d-4dff-8d9a-837fec0df682 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:35:24.081902 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-657dbb19-f77d-4dff-8d9a-837fec0df682 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:35:24.150173 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-657dbb19-f77d-4dff-8d9a-837fec0df682 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80763e09d44c475ea2425b22874e9612', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fef02a1dd77946a2ac0e0414b557435f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:35:24.158070 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-657dbb19-f77d-4dff-8d9a-837fec0df682 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] 10.222.0.11 "GET /compute/v2.1/servers/5ddbfaaa-fabf-4324-941c-8868625ffefc" status: 200 len: 1226 microversion: 2.1 time: 0.088489 Nov 17 03:35:24.158636 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 1082/2028] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:35:24 2021] GET /compute/v2.1/servers/5ddbfaaa-fabf-4324-941c-8868625ffefc => generated 1226 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:35:24.162927 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-fbac69e9-f027-4e1c-b411-569bf9855c74 tempest-AttachVolumeTestJSON-1651611701 tempest-AttachVolumeTestJSON-1651611701-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 17 03:35:24.163819 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-fbac69e9-f027-4e1c-b411-569bf9855c74 tempest-AttachVolumeTestJSON-1651611701 tempest-AttachVolumeTestJSON-1651611701-project] [instance: 9192e77c-eef4-40f6-85f6-afe009ad232f] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:35:24.169729 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-fbac69e9-f027-4e1c-b411-569bf9855c74 tempest-AttachVolumeTestJSON-1651611701 tempest-AttachVolumeTestJSON-1651611701-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:35:24.170176 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-fbac69e9-f027-4e1c-b411-569bf9855c74 tempest-AttachVolumeTestJSON-1651611701 tempest-AttachVolumeTestJSON-1651611701-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:35:24.170947 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-fbac69e9-f027-4e1c-b411-569bf9855c74 tempest-AttachVolumeTestJSON-1651611701 tempest-AttachVolumeTestJSON-1651611701-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:35:24.171381 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-fbac69e9-f027-4e1c-b411-569bf9855c74 tempest-AttachVolumeTestJSON-1651611701 tempest-AttachVolumeTestJSON-1651611701-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:35:24.274729 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-fbac69e9-f027-4e1c-b411-569bf9855c74 tempest-AttachVolumeTestJSON-1651611701 tempest-AttachVolumeTestJSON-1651611701-project] 10.222.0.11 "POST /compute/v2.1/servers/9192e77c-eef4-40f6-85f6-afe009ad232f/action" status: 200 len: 31755 microversion: 2.1 time: 0.114884 Nov 17 03:35:24.275366 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 1083/2029] 10.222.0.11 () {60 vars in 1277 bytes} [Wed Nov 17 03:35:24 2021] POST /compute/v2.1/servers/9192e77c-eef4-40f6-85f6-afe009ad232f/action => generated 31755 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 17 03:35:25.087126 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-7297421a-3352-4538-bd1f-615010639f30 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:35:25.087849 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-7297421a-3352-4538-bd1f-615010639f30 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] [instance: 0698dc5b-5f47-46c4-ace8-f5e891a964a0] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:35:25.095416 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-7297421a-3352-4538-bd1f-615010639f30 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:35:25.095857 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-7297421a-3352-4538-bd1f-615010639f30 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:35:25.096658 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-7297421a-3352-4538-bd1f-615010639f30 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:35:25.097103 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-7297421a-3352-4538-bd1f-615010639f30 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:35:25.246386 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-7297421a-3352-4538-bd1f-615010639f30 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '163b2f24a72649ac8084be1cac32fa09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e123e9b86124c93a7fc2db9984e7466', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:35:25.254320 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-7297421a-3352-4538-bd1f-615010639f30 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] 10.222.0.11 "GET /compute/v2.1/servers/0698dc5b-5f47-46c4-ace8-f5e891a964a0" status: 200 len: 1565 microversion: 2.1 time: 0.171285 Nov 17 03:35:25.254924 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 1084/2030] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:35:25 2021] GET /compute/v2.1/servers/0698dc5b-5f47-46c4-ace8-f5e891a964a0 => generated 1565 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:35:25.259307 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-bfa56071-3507-47e6-902e-adb6d7363081 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:35:25.259938 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-bfa56071-3507-47e6-902e-adb6d7363081 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] [instance: 5ddbfaaa-fabf-4324-941c-8868625ffefc] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:35:25.265806 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-bfa56071-3507-47e6-902e-adb6d7363081 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:35:25.266267 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-bfa56071-3507-47e6-902e-adb6d7363081 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:35:25.267040 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-bfa56071-3507-47e6-902e-adb6d7363081 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:35:25.267479 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-bfa56071-3507-47e6-902e-adb6d7363081 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:35:25.336379 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-bfa56071-3507-47e6-902e-adb6d7363081 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80763e09d44c475ea2425b22874e9612', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fef02a1dd77946a2ac0e0414b557435f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:35:25.344595 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-bfa56071-3507-47e6-902e-adb6d7363081 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] 10.222.0.11 "GET /compute/v2.1/servers/5ddbfaaa-fabf-4324-941c-8868625ffefc" status: 200 len: 1226 microversion: 2.1 time: 0.088597 Nov 17 03:35:25.345205 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 1085/2031] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:35:25 2021] GET /compute/v2.1/servers/5ddbfaaa-fabf-4324-941c-8868625ffefc => generated 1226 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:35:25.349715 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-044c0106-0296-4b37-aff4-3eec22c59be4 tempest-AttachVolumeTestJSON-1651611701 tempest-AttachVolumeTestJSON-1651611701-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 17 03:35:25.350619 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-044c0106-0296-4b37-aff4-3eec22c59be4 tempest-AttachVolumeTestJSON-1651611701 tempest-AttachVolumeTestJSON-1651611701-project] [instance: 9192e77c-eef4-40f6-85f6-afe009ad232f] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:35:25.357318 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-044c0106-0296-4b37-aff4-3eec22c59be4 tempest-AttachVolumeTestJSON-1651611701 tempest-AttachVolumeTestJSON-1651611701-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:35:25.357770 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-044c0106-0296-4b37-aff4-3eec22c59be4 tempest-AttachVolumeTestJSON-1651611701 tempest-AttachVolumeTestJSON-1651611701-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:35:25.358550 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-044c0106-0296-4b37-aff4-3eec22c59be4 tempest-AttachVolumeTestJSON-1651611701 tempest-AttachVolumeTestJSON-1651611701-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:35:25.358983 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-044c0106-0296-4b37-aff4-3eec22c59be4 tempest-AttachVolumeTestJSON-1651611701 tempest-AttachVolumeTestJSON-1651611701-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:35:25.453158 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-044c0106-0296-4b37-aff4-3eec22c59be4 tempest-AttachVolumeTestJSON-1651611701 tempest-AttachVolumeTestJSON-1651611701-project] 10.222.0.11 "POST /compute/v2.1/servers/9192e77c-eef4-40f6-85f6-afe009ad232f/action" status: 200 len: 33387 microversion: 2.1 time: 0.106609 Nov 17 03:35:25.453815 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 1086/2032] 10.222.0.11 () {60 vars in 1277 bytes} [Wed Nov 17 03:35:25 2021] POST /compute/v2.1/servers/9192e77c-eef4-40f6-85f6-afe009ad232f/action => generated 33387 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 17 03:35:26.273636 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-b457588d-8754-4693-bc38-b6df81db8397 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:35:26.274379 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-b457588d-8754-4693-bc38-b6df81db8397 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] [instance: 0698dc5b-5f47-46c4-ace8-f5e891a964a0] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:35:26.282246 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-b457588d-8754-4693-bc38-b6df81db8397 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:35:26.282685 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-b457588d-8754-4693-bc38-b6df81db8397 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:35:26.283447 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-b457588d-8754-4693-bc38-b6df81db8397 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:35:26.283878 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-b457588d-8754-4693-bc38-b6df81db8397 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:35:26.422212 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-b457588d-8754-4693-bc38-b6df81db8397 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '163b2f24a72649ac8084be1cac32fa09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e123e9b86124c93a7fc2db9984e7466', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:35:26.430968 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-b457588d-8754-4693-bc38-b6df81db8397 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] 10.222.0.11 "GET /compute/v2.1/servers/0698dc5b-5f47-46c4-ace8-f5e891a964a0" status: 200 len: 1565 microversion: 2.1 time: 0.162089 Nov 17 03:35:26.431534 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 1087/2033] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:35:26 2021] GET /compute/v2.1/servers/0698dc5b-5f47-46c4-ace8-f5e891a964a0 => generated 1565 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:35:26.435793 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-0618852a-a721-45e7-967f-50f2da62c6cc tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:35:26.436536 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-0618852a-a721-45e7-967f-50f2da62c6cc tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] [instance: 5ddbfaaa-fabf-4324-941c-8868625ffefc] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:35:26.442261 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-0618852a-a721-45e7-967f-50f2da62c6cc tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:35:26.442732 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-0618852a-a721-45e7-967f-50f2da62c6cc tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:35:26.443498 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-0618852a-a721-45e7-967f-50f2da62c6cc tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:35:26.443914 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-0618852a-a721-45e7-967f-50f2da62c6cc tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:35:26.505729 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-0618852a-a721-45e7-967f-50f2da62c6cc tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80763e09d44c475ea2425b22874e9612', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fef02a1dd77946a2ac0e0414b557435f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:35:26.513587 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-0618852a-a721-45e7-967f-50f2da62c6cc tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] 10.222.0.11 "GET /compute/v2.1/servers/5ddbfaaa-fabf-4324-941c-8868625ffefc" status: 200 len: 1226 microversion: 2.1 time: 0.081126 Nov 17 03:35:26.514141 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 1088/2034] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:35:26 2021] GET /compute/v2.1/servers/5ddbfaaa-fabf-4324-941c-8868625ffefc => generated 1226 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:35:26.518574 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-d374f1f1-898a-4a1c-9cc3-acbe41b1438c tempest-AttachVolumeTestJSON-1651611701 tempest-AttachVolumeTestJSON-1651611701-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 17 03:35:26.519453 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-d374f1f1-898a-4a1c-9cc3-acbe41b1438c tempest-AttachVolumeTestJSON-1651611701 tempest-AttachVolumeTestJSON-1651611701-project] [instance: 9192e77c-eef4-40f6-85f6-afe009ad232f] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:35:26.526112 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-d374f1f1-898a-4a1c-9cc3-acbe41b1438c tempest-AttachVolumeTestJSON-1651611701 tempest-AttachVolumeTestJSON-1651611701-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:35:26.526706 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-d374f1f1-898a-4a1c-9cc3-acbe41b1438c tempest-AttachVolumeTestJSON-1651611701 tempest-AttachVolumeTestJSON-1651611701-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:35:26.527939 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-d374f1f1-898a-4a1c-9cc3-acbe41b1438c tempest-AttachVolumeTestJSON-1651611701 tempest-AttachVolumeTestJSON-1651611701-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:35:26.528608 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-d374f1f1-898a-4a1c-9cc3-acbe41b1438c tempest-AttachVolumeTestJSON-1651611701 tempest-AttachVolumeTestJSON-1651611701-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:35:26.632214 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-d374f1f1-898a-4a1c-9cc3-acbe41b1438c tempest-AttachVolumeTestJSON-1651611701 tempest-AttachVolumeTestJSON-1651611701-project] 10.222.0.11 "POST /compute/v2.1/servers/9192e77c-eef4-40f6-85f6-afe009ad232f/action" status: 200 len: 34527 microversion: 2.1 time: 0.116381 Nov 17 03:35:26.633265 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 1089/2035] 10.222.0.11 () {60 vars in 1277 bytes} [Wed Nov 17 03:35:26 2021] POST /compute/v2.1/servers/9192e77c-eef4-40f6-85f6-afe009ad232f/action => generated 34527 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 17 03:35:27.452571 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-1585ac8d-5437-49e0-bc4b-9579cbecb54c tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:35:27.453284 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-1585ac8d-5437-49e0-bc4b-9579cbecb54c tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] [instance: 0698dc5b-5f47-46c4-ace8-f5e891a964a0] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:35:27.460576 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-1585ac8d-5437-49e0-bc4b-9579cbecb54c tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:35:27.461048 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-1585ac8d-5437-49e0-bc4b-9579cbecb54c tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:35:27.461813 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-1585ac8d-5437-49e0-bc4b-9579cbecb54c tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:35:27.462240 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-1585ac8d-5437-49e0-bc4b-9579cbecb54c tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:35:27.603764 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-1585ac8d-5437-49e0-bc4b-9579cbecb54c tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '163b2f24a72649ac8084be1cac32fa09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e123e9b86124c93a7fc2db9984e7466', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:35:27.611283 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-1585ac8d-5437-49e0-bc4b-9579cbecb54c tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] 10.222.0.11 "GET /compute/v2.1/servers/0698dc5b-5f47-46c4-ace8-f5e891a964a0" status: 200 len: 1565 microversion: 2.1 time: 0.165519 Nov 17 03:35:27.611854 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 1090/2036] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:35:27 2021] GET /compute/v2.1/servers/0698dc5b-5f47-46c4-ace8-f5e891a964a0 => generated 1565 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:35:27.616057 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-07a63f3a-818e-405d-983e-ab31ea4a1228 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:35:27.616655 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-07a63f3a-818e-405d-983e-ab31ea4a1228 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] [instance: 5ddbfaaa-fabf-4324-941c-8868625ffefc] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:35:27.622348 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-07a63f3a-818e-405d-983e-ab31ea4a1228 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:35:27.622781 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-07a63f3a-818e-405d-983e-ab31ea4a1228 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:35:27.623568 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-07a63f3a-818e-405d-983e-ab31ea4a1228 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:35:27.625019 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-07a63f3a-818e-405d-983e-ab31ea4a1228 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:35:27.683405 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-07a63f3a-818e-405d-983e-ab31ea4a1228 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80763e09d44c475ea2425b22874e9612', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fef02a1dd77946a2ac0e0414b557435f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:35:27.691566 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-07a63f3a-818e-405d-983e-ab31ea4a1228 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] 10.222.0.11 "GET /compute/v2.1/servers/5ddbfaaa-fabf-4324-941c-8868625ffefc" status: 200 len: 1226 microversion: 2.1 time: 0.078784 Nov 17 03:35:27.692125 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 1091/2037] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:35:27 2021] GET /compute/v2.1/servers/5ddbfaaa-fabf-4324-941c-8868625ffefc => generated 1226 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:35:27.696390 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-181305e7-30c8-49b7-9c41-2b9a93b9be32 tempest-AttachVolumeTestJSON-1651611701 tempest-AttachVolumeTestJSON-1651611701-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 17 03:35:27.697301 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-181305e7-30c8-49b7-9c41-2b9a93b9be32 tempest-AttachVolumeTestJSON-1651611701 tempest-AttachVolumeTestJSON-1651611701-project] [instance: 9192e77c-eef4-40f6-85f6-afe009ad232f] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:35:27.703057 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-181305e7-30c8-49b7-9c41-2b9a93b9be32 tempest-AttachVolumeTestJSON-1651611701 tempest-AttachVolumeTestJSON-1651611701-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:35:27.703416 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-181305e7-30c8-49b7-9c41-2b9a93b9be32 tempest-AttachVolumeTestJSON-1651611701 tempest-AttachVolumeTestJSON-1651611701-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:35:27.704171 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-181305e7-30c8-49b7-9c41-2b9a93b9be32 tempest-AttachVolumeTestJSON-1651611701 tempest-AttachVolumeTestJSON-1651611701-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:35:27.704594 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-181305e7-30c8-49b7-9c41-2b9a93b9be32 tempest-AttachVolumeTestJSON-1651611701 tempest-AttachVolumeTestJSON-1651611701-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:35:27.811533 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-181305e7-30c8-49b7-9c41-2b9a93b9be32 tempest-AttachVolumeTestJSON-1651611701 tempest-AttachVolumeTestJSON-1651611701-project] 10.222.0.11 "POST /compute/v2.1/servers/9192e77c-eef4-40f6-85f6-afe009ad232f/action" status: 200 len: 35748 microversion: 2.1 time: 0.117619 Nov 17 03:35:27.812201 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 1092/2038] 10.222.0.11 () {60 vars in 1277 bytes} [Wed Nov 17 03:35:27 2021] POST /compute/v2.1/servers/9192e77c-eef4-40f6-85f6-afe009ad232f/action => generated 35748 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 17 03:35:28.631213 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-c0e6616a-24d0-4a8b-afdd-a5d2bf336e09 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:35:28.631930 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-c0e6616a-24d0-4a8b-afdd-a5d2bf336e09 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] [instance: 0698dc5b-5f47-46c4-ace8-f5e891a964a0] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:35:28.641037 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-c0e6616a-24d0-4a8b-afdd-a5d2bf336e09 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:35:28.641859 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-c0e6616a-24d0-4a8b-afdd-a5d2bf336e09 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:35:28.642764 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-c0e6616a-24d0-4a8b-afdd-a5d2bf336e09 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:35:28.643450 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-c0e6616a-24d0-4a8b-afdd-a5d2bf336e09 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:35:28.796480 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-c0e6616a-24d0-4a8b-afdd-a5d2bf336e09 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '163b2f24a72649ac8084be1cac32fa09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e123e9b86124c93a7fc2db9984e7466', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:35:28.805661 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-c0e6616a-24d0-4a8b-afdd-a5d2bf336e09 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] 10.222.0.11 "GET /compute/v2.1/servers/0698dc5b-5f47-46c4-ace8-f5e891a964a0" status: 200 len: 1565 microversion: 2.1 time: 0.178540 Nov 17 03:35:28.806229 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 1093/2039] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:35:28 2021] GET /compute/v2.1/servers/0698dc5b-5f47-46c4-ace8-f5e891a964a0 => generated 1565 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 17 03:35:28.810588 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-ed4a4089-7ebc-457e-aca9-c38bde3ddbd2 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:35:28.811194 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-ed4a4089-7ebc-457e-aca9-c38bde3ddbd2 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] [instance: 5ddbfaaa-fabf-4324-941c-8868625ffefc] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:35:28.817751 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-ed4a4089-7ebc-457e-aca9-c38bde3ddbd2 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:35:28.818215 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-ed4a4089-7ebc-457e-aca9-c38bde3ddbd2 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:35:28.819049 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-ed4a4089-7ebc-457e-aca9-c38bde3ddbd2 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:35:28.819475 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-ed4a4089-7ebc-457e-aca9-c38bde3ddbd2 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:35:28.897955 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-ed4a4089-7ebc-457e-aca9-c38bde3ddbd2 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80763e09d44c475ea2425b22874e9612', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fef02a1dd77946a2ac0e0414b557435f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:35:28.909434 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-ed4a4089-7ebc-457e-aca9-c38bde3ddbd2 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] 10.222.0.11 "GET /compute/v2.1/servers/5ddbfaaa-fabf-4324-941c-8868625ffefc" status: 200 len: 1226 microversion: 2.1 time: 0.101749 Nov 17 03:35:28.910434 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 1094/2040] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:35:28 2021] GET /compute/v2.1/servers/5ddbfaaa-fabf-4324-941c-8868625ffefc => generated 1226 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:35:28.919958 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-845adba8-5df3-4b13-bf74-89d2131a5194 tempest-AttachVolumeTestJSON-1651611701 tempest-AttachVolumeTestJSON-1651611701-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 17 03:35:28.922195 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-845adba8-5df3-4b13-bf74-89d2131a5194 tempest-AttachVolumeTestJSON-1651611701 tempest-AttachVolumeTestJSON-1651611701-project] [instance: 9192e77c-eef4-40f6-85f6-afe009ad232f] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:35:28.930483 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-845adba8-5df3-4b13-bf74-89d2131a5194 tempest-AttachVolumeTestJSON-1651611701 tempest-AttachVolumeTestJSON-1651611701-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:35:28.930929 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-845adba8-5df3-4b13-bf74-89d2131a5194 tempest-AttachVolumeTestJSON-1651611701 tempest-AttachVolumeTestJSON-1651611701-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:35:28.931795 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-845adba8-5df3-4b13-bf74-89d2131a5194 tempest-AttachVolumeTestJSON-1651611701 tempest-AttachVolumeTestJSON-1651611701-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:35:28.932436 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-845adba8-5df3-4b13-bf74-89d2131a5194 tempest-AttachVolumeTestJSON-1651611701 tempest-AttachVolumeTestJSON-1651611701-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:35:29.028567 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-845adba8-5df3-4b13-bf74-89d2131a5194 tempest-AttachVolumeTestJSON-1651611701 tempest-AttachVolumeTestJSON-1651611701-project] 10.222.0.11 "POST /compute/v2.1/servers/9192e77c-eef4-40f6-85f6-afe009ad232f/action" status: 200 len: 37639 microversion: 2.1 time: 0.115923 Nov 17 03:35:29.030917 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 1095/2041] 10.222.0.11 () {60 vars in 1277 bytes} [Wed Nov 17 03:35:28 2021] POST /compute/v2.1/servers/9192e77c-eef4-40f6-85f6-afe009ad232f/action => generated 37639 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 17 03:35:29.827796 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-4434409a-5d9e-4a32-b0c7-045e3bb59c2d tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:35:29.828681 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-4434409a-5d9e-4a32-b0c7-045e3bb59c2d tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] [instance: 0698dc5b-5f47-46c4-ace8-f5e891a964a0] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:35:29.835973 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-4434409a-5d9e-4a32-b0c7-045e3bb59c2d tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:35:29.836425 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-4434409a-5d9e-4a32-b0c7-045e3bb59c2d tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:35:29.837211 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-4434409a-5d9e-4a32-b0c7-045e3bb59c2d tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:35:29.837701 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-4434409a-5d9e-4a32-b0c7-045e3bb59c2d tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:35:29.974524 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-4434409a-5d9e-4a32-b0c7-045e3bb59c2d tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '163b2f24a72649ac8084be1cac32fa09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e123e9b86124c93a7fc2db9984e7466', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:35:29.982642 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-4434409a-5d9e-4a32-b0c7-045e3bb59c2d tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] 10.222.0.11 "GET /compute/v2.1/servers/0698dc5b-5f47-46c4-ace8-f5e891a964a0" status: 200 len: 1565 microversion: 2.1 time: 0.161687 Nov 17 03:35:29.983202 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 1096/2042] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:35:29 2021] GET /compute/v2.1/servers/0698dc5b-5f47-46c4-ace8-f5e891a964a0 => generated 1565 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:35:29.987417 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-2b38b6ea-9b84-4fa6-8c01-56098c2c9818 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:35:29.988009 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-2b38b6ea-9b84-4fa6-8c01-56098c2c9818 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] [instance: 5ddbfaaa-fabf-4324-941c-8868625ffefc] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:35:29.993776 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-2b38b6ea-9b84-4fa6-8c01-56098c2c9818 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:35:29.994219 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-2b38b6ea-9b84-4fa6-8c01-56098c2c9818 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:35:29.995017 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-2b38b6ea-9b84-4fa6-8c01-56098c2c9818 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:35:29.995446 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-2b38b6ea-9b84-4fa6-8c01-56098c2c9818 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:35:30.058661 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-2b38b6ea-9b84-4fa6-8c01-56098c2c9818 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80763e09d44c475ea2425b22874e9612', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fef02a1dd77946a2ac0e0414b557435f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:35:30.066862 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-2b38b6ea-9b84-4fa6-8c01-56098c2c9818 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] 10.222.0.11 "GET /compute/v2.1/servers/5ddbfaaa-fabf-4324-941c-8868625ffefc" status: 200 len: 1226 microversion: 2.1 time: 0.082606 Nov 17 03:35:30.067438 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 1097/2043] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:35:29 2021] GET /compute/v2.1/servers/5ddbfaaa-fabf-4324-941c-8868625ffefc => generated 1226 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:35:30.071944 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-39463f9e-ff60-4def-9654-675d665cf9b9 tempest-AttachVolumeTestJSON-1651611701 tempest-AttachVolumeTestJSON-1651611701-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 17 03:35:30.072869 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-39463f9e-ff60-4def-9654-675d665cf9b9 tempest-AttachVolumeTestJSON-1651611701 tempest-AttachVolumeTestJSON-1651611701-project] [instance: 9192e77c-eef4-40f6-85f6-afe009ad232f] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:35:30.079167 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-39463f9e-ff60-4def-9654-675d665cf9b9 tempest-AttachVolumeTestJSON-1651611701 tempest-AttachVolumeTestJSON-1651611701-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:35:30.079543 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-39463f9e-ff60-4def-9654-675d665cf9b9 tempest-AttachVolumeTestJSON-1651611701 tempest-AttachVolumeTestJSON-1651611701-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:35:30.080318 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-39463f9e-ff60-4def-9654-675d665cf9b9 tempest-AttachVolumeTestJSON-1651611701 tempest-AttachVolumeTestJSON-1651611701-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:35:30.080752 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-39463f9e-ff60-4def-9654-675d665cf9b9 tempest-AttachVolumeTestJSON-1651611701 tempest-AttachVolumeTestJSON-1651611701-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:35:30.177584 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-39463f9e-ff60-4def-9654-675d665cf9b9 tempest-AttachVolumeTestJSON-1651611701 tempest-AttachVolumeTestJSON-1651611701-project] 10.222.0.11 "POST /compute/v2.1/servers/9192e77c-eef4-40f6-85f6-afe009ad232f/action" status: 200 len: 38171 microversion: 2.1 time: 0.108039 Nov 17 03:35:30.178771 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 1098/2044] 10.222.0.11 () {60 vars in 1277 bytes} [Wed Nov 17 03:35:30 2021] POST /compute/v2.1/servers/9192e77c-eef4-40f6-85f6-afe009ad232f/action => generated 38171 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 17 03:35:30.654332 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 17 03:35:30.655255 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: Wed Nov 17 03:35:30 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/15abb40f-daf9-4c4b-ac9c-55f57ee7b938/os-volume_attachments/a3573201-81ca-4c3f-ac74-4588ea819c9f (ip 10.222.0.11) !!! Nov 17 03:35:31.003426 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-7e5da07a-423b-4fef-aab3-8f21a66ad844 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:35:31.004208 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-7e5da07a-423b-4fef-aab3-8f21a66ad844 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] [instance: 0698dc5b-5f47-46c4-ace8-f5e891a964a0] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:35:31.012119 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-7e5da07a-423b-4fef-aab3-8f21a66ad844 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:35:31.012614 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-7e5da07a-423b-4fef-aab3-8f21a66ad844 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:35:31.013546 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-7e5da07a-423b-4fef-aab3-8f21a66ad844 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:35:31.014029 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-7e5da07a-423b-4fef-aab3-8f21a66ad844 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:35:31.157337 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-7e5da07a-423b-4fef-aab3-8f21a66ad844 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '163b2f24a72649ac8084be1cac32fa09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e123e9b86124c93a7fc2db9984e7466', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:35:31.169796 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-7e5da07a-423b-4fef-aab3-8f21a66ad844 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] 10.222.0.11 "GET /compute/v2.1/servers/0698dc5b-5f47-46c4-ace8-f5e891a964a0" status: 200 len: 1565 microversion: 2.1 time: 0.171195 Nov 17 03:35:31.170524 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 1099/2045] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:35:30 2021] GET /compute/v2.1/servers/0698dc5b-5f47-46c4-ace8-f5e891a964a0 => generated 1565 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:35:31.174807 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-bcafc7d8-f52b-4f16-b9bf-67575bfe2223 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:35:31.175409 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-bcafc7d8-f52b-4f16-b9bf-67575bfe2223 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] [instance: 5ddbfaaa-fabf-4324-941c-8868625ffefc] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:35:31.181666 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-bcafc7d8-f52b-4f16-b9bf-67575bfe2223 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:35:31.182106 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-bcafc7d8-f52b-4f16-b9bf-67575bfe2223 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:35:31.182861 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-bcafc7d8-f52b-4f16-b9bf-67575bfe2223 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:35:31.183287 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-bcafc7d8-f52b-4f16-b9bf-67575bfe2223 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:35:31.248639 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-bcafc7d8-f52b-4f16-b9bf-67575bfe2223 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80763e09d44c475ea2425b22874e9612', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fef02a1dd77946a2ac0e0414b557435f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:35:31.256272 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-bcafc7d8-f52b-4f16-b9bf-67575bfe2223 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] 10.222.0.11 "GET /compute/v2.1/servers/5ddbfaaa-fabf-4324-941c-8868625ffefc" status: 200 len: 1226 microversion: 2.1 time: 0.084707 Nov 17 03:35:31.256783 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 1100/2046] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:35:31 2021] GET /compute/v2.1/servers/5ddbfaaa-fabf-4324-941c-8868625ffefc => generated 1226 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:35:31.261102 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-01adce16-c7cc-4969-9a82-e2bce3188339 tempest-AttachVolumeTestJSON-1651611701 tempest-AttachVolumeTestJSON-1651611701-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 17 03:35:31.262005 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-01adce16-c7cc-4969-9a82-e2bce3188339 tempest-AttachVolumeTestJSON-1651611701 tempest-AttachVolumeTestJSON-1651611701-project] [instance: 9192e77c-eef4-40f6-85f6-afe009ad232f] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:35:31.269012 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-01adce16-c7cc-4969-9a82-e2bce3188339 tempest-AttachVolumeTestJSON-1651611701 tempest-AttachVolumeTestJSON-1651611701-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:35:31.269620 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-01adce16-c7cc-4969-9a82-e2bce3188339 tempest-AttachVolumeTestJSON-1651611701 tempest-AttachVolumeTestJSON-1651611701-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:35:31.270798 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-01adce16-c7cc-4969-9a82-e2bce3188339 tempest-AttachVolumeTestJSON-1651611701 tempest-AttachVolumeTestJSON-1651611701-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:35:31.271387 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-01adce16-c7cc-4969-9a82-e2bce3188339 tempest-AttachVolumeTestJSON-1651611701 tempest-AttachVolumeTestJSON-1651611701-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:35:31.367458 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-01adce16-c7cc-4969-9a82-e2bce3188339 tempest-AttachVolumeTestJSON-1651611701 tempest-AttachVolumeTestJSON-1651611701-project] 10.222.0.11 "POST /compute/v2.1/servers/9192e77c-eef4-40f6-85f6-afe009ad232f/action" status: 200 len: 38171 microversion: 2.1 time: 0.109022 Nov 17 03:35:31.368460 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 1101/2047] 10.222.0.11 () {60 vars in 1277 bytes} [Wed Nov 17 03:35:31 2021] POST /compute/v2.1/servers/9192e77c-eef4-40f6-85f6-afe009ad232f/action => generated 38171 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 17 03:35:32.190978 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-9660d03d-2ae5-431c-ac95-7531aaef294e tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:35:32.194103 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-9660d03d-2ae5-431c-ac95-7531aaef294e tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] [instance: 0698dc5b-5f47-46c4-ace8-f5e891a964a0] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:35:32.204635 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-9660d03d-2ae5-431c-ac95-7531aaef294e tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:35:32.205112 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-9660d03d-2ae5-431c-ac95-7531aaef294e tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:35:32.206080 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-9660d03d-2ae5-431c-ac95-7531aaef294e tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:35:32.206583 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-9660d03d-2ae5-431c-ac95-7531aaef294e tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:35:32.354034 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-9660d03d-2ae5-431c-ac95-7531aaef294e tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '163b2f24a72649ac8084be1cac32fa09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e123e9b86124c93a7fc2db9984e7466', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:35:32.361964 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-9660d03d-2ae5-431c-ac95-7531aaef294e tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] 10.222.0.11 "GET /compute/v2.1/servers/0698dc5b-5f47-46c4-ace8-f5e891a964a0" status: 200 len: 1565 microversion: 2.1 time: 0.177409 Nov 17 03:35:32.362505 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 1102/2048] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:35:32 2021] GET /compute/v2.1/servers/0698dc5b-5f47-46c4-ace8-f5e891a964a0 => generated 1565 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:35:32.366800 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-df17d311-614d-4ae8-86f6-bc4c58d53ed4 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:35:32.367399 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-df17d311-614d-4ae8-86f6-bc4c58d53ed4 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] [instance: 5ddbfaaa-fabf-4324-941c-8868625ffefc] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:35:32.373303 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-df17d311-614d-4ae8-86f6-bc4c58d53ed4 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:35:32.373726 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-df17d311-614d-4ae8-86f6-bc4c58d53ed4 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:35:32.374656 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-df17d311-614d-4ae8-86f6-bc4c58d53ed4 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:35:32.374979 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-df17d311-614d-4ae8-86f6-bc4c58d53ed4 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:35:32.447415 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-df17d311-614d-4ae8-86f6-bc4c58d53ed4 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80763e09d44c475ea2425b22874e9612', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fef02a1dd77946a2ac0e0414b557435f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:35:32.457264 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-df17d311-614d-4ae8-86f6-bc4c58d53ed4 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] 10.222.0.11 "GET /compute/v2.1/servers/5ddbfaaa-fabf-4324-941c-8868625ffefc" status: 200 len: 1226 microversion: 2.1 time: 0.093617 Nov 17 03:35:32.457815 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 1103/2049] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:35:32 2021] GET /compute/v2.1/servers/5ddbfaaa-fabf-4324-941c-8868625ffefc => generated 1226 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:35:32.462265 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-5ae78af3-da13-4703-828d-31d648a1dbec tempest-AttachVolumeTestJSON-1651611701 tempest-AttachVolumeTestJSON-1651611701-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 17 03:35:32.463185 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-5ae78af3-da13-4703-828d-31d648a1dbec tempest-AttachVolumeTestJSON-1651611701 tempest-AttachVolumeTestJSON-1651611701-project] [instance: 9192e77c-eef4-40f6-85f6-afe009ad232f] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:35:32.468961 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-5ae78af3-da13-4703-828d-31d648a1dbec tempest-AttachVolumeTestJSON-1651611701 tempest-AttachVolumeTestJSON-1651611701-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:35:32.469408 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-5ae78af3-da13-4703-828d-31d648a1dbec tempest-AttachVolumeTestJSON-1651611701 tempest-AttachVolumeTestJSON-1651611701-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:35:32.470171 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-5ae78af3-da13-4703-828d-31d648a1dbec tempest-AttachVolumeTestJSON-1651611701 tempest-AttachVolumeTestJSON-1651611701-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:35:32.470594 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-5ae78af3-da13-4703-828d-31d648a1dbec tempest-AttachVolumeTestJSON-1651611701 tempest-AttachVolumeTestJSON-1651611701-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:35:32.556377 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-5ae78af3-da13-4703-828d-31d648a1dbec tempest-AttachVolumeTestJSON-1651611701 tempest-AttachVolumeTestJSON-1651611701-project] 10.222.0.11 "POST /compute/v2.1/servers/9192e77c-eef4-40f6-85f6-afe009ad232f/action" status: 200 len: 38171 microversion: 2.1 time: 0.096911 Nov 17 03:35:32.557418 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 1104/2050] 10.222.0.11 () {60 vars in 1277 bytes} [Wed Nov 17 03:35:32 2021] POST /compute/v2.1/servers/9192e77c-eef4-40f6-85f6-afe009ad232f/action => generated 38171 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 17 03:35:33.383607 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-7a2759f3-1d2b-44e6-8f74-5e0593580869 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:35:33.384632 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-7a2759f3-1d2b-44e6-8f74-5e0593580869 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] [instance: 0698dc5b-5f47-46c4-ace8-f5e891a964a0] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:35:33.393981 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-7a2759f3-1d2b-44e6-8f74-5e0593580869 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:35:33.394432 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-7a2759f3-1d2b-44e6-8f74-5e0593580869 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:35:33.395219 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-7a2759f3-1d2b-44e6-8f74-5e0593580869 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:35:33.395655 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-7a2759f3-1d2b-44e6-8f74-5e0593580869 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:35:33.547734 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-7a2759f3-1d2b-44e6-8f74-5e0593580869 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '163b2f24a72649ac8084be1cac32fa09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e123e9b86124c93a7fc2db9984e7466', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:35:33.556257 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-7a2759f3-1d2b-44e6-8f74-5e0593580869 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] 10.222.0.11 "GET /compute/v2.1/servers/0698dc5b-5f47-46c4-ace8-f5e891a964a0" status: 200 len: 1565 microversion: 2.1 time: 0.179728 Nov 17 03:35:33.556809 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 1105/2051] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:35:33 2021] GET /compute/v2.1/servers/0698dc5b-5f47-46c4-ace8-f5e891a964a0 => generated 1565 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:35:33.561022 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-2058b544-8ac2-4f10-b538-536c265f574e tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:35:33.561659 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-2058b544-8ac2-4f10-b538-536c265f574e tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] [instance: 5ddbfaaa-fabf-4324-941c-8868625ffefc] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:35:33.567231 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-2058b544-8ac2-4f10-b538-536c265f574e tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:35:33.567673 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-2058b544-8ac2-4f10-b538-536c265f574e tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:35:33.568429 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-2058b544-8ac2-4f10-b538-536c265f574e tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:35:33.568874 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-2058b544-8ac2-4f10-b538-536c265f574e tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:35:33.629242 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-2058b544-8ac2-4f10-b538-536c265f574e tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80763e09d44c475ea2425b22874e9612', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fef02a1dd77946a2ac0e0414b557435f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:35:33.640843 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-2058b544-8ac2-4f10-b538-536c265f574e tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] 10.222.0.11 "GET /compute/v2.1/servers/5ddbfaaa-fabf-4324-941c-8868625ffefc" status: 200 len: 1226 microversion: 2.1 time: 0.082638 Nov 17 03:35:33.641488 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 1106/2052] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:35:33 2021] GET /compute/v2.1/servers/5ddbfaaa-fabf-4324-941c-8868625ffefc => generated 1226 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:35:33.645765 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-017a03c6-0ec9-40be-b180-c69ec931546b tempest-AttachVolumeTestJSON-1651611701 tempest-AttachVolumeTestJSON-1651611701-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 17 03:35:33.646655 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-017a03c6-0ec9-40be-b180-c69ec931546b tempest-AttachVolumeTestJSON-1651611701 tempest-AttachVolumeTestJSON-1651611701-project] [instance: 9192e77c-eef4-40f6-85f6-afe009ad232f] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:35:33.653630 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-017a03c6-0ec9-40be-b180-c69ec931546b tempest-AttachVolumeTestJSON-1651611701 tempest-AttachVolumeTestJSON-1651611701-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:35:33.654236 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-017a03c6-0ec9-40be-b180-c69ec931546b tempest-AttachVolumeTestJSON-1651611701 tempest-AttachVolumeTestJSON-1651611701-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:35:33.655407 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-017a03c6-0ec9-40be-b180-c69ec931546b tempest-AttachVolumeTestJSON-1651611701 tempest-AttachVolumeTestJSON-1651611701-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:35:33.655960 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-017a03c6-0ec9-40be-b180-c69ec931546b tempest-AttachVolumeTestJSON-1651611701 tempest-AttachVolumeTestJSON-1651611701-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:35:33.747983 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-017a03c6-0ec9-40be-b180-c69ec931546b tempest-AttachVolumeTestJSON-1651611701 tempest-AttachVolumeTestJSON-1651611701-project] 10.222.0.11 "POST /compute/v2.1/servers/9192e77c-eef4-40f6-85f6-afe009ad232f/action" status: 200 len: 38302 microversion: 2.1 time: 0.104882 Nov 17 03:35:33.749052 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 1107/2053] 10.222.0.11 () {60 vars in 1277 bytes} [Wed Nov 17 03:35:33 2021] POST /compute/v2.1/servers/9192e77c-eef4-40f6-85f6-afe009ad232f/action => generated 38302 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 17 03:35:33.759492 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-8c94bdcf-5e95-49fd-9d24-a5d53420e6d2 tempest-AttachVolumeTestJSON-1651611701 tempest-AttachVolumeTestJSON-1651611701-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:35:33.760069 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-8c94bdcf-5e95-49fd-9d24-a5d53420e6d2 tempest-AttachVolumeTestJSON-1651611701 tempest-AttachVolumeTestJSON-1651611701-project] [instance: 9192e77c-eef4-40f6-85f6-afe009ad232f] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:35:33.767201 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-8c94bdcf-5e95-49fd-9d24-a5d53420e6d2 tempest-AttachVolumeTestJSON-1651611701 tempest-AttachVolumeTestJSON-1651611701-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:35:33.767654 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-8c94bdcf-5e95-49fd-9d24-a5d53420e6d2 tempest-AttachVolumeTestJSON-1651611701 tempest-AttachVolumeTestJSON-1651611701-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:35:33.768429 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-8c94bdcf-5e95-49fd-9d24-a5d53420e6d2 tempest-AttachVolumeTestJSON-1651611701 tempest-AttachVolumeTestJSON-1651611701-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:35:33.768893 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-8c94bdcf-5e95-49fd-9d24-a5d53420e6d2 tempest-AttachVolumeTestJSON-1651611701 tempest-AttachVolumeTestJSON-1651611701-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:35:33.794156 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-8c94bdcf-5e95-49fd-9d24-a5d53420e6d2 tempest-AttachVolumeTestJSON-1651611701 tempest-AttachVolumeTestJSON-1651611701-project] 10.222.0.11 "GET /compute/v2.1/servers/9192e77c-eef4-40f6-85f6-afe009ad232f/ips" status: 200 len: 145 microversion: 2.1 time: 0.038375 Nov 17 03:35:33.794717 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 1108/2054] 10.222.0.11 () {58 vars in 1247 bytes} [Wed Nov 17 03:35:33 2021] GET /compute/v2.1/servers/9192e77c-eef4-40f6-85f6-afe009ad232f/ips => generated 145 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 17 03:35:34.574123 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-373caa46-ff76-420a-9b33-940053cc6f45 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:35:34.574807 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-373caa46-ff76-420a-9b33-940053cc6f45 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] [instance: 0698dc5b-5f47-46c4-ace8-f5e891a964a0] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:35:34.582154 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-373caa46-ff76-420a-9b33-940053cc6f45 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:35:34.582649 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-373caa46-ff76-420a-9b33-940053cc6f45 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:35:34.583451 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-373caa46-ff76-420a-9b33-940053cc6f45 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:35:34.583883 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-373caa46-ff76-420a-9b33-940053cc6f45 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:35:34.731912 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-373caa46-ff76-420a-9b33-940053cc6f45 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '163b2f24a72649ac8084be1cac32fa09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e123e9b86124c93a7fc2db9984e7466', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:35:34.739811 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-373caa46-ff76-420a-9b33-940053cc6f45 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] 10.222.0.11 "GET /compute/v2.1/servers/0698dc5b-5f47-46c4-ace8-f5e891a964a0" status: 200 len: 1565 microversion: 2.1 time: 0.169489 Nov 17 03:35:34.740379 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 1109/2055] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:35:34 2021] GET /compute/v2.1/servers/0698dc5b-5f47-46c4-ace8-f5e891a964a0 => generated 1565 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:35:34.744842 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-bb5e44f6-b908-40e4-b424-7a74734f91fa tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:35:34.745431 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-bb5e44f6-b908-40e4-b424-7a74734f91fa tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] [instance: 5ddbfaaa-fabf-4324-941c-8868625ffefc] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:35:34.751346 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-bb5e44f6-b908-40e4-b424-7a74734f91fa tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:35:34.751792 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-bb5e44f6-b908-40e4-b424-7a74734f91fa tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:35:34.752547 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-bb5e44f6-b908-40e4-b424-7a74734f91fa tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:35:34.753003 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-bb5e44f6-b908-40e4-b424-7a74734f91fa tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:35:34.814896 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-bb5e44f6-b908-40e4-b424-7a74734f91fa tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80763e09d44c475ea2425b22874e9612', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fef02a1dd77946a2ac0e0414b557435f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:35:34.822914 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-bb5e44f6-b908-40e4-b424-7a74734f91fa tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] 10.222.0.11 "GET /compute/v2.1/servers/5ddbfaaa-fabf-4324-941c-8868625ffefc" status: 200 len: 1226 microversion: 2.1 time: 0.081405 Nov 17 03:35:34.823469 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 1110/2056] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:35:34 2021] GET /compute/v2.1/servers/5ddbfaaa-fabf-4324-941c-8868625ffefc => generated 1226 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:35:35.760723 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-4b8a5030-cfe9-40e3-9dee-0bd0eca868f9 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:35:35.761811 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-4b8a5030-cfe9-40e3-9dee-0bd0eca868f9 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] [instance: 0698dc5b-5f47-46c4-ace8-f5e891a964a0] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:35:35.772433 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-4b8a5030-cfe9-40e3-9dee-0bd0eca868f9 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:35:35.773246 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-4b8a5030-cfe9-40e3-9dee-0bd0eca868f9 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:35:35.774530 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-4b8a5030-cfe9-40e3-9dee-0bd0eca868f9 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:35:35.775241 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-4b8a5030-cfe9-40e3-9dee-0bd0eca868f9 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:35:35.917011 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-4b8a5030-cfe9-40e3-9dee-0bd0eca868f9 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '163b2f24a72649ac8084be1cac32fa09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e123e9b86124c93a7fc2db9984e7466', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:35:35.924435 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-4b8a5030-cfe9-40e3-9dee-0bd0eca868f9 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] 10.222.0.11 "GET /compute/v2.1/servers/0698dc5b-5f47-46c4-ace8-f5e891a964a0" status: 200 len: 1565 microversion: 2.1 time: 0.169904 Nov 17 03:35:35.925046 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 1111/2057] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:35:35 2021] GET /compute/v2.1/servers/0698dc5b-5f47-46c4-ace8-f5e891a964a0 => generated 1565 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 17 03:35:35.929787 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-7f7d958a-e287-402a-838c-33c58fc41509 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:35:35.930382 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-7f7d958a-e287-402a-838c-33c58fc41509 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] [instance: 5ddbfaaa-fabf-4324-941c-8868625ffefc] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:35:35.935854 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-7f7d958a-e287-402a-838c-33c58fc41509 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:35:35.936309 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-7f7d958a-e287-402a-838c-33c58fc41509 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:35:35.937184 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-7f7d958a-e287-402a-838c-33c58fc41509 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:35:35.937623 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-7f7d958a-e287-402a-838c-33c58fc41509 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:35:35.995203 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-7f7d958a-e287-402a-838c-33c58fc41509 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80763e09d44c475ea2425b22874e9612', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fef02a1dd77946a2ac0e0414b557435f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:35:36.002617 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-7f7d958a-e287-402a-838c-33c58fc41509 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] 10.222.0.11 "GET /compute/v2.1/servers/5ddbfaaa-fabf-4324-941c-8868625ffefc" status: 200 len: 1226 microversion: 2.1 time: 0.076561 Nov 17 03:35:36.003201 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 1112/2058] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:35:35 2021] GET /compute/v2.1/servers/5ddbfaaa-fabf-4324-941c-8868625ffefc => generated 1226 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:35:36.936315 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-ec907c05-cf67-4275-8e25-57c57b0ba21b tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:35:36.937393 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-ec907c05-cf67-4275-8e25-57c57b0ba21b tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] [instance: 15abb40f-daf9-4c4b-ac9c-55f57ee7b938] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:35:36.943961 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-ec907c05-cf67-4275-8e25-57c57b0ba21b tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:35:36.944407 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-ec907c05-cf67-4275-8e25-57c57b0ba21b tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:35:36.945216 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-ec907c05-cf67-4275-8e25-57c57b0ba21b tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:35:36.945639 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-ec907c05-cf67-4275-8e25-57c57b0ba21b tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:36:37.026982 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.objects.instance [None req-c5705283-e360-4186-b9d2-2d4aba319154 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Lazy-loading 'services' on Instance uuid 15abb40f-daf9-4c4b-ac9c-55f57ee7b938 {{(pid=115916) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Nov 17 03:36:37.454065 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.objects.instance [None req-ec907c05-cf67-4275-8e25-57c57b0ba21b tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Lazy-loading 'services' on Instance uuid 15abb40f-daf9-4c4b-ac9c-55f57ee7b938 {{(pid=115917) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Nov 17 03:37:26.602339 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 17 03:37:26.603439 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: Wed Nov 17 03:37:26 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/15abb40f-daf9-4c4b-ac9c-55f57ee7b938/os-volume_attachments/a3573201-81ca-4c3f-ac74-4588ea819c9f (ip 10.222.0.11) !!! Nov 17 03:37:34.486605 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 17 03:37:34.487653 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: Wed Nov 17 03:37:34 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/15abb40f-daf9-4c4b-ac9c-55f57ee7b938/os-volume_attachments/a3573201-81ca-4c3f-ac74-4588ea819c9f (ip 10.222.0.11) !!! Nov 17 03:37:34.689905 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 17 03:37:34.690706 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: Wed Nov 17 03:37:34 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/15abb40f-daf9-4c4b-ac9c-55f57ee7b938/os-volume_attachments/a3573201-81ca-4c3f-ac74-4588ea819c9f (ip 10.222.0.11) !!! Nov 17 03:38:02.782465 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Nov 17 03:38:02.783477 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: Wed Nov 17 03:38:02 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/15abb40f-daf9-4c4b-ac9c-55f57ee7b938/os-volume_attachments/a3573201-81ca-4c3f-ac74-4588ea819c9f (ip 10.222.0.11) !!! Nov 17 03:38:37.812045 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: ERROR oslo.messaging._drivers.impl_rabbit [None req-c5705283-e360-4186-b9d2-2d4aba319154 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] [201d3e2d-67a7-4ecf-8825-2618ae09d16b] AMQP server on 10.222.0.11:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Nov 17 03:38:37.833026 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.wsgi [None req-ec907c05-cf67-4275-8e25-57c57b0ba21b tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] HTTP exception thrown: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-46418f40-3fcb-430c-a213-c0bd97578ac3) Nov 17 03:38:37.834204 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-ec907c05-cf67-4275-8e25-57c57b0ba21b tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Returning 400 to user: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-46418f40-3fcb-430c-a213-c0bd97578ac3) {{(pid=115917) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 17 03:38:37.835138 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-ec907c05-cf67-4275-8e25-57c57b0ba21b tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] 10.222.0.11 "DELETE /compute/v2.1/servers/15abb40f-daf9-4c4b-ac9c-55f57ee7b938/os-volume_attachments/a3573201-81ca-4c3f-ac74-4588ea819c9f" status: 400 len: 269 microversion: 2.1 time: 180.905753 Nov 17 03:38:37.835783 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 1113/2059] 10.222.0.11 () {58 vars in 1415 bytes} [Wed Nov 17 03:35:36 2021] DELETE /compute/v2.1/servers/15abb40f-daf9-4c4b-ac9c-55f57ee7b938/os-volume_attachments/a3573201-81ca-4c3f-ac74-4588ea819c9f => generated 269 bytes in 180907 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Nov 17 03:38:38.099088 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-7d91e362-7d07-4b1a-8215-142bfe897609 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:38:38.100001 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-7d91e362-7d07-4b1a-8215-142bfe897609 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] [instance: 0698dc5b-5f47-46c4-ace8-f5e891a964a0] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:38:38.108403 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-7d91e362-7d07-4b1a-8215-142bfe897609 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:38:38.109067 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-7d91e362-7d07-4b1a-8215-142bfe897609 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:38:38.110144 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-7d91e362-7d07-4b1a-8215-142bfe897609 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:38:38.110666 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-7d91e362-7d07-4b1a-8215-142bfe897609 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:38:38.246842 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-7d91e362-7d07-4b1a-8215-142bfe897609 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '163b2f24a72649ac8084be1cac32fa09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e123e9b86124c93a7fc2db9984e7466', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:38:38.254332 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-7d91e362-7d07-4b1a-8215-142bfe897609 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] 10.222.0.11 "GET /compute/v2.1/servers/0698dc5b-5f47-46c4-ace8-f5e891a964a0" status: 200 len: 1565 microversion: 2.1 time: 0.417282 Nov 17 03:38:38.254867 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 1114/2060] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:38:37 2021] GET /compute/v2.1/servers/0698dc5b-5f47-46c4-ace8-f5e891a964a0 => generated 1565 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:38:38.259099 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-5c63a00e-f871-4e41-9913-5e69b1a547b5 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:38:38.259723 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-5c63a00e-f871-4e41-9913-5e69b1a547b5 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] [instance: 5ddbfaaa-fabf-4324-941c-8868625ffefc] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:38:38.265471 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-5c63a00e-f871-4e41-9913-5e69b1a547b5 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:38:38.265912 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-5c63a00e-f871-4e41-9913-5e69b1a547b5 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:38:38.266683 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-5c63a00e-f871-4e41-9913-5e69b1a547b5 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:38:38.267124 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-5c63a00e-f871-4e41-9913-5e69b1a547b5 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:38:38.330567 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-5c63a00e-f871-4e41-9913-5e69b1a547b5 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80763e09d44c475ea2425b22874e9612', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fef02a1dd77946a2ac0e0414b557435f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:38:38.338339 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-5c63a00e-f871-4e41-9913-5e69b1a547b5 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] 10.222.0.11 "GET /compute/v2.1/servers/5ddbfaaa-fabf-4324-941c-8868625ffefc" status: 200 len: 1226 microversion: 2.1 time: 0.082476 Nov 17 03:38:38.338906 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 1115/2061] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:38:38 2021] GET /compute/v2.1/servers/5ddbfaaa-fabf-4324-941c-8868625ffefc => generated 1226 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:38:38.418292 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-caf9e4d2-9b8b-479e-84f7-28a8a0fe7b25 tempest-AttachVolumeTestJSON-1651611701 tempest-AttachVolumeTestJSON-1651611701-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:38:38.418788 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-caf9e4d2-9b8b-479e-84f7-28a8a0fe7b25 tempest-AttachVolumeTestJSON-1651611701 tempest-AttachVolumeTestJSON-1651611701-project] [instance: 9192e77c-eef4-40f6-85f6-afe009ad232f] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:38:38.424716 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-caf9e4d2-9b8b-479e-84f7-28a8a0fe7b25 tempest-AttachVolumeTestJSON-1651611701 tempest-AttachVolumeTestJSON-1651611701-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:38:38.425206 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-caf9e4d2-9b8b-479e-84f7-28a8a0fe7b25 tempest-AttachVolumeTestJSON-1651611701 tempest-AttachVolumeTestJSON-1651611701-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:38:38.425993 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-caf9e4d2-9b8b-479e-84f7-28a8a0fe7b25 tempest-AttachVolumeTestJSON-1651611701 tempest-AttachVolumeTestJSON-1651611701-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:38:38.426422 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-caf9e4d2-9b8b-479e-84f7-28a8a0fe7b25 tempest-AttachVolumeTestJSON-1651611701 tempest-AttachVolumeTestJSON-1651611701-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:38:38.452894 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-caf9e4d2-9b8b-479e-84f7-28a8a0fe7b25 tempest-AttachVolumeTestJSON-1651611701 tempest-AttachVolumeTestJSON-1651611701-project] [instance: 9192e77c-eef4-40f6-85f6-afe009ad232f] Going to try to terminate instance {{(pid=115917) delete /opt/stack/nova/nova/compute/api.py:2614}} Nov 17 03:38:38.536281 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-caf9e4d2-9b8b-479e-84f7-28a8a0fe7b25 tempest-AttachVolumeTestJSON-1651611701 tempest-AttachVolumeTestJSON-1651611701-project] 10.222.0.11 "DELETE /compute/v2.1/servers/9192e77c-eef4-40f6-85f6-afe009ad232f" status: 204 len: 0 microversion: 2.1 time: 0.196179 Nov 17 03:38:38.536908 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 1116/2062] 10.222.0.11 () {58 vars in 1238 bytes} [Wed Nov 17 03:38:38 2021] DELETE /compute/v2.1/servers/9192e77c-eef4-40f6-85f6-afe009ad232f => generated 0 bytes in 197 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 17 03:38:38.541980 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-5d097b6a-b02a-47c3-a173-10966d0dc13b tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:38:38.542541 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-5d097b6a-b02a-47c3-a173-10966d0dc13b tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] [instance: 15abb40f-daf9-4c4b-ac9c-55f57ee7b938] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:38:38.548086 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-5d097b6a-b02a-47c3-a173-10966d0dc13b tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:38:38.548534 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-5d097b6a-b02a-47c3-a173-10966d0dc13b tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:38:38.549343 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-5d097b6a-b02a-47c3-a173-10966d0dc13b tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:38:38.549774 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-5d097b6a-b02a-47c3-a173-10966d0dc13b tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:38:38.837959 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO oslo.messaging._drivers.impl_rabbit [None req-c5705283-e360-4186-b9d2-2d4aba319154 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] [201d3e2d-67a7-4ecf-8825-2618ae09d16b] Reconnected to AMQP server on 10.222.0.11:5672 via [amqp] client with port 43874. Nov 17 03:38:38.841910 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-c5705283-e360-4186-b9d2-2d4aba319154 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] 10.222.0.11 "DELETE /compute/v2.1/servers/15abb40f-daf9-4c4b-ac9c-55f57ee7b938/os-volume_attachments/a3573201-81ca-4c3f-ac74-4588ea819c9f" status: 202 len: 0 microversion: 2.1 time: 241.974528 Nov 17 03:38:38.842509 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 947/2063] 10.222.0.11 () {58 vars in 1415 bytes} [Wed Nov 17 03:34:36 2021] DELETE /compute/v2.1/servers/15abb40f-daf9-4c4b-ac9c-55f57ee7b938/os-volume_attachments/a3573201-81ca-4c3f-ac74-4588ea819c9f => generated 0 bytes in 241976 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 17 03:38:38.847972 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-fb43fee2-c229-48f3-a3c4-6fa80ee15644 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:38:38.848686 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-fb43fee2-c229-48f3-a3c4-6fa80ee15644 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] [instance: 0698dc5b-5f47-46c4-ace8-f5e891a964a0] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:38:38.855219 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-fb43fee2-c229-48f3-a3c4-6fa80ee15644 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:38:38.855667 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-fb43fee2-c229-48f3-a3c4-6fa80ee15644 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:38:38.856451 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-fb43fee2-c229-48f3-a3c4-6fa80ee15644 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:38:38.856922 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-fb43fee2-c229-48f3-a3c4-6fa80ee15644 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:38:38.994166 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-fb43fee2-c229-48f3-a3c4-6fa80ee15644 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '163b2f24a72649ac8084be1cac32fa09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e123e9b86124c93a7fc2db9984e7466', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:38:39.002261 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-fb43fee2-c229-48f3-a3c4-6fa80ee15644 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] 10.222.0.11 "GET /compute/v2.1/servers/0698dc5b-5f47-46c4-ace8-f5e891a964a0" status: 200 len: 1565 microversion: 2.1 time: 0.158655 Nov 17 03:38:39.002797 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 948/2064] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:38:38 2021] GET /compute/v2.1/servers/0698dc5b-5f47-46c4-ace8-f5e891a964a0 => generated 1565 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:38:39.007056 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-1bf630ed-ef33-4557-9dc1-91173a2c3e69 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:38:39.007653 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-1bf630ed-ef33-4557-9dc1-91173a2c3e69 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] [instance: 5ddbfaaa-fabf-4324-941c-8868625ffefc] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:38:39.013455 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-1bf630ed-ef33-4557-9dc1-91173a2c3e69 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:38:39.013906 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-1bf630ed-ef33-4557-9dc1-91173a2c3e69 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:38:39.014678 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-1bf630ed-ef33-4557-9dc1-91173a2c3e69 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:38:39.015101 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-1bf630ed-ef33-4557-9dc1-91173a2c3e69 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:38:39.082606 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-1bf630ed-ef33-4557-9dc1-91173a2c3e69 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80763e09d44c475ea2425b22874e9612', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fef02a1dd77946a2ac0e0414b557435f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:38:39.090220 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-1bf630ed-ef33-4557-9dc1-91173a2c3e69 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] 10.222.0.11 "GET /compute/v2.1/servers/5ddbfaaa-fabf-4324-941c-8868625ffefc" status: 200 len: 1226 microversion: 2.1 time: 0.086363 Nov 17 03:38:39.090684 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 949/2065] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:38:39 2021] GET /compute/v2.1/servers/5ddbfaaa-fabf-4324-941c-8868625ffefc => generated 1226 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:38:39.094831 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-a0bd7ca0-9e98-44f2-ad15-057ee1473cb7 tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:38:39.095347 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-a0bd7ca0-9e98-44f2-ad15-057ee1473cb7 tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] [instance: 61d387ba-e928-4e5f-a79c-4f757643903c] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:38:39.100984 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-a0bd7ca0-9e98-44f2-ad15-057ee1473cb7 tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:38:39.101428 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-a0bd7ca0-9e98-44f2-ad15-057ee1473cb7 tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:38:39.102194 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-a0bd7ca0-9e98-44f2-ad15-057ee1473cb7 tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:38:39.102623 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-a0bd7ca0-9e98-44f2-ad15-057ee1473cb7 tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:38:39.126344 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-a0bd7ca0-9e98-44f2-ad15-057ee1473cb7 tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] [instance: 61d387ba-e928-4e5f-a79c-4f757643903c] Going to try to terminate instance {{(pid=115916) delete /opt/stack/nova/nova/compute/api.py:2614}} Nov 17 03:38:39.200793 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-a0bd7ca0-9e98-44f2-ad15-057ee1473cb7 tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] 10.222.0.11 "DELETE /compute/v2.1/servers/61d387ba-e928-4e5f-a79c-4f757643903c" status: 204 len: 0 microversion: 2.1 time: 0.108902 Nov 17 03:38:39.201402 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 950/2066] 10.222.0.11 () {58 vars in 1238 bytes} [Wed Nov 17 03:38:39 2021] DELETE /compute/v2.1/servers/61d387ba-e928-4e5f-a79c-4f757643903c => generated 0 bytes in 110 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 17 03:38:39.206863 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-d6c7d233-26e9-41d1-867e-94808687d71d tempest-AttachVolumeTestJSON-1651611701 tempest-AttachVolumeTestJSON-1651611701-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:38:39.207433 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-d6c7d233-26e9-41d1-867e-94808687d71d tempest-AttachVolumeTestJSON-1651611701 tempest-AttachVolumeTestJSON-1651611701-project] [instance: 9192e77c-eef4-40f6-85f6-afe009ad232f] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:38:39.213022 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-d6c7d233-26e9-41d1-867e-94808687d71d tempest-AttachVolumeTestJSON-1651611701 tempest-AttachVolumeTestJSON-1651611701-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:38:39.213468 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-d6c7d233-26e9-41d1-867e-94808687d71d tempest-AttachVolumeTestJSON-1651611701 tempest-AttachVolumeTestJSON-1651611701-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:38:39.214237 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-d6c7d233-26e9-41d1-867e-94808687d71d tempest-AttachVolumeTestJSON-1651611701 tempest-AttachVolumeTestJSON-1651611701-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:38:39.214661 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-d6c7d233-26e9-41d1-867e-94808687d71d tempest-AttachVolumeTestJSON-1651611701 tempest-AttachVolumeTestJSON-1651611701-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:38:39.238179 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-d6c7d233-26e9-41d1-867e-94808687d71d tempest-AttachVolumeTestJSON-1651611701 tempest-AttachVolumeTestJSON-1651611701-project] [instance: 9192e77c-eef4-40f6-85f6-afe009ad232f] Going to try to terminate instance {{(pid=115916) delete /opt/stack/nova/nova/compute/api.py:2614}} Nov 17 03:38:39.290653 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.compute.api [None req-d6c7d233-26e9-41d1-867e-94808687d71d tempest-AttachVolumeTestJSON-1651611701 tempest-AttachVolumeTestJSON-1651611701-project] [instance: 9192e77c-eef4-40f6-85f6-afe009ad232f] Instance is already in deleting state, ignoring this request Nov 17 03:38:39.291476 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-d6c7d233-26e9-41d1-867e-94808687d71d tempest-AttachVolumeTestJSON-1651611701 tempest-AttachVolumeTestJSON-1651611701-project] 10.222.0.11 "DELETE /compute/v2.1/servers/9192e77c-eef4-40f6-85f6-afe009ad232f" status: 204 len: 0 microversion: 2.1 time: 0.089015 Nov 17 03:38:39.292016 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 951/2067] 10.222.0.11 () {58 vars in 1238 bytes} [Wed Nov 17 03:38:39 2021] DELETE /compute/v2.1/servers/9192e77c-eef4-40f6-85f6-afe009ad232f => generated 0 bytes in 90 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 17 03:38:39.298539 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-3fda4309-33d0-41fa-bfb2-31f337355b57 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:38:39.299284 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-3fda4309-33d0-41fa-bfb2-31f337355b57 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] [instance: 15abb40f-daf9-4c4b-ac9c-55f57ee7b938] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:38:39.307854 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-3fda4309-33d0-41fa-bfb2-31f337355b57 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:38:39.308300 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-3fda4309-33d0-41fa-bfb2-31f337355b57 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:38:39.309099 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-3fda4309-33d0-41fa-bfb2-31f337355b57 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:38:39.309532 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-3fda4309-33d0-41fa-bfb2-31f337355b57 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:40:09.925164 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 17 03:40:09.925998 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: Wed Nov 17 03:40:09 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/15abb40f-daf9-4c4b-ac9c-55f57ee7b938/os-volume_attachments/a3573201-81ca-4c3f-ac74-4588ea819c9f (ip 10.222.0.11) !!! Nov 17 03:40:38.112311 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.objects.instance [None req-5d097b6a-b02a-47c3-a173-10966d0dc13b tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Lazy-loading 'services' on Instance uuid 15abb40f-daf9-4c4b-ac9c-55f57ee7b938 {{(pid=115917) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Nov 17 03:40:38.193133 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.objects.instance [None req-3fda4309-33d0-41fa-bfb2-31f337355b57 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Lazy-loading 'services' on Instance uuid 15abb40f-daf9-4c4b-ac9c-55f57ee7b938 {{(pid=115916) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Nov 17 03:42:26.626827 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 17 03:42:26.627772 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: Wed Nov 17 03:42:26 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/15abb40f-daf9-4c4b-ac9c-55f57ee7b938/os-volume_attachments/a3573201-81ca-4c3f-ac74-4588ea819c9f (ip 10.222.0.11) !!! Nov 17 03:42:34.507153 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 17 03:42:34.507972 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: Wed Nov 17 03:42:34 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/15abb40f-daf9-4c4b-ac9c-55f57ee7b938/os-volume_attachments/a3573201-81ca-4c3f-ac74-4588ea819c9f (ip 10.222.0.11) !!! Nov 17 03:42:34.716128 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 17 03:42:34.717145 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: Wed Nov 17 03:42:34 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/15abb40f-daf9-4c4b-ac9c-55f57ee7b938/os-volume_attachments/a3573201-81ca-4c3f-ac74-4588ea819c9f (ip 10.222.0.11) !!! Nov 17 03:42:38.363974 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.wsgi [None req-5d097b6a-b02a-47c3-a173-10966d0dc13b tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] HTTP exception thrown: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-37e32fa7-97c8-4d0a-a60b-07d931452542) Nov 17 03:42:38.364597 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-5d097b6a-b02a-47c3-a173-10966d0dc13b tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Returning 400 to user: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-37e32fa7-97c8-4d0a-a60b-07d931452542) {{(pid=115917) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 17 03:42:38.365489 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-5d097b6a-b02a-47c3-a173-10966d0dc13b tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] 10.222.0.11 "DELETE /compute/v2.1/servers/15abb40f-daf9-4c4b-ac9c-55f57ee7b938/os-volume_attachments/a3573201-81ca-4c3f-ac74-4588ea819c9f" status: 400 len: 269 microversion: 2.1 time: 239.827508 Nov 17 03:42:38.366007 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: Wed Nov 17 03:42:38 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/15abb40f-daf9-4c4b-ac9c-55f57ee7b938/os-volume_attachments/a3573201-81ca-4c3f-ac74-4588ea819c9f (ip 10.222.0.11) !!! Nov 17 03:42:38.366007 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: Wed Nov 17 03:42:38 2021 - uwsgi_response_writev_headers_and_body_do(): Broken pipe [core/writer.c line 306] during DELETE /compute/v2.1/servers/15abb40f-daf9-4c4b-ac9c-55f57ee7b938/os-volume_attachments/a3573201-81ca-4c3f-ac74-4588ea819c9f (10.222.0.11) Nov 17 03:42:38.366972 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: CRITICAL nova [None req-5d097b6a-b02a-47c3-a173-10966d0dc13b tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Unhandled error: OSError: write error Nov 17 03:42:38.366972 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: ERROR nova OSError: write error Nov 17 03:42:38.366972 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: ERROR nova Nov 17 03:42:38.367359 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 1117/2068] 10.222.0.11 () {58 vars in 1415 bytes} [Wed Nov 17 03:38:38 2021] DELETE /compute/v2.1/servers/15abb40f-daf9-4c4b-ac9c-55f57ee7b938/os-volume_attachments/a3573201-81ca-4c3f-ac74-4588ea819c9f => generated 0 bytes in 239830 msecs (HTTP/1.1 400) 9 headers in 0 bytes (0 switches on core 0) Nov 17 03:42:38.372742 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-6aec42ef-2491-4608-89d9-3ddae6a0d5d4 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:42:38.373389 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-6aec42ef-2491-4608-89d9-3ddae6a0d5d4 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] [instance: 0698dc5b-5f47-46c4-ace8-f5e891a964a0] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:42:38.380198 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-6aec42ef-2491-4608-89d9-3ddae6a0d5d4 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:42:38.380653 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-6aec42ef-2491-4608-89d9-3ddae6a0d5d4 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:42:38.381638 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-6aec42ef-2491-4608-89d9-3ddae6a0d5d4 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:42:38.382079 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-6aec42ef-2491-4608-89d9-3ddae6a0d5d4 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:42:38.470876 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.wsgi [None req-3fda4309-33d0-41fa-bfb2-31f337355b57 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] HTTP exception thrown: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-1706d864-4026-4b5f-92dc-8dcacf83cc37) Nov 17 03:42:38.471561 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-3fda4309-33d0-41fa-bfb2-31f337355b57 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Returning 400 to user: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-1706d864-4026-4b5f-92dc-8dcacf83cc37) {{(pid=115916) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 17 03:42:38.472637 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-3fda4309-33d0-41fa-bfb2-31f337355b57 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] 10.222.0.11 "DELETE /compute/v2.1/servers/15abb40f-daf9-4c4b-ac9c-55f57ee7b938/os-volume_attachments/a3573201-81ca-4c3f-ac74-4588ea819c9f" status: 400 len: 269 microversion: 2.1 time: 239.179633 Nov 17 03:42:38.473247 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: Wed Nov 17 03:42:38 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/15abb40f-daf9-4c4b-ac9c-55f57ee7b938/os-volume_attachments/a3573201-81ca-4c3f-ac74-4588ea819c9f (ip 10.222.0.11) !!! Nov 17 03:42:38.473605 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: Wed Nov 17 03:42:38 2021 - uwsgi_response_writev_headers_and_body_do(): Broken pipe [core/writer.c line 306] during DELETE /compute/v2.1/servers/15abb40f-daf9-4c4b-ac9c-55f57ee7b938/os-volume_attachments/a3573201-81ca-4c3f-ac74-4588ea819c9f (10.222.0.11) Nov 17 03:42:38.474486 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: CRITICAL nova [None req-3fda4309-33d0-41fa-bfb2-31f337355b57 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Unhandled error: OSError: write error Nov 17 03:42:38.474486 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: ERROR nova OSError: write error Nov 17 03:42:38.474486 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: ERROR nova Nov 17 03:42:38.474766 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 952/2069] 10.222.0.11 () {58 vars in 1415 bytes} [Wed Nov 17 03:38:39 2021] DELETE /compute/v2.1/servers/15abb40f-daf9-4c4b-ac9c-55f57ee7b938/os-volume_attachments/a3573201-81ca-4c3f-ac74-4588ea819c9f => generated 0 bytes in 239182 msecs (HTTP/1.1 400) 9 headers in 0 bytes (0 switches on core 0) Nov 17 03:42:38.479687 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-5ceeb37a-adcf-46f4-97eb-fe2462845dea tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:42:38.480316 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-5ceeb37a-adcf-46f4-97eb-fe2462845dea tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] [instance: 5ddbfaaa-fabf-4324-941c-8868625ffefc] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:42:38.486834 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-5ceeb37a-adcf-46f4-97eb-fe2462845dea tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:42:38.487501 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-5ceeb37a-adcf-46f4-97eb-fe2462845dea tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:42:38.488283 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-5ceeb37a-adcf-46f4-97eb-fe2462845dea tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:42:38.488715 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-5ceeb37a-adcf-46f4-97eb-fe2462845dea tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:42:38.518258 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-5ceeb37a-adcf-46f4-97eb-fe2462845dea tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:42:38.518695 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-5ceeb37a-adcf-46f4-97eb-fe2462845dea tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:42:38.519146 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.objects.instance [None req-5ceeb37a-adcf-46f4-97eb-fe2462845dea tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Lazy-loading 'fault' on Instance uuid 5ddbfaaa-fabf-4324-941c-8868625ffefc {{(pid=115916) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Nov 17 03:42:38.524595 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-6aec42ef-2491-4608-89d9-3ddae6a0d5d4 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '163b2f24a72649ac8084be1cac32fa09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e123e9b86124c93a7fc2db9984e7466', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:42:38.533104 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-6aec42ef-2491-4608-89d9-3ddae6a0d5d4 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] 10.222.0.11 "GET /compute/v2.1/servers/0698dc5b-5f47-46c4-ace8-f5e891a964a0" status: 200 len: 1565 microversion: 2.1 time: 0.164659 Nov 17 03:42:38.534299 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: Wed Nov 17 03:42:38 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/0698dc5b-5f47-46c4-ace8-f5e891a964a0 (ip 10.222.0.11) !!! Nov 17 03:42:38.534534 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: Wed Nov 17 03:42:38 2021 - uwsgi_response_writev_headers_and_body_do(): Broken pipe [core/writer.c line 306] during GET /compute/v2.1/servers/0698dc5b-5f47-46c4-ace8-f5e891a964a0 (10.222.0.11) Nov 17 03:42:38.535184 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: CRITICAL nova [None req-6aec42ef-2491-4608-89d9-3ddae6a0d5d4 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Unhandled error: OSError: write error Nov 17 03:42:38.535184 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: ERROR nova OSError: write error Nov 17 03:42:38.535184 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: ERROR nova Nov 17 03:42:38.535423 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 1118/2070] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:42:38 2021] GET /compute/v2.1/servers/0698dc5b-5f47-46c4-ace8-f5e891a964a0 => generated 0 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 0 bytes (0 switches on core 0) Nov 17 03:42:38.564994 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-5ceeb37a-adcf-46f4-97eb-fe2462845dea tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80763e09d44c475ea2425b22874e9612', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fef02a1dd77946a2ac0e0414b557435f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:42:38.573126 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-5ceeb37a-adcf-46f4-97eb-fe2462845dea tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] 10.222.0.11 "GET /compute/v2.1/servers/5ddbfaaa-fabf-4324-941c-8868625ffefc" status: 200 len: 1231 microversion: 2.1 time: 0.097534 Nov 17 03:42:38.573651 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: Wed Nov 17 03:42:38 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/5ddbfaaa-fabf-4324-941c-8868625ffefc (ip 10.222.0.11) !!! Nov 17 03:42:38.573651 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: Wed Nov 17 03:42:38 2021 - uwsgi_response_writev_headers_and_body_do(): Broken pipe [core/writer.c line 306] during GET /compute/v2.1/servers/5ddbfaaa-fabf-4324-941c-8868625ffefc (10.222.0.11) Nov 17 03:42:38.574241 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: CRITICAL nova [None req-5ceeb37a-adcf-46f4-97eb-fe2462845dea tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Unhandled error: OSError: write error Nov 17 03:42:38.574241 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: ERROR nova OSError: write error Nov 17 03:42:38.574241 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: ERROR nova Nov 17 03:42:38.574592 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 953/2071] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:42:38 2021] GET /compute/v2.1/servers/5ddbfaaa-fabf-4324-941c-8868625ffefc => generated 0 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 0 bytes (0 switches on core 0) Nov 17 03:42:38.578663 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-1802d161-553b-454c-a34f-2ebc16812450 tempest-AttachVolumeTestJSON-1651611701 tempest-AttachVolumeTestJSON-1651611701-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:42:38.579155 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-1802d161-553b-454c-a34f-2ebc16812450 tempest-AttachVolumeTestJSON-1651611701 tempest-AttachVolumeTestJSON-1651611701-project] [instance: 9192e77c-eef4-40f6-85f6-afe009ad232f] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:42:38.585760 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-1802d161-553b-454c-a34f-2ebc16812450 tempest-AttachVolumeTestJSON-1651611701 tempest-AttachVolumeTestJSON-1651611701-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:42:38.586423 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-1802d161-553b-454c-a34f-2ebc16812450 tempest-AttachVolumeTestJSON-1651611701 tempest-AttachVolumeTestJSON-1651611701-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:42:38.587219 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-1802d161-553b-454c-a34f-2ebc16812450 tempest-AttachVolumeTestJSON-1651611701 tempest-AttachVolumeTestJSON-1651611701-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:42:38.587656 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-1802d161-553b-454c-a34f-2ebc16812450 tempest-AttachVolumeTestJSON-1651611701 tempest-AttachVolumeTestJSON-1651611701-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:42:38.611628 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.wsgi [None req-1802d161-553b-454c-a34f-2ebc16812450 tempest-AttachVolumeTestJSON-1651611701 tempest-AttachVolumeTestJSON-1651611701-project] HTTP exception thrown: Instance 9192e77c-eef4-40f6-85f6-afe009ad232f could not be found. Nov 17 03:42:38.612294 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-1802d161-553b-454c-a34f-2ebc16812450 tempest-AttachVolumeTestJSON-1651611701 tempest-AttachVolumeTestJSON-1651611701-project] Returning 404 to user: Instance 9192e77c-eef4-40f6-85f6-afe009ad232f could not be found. {{(pid=115916) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 17 03:42:38.613105 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-1802d161-553b-454c-a34f-2ebc16812450 tempest-AttachVolumeTestJSON-1651611701 tempest-AttachVolumeTestJSON-1651611701-project] 10.222.0.11 "DELETE /compute/v2.1/servers/9192e77c-eef4-40f6-85f6-afe009ad232f" status: 404 len: 111 microversion: 2.1 time: 0.037840 Nov 17 03:42:38.613859 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 954/2072] 10.222.0.11 () {58 vars in 1238 bytes} [Wed Nov 17 03:42:38 2021] DELETE /compute/v2.1/servers/9192e77c-eef4-40f6-85f6-afe009ad232f => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 17 03:42:38.619318 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-4452e05e-f836-4a1f-b9be-b30c3c261b27 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:42:38.619996 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-4452e05e-f836-4a1f-b9be-b30c3c261b27 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] [instance: 15abb40f-daf9-4c4b-ac9c-55f57ee7b938] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:42:38.626043 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-4452e05e-f836-4a1f-b9be-b30c3c261b27 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:42:38.626713 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-4452e05e-f836-4a1f-b9be-b30c3c261b27 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:42:38.627792 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-4452e05e-f836-4a1f-b9be-b30c3c261b27 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:42:38.628425 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-4452e05e-f836-4a1f-b9be-b30c3c261b27 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:42:38.683863 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-be1d5dc8-aa73-4d49-ba68-4c1c27859cd9 tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:42:38.684367 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-be1d5dc8-aa73-4d49-ba68-4c1c27859cd9 tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] [instance: 61d387ba-e928-4e5f-a79c-4f757643903c] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:42:38.690610 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-be1d5dc8-aa73-4d49-ba68-4c1c27859cd9 tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:42:38.691056 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-be1d5dc8-aa73-4d49-ba68-4c1c27859cd9 tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:42:38.691833 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-be1d5dc8-aa73-4d49-ba68-4c1c27859cd9 tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:42:38.692270 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-be1d5dc8-aa73-4d49-ba68-4c1c27859cd9 tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:42:38.707361 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.wsgi [None req-be1d5dc8-aa73-4d49-ba68-4c1c27859cd9 tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] HTTP exception thrown: Instance 61d387ba-e928-4e5f-a79c-4f757643903c could not be found. Nov 17 03:42:38.707962 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-be1d5dc8-aa73-4d49-ba68-4c1c27859cd9 tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] Returning 404 to user: Instance 61d387ba-e928-4e5f-a79c-4f757643903c could not be found. {{(pid=115917) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 17 03:42:38.708851 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-be1d5dc8-aa73-4d49-ba68-4c1c27859cd9 tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] 10.222.0.11 "DELETE /compute/v2.1/servers/61d387ba-e928-4e5f-a79c-4f757643903c" status: 404 len: 111 microversion: 2.1 time: 0.172509 Nov 17 03:42:38.709341 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: Wed Nov 17 03:42:38 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/61d387ba-e928-4e5f-a79c-4f757643903c (ip 10.222.0.11) !!! Nov 17 03:42:38.709341 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: Wed Nov 17 03:42:38 2021 - uwsgi_response_writev_headers_and_body_do(): Broken pipe [core/writer.c line 306] during DELETE /compute/v2.1/servers/61d387ba-e928-4e5f-a79c-4f757643903c (10.222.0.11) Nov 17 03:42:38.709916 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: CRITICAL nova [None req-be1d5dc8-aa73-4d49-ba68-4c1c27859cd9 tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] Unhandled error: OSError: write error Nov 17 03:42:38.709916 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: ERROR nova OSError: write error Nov 17 03:42:38.709916 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: ERROR nova Nov 17 03:42:38.710189 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 1119/2073] 10.222.0.11 () {58 vars in 1238 bytes} [Wed Nov 17 03:42:38 2021] DELETE /compute/v2.1/servers/61d387ba-e928-4e5f-a79c-4f757643903c => generated 0 bytes in 174 msecs (HTTP/1.1 404) 9 headers in 0 bytes (0 switches on core 0) Nov 17 03:42:38.715558 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-f2f9564d-4e2f-4aa3-a0f8-606a584a2c48 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:42:38.716159 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-f2f9564d-4e2f-4aa3-a0f8-606a584a2c48 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] [instance: 0698dc5b-5f47-46c4-ace8-f5e891a964a0] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:42:38.722767 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-f2f9564d-4e2f-4aa3-a0f8-606a584a2c48 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:42:38.723234 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-f2f9564d-4e2f-4aa3-a0f8-606a584a2c48 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:42:38.723980 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-f2f9564d-4e2f-4aa3-a0f8-606a584a2c48 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:42:38.724892 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-f2f9564d-4e2f-4aa3-a0f8-606a584a2c48 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:42:38.869488 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-f2f9564d-4e2f-4aa3-a0f8-606a584a2c48 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '163b2f24a72649ac8084be1cac32fa09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e123e9b86124c93a7fc2db9984e7466', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:42:38.877227 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-f2f9564d-4e2f-4aa3-a0f8-606a584a2c48 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] 10.222.0.11 "GET /compute/v2.1/servers/0698dc5b-5f47-46c4-ace8-f5e891a964a0" status: 200 len: 1565 microversion: 2.1 time: 0.166224 Nov 17 03:42:38.877815 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 1120/2074] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:42:38 2021] GET /compute/v2.1/servers/0698dc5b-5f47-46c4-ace8-f5e891a964a0 => generated 1565 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:42:38.882058 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-c4e25f20-891f-4e1f-93e9-e65331266c71 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:42:38.882698 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-c4e25f20-891f-4e1f-93e9-e65331266c71 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] [instance: 5ddbfaaa-fabf-4324-941c-8868625ffefc] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:42:38.889044 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-c4e25f20-891f-4e1f-93e9-e65331266c71 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:42:38.889495 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-c4e25f20-891f-4e1f-93e9-e65331266c71 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:42:38.890265 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-c4e25f20-891f-4e1f-93e9-e65331266c71 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:42:38.890718 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-c4e25f20-891f-4e1f-93e9-e65331266c71 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:42:38.904141 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.wsgi [None req-c4e25f20-891f-4e1f-93e9-e65331266c71 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] HTTP exception thrown: Instance 5ddbfaaa-fabf-4324-941c-8868625ffefc could not be found. Nov 17 03:42:38.904723 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-c4e25f20-891f-4e1f-93e9-e65331266c71 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Returning 404 to user: Instance 5ddbfaaa-fabf-4324-941c-8868625ffefc could not be found. {{(pid=115917) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 17 03:42:38.905575 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-c4e25f20-891f-4e1f-93e9-e65331266c71 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] 10.222.0.11 "GET /compute/v2.1/servers/5ddbfaaa-fabf-4324-941c-8868625ffefc" status: 404 len: 111 microversion: 2.1 time: 0.026841 Nov 17 03:42:38.906088 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 1121/2075] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:42:38 2021] GET /compute/v2.1/servers/5ddbfaaa-fabf-4324-941c-8868625ffefc => generated 111 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 17 03:42:38.910146 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-7a0eac27-a670-4cab-ab8c-684fc44d96e9 tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:42:38.910767 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-7a0eac27-a670-4cab-ab8c-684fc44d96e9 tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] [instance: 61d387ba-e928-4e5f-a79c-4f757643903c] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:42:38.917535 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-7a0eac27-a670-4cab-ab8c-684fc44d96e9 tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:42:38.917979 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-7a0eac27-a670-4cab-ab8c-684fc44d96e9 tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:42:38.918749 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-7a0eac27-a670-4cab-ab8c-684fc44d96e9 tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:42:38.919187 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-7a0eac27-a670-4cab-ab8c-684fc44d96e9 tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:42:38.932497 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.wsgi [None req-7a0eac27-a670-4cab-ab8c-684fc44d96e9 tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] HTTP exception thrown: Instance 61d387ba-e928-4e5f-a79c-4f757643903c could not be found. Nov 17 03:42:38.933108 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-7a0eac27-a670-4cab-ab8c-684fc44d96e9 tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] Returning 404 to user: Instance 61d387ba-e928-4e5f-a79c-4f757643903c could not be found. {{(pid=115917) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 17 03:42:38.933909 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-7a0eac27-a670-4cab-ab8c-684fc44d96e9 tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] 10.222.0.11 "DELETE /compute/v2.1/servers/61d387ba-e928-4e5f-a79c-4f757643903c" status: 404 len: 111 microversion: 2.1 time: 0.026960 Nov 17 03:42:38.934413 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 1122/2076] 10.222.0.11 () {58 vars in 1238 bytes} [Wed Nov 17 03:42:38 2021] DELETE /compute/v2.1/servers/61d387ba-e928-4e5f-a79c-4f757643903c => generated 111 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 17 03:42:38.997487 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [req-d8161734-8ee2-4637-8b10-b2f2ef90fc40 req-8fd9df4c-8edf-4092-acf4-1748c843fbe9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "61d387ba-e928-4e5f-a79c-4f757643903c", "name": "network-vif-deleted", "tag": "32f6ed0a-f65a-4a5d-8a00-f2d1292ed32c"}]} {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 17 03:42:38.999144 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 17 03:42:38.999144 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: warnings.warn(msg) Nov 17 03:42:39.006411 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [req-d8161734-8ee2-4637-8b10-b2f2ef90fc40 req-8fd9df4c-8edf-4092-acf4-1748c843fbe9 service nova] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:42:39.006851 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [req-d8161734-8ee2-4637-8b10-b2f2ef90fc40 req-8fd9df4c-8edf-4092-acf4-1748c843fbe9 service nova] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:42:39.018134 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.compute.server_external_events [req-d8161734-8ee2-4637-8b10-b2f2ef90fc40 req-8fd9df4c-8edf-4092-acf4-1748c843fbe9 service nova] Creating event network-vif-deleted:32f6ed0a-f65a-4a5d-8a00-f2d1292ed32c for instance 61d387ba-e928-4e5f-a79c-4f757643903c on hv-cinder-81803 Nov 17 03:42:39.021475 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: ERROR oslo.messaging._drivers.impl_rabbit [req-d8161734-8ee2-4637-8b10-b2f2ef90fc40 req-8fd9df4c-8edf-4092-acf4-1748c843fbe9 service nova] [f0347f10-0ad6-4123-a753-d9b92ea34588] AMQP server on 10.222.0.11:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Nov 17 03:42:40.048350 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO oslo.messaging._drivers.impl_rabbit [req-d8161734-8ee2-4637-8b10-b2f2ef90fc40 req-8fd9df4c-8edf-4092-acf4-1748c843fbe9 service nova] [f0347f10-0ad6-4123-a753-d9b92ea34588] Reconnected to AMQP server on 10.222.0.11:5672 via [amqp] client with port 44014. Nov 17 03:42:40.055745 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [req-d8161734-8ee2-4637-8b10-b2f2ef90fc40 req-8fd9df4c-8edf-4092-acf4-1748c843fbe9 service nova] 10.222.0.11 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 1.120083 Nov 17 03:42:40.056797 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 1123/2077] 10.222.0.11 () {64 vars in 1317 bytes} [Wed Nov 17 03:42:38 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 1122 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 17 03:42:40.062151 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-53f882e6-5f2c-42bb-a87a-0d4f1616e0e8 tempest-AttachVolumeTestJSON-1651611701 tempest-AttachVolumeTestJSON-1651611701-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:42:40.062722 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-53f882e6-5f2c-42bb-a87a-0d4f1616e0e8 tempest-AttachVolumeTestJSON-1651611701 tempest-AttachVolumeTestJSON-1651611701-project] [instance: 9192e77c-eef4-40f6-85f6-afe009ad232f] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:42:40.069441 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-53f882e6-5f2c-42bb-a87a-0d4f1616e0e8 tempest-AttachVolumeTestJSON-1651611701 tempest-AttachVolumeTestJSON-1651611701-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:42:40.069913 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-53f882e6-5f2c-42bb-a87a-0d4f1616e0e8 tempest-AttachVolumeTestJSON-1651611701 tempest-AttachVolumeTestJSON-1651611701-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:42:40.070720 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-53f882e6-5f2c-42bb-a87a-0d4f1616e0e8 tempest-AttachVolumeTestJSON-1651611701 tempest-AttachVolumeTestJSON-1651611701-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:42:40.071147 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-53f882e6-5f2c-42bb-a87a-0d4f1616e0e8 tempest-AttachVolumeTestJSON-1651611701 tempest-AttachVolumeTestJSON-1651611701-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:42:40.087281 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.wsgi [None req-53f882e6-5f2c-42bb-a87a-0d4f1616e0e8 tempest-AttachVolumeTestJSON-1651611701 tempest-AttachVolumeTestJSON-1651611701-project] HTTP exception thrown: Instance 9192e77c-eef4-40f6-85f6-afe009ad232f could not be found. Nov 17 03:42:40.087989 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-53f882e6-5f2c-42bb-a87a-0d4f1616e0e8 tempest-AttachVolumeTestJSON-1651611701 tempest-AttachVolumeTestJSON-1651611701-project] Returning 404 to user: Instance 9192e77c-eef4-40f6-85f6-afe009ad232f could not be found. {{(pid=115917) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 17 03:42:40.088987 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-53f882e6-5f2c-42bb-a87a-0d4f1616e0e8 tempest-AttachVolumeTestJSON-1651611701 tempest-AttachVolumeTestJSON-1651611701-project] 10.222.0.11 "DELETE /compute/v2.1/servers/9192e77c-eef4-40f6-85f6-afe009ad232f" status: 404 len: 111 microversion: 2.1 time: 0.030743 Nov 17 03:42:40.089576 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 1124/2078] 10.222.0.11 () {58 vars in 1238 bytes} [Wed Nov 17 03:42:40 2021] DELETE /compute/v2.1/servers/9192e77c-eef4-40f6-85f6-afe009ad232f => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 17 03:42:40.094138 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-d3dcc68c-c374-4428-a0f5-2e852c9c5205 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:42:40.094620 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-d3dcc68c-c374-4428-a0f5-2e852c9c5205 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] [instance: 15abb40f-daf9-4c4b-ac9c-55f57ee7b938] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:42:40.100260 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-d3dcc68c-c374-4428-a0f5-2e852c9c5205 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:42:40.100726 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-d3dcc68c-c374-4428-a0f5-2e852c9c5205 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:42:40.101501 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-d3dcc68c-c374-4428-a0f5-2e852c9c5205 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:42:40.101927 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-d3dcc68c-c374-4428-a0f5-2e852c9c5205 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:43:00.682674 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 17 03:43:00.683652 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: Wed Nov 17 03:43:00 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/15abb40f-daf9-4c4b-ac9c-55f57ee7b938/os-volume_attachments/a3573201-81ca-4c3f-ac74-4588ea819c9f (ip 10.222.0.11) !!! Nov 17 03:44:17.948564 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.objects.instance [None req-4452e05e-f836-4a1f-b9be-b30c3c261b27 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Lazy-loading 'services' on Instance uuid 15abb40f-daf9-4c4b-ac9c-55f57ee7b938 {{(pid=115916) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Nov 17 03:44:18.026586 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.objects.instance [None req-d3dcc68c-c374-4428-a0f5-2e852c9c5205 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Lazy-loading 'services' on Instance uuid 15abb40f-daf9-4c4b-ac9c-55f57ee7b938 {{(pid=115917) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Nov 17 03:44:18.130323 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.wsgi [None req-4452e05e-f836-4a1f-b9be-b30c3c261b27 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] HTTP exception thrown: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-bed0bb24-ea14-410b-a96e-edd66601f7af) Nov 17 03:44:18.130962 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-4452e05e-f836-4a1f-b9be-b30c3c261b27 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Returning 400 to user: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-bed0bb24-ea14-410b-a96e-edd66601f7af) {{(pid=115916) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 17 03:44:18.131817 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-4452e05e-f836-4a1f-b9be-b30c3c261b27 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] 10.222.0.11 "DELETE /compute/v2.1/servers/15abb40f-daf9-4c4b-ac9c-55f57ee7b938/os-volume_attachments/a3573201-81ca-4c3f-ac74-4588ea819c9f" status: 400 len: 269 microversion: 2.1 time: 99.516807 Nov 17 03:44:18.132479 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: Wed Nov 17 03:44:18 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/15abb40f-daf9-4c4b-ac9c-55f57ee7b938/os-volume_attachments/a3573201-81ca-4c3f-ac74-4588ea819c9f (ip 10.222.0.11) !!! Nov 17 03:44:18.132479 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: Wed Nov 17 03:44:18 2021 - uwsgi_response_writev_headers_and_body_do(): Broken pipe [core/writer.c line 306] during DELETE /compute/v2.1/servers/15abb40f-daf9-4c4b-ac9c-55f57ee7b938/os-volume_attachments/a3573201-81ca-4c3f-ac74-4588ea819c9f (10.222.0.11) Nov 17 03:44:18.133198 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: CRITICAL nova [None req-4452e05e-f836-4a1f-b9be-b30c3c261b27 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Unhandled error: OSError: write error Nov 17 03:44:18.133198 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: ERROR nova OSError: write error Nov 17 03:44:18.133198 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: ERROR nova Nov 17 03:44:18.133489 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 955/2079] 10.222.0.11 () {58 vars in 1415 bytes} [Wed Nov 17 03:42:38 2021] DELETE /compute/v2.1/servers/15abb40f-daf9-4c4b-ac9c-55f57ee7b938/os-volume_attachments/a3573201-81ca-4c3f-ac74-4588ea819c9f => generated 0 bytes in 99519 msecs (HTTP/1.1 400) 9 headers in 0 bytes (0 switches on core 0) Nov 17 03:44:18.162095 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.wsgi [None req-d3dcc68c-c374-4428-a0f5-2e852c9c5205 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] HTTP exception thrown: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-560880ee-e211-4877-89f6-5a7cd1db9bad) Nov 17 03:44:18.162743 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-d3dcc68c-c374-4428-a0f5-2e852c9c5205 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Returning 400 to user: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-560880ee-e211-4877-89f6-5a7cd1db9bad) {{(pid=115917) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 17 03:44:18.163737 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-d3dcc68c-c374-4428-a0f5-2e852c9c5205 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] 10.222.0.11 "DELETE /compute/v2.1/servers/15abb40f-daf9-4c4b-ac9c-55f57ee7b938/os-volume_attachments/a3573201-81ca-4c3f-ac74-4588ea819c9f" status: 400 len: 269 microversion: 2.1 time: 98.073109 Nov 17 03:44:18.164263 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 1125/2080] 10.222.0.11 () {58 vars in 1415 bytes} [Wed Nov 17 03:42:40 2021] DELETE /compute/v2.1/servers/15abb40f-daf9-4c4b-ac9c-55f57ee7b938/os-volume_attachments/a3573201-81ca-4c3f-ac74-4588ea819c9f => generated 269 bytes in 98074 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Nov 17 03:44:18.192808 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-ea73dda5-e503-46c8-b35b-08b520e08eb7 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:44:18.193505 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-ea73dda5-e503-46c8-b35b-08b520e08eb7 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] [instance: 0698dc5b-5f47-46c4-ace8-f5e891a964a0] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:44:18.206123 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-ea73dda5-e503-46c8-b35b-08b520e08eb7 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:44:18.206674 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-ea73dda5-e503-46c8-b35b-08b520e08eb7 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:44:18.207532 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-ea73dda5-e503-46c8-b35b-08b520e08eb7 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:44:18.208045 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-ea73dda5-e503-46c8-b35b-08b520e08eb7 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:44:18.239654 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-bf45cd4c-168a-4f46-b41d-7407340d8dd4 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:44:18.240292 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-bf45cd4c-168a-4f46-b41d-7407340d8dd4 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] [instance: 5ddbfaaa-fabf-4324-941c-8868625ffefc] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:44:18.246241 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-bf45cd4c-168a-4f46-b41d-7407340d8dd4 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:44:18.246684 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-bf45cd4c-168a-4f46-b41d-7407340d8dd4 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:44:18.247447 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-bf45cd4c-168a-4f46-b41d-7407340d8dd4 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:44:18.247881 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-bf45cd4c-168a-4f46-b41d-7407340d8dd4 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:44:18.262067 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.wsgi [None req-bf45cd4c-168a-4f46-b41d-7407340d8dd4 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] HTTP exception thrown: Instance 5ddbfaaa-fabf-4324-941c-8868625ffefc could not be found. Nov 17 03:44:18.262663 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-bf45cd4c-168a-4f46-b41d-7407340d8dd4 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Returning 404 to user: Instance 5ddbfaaa-fabf-4324-941c-8868625ffefc could not be found. {{(pid=115917) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 17 03:44:18.263688 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-bf45cd4c-168a-4f46-b41d-7407340d8dd4 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] 10.222.0.11 "GET /compute/v2.1/servers/5ddbfaaa-fabf-4324-941c-8868625ffefc" status: 404 len: 111 microversion: 2.1 time: 0.098537 Nov 17 03:44:18.265044 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 1126/2081] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:44:18 2021] GET /compute/v2.1/servers/5ddbfaaa-fabf-4324-941c-8868625ffefc => generated 111 bytes in 100 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 17 03:44:18.270357 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-02460ca2-0bc6-4650-b5b0-1da3a56b24a4 tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:44:18.271410 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-02460ca2-0bc6-4650-b5b0-1da3a56b24a4 tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] [instance: 61d387ba-e928-4e5f-a79c-4f757643903c] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:44:18.278097 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-02460ca2-0bc6-4650-b5b0-1da3a56b24a4 tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:44:18.278541 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-02460ca2-0bc6-4650-b5b0-1da3a56b24a4 tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:44:18.279287 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-02460ca2-0bc6-4650-b5b0-1da3a56b24a4 tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:44:18.279753 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-02460ca2-0bc6-4650-b5b0-1da3a56b24a4 tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:44:18.293966 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.wsgi [None req-02460ca2-0bc6-4650-b5b0-1da3a56b24a4 tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] HTTP exception thrown: Instance 61d387ba-e928-4e5f-a79c-4f757643903c could not be found. Nov 17 03:44:18.294556 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-02460ca2-0bc6-4650-b5b0-1da3a56b24a4 tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] Returning 404 to user: Instance 61d387ba-e928-4e5f-a79c-4f757643903c could not be found. {{(pid=115917) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 17 03:44:18.295449 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-02460ca2-0bc6-4650-b5b0-1da3a56b24a4 tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] 10.222.0.11 "DELETE /compute/v2.1/servers/61d387ba-e928-4e5f-a79c-4f757643903c" status: 404 len: 111 microversion: 2.1 time: 0.029263 Nov 17 03:44:18.296023 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 1127/2082] 10.222.0.11 () {58 vars in 1238 bytes} [Wed Nov 17 03:44:18 2021] DELETE /compute/v2.1/servers/61d387ba-e928-4e5f-a79c-4f757643903c => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 17 03:44:18.345981 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-ea73dda5-e503-46c8-b35b-08b520e08eb7 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '163b2f24a72649ac8084be1cac32fa09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e123e9b86124c93a7fc2db9984e7466', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:44:18.353657 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-ea73dda5-e503-46c8-b35b-08b520e08eb7 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] 10.222.0.11 "GET /compute/v2.1/servers/0698dc5b-5f47-46c4-ace8-f5e891a964a0" status: 200 len: 1565 microversion: 2.1 time: 0.219304 Nov 17 03:44:18.354269 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 956/2083] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:44:18 2021] GET /compute/v2.1/servers/0698dc5b-5f47-46c4-ace8-f5e891a964a0 => generated 1565 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:44:18.359520 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-2c7b0df8-7ae2-41f0-a68e-f8702671c043 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:44:18.360010 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-2c7b0df8-7ae2-41f0-a68e-f8702671c043 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] [instance: 15abb40f-daf9-4c4b-ac9c-55f57ee7b938] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:44:18.365839 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-2c7b0df8-7ae2-41f0-a68e-f8702671c043 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:44:18.366608 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-2c7b0df8-7ae2-41f0-a68e-f8702671c043 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:44:18.367215 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-2c7b0df8-7ae2-41f0-a68e-f8702671c043 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:44:18.367629 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-2c7b0df8-7ae2-41f0-a68e-f8702671c043 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:44:18.417261 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-06d93144-9695-421a-84ed-a751424a74e2 tempest-AttachVolumeTestJSON-1651611701 tempest-AttachVolumeTestJSON-1651611701-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:44:18.417748 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-06d93144-9695-421a-84ed-a751424a74e2 tempest-AttachVolumeTestJSON-1651611701 tempest-AttachVolumeTestJSON-1651611701-project] [instance: 9192e77c-eef4-40f6-85f6-afe009ad232f] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:44:18.424128 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-06d93144-9695-421a-84ed-a751424a74e2 tempest-AttachVolumeTestJSON-1651611701 tempest-AttachVolumeTestJSON-1651611701-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:44:18.424568 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-06d93144-9695-421a-84ed-a751424a74e2 tempest-AttachVolumeTestJSON-1651611701 tempest-AttachVolumeTestJSON-1651611701-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:44:18.425362 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-06d93144-9695-421a-84ed-a751424a74e2 tempest-AttachVolumeTestJSON-1651611701 tempest-AttachVolumeTestJSON-1651611701-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:44:18.425765 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-06d93144-9695-421a-84ed-a751424a74e2 tempest-AttachVolumeTestJSON-1651611701 tempest-AttachVolumeTestJSON-1651611701-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:44:18.440168 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.wsgi [None req-06d93144-9695-421a-84ed-a751424a74e2 tempest-AttachVolumeTestJSON-1651611701 tempest-AttachVolumeTestJSON-1651611701-project] HTTP exception thrown: Instance 9192e77c-eef4-40f6-85f6-afe009ad232f could not be found. Nov 17 03:44:18.440741 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-06d93144-9695-421a-84ed-a751424a74e2 tempest-AttachVolumeTestJSON-1651611701 tempest-AttachVolumeTestJSON-1651611701-project] Returning 404 to user: Instance 9192e77c-eef4-40f6-85f6-afe009ad232f could not be found. {{(pid=115917) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 17 03:44:18.441573 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-06d93144-9695-421a-84ed-a751424a74e2 tempest-AttachVolumeTestJSON-1651611701 tempest-AttachVolumeTestJSON-1651611701-project] 10.222.0.11 "DELETE /compute/v2.1/servers/9192e77c-eef4-40f6-85f6-afe009ad232f" status: 404 len: 111 microversion: 2.1 time: 0.144616 Nov 17 03:44:18.442105 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 1128/2084] 10.222.0.11 () {58 vars in 1238 bytes} [Wed Nov 17 03:44:18 2021] DELETE /compute/v2.1/servers/9192e77c-eef4-40f6-85f6-afe009ad232f => generated 111 bytes in 146 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 17 03:44:18.446230 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-3352b1cc-7c81-4783-bb82-8b4a599a2e04 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:44:18.446820 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-3352b1cc-7c81-4783-bb82-8b4a599a2e04 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] [instance: 0698dc5b-5f47-46c4-ace8-f5e891a964a0] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:44:18.452150 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-3352b1cc-7c81-4783-bb82-8b4a599a2e04 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:44:18.452584 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-3352b1cc-7c81-4783-bb82-8b4a599a2e04 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:44:18.453460 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-3352b1cc-7c81-4783-bb82-8b4a599a2e04 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:44:18.453886 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-3352b1cc-7c81-4783-bb82-8b4a599a2e04 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:44:18.599090 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-3352b1cc-7c81-4783-bb82-8b4a599a2e04 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '163b2f24a72649ac8084be1cac32fa09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e123e9b86124c93a7fc2db9984e7466', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:44:18.610895 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-3352b1cc-7c81-4783-bb82-8b4a599a2e04 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] 10.222.0.11 "GET /compute/v2.1/servers/0698dc5b-5f47-46c4-ace8-f5e891a964a0" status: 200 len: 1565 microversion: 2.1 time: 0.167629 Nov 17 03:44:18.611713 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 1129/2085] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:44:18 2021] GET /compute/v2.1/servers/0698dc5b-5f47-46c4-ace8-f5e891a964a0 => generated 1565 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:44:18.618362 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-e8fa8a42-c851-4ad1-ab0a-98ba5f3ef72f tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:44:18.619141 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-e8fa8a42-c851-4ad1-ab0a-98ba5f3ef72f tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] [instance: 5ddbfaaa-fabf-4324-941c-8868625ffefc] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:44:18.626688 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-e8fa8a42-c851-4ad1-ab0a-98ba5f3ef72f tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:44:18.627150 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-e8fa8a42-c851-4ad1-ab0a-98ba5f3ef72f tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:44:18.627913 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-e8fa8a42-c851-4ad1-ab0a-98ba5f3ef72f tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:44:18.628420 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-e8fa8a42-c851-4ad1-ab0a-98ba5f3ef72f tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:44:18.641575 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.wsgi [None req-e8fa8a42-c851-4ad1-ab0a-98ba5f3ef72f tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] HTTP exception thrown: Instance 5ddbfaaa-fabf-4324-941c-8868625ffefc could not be found. Nov 17 03:44:18.642149 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-e8fa8a42-c851-4ad1-ab0a-98ba5f3ef72f tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Returning 404 to user: Instance 5ddbfaaa-fabf-4324-941c-8868625ffefc could not be found. {{(pid=115917) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 17 03:44:18.642983 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-e8fa8a42-c851-4ad1-ab0a-98ba5f3ef72f tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] 10.222.0.11 "GET /compute/v2.1/servers/5ddbfaaa-fabf-4324-941c-8868625ffefc" status: 404 len: 111 microversion: 2.1 time: 0.030261 Nov 17 03:44:18.643460 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 1130/2086] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:44:18 2021] GET /compute/v2.1/servers/5ddbfaaa-fabf-4324-941c-8868625ffefc => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 17 03:44:18.647499 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-3ccb60fc-d99b-4094-93b4-65a7de618ffc tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:44:18.647964 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-3ccb60fc-d99b-4094-93b4-65a7de618ffc tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] [instance: 61d387ba-e928-4e5f-a79c-4f757643903c] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:44:18.653654 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-3ccb60fc-d99b-4094-93b4-65a7de618ffc tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:44:18.654096 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-3ccb60fc-d99b-4094-93b4-65a7de618ffc tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:44:18.654976 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-3ccb60fc-d99b-4094-93b4-65a7de618ffc tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:44:18.655410 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-3ccb60fc-d99b-4094-93b4-65a7de618ffc tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:44:18.668034 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.wsgi [None req-3ccb60fc-d99b-4094-93b4-65a7de618ffc tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] HTTP exception thrown: Instance 61d387ba-e928-4e5f-a79c-4f757643903c could not be found. Nov 17 03:44:18.668598 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-3ccb60fc-d99b-4094-93b4-65a7de618ffc tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] Returning 404 to user: Instance 61d387ba-e928-4e5f-a79c-4f757643903c could not be found. {{(pid=115917) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 17 03:44:18.669437 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-3ccb60fc-d99b-4094-93b4-65a7de618ffc tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] 10.222.0.11 "DELETE /compute/v2.1/servers/61d387ba-e928-4e5f-a79c-4f757643903c" status: 404 len: 111 microversion: 2.1 time: 0.025070 Nov 17 03:44:18.669932 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 1131/2087] 10.222.0.11 () {58 vars in 1238 bytes} [Wed Nov 17 03:44:18 2021] DELETE /compute/v2.1/servers/61d387ba-e928-4e5f-a79c-4f757643903c => generated 111 bytes in 26 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 17 03:44:18.673883 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-40b023bc-4b30-4470-b18c-c3f7f3b15478 tempest-AttachVolumeTestJSON-1651611701 tempest-AttachVolumeTestJSON-1651611701-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:44:18.674357 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-40b023bc-4b30-4470-b18c-c3f7f3b15478 tempest-AttachVolumeTestJSON-1651611701 tempest-AttachVolumeTestJSON-1651611701-project] [instance: 9192e77c-eef4-40f6-85f6-afe009ad232f] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:44:18.680432 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-40b023bc-4b30-4470-b18c-c3f7f3b15478 tempest-AttachVolumeTestJSON-1651611701 tempest-AttachVolumeTestJSON-1651611701-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:44:18.680873 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-40b023bc-4b30-4470-b18c-c3f7f3b15478 tempest-AttachVolumeTestJSON-1651611701 tempest-AttachVolumeTestJSON-1651611701-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:44:18.681616 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-40b023bc-4b30-4470-b18c-c3f7f3b15478 tempest-AttachVolumeTestJSON-1651611701 tempest-AttachVolumeTestJSON-1651611701-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:44:18.682043 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-40b023bc-4b30-4470-b18c-c3f7f3b15478 tempest-AttachVolumeTestJSON-1651611701 tempest-AttachVolumeTestJSON-1651611701-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:44:18.694846 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.wsgi [None req-40b023bc-4b30-4470-b18c-c3f7f3b15478 tempest-AttachVolumeTestJSON-1651611701 tempest-AttachVolumeTestJSON-1651611701-project] HTTP exception thrown: Instance 9192e77c-eef4-40f6-85f6-afe009ad232f could not be found. Nov 17 03:44:18.695410 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-40b023bc-4b30-4470-b18c-c3f7f3b15478 tempest-AttachVolumeTestJSON-1651611701 tempest-AttachVolumeTestJSON-1651611701-project] Returning 404 to user: Instance 9192e77c-eef4-40f6-85f6-afe009ad232f could not be found. {{(pid=115917) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 17 03:44:18.696199 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-40b023bc-4b30-4470-b18c-c3f7f3b15478 tempest-AttachVolumeTestJSON-1651611701 tempest-AttachVolumeTestJSON-1651611701-project] 10.222.0.11 "DELETE /compute/v2.1/servers/9192e77c-eef4-40f6-85f6-afe009ad232f" status: 404 len: 111 microversion: 2.1 time: 0.025429 Nov 17 03:44:18.696703 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 1132/2088] 10.222.0.11 () {58 vars in 1238 bytes} [Wed Nov 17 03:44:18 2021] DELETE /compute/v2.1/servers/9192e77c-eef4-40f6-85f6-afe009ad232f => generated 111 bytes in 26 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 17 03:44:18.701102 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-0bbedf38-feec-47cc-912a-268223035618 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:44:18.701615 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-0bbedf38-feec-47cc-912a-268223035618 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] [instance: 15abb40f-daf9-4c4b-ac9c-55f57ee7b938] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:44:18.707449 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-0bbedf38-feec-47cc-912a-268223035618 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:44:18.707923 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-0bbedf38-feec-47cc-912a-268223035618 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:44:18.708661 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-0bbedf38-feec-47cc-912a-268223035618 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:44:18.709111 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-0bbedf38-feec-47cc-912a-268223035618 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:44:38.692406 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.objects.instance [None req-2c7b0df8-7ae2-41f0-a68e-f8702671c043 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Lazy-loading 'services' on Instance uuid 15abb40f-daf9-4c4b-ac9c-55f57ee7b938 {{(pid=115916) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Nov 17 03:44:38.733686 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.objects.instance [None req-0bbedf38-feec-47cc-912a-268223035618 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Lazy-loading 'services' on Instance uuid 15abb40f-daf9-4c4b-ac9c-55f57ee7b938 {{(pid=115917) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Nov 17 03:45:09.947494 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 17 03:45:09.948448 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: Wed Nov 17 03:45:09 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/15abb40f-daf9-4c4b-ac9c-55f57ee7b938/os-volume_attachments/a3573201-81ca-4c3f-ac74-4588ea819c9f (ip 10.222.0.11) !!! Nov 17 03:45:32.815946 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Too many heartbeats missed Nov 17 03:46:18.460698 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.wsgi [None req-2c7b0df8-7ae2-41f0-a68e-f8702671c043 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] HTTP exception thrown: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-1dc67314-470e-448b-b49d-b1345d7cebdb) Nov 17 03:46:18.461521 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-2c7b0df8-7ae2-41f0-a68e-f8702671c043 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Returning 400 to user: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-1dc67314-470e-448b-b49d-b1345d7cebdb) {{(pid=115916) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 17 03:46:18.462793 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-2c7b0df8-7ae2-41f0-a68e-f8702671c043 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] 10.222.0.11 "DELETE /compute/v2.1/servers/15abb40f-daf9-4c4b-ac9c-55f57ee7b938/os-volume_attachments/a3573201-81ca-4c3f-ac74-4588ea819c9f" status: 400 len: 269 microversion: 2.1 time: 120.107306 Nov 17 03:46:18.463416 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: Wed Nov 17 03:46:18 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/15abb40f-daf9-4c4b-ac9c-55f57ee7b938/os-volume_attachments/a3573201-81ca-4c3f-ac74-4588ea819c9f (ip 10.222.0.11) !!! Nov 17 03:46:18.463662 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: Wed Nov 17 03:46:18 2021 - uwsgi_response_writev_headers_and_body_do(): Broken pipe [core/writer.c line 306] during DELETE /compute/v2.1/servers/15abb40f-daf9-4c4b-ac9c-55f57ee7b938/os-volume_attachments/a3573201-81ca-4c3f-ac74-4588ea819c9f (10.222.0.11) Nov 17 03:46:18.465838 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: CRITICAL nova [None req-2c7b0df8-7ae2-41f0-a68e-f8702671c043 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Unhandled error: OSError: write error Nov 17 03:46:18.465838 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: ERROR nova OSError: write error Nov 17 03:46:18.465838 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: ERROR nova Nov 17 03:46:18.466153 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 957/2089] 10.222.0.11 () {58 vars in 1415 bytes} [Wed Nov 17 03:44:18 2021] DELETE /compute/v2.1/servers/15abb40f-daf9-4c4b-ac9c-55f57ee7b938/os-volume_attachments/a3573201-81ca-4c3f-ac74-4588ea819c9f => generated 0 bytes in 120111 msecs (HTTP/1.1 400) 9 headers in 0 bytes (0 switches on core 0) Nov 17 03:46:18.471062 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-e51fde50-2036-4c86-baab-86aad14f7f2b tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:46:18.471596 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-e51fde50-2036-4c86-baab-86aad14f7f2b tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] [instance: 0698dc5b-5f47-46c4-ace8-f5e891a964a0] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:46:18.478552 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-e51fde50-2036-4c86-baab-86aad14f7f2b tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:46:18.479031 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-e51fde50-2036-4c86-baab-86aad14f7f2b tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:46:18.479767 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-e51fde50-2036-4c86-baab-86aad14f7f2b tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:46:18.480218 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-e51fde50-2036-4c86-baab-86aad14f7f2b tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:46:18.541768 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.wsgi [None req-0bbedf38-feec-47cc-912a-268223035618 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] HTTP exception thrown: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-f3447514-9456-4270-bc7d-38277ee1dcc7) Nov 17 03:46:18.542381 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-0bbedf38-feec-47cc-912a-268223035618 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Returning 400 to user: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-f3447514-9456-4270-bc7d-38277ee1dcc7) {{(pid=115917) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 17 03:46:18.543250 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-0bbedf38-feec-47cc-912a-268223035618 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] 10.222.0.11 "DELETE /compute/v2.1/servers/15abb40f-daf9-4c4b-ac9c-55f57ee7b938/os-volume_attachments/a3573201-81ca-4c3f-ac74-4588ea819c9f" status: 400 len: 269 microversion: 2.1 time: 119.845634 Nov 17 03:46:18.543807 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 1133/2090] 10.222.0.11 () {58 vars in 1415 bytes} [Wed Nov 17 03:44:18 2021] DELETE /compute/v2.1/servers/15abb40f-daf9-4c4b-ac9c-55f57ee7b938/os-volume_attachments/a3573201-81ca-4c3f-ac74-4588ea819c9f => generated 269 bytes in 119847 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Nov 17 03:46:18.549407 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-eefebb1f-0aec-4b3b-9212-1fd8ef8c097a tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:46:18.550011 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-eefebb1f-0aec-4b3b-9212-1fd8ef8c097a tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] [instance: 5ddbfaaa-fabf-4324-941c-8868625ffefc] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:46:18.563783 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-eefebb1f-0aec-4b3b-9212-1fd8ef8c097a tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:46:18.563783 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-eefebb1f-0aec-4b3b-9212-1fd8ef8c097a tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:46:18.564449 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-eefebb1f-0aec-4b3b-9212-1fd8ef8c097a tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:46:18.565368 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-eefebb1f-0aec-4b3b-9212-1fd8ef8c097a tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:46:18.578917 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.wsgi [None req-eefebb1f-0aec-4b3b-9212-1fd8ef8c097a tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] HTTP exception thrown: Instance 5ddbfaaa-fabf-4324-941c-8868625ffefc could not be found. Nov 17 03:46:18.579822 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-eefebb1f-0aec-4b3b-9212-1fd8ef8c097a tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Returning 404 to user: Instance 5ddbfaaa-fabf-4324-941c-8868625ffefc could not be found. {{(pid=115917) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 17 03:46:18.580729 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-eefebb1f-0aec-4b3b-9212-1fd8ef8c097a tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] 10.222.0.11 "GET /compute/v2.1/servers/5ddbfaaa-fabf-4324-941c-8868625ffefc" status: 404 len: 111 microversion: 2.1 time: 0.036055 Nov 17 03:46:18.581368 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 1134/2091] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:46:18 2021] GET /compute/v2.1/servers/5ddbfaaa-fabf-4324-941c-8868625ffefc => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 17 03:46:18.585717 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-e214cf92-b76f-45cd-9346-2714b7a2f85b tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:46:18.586180 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-e214cf92-b76f-45cd-9346-2714b7a2f85b tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] [instance: 61d387ba-e928-4e5f-a79c-4f757643903c] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:46:18.592920 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-e214cf92-b76f-45cd-9346-2714b7a2f85b tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:46:18.593592 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-e214cf92-b76f-45cd-9346-2714b7a2f85b tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:46:18.594360 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-e214cf92-b76f-45cd-9346-2714b7a2f85b tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:46:18.594806 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-e214cf92-b76f-45cd-9346-2714b7a2f85b tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:46:18.608149 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.wsgi [None req-e214cf92-b76f-45cd-9346-2714b7a2f85b tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] HTTP exception thrown: Instance 61d387ba-e928-4e5f-a79c-4f757643903c could not be found. Nov 17 03:46:18.608750 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-e214cf92-b76f-45cd-9346-2714b7a2f85b tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] Returning 404 to user: Instance 61d387ba-e928-4e5f-a79c-4f757643903c could not be found. {{(pid=115917) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 17 03:46:18.609611 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-e214cf92-b76f-45cd-9346-2714b7a2f85b tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] 10.222.0.11 "DELETE /compute/v2.1/servers/61d387ba-e928-4e5f-a79c-4f757643903c" status: 404 len: 111 microversion: 2.1 time: 0.027190 Nov 17 03:46:18.610137 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 1135/2092] 10.222.0.11 () {58 vars in 1238 bytes} [Wed Nov 17 03:46:18 2021] DELETE /compute/v2.1/servers/61d387ba-e928-4e5f-a79c-4f757643903c => generated 111 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 17 03:46:18.614674 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-df5a30f7-1118-4ea8-9bf8-93d0ee2a1266 tempest-AttachVolumeTestJSON-1651611701 tempest-AttachVolumeTestJSON-1651611701-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:46:18.615166 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-df5a30f7-1118-4ea8-9bf8-93d0ee2a1266 tempest-AttachVolumeTestJSON-1651611701 tempest-AttachVolumeTestJSON-1651611701-project] [instance: 9192e77c-eef4-40f6-85f6-afe009ad232f] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:46:18.620985 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-df5a30f7-1118-4ea8-9bf8-93d0ee2a1266 tempest-AttachVolumeTestJSON-1651611701 tempest-AttachVolumeTestJSON-1651611701-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:46:18.621613 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-e51fde50-2036-4c86-baab-86aad14f7f2b tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '163b2f24a72649ac8084be1cac32fa09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e123e9b86124c93a7fc2db9984e7466', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:46:18.621758 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-df5a30f7-1118-4ea8-9bf8-93d0ee2a1266 tempest-AttachVolumeTestJSON-1651611701 tempest-AttachVolumeTestJSON-1651611701-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:46:18.622386 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-df5a30f7-1118-4ea8-9bf8-93d0ee2a1266 tempest-AttachVolumeTestJSON-1651611701 tempest-AttachVolumeTestJSON-1651611701-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:46:18.622807 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-df5a30f7-1118-4ea8-9bf8-93d0ee2a1266 tempest-AttachVolumeTestJSON-1651611701 tempest-AttachVolumeTestJSON-1651611701-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:46:18.630459 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-e51fde50-2036-4c86-baab-86aad14f7f2b tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] 10.222.0.11 "GET /compute/v2.1/servers/0698dc5b-5f47-46c4-ace8-f5e891a964a0" status: 200 len: 1565 microversion: 2.1 time: 0.163372 Nov 17 03:46:18.631349 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 958/2093] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:46:18 2021] GET /compute/v2.1/servers/0698dc5b-5f47-46c4-ace8-f5e891a964a0 => generated 1565 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:46:18.636615 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-824397c7-5250-4382-a34d-6fc52428c852 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:46:18.637143 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-824397c7-5250-4382-a34d-6fc52428c852 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] [instance: 15abb40f-daf9-4c4b-ac9c-55f57ee7b938] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:46:18.637718 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.wsgi [None req-df5a30f7-1118-4ea8-9bf8-93d0ee2a1266 tempest-AttachVolumeTestJSON-1651611701 tempest-AttachVolumeTestJSON-1651611701-project] HTTP exception thrown: Instance 9192e77c-eef4-40f6-85f6-afe009ad232f could not be found. Nov 17 03:46:18.638238 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-df5a30f7-1118-4ea8-9bf8-93d0ee2a1266 tempest-AttachVolumeTestJSON-1651611701 tempest-AttachVolumeTestJSON-1651611701-project] Returning 404 to user: Instance 9192e77c-eef4-40f6-85f6-afe009ad232f could not be found. {{(pid=115917) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 17 03:46:18.639054 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-df5a30f7-1118-4ea8-9bf8-93d0ee2a1266 tempest-AttachVolumeTestJSON-1651611701 tempest-AttachVolumeTestJSON-1651611701-project] 10.222.0.11 "DELETE /compute/v2.1/servers/9192e77c-eef4-40f6-85f6-afe009ad232f" status: 404 len: 111 microversion: 2.1 time: 0.027872 Nov 17 03:46:18.639909 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 1136/2094] 10.222.0.11 () {58 vars in 1238 bytes} [Wed Nov 17 03:46:18 2021] DELETE /compute/v2.1/servers/9192e77c-eef4-40f6-85f6-afe009ad232f => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 17 03:46:18.643992 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-824397c7-5250-4382-a34d-6fc52428c852 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:46:18.644265 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-1b729a75-26cf-4d0c-9cae-7ee9d8d4b032 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:46:18.644881 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-1b729a75-26cf-4d0c-9cae-7ee9d8d4b032 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] [instance: 0698dc5b-5f47-46c4-ace8-f5e891a964a0] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:46:18.645156 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-824397c7-5250-4382-a34d-6fc52428c852 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:46:18.646234 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-824397c7-5250-4382-a34d-6fc52428c852 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:46:18.646830 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-824397c7-5250-4382-a34d-6fc52428c852 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:46:18.650886 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-1b729a75-26cf-4d0c-9cae-7ee9d8d4b032 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:46:18.651436 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-1b729a75-26cf-4d0c-9cae-7ee9d8d4b032 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:46:18.652200 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-1b729a75-26cf-4d0c-9cae-7ee9d8d4b032 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:46:18.652628 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-1b729a75-26cf-4d0c-9cae-7ee9d8d4b032 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:46:18.790433 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-1b729a75-26cf-4d0c-9cae-7ee9d8d4b032 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '163b2f24a72649ac8084be1cac32fa09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e123e9b86124c93a7fc2db9984e7466', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:46:18.798247 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-1b729a75-26cf-4d0c-9cae-7ee9d8d4b032 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] 10.222.0.11 "GET /compute/v2.1/servers/0698dc5b-5f47-46c4-ace8-f5e891a964a0" status: 200 len: 1565 microversion: 2.1 time: 0.157198 Nov 17 03:46:18.798793 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 1137/2095] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:46:18 2021] GET /compute/v2.1/servers/0698dc5b-5f47-46c4-ace8-f5e891a964a0 => generated 1565 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:46:18.803260 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-b9252147-ff2d-4a08-8e5e-a9b29f8725f1 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:46:18.804215 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-b9252147-ff2d-4a08-8e5e-a9b29f8725f1 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] [instance: 5ddbfaaa-fabf-4324-941c-8868625ffefc] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:46:18.810020 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-b9252147-ff2d-4a08-8e5e-a9b29f8725f1 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:46:18.810468 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-b9252147-ff2d-4a08-8e5e-a9b29f8725f1 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:46:18.819790 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-b9252147-ff2d-4a08-8e5e-a9b29f8725f1 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:46:18.820279 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-b9252147-ff2d-4a08-8e5e-a9b29f8725f1 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:46:18.834308 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.wsgi [None req-b9252147-ff2d-4a08-8e5e-a9b29f8725f1 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] HTTP exception thrown: Instance 5ddbfaaa-fabf-4324-941c-8868625ffefc could not be found. Nov 17 03:46:18.834913 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-b9252147-ff2d-4a08-8e5e-a9b29f8725f1 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Returning 404 to user: Instance 5ddbfaaa-fabf-4324-941c-8868625ffefc could not be found. {{(pid=115917) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 17 03:46:18.835792 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-b9252147-ff2d-4a08-8e5e-a9b29f8725f1 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] 10.222.0.11 "GET /compute/v2.1/servers/5ddbfaaa-fabf-4324-941c-8868625ffefc" status: 404 len: 111 microversion: 2.1 time: 0.035898 Nov 17 03:46:18.836338 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 1138/2096] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:46:18 2021] GET /compute/v2.1/servers/5ddbfaaa-fabf-4324-941c-8868625ffefc => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 17 03:46:18.840922 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-e53e3a15-be6c-4125-9b2e-77eed746b383 tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:46:18.841457 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-e53e3a15-be6c-4125-9b2e-77eed746b383 tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] [instance: 61d387ba-e928-4e5f-a79c-4f757643903c] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:46:18.847172 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-e53e3a15-be6c-4125-9b2e-77eed746b383 tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:46:18.847615 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-e53e3a15-be6c-4125-9b2e-77eed746b383 tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:46:18.848450 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-e53e3a15-be6c-4125-9b2e-77eed746b383 tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:46:18.848854 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-e53e3a15-be6c-4125-9b2e-77eed746b383 tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:46:18.862237 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.wsgi [None req-e53e3a15-be6c-4125-9b2e-77eed746b383 tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] HTTP exception thrown: Instance 61d387ba-e928-4e5f-a79c-4f757643903c could not be found. Nov 17 03:46:18.862817 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-e53e3a15-be6c-4125-9b2e-77eed746b383 tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] Returning 404 to user: Instance 61d387ba-e928-4e5f-a79c-4f757643903c could not be found. {{(pid=115917) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 17 03:46:18.863616 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-e53e3a15-be6c-4125-9b2e-77eed746b383 tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] 10.222.0.11 "DELETE /compute/v2.1/servers/61d387ba-e928-4e5f-a79c-4f757643903c" status: 404 len: 111 microversion: 2.1 time: 0.026036 Nov 17 03:46:18.864127 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 1139/2097] 10.222.0.11 () {58 vars in 1238 bytes} [Wed Nov 17 03:46:18 2021] DELETE /compute/v2.1/servers/61d387ba-e928-4e5f-a79c-4f757643903c => generated 111 bytes in 27 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 17 03:46:18.868462 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [req-29eb05ac-d907-4947-9e0c-c7d1f2b0bb88 req-72d66c1f-3fed-4267-a537-0e01a6fc9aab service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9192e77c-eef4-40f6-85f6-afe009ad232f", "name": "network-vif-deleted", "tag": "a8f2f0a2-c75a-46ef-9d80-9edfed887be8"}]} {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 17 03:46:18.870049 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 17 03:46:18.870049 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: warnings.warn(msg) Nov 17 03:46:18.876414 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [req-29eb05ac-d907-4947-9e0c-c7d1f2b0bb88 req-72d66c1f-3fed-4267-a537-0e01a6fc9aab service nova] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:46:18.876872 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [req-29eb05ac-d907-4947-9e0c-c7d1f2b0bb88 req-72d66c1f-3fed-4267-a537-0e01a6fc9aab service nova] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:46:18.887338 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.compute.server_external_events [req-29eb05ac-d907-4947-9e0c-c7d1f2b0bb88 req-72d66c1f-3fed-4267-a537-0e01a6fc9aab service nova] Creating event network-vif-deleted:a8f2f0a2-c75a-46ef-9d80-9edfed887be8 for instance 9192e77c-eef4-40f6-85f6-afe009ad232f on hv-cinder-81803 Nov 17 03:46:18.893729 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [req-29eb05ac-d907-4947-9e0c-c7d1f2b0bb88 req-72d66c1f-3fed-4267-a537-0e01a6fc9aab service nova] 10.222.0.11 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028399 Nov 17 03:46:18.894256 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 1140/2098] 10.222.0.11 () {64 vars in 1317 bytes} [Wed Nov 17 03:46:18 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 17 03:46:18.898799 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-b170292b-db3b-4ea8-9fac-b9f4678315cd tempest-AttachVolumeTestJSON-1651611701 tempest-AttachVolumeTestJSON-1651611701-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:46:18.899523 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-b170292b-db3b-4ea8-9fac-b9f4678315cd tempest-AttachVolumeTestJSON-1651611701 tempest-AttachVolumeTestJSON-1651611701-project] [instance: 9192e77c-eef4-40f6-85f6-afe009ad232f] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:46:18.905662 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-b170292b-db3b-4ea8-9fac-b9f4678315cd tempest-AttachVolumeTestJSON-1651611701 tempest-AttachVolumeTestJSON-1651611701-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:46:18.906033 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-b170292b-db3b-4ea8-9fac-b9f4678315cd tempest-AttachVolumeTestJSON-1651611701 tempest-AttachVolumeTestJSON-1651611701-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:46:18.906814 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-b170292b-db3b-4ea8-9fac-b9f4678315cd tempest-AttachVolumeTestJSON-1651611701 tempest-AttachVolumeTestJSON-1651611701-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:46:18.907240 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-b170292b-db3b-4ea8-9fac-b9f4678315cd tempest-AttachVolumeTestJSON-1651611701 tempest-AttachVolumeTestJSON-1651611701-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:46:18.919918 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.wsgi [None req-b170292b-db3b-4ea8-9fac-b9f4678315cd tempest-AttachVolumeTestJSON-1651611701 tempest-AttachVolumeTestJSON-1651611701-project] HTTP exception thrown: Instance 9192e77c-eef4-40f6-85f6-afe009ad232f could not be found. Nov 17 03:46:18.920486 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-b170292b-db3b-4ea8-9fac-b9f4678315cd tempest-AttachVolumeTestJSON-1651611701 tempest-AttachVolumeTestJSON-1651611701-project] Returning 404 to user: Instance 9192e77c-eef4-40f6-85f6-afe009ad232f could not be found. {{(pid=115917) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 17 03:46:18.921325 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-b170292b-db3b-4ea8-9fac-b9f4678315cd tempest-AttachVolumeTestJSON-1651611701 tempest-AttachVolumeTestJSON-1651611701-project] 10.222.0.11 "DELETE /compute/v2.1/servers/9192e77c-eef4-40f6-85f6-afe009ad232f" status: 404 len: 111 microversion: 2.1 time: 0.025972 Nov 17 03:46:18.921828 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 1141/2099] 10.222.0.11 () {58 vars in 1238 bytes} [Wed Nov 17 03:46:18 2021] DELETE /compute/v2.1/servers/9192e77c-eef4-40f6-85f6-afe009ad232f => generated 111 bytes in 27 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 17 03:46:18.926132 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-6d1ac37d-eced-40db-bdca-77e331200172 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:46:18.926592 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-6d1ac37d-eced-40db-bdca-77e331200172 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] [instance: 15abb40f-daf9-4c4b-ac9c-55f57ee7b938] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:46:18.932417 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-6d1ac37d-eced-40db-bdca-77e331200172 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:46:18.932892 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-6d1ac37d-eced-40db-bdca-77e331200172 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:46:18.933642 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-6d1ac37d-eced-40db-bdca-77e331200172 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:46:18.934071 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-6d1ac37d-eced-40db-bdca-77e331200172 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:46:38.903078 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.objects.instance [None req-824397c7-5250-4382-a34d-6fc52428c852 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Lazy-loading 'services' on Instance uuid 15abb40f-daf9-4c4b-ac9c-55f57ee7b938 {{(pid=115916) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Nov 17 03:46:38.957582 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.objects.instance [None req-6d1ac37d-eced-40db-bdca-77e331200172 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Lazy-loading 'services' on Instance uuid 15abb40f-daf9-4c4b-ac9c-55f57ee7b938 {{(pid=115917) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Nov 17 03:46:39.118785 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.wsgi [None req-824397c7-5250-4382-a34d-6fc52428c852 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] HTTP exception thrown: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-e50fb82c-e84f-46d3-b8f3-a10d3b83aeea) Nov 17 03:46:39.120326 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-824397c7-5250-4382-a34d-6fc52428c852 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Returning 400 to user: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-e50fb82c-e84f-46d3-b8f3-a10d3b83aeea) {{(pid=115916) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 17 03:46:39.121894 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-824397c7-5250-4382-a34d-6fc52428c852 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] 10.222.0.11 "DELETE /compute/v2.1/servers/15abb40f-daf9-4c4b-ac9c-55f57ee7b938/os-volume_attachments/a3573201-81ca-4c3f-ac74-4588ea819c9f" status: 400 len: 269 microversion: 2.1 time: 20.489601 Nov 17 03:46:39.123088 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 959/2100] 10.222.0.11 () {58 vars in 1415 bytes} [Wed Nov 17 03:46:18 2021] DELETE /compute/v2.1/servers/15abb40f-daf9-4c4b-ac9c-55f57ee7b938/os-volume_attachments/a3573201-81ca-4c3f-ac74-4588ea819c9f => generated 269 bytes in 20491 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Nov 17 03:46:39.128648 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-24d174a0-6e9b-40cf-81b0-daa5674e2f5c tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:46:39.129290 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-24d174a0-6e9b-40cf-81b0-daa5674e2f5c tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] [instance: 0698dc5b-5f47-46c4-ace8-f5e891a964a0] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:46:39.135577 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-24d174a0-6e9b-40cf-81b0-daa5674e2f5c tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:46:39.136022 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-24d174a0-6e9b-40cf-81b0-daa5674e2f5c tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:46:39.136875 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-24d174a0-6e9b-40cf-81b0-daa5674e2f5c tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:46:39.137278 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-24d174a0-6e9b-40cf-81b0-daa5674e2f5c tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:46:39.150711 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.wsgi [None req-6d1ac37d-eced-40db-bdca-77e331200172 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] HTTP exception thrown: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-39e0a608-b1d7-4737-8a29-c2e1fcd1a09e) Nov 17 03:46:39.151321 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-6d1ac37d-eced-40db-bdca-77e331200172 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Returning 400 to user: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-39e0a608-b1d7-4737-8a29-c2e1fcd1a09e) {{(pid=115917) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 17 03:46:39.152162 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-6d1ac37d-eced-40db-bdca-77e331200172 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] 10.222.0.11 "DELETE /compute/v2.1/servers/15abb40f-daf9-4c4b-ac9c-55f57ee7b938/os-volume_attachments/a3573201-81ca-4c3f-ac74-4588ea819c9f" status: 400 len: 269 microversion: 2.1 time: 20.229381 Nov 17 03:46:39.152718 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 1142/2101] 10.222.0.11 () {58 vars in 1415 bytes} [Wed Nov 17 03:46:18 2021] DELETE /compute/v2.1/servers/15abb40f-daf9-4c4b-ac9c-55f57ee7b938/os-volume_attachments/a3573201-81ca-4c3f-ac74-4588ea819c9f => generated 269 bytes in 20230 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Nov 17 03:46:39.158479 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-1962d3ad-d128-40b8-ba9f-236a39d5dde7 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:46:39.159062 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-1962d3ad-d128-40b8-ba9f-236a39d5dde7 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] [instance: 5ddbfaaa-fabf-4324-941c-8868625ffefc] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:46:39.165786 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-1962d3ad-d128-40b8-ba9f-236a39d5dde7 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:46:39.166554 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-1962d3ad-d128-40b8-ba9f-236a39d5dde7 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:46:39.167656 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-1962d3ad-d128-40b8-ba9f-236a39d5dde7 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:46:39.168400 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-1962d3ad-d128-40b8-ba9f-236a39d5dde7 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:46:39.187634 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.wsgi [None req-1962d3ad-d128-40b8-ba9f-236a39d5dde7 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] HTTP exception thrown: Instance 5ddbfaaa-fabf-4324-941c-8868625ffefc could not be found. Nov 17 03:46:39.188388 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-1962d3ad-d128-40b8-ba9f-236a39d5dde7 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Returning 404 to user: Instance 5ddbfaaa-fabf-4324-941c-8868625ffefc could not be found. {{(pid=115917) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 17 03:46:39.189310 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-1962d3ad-d128-40b8-ba9f-236a39d5dde7 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] 10.222.0.11 "GET /compute/v2.1/servers/5ddbfaaa-fabf-4324-941c-8868625ffefc" status: 404 len: 111 microversion: 2.1 time: 0.035307 Nov 17 03:46:39.189893 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 1143/2102] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:46:39 2021] GET /compute/v2.1/servers/5ddbfaaa-fabf-4324-941c-8868625ffefc => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 17 03:46:39.194647 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-ea1a0a14-795e-4dab-aaa4-73b17683c725 tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:46:39.195145 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-ea1a0a14-795e-4dab-aaa4-73b17683c725 tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] [instance: 61d387ba-e928-4e5f-a79c-4f757643903c] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:46:39.202621 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-ea1a0a14-795e-4dab-aaa4-73b17683c725 tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:46:39.203178 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-ea1a0a14-795e-4dab-aaa4-73b17683c725 tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:46:39.204176 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-ea1a0a14-795e-4dab-aaa4-73b17683c725 tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:46:39.204612 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-ea1a0a14-795e-4dab-aaa4-73b17683c725 tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:46:39.219382 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.wsgi [None req-ea1a0a14-795e-4dab-aaa4-73b17683c725 tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] HTTP exception thrown: Instance 61d387ba-e928-4e5f-a79c-4f757643903c could not be found. Nov 17 03:46:39.220142 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-ea1a0a14-795e-4dab-aaa4-73b17683c725 tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] Returning 404 to user: Instance 61d387ba-e928-4e5f-a79c-4f757643903c could not be found. {{(pid=115917) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 17 03:46:39.221033 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-ea1a0a14-795e-4dab-aaa4-73b17683c725 tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] 10.222.0.11 "DELETE /compute/v2.1/servers/61d387ba-e928-4e5f-a79c-4f757643903c" status: 404 len: 111 microversion: 2.1 time: 0.029959 Nov 17 03:46:39.221581 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 1144/2103] 10.222.0.11 () {58 vars in 1238 bytes} [Wed Nov 17 03:46:39 2021] DELETE /compute/v2.1/servers/61d387ba-e928-4e5f-a79c-4f757643903c => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 17 03:46:39.226348 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-9c813492-a6e9-4413-a657-e77094b3c422 tempest-AttachVolumeTestJSON-1651611701 tempest-AttachVolumeTestJSON-1651611701-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:46:39.226835 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-9c813492-a6e9-4413-a657-e77094b3c422 tempest-AttachVolumeTestJSON-1651611701 tempest-AttachVolumeTestJSON-1651611701-project] [instance: 9192e77c-eef4-40f6-85f6-afe009ad232f] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:46:39.233159 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-9c813492-a6e9-4413-a657-e77094b3c422 tempest-AttachVolumeTestJSON-1651611701 tempest-AttachVolumeTestJSON-1651611701-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:46:39.234193 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-9c813492-a6e9-4413-a657-e77094b3c422 tempest-AttachVolumeTestJSON-1651611701 tempest-AttachVolumeTestJSON-1651611701-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:46:39.234361 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-9c813492-a6e9-4413-a657-e77094b3c422 tempest-AttachVolumeTestJSON-1651611701 tempest-AttachVolumeTestJSON-1651611701-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:46:39.234789 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-9c813492-a6e9-4413-a657-e77094b3c422 tempest-AttachVolumeTestJSON-1651611701 tempest-AttachVolumeTestJSON-1651611701-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:46:39.250728 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.wsgi [None req-9c813492-a6e9-4413-a657-e77094b3c422 tempest-AttachVolumeTestJSON-1651611701 tempest-AttachVolumeTestJSON-1651611701-project] HTTP exception thrown: Instance 9192e77c-eef4-40f6-85f6-afe009ad232f could not be found. Nov 17 03:46:39.251652 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-9c813492-a6e9-4413-a657-e77094b3c422 tempest-AttachVolumeTestJSON-1651611701 tempest-AttachVolumeTestJSON-1651611701-project] Returning 404 to user: Instance 9192e77c-eef4-40f6-85f6-afe009ad232f could not be found. {{(pid=115917) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 17 03:46:39.252990 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-9c813492-a6e9-4413-a657-e77094b3c422 tempest-AttachVolumeTestJSON-1651611701 tempest-AttachVolumeTestJSON-1651611701-project] 10.222.0.11 "DELETE /compute/v2.1/servers/9192e77c-eef4-40f6-85f6-afe009ad232f" status: 404 len: 111 microversion: 2.1 time: 0.030204 Nov 17 03:46:39.254061 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 1145/2104] 10.222.0.11 () {58 vars in 1238 bytes} [Wed Nov 17 03:46:39 2021] DELETE /compute/v2.1/servers/9192e77c-eef4-40f6-85f6-afe009ad232f => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 17 03:46:39.259661 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-9f2d3d63-c6ec-4a54-bab8-488e2142815f tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:46:39.260165 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-9f2d3d63-c6ec-4a54-bab8-488e2142815f tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] [instance: 15abb40f-daf9-4c4b-ac9c-55f57ee7b938] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:46:39.267836 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-9f2d3d63-c6ec-4a54-bab8-488e2142815f tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:46:39.268579 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-9f2d3d63-c6ec-4a54-bab8-488e2142815f tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:46:39.269627 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-9f2d3d63-c6ec-4a54-bab8-488e2142815f tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:46:39.270257 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-9f2d3d63-c6ec-4a54-bab8-488e2142815f tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:46:39.312211 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-24d174a0-6e9b-40cf-81b0-daa5674e2f5c tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '163b2f24a72649ac8084be1cac32fa09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e123e9b86124c93a7fc2db9984e7466', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:46:39.327544 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-24d174a0-6e9b-40cf-81b0-daa5674e2f5c tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] 10.222.0.11 "GET /compute/v2.1/servers/0698dc5b-5f47-46c4-ace8-f5e891a964a0" status: 200 len: 1559 microversion: 2.1 time: 0.202931 Nov 17 03:46:39.328401 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 960/2105] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:46:39 2021] GET /compute/v2.1/servers/0698dc5b-5f47-46c4-ace8-f5e891a964a0 => generated 1559 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:46:39.334100 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-c30d4bd2-4c33-408f-b6c7-cf5f55d95cfa tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:46:39.335219 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-c30d4bd2-4c33-408f-b6c7-cf5f55d95cfa tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] [instance: 0698dc5b-5f47-46c4-ace8-f5e891a964a0] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:46:39.341981 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-c30d4bd2-4c33-408f-b6c7-cf5f55d95cfa tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:46:39.342670 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-c30d4bd2-4c33-408f-b6c7-cf5f55d95cfa tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:46:39.343540 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-c30d4bd2-4c33-408f-b6c7-cf5f55d95cfa tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:46:39.343970 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-c30d4bd2-4c33-408f-b6c7-cf5f55d95cfa tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:46:39.363140 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.objects.instance [None req-9f2d3d63-c6ec-4a54-bab8-488e2142815f tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Lazy-loading 'services' on Instance uuid 15abb40f-daf9-4c4b-ac9c-55f57ee7b938 {{(pid=115917) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Nov 17 03:46:39.418769 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.wsgi [None req-9f2d3d63-c6ec-4a54-bab8-488e2142815f tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] HTTP exception thrown: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-11ebc455-c591-4342-b269-4c8722b9c449) Nov 17 03:46:39.419392 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-9f2d3d63-c6ec-4a54-bab8-488e2142815f tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Returning 400 to user: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-11ebc455-c591-4342-b269-4c8722b9c449) {{(pid=115917) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 17 03:46:39.420204 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-9f2d3d63-c6ec-4a54-bab8-488e2142815f tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] 10.222.0.11 "DELETE /compute/v2.1/servers/15abb40f-daf9-4c4b-ac9c-55f57ee7b938/os-volume_attachments/a3573201-81ca-4c3f-ac74-4588ea819c9f" status: 400 len: 269 microversion: 2.1 time: 0.165049 Nov 17 03:46:39.420999 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 1146/2106] 10.222.0.11 () {58 vars in 1415 bytes} [Wed Nov 17 03:46:39 2021] DELETE /compute/v2.1/servers/15abb40f-daf9-4c4b-ac9c-55f57ee7b938/os-volume_attachments/a3573201-81ca-4c3f-ac74-4588ea819c9f => generated 269 bytes in 166 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Nov 17 03:46:39.425396 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-2a04c9f2-5873-4cd2-82a8-10ac22570b01 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:46:39.425983 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-2a04c9f2-5873-4cd2-82a8-10ac22570b01 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] [instance: 5ddbfaaa-fabf-4324-941c-8868625ffefc] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:46:39.433432 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-2a04c9f2-5873-4cd2-82a8-10ac22570b01 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:46:39.433871 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-2a04c9f2-5873-4cd2-82a8-10ac22570b01 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:46:39.434647 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-2a04c9f2-5873-4cd2-82a8-10ac22570b01 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:46:39.435080 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-2a04c9f2-5873-4cd2-82a8-10ac22570b01 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:46:39.448607 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.wsgi [None req-2a04c9f2-5873-4cd2-82a8-10ac22570b01 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] HTTP exception thrown: Instance 5ddbfaaa-fabf-4324-941c-8868625ffefc could not be found. Nov 17 03:46:39.449112 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-2a04c9f2-5873-4cd2-82a8-10ac22570b01 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Returning 404 to user: Instance 5ddbfaaa-fabf-4324-941c-8868625ffefc could not be found. {{(pid=115917) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 17 03:46:39.449939 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-2a04c9f2-5873-4cd2-82a8-10ac22570b01 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] 10.222.0.11 "GET /compute/v2.1/servers/5ddbfaaa-fabf-4324-941c-8868625ffefc" status: 404 len: 111 microversion: 2.1 time: 0.028104 Nov 17 03:46:39.450492 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 1147/2107] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:46:39 2021] GET /compute/v2.1/servers/5ddbfaaa-fabf-4324-941c-8868625ffefc => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 17 03:46:39.455176 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-dc235ad8-cf70-4cd5-8b03-86be956dc78e tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:46:39.455661 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-dc235ad8-cf70-4cd5-8b03-86be956dc78e tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] [instance: 61d387ba-e928-4e5f-a79c-4f757643903c] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:46:39.462904 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-dc235ad8-cf70-4cd5-8b03-86be956dc78e tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:46:39.463339 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-dc235ad8-cf70-4cd5-8b03-86be956dc78e tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:46:39.464363 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-dc235ad8-cf70-4cd5-8b03-86be956dc78e tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:46:39.464799 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-dc235ad8-cf70-4cd5-8b03-86be956dc78e tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:46:39.478393 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.wsgi [None req-dc235ad8-cf70-4cd5-8b03-86be956dc78e tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] HTTP exception thrown: Instance 61d387ba-e928-4e5f-a79c-4f757643903c could not be found. Nov 17 03:46:39.478998 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-dc235ad8-cf70-4cd5-8b03-86be956dc78e tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] Returning 404 to user: Instance 61d387ba-e928-4e5f-a79c-4f757643903c could not be found. {{(pid=115917) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 17 03:46:39.479843 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-dc235ad8-cf70-4cd5-8b03-86be956dc78e tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] 10.222.0.11 "DELETE /compute/v2.1/servers/61d387ba-e928-4e5f-a79c-4f757643903c" status: 404 len: 111 microversion: 2.1 time: 0.028142 Nov 17 03:46:39.480395 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 1148/2108] 10.222.0.11 () {58 vars in 1238 bytes} [Wed Nov 17 03:46:39 2021] DELETE /compute/v2.1/servers/61d387ba-e928-4e5f-a79c-4f757643903c => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 17 03:46:39.492250 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-aa34a016-6785-45bb-ab07-ec75b9feb393 tempest-AttachVolumeTestJSON-1651611701 tempest-AttachVolumeTestJSON-1651611701-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:46:39.492762 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-aa34a016-6785-45bb-ab07-ec75b9feb393 tempest-AttachVolumeTestJSON-1651611701 tempest-AttachVolumeTestJSON-1651611701-project] [instance: 9192e77c-eef4-40f6-85f6-afe009ad232f] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:46:39.499579 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-aa34a016-6785-45bb-ab07-ec75b9feb393 tempest-AttachVolumeTestJSON-1651611701 tempest-AttachVolumeTestJSON-1651611701-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:46:39.500069 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-aa34a016-6785-45bb-ab07-ec75b9feb393 tempest-AttachVolumeTestJSON-1651611701 tempest-AttachVolumeTestJSON-1651611701-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:46:39.500858 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-aa34a016-6785-45bb-ab07-ec75b9feb393 tempest-AttachVolumeTestJSON-1651611701 tempest-AttachVolumeTestJSON-1651611701-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:46:39.501294 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-aa34a016-6785-45bb-ab07-ec75b9feb393 tempest-AttachVolumeTestJSON-1651611701 tempest-AttachVolumeTestJSON-1651611701-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:46:39.503898 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-c30d4bd2-4c33-408f-b6c7-cf5f55d95cfa tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '163b2f24a72649ac8084be1cac32fa09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e123e9b86124c93a7fc2db9984e7466', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:46:39.511268 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-c30d4bd2-4c33-408f-b6c7-cf5f55d95cfa tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] 10.222.0.11 "GET /compute/v2.1/servers/0698dc5b-5f47-46c4-ace8-f5e891a964a0" status: 200 len: 1559 microversion: 2.1 time: 0.181693 Nov 17 03:46:39.511827 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 961/2109] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:46:39 2021] GET /compute/v2.1/servers/0698dc5b-5f47-46c4-ace8-f5e891a964a0 => generated 1559 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:46:39.515401 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.wsgi [None req-aa34a016-6785-45bb-ab07-ec75b9feb393 tempest-AttachVolumeTestJSON-1651611701 tempest-AttachVolumeTestJSON-1651611701-project] HTTP exception thrown: Instance 9192e77c-eef4-40f6-85f6-afe009ad232f could not be found. Nov 17 03:46:39.516090 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-aa34a016-6785-45bb-ab07-ec75b9feb393 tempest-AttachVolumeTestJSON-1651611701 tempest-AttachVolumeTestJSON-1651611701-project] Returning 404 to user: Instance 9192e77c-eef4-40f6-85f6-afe009ad232f could not be found. {{(pid=115917) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 17 03:46:39.516958 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-aa34a016-6785-45bb-ab07-ec75b9feb393 tempest-AttachVolumeTestJSON-1651611701 tempest-AttachVolumeTestJSON-1651611701-project] 10.222.0.11 "DELETE /compute/v2.1/servers/9192e77c-eef4-40f6-85f6-afe009ad232f" status: 404 len: 111 microversion: 2.1 time: 0.035251 Nov 17 03:46:39.517179 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-5196d474-53f9-4876-bd92-24047c1b5925 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:46:39.517552 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 1149/2110] 10.222.0.11 () {58 vars in 1238 bytes} [Wed Nov 17 03:46:39 2021] DELETE /compute/v2.1/servers/9192e77c-eef4-40f6-85f6-afe009ad232f => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 17 03:46:39.517770 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-5196d474-53f9-4876-bd92-24047c1b5925 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] [instance: 0698dc5b-5f47-46c4-ace8-f5e891a964a0] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:46:39.524221 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-5196d474-53f9-4876-bd92-24047c1b5925 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:46:39.524652 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-5196d474-53f9-4876-bd92-24047c1b5925 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:46:39.525685 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-5196d474-53f9-4876-bd92-24047c1b5925 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:46:39.526115 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-5196d474-53f9-4876-bd92-24047c1b5925 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:46:39.526543 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-3a09804a-8cca-442d-be0e-b18eb71db313 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:46:39.527150 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-3a09804a-8cca-442d-be0e-b18eb71db313 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] [instance: 5ddbfaaa-fabf-4324-941c-8868625ffefc] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:46:39.533264 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-3a09804a-8cca-442d-be0e-b18eb71db313 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:46:39.533711 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-3a09804a-8cca-442d-be0e-b18eb71db313 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:46:39.534486 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-3a09804a-8cca-442d-be0e-b18eb71db313 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:46:39.534921 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-3a09804a-8cca-442d-be0e-b18eb71db313 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:46:39.548647 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.wsgi [None req-3a09804a-8cca-442d-be0e-b18eb71db313 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] HTTP exception thrown: Instance 5ddbfaaa-fabf-4324-941c-8868625ffefc could not be found. Nov 17 03:46:39.549289 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-3a09804a-8cca-442d-be0e-b18eb71db313 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Returning 404 to user: Instance 5ddbfaaa-fabf-4324-941c-8868625ffefc could not be found. {{(pid=115917) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 17 03:46:39.550127 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-3a09804a-8cca-442d-be0e-b18eb71db313 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] 10.222.0.11 "GET /compute/v2.1/servers/5ddbfaaa-fabf-4324-941c-8868625ffefc" status: 404 len: 111 microversion: 2.1 time: 0.027712 Nov 17 03:46:39.550932 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 1150/2111] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:46:39 2021] GET /compute/v2.1/servers/5ddbfaaa-fabf-4324-941c-8868625ffefc => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 17 03:46:39.555397 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-65764c69-82a1-4f87-bb3f-0ad222772991 tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:46:39.555894 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-65764c69-82a1-4f87-bb3f-0ad222772991 tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] [instance: 61d387ba-e928-4e5f-a79c-4f757643903c] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:46:39.562216 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-65764c69-82a1-4f87-bb3f-0ad222772991 tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:46:39.562661 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-65764c69-82a1-4f87-bb3f-0ad222772991 tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:46:39.563607 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-65764c69-82a1-4f87-bb3f-0ad222772991 tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:46:39.564030 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-65764c69-82a1-4f87-bb3f-0ad222772991 tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:46:39.578164 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.wsgi [None req-65764c69-82a1-4f87-bb3f-0ad222772991 tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] HTTP exception thrown: Instance 61d387ba-e928-4e5f-a79c-4f757643903c could not be found. Nov 17 03:46:39.578755 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-65764c69-82a1-4f87-bb3f-0ad222772991 tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] Returning 404 to user: Instance 61d387ba-e928-4e5f-a79c-4f757643903c could not be found. {{(pid=115917) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 17 03:46:39.579583 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-65764c69-82a1-4f87-bb3f-0ad222772991 tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] 10.222.0.11 "DELETE /compute/v2.1/servers/61d387ba-e928-4e5f-a79c-4f757643903c" status: 404 len: 111 microversion: 2.1 time: 0.028008 Nov 17 03:46:39.580138 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 1151/2112] 10.222.0.11 () {58 vars in 1238 bytes} [Wed Nov 17 03:46:39 2021] DELETE /compute/v2.1/servers/61d387ba-e928-4e5f-a79c-4f757643903c => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 17 03:46:39.584800 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-c1ad7528-a763-43b5-be61-8a4e7a7334be tempest-AttachVolumeTestJSON-1651611701 tempest-AttachVolumeTestJSON-1651611701-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:46:39.585284 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-c1ad7528-a763-43b5-be61-8a4e7a7334be tempest-AttachVolumeTestJSON-1651611701 tempest-AttachVolumeTestJSON-1651611701-project] [instance: 9192e77c-eef4-40f6-85f6-afe009ad232f] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:46:39.591389 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-c1ad7528-a763-43b5-be61-8a4e7a7334be tempest-AttachVolumeTestJSON-1651611701 tempest-AttachVolumeTestJSON-1651611701-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:46:39.591881 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-c1ad7528-a763-43b5-be61-8a4e7a7334be tempest-AttachVolumeTestJSON-1651611701 tempest-AttachVolumeTestJSON-1651611701-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:46:39.593040 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-c1ad7528-a763-43b5-be61-8a4e7a7334be tempest-AttachVolumeTestJSON-1651611701 tempest-AttachVolumeTestJSON-1651611701-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:46:39.593403 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-c1ad7528-a763-43b5-be61-8a4e7a7334be tempest-AttachVolumeTestJSON-1651611701 tempest-AttachVolumeTestJSON-1651611701-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:46:39.608339 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.wsgi [None req-c1ad7528-a763-43b5-be61-8a4e7a7334be tempest-AttachVolumeTestJSON-1651611701 tempest-AttachVolumeTestJSON-1651611701-project] HTTP exception thrown: Instance 9192e77c-eef4-40f6-85f6-afe009ad232f could not be found. Nov 17 03:46:39.608975 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-c1ad7528-a763-43b5-be61-8a4e7a7334be tempest-AttachVolumeTestJSON-1651611701 tempest-AttachVolumeTestJSON-1651611701-project] Returning 404 to user: Instance 9192e77c-eef4-40f6-85f6-afe009ad232f could not be found. {{(pid=115917) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 17 03:46:39.609806 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-c1ad7528-a763-43b5-be61-8a4e7a7334be tempest-AttachVolumeTestJSON-1651611701 tempest-AttachVolumeTestJSON-1651611701-project] 10.222.0.11 "DELETE /compute/v2.1/servers/9192e77c-eef4-40f6-85f6-afe009ad232f" status: 404 len: 111 microversion: 2.1 time: 0.028516 Nov 17 03:46:39.610366 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 1152/2113] 10.222.0.11 () {58 vars in 1238 bytes} [Wed Nov 17 03:46:39 2021] DELETE /compute/v2.1/servers/9192e77c-eef4-40f6-85f6-afe009ad232f => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 17 03:46:39.615528 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-2265b771-b0be-4338-a413-ca46622d14ac tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:46:39.616216 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-2265b771-b0be-4338-a413-ca46622d14ac tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] [instance: 61d387ba-e928-4e5f-a79c-4f757643903c] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:46:39.623637 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-2265b771-b0be-4338-a413-ca46622d14ac tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:46:39.623637 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-2265b771-b0be-4338-a413-ca46622d14ac tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:46:39.623959 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-2265b771-b0be-4338-a413-ca46622d14ac tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:46:39.624316 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-2265b771-b0be-4338-a413-ca46622d14ac tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:46:39.638968 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.wsgi [None req-2265b771-b0be-4338-a413-ca46622d14ac tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] HTTP exception thrown: Instance 61d387ba-e928-4e5f-a79c-4f757643903c could not be found. Nov 17 03:46:39.639745 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-2265b771-b0be-4338-a413-ca46622d14ac tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] Returning 404 to user: Instance 61d387ba-e928-4e5f-a79c-4f757643903c could not be found. {{(pid=115917) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 17 03:46:39.640968 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-2265b771-b0be-4338-a413-ca46622d14ac tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] 10.222.0.11 "DELETE /compute/v2.1/servers/61d387ba-e928-4e5f-a79c-4f757643903c" status: 404 len: 111 microversion: 2.1 time: 0.029331 Nov 17 03:46:39.641541 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 1153/2114] 10.222.0.11 () {58 vars in 1238 bytes} [Wed Nov 17 03:46:39 2021] DELETE /compute/v2.1/servers/61d387ba-e928-4e5f-a79c-4f757643903c => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 17 03:46:39.646332 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-b81cf8e8-4a44-4bcf-bc5f-8e43faae6cef tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:46:39.646822 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-b81cf8e8-4a44-4bcf-bc5f-8e43faae6cef tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] [instance: 5ddbfaaa-fabf-4324-941c-8868625ffefc] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:46:39.653027 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-b81cf8e8-4a44-4bcf-bc5f-8e43faae6cef tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:46:39.653474 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-b81cf8e8-4a44-4bcf-bc5f-8e43faae6cef tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:46:39.654268 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-b81cf8e8-4a44-4bcf-bc5f-8e43faae6cef tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:46:39.654726 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-b81cf8e8-4a44-4bcf-bc5f-8e43faae6cef tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:46:39.668104 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.wsgi [None req-b81cf8e8-4a44-4bcf-bc5f-8e43faae6cef tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] HTTP exception thrown: Instance 5ddbfaaa-fabf-4324-941c-8868625ffefc could not be found. Nov 17 03:46:39.668724 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-b81cf8e8-4a44-4bcf-bc5f-8e43faae6cef tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Returning 404 to user: Instance 5ddbfaaa-fabf-4324-941c-8868625ffefc could not be found. {{(pid=115917) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 17 03:46:39.669579 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-b81cf8e8-4a44-4bcf-bc5f-8e43faae6cef tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] 10.222.0.11 "DELETE /compute/v2.1/servers/5ddbfaaa-fabf-4324-941c-8868625ffefc" status: 404 len: 111 microversion: 2.1 time: 0.026886 Nov 17 03:46:39.670129 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 1154/2115] 10.222.0.11 () {58 vars in 1238 bytes} [Wed Nov 17 03:46:39 2021] DELETE /compute/v2.1/servers/5ddbfaaa-fabf-4324-941c-8868625ffefc => generated 111 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 17 03:46:39.674894 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-8fef7623-f8fd-4afb-b309-19531fbde811 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:46:39.675385 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-8fef7623-f8fd-4afb-b309-19531fbde811 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] [instance: 0698dc5b-5f47-46c4-ace8-f5e891a964a0] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:46:39.679285 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-5196d474-53f9-4876-bd92-24047c1b5925 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '163b2f24a72649ac8084be1cac32fa09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e123e9b86124c93a7fc2db9984e7466', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:46:39.681584 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-8fef7623-f8fd-4afb-b309-19531fbde811 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:46:39.682115 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-8fef7623-f8fd-4afb-b309-19531fbde811 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:46:39.682889 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-8fef7623-f8fd-4afb-b309-19531fbde811 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:46:39.683542 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-8fef7623-f8fd-4afb-b309-19531fbde811 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:46:39.687805 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-5196d474-53f9-4876-bd92-24047c1b5925 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] 10.222.0.11 "GET /compute/v2.1/servers/0698dc5b-5f47-46c4-ace8-f5e891a964a0" status: 200 len: 1559 microversion: 2.1 time: 0.174789 Nov 17 03:46:39.688841 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 962/2116] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:46:39 2021] GET /compute/v2.1/servers/0698dc5b-5f47-46c4-ace8-f5e891a964a0 => generated 1559 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:46:39.694063 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [req-bd0cf664-2f1d-4ddb-beac-8edab9c9668b req-9fa6020f-45f3-4e43-a401-e99cc2734543 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0698dc5b-5f47-46c4-ace8-f5e891a964a0", "tag": "ade336c1-073e-4cb9-90d9-0e1652a810a1"}]} {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 17 03:46:39.696030 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 17 03:46:39.696030 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: warnings.warn(msg) Nov 17 03:46:39.704602 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [req-bd0cf664-2f1d-4ddb-beac-8edab9c9668b req-9fa6020f-45f3-4e43-a401-e99cc2734543 service nova] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:46:39.705239 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [req-bd0cf664-2f1d-4ddb-beac-8edab9c9668b req-9fa6020f-45f3-4e43-a401-e99cc2734543 service nova] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:46:39.710359 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-8fef7623-f8fd-4afb-b309-19531fbde811 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] [instance: 0698dc5b-5f47-46c4-ace8-f5e891a964a0] Going to try to terminate instance {{(pid=115917) delete /opt/stack/nova/nova/compute/api.py:2614}} Nov 17 03:46:39.719473 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.compute.server_external_events [req-bd0cf664-2f1d-4ddb-beac-8edab9c9668b req-9fa6020f-45f3-4e43-a401-e99cc2734543 service nova] Creating event network-changed:ade336c1-073e-4cb9-90d9-0e1652a810a1 for instance 0698dc5b-5f47-46c4-ace8-f5e891a964a0 on hv-cinder-81803 Nov 17 03:46:39.723156 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: ERROR oslo.messaging._drivers.impl_rabbit [req-bd0cf664-2f1d-4ddb-beac-8edab9c9668b req-9fa6020f-45f3-4e43-a401-e99cc2734543 service nova] [201d3e2d-67a7-4ecf-8825-2618ae09d16b] AMQP server on 10.222.0.11:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Nov 17 03:46:39.793330 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-8fef7623-f8fd-4afb-b309-19531fbde811 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] 10.222.0.11 "DELETE /compute/v2.1/servers/0698dc5b-5f47-46c4-ace8-f5e891a964a0" status: 204 len: 0 microversion: 2.1 time: 0.121494 Nov 17 03:46:39.794242 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 1155/2117] 10.222.0.11 () {58 vars in 1238 bytes} [Wed Nov 17 03:46:39 2021] DELETE /compute/v2.1/servers/0698dc5b-5f47-46c4-ace8-f5e891a964a0 => generated 0 bytes in 123 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 17 03:46:39.800012 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-405e8815-0d06-4ac8-9348-edcdc5daa907 tempest-AttachVolumeTestJSON-1651611701 tempest-AttachVolumeTestJSON-1651611701-project] Calling method '.version_select at 0x7f9e1d9e9b80>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:46:39.804413 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: ERROR oslo.messaging._drivers.impl_rabbit [None req-405e8815-0d06-4ac8-9348-edcdc5daa907 tempest-AttachVolumeTestJSON-1651611701 tempest-AttachVolumeTestJSON-1651611701-project] [20b4dd9d-de6d-4c7f-bcd6-2a862e657b39] AMQP server on 10.222.0.11:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Nov 17 03:46:40.742224 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO oslo.messaging._drivers.impl_rabbit [req-bd0cf664-2f1d-4ddb-beac-8edab9c9668b req-9fa6020f-45f3-4e43-a401-e99cc2734543 service nova] [201d3e2d-67a7-4ecf-8825-2618ae09d16b] Reconnected to AMQP server on 10.222.0.11:5672 via [amqp] client with port 44178. Nov 17 03:46:40.745731 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [req-bd0cf664-2f1d-4ddb-beac-8edab9c9668b req-9fa6020f-45f3-4e43-a401-e99cc2734543 service nova] 10.222.0.11 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 1.055590 Nov 17 03:46:40.746358 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 963/2118] 10.222.0.11 () {64 vars in 1317 bytes} [Wed Nov 17 03:46:39 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 1057 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 17 03:46:40.751349 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-552c927b-7dc0-4e84-b347-e94a93884d66 tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:46:40.752128 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-552c927b-7dc0-4e84-b347-e94a93884d66 tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] [instance: 61d387ba-e928-4e5f-a79c-4f757643903c] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:46:40.758575 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-552c927b-7dc0-4e84-b347-e94a93884d66 tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:46:40.759011 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-552c927b-7dc0-4e84-b347-e94a93884d66 tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:46:40.759768 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-552c927b-7dc0-4e84-b347-e94a93884d66 tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:46:40.760192 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-552c927b-7dc0-4e84-b347-e94a93884d66 tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:46:40.773210 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.wsgi [None req-552c927b-7dc0-4e84-b347-e94a93884d66 tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] HTTP exception thrown: Instance 61d387ba-e928-4e5f-a79c-4f757643903c could not be found. Nov 17 03:46:40.773791 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-552c927b-7dc0-4e84-b347-e94a93884d66 tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] Returning 404 to user: Instance 61d387ba-e928-4e5f-a79c-4f757643903c could not be found. {{(pid=115916) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 17 03:46:40.774594 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-552c927b-7dc0-4e84-b347-e94a93884d66 tempest-AttachVolumeNegativeTest-359981978 tempest-AttachVolumeNegativeTest-359981978-project] 10.222.0.11 "GET /compute/v2.1/servers/61d387ba-e928-4e5f-a79c-4f757643903c" status: 404 len: 111 microversion: 2.1 time: 0.027121 Nov 17 03:46:40.775182 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 964/2119] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:46:40 2021] GET /compute/v2.1/servers/61d387ba-e928-4e5f-a79c-4f757643903c => generated 111 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 17 03:46:40.779968 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-d5dfeb1a-afaa-47ef-880b-8cae63442449 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:46:40.780616 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-d5dfeb1a-afaa-47ef-880b-8cae63442449 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] [instance: 5ddbfaaa-fabf-4324-941c-8868625ffefc] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:46:40.787671 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-d5dfeb1a-afaa-47ef-880b-8cae63442449 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:46:40.788362 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-d5dfeb1a-afaa-47ef-880b-8cae63442449 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:46:40.788911 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-d5dfeb1a-afaa-47ef-880b-8cae63442449 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:46:40.789335 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-d5dfeb1a-afaa-47ef-880b-8cae63442449 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:46:40.802899 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.wsgi [None req-d5dfeb1a-afaa-47ef-880b-8cae63442449 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] HTTP exception thrown: Instance 5ddbfaaa-fabf-4324-941c-8868625ffefc could not be found. Nov 17 03:46:40.804012 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-d5dfeb1a-afaa-47ef-880b-8cae63442449 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Returning 404 to user: Instance 5ddbfaaa-fabf-4324-941c-8868625ffefc could not be found. {{(pid=115916) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 17 03:46:40.806815 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-d5dfeb1a-afaa-47ef-880b-8cae63442449 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] 10.222.0.11 "GET /compute/v2.1/servers/5ddbfaaa-fabf-4324-941c-8868625ffefc" status: 404 len: 111 microversion: 2.1 time: 0.028485 Nov 17 03:46:40.806815 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 965/2120] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:46:40 2021] GET /compute/v2.1/servers/5ddbfaaa-fabf-4324-941c-8868625ffefc => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 17 03:46:40.811686 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-8bb6acaf-24c3-4eea-858e-a98f19700368 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:46:40.812291 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-8bb6acaf-24c3-4eea-858e-a98f19700368 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] [instance: 0698dc5b-5f47-46c4-ace8-f5e891a964a0] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:46:40.820320 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-8bb6acaf-24c3-4eea-858e-a98f19700368 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:46:40.820867 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-8bb6acaf-24c3-4eea-858e-a98f19700368 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:46:40.821715 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-8bb6acaf-24c3-4eea-858e-a98f19700368 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:46:40.822331 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-8bb6acaf-24c3-4eea-858e-a98f19700368 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:46:40.829390 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO oslo.messaging._drivers.impl_rabbit [None req-405e8815-0d06-4ac8-9348-edcdc5daa907 tempest-AttachVolumeTestJSON-1651611701 tempest-AttachVolumeTestJSON-1651611701-project] [20b4dd9d-de6d-4c7f-bcd6-2a862e657b39] Reconnected to AMQP server on 10.222.0.11:5672 via [amqp] client with port 44186. Nov 17 03:46:40.850757 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-405e8815-0d06-4ac8-9348-edcdc5daa907 tempest-AttachVolumeTestJSON-1651611701 tempest-AttachVolumeTestJSON-1651611701-project] 10.222.0.11 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-725423103" status: 202 len: 0 microversion: 2.1 time: 1.055174 Nov 17 03:46:40.854735 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 1156/2121] 10.222.0.11 () {58 vars in 1217 bytes} [Wed Nov 17 03:46:39 2021] DELETE /compute/v2.1/os-keypairs/tempest-keypair-725423103 => generated 0 bytes in 1057 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 17 03:46:40.907658 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-8bb6acaf-24c3-4eea-858e-a98f19700368 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '163b2f24a72649ac8084be1cac32fa09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e123e9b86124c93a7fc2db9984e7466', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:46:40.919854 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-8bb6acaf-24c3-4eea-858e-a98f19700368 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] 10.222.0.11 "GET /compute/v2.1/servers/0698dc5b-5f47-46c4-ace8-f5e891a964a0" status: 200 len: 1218 microversion: 2.1 time: 0.113366 Nov 17 03:46:40.922347 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 966/2122] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:46:40 2021] GET /compute/v2.1/servers/0698dc5b-5f47-46c4-ace8-f5e891a964a0 => generated 1218 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:46:41.569160 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-c883139a-cab0-487d-b2aa-37553deb9162 tempest-AttachVolumeTestJSON-1651611701 tempest-AttachVolumeTestJSON-1651611701-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:46:41.569858 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-c883139a-cab0-487d-b2aa-37553deb9162 tempest-AttachVolumeTestJSON-1651611701 tempest-AttachVolumeTestJSON-1651611701-project] [instance: 9192e77c-eef4-40f6-85f6-afe009ad232f] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:46:41.579678 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-c883139a-cab0-487d-b2aa-37553deb9162 tempest-AttachVolumeTestJSON-1651611701 tempest-AttachVolumeTestJSON-1651611701-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:46:41.580422 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-c883139a-cab0-487d-b2aa-37553deb9162 tempest-AttachVolumeTestJSON-1651611701 tempest-AttachVolumeTestJSON-1651611701-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:46:41.581435 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-c883139a-cab0-487d-b2aa-37553deb9162 tempest-AttachVolumeTestJSON-1651611701 tempest-AttachVolumeTestJSON-1651611701-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:46:41.581859 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-c883139a-cab0-487d-b2aa-37553deb9162 tempest-AttachVolumeTestJSON-1651611701 tempest-AttachVolumeTestJSON-1651611701-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:46:41.598032 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.wsgi [None req-c883139a-cab0-487d-b2aa-37553deb9162 tempest-AttachVolumeTestJSON-1651611701 tempest-AttachVolumeTestJSON-1651611701-project] HTTP exception thrown: Instance 9192e77c-eef4-40f6-85f6-afe009ad232f could not be found. Nov 17 03:46:41.598651 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-c883139a-cab0-487d-b2aa-37553deb9162 tempest-AttachVolumeTestJSON-1651611701 tempest-AttachVolumeTestJSON-1651611701-project] Returning 404 to user: Instance 9192e77c-eef4-40f6-85f6-afe009ad232f could not be found. {{(pid=115917) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 17 03:46:41.599744 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-c883139a-cab0-487d-b2aa-37553deb9162 tempest-AttachVolumeTestJSON-1651611701 tempest-AttachVolumeTestJSON-1651611701-project] 10.222.0.11 "DELETE /compute/v2.1/servers/9192e77c-eef4-40f6-85f6-afe009ad232f" status: 404 len: 111 microversion: 2.1 time: 0.037272 Nov 17 03:46:41.600320 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 1157/2123] 10.222.0.11 () {58 vars in 1238 bytes} [Wed Nov 17 03:46:41 2021] DELETE /compute/v2.1/servers/9192e77c-eef4-40f6-85f6-afe009ad232f => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 17 03:46:41.608359 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-0e457f00-65d8-452b-99bb-2a808a55bab9 tempest-AttachVolumeTestJSON-1651611701 tempest-AttachVolumeTestJSON-1651611701-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:46:41.609353 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-0e457f00-65d8-452b-99bb-2a808a55bab9 tempest-AttachVolumeTestJSON-1651611701 tempest-AttachVolumeTestJSON-1651611701-project] [instance: 9192e77c-eef4-40f6-85f6-afe009ad232f] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:46:41.616166 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-0e457f00-65d8-452b-99bb-2a808a55bab9 tempest-AttachVolumeTestJSON-1651611701 tempest-AttachVolumeTestJSON-1651611701-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:46:41.616607 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-0e457f00-65d8-452b-99bb-2a808a55bab9 tempest-AttachVolumeTestJSON-1651611701 tempest-AttachVolumeTestJSON-1651611701-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:46:41.617594 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-0e457f00-65d8-452b-99bb-2a808a55bab9 tempest-AttachVolumeTestJSON-1651611701 tempest-AttachVolumeTestJSON-1651611701-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:46:41.618022 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-0e457f00-65d8-452b-99bb-2a808a55bab9 tempest-AttachVolumeTestJSON-1651611701 tempest-AttachVolumeTestJSON-1651611701-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:46:41.633027 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.wsgi [None req-0e457f00-65d8-452b-99bb-2a808a55bab9 tempest-AttachVolumeTestJSON-1651611701 tempest-AttachVolumeTestJSON-1651611701-project] HTTP exception thrown: Instance 9192e77c-eef4-40f6-85f6-afe009ad232f could not be found. Nov 17 03:46:41.633755 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-0e457f00-65d8-452b-99bb-2a808a55bab9 tempest-AttachVolumeTestJSON-1651611701 tempest-AttachVolumeTestJSON-1651611701-project] Returning 404 to user: Instance 9192e77c-eef4-40f6-85f6-afe009ad232f could not be found. {{(pid=115916) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 17 03:46:41.634608 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-0e457f00-65d8-452b-99bb-2a808a55bab9 tempest-AttachVolumeTestJSON-1651611701 tempest-AttachVolumeTestJSON-1651611701-project] 10.222.0.11 "GET /compute/v2.1/servers/9192e77c-eef4-40f6-85f6-afe009ad232f" status: 404 len: 111 microversion: 2.1 time: 0.029937 Nov 17 03:46:41.635219 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 967/2124] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:46:41 2021] GET /compute/v2.1/servers/9192e77c-eef4-40f6-85f6-afe009ad232f => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 17 03:46:41.938621 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-0ab3e14c-8fc3-433a-8fe5-add5fa93af1f tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:46:41.939599 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-0ab3e14c-8fc3-433a-8fe5-add5fa93af1f tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] [instance: 0698dc5b-5f47-46c4-ace8-f5e891a964a0] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:46:41.946794 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-0ab3e14c-8fc3-433a-8fe5-add5fa93af1f tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:46:41.947250 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-0ab3e14c-8fc3-433a-8fe5-add5fa93af1f tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:46:41.948032 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-0ab3e14c-8fc3-433a-8fe5-add5fa93af1f tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:46:41.948470 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-0ab3e14c-8fc3-433a-8fe5-add5fa93af1f tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:46:42.013205 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-0ab3e14c-8fc3-433a-8fe5-add5fa93af1f tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '163b2f24a72649ac8084be1cac32fa09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e123e9b86124c93a7fc2db9984e7466', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:46:42.021217 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-0ab3e14c-8fc3-433a-8fe5-add5fa93af1f tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] 10.222.0.11 "GET /compute/v2.1/servers/0698dc5b-5f47-46c4-ace8-f5e891a964a0" status: 200 len: 1218 microversion: 2.1 time: 0.086253 Nov 17 03:46:42.022174 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 1158/2125] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:46:41 2021] GET /compute/v2.1/servers/0698dc5b-5f47-46c4-ace8-f5e891a964a0 => generated 1218 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:46:42.760895 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [req-64029681-b3df-43d9-92de-d0de90c554f4 req-684893d8-06fb-4489-b9c6-4f1cb4d5e064 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0698dc5b-5f47-46c4-ace8-f5e891a964a0", "name": "network-vif-deleted", "tag": "ade336c1-073e-4cb9-90d9-0e1652a810a1"}]} {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 17 03:46:42.762938 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 17 03:46:42.762938 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: warnings.warn(msg) Nov 17 03:46:42.770974 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [req-64029681-b3df-43d9-92de-d0de90c554f4 req-684893d8-06fb-4489-b9c6-4f1cb4d5e064 service nova] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:46:42.771411 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [req-64029681-b3df-43d9-92de-d0de90c554f4 req-684893d8-06fb-4489-b9c6-4f1cb4d5e064 service nova] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:46:42.785939 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.compute.server_external_events [req-64029681-b3df-43d9-92de-d0de90c554f4 req-684893d8-06fb-4489-b9c6-4f1cb4d5e064 service nova] Creating event network-vif-deleted:ade336c1-073e-4cb9-90d9-0e1652a810a1 for instance 0698dc5b-5f47-46c4-ace8-f5e891a964a0 on hv-cinder-81803 Nov 17 03:46:42.791039 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [req-64029681-b3df-43d9-92de-d0de90c554f4 req-684893d8-06fb-4489-b9c6-4f1cb4d5e064 service nova] 10.222.0.11 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034272 Nov 17 03:46:42.791955 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 968/2126] 10.222.0.11 () {64 vars in 1317 bytes} [Wed Nov 17 03:46:42 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 17 03:46:43.039817 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-35ef690c-f507-4521-a6b4-76e1d96bfaab tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:46:43.040553 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-35ef690c-f507-4521-a6b4-76e1d96bfaab tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] [instance: 0698dc5b-5f47-46c4-ace8-f5e891a964a0] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:46:43.047284 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-35ef690c-f507-4521-a6b4-76e1d96bfaab tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:46:43.047730 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-35ef690c-f507-4521-a6b4-76e1d96bfaab tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:46:43.048582 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-35ef690c-f507-4521-a6b4-76e1d96bfaab tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:46:43.049213 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-35ef690c-f507-4521-a6b4-76e1d96bfaab tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:46:43.109450 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-35ef690c-f507-4521-a6b4-76e1d96bfaab tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '163b2f24a72649ac8084be1cac32fa09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e123e9b86124c93a7fc2db9984e7466', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:46:43.117329 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-35ef690c-f507-4521-a6b4-76e1d96bfaab tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] 10.222.0.11 "GET /compute/v2.1/servers/0698dc5b-5f47-46c4-ace8-f5e891a964a0" status: 200 len: 1218 microversion: 2.1 time: 0.082005 Nov 17 03:46:43.117916 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 1159/2127] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:46:43 2021] GET /compute/v2.1/servers/0698dc5b-5f47-46c4-ace8-f5e891a964a0 => generated 1218 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:46:44.144455 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-06f30f53-6b22-499a-ba14-f96891474691 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:46:44.145279 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-06f30f53-6b22-499a-ba14-f96891474691 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] [instance: 0698dc5b-5f47-46c4-ace8-f5e891a964a0] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:46:44.152606 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-06f30f53-6b22-499a-ba14-f96891474691 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:46:44.153151 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-06f30f53-6b22-499a-ba14-f96891474691 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:46:44.154014 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-06f30f53-6b22-499a-ba14-f96891474691 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:46:44.154515 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-06f30f53-6b22-499a-ba14-f96891474691 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:46:44.219324 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-06f30f53-6b22-499a-ba14-f96891474691 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '163b2f24a72649ac8084be1cac32fa09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e123e9b86124c93a7fc2db9984e7466', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:46:44.231971 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-06f30f53-6b22-499a-ba14-f96891474691 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] 10.222.0.11 "GET /compute/v2.1/servers/0698dc5b-5f47-46c4-ace8-f5e891a964a0" status: 200 len: 1218 microversion: 2.1 time: 0.094247 Nov 17 03:46:44.232881 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 969/2128] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:46:44 2021] GET /compute/v2.1/servers/0698dc5b-5f47-46c4-ace8-f5e891a964a0 => generated 1218 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:46:45.254142 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-bc9f05c6-6e1f-4f7f-8a70-7961c4083341 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:46:45.254890 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-bc9f05c6-6e1f-4f7f-8a70-7961c4083341 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] [instance: 0698dc5b-5f47-46c4-ace8-f5e891a964a0] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:46:45.264460 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-bc9f05c6-6e1f-4f7f-8a70-7961c4083341 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:46:45.265227 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-bc9f05c6-6e1f-4f7f-8a70-7961c4083341 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:46:45.266465 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-bc9f05c6-6e1f-4f7f-8a70-7961c4083341 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:46:45.267111 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-bc9f05c6-6e1f-4f7f-8a70-7961c4083341 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:46:45.334441 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-bc9f05c6-6e1f-4f7f-8a70-7961c4083341 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '163b2f24a72649ac8084be1cac32fa09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e123e9b86124c93a7fc2db9984e7466', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:46:45.342413 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-bc9f05c6-6e1f-4f7f-8a70-7961c4083341 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] 10.222.0.11 "GET /compute/v2.1/servers/0698dc5b-5f47-46c4-ace8-f5e891a964a0" status: 200 len: 1218 microversion: 2.1 time: 0.094570 Nov 17 03:46:45.342982 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 1160/2129] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:46:45 2021] GET /compute/v2.1/servers/0698dc5b-5f47-46c4-ace8-f5e891a964a0 => generated 1218 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:46:46.363157 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-c994ec84-8b2c-456d-b0e6-af176294c765 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:46:46.363882 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-c994ec84-8b2c-456d-b0e6-af176294c765 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] [instance: 0698dc5b-5f47-46c4-ace8-f5e891a964a0] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:46:46.371558 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-c994ec84-8b2c-456d-b0e6-af176294c765 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:46:46.372079 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-c994ec84-8b2c-456d-b0e6-af176294c765 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:46:46.373015 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-c994ec84-8b2c-456d-b0e6-af176294c765 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:46:46.373517 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-c994ec84-8b2c-456d-b0e6-af176294c765 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:46:46.440064 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-c994ec84-8b2c-456d-b0e6-af176294c765 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '163b2f24a72649ac8084be1cac32fa09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e123e9b86124c93a7fc2db9984e7466', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:46:46.447699 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-c994ec84-8b2c-456d-b0e6-af176294c765 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] 10.222.0.11 "GET /compute/v2.1/servers/0698dc5b-5f47-46c4-ace8-f5e891a964a0" status: 200 len: 1218 microversion: 2.1 time: 0.090649 Nov 17 03:46:46.448266 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 970/2130] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:46:46 2021] GET /compute/v2.1/servers/0698dc5b-5f47-46c4-ace8-f5e891a964a0 => generated 1218 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:46:47.470516 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-174402f3-e714-4f6a-8871-72a77c45add1 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:46:47.471660 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-174402f3-e714-4f6a-8871-72a77c45add1 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] [instance: 0698dc5b-5f47-46c4-ace8-f5e891a964a0] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:46:47.479270 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-174402f3-e714-4f6a-8871-72a77c45add1 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:46:47.479797 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-174402f3-e714-4f6a-8871-72a77c45add1 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:46:47.480689 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-174402f3-e714-4f6a-8871-72a77c45add1 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:46:47.481229 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-174402f3-e714-4f6a-8871-72a77c45add1 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:46:47.544083 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-174402f3-e714-4f6a-8871-72a77c45add1 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '163b2f24a72649ac8084be1cac32fa09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e123e9b86124c93a7fc2db9984e7466', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:46:47.551784 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-174402f3-e714-4f6a-8871-72a77c45add1 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] 10.222.0.11 "GET /compute/v2.1/servers/0698dc5b-5f47-46c4-ace8-f5e891a964a0" status: 200 len: 1218 microversion: 2.1 time: 0.088417 Nov 17 03:46:47.552348 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 1161/2131] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:46:47 2021] GET /compute/v2.1/servers/0698dc5b-5f47-46c4-ace8-f5e891a964a0 => generated 1218 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:46:48.572044 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-51c9f882-aa01-4fb1-b9af-d0ac61d958b2 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:46:48.573076 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-51c9f882-aa01-4fb1-b9af-d0ac61d958b2 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] [instance: 0698dc5b-5f47-46c4-ace8-f5e891a964a0] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:46:48.582658 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-51c9f882-aa01-4fb1-b9af-d0ac61d958b2 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:46:48.583106 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-51c9f882-aa01-4fb1-b9af-d0ac61d958b2 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:46:48.583878 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-51c9f882-aa01-4fb1-b9af-d0ac61d958b2 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:46:48.584340 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-51c9f882-aa01-4fb1-b9af-d0ac61d958b2 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:46:48.644023 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-51c9f882-aa01-4fb1-b9af-d0ac61d958b2 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '163b2f24a72649ac8084be1cac32fa09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e123e9b86124c93a7fc2db9984e7466', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:46:48.651885 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-51c9f882-aa01-4fb1-b9af-d0ac61d958b2 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] 10.222.0.11 "GET /compute/v2.1/servers/0698dc5b-5f47-46c4-ace8-f5e891a964a0" status: 200 len: 1218 microversion: 2.1 time: 0.086188 Nov 17 03:46:48.652457 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 971/2132] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:46:48 2021] GET /compute/v2.1/servers/0698dc5b-5f47-46c4-ace8-f5e891a964a0 => generated 1218 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:46:49.673484 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-77b2192d-2a0c-4053-8070-089d7abcc769 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:46:49.674539 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-77b2192d-2a0c-4053-8070-089d7abcc769 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] [instance: 0698dc5b-5f47-46c4-ace8-f5e891a964a0] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:46:49.685696 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-77b2192d-2a0c-4053-8070-089d7abcc769 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:46:49.686434 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-77b2192d-2a0c-4053-8070-089d7abcc769 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:46:49.687696 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-77b2192d-2a0c-4053-8070-089d7abcc769 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:46:49.688409 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-77b2192d-2a0c-4053-8070-089d7abcc769 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:46:49.748456 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-77b2192d-2a0c-4053-8070-089d7abcc769 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '163b2f24a72649ac8084be1cac32fa09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e123e9b86124c93a7fc2db9984e7466', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:46:49.756603 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-77b2192d-2a0c-4053-8070-089d7abcc769 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] 10.222.0.11 "GET /compute/v2.1/servers/0698dc5b-5f47-46c4-ace8-f5e891a964a0" status: 200 len: 1218 microversion: 2.1 time: 0.089366 Nov 17 03:46:49.757206 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 1162/2133] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:46:49 2021] GET /compute/v2.1/servers/0698dc5b-5f47-46c4-ace8-f5e891a964a0 => generated 1218 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:46:50.777843 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-4da9ceb2-76b0-429a-8f87-e97b6b952691 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:46:50.778747 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-4da9ceb2-76b0-429a-8f87-e97b6b952691 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] [instance: 0698dc5b-5f47-46c4-ace8-f5e891a964a0] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:46:50.788050 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-4da9ceb2-76b0-429a-8f87-e97b6b952691 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:46:50.788506 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-4da9ceb2-76b0-429a-8f87-e97b6b952691 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:46:50.789289 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-4da9ceb2-76b0-429a-8f87-e97b6b952691 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:46:50.789747 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-4da9ceb2-76b0-429a-8f87-e97b6b952691 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:46:50.860464 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-4da9ceb2-76b0-429a-8f87-e97b6b952691 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '163b2f24a72649ac8084be1cac32fa09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e123e9b86124c93a7fc2db9984e7466', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:46:50.868429 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-4da9ceb2-76b0-429a-8f87-e97b6b952691 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] 10.222.0.11 "GET /compute/v2.1/servers/0698dc5b-5f47-46c4-ace8-f5e891a964a0" status: 200 len: 1218 microversion: 2.1 time: 0.097002 Nov 17 03:46:50.869022 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 972/2134] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:46:50 2021] GET /compute/v2.1/servers/0698dc5b-5f47-46c4-ace8-f5e891a964a0 => generated 1218 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:46:51.889276 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-a3803dd8-f075-45a1-997f-4c89781f4765 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:46:51.890238 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-a3803dd8-f075-45a1-997f-4c89781f4765 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] [instance: 0698dc5b-5f47-46c4-ace8-f5e891a964a0] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:46:51.898613 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-a3803dd8-f075-45a1-997f-4c89781f4765 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:46:51.899062 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-a3803dd8-f075-45a1-997f-4c89781f4765 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:46:51.899825 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-a3803dd8-f075-45a1-997f-4c89781f4765 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:46:51.900252 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-a3803dd8-f075-45a1-997f-4c89781f4765 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:46:51.965756 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-a3803dd8-f075-45a1-997f-4c89781f4765 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '163b2f24a72649ac8084be1cac32fa09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e123e9b86124c93a7fc2db9984e7466', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:46:51.973729 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-a3803dd8-f075-45a1-997f-4c89781f4765 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] 10.222.0.11 "GET /compute/v2.1/servers/0698dc5b-5f47-46c4-ace8-f5e891a964a0" status: 200 len: 1218 microversion: 2.1 time: 0.090739 Nov 17 03:46:51.974315 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 1163/2135] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:46:51 2021] GET /compute/v2.1/servers/0698dc5b-5f47-46c4-ace8-f5e891a964a0 => generated 1218 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:46:52.996166 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-a3b83611-54d9-47f6-ab1c-fafb9a451830 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:46:52.997113 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-a3b83611-54d9-47f6-ab1c-fafb9a451830 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] [instance: 0698dc5b-5f47-46c4-ace8-f5e891a964a0] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:46:53.006550 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-a3b83611-54d9-47f6-ab1c-fafb9a451830 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:46:53.007004 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-a3b83611-54d9-47f6-ab1c-fafb9a451830 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:46:53.007771 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-a3b83611-54d9-47f6-ab1c-fafb9a451830 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:46:53.008200 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-a3b83611-54d9-47f6-ab1c-fafb9a451830 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:46:53.070132 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-a3b83611-54d9-47f6-ab1c-fafb9a451830 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '163b2f24a72649ac8084be1cac32fa09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e123e9b86124c93a7fc2db9984e7466', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:46:53.077783 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-a3b83611-54d9-47f6-ab1c-fafb9a451830 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] 10.222.0.11 "GET /compute/v2.1/servers/0698dc5b-5f47-46c4-ace8-f5e891a964a0" status: 200 len: 1218 microversion: 2.1 time: 0.088212 Nov 17 03:46:53.078346 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 973/2136] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:46:52 2021] GET /compute/v2.1/servers/0698dc5b-5f47-46c4-ace8-f5e891a964a0 => generated 1218 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:46:54.096761 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-9f4ddd8d-0acd-4caa-9ed3-bdd41077cc02 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:46:54.097445 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-9f4ddd8d-0acd-4caa-9ed3-bdd41077cc02 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] [instance: 0698dc5b-5f47-46c4-ace8-f5e891a964a0] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:46:54.104049 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-9f4ddd8d-0acd-4caa-9ed3-bdd41077cc02 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:46:54.104514 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-9f4ddd8d-0acd-4caa-9ed3-bdd41077cc02 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:46:54.105299 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-9f4ddd8d-0acd-4caa-9ed3-bdd41077cc02 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:46:54.105729 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-9f4ddd8d-0acd-4caa-9ed3-bdd41077cc02 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:46:54.169332 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-9f4ddd8d-0acd-4caa-9ed3-bdd41077cc02 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '163b2f24a72649ac8084be1cac32fa09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e123e9b86124c93a7fc2db9984e7466', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:46:54.177183 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-9f4ddd8d-0acd-4caa-9ed3-bdd41077cc02 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] 10.222.0.11 "GET /compute/v2.1/servers/0698dc5b-5f47-46c4-ace8-f5e891a964a0" status: 200 len: 1218 microversion: 2.1 time: 0.084277 Nov 17 03:46:54.177741 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 1164/2137] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:46:54 2021] GET /compute/v2.1/servers/0698dc5b-5f47-46c4-ace8-f5e891a964a0 => generated 1218 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:46:55.198193 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-b574dc60-25b2-4e02-b02a-f0c26cbec63d tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:46:55.199258 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-b574dc60-25b2-4e02-b02a-f0c26cbec63d tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] [instance: 0698dc5b-5f47-46c4-ace8-f5e891a964a0] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:46:55.210238 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-b574dc60-25b2-4e02-b02a-f0c26cbec63d tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:46:55.210997 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-b574dc60-25b2-4e02-b02a-f0c26cbec63d tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:46:55.212282 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-b574dc60-25b2-4e02-b02a-f0c26cbec63d tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:46:55.213054 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-b574dc60-25b2-4e02-b02a-f0c26cbec63d tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:46:55.279976 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-b574dc60-25b2-4e02-b02a-f0c26cbec63d tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '163b2f24a72649ac8084be1cac32fa09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e123e9b86124c93a7fc2db9984e7466', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:46:55.287682 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-b574dc60-25b2-4e02-b02a-f0c26cbec63d tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] 10.222.0.11 "GET /compute/v2.1/servers/0698dc5b-5f47-46c4-ace8-f5e891a964a0" status: 200 len: 1218 microversion: 2.1 time: 0.095939 Nov 17 03:46:55.288247 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 974/2138] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:46:55 2021] GET /compute/v2.1/servers/0698dc5b-5f47-46c4-ace8-f5e891a964a0 => generated 1218 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:46:56.309421 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-e049ac2b-761f-43ad-88a4-c0d4102aadef tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:46:56.310628 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-e049ac2b-761f-43ad-88a4-c0d4102aadef tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] [instance: 0698dc5b-5f47-46c4-ace8-f5e891a964a0] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:46:56.321025 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-e049ac2b-761f-43ad-88a4-c0d4102aadef tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:46:56.321778 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-e049ac2b-761f-43ad-88a4-c0d4102aadef tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:46:56.323038 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-e049ac2b-761f-43ad-88a4-c0d4102aadef tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:46:56.323757 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-e049ac2b-761f-43ad-88a4-c0d4102aadef tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:46:56.390367 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-e049ac2b-761f-43ad-88a4-c0d4102aadef tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '163b2f24a72649ac8084be1cac32fa09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e123e9b86124c93a7fc2db9984e7466', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:46:56.398113 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-e049ac2b-761f-43ad-88a4-c0d4102aadef tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] 10.222.0.11 "GET /compute/v2.1/servers/0698dc5b-5f47-46c4-ace8-f5e891a964a0" status: 200 len: 1218 microversion: 2.1 time: 0.095461 Nov 17 03:46:56.398682 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 1165/2139] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:46:56 2021] GET /compute/v2.1/servers/0698dc5b-5f47-46c4-ace8-f5e891a964a0 => generated 1218 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:46:57.423749 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-0f8ac83b-b941-40cc-9959-1aa2252b694d tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:46:57.424614 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-0f8ac83b-b941-40cc-9959-1aa2252b694d tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] [instance: 0698dc5b-5f47-46c4-ace8-f5e891a964a0] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:46:57.439681 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-0f8ac83b-b941-40cc-9959-1aa2252b694d tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:46:57.440432 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-0f8ac83b-b941-40cc-9959-1aa2252b694d tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:46:57.441784 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-0f8ac83b-b941-40cc-9959-1aa2252b694d tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:46:57.442677 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-0f8ac83b-b941-40cc-9959-1aa2252b694d tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:46:57.503287 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-0f8ac83b-b941-40cc-9959-1aa2252b694d tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '163b2f24a72649ac8084be1cac32fa09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e123e9b86124c93a7fc2db9984e7466', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:46:57.511776 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-0f8ac83b-b941-40cc-9959-1aa2252b694d tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] 10.222.0.11 "GET /compute/v2.1/servers/0698dc5b-5f47-46c4-ace8-f5e891a964a0" status: 200 len: 1218 microversion: 2.1 time: 0.094320 Nov 17 03:46:57.512345 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 975/2140] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:46:57 2021] GET /compute/v2.1/servers/0698dc5b-5f47-46c4-ace8-f5e891a964a0 => generated 1218 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:46:58.529471 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-d0aec4c2-9887-42aa-b1e1-797a635b0766 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:46:58.530084 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-d0aec4c2-9887-42aa-b1e1-797a635b0766 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] [instance: 0698dc5b-5f47-46c4-ace8-f5e891a964a0] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:46:58.539744 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-d0aec4c2-9887-42aa-b1e1-797a635b0766 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:46:58.540383 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-d0aec4c2-9887-42aa-b1e1-797a635b0766 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:46:58.541615 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-d0aec4c2-9887-42aa-b1e1-797a635b0766 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:46:58.542259 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-d0aec4c2-9887-42aa-b1e1-797a635b0766 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:46:58.609106 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-d0aec4c2-9887-42aa-b1e1-797a635b0766 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '163b2f24a72649ac8084be1cac32fa09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e123e9b86124c93a7fc2db9984e7466', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:46:58.617434 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-d0aec4c2-9887-42aa-b1e1-797a635b0766 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] 10.222.0.11 "GET /compute/v2.1/servers/0698dc5b-5f47-46c4-ace8-f5e891a964a0" status: 200 len: 1218 microversion: 2.1 time: 0.092229 Nov 17 03:46:58.618007 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 1166/2141] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:46:58 2021] GET /compute/v2.1/servers/0698dc5b-5f47-46c4-ace8-f5e891a964a0 => generated 1218 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:46:59.638518 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-2666005b-37e5-411a-a554-6dc28ed405b8 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:46:59.639514 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-2666005b-37e5-411a-a554-6dc28ed405b8 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] [instance: 0698dc5b-5f47-46c4-ace8-f5e891a964a0] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:46:59.650452 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-2666005b-37e5-411a-a554-6dc28ed405b8 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:46:59.651196 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-2666005b-37e5-411a-a554-6dc28ed405b8 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:46:59.652475 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-2666005b-37e5-411a-a554-6dc28ed405b8 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:46:59.653247 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-2666005b-37e5-411a-a554-6dc28ed405b8 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:46:59.717589 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-2666005b-37e5-411a-a554-6dc28ed405b8 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '163b2f24a72649ac8084be1cac32fa09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e123e9b86124c93a7fc2db9984e7466', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:46:59.727662 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-2666005b-37e5-411a-a554-6dc28ed405b8 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] 10.222.0.11 "GET /compute/v2.1/servers/0698dc5b-5f47-46c4-ace8-f5e891a964a0" status: 200 len: 1218 microversion: 2.1 time: 0.095407 Nov 17 03:46:59.728232 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 976/2142] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:46:59 2021] GET /compute/v2.1/servers/0698dc5b-5f47-46c4-ace8-f5e891a964a0 => generated 1218 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:47:00.746398 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-94248e8f-5ed3-4d86-95ee-1d205ed2f849 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:47:00.747069 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-94248e8f-5ed3-4d86-95ee-1d205ed2f849 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] [instance: 0698dc5b-5f47-46c4-ace8-f5e891a964a0] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:47:00.754944 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-94248e8f-5ed3-4d86-95ee-1d205ed2f849 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:47:00.755806 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-94248e8f-5ed3-4d86-95ee-1d205ed2f849 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:47:00.756730 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-94248e8f-5ed3-4d86-95ee-1d205ed2f849 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:47:00.757285 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-94248e8f-5ed3-4d86-95ee-1d205ed2f849 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:47:00.827759 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-94248e8f-5ed3-4d86-95ee-1d205ed2f849 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '163b2f24a72649ac8084be1cac32fa09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e123e9b86124c93a7fc2db9984e7466', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:47:00.836051 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-94248e8f-5ed3-4d86-95ee-1d205ed2f849 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] 10.222.0.11 "GET /compute/v2.1/servers/0698dc5b-5f47-46c4-ace8-f5e891a964a0" status: 200 len: 1218 microversion: 2.1 time: 0.094022 Nov 17 03:47:00.836624 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 1167/2143] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:47:00 2021] GET /compute/v2.1/servers/0698dc5b-5f47-46c4-ace8-f5e891a964a0 => generated 1218 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:47:01.856236 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-66f65763-f5bb-47d9-8acb-f51b5c52798c tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:47:01.857150 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-66f65763-f5bb-47d9-8acb-f51b5c52798c tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] [instance: 0698dc5b-5f47-46c4-ace8-f5e891a964a0] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:47:01.867347 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-66f65763-f5bb-47d9-8acb-f51b5c52798c tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:47:01.868031 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-66f65763-f5bb-47d9-8acb-f51b5c52798c tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:47:01.869295 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-66f65763-f5bb-47d9-8acb-f51b5c52798c tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:47:01.869951 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-66f65763-f5bb-47d9-8acb-f51b5c52798c tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:47:01.946530 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-66f65763-f5bb-47d9-8acb-f51b5c52798c tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '163b2f24a72649ac8084be1cac32fa09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e123e9b86124c93a7fc2db9984e7466', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:47:01.957707 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-66f65763-f5bb-47d9-8acb-f51b5c52798c tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] 10.222.0.11 "GET /compute/v2.1/servers/0698dc5b-5f47-46c4-ace8-f5e891a964a0" status: 200 len: 1218 microversion: 2.1 time: 0.107033 Nov 17 03:47:01.958441 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 977/2144] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:47:01 2021] GET /compute/v2.1/servers/0698dc5b-5f47-46c4-ace8-f5e891a964a0 => generated 1218 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:47:02.984721 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-ce58e6b5-230f-498b-9d19-d703de452e58 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:47:02.985653 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-ce58e6b5-230f-498b-9d19-d703de452e58 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] [instance: 0698dc5b-5f47-46c4-ace8-f5e891a964a0] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:47:02.993788 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-ce58e6b5-230f-498b-9d19-d703de452e58 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:47:02.994242 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-ce58e6b5-230f-498b-9d19-d703de452e58 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:47:02.995018 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-ce58e6b5-230f-498b-9d19-d703de452e58 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:47:02.995449 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-ce58e6b5-230f-498b-9d19-d703de452e58 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:47:03.057466 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-ce58e6b5-230f-498b-9d19-d703de452e58 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '163b2f24a72649ac8084be1cac32fa09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e123e9b86124c93a7fc2db9984e7466', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:47:03.065332 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-ce58e6b5-230f-498b-9d19-d703de452e58 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] 10.222.0.11 "GET /compute/v2.1/servers/0698dc5b-5f47-46c4-ace8-f5e891a964a0" status: 200 len: 1218 microversion: 2.1 time: 0.086951 Nov 17 03:47:03.065882 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 1168/2145] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:47:02 2021] GET /compute/v2.1/servers/0698dc5b-5f47-46c4-ace8-f5e891a964a0 => generated 1218 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:47:04.085340 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-142cb164-c877-4c99-8288-f302aa1c97b7 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:47:04.085959 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-142cb164-c877-4c99-8288-f302aa1c97b7 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] [instance: 0698dc5b-5f47-46c4-ace8-f5e891a964a0] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:47:04.092799 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-142cb164-c877-4c99-8288-f302aa1c97b7 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:47:04.093291 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-142cb164-c877-4c99-8288-f302aa1c97b7 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:47:04.094079 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-142cb164-c877-4c99-8288-f302aa1c97b7 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:47:04.094512 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-142cb164-c877-4c99-8288-f302aa1c97b7 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:47:04.167289 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-142cb164-c877-4c99-8288-f302aa1c97b7 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '163b2f24a72649ac8084be1cac32fa09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e123e9b86124c93a7fc2db9984e7466', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:47:04.175261 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-142cb164-c877-4c99-8288-f302aa1c97b7 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] 10.222.0.11 "GET /compute/v2.1/servers/0698dc5b-5f47-46c4-ace8-f5e891a964a0" status: 200 len: 1218 microversion: 2.1 time: 0.094919 Nov 17 03:47:04.175831 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 978/2146] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:47:04 2021] GET /compute/v2.1/servers/0698dc5b-5f47-46c4-ace8-f5e891a964a0 => generated 1218 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:47:05.195139 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-9a634742-7391-4b32-952c-74df570fe8f5 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:47:05.195737 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-9a634742-7391-4b32-952c-74df570fe8f5 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] [instance: 0698dc5b-5f47-46c4-ace8-f5e891a964a0] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:47:05.202684 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-9a634742-7391-4b32-952c-74df570fe8f5 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:47:05.203129 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-9a634742-7391-4b32-952c-74df570fe8f5 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:47:05.203863 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-9a634742-7391-4b32-952c-74df570fe8f5 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:47:05.204321 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-9a634742-7391-4b32-952c-74df570fe8f5 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:47:05.269441 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-9a634742-7391-4b32-952c-74df570fe8f5 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '163b2f24a72649ac8084be1cac32fa09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e123e9b86124c93a7fc2db9984e7466', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:47:05.277440 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-9a634742-7391-4b32-952c-74df570fe8f5 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] 10.222.0.11 "GET /compute/v2.1/servers/0698dc5b-5f47-46c4-ace8-f5e891a964a0" status: 200 len: 1218 microversion: 2.1 time: 0.087099 Nov 17 03:47:05.278014 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 1169/2147] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:47:05 2021] GET /compute/v2.1/servers/0698dc5b-5f47-46c4-ace8-f5e891a964a0 => generated 1218 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:47:06.299025 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-846f533e-19ea-45a5-8848-e67a49f05758 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:47:06.299977 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-846f533e-19ea-45a5-8848-e67a49f05758 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] [instance: 0698dc5b-5f47-46c4-ace8-f5e891a964a0] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:47:06.308159 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-846f533e-19ea-45a5-8848-e67a49f05758 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:47:06.308539 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-846f533e-19ea-45a5-8848-e67a49f05758 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:47:06.309349 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-846f533e-19ea-45a5-8848-e67a49f05758 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:47:06.309779 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-846f533e-19ea-45a5-8848-e67a49f05758 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:47:06.369521 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-846f533e-19ea-45a5-8848-e67a49f05758 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '163b2f24a72649ac8084be1cac32fa09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e123e9b86124c93a7fc2db9984e7466', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:47:06.377035 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-846f533e-19ea-45a5-8848-e67a49f05758 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] 10.222.0.11 "GET /compute/v2.1/servers/0698dc5b-5f47-46c4-ace8-f5e891a964a0" status: 200 len: 1218 microversion: 2.1 time: 0.084232 Nov 17 03:47:06.377605 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 979/2148] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:47:06 2021] GET /compute/v2.1/servers/0698dc5b-5f47-46c4-ace8-f5e891a964a0 => generated 1218 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:47:07.396870 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-82998cd8-b336-4e6e-88e2-3f45fe93d9ba tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:47:07.397549 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-82998cd8-b336-4e6e-88e2-3f45fe93d9ba tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] [instance: 0698dc5b-5f47-46c4-ace8-f5e891a964a0] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:47:07.405671 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-82998cd8-b336-4e6e-88e2-3f45fe93d9ba tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:47:07.406265 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-82998cd8-b336-4e6e-88e2-3f45fe93d9ba tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:47:07.407225 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-82998cd8-b336-4e6e-88e2-3f45fe93d9ba tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:47:07.407754 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-82998cd8-b336-4e6e-88e2-3f45fe93d9ba tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:47:07.470480 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-82998cd8-b336-4e6e-88e2-3f45fe93d9ba tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '163b2f24a72649ac8084be1cac32fa09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e123e9b86124c93a7fc2db9984e7466', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:47:07.478522 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-82998cd8-b336-4e6e-88e2-3f45fe93d9ba tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] 10.222.0.11 "GET /compute/v2.1/servers/0698dc5b-5f47-46c4-ace8-f5e891a964a0" status: 200 len: 1218 microversion: 2.1 time: 0.086998 Nov 17 03:47:07.479091 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 1170/2149] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:47:07 2021] GET /compute/v2.1/servers/0698dc5b-5f47-46c4-ace8-f5e891a964a0 => generated 1218 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:47:08.499322 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-d934c165-86aa-49f5-bc74-68884cd3c6f4 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:47:08.500230 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-d934c165-86aa-49f5-bc74-68884cd3c6f4 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] [instance: 0698dc5b-5f47-46c4-ace8-f5e891a964a0] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:47:08.510904 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-d934c165-86aa-49f5-bc74-68884cd3c6f4 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:47:08.511648 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-d934c165-86aa-49f5-bc74-68884cd3c6f4 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:47:08.512959 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-d934c165-86aa-49f5-bc74-68884cd3c6f4 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:47:08.513689 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-d934c165-86aa-49f5-bc74-68884cd3c6f4 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:47:08.585613 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-d934c165-86aa-49f5-bc74-68884cd3c6f4 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '163b2f24a72649ac8084be1cac32fa09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e123e9b86124c93a7fc2db9984e7466', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:47:08.593271 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-d934c165-86aa-49f5-bc74-68884cd3c6f4 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] 10.222.0.11 "GET /compute/v2.1/servers/0698dc5b-5f47-46c4-ace8-f5e891a964a0" status: 200 len: 1218 microversion: 2.1 time: 0.100294 Nov 17 03:47:08.593838 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 980/2150] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:47:08 2021] GET /compute/v2.1/servers/0698dc5b-5f47-46c4-ace8-f5e891a964a0 => generated 1218 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:47:09.614098 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-68b73b86-c96a-4ab8-9b3c-0e82ba085e7e tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:47:09.615568 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-68b73b86-c96a-4ab8-9b3c-0e82ba085e7e tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] [instance: 0698dc5b-5f47-46c4-ace8-f5e891a964a0] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:47:09.626178 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-68b73b86-c96a-4ab8-9b3c-0e82ba085e7e tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:47:09.626937 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-68b73b86-c96a-4ab8-9b3c-0e82ba085e7e tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:47:09.628204 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-68b73b86-c96a-4ab8-9b3c-0e82ba085e7e tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:47:09.628972 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-68b73b86-c96a-4ab8-9b3c-0e82ba085e7e tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:47:09.690197 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-68b73b86-c96a-4ab8-9b3c-0e82ba085e7e tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '163b2f24a72649ac8084be1cac32fa09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e123e9b86124c93a7fc2db9984e7466', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:47:09.698917 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-68b73b86-c96a-4ab8-9b3c-0e82ba085e7e tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] 10.222.0.11 "GET /compute/v2.1/servers/0698dc5b-5f47-46c4-ace8-f5e891a964a0" status: 200 len: 1218 microversion: 2.1 time: 0.091069 Nov 17 03:47:09.699489 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 1171/2151] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:47:09 2021] GET /compute/v2.1/servers/0698dc5b-5f47-46c4-ace8-f5e891a964a0 => generated 1218 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:47:10.725175 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-38ed89d9-1ddc-4ac1-bea3-700a98f0292a tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:47:10.726113 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-38ed89d9-1ddc-4ac1-bea3-700a98f0292a tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] [instance: 0698dc5b-5f47-46c4-ace8-f5e891a964a0] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:47:10.736483 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-38ed89d9-1ddc-4ac1-bea3-700a98f0292a tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:47:10.737303 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-38ed89d9-1ddc-4ac1-bea3-700a98f0292a tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:47:10.738580 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-38ed89d9-1ddc-4ac1-bea3-700a98f0292a tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:47:10.739322 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-38ed89d9-1ddc-4ac1-bea3-700a98f0292a tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:47:10.798263 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-38ed89d9-1ddc-4ac1-bea3-700a98f0292a tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '163b2f24a72649ac8084be1cac32fa09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e123e9b86124c93a7fc2db9984e7466', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:47:10.807048 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-38ed89d9-1ddc-4ac1-bea3-700a98f0292a tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] 10.222.0.11 "GET /compute/v2.1/servers/0698dc5b-5f47-46c4-ace8-f5e891a964a0" status: 200 len: 1218 microversion: 2.1 time: 0.088372 Nov 17 03:47:10.807615 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 981/2152] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:47:10 2021] GET /compute/v2.1/servers/0698dc5b-5f47-46c4-ace8-f5e891a964a0 => generated 1218 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:47:11.826559 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-fcc5f4d4-6f8c-4e39-9ae3-ed8c558742c1 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:47:11.827367 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-fcc5f4d4-6f8c-4e39-9ae3-ed8c558742c1 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] [instance: 0698dc5b-5f47-46c4-ace8-f5e891a964a0] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:47:11.837064 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-fcc5f4d4-6f8c-4e39-9ae3-ed8c558742c1 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:47:11.837697 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-fcc5f4d4-6f8c-4e39-9ae3-ed8c558742c1 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:47:11.838706 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-fcc5f4d4-6f8c-4e39-9ae3-ed8c558742c1 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:47:11.839277 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-fcc5f4d4-6f8c-4e39-9ae3-ed8c558742c1 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:47:11.905440 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-fcc5f4d4-6f8c-4e39-9ae3-ed8c558742c1 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '163b2f24a72649ac8084be1cac32fa09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e123e9b86124c93a7fc2db9984e7466', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:47:11.913429 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-fcc5f4d4-6f8c-4e39-9ae3-ed8c558742c1 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] 10.222.0.11 "GET /compute/v2.1/servers/0698dc5b-5f47-46c4-ace8-f5e891a964a0" status: 200 len: 1218 microversion: 2.1 time: 0.091831 Nov 17 03:47:11.913987 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 1172/2153] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:47:11 2021] GET /compute/v2.1/servers/0698dc5b-5f47-46c4-ace8-f5e891a964a0 => generated 1218 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:47:12.931086 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-5d92a4dc-afb0-4b78-93b3-2e72f325ab7f tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:47:12.931702 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-5d92a4dc-afb0-4b78-93b3-2e72f325ab7f tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] [instance: 0698dc5b-5f47-46c4-ace8-f5e891a964a0] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:47:12.938621 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-5d92a4dc-afb0-4b78-93b3-2e72f325ab7f tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:47:12.939116 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-5d92a4dc-afb0-4b78-93b3-2e72f325ab7f tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:47:12.939885 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-5d92a4dc-afb0-4b78-93b3-2e72f325ab7f tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:47:12.940321 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-5d92a4dc-afb0-4b78-93b3-2e72f325ab7f tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:47:12.999910 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-5d92a4dc-afb0-4b78-93b3-2e72f325ab7f tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '163b2f24a72649ac8084be1cac32fa09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e123e9b86124c93a7fc2db9984e7466', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:47:13.007781 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-5d92a4dc-afb0-4b78-93b3-2e72f325ab7f tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] 10.222.0.11 "GET /compute/v2.1/servers/0698dc5b-5f47-46c4-ace8-f5e891a964a0" status: 200 len: 1218 microversion: 2.1 time: 0.081305 Nov 17 03:47:13.008356 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 982/2154] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:47:12 2021] GET /compute/v2.1/servers/0698dc5b-5f47-46c4-ace8-f5e891a964a0 => generated 1218 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:47:14.028727 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-f9a69d82-deb8-4f3b-b839-96c2c364c826 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:47:14.029800 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-f9a69d82-deb8-4f3b-b839-96c2c364c826 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] [instance: 0698dc5b-5f47-46c4-ace8-f5e891a964a0] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:47:14.038764 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-f9a69d82-deb8-4f3b-b839-96c2c364c826 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:47:14.039211 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-f9a69d82-deb8-4f3b-b839-96c2c364c826 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:47:14.039982 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-f9a69d82-deb8-4f3b-b839-96c2c364c826 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:47:14.040414 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-f9a69d82-deb8-4f3b-b839-96c2c364c826 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:47:14.100072 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-f9a69d82-deb8-4f3b-b839-96c2c364c826 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '163b2f24a72649ac8084be1cac32fa09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e123e9b86124c93a7fc2db9984e7466', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:47:14.108200 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-f9a69d82-deb8-4f3b-b839-96c2c364c826 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] 10.222.0.11 "GET /compute/v2.1/servers/0698dc5b-5f47-46c4-ace8-f5e891a964a0" status: 200 len: 1218 microversion: 2.1 time: 0.085589 Nov 17 03:47:14.108801 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 1173/2155] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:47:14 2021] GET /compute/v2.1/servers/0698dc5b-5f47-46c4-ace8-f5e891a964a0 => generated 1218 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:47:15.129587 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-f78c6641-4c46-414e-a5b7-7900d3517e1d tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:47:15.131308 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-f78c6641-4c46-414e-a5b7-7900d3517e1d tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] [instance: 0698dc5b-5f47-46c4-ace8-f5e891a964a0] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:47:15.142191 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-f78c6641-4c46-414e-a5b7-7900d3517e1d tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:47:15.142942 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-f78c6641-4c46-414e-a5b7-7900d3517e1d tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:47:15.144318 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-f78c6641-4c46-414e-a5b7-7900d3517e1d tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:47:15.145081 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-f78c6641-4c46-414e-a5b7-7900d3517e1d tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:47:15.204696 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-f78c6641-4c46-414e-a5b7-7900d3517e1d tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '163b2f24a72649ac8084be1cac32fa09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e123e9b86124c93a7fc2db9984e7466', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:47:15.212909 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-f78c6641-4c46-414e-a5b7-7900d3517e1d tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] 10.222.0.11 "GET /compute/v2.1/servers/0698dc5b-5f47-46c4-ace8-f5e891a964a0" status: 200 len: 1218 microversion: 2.1 time: 0.089663 Nov 17 03:47:15.213484 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 983/2156] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:47:15 2021] GET /compute/v2.1/servers/0698dc5b-5f47-46c4-ace8-f5e891a964a0 => generated 1218 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:47:16.233969 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-507076cc-9f57-4cf3-a85a-6051607e01d0 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:47:16.235374 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-507076cc-9f57-4cf3-a85a-6051607e01d0 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] [instance: 0698dc5b-5f47-46c4-ace8-f5e891a964a0] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:47:16.246162 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-507076cc-9f57-4cf3-a85a-6051607e01d0 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:47:16.246917 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-507076cc-9f57-4cf3-a85a-6051607e01d0 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:47:16.248172 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-507076cc-9f57-4cf3-a85a-6051607e01d0 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:47:16.248932 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-507076cc-9f57-4cf3-a85a-6051607e01d0 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:47:16.312283 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-507076cc-9f57-4cf3-a85a-6051607e01d0 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '163b2f24a72649ac8084be1cac32fa09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e123e9b86124c93a7fc2db9984e7466', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:47:16.321016 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-507076cc-9f57-4cf3-a85a-6051607e01d0 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] 10.222.0.11 "GET /compute/v2.1/servers/0698dc5b-5f47-46c4-ace8-f5e891a964a0" status: 200 len: 1218 microversion: 2.1 time: 0.093349 Nov 17 03:47:16.321608 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 1174/2157] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:47:16 2021] GET /compute/v2.1/servers/0698dc5b-5f47-46c4-ace8-f5e891a964a0 => generated 1218 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:47:17.342887 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-e4766664-7bf3-46a0-b51f-84de17c6d8b5 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:47:17.343754 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-e4766664-7bf3-46a0-b51f-84de17c6d8b5 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] [instance: 0698dc5b-5f47-46c4-ace8-f5e891a964a0] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:47:17.354768 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-e4766664-7bf3-46a0-b51f-84de17c6d8b5 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:47:17.355514 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-e4766664-7bf3-46a0-b51f-84de17c6d8b5 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:47:17.356821 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-e4766664-7bf3-46a0-b51f-84de17c6d8b5 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:47:17.357558 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-e4766664-7bf3-46a0-b51f-84de17c6d8b5 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:47:17.441349 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-e4766664-7bf3-46a0-b51f-84de17c6d8b5 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '163b2f24a72649ac8084be1cac32fa09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e123e9b86124c93a7fc2db9984e7466', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:47:17.449793 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-e4766664-7bf3-46a0-b51f-84de17c6d8b5 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] 10.222.0.11 "GET /compute/v2.1/servers/0698dc5b-5f47-46c4-ace8-f5e891a964a0" status: 200 len: 1218 microversion: 2.1 time: 0.113225 Nov 17 03:47:17.450355 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 984/2158] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:47:17 2021] GET /compute/v2.1/servers/0698dc5b-5f47-46c4-ace8-f5e891a964a0 => generated 1218 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:47:18.470620 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-56508173-4bc2-452e-930a-f22ae4aee2b7 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:47:18.471486 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-56508173-4bc2-452e-930a-f22ae4aee2b7 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] [instance: 0698dc5b-5f47-46c4-ace8-f5e891a964a0] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:47:18.479154 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-56508173-4bc2-452e-930a-f22ae4aee2b7 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:47:18.479605 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-56508173-4bc2-452e-930a-f22ae4aee2b7 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:47:18.480369 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-56508173-4bc2-452e-930a-f22ae4aee2b7 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:47:18.480804 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-56508173-4bc2-452e-930a-f22ae4aee2b7 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:47:18.544201 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-56508173-4bc2-452e-930a-f22ae4aee2b7 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '163b2f24a72649ac8084be1cac32fa09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e123e9b86124c93a7fc2db9984e7466', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:47:18.552625 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-56508173-4bc2-452e-930a-f22ae4aee2b7 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] 10.222.0.11 "GET /compute/v2.1/servers/0698dc5b-5f47-46c4-ace8-f5e891a964a0" status: 200 len: 1218 microversion: 2.1 time: 0.088280 Nov 17 03:47:18.553602 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 1175/2159] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:47:18 2021] GET /compute/v2.1/servers/0698dc5b-5f47-46c4-ace8-f5e891a964a0 => generated 1218 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:47:19.573993 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-4ab44fbf-1712-464b-8197-f60d439a008b tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:47:19.575017 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-4ab44fbf-1712-464b-8197-f60d439a008b tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] [instance: 0698dc5b-5f47-46c4-ace8-f5e891a964a0] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:47:19.584630 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-4ab44fbf-1712-464b-8197-f60d439a008b tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:47:19.585117 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-4ab44fbf-1712-464b-8197-f60d439a008b tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:47:19.585899 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-4ab44fbf-1712-464b-8197-f60d439a008b tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:47:19.586323 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-4ab44fbf-1712-464b-8197-f60d439a008b tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:47:19.656350 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-4ab44fbf-1712-464b-8197-f60d439a008b tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '163b2f24a72649ac8084be1cac32fa09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e123e9b86124c93a7fc2db9984e7466', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:47:19.667971 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-4ab44fbf-1712-464b-8197-f60d439a008b tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] 10.222.0.11 "GET /compute/v2.1/servers/0698dc5b-5f47-46c4-ace8-f5e891a964a0" status: 200 len: 1218 microversion: 2.1 time: 0.099884 Nov 17 03:47:19.668826 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 985/2160] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:47:19 2021] GET /compute/v2.1/servers/0698dc5b-5f47-46c4-ace8-f5e891a964a0 => generated 1218 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:47:20.692156 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-a1f39779-431f-4b62-88ad-8b9240c69d10 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:47:20.692801 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-a1f39779-431f-4b62-88ad-8b9240c69d10 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] [instance: 0698dc5b-5f47-46c4-ace8-f5e891a964a0] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:47:20.699597 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-a1f39779-431f-4b62-88ad-8b9240c69d10 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:47:20.700048 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-a1f39779-431f-4b62-88ad-8b9240c69d10 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:47:20.700824 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-a1f39779-431f-4b62-88ad-8b9240c69d10 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:47:20.701288 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-a1f39779-431f-4b62-88ad-8b9240c69d10 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:47:20.760808 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-a1f39779-431f-4b62-88ad-8b9240c69d10 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '163b2f24a72649ac8084be1cac32fa09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e123e9b86124c93a7fc2db9984e7466', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:47:20.768224 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-a1f39779-431f-4b62-88ad-8b9240c69d10 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] 10.222.0.11 "GET /compute/v2.1/servers/0698dc5b-5f47-46c4-ace8-f5e891a964a0" status: 200 len: 1218 microversion: 2.1 time: 0.082506 Nov 17 03:47:20.768806 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 1176/2161] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:47:20 2021] GET /compute/v2.1/servers/0698dc5b-5f47-46c4-ace8-f5e891a964a0 => generated 1218 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:47:21.789492 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-9b0a6cdb-3c5e-48d4-a3c6-fad7a2f58cd2 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:47:21.790377 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-9b0a6cdb-3c5e-48d4-a3c6-fad7a2f58cd2 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] [instance: 0698dc5b-5f47-46c4-ace8-f5e891a964a0] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:47:21.800461 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-9b0a6cdb-3c5e-48d4-a3c6-fad7a2f58cd2 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:47:21.801497 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-9b0a6cdb-3c5e-48d4-a3c6-fad7a2f58cd2 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:47:21.802348 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-9b0a6cdb-3c5e-48d4-a3c6-fad7a2f58cd2 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:47:21.802792 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-9b0a6cdb-3c5e-48d4-a3c6-fad7a2f58cd2 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:47:21.873720 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-9b0a6cdb-3c5e-48d4-a3c6-fad7a2f58cd2 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '163b2f24a72649ac8084be1cac32fa09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e123e9b86124c93a7fc2db9984e7466', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:47:21.886080 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-9b0a6cdb-3c5e-48d4-a3c6-fad7a2f58cd2 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] 10.222.0.11 "GET /compute/v2.1/servers/0698dc5b-5f47-46c4-ace8-f5e891a964a0" status: 200 len: 1218 microversion: 2.1 time: 0.102488 Nov 17 03:47:21.886856 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 986/2162] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:47:21 2021] GET /compute/v2.1/servers/0698dc5b-5f47-46c4-ace8-f5e891a964a0 => generated 1218 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:47:22.907175 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-8d84f65f-3dfd-4578-ad8b-e9e927413016 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:47:22.908026 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-8d84f65f-3dfd-4578-ad8b-e9e927413016 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] [instance: 0698dc5b-5f47-46c4-ace8-f5e891a964a0] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:47:22.916527 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-8d84f65f-3dfd-4578-ad8b-e9e927413016 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:47:22.917009 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-8d84f65f-3dfd-4578-ad8b-e9e927413016 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:47:22.917783 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-8d84f65f-3dfd-4578-ad8b-e9e927413016 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:47:22.918216 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-8d84f65f-3dfd-4578-ad8b-e9e927413016 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:47:22.979967 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-8d84f65f-3dfd-4578-ad8b-e9e927413016 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '163b2f24a72649ac8084be1cac32fa09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e123e9b86124c93a7fc2db9984e7466', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:47:22.987517 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-8d84f65f-3dfd-4578-ad8b-e9e927413016 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] 10.222.0.11 "GET /compute/v2.1/servers/0698dc5b-5f47-46c4-ace8-f5e891a964a0" status: 200 len: 1218 microversion: 2.1 time: 0.086681 Nov 17 03:47:22.988086 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 1177/2163] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:47:22 2021] GET /compute/v2.1/servers/0698dc5b-5f47-46c4-ace8-f5e891a964a0 => generated 1218 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:47:24.005132 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-a0a13f27-3224-41ac-b513-7e414cc5ed9a tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:47:24.005820 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-a0a13f27-3224-41ac-b513-7e414cc5ed9a tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] [instance: 0698dc5b-5f47-46c4-ace8-f5e891a964a0] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:47:24.012711 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-a0a13f27-3224-41ac-b513-7e414cc5ed9a tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:47:24.013219 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-a0a13f27-3224-41ac-b513-7e414cc5ed9a tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:47:24.014029 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-a0a13f27-3224-41ac-b513-7e414cc5ed9a tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:47:24.014488 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-a0a13f27-3224-41ac-b513-7e414cc5ed9a tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:47:24.076404 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-a0a13f27-3224-41ac-b513-7e414cc5ed9a tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '163b2f24a72649ac8084be1cac32fa09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e123e9b86124c93a7fc2db9984e7466', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:47:24.084804 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-a0a13f27-3224-41ac-b513-7e414cc5ed9a tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] 10.222.0.11 "GET /compute/v2.1/servers/0698dc5b-5f47-46c4-ace8-f5e891a964a0" status: 200 len: 1218 microversion: 2.1 time: 0.083704 Nov 17 03:47:24.085351 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 987/2164] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:47:23 2021] GET /compute/v2.1/servers/0698dc5b-5f47-46c4-ace8-f5e891a964a0 => generated 1218 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:47:25.102033 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-4ee91052-7145-4891-96d6-1567538bc4c9 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:47:25.102596 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-4ee91052-7145-4891-96d6-1567538bc4c9 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] [instance: 0698dc5b-5f47-46c4-ace8-f5e891a964a0] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:47:25.109105 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-4ee91052-7145-4891-96d6-1567538bc4c9 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:47:25.109557 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-4ee91052-7145-4891-96d6-1567538bc4c9 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:47:25.110327 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-4ee91052-7145-4891-96d6-1567538bc4c9 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:47:25.110758 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-4ee91052-7145-4891-96d6-1567538bc4c9 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:47:25.169336 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-4ee91052-7145-4891-96d6-1567538bc4c9 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '163b2f24a72649ac8084be1cac32fa09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e123e9b86124c93a7fc2db9984e7466', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:47:25.176959 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-4ee91052-7145-4891-96d6-1567538bc4c9 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] 10.222.0.11 "GET /compute/v2.1/servers/0698dc5b-5f47-46c4-ace8-f5e891a964a0" status: 200 len: 1218 microversion: 2.1 time: 0.078815 Nov 17 03:47:25.177528 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 1178/2165] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:47:25 2021] GET /compute/v2.1/servers/0698dc5b-5f47-46c4-ace8-f5e891a964a0 => generated 1218 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:47:26.194628 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-b0491305-d16a-4062-9d8d-b373353321cf tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:47:26.195283 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-b0491305-d16a-4062-9d8d-b373353321cf tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] [instance: 0698dc5b-5f47-46c4-ace8-f5e891a964a0] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:47:26.202547 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-b0491305-d16a-4062-9d8d-b373353321cf tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:47:26.203016 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-b0491305-d16a-4062-9d8d-b373353321cf tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:47:26.203789 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-b0491305-d16a-4062-9d8d-b373353321cf tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:47:26.204215 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-b0491305-d16a-4062-9d8d-b373353321cf tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:47:26.268172 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-b0491305-d16a-4062-9d8d-b373353321cf tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '163b2f24a72649ac8084be1cac32fa09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e123e9b86124c93a7fc2db9984e7466', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:47:26.277074 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-b0491305-d16a-4062-9d8d-b373353321cf tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] 10.222.0.11 "GET /compute/v2.1/servers/0698dc5b-5f47-46c4-ace8-f5e891a964a0" status: 200 len: 1218 microversion: 2.1 time: 0.086818 Nov 17 03:47:26.277642 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 988/2166] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:47:26 2021] GET /compute/v2.1/servers/0698dc5b-5f47-46c4-ace8-f5e891a964a0 => generated 1218 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:47:27.297998 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-7f8cff14-43c4-489b-bbf8-272097d06559 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:47:27.299044 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-7f8cff14-43c4-489b-bbf8-272097d06559 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] [instance: 0698dc5b-5f47-46c4-ace8-f5e891a964a0] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:47:27.307588 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-7f8cff14-43c4-489b-bbf8-272097d06559 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:47:27.308037 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-7f8cff14-43c4-489b-bbf8-272097d06559 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:47:27.308810 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-7f8cff14-43c4-489b-bbf8-272097d06559 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:47:27.309269 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-7f8cff14-43c4-489b-bbf8-272097d06559 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:47:27.371723 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-7f8cff14-43c4-489b-bbf8-272097d06559 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '163b2f24a72649ac8084be1cac32fa09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e123e9b86124c93a7fc2db9984e7466', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:47:27.379782 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-7f8cff14-43c4-489b-bbf8-272097d06559 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] 10.222.0.11 "GET /compute/v2.1/servers/0698dc5b-5f47-46c4-ace8-f5e891a964a0" status: 200 len: 1218 microversion: 2.1 time: 0.088026 Nov 17 03:47:27.380359 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 1179/2167] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:47:27 2021] GET /compute/v2.1/servers/0698dc5b-5f47-46c4-ace8-f5e891a964a0 => generated 1218 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:47:28.397996 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-8193aaa5-2b13-46a4-ab4e-1ed84dfaeebd tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:47:28.398659 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-8193aaa5-2b13-46a4-ab4e-1ed84dfaeebd tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] [instance: 0698dc5b-5f47-46c4-ace8-f5e891a964a0] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:47:28.405538 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-8193aaa5-2b13-46a4-ab4e-1ed84dfaeebd tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:47:28.405981 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-8193aaa5-2b13-46a4-ab4e-1ed84dfaeebd tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:47:28.406747 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-8193aaa5-2b13-46a4-ab4e-1ed84dfaeebd tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:47:28.407174 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-8193aaa5-2b13-46a4-ab4e-1ed84dfaeebd tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:47:28.465917 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-8193aaa5-2b13-46a4-ab4e-1ed84dfaeebd tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '163b2f24a72649ac8084be1cac32fa09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e123e9b86124c93a7fc2db9984e7466', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:47:28.473626 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-8193aaa5-2b13-46a4-ab4e-1ed84dfaeebd tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] 10.222.0.11 "GET /compute/v2.1/servers/0698dc5b-5f47-46c4-ace8-f5e891a964a0" status: 200 len: 1218 microversion: 2.1 time: 0.079526 Nov 17 03:47:28.474183 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 989/2168] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:47:28 2021] GET /compute/v2.1/servers/0698dc5b-5f47-46c4-ace8-f5e891a964a0 => generated 1218 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:47:29.491442 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-015f3dc4-9f49-4fd3-87ec-3494bae43aed tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:47:29.492071 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-015f3dc4-9f49-4fd3-87ec-3494bae43aed tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] [instance: 0698dc5b-5f47-46c4-ace8-f5e891a964a0] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:47:29.499327 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-015f3dc4-9f49-4fd3-87ec-3494bae43aed tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:47:29.499829 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-015f3dc4-9f49-4fd3-87ec-3494bae43aed tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:47:29.500695 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-015f3dc4-9f49-4fd3-87ec-3494bae43aed tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:47:29.501252 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-015f3dc4-9f49-4fd3-87ec-3494bae43aed tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:47:29.562586 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-015f3dc4-9f49-4fd3-87ec-3494bae43aed tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '163b2f24a72649ac8084be1cac32fa09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e123e9b86124c93a7fc2db9984e7466', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:47:29.570810 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-015f3dc4-9f49-4fd3-87ec-3494bae43aed tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] 10.222.0.11 "GET /compute/v2.1/servers/0698dc5b-5f47-46c4-ace8-f5e891a964a0" status: 200 len: 1218 microversion: 2.1 time: 0.083916 Nov 17 03:47:29.571384 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 1180/2169] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:47:29 2021] GET /compute/v2.1/servers/0698dc5b-5f47-46c4-ace8-f5e891a964a0 => generated 1218 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:47:30.587643 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-51699d24-57f0-4336-a2a8-30fece8b0f6c tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:47:30.588170 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-51699d24-57f0-4336-a2a8-30fece8b0f6c tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] [instance: 0698dc5b-5f47-46c4-ace8-f5e891a964a0] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:47:30.594909 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-51699d24-57f0-4336-a2a8-30fece8b0f6c tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:47:30.595364 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-51699d24-57f0-4336-a2a8-30fece8b0f6c tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:47:30.596143 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-51699d24-57f0-4336-a2a8-30fece8b0f6c tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:47:30.596576 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-51699d24-57f0-4336-a2a8-30fece8b0f6c tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:47:30.665853 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-51699d24-57f0-4336-a2a8-30fece8b0f6c tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '163b2f24a72649ac8084be1cac32fa09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e123e9b86124c93a7fc2db9984e7466', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:47:30.678449 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-51699d24-57f0-4336-a2a8-30fece8b0f6c tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] 10.222.0.11 "GET /compute/v2.1/servers/0698dc5b-5f47-46c4-ace8-f5e891a964a0" status: 200 len: 1218 microversion: 2.1 time: 0.093950 Nov 17 03:47:30.679420 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 990/2170] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:47:30 2021] GET /compute/v2.1/servers/0698dc5b-5f47-46c4-ace8-f5e891a964a0 => generated 1218 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:47:31.704679 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-f96e6c3a-873f-4def-8dcc-2084dd8018dc tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:47:31.705713 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-f96e6c3a-873f-4def-8dcc-2084dd8018dc tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] [instance: 0698dc5b-5f47-46c4-ace8-f5e891a964a0] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:47:31.713127 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-f96e6c3a-873f-4def-8dcc-2084dd8018dc tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:47:31.713566 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-f96e6c3a-873f-4def-8dcc-2084dd8018dc tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:47:31.714337 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-f96e6c3a-873f-4def-8dcc-2084dd8018dc tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:47:31.714749 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-f96e6c3a-873f-4def-8dcc-2084dd8018dc tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:47:31.786631 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-f96e6c3a-873f-4def-8dcc-2084dd8018dc tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '163b2f24a72649ac8084be1cac32fa09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e123e9b86124c93a7fc2db9984e7466', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:47:31.794106 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-f96e6c3a-873f-4def-8dcc-2084dd8018dc tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] 10.222.0.11 "GET /compute/v2.1/servers/0698dc5b-5f47-46c4-ace8-f5e891a964a0" status: 200 len: 1218 microversion: 2.1 time: 0.095581 Nov 17 03:47:31.794675 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 1181/2171] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:47:31 2021] GET /compute/v2.1/servers/0698dc5b-5f47-46c4-ace8-f5e891a964a0 => generated 1218 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:47:32.815648 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-9368ca83-d9f8-4329-b08d-1f3f489d4282 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:47:32.816564 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-9368ca83-d9f8-4329-b08d-1f3f489d4282 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] [instance: 0698dc5b-5f47-46c4-ace8-f5e891a964a0] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:47:32.824210 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-9368ca83-d9f8-4329-b08d-1f3f489d4282 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:47:32.824703 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-9368ca83-d9f8-4329-b08d-1f3f489d4282 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:47:32.825623 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-9368ca83-d9f8-4329-b08d-1f3f489d4282 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:47:32.826095 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-9368ca83-d9f8-4329-b08d-1f3f489d4282 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:47:32.894541 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-9368ca83-d9f8-4329-b08d-1f3f489d4282 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '163b2f24a72649ac8084be1cac32fa09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e123e9b86124c93a7fc2db9984e7466', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:47:32.902072 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-9368ca83-d9f8-4329-b08d-1f3f489d4282 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] 10.222.0.11 "GET /compute/v2.1/servers/0698dc5b-5f47-46c4-ace8-f5e891a964a0" status: 200 len: 1218 microversion: 2.1 time: 0.093029 Nov 17 03:47:32.902634 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 991/2172] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:47:32 2021] GET /compute/v2.1/servers/0698dc5b-5f47-46c4-ace8-f5e891a964a0 => generated 1218 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:47:33.922853 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-7fe0301c-a4a8-4dd7-a48a-3d73beb88f8a tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:47:33.923528 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-7fe0301c-a4a8-4dd7-a48a-3d73beb88f8a tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] [instance: 0698dc5b-5f47-46c4-ace8-f5e891a964a0] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:47:33.930842 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-7fe0301c-a4a8-4dd7-a48a-3d73beb88f8a tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:47:33.931287 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-7fe0301c-a4a8-4dd7-a48a-3d73beb88f8a tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:47:33.932056 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-7fe0301c-a4a8-4dd7-a48a-3d73beb88f8a tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:47:33.932482 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-7fe0301c-a4a8-4dd7-a48a-3d73beb88f8a tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:47:33.993082 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-7fe0301c-a4a8-4dd7-a48a-3d73beb88f8a tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '163b2f24a72649ac8084be1cac32fa09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e123e9b86124c93a7fc2db9984e7466', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:47:34.000923 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-7fe0301c-a4a8-4dd7-a48a-3d73beb88f8a tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] 10.222.0.11 "GET /compute/v2.1/servers/0698dc5b-5f47-46c4-ace8-f5e891a964a0" status: 200 len: 1218 microversion: 2.1 time: 0.082014 Nov 17 03:47:34.001492 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 1182/2173] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:47:33 2021] GET /compute/v2.1/servers/0698dc5b-5f47-46c4-ace8-f5e891a964a0 => generated 1218 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:47:34.536366 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 17 03:47:34.536910 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: Wed Nov 17 03:47:34 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Nov 17 03:47:34.739271 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 17 03:47:34.739876 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: Wed Nov 17 03:47:34 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Nov 17 03:47:35.020731 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-a7abbca1-d100-4382-b693-bebcb5286022 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:47:35.021619 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-a7abbca1-d100-4382-b693-bebcb5286022 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] [instance: 0698dc5b-5f47-46c4-ace8-f5e891a964a0] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:47:35.028874 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-a7abbca1-d100-4382-b693-bebcb5286022 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:47:35.029315 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-a7abbca1-d100-4382-b693-bebcb5286022 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:47:35.030085 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-a7abbca1-d100-4382-b693-bebcb5286022 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:47:35.030513 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-a7abbca1-d100-4382-b693-bebcb5286022 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:47:35.091413 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-a7abbca1-d100-4382-b693-bebcb5286022 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '163b2f24a72649ac8084be1cac32fa09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e123e9b86124c93a7fc2db9984e7466', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:47:35.099437 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-a7abbca1-d100-4382-b693-bebcb5286022 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] 10.222.0.11 "GET /compute/v2.1/servers/0698dc5b-5f47-46c4-ace8-f5e891a964a0" status: 200 len: 1218 microversion: 2.1 time: 0.084740 Nov 17 03:47:35.100005 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 992/2174] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:47:35 2021] GET /compute/v2.1/servers/0698dc5b-5f47-46c4-ace8-f5e891a964a0 => generated 1218 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:47:36.115686 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-18d73d29-d316-410e-8109-ef4d8ecdbc5a tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:47:36.116273 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-18d73d29-d316-410e-8109-ef4d8ecdbc5a tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] [instance: 0698dc5b-5f47-46c4-ace8-f5e891a964a0] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:47:36.123032 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-18d73d29-d316-410e-8109-ef4d8ecdbc5a tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:47:36.123473 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-18d73d29-d316-410e-8109-ef4d8ecdbc5a tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:47:36.124238 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-18d73d29-d316-410e-8109-ef4d8ecdbc5a tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:47:36.124664 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-18d73d29-d316-410e-8109-ef4d8ecdbc5a tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:47:36.186608 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-18d73d29-d316-410e-8109-ef4d8ecdbc5a tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '163b2f24a72649ac8084be1cac32fa09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e123e9b86124c93a7fc2db9984e7466', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:47:36.196133 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-18d73d29-d316-410e-8109-ef4d8ecdbc5a tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] 10.222.0.11 "GET /compute/v2.1/servers/0698dc5b-5f47-46c4-ace8-f5e891a964a0" status: 200 len: 1218 microversion: 2.1 time: 0.084432 Nov 17 03:47:36.196706 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 1183/2175] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:47:36 2021] GET /compute/v2.1/servers/0698dc5b-5f47-46c4-ace8-f5e891a964a0 => generated 1218 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:47:37.213669 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-076235be-ed0e-42a3-b285-f3d999198fd0 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:47:37.214280 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-076235be-ed0e-42a3-b285-f3d999198fd0 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] [instance: 0698dc5b-5f47-46c4-ace8-f5e891a964a0] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:47:37.221055 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-076235be-ed0e-42a3-b285-f3d999198fd0 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:47:37.221504 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-076235be-ed0e-42a3-b285-f3d999198fd0 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:47:37.222271 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-076235be-ed0e-42a3-b285-f3d999198fd0 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:47:37.222676 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-076235be-ed0e-42a3-b285-f3d999198fd0 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:47:37.286288 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-076235be-ed0e-42a3-b285-f3d999198fd0 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '163b2f24a72649ac8084be1cac32fa09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e123e9b86124c93a7fc2db9984e7466', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:47:37.294177 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-076235be-ed0e-42a3-b285-f3d999198fd0 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] 10.222.0.11 "GET /compute/v2.1/servers/0698dc5b-5f47-46c4-ace8-f5e891a964a0" status: 200 len: 1218 microversion: 2.1 time: 0.084257 Nov 17 03:47:37.294748 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 993/2176] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:47:37 2021] GET /compute/v2.1/servers/0698dc5b-5f47-46c4-ace8-f5e891a964a0 => generated 1218 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:47:38.313056 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-48efd85a-a3ee-4124-b3a5-c5554242a406 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:47:38.313760 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-48efd85a-a3ee-4124-b3a5-c5554242a406 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] [instance: 0698dc5b-5f47-46c4-ace8-f5e891a964a0] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:47:38.320815 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-48efd85a-a3ee-4124-b3a5-c5554242a406 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:47:38.321269 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-48efd85a-a3ee-4124-b3a5-c5554242a406 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:47:38.322104 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-48efd85a-a3ee-4124-b3a5-c5554242a406 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:47:38.322586 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-48efd85a-a3ee-4124-b3a5-c5554242a406 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:47:38.401031 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-48efd85a-a3ee-4124-b3a5-c5554242a406 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '163b2f24a72649ac8084be1cac32fa09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e123e9b86124c93a7fc2db9984e7466', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:47:38.409341 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-48efd85a-a3ee-4124-b3a5-c5554242a406 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] 10.222.0.11 "GET /compute/v2.1/servers/0698dc5b-5f47-46c4-ace8-f5e891a964a0" status: 200 len: 1218 microversion: 2.1 time: 0.101272 Nov 17 03:47:38.409926 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 1184/2177] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:47:38 2021] GET /compute/v2.1/servers/0698dc5b-5f47-46c4-ace8-f5e891a964a0 => generated 1218 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:47:39.431957 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-819d44ab-0aec-4984-9791-e5610d5337d8 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:47:39.432551 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-819d44ab-0aec-4984-9791-e5610d5337d8 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] [instance: 0698dc5b-5f47-46c4-ace8-f5e891a964a0] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:47:39.438915 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-819d44ab-0aec-4984-9791-e5610d5337d8 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:47:39.439352 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-819d44ab-0aec-4984-9791-e5610d5337d8 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:47:39.440136 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-819d44ab-0aec-4984-9791-e5610d5337d8 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:47:39.440568 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-819d44ab-0aec-4984-9791-e5610d5337d8 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:47:39.687366 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-819d44ab-0aec-4984-9791-e5610d5337d8 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '163b2f24a72649ac8084be1cac32fa09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e123e9b86124c93a7fc2db9984e7466', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:47:39.695868 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-819d44ab-0aec-4984-9791-e5610d5337d8 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] 10.222.0.11 "GET /compute/v2.1/servers/0698dc5b-5f47-46c4-ace8-f5e891a964a0" status: 200 len: 1218 microversion: 2.1 time: 0.269398 Nov 17 03:47:39.696455 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 994/2178] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:47:39 2021] GET /compute/v2.1/servers/0698dc5b-5f47-46c4-ace8-f5e891a964a0 => generated 1218 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:47:40.716157 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-6dcbc10f-841f-433f-a0cf-b005d2acbd73 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:47:40.717188 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-6dcbc10f-841f-433f-a0cf-b005d2acbd73 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] [instance: 0698dc5b-5f47-46c4-ace8-f5e891a964a0] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:47:40.727881 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-6dcbc10f-841f-433f-a0cf-b005d2acbd73 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:47:40.728678 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-6dcbc10f-841f-433f-a0cf-b005d2acbd73 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:47:40.730123 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-6dcbc10f-841f-433f-a0cf-b005d2acbd73 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:47:40.730711 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-6dcbc10f-841f-433f-a0cf-b005d2acbd73 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:47:40.808143 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-6dcbc10f-841f-433f-a0cf-b005d2acbd73 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '163b2f24a72649ac8084be1cac32fa09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e123e9b86124c93a7fc2db9984e7466', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:47:40.819944 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-6dcbc10f-841f-433f-a0cf-b005d2acbd73 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] 10.222.0.11 "GET /compute/v2.1/servers/0698dc5b-5f47-46c4-ace8-f5e891a964a0" status: 200 len: 1218 microversion: 2.1 time: 0.109668 Nov 17 03:47:40.820807 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 1185/2179] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:47:40 2021] GET /compute/v2.1/servers/0698dc5b-5f47-46c4-ace8-f5e891a964a0 => generated 1218 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:47:41.841450 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-828ca074-0a28-47fd-a0f2-f59208794ec6 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:47:41.842373 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-828ca074-0a28-47fd-a0f2-f59208794ec6 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] [instance: 0698dc5b-5f47-46c4-ace8-f5e891a964a0] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:47:41.851285 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-828ca074-0a28-47fd-a0f2-f59208794ec6 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:47:41.851722 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-828ca074-0a28-47fd-a0f2-f59208794ec6 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:47:41.852518 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-828ca074-0a28-47fd-a0f2-f59208794ec6 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:47:41.852990 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-828ca074-0a28-47fd-a0f2-f59208794ec6 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:47:41.923196 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-828ca074-0a28-47fd-a0f2-f59208794ec6 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '163b2f24a72649ac8084be1cac32fa09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e123e9b86124c93a7fc2db9984e7466', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:47:41.931234 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-828ca074-0a28-47fd-a0f2-f59208794ec6 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] 10.222.0.11 "GET /compute/v2.1/servers/0698dc5b-5f47-46c4-ace8-f5e891a964a0" status: 200 len: 1218 microversion: 2.1 time: 0.096275 Nov 17 03:47:41.931795 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 995/2180] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:47:41 2021] GET /compute/v2.1/servers/0698dc5b-5f47-46c4-ace8-f5e891a964a0 => generated 1218 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:47:42.951865 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-7053228d-83c8-46c6-bc84-c16f1d2b1fa4 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:47:42.952963 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-7053228d-83c8-46c6-bc84-c16f1d2b1fa4 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] [instance: 0698dc5b-5f47-46c4-ace8-f5e891a964a0] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:47:42.961739 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-7053228d-83c8-46c6-bc84-c16f1d2b1fa4 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:47:42.962188 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-7053228d-83c8-46c6-bc84-c16f1d2b1fa4 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:47:42.962989 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-7053228d-83c8-46c6-bc84-c16f1d2b1fa4 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:47:42.963420 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-7053228d-83c8-46c6-bc84-c16f1d2b1fa4 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:47:43.029393 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-7053228d-83c8-46c6-bc84-c16f1d2b1fa4 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '163b2f24a72649ac8084be1cac32fa09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e123e9b86124c93a7fc2db9984e7466', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:47:43.040420 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-7053228d-83c8-46c6-bc84-c16f1d2b1fa4 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] 10.222.0.11 "GET /compute/v2.1/servers/0698dc5b-5f47-46c4-ace8-f5e891a964a0" status: 200 len: 1218 microversion: 2.1 time: 0.094310 Nov 17 03:47:43.041242 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 1186/2181] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:47:42 2021] GET /compute/v2.1/servers/0698dc5b-5f47-46c4-ace8-f5e891a964a0 => generated 1218 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:47:44.059790 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-ccde540c-54a6-4c72-8f7c-ab4c10b349f9 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:47:44.061032 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-ccde540c-54a6-4c72-8f7c-ab4c10b349f9 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] [instance: 0698dc5b-5f47-46c4-ace8-f5e891a964a0] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:47:44.067563 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-ccde540c-54a6-4c72-8f7c-ab4c10b349f9 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:47:44.068010 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-ccde540c-54a6-4c72-8f7c-ab4c10b349f9 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:47:44.068800 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-ccde540c-54a6-4c72-8f7c-ab4c10b349f9 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:47:44.069252 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-ccde540c-54a6-4c72-8f7c-ab4c10b349f9 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:47:44.129784 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-ccde540c-54a6-4c72-8f7c-ab4c10b349f9 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '163b2f24a72649ac8084be1cac32fa09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e123e9b86124c93a7fc2db9984e7466', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:47:44.137240 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-ccde540c-54a6-4c72-8f7c-ab4c10b349f9 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] 10.222.0.11 "GET /compute/v2.1/servers/0698dc5b-5f47-46c4-ace8-f5e891a964a0" status: 200 len: 1218 microversion: 2.1 time: 0.082952 Nov 17 03:47:44.137861 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 996/2182] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:47:44 2021] GET /compute/v2.1/servers/0698dc5b-5f47-46c4-ace8-f5e891a964a0 => generated 1218 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:47:45.154265 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-2db39558-78d1-491c-9bd3-aa1b0623c5ab tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:47:45.154856 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-2db39558-78d1-491c-9bd3-aa1b0623c5ab tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] [instance: 0698dc5b-5f47-46c4-ace8-f5e891a964a0] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:47:45.161842 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-2db39558-78d1-491c-9bd3-aa1b0623c5ab tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:47:45.162290 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-2db39558-78d1-491c-9bd3-aa1b0623c5ab tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:47:45.163053 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-2db39558-78d1-491c-9bd3-aa1b0623c5ab tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:47:45.163486 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-2db39558-78d1-491c-9bd3-aa1b0623c5ab tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:47:45.227619 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-2db39558-78d1-491c-9bd3-aa1b0623c5ab tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '163b2f24a72649ac8084be1cac32fa09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e123e9b86124c93a7fc2db9984e7466', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:47:45.236824 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-2db39558-78d1-491c-9bd3-aa1b0623c5ab tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] 10.222.0.11 "GET /compute/v2.1/servers/0698dc5b-5f47-46c4-ace8-f5e891a964a0" status: 200 len: 1218 microversion: 2.1 time: 0.085823 Nov 17 03:47:45.237385 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 1187/2183] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:47:45 2021] GET /compute/v2.1/servers/0698dc5b-5f47-46c4-ace8-f5e891a964a0 => generated 1218 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:47:46.253909 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-7d5e220c-a1a3-44a2-b8b5-dfdb76856e32 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:47:46.254735 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-7d5e220c-a1a3-44a2-b8b5-dfdb76856e32 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] [instance: 0698dc5b-5f47-46c4-ace8-f5e891a964a0] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:47:46.261528 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-7d5e220c-a1a3-44a2-b8b5-dfdb76856e32 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:47:46.261971 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-7d5e220c-a1a3-44a2-b8b5-dfdb76856e32 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:47:46.262784 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-7d5e220c-a1a3-44a2-b8b5-dfdb76856e32 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:47:46.263210 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-7d5e220c-a1a3-44a2-b8b5-dfdb76856e32 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:47:46.330851 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-7d5e220c-a1a3-44a2-b8b5-dfdb76856e32 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '163b2f24a72649ac8084be1cac32fa09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e123e9b86124c93a7fc2db9984e7466', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:47:46.338798 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-7d5e220c-a1a3-44a2-b8b5-dfdb76856e32 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] 10.222.0.11 "GET /compute/v2.1/servers/0698dc5b-5f47-46c4-ace8-f5e891a964a0" status: 200 len: 1218 microversion: 2.1 time: 0.088592 Nov 17 03:47:46.339360 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 997/2184] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:47:46 2021] GET /compute/v2.1/servers/0698dc5b-5f47-46c4-ace8-f5e891a964a0 => generated 1218 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:47:47.362854 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-a8516a51-86c6-4c3c-a1d9-fc21dc1d7ad0 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:47:47.363768 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-a8516a51-86c6-4c3c-a1d9-fc21dc1d7ad0 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] [instance: 0698dc5b-5f47-46c4-ace8-f5e891a964a0] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:47:47.370826 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-a8516a51-86c6-4c3c-a1d9-fc21dc1d7ad0 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:47:47.371277 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-a8516a51-86c6-4c3c-a1d9-fc21dc1d7ad0 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:47:47.372047 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-a8516a51-86c6-4c3c-a1d9-fc21dc1d7ad0 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:47:47.372481 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-a8516a51-86c6-4c3c-a1d9-fc21dc1d7ad0 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:47:47.438477 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-a8516a51-86c6-4c3c-a1d9-fc21dc1d7ad0 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '163b2f24a72649ac8084be1cac32fa09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e123e9b86124c93a7fc2db9984e7466', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:47:47.446560 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-a8516a51-86c6-4c3c-a1d9-fc21dc1d7ad0 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] 10.222.0.11 "GET /compute/v2.1/servers/0698dc5b-5f47-46c4-ace8-f5e891a964a0" status: 200 len: 1218 microversion: 2.1 time: 0.090027 Nov 17 03:47:47.447126 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 1188/2185] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:47:47 2021] GET /compute/v2.1/servers/0698dc5b-5f47-46c4-ace8-f5e891a964a0 => generated 1218 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:47:48.467829 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-fa9d6c45-c3ee-4ff7-8b24-86d20b69db9b tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:47:48.468692 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-fa9d6c45-c3ee-4ff7-8b24-86d20b69db9b tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] [instance: 0698dc5b-5f47-46c4-ace8-f5e891a964a0] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:47:48.477299 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-fa9d6c45-c3ee-4ff7-8b24-86d20b69db9b tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:47:48.477752 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-fa9d6c45-c3ee-4ff7-8b24-86d20b69db9b tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:47:48.478523 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-fa9d6c45-c3ee-4ff7-8b24-86d20b69db9b tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:47:48.478957 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-fa9d6c45-c3ee-4ff7-8b24-86d20b69db9b tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:47:48.538888 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-fa9d6c45-c3ee-4ff7-8b24-86d20b69db9b tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '163b2f24a72649ac8084be1cac32fa09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e123e9b86124c93a7fc2db9984e7466', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:47:48.546514 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-fa9d6c45-c3ee-4ff7-8b24-86d20b69db9b tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] 10.222.0.11 "GET /compute/v2.1/servers/0698dc5b-5f47-46c4-ace8-f5e891a964a0" status: 200 len: 1218 microversion: 2.1 time: 0.085028 Nov 17 03:47:48.547087 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 998/2186] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:47:48 2021] GET /compute/v2.1/servers/0698dc5b-5f47-46c4-ace8-f5e891a964a0 => generated 1218 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:47:49.569063 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-1aa9c022-975c-4733-9b44-328f05c8894e tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:47:49.569661 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-1aa9c022-975c-4733-9b44-328f05c8894e tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] [instance: 0698dc5b-5f47-46c4-ace8-f5e891a964a0] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:47:49.576627 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-1aa9c022-975c-4733-9b44-328f05c8894e tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:47:49.577114 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-1aa9c022-975c-4733-9b44-328f05c8894e tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:47:49.577917 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-1aa9c022-975c-4733-9b44-328f05c8894e tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:47:49.578361 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-1aa9c022-975c-4733-9b44-328f05c8894e tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:47:49.648637 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-1aa9c022-975c-4733-9b44-328f05c8894e tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '163b2f24a72649ac8084be1cac32fa09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e123e9b86124c93a7fc2db9984e7466', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:47:49.659907 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-1aa9c022-975c-4733-9b44-328f05c8894e tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] 10.222.0.11 "GET /compute/v2.1/servers/0698dc5b-5f47-46c4-ace8-f5e891a964a0" status: 200 len: 1218 microversion: 2.1 time: 0.096861 Nov 17 03:47:49.660688 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 1189/2187] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:47:49 2021] GET /compute/v2.1/servers/0698dc5b-5f47-46c4-ace8-f5e891a964a0 => generated 1218 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:47:50.681547 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-b5a766ad-8d3e-49f4-bce0-a2c06383ae50 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:47:50.682309 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-b5a766ad-8d3e-49f4-bce0-a2c06383ae50 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] [instance: 0698dc5b-5f47-46c4-ace8-f5e891a964a0] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:47:50.690501 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-b5a766ad-8d3e-49f4-bce0-a2c06383ae50 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:47:50.691064 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-b5a766ad-8d3e-49f4-bce0-a2c06383ae50 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:47:50.692027 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-b5a766ad-8d3e-49f4-bce0-a2c06383ae50 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:47:50.692569 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-b5a766ad-8d3e-49f4-bce0-a2c06383ae50 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:47:50.760424 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-b5a766ad-8d3e-49f4-bce0-a2c06383ae50 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '163b2f24a72649ac8084be1cac32fa09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e123e9b86124c93a7fc2db9984e7466', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:47:50.768131 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-b5a766ad-8d3e-49f4-bce0-a2c06383ae50 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] 10.222.0.11 "GET /compute/v2.1/servers/0698dc5b-5f47-46c4-ace8-f5e891a964a0" status: 200 len: 1218 microversion: 2.1 time: 0.092869 Nov 17 03:47:50.768696 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 999/2188] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:47:50 2021] GET /compute/v2.1/servers/0698dc5b-5f47-46c4-ace8-f5e891a964a0 => generated 1218 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:47:51.788746 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-c12442da-de9c-4b4a-8e20-4bc72c839b41 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:47:51.789581 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-c12442da-de9c-4b4a-8e20-4bc72c839b41 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] [instance: 0698dc5b-5f47-46c4-ace8-f5e891a964a0] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:47:51.797003 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-c12442da-de9c-4b4a-8e20-4bc72c839b41 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:47:51.797532 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-c12442da-de9c-4b4a-8e20-4bc72c839b41 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:47:51.798431 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-c12442da-de9c-4b4a-8e20-4bc72c839b41 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:47:51.798934 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-c12442da-de9c-4b4a-8e20-4bc72c839b41 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:47:51.864762 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-c12442da-de9c-4b4a-8e20-4bc72c839b41 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '163b2f24a72649ac8084be1cac32fa09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e123e9b86124c93a7fc2db9984e7466', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:47:51.872733 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-c12442da-de9c-4b4a-8e20-4bc72c839b41 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] 10.222.0.11 "GET /compute/v2.1/servers/0698dc5b-5f47-46c4-ace8-f5e891a964a0" status: 200 len: 1218 microversion: 2.1 time: 0.089866 Nov 17 03:47:51.873338 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 1190/2189] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:47:51 2021] GET /compute/v2.1/servers/0698dc5b-5f47-46c4-ace8-f5e891a964a0 => generated 1218 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:47:52.895851 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-483b403c-2086-40e3-8d5a-d3f8303dd1b2 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:47:52.896959 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-483b403c-2086-40e3-8d5a-d3f8303dd1b2 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] [instance: 0698dc5b-5f47-46c4-ace8-f5e891a964a0] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:47:52.903711 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-483b403c-2086-40e3-8d5a-d3f8303dd1b2 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:47:52.904161 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-483b403c-2086-40e3-8d5a-d3f8303dd1b2 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:47:52.904986 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-483b403c-2086-40e3-8d5a-d3f8303dd1b2 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:47:52.905417 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-483b403c-2086-40e3-8d5a-d3f8303dd1b2 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:47:52.969396 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-483b403c-2086-40e3-8d5a-d3f8303dd1b2 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '163b2f24a72649ac8084be1cac32fa09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e123e9b86124c93a7fc2db9984e7466', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:47:52.977205 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-483b403c-2086-40e3-8d5a-d3f8303dd1b2 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] 10.222.0.11 "GET /compute/v2.1/servers/0698dc5b-5f47-46c4-ace8-f5e891a964a0" status: 200 len: 1218 microversion: 2.1 time: 0.087657 Nov 17 03:47:52.977773 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 1000/2190] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:47:52 2021] GET /compute/v2.1/servers/0698dc5b-5f47-46c4-ace8-f5e891a964a0 => generated 1218 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:47:53.997343 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-391f49f4-241e-43fe-a97e-7880b792341f tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:47:53.998475 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-391f49f4-241e-43fe-a97e-7880b792341f tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] [instance: 0698dc5b-5f47-46c4-ace8-f5e891a964a0] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:47:54.007712 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-391f49f4-241e-43fe-a97e-7880b792341f tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:47:54.008172 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-391f49f4-241e-43fe-a97e-7880b792341f tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:47:54.008988 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-391f49f4-241e-43fe-a97e-7880b792341f tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:47:54.009427 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-391f49f4-241e-43fe-a97e-7880b792341f tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:47:54.069450 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-391f49f4-241e-43fe-a97e-7880b792341f tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '163b2f24a72649ac8084be1cac32fa09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e123e9b86124c93a7fc2db9984e7466', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:47:54.077052 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-391f49f4-241e-43fe-a97e-7880b792341f tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] 10.222.0.11 "GET /compute/v2.1/servers/0698dc5b-5f47-46c4-ace8-f5e891a964a0" status: 200 len: 1218 microversion: 2.1 time: 0.085852 Nov 17 03:47:54.077626 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 1191/2191] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:47:53 2021] GET /compute/v2.1/servers/0698dc5b-5f47-46c4-ace8-f5e891a964a0 => generated 1218 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:47:55.098259 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-73852b54-59d3-4f6a-b1d1-abe77038f6a5 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:47:55.099319 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-73852b54-59d3-4f6a-b1d1-abe77038f6a5 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] [instance: 0698dc5b-5f47-46c4-ace8-f5e891a964a0] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:47:55.110412 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-73852b54-59d3-4f6a-b1d1-abe77038f6a5 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:47:55.111175 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-73852b54-59d3-4f6a-b1d1-abe77038f6a5 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:47:55.112451 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-73852b54-59d3-4f6a-b1d1-abe77038f6a5 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:47:55.113215 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-73852b54-59d3-4f6a-b1d1-abe77038f6a5 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:47:55.179235 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-73852b54-59d3-4f6a-b1d1-abe77038f6a5 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '163b2f24a72649ac8084be1cac32fa09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e123e9b86124c93a7fc2db9984e7466', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:47:55.187172 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-73852b54-59d3-4f6a-b1d1-abe77038f6a5 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] 10.222.0.11 "GET /compute/v2.1/servers/0698dc5b-5f47-46c4-ace8-f5e891a964a0" status: 200 len: 1218 microversion: 2.1 time: 0.095228 Nov 17 03:47:55.187733 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 1001/2192] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:47:55 2021] GET /compute/v2.1/servers/0698dc5b-5f47-46c4-ace8-f5e891a964a0 => generated 1218 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:47:56.204039 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-c9e21ec6-5442-4fc4-80c4-4179c1cae3af tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:47:56.204661 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-c9e21ec6-5442-4fc4-80c4-4179c1cae3af tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] [instance: 0698dc5b-5f47-46c4-ace8-f5e891a964a0] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:47:56.211296 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-c9e21ec6-5442-4fc4-80c4-4179c1cae3af tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:47:56.211751 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-c9e21ec6-5442-4fc4-80c4-4179c1cae3af tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:47:56.212524 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-c9e21ec6-5442-4fc4-80c4-4179c1cae3af tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:47:56.212996 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-c9e21ec6-5442-4fc4-80c4-4179c1cae3af tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:47:56.277217 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-c9e21ec6-5442-4fc4-80c4-4179c1cae3af tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '163b2f24a72649ac8084be1cac32fa09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e123e9b86124c93a7fc2db9984e7466', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:47:56.285066 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-c9e21ec6-5442-4fc4-80c4-4179c1cae3af tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] 10.222.0.11 "GET /compute/v2.1/servers/0698dc5b-5f47-46c4-ace8-f5e891a964a0" status: 200 len: 1218 microversion: 2.1 time: 0.084744 Nov 17 03:47:56.285676 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 1192/2193] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:47:56 2021] GET /compute/v2.1/servers/0698dc5b-5f47-46c4-ace8-f5e891a964a0 => generated 1218 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:47:57.306621 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-a357cad8-5475-481d-8186-cf376277991f tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:47:57.307585 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-a357cad8-5475-481d-8186-cf376277991f tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] [instance: 0698dc5b-5f47-46c4-ace8-f5e891a964a0] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:47:57.319135 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-a357cad8-5475-481d-8186-cf376277991f tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:47:57.319379 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-a357cad8-5475-481d-8186-cf376277991f tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:47:57.320162 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-a357cad8-5475-481d-8186-cf376277991f tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:47:57.321096 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-a357cad8-5475-481d-8186-cf376277991f tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:47:57.391056 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-a357cad8-5475-481d-8186-cf376277991f tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '163b2f24a72649ac8084be1cac32fa09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e123e9b86124c93a7fc2db9984e7466', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:47:57.399416 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-a357cad8-5475-481d-8186-cf376277991f tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] 10.222.0.11 "GET /compute/v2.1/servers/0698dc5b-5f47-46c4-ace8-f5e891a964a0" status: 200 len: 1218 microversion: 2.1 time: 0.099635 Nov 17 03:47:57.399984 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 1002/2194] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:47:57 2021] GET /compute/v2.1/servers/0698dc5b-5f47-46c4-ace8-f5e891a964a0 => generated 1218 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:47:58.425784 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-784b1cf3-0f3e-4d7e-9292-0fb5d9cd62c3 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:47:58.426670 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-784b1cf3-0f3e-4d7e-9292-0fb5d9cd62c3 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] [instance: 0698dc5b-5f47-46c4-ace8-f5e891a964a0] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:47:58.434842 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-784b1cf3-0f3e-4d7e-9292-0fb5d9cd62c3 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:47:58.435290 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-784b1cf3-0f3e-4d7e-9292-0fb5d9cd62c3 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:47:58.436055 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-784b1cf3-0f3e-4d7e-9292-0fb5d9cd62c3 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:47:58.436492 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-784b1cf3-0f3e-4d7e-9292-0fb5d9cd62c3 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:47:58.499590 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-784b1cf3-0f3e-4d7e-9292-0fb5d9cd62c3 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '163b2f24a72649ac8084be1cac32fa09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e123e9b86124c93a7fc2db9984e7466', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:47:58.509605 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-784b1cf3-0f3e-4d7e-9292-0fb5d9cd62c3 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] 10.222.0.11 "GET /compute/v2.1/servers/0698dc5b-5f47-46c4-ace8-f5e891a964a0" status: 200 len: 1218 microversion: 2.1 time: 0.090541 Nov 17 03:47:58.510156 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 1193/2195] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:47:58 2021] GET /compute/v2.1/servers/0698dc5b-5f47-46c4-ace8-f5e891a964a0 => generated 1218 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:47:59.526723 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-f75a684b-145c-4f54-9cc6-d85706d171ff tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:47:59.527353 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-f75a684b-145c-4f54-9cc6-d85706d171ff tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] [instance: 0698dc5b-5f47-46c4-ace8-f5e891a964a0] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:47:59.534079 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-f75a684b-145c-4f54-9cc6-d85706d171ff tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:47:59.534525 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-f75a684b-145c-4f54-9cc6-d85706d171ff tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:47:59.535295 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-f75a684b-145c-4f54-9cc6-d85706d171ff tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:47:59.535730 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-f75a684b-145c-4f54-9cc6-d85706d171ff tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:47:59.598363 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-f75a684b-145c-4f54-9cc6-d85706d171ff tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '163b2f24a72649ac8084be1cac32fa09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e123e9b86124c93a7fc2db9984e7466', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:47:59.610570 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-f75a684b-145c-4f54-9cc6-d85706d171ff tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] 10.222.0.11 "GET /compute/v2.1/servers/0698dc5b-5f47-46c4-ace8-f5e891a964a0" status: 200 len: 1218 microversion: 2.1 time: 0.087290 Nov 17 03:47:59.611332 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 1003/2196] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:47:59 2021] GET /compute/v2.1/servers/0698dc5b-5f47-46c4-ace8-f5e891a964a0 => generated 1218 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:48:00.633375 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-b75a0ecd-c3c6-499e-9972-07d9f8819dd5 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:48:00.634366 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-b75a0ecd-c3c6-499e-9972-07d9f8819dd5 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] [instance: 0698dc5b-5f47-46c4-ace8-f5e891a964a0] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:48:00.644999 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-b75a0ecd-c3c6-499e-9972-07d9f8819dd5 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:48:00.645728 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-b75a0ecd-c3c6-499e-9972-07d9f8819dd5 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:48:00.647171 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-b75a0ecd-c3c6-499e-9972-07d9f8819dd5 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:48:00.647567 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-b75a0ecd-c3c6-499e-9972-07d9f8819dd5 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:48:00.712686 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-b75a0ecd-c3c6-499e-9972-07d9f8819dd5 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '163b2f24a72649ac8084be1cac32fa09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e123e9b86124c93a7fc2db9984e7466', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:48:00.723806 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-b75a0ecd-c3c6-499e-9972-07d9f8819dd5 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] 10.222.0.11 "GET /compute/v2.1/servers/0698dc5b-5f47-46c4-ace8-f5e891a964a0" status: 200 len: 1218 microversion: 2.1 time: 0.096706 Nov 17 03:48:00.724492 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 1194/2197] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:48:00 2021] GET /compute/v2.1/servers/0698dc5b-5f47-46c4-ace8-f5e891a964a0 => generated 1218 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:48:01.741156 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-4f13501e-6077-4576-ab81-8afa1f573b62 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:48:01.741783 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-4f13501e-6077-4576-ab81-8afa1f573b62 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] [instance: 0698dc5b-5f47-46c4-ace8-f5e891a964a0] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:48:01.748359 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-4f13501e-6077-4576-ab81-8afa1f573b62 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:48:01.748809 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-4f13501e-6077-4576-ab81-8afa1f573b62 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:48:01.749604 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-4f13501e-6077-4576-ab81-8afa1f573b62 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:48:01.750026 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-4f13501e-6077-4576-ab81-8afa1f573b62 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:48:01.818376 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-4f13501e-6077-4576-ab81-8afa1f573b62 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '163b2f24a72649ac8084be1cac32fa09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e123e9b86124c93a7fc2db9984e7466', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:48:01.826093 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-4f13501e-6077-4576-ab81-8afa1f573b62 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] 10.222.0.11 "GET /compute/v2.1/servers/0698dc5b-5f47-46c4-ace8-f5e891a964a0" status: 200 len: 1218 microversion: 2.1 time: 0.088630 Nov 17 03:48:01.826651 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 1004/2198] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:48:01 2021] GET /compute/v2.1/servers/0698dc5b-5f47-46c4-ace8-f5e891a964a0 => generated 1218 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:48:02.846780 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-82bb1f65-9723-42fe-bd3b-b16be9863c8e tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:48:02.847800 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-82bb1f65-9723-42fe-bd3b-b16be9863c8e tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] [instance: 0698dc5b-5f47-46c4-ace8-f5e891a964a0] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:48:02.858584 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-82bb1f65-9723-42fe-bd3b-b16be9863c8e tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:48:02.859334 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-82bb1f65-9723-42fe-bd3b-b16be9863c8e tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:48:02.860621 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-82bb1f65-9723-42fe-bd3b-b16be9863c8e tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:48:02.861399 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-82bb1f65-9723-42fe-bd3b-b16be9863c8e tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:48:02.923751 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-82bb1f65-9723-42fe-bd3b-b16be9863c8e tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '163b2f24a72649ac8084be1cac32fa09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e123e9b86124c93a7fc2db9984e7466', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:48:02.931814 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-82bb1f65-9723-42fe-bd3b-b16be9863c8e tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] 10.222.0.11 "GET /compute/v2.1/servers/0698dc5b-5f47-46c4-ace8-f5e891a964a0" status: 200 len: 1218 microversion: 2.1 time: 0.091202 Nov 17 03:48:02.932377 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 1195/2199] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:48:02 2021] GET /compute/v2.1/servers/0698dc5b-5f47-46c4-ace8-f5e891a964a0 => generated 1218 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:48:03.949506 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-cc311b33-ee60-4e4e-bb9f-030b7e4ec28e tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:48:03.950130 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-cc311b33-ee60-4e4e-bb9f-030b7e4ec28e tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] [instance: 0698dc5b-5f47-46c4-ace8-f5e891a964a0] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:48:03.957710 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-cc311b33-ee60-4e4e-bb9f-030b7e4ec28e tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:48:03.958205 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-cc311b33-ee60-4e4e-bb9f-030b7e4ec28e tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:48:03.959099 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-cc311b33-ee60-4e4e-bb9f-030b7e4ec28e tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:48:03.959600 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-cc311b33-ee60-4e4e-bb9f-030b7e4ec28e tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:48:04.021802 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-cc311b33-ee60-4e4e-bb9f-030b7e4ec28e tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '163b2f24a72649ac8084be1cac32fa09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e123e9b86124c93a7fc2db9984e7466', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:48:04.029934 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-cc311b33-ee60-4e4e-bb9f-030b7e4ec28e tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] 10.222.0.11 "GET /compute/v2.1/servers/0698dc5b-5f47-46c4-ace8-f5e891a964a0" status: 200 len: 1218 microversion: 2.1 time: 0.085403 Nov 17 03:48:04.030509 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 1005/2200] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:48:03 2021] GET /compute/v2.1/servers/0698dc5b-5f47-46c4-ace8-f5e891a964a0 => generated 1218 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:48:05.050789 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-48a08abc-3630-407b-b93d-457ab544faed tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:48:05.051745 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-48a08abc-3630-407b-b93d-457ab544faed tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] [instance: 0698dc5b-5f47-46c4-ace8-f5e891a964a0] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:48:05.059939 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-48a08abc-3630-407b-b93d-457ab544faed tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:48:05.060406 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-48a08abc-3630-407b-b93d-457ab544faed tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:48:05.061212 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-48a08abc-3630-407b-b93d-457ab544faed tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:48:05.061640 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-48a08abc-3630-407b-b93d-457ab544faed tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:48:05.134430 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-48a08abc-3630-407b-b93d-457ab544faed tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '163b2f24a72649ac8084be1cac32fa09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e123e9b86124c93a7fc2db9984e7466', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:48:05.142375 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-48a08abc-3630-407b-b93d-457ab544faed tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] 10.222.0.11 "GET /compute/v2.1/servers/0698dc5b-5f47-46c4-ace8-f5e891a964a0" status: 200 len: 1218 microversion: 2.1 time: 0.097721 Nov 17 03:48:05.142921 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 1196/2201] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:48:05 2021] GET /compute/v2.1/servers/0698dc5b-5f47-46c4-ace8-f5e891a964a0 => generated 1218 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:48:06.162779 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-a65a9c58-01b3-4058-aba0-258a8604f653 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:48:06.163728 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-a65a9c58-01b3-4058-aba0-258a8604f653 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] [instance: 0698dc5b-5f47-46c4-ace8-f5e891a964a0] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:48:06.170678 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-a65a9c58-01b3-4058-aba0-258a8604f653 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:48:06.171120 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-a65a9c58-01b3-4058-aba0-258a8604f653 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:48:06.171883 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-a65a9c58-01b3-4058-aba0-258a8604f653 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:48:06.172309 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-a65a9c58-01b3-4058-aba0-258a8604f653 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:48:06.243649 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-a65a9c58-01b3-4058-aba0-258a8604f653 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '163b2f24a72649ac8084be1cac32fa09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e123e9b86124c93a7fc2db9984e7466', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:48:06.251645 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-a65a9c58-01b3-4058-aba0-258a8604f653 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] 10.222.0.11 "GET /compute/v2.1/servers/0698dc5b-5f47-46c4-ace8-f5e891a964a0" status: 200 len: 1218 microversion: 2.1 time: 0.095005 Nov 17 03:48:06.252216 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 1006/2202] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:48:06 2021] GET /compute/v2.1/servers/0698dc5b-5f47-46c4-ace8-f5e891a964a0 => generated 1218 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:48:07.273227 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-b524700b-ea05-4a93-9c3d-029bee22bd17 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:48:07.274444 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-b524700b-ea05-4a93-9c3d-029bee22bd17 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] [instance: 0698dc5b-5f47-46c4-ace8-f5e891a964a0] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:48:07.282135 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-b524700b-ea05-4a93-9c3d-029bee22bd17 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:48:07.282680 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-b524700b-ea05-4a93-9c3d-029bee22bd17 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:48:07.283592 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-b524700b-ea05-4a93-9c3d-029bee22bd17 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:48:07.284107 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-b524700b-ea05-4a93-9c3d-029bee22bd17 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:48:07.352525 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-b524700b-ea05-4a93-9c3d-029bee22bd17 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '163b2f24a72649ac8084be1cac32fa09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e123e9b86124c93a7fc2db9984e7466', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:48:07.360434 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-b524700b-ea05-4a93-9c3d-029bee22bd17 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] 10.222.0.11 "GET /compute/v2.1/servers/0698dc5b-5f47-46c4-ace8-f5e891a964a0" status: 200 len: 1218 microversion: 2.1 time: 0.093537 Nov 17 03:48:07.361007 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 1197/2203] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:48:07 2021] GET /compute/v2.1/servers/0698dc5b-5f47-46c4-ace8-f5e891a964a0 => generated 1218 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:48:08.382197 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-02aa4492-2230-4f3a-a2d0-8f1319301c3a tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:48:08.383576 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-02aa4492-2230-4f3a-a2d0-8f1319301c3a tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] [instance: 0698dc5b-5f47-46c4-ace8-f5e891a964a0] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:48:08.390832 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-02aa4492-2230-4f3a-a2d0-8f1319301c3a tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:48:08.391310 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-02aa4492-2230-4f3a-a2d0-8f1319301c3a tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:48:08.392123 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-02aa4492-2230-4f3a-a2d0-8f1319301c3a tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:48:08.392585 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-02aa4492-2230-4f3a-a2d0-8f1319301c3a tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:48:08.455254 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-02aa4492-2230-4f3a-a2d0-8f1319301c3a tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '163b2f24a72649ac8084be1cac32fa09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e123e9b86124c93a7fc2db9984e7466', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:48:08.462998 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-02aa4492-2230-4f3a-a2d0-8f1319301c3a tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] 10.222.0.11 "GET /compute/v2.1/servers/0698dc5b-5f47-46c4-ace8-f5e891a964a0" status: 200 len: 1218 microversion: 2.1 time: 0.087188 Nov 17 03:48:08.463562 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 1007/2204] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:48:08 2021] GET /compute/v2.1/servers/0698dc5b-5f47-46c4-ace8-f5e891a964a0 => generated 1218 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:48:09.484378 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-0fd1c981-c9eb-4dcb-ad6f-bbadab8cae29 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:48:09.485162 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-0fd1c981-c9eb-4dcb-ad6f-bbadab8cae29 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] [instance: 0698dc5b-5f47-46c4-ace8-f5e891a964a0] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:48:09.494690 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-0fd1c981-c9eb-4dcb-ad6f-bbadab8cae29 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:48:09.495141 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-0fd1c981-c9eb-4dcb-ad6f-bbadab8cae29 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:48:09.495898 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-0fd1c981-c9eb-4dcb-ad6f-bbadab8cae29 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:48:09.496327 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-0fd1c981-c9eb-4dcb-ad6f-bbadab8cae29 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:48:09.564248 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-0fd1c981-c9eb-4dcb-ad6f-bbadab8cae29 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '163b2f24a72649ac8084be1cac32fa09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e123e9b86124c93a7fc2db9984e7466', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:48:09.575738 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-0fd1c981-c9eb-4dcb-ad6f-bbadab8cae29 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] 10.222.0.11 "GET /compute/v2.1/servers/0698dc5b-5f47-46c4-ace8-f5e891a964a0" status: 200 len: 1218 microversion: 2.1 time: 0.097564 Nov 17 03:48:09.576555 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 1198/2205] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:48:09 2021] GET /compute/v2.1/servers/0698dc5b-5f47-46c4-ace8-f5e891a964a0 => generated 1218 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:48:10.600666 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-b3c49426-90ff-4e58-a300-cac71ce275e6 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:48:10.601820 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-b3c49426-90ff-4e58-a300-cac71ce275e6 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] [instance: 0698dc5b-5f47-46c4-ace8-f5e891a964a0] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:48:10.608347 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-b3c49426-90ff-4e58-a300-cac71ce275e6 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:48:10.608803 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-b3c49426-90ff-4e58-a300-cac71ce275e6 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:48:10.609675 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-b3c49426-90ff-4e58-a300-cac71ce275e6 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:48:10.610100 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-b3c49426-90ff-4e58-a300-cac71ce275e6 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:48:10.679006 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-b3c49426-90ff-4e58-a300-cac71ce275e6 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '163b2f24a72649ac8084be1cac32fa09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e123e9b86124c93a7fc2db9984e7466', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:48:10.690798 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-b3c49426-90ff-4e58-a300-cac71ce275e6 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] 10.222.0.11 "GET /compute/v2.1/servers/0698dc5b-5f47-46c4-ace8-f5e891a964a0" status: 200 len: 1218 microversion: 2.1 time: 0.096446 Nov 17 03:48:10.691545 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 1008/2206] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:48:10 2021] GET /compute/v2.1/servers/0698dc5b-5f47-46c4-ace8-f5e891a964a0 => generated 1218 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:48:11.714244 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-40db2543-a154-4c8e-9760-b2e1c15fef69 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:48:11.715193 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-40db2543-a154-4c8e-9760-b2e1c15fef69 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] [instance: 0698dc5b-5f47-46c4-ace8-f5e891a964a0] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:48:11.721700 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-40db2543-a154-4c8e-9760-b2e1c15fef69 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:48:11.722143 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-40db2543-a154-4c8e-9760-b2e1c15fef69 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:48:11.722909 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-40db2543-a154-4c8e-9760-b2e1c15fef69 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:48:11.723341 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-40db2543-a154-4c8e-9760-b2e1c15fef69 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:48:11.792620 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-40db2543-a154-4c8e-9760-b2e1c15fef69 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '163b2f24a72649ac8084be1cac32fa09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e123e9b86124c93a7fc2db9984e7466', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:48:11.801280 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-40db2543-a154-4c8e-9760-b2e1c15fef69 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] 10.222.0.11 "GET /compute/v2.1/servers/0698dc5b-5f47-46c4-ace8-f5e891a964a0" status: 200 len: 1218 microversion: 2.1 time: 0.093830 Nov 17 03:48:11.801855 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 1199/2207] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:48:11 2021] GET /compute/v2.1/servers/0698dc5b-5f47-46c4-ace8-f5e891a964a0 => generated 1218 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:48:12.823959 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-8a211bc9-1a1c-4c17-9f21-500de839f1e0 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:48:12.824552 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-8a211bc9-1a1c-4c17-9f21-500de839f1e0 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] [instance: 0698dc5b-5f47-46c4-ace8-f5e891a964a0] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:48:12.831097 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-8a211bc9-1a1c-4c17-9f21-500de839f1e0 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:48:12.831548 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-8a211bc9-1a1c-4c17-9f21-500de839f1e0 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:48:12.832324 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-8a211bc9-1a1c-4c17-9f21-500de839f1e0 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:48:12.832825 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-8a211bc9-1a1c-4c17-9f21-500de839f1e0 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:48:12.899790 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-8a211bc9-1a1c-4c17-9f21-500de839f1e0 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '163b2f24a72649ac8084be1cac32fa09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e123e9b86124c93a7fc2db9984e7466', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:48:12.908030 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-8a211bc9-1a1c-4c17-9f21-500de839f1e0 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] 10.222.0.11 "GET /compute/v2.1/servers/0698dc5b-5f47-46c4-ace8-f5e891a964a0" status: 200 len: 1218 microversion: 2.1 time: 0.089503 Nov 17 03:48:12.908600 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 1009/2208] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:48:12 2021] GET /compute/v2.1/servers/0698dc5b-5f47-46c4-ace8-f5e891a964a0 => generated 1218 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:48:13.925728 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-07682beb-b145-4118-8ff1-2d5ec135ccaa tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:48:13.926357 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-07682beb-b145-4118-8ff1-2d5ec135ccaa tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] [instance: 0698dc5b-5f47-46c4-ace8-f5e891a964a0] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:48:13.933931 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-07682beb-b145-4118-8ff1-2d5ec135ccaa tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:48:13.934405 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-07682beb-b145-4118-8ff1-2d5ec135ccaa tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:48:13.935175 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-07682beb-b145-4118-8ff1-2d5ec135ccaa tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:48:13.935600 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-07682beb-b145-4118-8ff1-2d5ec135ccaa tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:48:13.996794 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-07682beb-b145-4118-8ff1-2d5ec135ccaa tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '163b2f24a72649ac8084be1cac32fa09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e123e9b86124c93a7fc2db9984e7466', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:48:14.004380 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-07682beb-b145-4118-8ff1-2d5ec135ccaa tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] 10.222.0.11 "GET /compute/v2.1/servers/0698dc5b-5f47-46c4-ace8-f5e891a964a0" status: 200 len: 1218 microversion: 2.1 time: 0.082400 Nov 17 03:48:14.004981 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 1200/2209] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:48:13 2021] GET /compute/v2.1/servers/0698dc5b-5f47-46c4-ace8-f5e891a964a0 => generated 1218 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:48:15.025085 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-588c69c7-5cf4-444c-ab69-778361cb68b2 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:48:15.026296 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-588c69c7-5cf4-444c-ab69-778361cb68b2 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] [instance: 0698dc5b-5f47-46c4-ace8-f5e891a964a0] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:48:15.037021 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-588c69c7-5cf4-444c-ab69-778361cb68b2 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:48:15.037775 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-588c69c7-5cf4-444c-ab69-778361cb68b2 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:48:15.039062 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-588c69c7-5cf4-444c-ab69-778361cb68b2 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:48:15.039788 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-588c69c7-5cf4-444c-ab69-778361cb68b2 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:48:15.101679 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-588c69c7-5cf4-444c-ab69-778361cb68b2 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '163b2f24a72649ac8084be1cac32fa09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e123e9b86124c93a7fc2db9984e7466', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:48:15.109420 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-588c69c7-5cf4-444c-ab69-778361cb68b2 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] 10.222.0.11 "GET /compute/v2.1/servers/0698dc5b-5f47-46c4-ace8-f5e891a964a0" status: 200 len: 1218 microversion: 2.1 time: 0.090573 Nov 17 03:48:15.109993 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 1010/2210] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:48:15 2021] GET /compute/v2.1/servers/0698dc5b-5f47-46c4-ace8-f5e891a964a0 => generated 1218 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:48:16.126675 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-8c6771c0-4562-4786-9798-9b472af7ff0f tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:48:16.127287 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-8c6771c0-4562-4786-9798-9b472af7ff0f tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] [instance: 0698dc5b-5f47-46c4-ace8-f5e891a964a0] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:48:16.134006 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-8c6771c0-4562-4786-9798-9b472af7ff0f tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:48:16.134455 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-8c6771c0-4562-4786-9798-9b472af7ff0f tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:48:16.135205 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-8c6771c0-4562-4786-9798-9b472af7ff0f tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:48:16.135671 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-8c6771c0-4562-4786-9798-9b472af7ff0f tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:48:16.202558 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-8c6771c0-4562-4786-9798-9b472af7ff0f tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '163b2f24a72649ac8084be1cac32fa09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e123e9b86124c93a7fc2db9984e7466', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:48:16.215157 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-8c6771c0-4562-4786-9798-9b472af7ff0f tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] 10.222.0.11 "GET /compute/v2.1/servers/0698dc5b-5f47-46c4-ace8-f5e891a964a0" status: 200 len: 1218 microversion: 2.1 time: 0.092176 Nov 17 03:48:16.215765 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 1201/2211] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:48:16 2021] GET /compute/v2.1/servers/0698dc5b-5f47-46c4-ace8-f5e891a964a0 => generated 1218 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:48:17.237489 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-bc910298-886a-4b91-9e99-1b2aa8c73be3 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:48:17.238531 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-bc910298-886a-4b91-9e99-1b2aa8c73be3 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] [instance: 0698dc5b-5f47-46c4-ace8-f5e891a964a0] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:48:17.249186 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-bc910298-886a-4b91-9e99-1b2aa8c73be3 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:48:17.249916 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-bc910298-886a-4b91-9e99-1b2aa8c73be3 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:48:17.251169 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-bc910298-886a-4b91-9e99-1b2aa8c73be3 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:48:17.251873 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-bc910298-886a-4b91-9e99-1b2aa8c73be3 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:48:17.317627 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-bc910298-886a-4b91-9e99-1b2aa8c73be3 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '163b2f24a72649ac8084be1cac32fa09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e123e9b86124c93a7fc2db9984e7466', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:48:17.325415 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-bc910298-886a-4b91-9e99-1b2aa8c73be3 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] 10.222.0.11 "GET /compute/v2.1/servers/0698dc5b-5f47-46c4-ace8-f5e891a964a0" status: 200 len: 1218 microversion: 2.1 time: 0.094182 Nov 17 03:48:17.325977 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 1011/2212] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:48:17 2021] GET /compute/v2.1/servers/0698dc5b-5f47-46c4-ace8-f5e891a964a0 => generated 1218 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:48:18.350595 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-bef51f88-38e6-4fde-9e73-2999340c92fc tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:48:18.351541 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-bef51f88-38e6-4fde-9e73-2999340c92fc tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] [instance: 0698dc5b-5f47-46c4-ace8-f5e891a964a0] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:48:18.362647 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-bef51f88-38e6-4fde-9e73-2999340c92fc tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:48:18.363391 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-bef51f88-38e6-4fde-9e73-2999340c92fc tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:48:18.364673 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-bef51f88-38e6-4fde-9e73-2999340c92fc tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:48:18.365453 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-bef51f88-38e6-4fde-9e73-2999340c92fc tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:48:18.445973 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-bef51f88-38e6-4fde-9e73-2999340c92fc tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '163b2f24a72649ac8084be1cac32fa09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e123e9b86124c93a7fc2db9984e7466', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:48:18.454192 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-bef51f88-38e6-4fde-9e73-2999340c92fc tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] 10.222.0.11 "GET /compute/v2.1/servers/0698dc5b-5f47-46c4-ace8-f5e891a964a0" status: 200 len: 1218 microversion: 2.1 time: 0.109854 Nov 17 03:48:18.454757 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 1202/2213] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:48:18 2021] GET /compute/v2.1/servers/0698dc5b-5f47-46c4-ace8-f5e891a964a0 => generated 1218 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:48:19.470886 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-80f394e8-571d-447a-8038-e234565a78ae tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:48:19.471457 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-80f394e8-571d-447a-8038-e234565a78ae tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] [instance: 0698dc5b-5f47-46c4-ace8-f5e891a964a0] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:48:19.478743 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-80f394e8-571d-447a-8038-e234565a78ae tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:48:19.479186 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-80f394e8-571d-447a-8038-e234565a78ae tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:48:19.479951 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-80f394e8-571d-447a-8038-e234565a78ae tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:48:19.480408 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-80f394e8-571d-447a-8038-e234565a78ae tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:48:19.543853 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-80f394e8-571d-447a-8038-e234565a78ae tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '163b2f24a72649ac8084be1cac32fa09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e123e9b86124c93a7fc2db9984e7466', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:48:19.552465 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-80f394e8-571d-447a-8038-e234565a78ae tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] 10.222.0.11 "GET /compute/v2.1/servers/0698dc5b-5f47-46c4-ace8-f5e891a964a0" status: 200 len: 1218 microversion: 2.1 time: 0.085277 Nov 17 03:48:19.553603 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 1012/2214] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:48:19 2021] GET /compute/v2.1/servers/0698dc5b-5f47-46c4-ace8-f5e891a964a0 => generated 1218 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:48:20.574152 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-75f05045-48cb-45fb-acc0-6d030cb27117 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:48:20.575092 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-75f05045-48cb-45fb-acc0-6d030cb27117 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] [instance: 0698dc5b-5f47-46c4-ace8-f5e891a964a0] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:48:20.585763 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-75f05045-48cb-45fb-acc0-6d030cb27117 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:48:20.586510 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-75f05045-48cb-45fb-acc0-6d030cb27117 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:48:20.587911 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-75f05045-48cb-45fb-acc0-6d030cb27117 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:48:20.588638 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-75f05045-48cb-45fb-acc0-6d030cb27117 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:48:20.647871 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-75f05045-48cb-45fb-acc0-6d030cb27117 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '163b2f24a72649ac8084be1cac32fa09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e123e9b86124c93a7fc2db9984e7466', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:48:20.655979 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-75f05045-48cb-45fb-acc0-6d030cb27117 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] 10.222.0.11 "GET /compute/v2.1/servers/0698dc5b-5f47-46c4-ace8-f5e891a964a0" status: 200 len: 1218 microversion: 2.1 time: 0.088512 Nov 17 03:48:20.656553 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 1203/2215] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:48:20 2021] GET /compute/v2.1/servers/0698dc5b-5f47-46c4-ace8-f5e891a964a0 => generated 1218 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:48:21.676653 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-b560f310-1d36-437c-a31d-7472482cc0f9 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:48:21.677650 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-b560f310-1d36-437c-a31d-7472482cc0f9 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] [instance: 0698dc5b-5f47-46c4-ace8-f5e891a964a0] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:48:21.688135 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-b560f310-1d36-437c-a31d-7472482cc0f9 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:48:21.688900 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-b560f310-1d36-437c-a31d-7472482cc0f9 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:48:21.690185 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-b560f310-1d36-437c-a31d-7472482cc0f9 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:48:21.690892 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-b560f310-1d36-437c-a31d-7472482cc0f9 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:48:21.754486 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-b560f310-1d36-437c-a31d-7472482cc0f9 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '163b2f24a72649ac8084be1cac32fa09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e123e9b86124c93a7fc2db9984e7466', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:48:21.762293 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-b560f310-1d36-437c-a31d-7472482cc0f9 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] 10.222.0.11 "GET /compute/v2.1/servers/0698dc5b-5f47-46c4-ace8-f5e891a964a0" status: 200 len: 1218 microversion: 2.1 time: 0.091778 Nov 17 03:48:21.762858 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 1013/2216] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:48:21 2021] GET /compute/v2.1/servers/0698dc5b-5f47-46c4-ace8-f5e891a964a0 => generated 1218 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:48:22.783614 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-16d90cf1-2738-4c9d-b5b7-5ea601ca8592 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:48:22.784617 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-16d90cf1-2738-4c9d-b5b7-5ea601ca8592 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] [instance: 0698dc5b-5f47-46c4-ace8-f5e891a964a0] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:48:22.795537 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-16d90cf1-2738-4c9d-b5b7-5ea601ca8592 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:48:22.796278 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-16d90cf1-2738-4c9d-b5b7-5ea601ca8592 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:48:22.797589 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-16d90cf1-2738-4c9d-b5b7-5ea601ca8592 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:48:22.798300 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-16d90cf1-2738-4c9d-b5b7-5ea601ca8592 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:48:22.873292 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-16d90cf1-2738-4c9d-b5b7-5ea601ca8592 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '163b2f24a72649ac8084be1cac32fa09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e123e9b86124c93a7fc2db9984e7466', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:48:22.880999 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-16d90cf1-2738-4c9d-b5b7-5ea601ca8592 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] 10.222.0.11 "GET /compute/v2.1/servers/0698dc5b-5f47-46c4-ace8-f5e891a964a0" status: 200 len: 1218 microversion: 2.1 time: 0.103561 Nov 17 03:48:22.881565 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 1204/2217] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:48:22 2021] GET /compute/v2.1/servers/0698dc5b-5f47-46c4-ace8-f5e891a964a0 => generated 1218 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:48:23.902595 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-ae11e672-a4a0-41a4-8b75-eb5a969542f3 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:48:23.903692 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-ae11e672-a4a0-41a4-8b75-eb5a969542f3 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] [instance: 0698dc5b-5f47-46c4-ace8-f5e891a964a0] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:48:23.914152 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-ae11e672-a4a0-41a4-8b75-eb5a969542f3 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:48:23.914892 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-ae11e672-a4a0-41a4-8b75-eb5a969542f3 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:48:23.916146 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-ae11e672-a4a0-41a4-8b75-eb5a969542f3 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:48:23.916547 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-ae11e672-a4a0-41a4-8b75-eb5a969542f3 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:48:23.977019 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-ae11e672-a4a0-41a4-8b75-eb5a969542f3 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '163b2f24a72649ac8084be1cac32fa09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e123e9b86124c93a7fc2db9984e7466', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:48:23.984934 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-ae11e672-a4a0-41a4-8b75-eb5a969542f3 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] 10.222.0.11 "GET /compute/v2.1/servers/0698dc5b-5f47-46c4-ace8-f5e891a964a0" status: 200 len: 1218 microversion: 2.1 time: 0.089446 Nov 17 03:48:23.985490 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 1014/2218] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:48:23 2021] GET /compute/v2.1/servers/0698dc5b-5f47-46c4-ace8-f5e891a964a0 => generated 1218 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:48:25.006189 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-9b19bd2e-9234-47f5-8895-a4b119bfdfc7 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:48:25.007186 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-9b19bd2e-9234-47f5-8895-a4b119bfdfc7 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] [instance: 0698dc5b-5f47-46c4-ace8-f5e891a964a0] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:48:25.017465 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-9b19bd2e-9234-47f5-8895-a4b119bfdfc7 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:48:25.018215 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-9b19bd2e-9234-47f5-8895-a4b119bfdfc7 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:48:25.019500 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-9b19bd2e-9234-47f5-8895-a4b119bfdfc7 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:48:25.020227 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-9b19bd2e-9234-47f5-8895-a4b119bfdfc7 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:48:25.082200 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-9b19bd2e-9234-47f5-8895-a4b119bfdfc7 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '163b2f24a72649ac8084be1cac32fa09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e123e9b86124c93a7fc2db9984e7466', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:48:25.089987 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-9b19bd2e-9234-47f5-8895-a4b119bfdfc7 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] 10.222.0.11 "GET /compute/v2.1/servers/0698dc5b-5f47-46c4-ace8-f5e891a964a0" status: 200 len: 1218 microversion: 2.1 time: 0.090216 Nov 17 03:48:25.090558 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 1205/2219] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:48:24 2021] GET /compute/v2.1/servers/0698dc5b-5f47-46c4-ace8-f5e891a964a0 => generated 1218 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:48:26.107148 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-536acc9f-b099-48d8-8a25-a23a387b64ae tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:48:26.107751 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-536acc9f-b099-48d8-8a25-a23a387b64ae tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] [instance: 0698dc5b-5f47-46c4-ace8-f5e891a964a0] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:48:26.114590 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-536acc9f-b099-48d8-8a25-a23a387b64ae tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:48:26.115044 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-536acc9f-b099-48d8-8a25-a23a387b64ae tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:48:26.115844 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-536acc9f-b099-48d8-8a25-a23a387b64ae tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:48:26.116313 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-536acc9f-b099-48d8-8a25-a23a387b64ae tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:48:26.183128 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-536acc9f-b099-48d8-8a25-a23a387b64ae tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '163b2f24a72649ac8084be1cac32fa09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e123e9b86124c93a7fc2db9984e7466', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:48:26.191017 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-536acc9f-b099-48d8-8a25-a23a387b64ae tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] 10.222.0.11 "GET /compute/v2.1/servers/0698dc5b-5f47-46c4-ace8-f5e891a964a0" status: 200 len: 1218 microversion: 2.1 time: 0.087785 Nov 17 03:48:26.191584 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 1015/2220] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:48:26 2021] GET /compute/v2.1/servers/0698dc5b-5f47-46c4-ace8-f5e891a964a0 => generated 1218 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:48:27.212163 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-e9de19c7-ad3c-49d7-8eb1-d3b8b47e57d1 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:48:27.213143 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-e9de19c7-ad3c-49d7-8eb1-d3b8b47e57d1 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] [instance: 0698dc5b-5f47-46c4-ace8-f5e891a964a0] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:48:27.219918 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-e9de19c7-ad3c-49d7-8eb1-d3b8b47e57d1 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:48:27.220374 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-e9de19c7-ad3c-49d7-8eb1-d3b8b47e57d1 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:48:27.221172 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-e9de19c7-ad3c-49d7-8eb1-d3b8b47e57d1 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:48:27.221613 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-e9de19c7-ad3c-49d7-8eb1-d3b8b47e57d1 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:48:27.287997 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-e9de19c7-ad3c-49d7-8eb1-d3b8b47e57d1 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '163b2f24a72649ac8084be1cac32fa09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e123e9b86124c93a7fc2db9984e7466', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:48:27.295968 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-e9de19c7-ad3c-49d7-8eb1-d3b8b47e57d1 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] 10.222.0.11 "GET /compute/v2.1/servers/0698dc5b-5f47-46c4-ace8-f5e891a964a0" status: 200 len: 1218 microversion: 2.1 time: 0.089966 Nov 17 03:48:27.296558 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 1206/2221] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:48:27 2021] GET /compute/v2.1/servers/0698dc5b-5f47-46c4-ace8-f5e891a964a0 => generated 1218 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:48:28.316833 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-6767bd8a-3fa1-4fc0-b4f3-7b4f76c96e49 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:48:28.317661 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-6767bd8a-3fa1-4fc0-b4f3-7b4f76c96e49 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] [instance: 0698dc5b-5f47-46c4-ace8-f5e891a964a0] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:48:28.329337 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-6767bd8a-3fa1-4fc0-b4f3-7b4f76c96e49 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:48:28.330121 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-6767bd8a-3fa1-4fc0-b4f3-7b4f76c96e49 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:48:28.331405 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-6767bd8a-3fa1-4fc0-b4f3-7b4f76c96e49 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:48:28.332139 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-6767bd8a-3fa1-4fc0-b4f3-7b4f76c96e49 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:48:28.400938 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-6767bd8a-3fa1-4fc0-b4f3-7b4f76c96e49 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '163b2f24a72649ac8084be1cac32fa09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e123e9b86124c93a7fc2db9984e7466', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:48:28.408816 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-6767bd8a-3fa1-4fc0-b4f3-7b4f76c96e49 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] 10.222.0.11 "GET /compute/v2.1/servers/0698dc5b-5f47-46c4-ace8-f5e891a964a0" status: 200 len: 1218 microversion: 2.1 time: 0.098282 Nov 17 03:48:28.409409 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 1016/2222] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:48:28 2021] GET /compute/v2.1/servers/0698dc5b-5f47-46c4-ace8-f5e891a964a0 => generated 1218 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:48:29.428713 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-c525a365-3b9c-4392-9338-bfe3ef62ba82 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:48:29.429335 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-c525a365-3b9c-4392-9338-bfe3ef62ba82 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] [instance: 0698dc5b-5f47-46c4-ace8-f5e891a964a0] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:48:29.438563 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-c525a365-3b9c-4392-9338-bfe3ef62ba82 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:48:29.439167 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-c525a365-3b9c-4392-9338-bfe3ef62ba82 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:48:29.440374 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-c525a365-3b9c-4392-9338-bfe3ef62ba82 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:48:29.441105 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-c525a365-3b9c-4392-9338-bfe3ef62ba82 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:48:29.512951 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-c525a365-3b9c-4392-9338-bfe3ef62ba82 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '163b2f24a72649ac8084be1cac32fa09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e123e9b86124c93a7fc2db9984e7466', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:48:29.520595 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-c525a365-3b9c-4392-9338-bfe3ef62ba82 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] 10.222.0.11 "GET /compute/v2.1/servers/0698dc5b-5f47-46c4-ace8-f5e891a964a0" status: 200 len: 1218 microversion: 2.1 time: 0.097989 Nov 17 03:48:29.521196 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 1207/2223] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:48:29 2021] GET /compute/v2.1/servers/0698dc5b-5f47-46c4-ace8-f5e891a964a0 => generated 1218 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:48:30.539806 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-4483197b-d848-47da-85a6-18f244b172ce tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:48:30.540629 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-4483197b-d848-47da-85a6-18f244b172ce tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] [instance: 0698dc5b-5f47-46c4-ace8-f5e891a964a0] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:48:30.549632 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-4483197b-d848-47da-85a6-18f244b172ce tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:48:30.550227 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-4483197b-d848-47da-85a6-18f244b172ce tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:48:30.551251 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-4483197b-d848-47da-85a6-18f244b172ce tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:48:30.551823 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-4483197b-d848-47da-85a6-18f244b172ce tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:48:30.623254 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-4483197b-d848-47da-85a6-18f244b172ce tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '163b2f24a72649ac8084be1cac32fa09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e123e9b86124c93a7fc2db9984e7466', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:48:30.630972 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-4483197b-d848-47da-85a6-18f244b172ce tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] 10.222.0.11 "GET /compute/v2.1/servers/0698dc5b-5f47-46c4-ace8-f5e891a964a0" status: 200 len: 1218 microversion: 2.1 time: 0.096268 Nov 17 03:48:30.631535 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 1017/2224] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:48:30 2021] GET /compute/v2.1/servers/0698dc5b-5f47-46c4-ace8-f5e891a964a0 => generated 1218 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:48:31.649225 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-3ad08c0a-d2fa-45c8-80b3-814c7ef3fe7d tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:48:31.649857 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-3ad08c0a-d2fa-45c8-80b3-814c7ef3fe7d tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] [instance: 0698dc5b-5f47-46c4-ace8-f5e891a964a0] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:48:31.657209 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-3ad08c0a-d2fa-45c8-80b3-814c7ef3fe7d tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:48:31.657656 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-3ad08c0a-d2fa-45c8-80b3-814c7ef3fe7d tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:48:31.658428 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-3ad08c0a-d2fa-45c8-80b3-814c7ef3fe7d tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:48:31.658847 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-3ad08c0a-d2fa-45c8-80b3-814c7ef3fe7d tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:48:31.728536 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-3ad08c0a-d2fa-45c8-80b3-814c7ef3fe7d tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '163b2f24a72649ac8084be1cac32fa09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e123e9b86124c93a7fc2db9984e7466', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:48:31.736897 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-3ad08c0a-d2fa-45c8-80b3-814c7ef3fe7d tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] 10.222.0.11 "GET /compute/v2.1/servers/0698dc5b-5f47-46c4-ace8-f5e891a964a0" status: 200 len: 1218 microversion: 2.1 time: 0.091325 Nov 17 03:48:31.737717 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 1208/2225] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:48:31 2021] GET /compute/v2.1/servers/0698dc5b-5f47-46c4-ace8-f5e891a964a0 => generated 1218 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:48:32.754225 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-d2b6334f-7d65-4776-a64b-c3a6a4c5f48c tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:48:32.754837 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-d2b6334f-7d65-4776-a64b-c3a6a4c5f48c tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] [instance: 0698dc5b-5f47-46c4-ace8-f5e891a964a0] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:48:32.762071 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-d2b6334f-7d65-4776-a64b-c3a6a4c5f48c tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:48:32.762507 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-d2b6334f-7d65-4776-a64b-c3a6a4c5f48c tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:48:32.763271 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-d2b6334f-7d65-4776-a64b-c3a6a4c5f48c tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:48:32.763696 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-d2b6334f-7d65-4776-a64b-c3a6a4c5f48c tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:48:32.827189 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-d2b6334f-7d65-4776-a64b-c3a6a4c5f48c tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '163b2f24a72649ac8084be1cac32fa09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e123e9b86124c93a7fc2db9984e7466', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:48:32.834630 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-d2b6334f-7d65-4776-a64b-c3a6a4c5f48c tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] 10.222.0.11 "GET /compute/v2.1/servers/0698dc5b-5f47-46c4-ace8-f5e891a964a0" status: 200 len: 1218 microversion: 2.1 time: 0.084245 Nov 17 03:48:32.835192 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 1018/2226] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:48:32 2021] GET /compute/v2.1/servers/0698dc5b-5f47-46c4-ace8-f5e891a964a0 => generated 1218 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:48:33.856882 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-661cee0a-a658-4620-a9d9-9d708a4a4b0d tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:48:33.857873 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-661cee0a-a658-4620-a9d9-9d708a4a4b0d tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] [instance: 0698dc5b-5f47-46c4-ace8-f5e891a964a0] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:48:33.868485 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-661cee0a-a658-4620-a9d9-9d708a4a4b0d tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:48:33.869530 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-661cee0a-a658-4620-a9d9-9d708a4a4b0d tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:48:33.871087 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-661cee0a-a658-4620-a9d9-9d708a4a4b0d tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:48:33.871860 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-661cee0a-a658-4620-a9d9-9d708a4a4b0d tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:48:33.947317 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-661cee0a-a658-4620-a9d9-9d708a4a4b0d tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '163b2f24a72649ac8084be1cac32fa09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e123e9b86124c93a7fc2db9984e7466', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:48:33.955274 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-661cee0a-a658-4620-a9d9-9d708a4a4b0d tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] 10.222.0.11 "GET /compute/v2.1/servers/0698dc5b-5f47-46c4-ace8-f5e891a964a0" status: 200 len: 1218 microversion: 2.1 time: 0.105137 Nov 17 03:48:33.955842 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 1209/2227] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:48:33 2021] GET /compute/v2.1/servers/0698dc5b-5f47-46c4-ace8-f5e891a964a0 => generated 1218 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:48:34.975084 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-106f7b98-de56-4485-a976-76e7b30fa74b tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:48:34.975731 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-106f7b98-de56-4485-a976-76e7b30fa74b tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] [instance: 0698dc5b-5f47-46c4-ace8-f5e891a964a0] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:48:34.984535 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-106f7b98-de56-4485-a976-76e7b30fa74b tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:48:34.985102 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-106f7b98-de56-4485-a976-76e7b30fa74b tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:48:34.986000 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-106f7b98-de56-4485-a976-76e7b30fa74b tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:48:34.986499 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-106f7b98-de56-4485-a976-76e7b30fa74b tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:48:35.054355 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-106f7b98-de56-4485-a976-76e7b30fa74b tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '163b2f24a72649ac8084be1cac32fa09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e123e9b86124c93a7fc2db9984e7466', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:48:35.062696 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-106f7b98-de56-4485-a976-76e7b30fa74b tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] 10.222.0.11 "GET /compute/v2.1/servers/0698dc5b-5f47-46c4-ace8-f5e891a964a0" status: 200 len: 1218 microversion: 2.1 time: 0.093840 Nov 17 03:48:35.063264 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 1019/2228] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:48:34 2021] GET /compute/v2.1/servers/0698dc5b-5f47-46c4-ace8-f5e891a964a0 => generated 1218 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:48:36.079600 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-ec4b7f90-6626-4867-ad52-cb373cd0f187 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:48:36.080206 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-ec4b7f90-6626-4867-ad52-cb373cd0f187 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] [instance: 0698dc5b-5f47-46c4-ace8-f5e891a964a0] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:48:36.086833 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-ec4b7f90-6626-4867-ad52-cb373cd0f187 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:48:36.087281 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-ec4b7f90-6626-4867-ad52-cb373cd0f187 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:48:36.088075 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-ec4b7f90-6626-4867-ad52-cb373cd0f187 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:48:36.088523 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-ec4b7f90-6626-4867-ad52-cb373cd0f187 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:48:36.147677 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-ec4b7f90-6626-4867-ad52-cb373cd0f187 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '163b2f24a72649ac8084be1cac32fa09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e123e9b86124c93a7fc2db9984e7466', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:48:36.155351 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-ec4b7f90-6626-4867-ad52-cb373cd0f187 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] 10.222.0.11 "GET /compute/v2.1/servers/0698dc5b-5f47-46c4-ace8-f5e891a964a0" status: 200 len: 1218 microversion: 2.1 time: 0.079531 Nov 17 03:48:36.155906 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 1210/2229] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:48:36 2021] GET /compute/v2.1/servers/0698dc5b-5f47-46c4-ace8-f5e891a964a0 => generated 1218 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:48:37.176115 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-6d5799af-27df-449c-ae8a-92b8e3ebfd7a tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:48:37.177170 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-6d5799af-27df-449c-ae8a-92b8e3ebfd7a tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] [instance: 0698dc5b-5f47-46c4-ace8-f5e891a964a0] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:48:37.186178 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-6d5799af-27df-449c-ae8a-92b8e3ebfd7a tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:48:37.186633 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-6d5799af-27df-449c-ae8a-92b8e3ebfd7a tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:48:37.187387 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-6d5799af-27df-449c-ae8a-92b8e3ebfd7a tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:48:37.187812 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-6d5799af-27df-449c-ae8a-92b8e3ebfd7a tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:48:37.256913 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-6d5799af-27df-449c-ae8a-92b8e3ebfd7a tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '163b2f24a72649ac8084be1cac32fa09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e123e9b86124c93a7fc2db9984e7466', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:48:37.264539 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-6d5799af-27df-449c-ae8a-92b8e3ebfd7a tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] 10.222.0.11 "GET /compute/v2.1/servers/0698dc5b-5f47-46c4-ace8-f5e891a964a0" status: 200 len: 1218 microversion: 2.1 time: 0.094592 Nov 17 03:48:37.265139 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 1020/2230] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:48:37 2021] GET /compute/v2.1/servers/0698dc5b-5f47-46c4-ace8-f5e891a964a0 => generated 1218 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:48:38.284928 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-3328c952-5140-449c-8fe1-741ba9afd594 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:48:38.285908 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-3328c952-5140-449c-8fe1-741ba9afd594 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] [instance: 0698dc5b-5f47-46c4-ace8-f5e891a964a0] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:48:38.295678 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-3328c952-5140-449c-8fe1-741ba9afd594 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:48:38.296122 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-3328c952-5140-449c-8fe1-741ba9afd594 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:48:38.296924 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-3328c952-5140-449c-8fe1-741ba9afd594 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:48:38.297357 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-3328c952-5140-449c-8fe1-741ba9afd594 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:48:38.366467 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-3328c952-5140-449c-8fe1-741ba9afd594 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '163b2f24a72649ac8084be1cac32fa09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e123e9b86124c93a7fc2db9984e7466', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:48:38.374892 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-3328c952-5140-449c-8fe1-741ba9afd594 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] 10.222.0.11 "GET /compute/v2.1/servers/0698dc5b-5f47-46c4-ace8-f5e891a964a0" status: 200 len: 1218 microversion: 2.1 time: 0.096135 Nov 17 03:48:38.375459 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 1211/2231] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:48:38 2021] GET /compute/v2.1/servers/0698dc5b-5f47-46c4-ace8-f5e891a964a0 => generated 1218 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:48:39.398240 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-64c494b6-ec2b-4247-bc1c-6aa9b606e36c tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:48:39.398816 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-64c494b6-ec2b-4247-bc1c-6aa9b606e36c tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] [instance: 0698dc5b-5f47-46c4-ace8-f5e891a964a0] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:48:39.406974 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-64c494b6-ec2b-4247-bc1c-6aa9b606e36c tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:48:39.407725 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-64c494b6-ec2b-4247-bc1c-6aa9b606e36c tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:48:39.408520 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-64c494b6-ec2b-4247-bc1c-6aa9b606e36c tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:48:39.408992 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-64c494b6-ec2b-4247-bc1c-6aa9b606e36c tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:48:39.471198 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-64c494b6-ec2b-4247-bc1c-6aa9b606e36c tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '163b2f24a72649ac8084be1cac32fa09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e123e9b86124c93a7fc2db9984e7466', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:48:39.478858 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-64c494b6-ec2b-4247-bc1c-6aa9b606e36c tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] 10.222.0.11 "GET /compute/v2.1/servers/0698dc5b-5f47-46c4-ace8-f5e891a964a0" status: 200 len: 1218 microversion: 2.1 time: 0.086579 Nov 17 03:48:39.479427 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 1021/2232] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:48:39 2021] GET /compute/v2.1/servers/0698dc5b-5f47-46c4-ace8-f5e891a964a0 => generated 1218 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:48:40.499397 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-8a6e60d1-54af-4815-98c3-3cce76c50905 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:48:40.500037 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-8a6e60d1-54af-4815-98c3-3cce76c50905 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] [instance: 0698dc5b-5f47-46c4-ace8-f5e891a964a0] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:48:40.508361 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-8a6e60d1-54af-4815-98c3-3cce76c50905 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:48:40.508858 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-8a6e60d1-54af-4815-98c3-3cce76c50905 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:48:40.509625 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-8a6e60d1-54af-4815-98c3-3cce76c50905 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:48:40.510225 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-8a6e60d1-54af-4815-98c3-3cce76c50905 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:48:40.580409 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-8a6e60d1-54af-4815-98c3-3cce76c50905 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '163b2f24a72649ac8084be1cac32fa09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e123e9b86124c93a7fc2db9984e7466', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:48:40.587960 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-8a6e60d1-54af-4815-98c3-3cce76c50905 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] 10.222.0.11 "GET /compute/v2.1/servers/0698dc5b-5f47-46c4-ace8-f5e891a964a0" status: 200 len: 1218 microversion: 2.1 time: 0.094587 Nov 17 03:48:40.588519 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 1212/2233] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:48:40 2021] GET /compute/v2.1/servers/0698dc5b-5f47-46c4-ace8-f5e891a964a0 => generated 1218 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:48:41.609579 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-cea0a4b3-6a57-44eb-b536-1ee44ff1764c tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:48:41.610541 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-cea0a4b3-6a57-44eb-b536-1ee44ff1764c tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] [instance: 0698dc5b-5f47-46c4-ace8-f5e891a964a0] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:48:41.620434 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-cea0a4b3-6a57-44eb-b536-1ee44ff1764c tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:48:41.621224 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-cea0a4b3-6a57-44eb-b536-1ee44ff1764c tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:48:41.622474 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-cea0a4b3-6a57-44eb-b536-1ee44ff1764c tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:48:41.623133 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-cea0a4b3-6a57-44eb-b536-1ee44ff1764c tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:48:41.684920 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-cea0a4b3-6a57-44eb-b536-1ee44ff1764c tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '163b2f24a72649ac8084be1cac32fa09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e123e9b86124c93a7fc2db9984e7466', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:48:41.695256 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-cea0a4b3-6a57-44eb-b536-1ee44ff1764c tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] 10.222.0.11 "GET /compute/v2.1/servers/0698dc5b-5f47-46c4-ace8-f5e891a964a0" status: 200 len: 1218 microversion: 2.1 time: 0.092294 Nov 17 03:48:41.696020 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 1022/2234] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:48:41 2021] GET /compute/v2.1/servers/0698dc5b-5f47-46c4-ace8-f5e891a964a0 => generated 1218 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:48:42.718035 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-418b002e-80a3-4406-8e51-3f3cf3900153 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:48:42.720255 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-418b002e-80a3-4406-8e51-3f3cf3900153 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] [instance: 0698dc5b-5f47-46c4-ace8-f5e891a964a0] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:48:42.730879 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-418b002e-80a3-4406-8e51-3f3cf3900153 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:48:42.731625 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-418b002e-80a3-4406-8e51-3f3cf3900153 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:48:42.732928 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-418b002e-80a3-4406-8e51-3f3cf3900153 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:48:42.733374 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-418b002e-80a3-4406-8e51-3f3cf3900153 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:48:42.791456 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-418b002e-80a3-4406-8e51-3f3cf3900153 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '163b2f24a72649ac8084be1cac32fa09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e123e9b86124c93a7fc2db9984e7466', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:48:42.799464 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-418b002e-80a3-4406-8e51-3f3cf3900153 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] 10.222.0.11 "GET /compute/v2.1/servers/0698dc5b-5f47-46c4-ace8-f5e891a964a0" status: 200 len: 1218 microversion: 2.1 time: 0.087700 Nov 17 03:48:42.800032 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 1213/2235] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:48:42 2021] GET /compute/v2.1/servers/0698dc5b-5f47-46c4-ace8-f5e891a964a0 => generated 1218 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:48:43.820723 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-5a70de60-9e88-46d9-90d8-5baff3292f8d tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:48:43.821453 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-5a70de60-9e88-46d9-90d8-5baff3292f8d tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] [instance: 0698dc5b-5f47-46c4-ace8-f5e891a964a0] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:48:43.837917 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-5a70de60-9e88-46d9-90d8-5baff3292f8d tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:48:43.838553 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-5a70de60-9e88-46d9-90d8-5baff3292f8d tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:48:43.839800 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-5a70de60-9e88-46d9-90d8-5baff3292f8d tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:48:43.841058 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-5a70de60-9e88-46d9-90d8-5baff3292f8d tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:48:43.937766 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-5a70de60-9e88-46d9-90d8-5baff3292f8d tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '163b2f24a72649ac8084be1cac32fa09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e123e9b86124c93a7fc2db9984e7466', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:48:43.945412 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-5a70de60-9e88-46d9-90d8-5baff3292f8d tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] 10.222.0.11 "GET /compute/v2.1/servers/0698dc5b-5f47-46c4-ace8-f5e891a964a0" status: 200 len: 1218 microversion: 2.1 time: 0.131063 Nov 17 03:48:43.945968 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 1023/2236] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:48:43 2021] GET /compute/v2.1/servers/0698dc5b-5f47-46c4-ace8-f5e891a964a0 => generated 1218 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:48:44.969573 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-294de57e-4190-4cbf-a1ef-330db206573c tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:48:44.970443 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-294de57e-4190-4cbf-a1ef-330db206573c tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] [instance: 0698dc5b-5f47-46c4-ace8-f5e891a964a0] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:48:44.981171 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-294de57e-4190-4cbf-a1ef-330db206573c tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:48:44.981882 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-294de57e-4190-4cbf-a1ef-330db206573c tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:48:44.983189 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-294de57e-4190-4cbf-a1ef-330db206573c tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:48:44.984043 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-294de57e-4190-4cbf-a1ef-330db206573c tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:48:45.058148 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-294de57e-4190-4cbf-a1ef-330db206573c tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '163b2f24a72649ac8084be1cac32fa09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e123e9b86124c93a7fc2db9984e7466', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:48:45.066771 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-294de57e-4190-4cbf-a1ef-330db206573c tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] 10.222.0.11 "GET /compute/v2.1/servers/0698dc5b-5f47-46c4-ace8-f5e891a964a0" status: 200 len: 1218 microversion: 2.1 time: 0.104151 Nov 17 03:48:45.067350 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 1214/2237] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:48:44 2021] GET /compute/v2.1/servers/0698dc5b-5f47-46c4-ace8-f5e891a964a0 => generated 1218 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:48:46.083682 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-eaf033bb-13ac-4f2e-856a-7ae2b25cdac1 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:48:46.084317 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-eaf033bb-13ac-4f2e-856a-7ae2b25cdac1 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] [instance: 0698dc5b-5f47-46c4-ace8-f5e891a964a0] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:48:46.091087 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-eaf033bb-13ac-4f2e-856a-7ae2b25cdac1 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:48:46.091532 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-eaf033bb-13ac-4f2e-856a-7ae2b25cdac1 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:48:46.092293 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-eaf033bb-13ac-4f2e-856a-7ae2b25cdac1 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:48:46.092720 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-eaf033bb-13ac-4f2e-856a-7ae2b25cdac1 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:48:46.157758 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-eaf033bb-13ac-4f2e-856a-7ae2b25cdac1 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '163b2f24a72649ac8084be1cac32fa09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e123e9b86124c93a7fc2db9984e7466', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:48:46.165353 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-eaf033bb-13ac-4f2e-856a-7ae2b25cdac1 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] 10.222.0.11 "GET /compute/v2.1/servers/0698dc5b-5f47-46c4-ace8-f5e891a964a0" status: 200 len: 1218 microversion: 2.1 time: 0.085579 Nov 17 03:48:46.165940 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 1024/2238] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:48:46 2021] GET /compute/v2.1/servers/0698dc5b-5f47-46c4-ace8-f5e891a964a0 => generated 1218 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:48:47.186402 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-f3d9ca16-2eb0-459d-bcd4-8c7d98d502ac tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:48:47.187545 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-f3d9ca16-2eb0-459d-bcd4-8c7d98d502ac tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] [instance: 0698dc5b-5f47-46c4-ace8-f5e891a964a0] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:48:47.198295 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-f3d9ca16-2eb0-459d-bcd4-8c7d98d502ac tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:48:47.199047 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-f3d9ca16-2eb0-459d-bcd4-8c7d98d502ac tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:48:47.200315 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-f3d9ca16-2eb0-459d-bcd4-8c7d98d502ac tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:48:47.201104 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-f3d9ca16-2eb0-459d-bcd4-8c7d98d502ac tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:48:47.261157 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-f3d9ca16-2eb0-459d-bcd4-8c7d98d502ac tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '163b2f24a72649ac8084be1cac32fa09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e123e9b86124c93a7fc2db9984e7466', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:48:47.269194 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-f3d9ca16-2eb0-459d-bcd4-8c7d98d502ac tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] 10.222.0.11 "GET /compute/v2.1/servers/0698dc5b-5f47-46c4-ace8-f5e891a964a0" status: 200 len: 1218 microversion: 2.1 time: 0.088907 Nov 17 03:48:47.269758 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 1215/2239] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:48:47 2021] GET /compute/v2.1/servers/0698dc5b-5f47-46c4-ace8-f5e891a964a0 => generated 1218 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:48:48.289329 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-d38b3e27-bce5-4cd6-a53f-1c5e5a32d498 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:48:48.290280 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-d38b3e27-bce5-4cd6-a53f-1c5e5a32d498 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] [instance: 0698dc5b-5f47-46c4-ace8-f5e891a964a0] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:48:48.299972 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-d38b3e27-bce5-4cd6-a53f-1c5e5a32d498 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:48:48.300614 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-d38b3e27-bce5-4cd6-a53f-1c5e5a32d498 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:48:48.301941 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-d38b3e27-bce5-4cd6-a53f-1c5e5a32d498 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:48:48.302638 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-d38b3e27-bce5-4cd6-a53f-1c5e5a32d498 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:48:48.366181 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-d38b3e27-bce5-4cd6-a53f-1c5e5a32d498 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '163b2f24a72649ac8084be1cac32fa09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e123e9b86124c93a7fc2db9984e7466', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:48:48.376626 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-d38b3e27-bce5-4cd6-a53f-1c5e5a32d498 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] 10.222.0.11 "GET /compute/v2.1/servers/0698dc5b-5f47-46c4-ace8-f5e891a964a0" status: 200 len: 1218 microversion: 2.1 time: 0.093427 Nov 17 03:48:48.377254 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 1025/2240] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:48:48 2021] GET /compute/v2.1/servers/0698dc5b-5f47-46c4-ace8-f5e891a964a0 => generated 1218 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:48:49.397606 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-4c9a7be7-5093-4e48-a545-b9e63bb6a288 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:48:49.398413 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-4c9a7be7-5093-4e48-a545-b9e63bb6a288 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] [instance: 0698dc5b-5f47-46c4-ace8-f5e891a964a0] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:48:49.408836 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-4c9a7be7-5093-4e48-a545-b9e63bb6a288 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:48:49.409535 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-4c9a7be7-5093-4e48-a545-b9e63bb6a288 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:48:49.410790 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-4c9a7be7-5093-4e48-a545-b9e63bb6a288 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:48:49.411486 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-4c9a7be7-5093-4e48-a545-b9e63bb6a288 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:48:49.477572 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-4c9a7be7-5093-4e48-a545-b9e63bb6a288 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '163b2f24a72649ac8084be1cac32fa09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e123e9b86124c93a7fc2db9984e7466', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:48:49.485108 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-4c9a7be7-5093-4e48-a545-b9e63bb6a288 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] 10.222.0.11 "GET /compute/v2.1/servers/0698dc5b-5f47-46c4-ace8-f5e891a964a0" status: 200 len: 1218 microversion: 2.1 time: 0.094029 Nov 17 03:48:49.485671 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 1216/2241] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:48:49 2021] GET /compute/v2.1/servers/0698dc5b-5f47-46c4-ace8-f5e891a964a0 => generated 1218 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:48:50.506072 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-852e0d4a-6e50-4a44-9210-8d98c7318880 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:48:50.506837 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-852e0d4a-6e50-4a44-9210-8d98c7318880 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] [instance: 0698dc5b-5f47-46c4-ace8-f5e891a964a0] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:48:50.515589 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-852e0d4a-6e50-4a44-9210-8d98c7318880 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:48:50.516188 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-852e0d4a-6e50-4a44-9210-8d98c7318880 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:48:50.517312 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-852e0d4a-6e50-4a44-9210-8d98c7318880 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:48:50.517894 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-852e0d4a-6e50-4a44-9210-8d98c7318880 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:48:50.582757 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-852e0d4a-6e50-4a44-9210-8d98c7318880 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '163b2f24a72649ac8084be1cac32fa09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e123e9b86124c93a7fc2db9984e7466', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:48:50.590390 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-852e0d4a-6e50-4a44-9210-8d98c7318880 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] 10.222.0.11 "GET /compute/v2.1/servers/0698dc5b-5f47-46c4-ace8-f5e891a964a0" status: 200 len: 1218 microversion: 2.1 time: 0.090477 Nov 17 03:48:50.590948 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 1026/2242] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:48:50 2021] GET /compute/v2.1/servers/0698dc5b-5f47-46c4-ace8-f5e891a964a0 => generated 1218 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:48:51.611813 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-b5d33b7b-6b2a-4c4f-8fd6-85d9feb7116b tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:48:51.612563 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-b5d33b7b-6b2a-4c4f-8fd6-85d9feb7116b tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] [instance: 0698dc5b-5f47-46c4-ace8-f5e891a964a0] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:48:51.620105 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-b5d33b7b-6b2a-4c4f-8fd6-85d9feb7116b tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:48:51.620601 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-b5d33b7b-6b2a-4c4f-8fd6-85d9feb7116b tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:48:51.621488 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-b5d33b7b-6b2a-4c4f-8fd6-85d9feb7116b tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:48:51.621972 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-b5d33b7b-6b2a-4c4f-8fd6-85d9feb7116b tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:48:51.683514 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-b5d33b7b-6b2a-4c4f-8fd6-85d9feb7116b tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '163b2f24a72649ac8084be1cac32fa09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e123e9b86124c93a7fc2db9984e7466', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:48:51.691783 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-b5d33b7b-6b2a-4c4f-8fd6-85d9feb7116b tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] 10.222.0.11 "GET /compute/v2.1/servers/0698dc5b-5f47-46c4-ace8-f5e891a964a0" status: 200 len: 1218 microversion: 2.1 time: 0.086763 Nov 17 03:48:51.692350 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 1217/2243] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:48:51 2021] GET /compute/v2.1/servers/0698dc5b-5f47-46c4-ace8-f5e891a964a0 => generated 1218 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:48:52.712328 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-189644c6-4dd5-4e67-b946-b2266c31a9ad tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:48:52.713461 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-189644c6-4dd5-4e67-b946-b2266c31a9ad tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] [instance: 0698dc5b-5f47-46c4-ace8-f5e891a964a0] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:48:52.722771 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-189644c6-4dd5-4e67-b946-b2266c31a9ad tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:48:52.723214 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-189644c6-4dd5-4e67-b946-b2266c31a9ad tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:48:52.723988 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-189644c6-4dd5-4e67-b946-b2266c31a9ad tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:48:52.724438 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-189644c6-4dd5-4e67-b946-b2266c31a9ad tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:48:52.785169 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-189644c6-4dd5-4e67-b946-b2266c31a9ad tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '163b2f24a72649ac8084be1cac32fa09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e123e9b86124c93a7fc2db9984e7466', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:48:52.793231 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-189644c6-4dd5-4e67-b946-b2266c31a9ad tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] 10.222.0.11 "GET /compute/v2.1/servers/0698dc5b-5f47-46c4-ace8-f5e891a964a0" status: 200 len: 1218 microversion: 2.1 time: 0.086943 Nov 17 03:48:52.793796 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 1027/2244] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:48:52 2021] GET /compute/v2.1/servers/0698dc5b-5f47-46c4-ace8-f5e891a964a0 => generated 1218 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:48:53.817085 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-61e891ca-2ac7-4362-9681-1301cb8653d2 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:48:53.818039 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-61e891ca-2ac7-4362-9681-1301cb8653d2 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] [instance: 0698dc5b-5f47-46c4-ace8-f5e891a964a0] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:48:53.828316 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-61e891ca-2ac7-4362-9681-1301cb8653d2 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:48:53.829084 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-61e891ca-2ac7-4362-9681-1301cb8653d2 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:48:53.830778 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-61e891ca-2ac7-4362-9681-1301cb8653d2 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:48:53.831220 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-61e891ca-2ac7-4362-9681-1301cb8653d2 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:48:53.894624 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-61e891ca-2ac7-4362-9681-1301cb8653d2 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '163b2f24a72649ac8084be1cac32fa09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e123e9b86124c93a7fc2db9984e7466', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:48:53.904055 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-61e891ca-2ac7-4362-9681-1301cb8653d2 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] 10.222.0.11 "GET /compute/v2.1/servers/0698dc5b-5f47-46c4-ace8-f5e891a964a0" status: 200 len: 1218 microversion: 2.1 time: 0.093715 Nov 17 03:48:53.904703 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 1218/2245] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:48:53 2021] GET /compute/v2.1/servers/0698dc5b-5f47-46c4-ace8-f5e891a964a0 => generated 1218 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:48:54.929581 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-a7cc849e-8879-4ada-943b-0bdd63d74060 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:48:54.930315 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-a7cc849e-8879-4ada-943b-0bdd63d74060 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] [instance: 0698dc5b-5f47-46c4-ace8-f5e891a964a0] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:48:54.939723 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-a7cc849e-8879-4ada-943b-0bdd63d74060 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:48:54.940189 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-a7cc849e-8879-4ada-943b-0bdd63d74060 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:48:54.941008 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-a7cc849e-8879-4ada-943b-0bdd63d74060 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:48:54.941440 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-a7cc849e-8879-4ada-943b-0bdd63d74060 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:48:55.004510 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-a7cc849e-8879-4ada-943b-0bdd63d74060 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '163b2f24a72649ac8084be1cac32fa09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e123e9b86124c93a7fc2db9984e7466', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:48:55.016512 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-a7cc849e-8879-4ada-943b-0bdd63d74060 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] 10.222.0.11 "GET /compute/v2.1/servers/0698dc5b-5f47-46c4-ace8-f5e891a964a0" status: 200 len: 1218 microversion: 2.1 time: 0.092585 Nov 17 03:48:55.017258 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 1028/2246] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:48:54 2021] GET /compute/v2.1/servers/0698dc5b-5f47-46c4-ace8-f5e891a964a0 => generated 1218 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:48:56.043872 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-22211680-ace8-4d03-adae-736a6ce392b8 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:48:56.045260 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-22211680-ace8-4d03-adae-736a6ce392b8 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] [instance: 0698dc5b-5f47-46c4-ace8-f5e891a964a0] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:48:56.054022 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-22211680-ace8-4d03-adae-736a6ce392b8 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:48:56.054464 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-22211680-ace8-4d03-adae-736a6ce392b8 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:48:56.055234 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-22211680-ace8-4d03-adae-736a6ce392b8 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:48:56.056021 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-22211680-ace8-4d03-adae-736a6ce392b8 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:48:56.114846 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-22211680-ace8-4d03-adae-736a6ce392b8 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '163b2f24a72649ac8084be1cac32fa09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e123e9b86124c93a7fc2db9984e7466', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:48:56.123268 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-22211680-ace8-4d03-adae-736a6ce392b8 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] 10.222.0.11 "GET /compute/v2.1/servers/0698dc5b-5f47-46c4-ace8-f5e891a964a0" status: 200 len: 1218 microversion: 2.1 time: 0.085505 Nov 17 03:48:56.123828 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 1219/2247] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:48:56 2021] GET /compute/v2.1/servers/0698dc5b-5f47-46c4-ace8-f5e891a964a0 => generated 1218 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:48:57.147357 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-b6bee23d-e509-4a12-8c80-75052492ba04 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:48:57.148434 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-b6bee23d-e509-4a12-8c80-75052492ba04 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] [instance: 0698dc5b-5f47-46c4-ace8-f5e891a964a0] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:48:57.159004 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-b6bee23d-e509-4a12-8c80-75052492ba04 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:48:57.159457 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-b6bee23d-e509-4a12-8c80-75052492ba04 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:48:57.160218 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-b6bee23d-e509-4a12-8c80-75052492ba04 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:48:57.160655 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-b6bee23d-e509-4a12-8c80-75052492ba04 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:48:57.229664 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-b6bee23d-e509-4a12-8c80-75052492ba04 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '163b2f24a72649ac8084be1cac32fa09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e123e9b86124c93a7fc2db9984e7466', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:48:57.237860 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-b6bee23d-e509-4a12-8c80-75052492ba04 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] 10.222.0.11 "GET /compute/v2.1/servers/0698dc5b-5f47-46c4-ace8-f5e891a964a0" status: 200 len: 1218 microversion: 2.1 time: 0.096823 Nov 17 03:48:57.238464 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 1029/2248] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:48:57 2021] GET /compute/v2.1/servers/0698dc5b-5f47-46c4-ace8-f5e891a964a0 => generated 1218 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:48:58.261291 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-59eb15e6-3cb2-48fc-b6e0-f75534ce4027 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:48:58.262018 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-59eb15e6-3cb2-48fc-b6e0-f75534ce4027 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] [instance: 0698dc5b-5f47-46c4-ace8-f5e891a964a0] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:48:58.269990 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-59eb15e6-3cb2-48fc-b6e0-f75534ce4027 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:48:58.270433 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-59eb15e6-3cb2-48fc-b6e0-f75534ce4027 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:48:58.271206 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-59eb15e6-3cb2-48fc-b6e0-f75534ce4027 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:48:58.271632 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-59eb15e6-3cb2-48fc-b6e0-f75534ce4027 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:48:58.345463 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-59eb15e6-3cb2-48fc-b6e0-f75534ce4027 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '163b2f24a72649ac8084be1cac32fa09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e123e9b86124c93a7fc2db9984e7466', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:48:58.353897 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-59eb15e6-3cb2-48fc-b6e0-f75534ce4027 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] 10.222.0.11 "GET /compute/v2.1/servers/0698dc5b-5f47-46c4-ace8-f5e891a964a0" status: 200 len: 1218 microversion: 2.1 time: 0.097208 Nov 17 03:48:58.354457 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 1220/2249] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:48:58 2021] GET /compute/v2.1/servers/0698dc5b-5f47-46c4-ace8-f5e891a964a0 => generated 1218 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:48:59.375003 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-66e39e2b-bb08-4e4c-bcb9-a2a6da7c905f tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:48:59.375869 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-66e39e2b-bb08-4e4c-bcb9-a2a6da7c905f tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] [instance: 0698dc5b-5f47-46c4-ace8-f5e891a964a0] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:48:59.383129 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-66e39e2b-bb08-4e4c-bcb9-a2a6da7c905f tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:48:59.383580 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-66e39e2b-bb08-4e4c-bcb9-a2a6da7c905f tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:48:59.384352 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-66e39e2b-bb08-4e4c-bcb9-a2a6da7c905f tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:48:59.384813 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-66e39e2b-bb08-4e4c-bcb9-a2a6da7c905f tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:48:59.448224 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-66e39e2b-bb08-4e4c-bcb9-a2a6da7c905f tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '163b2f24a72649ac8084be1cac32fa09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e123e9b86124c93a7fc2db9984e7466', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:48:59.456020 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-66e39e2b-bb08-4e4c-bcb9-a2a6da7c905f tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] 10.222.0.11 "GET /compute/v2.1/servers/0698dc5b-5f47-46c4-ace8-f5e891a964a0" status: 200 len: 1218 microversion: 2.1 time: 0.087384 Nov 17 03:48:59.456588 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 1030/2250] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:48:59 2021] GET /compute/v2.1/servers/0698dc5b-5f47-46c4-ace8-f5e891a964a0 => generated 1218 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:49:00.476975 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-b48fc080-cf81-4f2f-bf3b-f9734d8be735 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:49:00.478024 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-b48fc080-cf81-4f2f-bf3b-f9734d8be735 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] [instance: 0698dc5b-5f47-46c4-ace8-f5e891a964a0] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:49:00.487900 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-b48fc080-cf81-4f2f-bf3b-f9734d8be735 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:49:00.488345 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-b48fc080-cf81-4f2f-bf3b-f9734d8be735 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:49:00.489169 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-b48fc080-cf81-4f2f-bf3b-f9734d8be735 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:49:00.489602 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-b48fc080-cf81-4f2f-bf3b-f9734d8be735 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:49:00.551148 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-b48fc080-cf81-4f2f-bf3b-f9734d8be735 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '163b2f24a72649ac8084be1cac32fa09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e123e9b86124c93a7fc2db9984e7466', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:49:00.559056 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-b48fc080-cf81-4f2f-bf3b-f9734d8be735 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] 10.222.0.11 "GET /compute/v2.1/servers/0698dc5b-5f47-46c4-ace8-f5e891a964a0" status: 200 len: 1218 microversion: 2.1 time: 0.088403 Nov 17 03:49:00.559620 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 1221/2251] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:49:00 2021] GET /compute/v2.1/servers/0698dc5b-5f47-46c4-ace8-f5e891a964a0 => generated 1218 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:49:01.579472 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-fc14eef5-a302-4f79-add3-48eaef310610 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:49:01.580754 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-fc14eef5-a302-4f79-add3-48eaef310610 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] [instance: 0698dc5b-5f47-46c4-ace8-f5e891a964a0] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:49:01.591489 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-fc14eef5-a302-4f79-add3-48eaef310610 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:49:01.592232 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-fc14eef5-a302-4f79-add3-48eaef310610 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:49:01.593561 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-fc14eef5-a302-4f79-add3-48eaef310610 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:49:01.594284 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-fc14eef5-a302-4f79-add3-48eaef310610 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:49:01.660072 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-fc14eef5-a302-4f79-add3-48eaef310610 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '163b2f24a72649ac8084be1cac32fa09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e123e9b86124c93a7fc2db9984e7466', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:49:01.675048 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-fc14eef5-a302-4f79-add3-48eaef310610 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] 10.222.0.11 "GET /compute/v2.1/servers/0698dc5b-5f47-46c4-ace8-f5e891a964a0" status: 200 len: 1218 microversion: 2.1 time: 0.101155 Nov 17 03:49:01.675933 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 1031/2252] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:49:01 2021] GET /compute/v2.1/servers/0698dc5b-5f47-46c4-ace8-f5e891a964a0 => generated 1218 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:49:02.697960 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-a94deacf-7c38-4002-9b05-2a41eaa09ae0 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:49:02.698525 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-a94deacf-7c38-4002-9b05-2a41eaa09ae0 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] [instance: 0698dc5b-5f47-46c4-ace8-f5e891a964a0] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:49:02.705580 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-a94deacf-7c38-4002-9b05-2a41eaa09ae0 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:49:02.706017 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-a94deacf-7c38-4002-9b05-2a41eaa09ae0 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:49:02.706788 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-a94deacf-7c38-4002-9b05-2a41eaa09ae0 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:49:02.707210 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-a94deacf-7c38-4002-9b05-2a41eaa09ae0 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:49:02.766232 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-a94deacf-7c38-4002-9b05-2a41eaa09ae0 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '163b2f24a72649ac8084be1cac32fa09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e123e9b86124c93a7fc2db9984e7466', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:49:02.774112 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-a94deacf-7c38-4002-9b05-2a41eaa09ae0 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] 10.222.0.11 "GET /compute/v2.1/servers/0698dc5b-5f47-46c4-ace8-f5e891a964a0" status: 200 len: 1218 microversion: 2.1 time: 0.079951 Nov 17 03:49:02.774677 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 1222/2253] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:49:02 2021] GET /compute/v2.1/servers/0698dc5b-5f47-46c4-ace8-f5e891a964a0 => generated 1218 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:49:03.800202 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-16f111cd-cf2b-4b44-b74f-3eddc05145ba tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:49:03.801206 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-16f111cd-cf2b-4b44-b74f-3eddc05145ba tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] [instance: 0698dc5b-5f47-46c4-ace8-f5e891a964a0] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:49:03.812227 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-16f111cd-cf2b-4b44-b74f-3eddc05145ba tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:49:03.813018 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-16f111cd-cf2b-4b44-b74f-3eddc05145ba tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:49:03.814281 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-16f111cd-cf2b-4b44-b74f-3eddc05145ba tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:49:03.814893 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-16f111cd-cf2b-4b44-b74f-3eddc05145ba tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:49:03.873940 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-16f111cd-cf2b-4b44-b74f-3eddc05145ba tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '163b2f24a72649ac8084be1cac32fa09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e123e9b86124c93a7fc2db9984e7466', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:49:03.881966 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-16f111cd-cf2b-4b44-b74f-3eddc05145ba tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] 10.222.0.11 "GET /compute/v2.1/servers/0698dc5b-5f47-46c4-ace8-f5e891a964a0" status: 200 len: 1218 microversion: 2.1 time: 0.088011 Nov 17 03:49:03.882528 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 1032/2254] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:49:03 2021] GET /compute/v2.1/servers/0698dc5b-5f47-46c4-ace8-f5e891a964a0 => generated 1218 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:49:04.903576 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-0d37e7ce-63a5-4550-91b1-b3c8879def5e tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:49:04.904436 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-0d37e7ce-63a5-4550-91b1-b3c8879def5e tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] [instance: 0698dc5b-5f47-46c4-ace8-f5e891a964a0] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:49:04.915493 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-0d37e7ce-63a5-4550-91b1-b3c8879def5e tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:49:04.916247 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-0d37e7ce-63a5-4550-91b1-b3c8879def5e tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:49:04.917585 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-0d37e7ce-63a5-4550-91b1-b3c8879def5e tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:49:04.918334 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-0d37e7ce-63a5-4550-91b1-b3c8879def5e tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:49:04.982432 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-0d37e7ce-63a5-4550-91b1-b3c8879def5e tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '163b2f24a72649ac8084be1cac32fa09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e123e9b86124c93a7fc2db9984e7466', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:49:04.990796 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-0d37e7ce-63a5-4550-91b1-b3c8879def5e tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] 10.222.0.11 "GET /compute/v2.1/servers/0698dc5b-5f47-46c4-ace8-f5e891a964a0" status: 200 len: 1218 microversion: 2.1 time: 0.093579 Nov 17 03:49:04.991368 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 1223/2255] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:49:04 2021] GET /compute/v2.1/servers/0698dc5b-5f47-46c4-ace8-f5e891a964a0 => generated 1218 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:49:06.011509 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-9a3e3b9c-7810-4cae-bd60-d1662ddc974b tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:49:06.012443 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-9a3e3b9c-7810-4cae-bd60-d1662ddc974b tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] [instance: 0698dc5b-5f47-46c4-ace8-f5e891a964a0] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:49:06.024370 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-9a3e3b9c-7810-4cae-bd60-d1662ddc974b tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:49:06.025617 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-9a3e3b9c-7810-4cae-bd60-d1662ddc974b tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:49:06.027744 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-9a3e3b9c-7810-4cae-bd60-d1662ddc974b tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:49:06.030423 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-9a3e3b9c-7810-4cae-bd60-d1662ddc974b tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:49:06.095670 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-9a3e3b9c-7810-4cae-bd60-d1662ddc974b tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '163b2f24a72649ac8084be1cac32fa09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e123e9b86124c93a7fc2db9984e7466', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:49:06.107221 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-9a3e3b9c-7810-4cae-bd60-d1662ddc974b tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] 10.222.0.11 "GET /compute/v2.1/servers/0698dc5b-5f47-46c4-ace8-f5e891a964a0" status: 200 len: 1218 microversion: 2.1 time: 0.101774 Nov 17 03:49:06.108124 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 1033/2256] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:49:06 2021] GET /compute/v2.1/servers/0698dc5b-5f47-46c4-ace8-f5e891a964a0 => generated 1218 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:49:07.132490 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-8818900d-5f04-497e-a7a8-0abe6abd5b2e tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:49:07.133608 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-8818900d-5f04-497e-a7a8-0abe6abd5b2e tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] [instance: 0698dc5b-5f47-46c4-ace8-f5e891a964a0] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:49:07.143185 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-8818900d-5f04-497e-a7a8-0abe6abd5b2e tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:49:07.143855 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-8818900d-5f04-497e-a7a8-0abe6abd5b2e tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:49:07.145171 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-8818900d-5f04-497e-a7a8-0abe6abd5b2e tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:49:07.145876 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-8818900d-5f04-497e-a7a8-0abe6abd5b2e tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:49:07.206395 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-8818900d-5f04-497e-a7a8-0abe6abd5b2e tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '163b2f24a72649ac8084be1cac32fa09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e123e9b86124c93a7fc2db9984e7466', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:49:07.214866 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-8818900d-5f04-497e-a7a8-0abe6abd5b2e tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] 10.222.0.11 "GET /compute/v2.1/servers/0698dc5b-5f47-46c4-ace8-f5e891a964a0" status: 200 len: 1218 microversion: 2.1 time: 0.088145 Nov 17 03:49:07.215448 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 1224/2257] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:49:07 2021] GET /compute/v2.1/servers/0698dc5b-5f47-46c4-ace8-f5e891a964a0 => generated 1218 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:49:08.235381 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-f8f7d160-49e4-4d5e-8b59-04d17b43ca59 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:49:08.236417 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-f8f7d160-49e4-4d5e-8b59-04d17b43ca59 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] [instance: 0698dc5b-5f47-46c4-ace8-f5e891a964a0] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:49:08.247003 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-f8f7d160-49e4-4d5e-8b59-04d17b43ca59 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:49:08.247738 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-f8f7d160-49e4-4d5e-8b59-04d17b43ca59 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:49:08.249055 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-f8f7d160-49e4-4d5e-8b59-04d17b43ca59 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:49:08.249768 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-f8f7d160-49e4-4d5e-8b59-04d17b43ca59 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:49:08.312409 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-f8f7d160-49e4-4d5e-8b59-04d17b43ca59 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '163b2f24a72649ac8084be1cac32fa09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e123e9b86124c93a7fc2db9984e7466', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:49:08.320303 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-f8f7d160-49e4-4d5e-8b59-04d17b43ca59 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] 10.222.0.11 "GET /compute/v2.1/servers/0698dc5b-5f47-46c4-ace8-f5e891a964a0" status: 200 len: 1218 microversion: 2.1 time: 0.091149 Nov 17 03:49:08.320914 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 1034/2258] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:49:08 2021] GET /compute/v2.1/servers/0698dc5b-5f47-46c4-ace8-f5e891a964a0 => generated 1218 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:49:09.341387 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-82172fed-21df-462c-8535-92e434a82a87 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:49:09.342283 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-82172fed-21df-462c-8535-92e434a82a87 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] [instance: 0698dc5b-5f47-46c4-ace8-f5e891a964a0] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:49:09.353897 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-82172fed-21df-462c-8535-92e434a82a87 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:49:09.354646 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-82172fed-21df-462c-8535-92e434a82a87 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:49:09.355914 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-82172fed-21df-462c-8535-92e434a82a87 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:49:09.356631 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-82172fed-21df-462c-8535-92e434a82a87 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:49:09.423722 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-82172fed-21df-462c-8535-92e434a82a87 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '163b2f24a72649ac8084be1cac32fa09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e123e9b86124c93a7fc2db9984e7466', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:49:09.432717 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-82172fed-21df-462c-8535-92e434a82a87 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] 10.222.0.11 "GET /compute/v2.1/servers/0698dc5b-5f47-46c4-ace8-f5e891a964a0" status: 200 len: 1218 microversion: 2.1 time: 0.097636 Nov 17 03:49:09.433323 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 1225/2259] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:49:09 2021] GET /compute/v2.1/servers/0698dc5b-5f47-46c4-ace8-f5e891a964a0 => generated 1218 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:49:10.454208 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-e9ec96af-5cf6-4d3d-837d-3d29cd311f12 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:49:10.455080 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-e9ec96af-5cf6-4d3d-837d-3d29cd311f12 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] [instance: 0698dc5b-5f47-46c4-ace8-f5e891a964a0] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:49:10.465632 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-e9ec96af-5cf6-4d3d-837d-3d29cd311f12 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:49:10.466375 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-e9ec96af-5cf6-4d3d-837d-3d29cd311f12 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:49:10.467651 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-e9ec96af-5cf6-4d3d-837d-3d29cd311f12 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:49:10.468389 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-e9ec96af-5cf6-4d3d-837d-3d29cd311f12 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:49:10.529559 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-e9ec96af-5cf6-4d3d-837d-3d29cd311f12 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '163b2f24a72649ac8084be1cac32fa09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e123e9b86124c93a7fc2db9984e7466', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:49:10.537836 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-e9ec96af-5cf6-4d3d-837d-3d29cd311f12 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] 10.222.0.11 "GET /compute/v2.1/servers/0698dc5b-5f47-46c4-ace8-f5e891a964a0" status: 200 len: 1218 microversion: 2.1 time: 0.089462 Nov 17 03:49:10.538037 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 1035/2260] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:49:10 2021] GET /compute/v2.1/servers/0698dc5b-5f47-46c4-ace8-f5e891a964a0 => generated 1218 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:49:11.558787 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-844ab91d-188a-45fb-a071-e15ca1b233f1 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:49:11.559714 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-844ab91d-188a-45fb-a071-e15ca1b233f1 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] [instance: 0698dc5b-5f47-46c4-ace8-f5e891a964a0] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:49:11.569697 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-844ab91d-188a-45fb-a071-e15ca1b233f1 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:49:11.570395 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-844ab91d-188a-45fb-a071-e15ca1b233f1 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:49:11.571583 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-844ab91d-188a-45fb-a071-e15ca1b233f1 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:49:11.572209 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-844ab91d-188a-45fb-a071-e15ca1b233f1 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:49:11.638881 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-844ab91d-188a-45fb-a071-e15ca1b233f1 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '163b2f24a72649ac8084be1cac32fa09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e123e9b86124c93a7fc2db9984e7466', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:49:11.646410 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-844ab91d-188a-45fb-a071-e15ca1b233f1 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] 10.222.0.11 "GET /compute/v2.1/servers/0698dc5b-5f47-46c4-ace8-f5e891a964a0" status: 200 len: 1218 microversion: 2.1 time: 0.093981 Nov 17 03:49:11.647190 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 1226/2261] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:49:11 2021] GET /compute/v2.1/servers/0698dc5b-5f47-46c4-ace8-f5e891a964a0 => generated 1218 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:49:12.663649 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-46fe7ec5-f8f9-4628-9ae0-54c0c88fc871 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:49:12.664339 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-46fe7ec5-f8f9-4628-9ae0-54c0c88fc871 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] [instance: 0698dc5b-5f47-46c4-ace8-f5e891a964a0] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:49:12.671302 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-46fe7ec5-f8f9-4628-9ae0-54c0c88fc871 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:49:12.671756 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-46fe7ec5-f8f9-4628-9ae0-54c0c88fc871 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:49:12.672518 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-46fe7ec5-f8f9-4628-9ae0-54c0c88fc871 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:49:12.672994 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-46fe7ec5-f8f9-4628-9ae0-54c0c88fc871 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:49:12.738045 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-46fe7ec5-f8f9-4628-9ae0-54c0c88fc871 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '163b2f24a72649ac8084be1cac32fa09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e123e9b86124c93a7fc2db9984e7466', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:49:12.745697 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-46fe7ec5-f8f9-4628-9ae0-54c0c88fc871 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] 10.222.0.11 "GET /compute/v2.1/servers/0698dc5b-5f47-46c4-ace8-f5e891a964a0" status: 200 len: 1218 microversion: 2.1 time: 0.085886 Nov 17 03:49:12.746254 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 1036/2262] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:49:12 2021] GET /compute/v2.1/servers/0698dc5b-5f47-46c4-ace8-f5e891a964a0 => generated 1218 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:49:13.766512 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-c9386283-00e6-4726-81ac-4265c708054c tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:49:13.767432 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-c9386283-00e6-4726-81ac-4265c708054c tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] [instance: 0698dc5b-5f47-46c4-ace8-f5e891a964a0] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:49:13.775887 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-c9386283-00e6-4726-81ac-4265c708054c tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:49:13.776361 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-c9386283-00e6-4726-81ac-4265c708054c tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:49:13.777154 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-c9386283-00e6-4726-81ac-4265c708054c tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:49:13.777580 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-c9386283-00e6-4726-81ac-4265c708054c tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:49:13.836961 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-c9386283-00e6-4726-81ac-4265c708054c tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '163b2f24a72649ac8084be1cac32fa09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e123e9b86124c93a7fc2db9984e7466', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:49:13.844799 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-c9386283-00e6-4726-81ac-4265c708054c tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] 10.222.0.11 "GET /compute/v2.1/servers/0698dc5b-5f47-46c4-ace8-f5e891a964a0" status: 200 len: 1218 microversion: 2.1 time: 0.084560 Nov 17 03:49:13.845340 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 1227/2263] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:49:13 2021] GET /compute/v2.1/servers/0698dc5b-5f47-46c4-ace8-f5e891a964a0 => generated 1218 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:49:14.865706 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-ffc227e3-1edf-497b-b7dc-afeaeac24a03 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:49:14.866686 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-ffc227e3-1edf-497b-b7dc-afeaeac24a03 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] [instance: 0698dc5b-5f47-46c4-ace8-f5e891a964a0] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:49:14.874171 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-ffc227e3-1edf-497b-b7dc-afeaeac24a03 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:49:14.874684 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-ffc227e3-1edf-497b-b7dc-afeaeac24a03 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:49:14.875525 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-ffc227e3-1edf-497b-b7dc-afeaeac24a03 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:49:14.876010 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-ffc227e3-1edf-497b-b7dc-afeaeac24a03 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:49:14.937375 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-ffc227e3-1edf-497b-b7dc-afeaeac24a03 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '163b2f24a72649ac8084be1cac32fa09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e123e9b86124c93a7fc2db9984e7466', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:49:14.944987 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-ffc227e3-1edf-497b-b7dc-afeaeac24a03 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] 10.222.0.11 "GET /compute/v2.1/servers/0698dc5b-5f47-46c4-ace8-f5e891a964a0" status: 200 len: 1218 microversion: 2.1 time: 0.085493 Nov 17 03:49:14.945547 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 1037/2264] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:49:14 2021] GET /compute/v2.1/servers/0698dc5b-5f47-46c4-ace8-f5e891a964a0 => generated 1218 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:49:15.970423 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-61d1abde-b8d5-4618-837b-8bc3229550f5 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:49:15.971360 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-61d1abde-b8d5-4618-837b-8bc3229550f5 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] [instance: 0698dc5b-5f47-46c4-ace8-f5e891a964a0] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:49:15.980094 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-61d1abde-b8d5-4618-837b-8bc3229550f5 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:49:15.980541 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-61d1abde-b8d5-4618-837b-8bc3229550f5 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:49:15.981356 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-61d1abde-b8d5-4618-837b-8bc3229550f5 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:49:15.981789 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-61d1abde-b8d5-4618-837b-8bc3229550f5 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:49:16.053271 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-61d1abde-b8d5-4618-837b-8bc3229550f5 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '163b2f24a72649ac8084be1cac32fa09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e123e9b86124c93a7fc2db9984e7466', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:49:16.062076 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-61d1abde-b8d5-4618-837b-8bc3229550f5 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] 10.222.0.11 "GET /compute/v2.1/servers/0698dc5b-5f47-46c4-ace8-f5e891a964a0" status: 200 len: 1218 microversion: 2.1 time: 0.097835 Nov 17 03:49:16.062651 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 1228/2265] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:49:15 2021] GET /compute/v2.1/servers/0698dc5b-5f47-46c4-ace8-f5e891a964a0 => generated 1218 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:49:17.338979 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-1f88dec6-80fd-4192-910f-9509afab9447 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:49:17.339544 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-1f88dec6-80fd-4192-910f-9509afab9447 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] [instance: 0698dc5b-5f47-46c4-ace8-f5e891a964a0] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:49:17.345685 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-1f88dec6-80fd-4192-910f-9509afab9447 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:49:17.346128 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-1f88dec6-80fd-4192-910f-9509afab9447 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:49:17.346877 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-1f88dec6-80fd-4192-910f-9509afab9447 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:49:17.347301 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-1f88dec6-80fd-4192-910f-9509afab9447 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:49:17.409955 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-1f88dec6-80fd-4192-910f-9509afab9447 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '163b2f24a72649ac8084be1cac32fa09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e123e9b86124c93a7fc2db9984e7466', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:49:17.418172 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-1f88dec6-80fd-4192-910f-9509afab9447 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] 10.222.0.11 "GET /compute/v2.1/servers/0698dc5b-5f47-46c4-ace8-f5e891a964a0" status: 200 len: 1218 microversion: 2.1 time: 0.337169 Nov 17 03:49:17.418733 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 1038/2266] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:49:17 2021] GET /compute/v2.1/servers/0698dc5b-5f47-46c4-ace8-f5e891a964a0 => generated 1218 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:49:18.438360 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-5a53eb39-2b94-4e80-be61-e1112a96cee4 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:49:18.438983 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-5a53eb39-2b94-4e80-be61-e1112a96cee4 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] [instance: 0698dc5b-5f47-46c4-ace8-f5e891a964a0] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:49:18.448040 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-5a53eb39-2b94-4e80-be61-e1112a96cee4 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:49:18.448539 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-5a53eb39-2b94-4e80-be61-e1112a96cee4 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:49:18.449424 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-5a53eb39-2b94-4e80-be61-e1112a96cee4 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:49:18.449903 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-5a53eb39-2b94-4e80-be61-e1112a96cee4 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:49:18.514551 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-5a53eb39-2b94-4e80-be61-e1112a96cee4 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '163b2f24a72649ac8084be1cac32fa09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e123e9b86124c93a7fc2db9984e7466', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:49:18.524929 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-5a53eb39-2b94-4e80-be61-e1112a96cee4 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] 10.222.0.11 "GET /compute/v2.1/servers/0698dc5b-5f47-46c4-ace8-f5e891a964a0" status: 200 len: 1218 microversion: 2.1 time: 0.092601 Nov 17 03:49:18.525519 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 1229/2267] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:49:18 2021] GET /compute/v2.1/servers/0698dc5b-5f47-46c4-ace8-f5e891a964a0 => generated 1218 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:49:19.550577 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-7f524fda-ee68-4062-89c3-1d0bef882535 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:49:19.551549 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-7f524fda-ee68-4062-89c3-1d0bef882535 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] [instance: 0698dc5b-5f47-46c4-ace8-f5e891a964a0] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:49:19.563110 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-7f524fda-ee68-4062-89c3-1d0bef882535 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:49:19.563922 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-7f524fda-ee68-4062-89c3-1d0bef882535 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:49:19.565328 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-7f524fda-ee68-4062-89c3-1d0bef882535 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:49:19.566099 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-7f524fda-ee68-4062-89c3-1d0bef882535 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:49:19.629837 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-7f524fda-ee68-4062-89c3-1d0bef882535 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '163b2f24a72649ac8084be1cac32fa09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e123e9b86124c93a7fc2db9984e7466', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:49:19.637370 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-7f524fda-ee68-4062-89c3-1d0bef882535 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] 10.222.0.11 "GET /compute/v2.1/servers/0698dc5b-5f47-46c4-ace8-f5e891a964a0" status: 200 len: 1218 microversion: 2.1 time: 0.093107 Nov 17 03:49:19.637927 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 1039/2268] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:49:19 2021] GET /compute/v2.1/servers/0698dc5b-5f47-46c4-ace8-f5e891a964a0 => generated 1218 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:49:20.659046 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-6a0779e5-af84-4463-ba40-318a352b05b5 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:49:20.660042 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-6a0779e5-af84-4463-ba40-318a352b05b5 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] [instance: 0698dc5b-5f47-46c4-ace8-f5e891a964a0] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:49:20.671148 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-6a0779e5-af84-4463-ba40-318a352b05b5 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:49:20.671884 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-6a0779e5-af84-4463-ba40-318a352b05b5 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:49:20.673195 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-6a0779e5-af84-4463-ba40-318a352b05b5 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:49:20.673901 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-6a0779e5-af84-4463-ba40-318a352b05b5 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:49:20.738182 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-6a0779e5-af84-4463-ba40-318a352b05b5 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '163b2f24a72649ac8084be1cac32fa09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e123e9b86124c93a7fc2db9984e7466', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:49:20.745777 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-6a0779e5-af84-4463-ba40-318a352b05b5 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] 10.222.0.11 "GET /compute/v2.1/servers/0698dc5b-5f47-46c4-ace8-f5e891a964a0" status: 200 len: 1218 microversion: 2.1 time: 0.093201 Nov 17 03:49:20.746344 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 1230/2269] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:49:20 2021] GET /compute/v2.1/servers/0698dc5b-5f47-46c4-ace8-f5e891a964a0 => generated 1218 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:49:21.767754 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-42f31984-46e6-46af-bcb7-cee6c92f4169 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:49:21.768374 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-42f31984-46e6-46af-bcb7-cee6c92f4169 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] [instance: 0698dc5b-5f47-46c4-ace8-f5e891a964a0] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:49:21.775168 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-42f31984-46e6-46af-bcb7-cee6c92f4169 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:49:21.775592 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-42f31984-46e6-46af-bcb7-cee6c92f4169 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:49:21.776367 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-42f31984-46e6-46af-bcb7-cee6c92f4169 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:49:21.776840 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-42f31984-46e6-46af-bcb7-cee6c92f4169 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:49:21.847640 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-42f31984-46e6-46af-bcb7-cee6c92f4169 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '163b2f24a72649ac8084be1cac32fa09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e123e9b86124c93a7fc2db9984e7466', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:49:21.857580 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-42f31984-46e6-46af-bcb7-cee6c92f4169 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] 10.222.0.11 "GET /compute/v2.1/servers/0698dc5b-5f47-46c4-ace8-f5e891a964a0" status: 200 len: 1218 microversion: 2.1 time: 0.093503 Nov 17 03:49:21.858149 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 1040/2270] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:49:21 2021] GET /compute/v2.1/servers/0698dc5b-5f47-46c4-ace8-f5e891a964a0 => generated 1218 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:49:22.881441 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-404e24a6-d735-4afc-8047-42f32533621a tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:49:22.882462 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-404e24a6-d735-4afc-8047-42f32533621a tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] [instance: 0698dc5b-5f47-46c4-ace8-f5e891a964a0] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:49:22.893383 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-404e24a6-d735-4afc-8047-42f32533621a tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:49:22.894127 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-404e24a6-d735-4afc-8047-42f32533621a tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:49:22.895383 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-404e24a6-d735-4afc-8047-42f32533621a tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:49:22.896093 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-404e24a6-d735-4afc-8047-42f32533621a tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:49:22.958843 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-404e24a6-d735-4afc-8047-42f32533621a tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '163b2f24a72649ac8084be1cac32fa09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e123e9b86124c93a7fc2db9984e7466', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:49:22.966742 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-404e24a6-d735-4afc-8047-42f32533621a tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] 10.222.0.11 "GET /compute/v2.1/servers/0698dc5b-5f47-46c4-ace8-f5e891a964a0" status: 200 len: 1218 microversion: 2.1 time: 0.091439 Nov 17 03:49:22.967303 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 1231/2271] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:49:22 2021] GET /compute/v2.1/servers/0698dc5b-5f47-46c4-ace8-f5e891a964a0 => generated 1218 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:49:23.986588 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-20a37cb1-3bf5-48f2-a511-e612aa5a7a90 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:49:23.987365 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-20a37cb1-3bf5-48f2-a511-e612aa5a7a90 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] [instance: 0698dc5b-5f47-46c4-ace8-f5e891a964a0] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:49:23.997797 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-20a37cb1-3bf5-48f2-a511-e612aa5a7a90 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:49:23.998397 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-20a37cb1-3bf5-48f2-a511-e612aa5a7a90 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:49:23.999530 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-20a37cb1-3bf5-48f2-a511-e612aa5a7a90 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:49:24.000094 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-20a37cb1-3bf5-48f2-a511-e612aa5a7a90 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:49:24.064469 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-20a37cb1-3bf5-48f2-a511-e612aa5a7a90 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '163b2f24a72649ac8084be1cac32fa09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e123e9b86124c93a7fc2db9984e7466', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:49:24.072588 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-20a37cb1-3bf5-48f2-a511-e612aa5a7a90 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] 10.222.0.11 "GET /compute/v2.1/servers/0698dc5b-5f47-46c4-ace8-f5e891a964a0" status: 200 len: 1218 microversion: 2.1 time: 0.092241 Nov 17 03:49:24.073232 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 1041/2272] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:49:23 2021] GET /compute/v2.1/servers/0698dc5b-5f47-46c4-ace8-f5e891a964a0 => generated 1218 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:49:25.091297 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-5b62fb1b-3480-43dc-b75a-1127633cbfdb tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:49:25.091924 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-5b62fb1b-3480-43dc-b75a-1127633cbfdb tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] [instance: 0698dc5b-5f47-46c4-ace8-f5e891a964a0] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:49:25.098504 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-5b62fb1b-3480-43dc-b75a-1127633cbfdb tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:49:25.098948 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-5b62fb1b-3480-43dc-b75a-1127633cbfdb tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:49:25.099768 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-5b62fb1b-3480-43dc-b75a-1127633cbfdb tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:49:25.100200 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-5b62fb1b-3480-43dc-b75a-1127633cbfdb tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:49:25.163518 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-5b62fb1b-3480-43dc-b75a-1127633cbfdb tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '163b2f24a72649ac8084be1cac32fa09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e123e9b86124c93a7fc2db9984e7466', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:49:25.171476 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-5b62fb1b-3480-43dc-b75a-1127633cbfdb tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] 10.222.0.11 "GET /compute/v2.1/servers/0698dc5b-5f47-46c4-ace8-f5e891a964a0" status: 200 len: 1218 microversion: 2.1 time: 0.084824 Nov 17 03:49:25.172052 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 1232/2273] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:49:25 2021] GET /compute/v2.1/servers/0698dc5b-5f47-46c4-ace8-f5e891a964a0 => generated 1218 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:49:26.192294 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-50b5b5bf-f82d-4ea0-8175-b72ddce25352 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:49:26.192947 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-50b5b5bf-f82d-4ea0-8175-b72ddce25352 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] [instance: 0698dc5b-5f47-46c4-ace8-f5e891a964a0] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:49:26.200818 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-50b5b5bf-f82d-4ea0-8175-b72ddce25352 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:49:26.201347 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-50b5b5bf-f82d-4ea0-8175-b72ddce25352 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:49:26.202112 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-50b5b5bf-f82d-4ea0-8175-b72ddce25352 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:49:26.202537 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-50b5b5bf-f82d-4ea0-8175-b72ddce25352 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:49:26.275267 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-50b5b5bf-f82d-4ea0-8175-b72ddce25352 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '163b2f24a72649ac8084be1cac32fa09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e123e9b86124c93a7fc2db9984e7466', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:49:26.282954 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-50b5b5bf-f82d-4ea0-8175-b72ddce25352 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] 10.222.0.11 "GET /compute/v2.1/servers/0698dc5b-5f47-46c4-ace8-f5e891a964a0" status: 200 len: 1218 microversion: 2.1 time: 0.096432 Nov 17 03:49:26.283508 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 1042/2274] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:49:26 2021] GET /compute/v2.1/servers/0698dc5b-5f47-46c4-ace8-f5e891a964a0 => generated 1218 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:49:27.304217 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-75d5c237-732e-4142-9250-da35afc6f067 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:49:27.305338 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-75d5c237-732e-4142-9250-da35afc6f067 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] [instance: 0698dc5b-5f47-46c4-ace8-f5e891a964a0] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:49:27.312458 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-75d5c237-732e-4142-9250-da35afc6f067 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:49:27.312881 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-75d5c237-732e-4142-9250-da35afc6f067 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:49:27.313681 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-75d5c237-732e-4142-9250-da35afc6f067 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:49:27.314114 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-75d5c237-732e-4142-9250-da35afc6f067 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:49:27.374050 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-75d5c237-732e-4142-9250-da35afc6f067 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '163b2f24a72649ac8084be1cac32fa09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e123e9b86124c93a7fc2db9984e7466', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:49:27.382031 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-75d5c237-732e-4142-9250-da35afc6f067 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] 10.222.0.11 "GET /compute/v2.1/servers/0698dc5b-5f47-46c4-ace8-f5e891a964a0" status: 200 len: 1218 microversion: 2.1 time: 0.084397 Nov 17 03:49:27.382593 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 1233/2275] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:49:27 2021] GET /compute/v2.1/servers/0698dc5b-5f47-46c4-ace8-f5e891a964a0 => generated 1218 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:49:28.398864 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-0f83768e-e1ca-4aa7-b2b9-e1d340183eaf tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:49:28.399506 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-0f83768e-e1ca-4aa7-b2b9-e1d340183eaf tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] [instance: 0698dc5b-5f47-46c4-ace8-f5e891a964a0] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:49:28.406473 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-0f83768e-e1ca-4aa7-b2b9-e1d340183eaf tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:49:28.406932 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-0f83768e-e1ca-4aa7-b2b9-e1d340183eaf tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:49:28.407832 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-0f83768e-e1ca-4aa7-b2b9-e1d340183eaf tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:49:28.408374 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-0f83768e-e1ca-4aa7-b2b9-e1d340183eaf tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:49:28.470260 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-0f83768e-e1ca-4aa7-b2b9-e1d340183eaf tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '163b2f24a72649ac8084be1cac32fa09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e123e9b86124c93a7fc2db9984e7466', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:49:28.477933 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-0f83768e-e1ca-4aa7-b2b9-e1d340183eaf tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] 10.222.0.11 "GET /compute/v2.1/servers/0698dc5b-5f47-46c4-ace8-f5e891a964a0" status: 200 len: 1218 microversion: 2.1 time: 0.082804 Nov 17 03:49:28.478621 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 1043/2276] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:49:28 2021] GET /compute/v2.1/servers/0698dc5b-5f47-46c4-ace8-f5e891a964a0 => generated 1218 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:49:29.497364 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-64f8feb0-ac65-481f-a336-1e6eed58e3bd tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:49:29.498121 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-64f8feb0-ac65-481f-a336-1e6eed58e3bd tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] [instance: 0698dc5b-5f47-46c4-ace8-f5e891a964a0] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:49:29.506749 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-64f8feb0-ac65-481f-a336-1e6eed58e3bd tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:49:29.507348 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-64f8feb0-ac65-481f-a336-1e6eed58e3bd tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:49:29.508352 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-64f8feb0-ac65-481f-a336-1e6eed58e3bd tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:49:29.508967 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-64f8feb0-ac65-481f-a336-1e6eed58e3bd tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:49:29.579114 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-64f8feb0-ac65-481f-a336-1e6eed58e3bd tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '163b2f24a72649ac8084be1cac32fa09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e123e9b86124c93a7fc2db9984e7466', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:49:29.590626 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-64f8feb0-ac65-481f-a336-1e6eed58e3bd tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] 10.222.0.11 "GET /compute/v2.1/servers/0698dc5b-5f47-46c4-ace8-f5e891a964a0" status: 200 len: 1218 microversion: 2.1 time: 0.098754 Nov 17 03:49:29.591191 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 1234/2277] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:49:29 2021] GET /compute/v2.1/servers/0698dc5b-5f47-46c4-ace8-f5e891a964a0 => generated 1218 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:49:30.612000 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-55ea41e4-b691-4f18-a51f-c516c9177f87 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:49:30.615917 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-55ea41e4-b691-4f18-a51f-c516c9177f87 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] [instance: 0698dc5b-5f47-46c4-ace8-f5e891a964a0] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:49:30.624564 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-55ea41e4-b691-4f18-a51f-c516c9177f87 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:49:30.625357 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-55ea41e4-b691-4f18-a51f-c516c9177f87 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:49:30.626664 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-55ea41e4-b691-4f18-a51f-c516c9177f87 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:49:30.627452 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-55ea41e4-b691-4f18-a51f-c516c9177f87 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:49:30.689800 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-55ea41e4-b691-4f18-a51f-c516c9177f87 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '163b2f24a72649ac8084be1cac32fa09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e123e9b86124c93a7fc2db9984e7466', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:49:30.697540 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-55ea41e4-b691-4f18-a51f-c516c9177f87 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] 10.222.0.11 "GET /compute/v2.1/servers/0698dc5b-5f47-46c4-ace8-f5e891a964a0" status: 200 len: 1218 microversion: 2.1 time: 0.091760 Nov 17 03:49:30.698108 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 1044/2278] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:49:30 2021] GET /compute/v2.1/servers/0698dc5b-5f47-46c4-ace8-f5e891a964a0 => generated 1218 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:49:31.719495 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-6d66dd13-57dc-406c-a385-6495e33944ff tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:49:31.720229 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-6d66dd13-57dc-406c-a385-6495e33944ff tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] [instance: 0698dc5b-5f47-46c4-ace8-f5e891a964a0] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:49:31.729761 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-6d66dd13-57dc-406c-a385-6495e33944ff tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:49:31.730544 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-6d66dd13-57dc-406c-a385-6495e33944ff tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:49:31.731462 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-6d66dd13-57dc-406c-a385-6495e33944ff tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:49:31.731950 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-6d66dd13-57dc-406c-a385-6495e33944ff tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:49:31.802450 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-6d66dd13-57dc-406c-a385-6495e33944ff tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '163b2f24a72649ac8084be1cac32fa09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e123e9b86124c93a7fc2db9984e7466', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:49:31.810790 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-6d66dd13-57dc-406c-a385-6495e33944ff tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] 10.222.0.11 "GET /compute/v2.1/servers/0698dc5b-5f47-46c4-ace8-f5e891a964a0" status: 200 len: 1218 microversion: 2.1 time: 0.098566 Nov 17 03:49:31.811363 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 1235/2279] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:49:31 2021] GET /compute/v2.1/servers/0698dc5b-5f47-46c4-ace8-f5e891a964a0 => generated 1218 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:49:32.832106 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-f9df5fee-0330-4e8f-9501-84b50d4a6055 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:49:32.833171 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-f9df5fee-0330-4e8f-9501-84b50d4a6055 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] [instance: 0698dc5b-5f47-46c4-ace8-f5e891a964a0] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:49:32.843940 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-f9df5fee-0330-4e8f-9501-84b50d4a6055 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:49:32.844682 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-f9df5fee-0330-4e8f-9501-84b50d4a6055 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:49:32.846011 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-f9df5fee-0330-4e8f-9501-84b50d4a6055 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:49:32.846747 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-f9df5fee-0330-4e8f-9501-84b50d4a6055 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:49:32.909612 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-f9df5fee-0330-4e8f-9501-84b50d4a6055 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '163b2f24a72649ac8084be1cac32fa09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e123e9b86124c93a7fc2db9984e7466', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:49:32.918793 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-f9df5fee-0330-4e8f-9501-84b50d4a6055 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] 10.222.0.11 "GET /compute/v2.1/servers/0698dc5b-5f47-46c4-ace8-f5e891a964a0" status: 200 len: 1218 microversion: 2.1 time: 0.092912 Nov 17 03:49:32.919383 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 1045/2280] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:49:32 2021] GET /compute/v2.1/servers/0698dc5b-5f47-46c4-ace8-f5e891a964a0 => generated 1218 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:49:33.937591 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-2c933cae-803c-49b5-a188-202679892b84 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:49:33.938227 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-2c933cae-803c-49b5-a188-202679892b84 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] [instance: 0698dc5b-5f47-46c4-ace8-f5e891a964a0] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:49:33.944695 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-2c933cae-803c-49b5-a188-202679892b84 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:49:33.945170 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-2c933cae-803c-49b5-a188-202679892b84 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:49:33.945929 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-2c933cae-803c-49b5-a188-202679892b84 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:49:33.946359 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-2c933cae-803c-49b5-a188-202679892b84 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:49:34.018486 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-2c933cae-803c-49b5-a188-202679892b84 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '163b2f24a72649ac8084be1cac32fa09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e123e9b86124c93a7fc2db9984e7466', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:49:34.026476 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-2c933cae-803c-49b5-a188-202679892b84 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] 10.222.0.11 "GET /compute/v2.1/servers/0698dc5b-5f47-46c4-ace8-f5e891a964a0" status: 200 len: 1218 microversion: 2.1 time: 0.092933 Nov 17 03:49:34.027213 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 1236/2281] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:49:33 2021] GET /compute/v2.1/servers/0698dc5b-5f47-46c4-ace8-f5e891a964a0 => generated 1218 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:49:35.046619 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-b7d2e178-c912-4f10-9706-56f3efeb41c8 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:49:35.047480 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-b7d2e178-c912-4f10-9706-56f3efeb41c8 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] [instance: 0698dc5b-5f47-46c4-ace8-f5e891a964a0] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:49:35.056590 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-b7d2e178-c912-4f10-9706-56f3efeb41c8 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:49:35.057901 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-b7d2e178-c912-4f10-9706-56f3efeb41c8 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:49:35.058210 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-b7d2e178-c912-4f10-9706-56f3efeb41c8 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:49:35.058818 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-b7d2e178-c912-4f10-9706-56f3efeb41c8 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:49:35.122018 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-b7d2e178-c912-4f10-9706-56f3efeb41c8 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '163b2f24a72649ac8084be1cac32fa09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e123e9b86124c93a7fc2db9984e7466', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:49:35.129473 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-b7d2e178-c912-4f10-9706-56f3efeb41c8 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] 10.222.0.11 "GET /compute/v2.1/servers/0698dc5b-5f47-46c4-ace8-f5e891a964a0" status: 200 len: 1218 microversion: 2.1 time: 0.088446 Nov 17 03:49:35.130032 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 1046/2282] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:49:35 2021] GET /compute/v2.1/servers/0698dc5b-5f47-46c4-ace8-f5e891a964a0 => generated 1218 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:49:36.149736 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-b772249f-e99b-44d7-b56c-8611b32eede7 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:49:36.150509 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-b772249f-e99b-44d7-b56c-8611b32eede7 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] [instance: 0698dc5b-5f47-46c4-ace8-f5e891a964a0] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:49:36.159006 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-b772249f-e99b-44d7-b56c-8611b32eede7 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:49:36.159548 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-b772249f-e99b-44d7-b56c-8611b32eede7 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:49:36.160523 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-b772249f-e99b-44d7-b56c-8611b32eede7 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:49:36.161021 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-b772249f-e99b-44d7-b56c-8611b32eede7 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:49:36.222194 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-b772249f-e99b-44d7-b56c-8611b32eede7 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '163b2f24a72649ac8084be1cac32fa09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e123e9b86124c93a7fc2db9984e7466', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:49:36.233526 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-b772249f-e99b-44d7-b56c-8611b32eede7 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] 10.222.0.11 "GET /compute/v2.1/servers/0698dc5b-5f47-46c4-ace8-f5e891a964a0" status: 200 len: 1218 microversion: 2.1 time: 0.089483 Nov 17 03:49:36.234290 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 1237/2283] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:49:36 2021] GET /compute/v2.1/servers/0698dc5b-5f47-46c4-ace8-f5e891a964a0 => generated 1218 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:49:37.257426 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-57dead89-779e-4e04-9a9b-113d5528a6c4 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:49:37.258554 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-57dead89-779e-4e04-9a9b-113d5528a6c4 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] [instance: 0698dc5b-5f47-46c4-ace8-f5e891a964a0] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:49:37.267520 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-57dead89-779e-4e04-9a9b-113d5528a6c4 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:49:37.267963 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-57dead89-779e-4e04-9a9b-113d5528a6c4 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:49:37.268724 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-57dead89-779e-4e04-9a9b-113d5528a6c4 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:49:37.269193 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-57dead89-779e-4e04-9a9b-113d5528a6c4 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:49:37.329451 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-57dead89-779e-4e04-9a9b-113d5528a6c4 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '163b2f24a72649ac8084be1cac32fa09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e123e9b86124c93a7fc2db9984e7466', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:49:37.337099 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-57dead89-779e-4e04-9a9b-113d5528a6c4 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] 10.222.0.11 "GET /compute/v2.1/servers/0698dc5b-5f47-46c4-ace8-f5e891a964a0" status: 200 len: 1218 microversion: 2.1 time: 0.086225 Nov 17 03:49:37.337659 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 1047/2284] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:49:37 2021] GET /compute/v2.1/servers/0698dc5b-5f47-46c4-ace8-f5e891a964a0 => generated 1218 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:49:38.356852 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-57e9f1f7-0c40-4573-9f8f-069ea3ffbaff tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:49:38.357467 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-57e9f1f7-0c40-4573-9f8f-069ea3ffbaff tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] [instance: 0698dc5b-5f47-46c4-ace8-f5e891a964a0] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:49:38.364914 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-57e9f1f7-0c40-4573-9f8f-069ea3ffbaff tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:49:38.365420 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-57e9f1f7-0c40-4573-9f8f-069ea3ffbaff tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:49:38.366303 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-57e9f1f7-0c40-4573-9f8f-069ea3ffbaff tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:49:38.366782 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-57e9f1f7-0c40-4573-9f8f-069ea3ffbaff tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:49:38.442689 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-57e9f1f7-0c40-4573-9f8f-069ea3ffbaff tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '163b2f24a72649ac8084be1cac32fa09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e123e9b86124c93a7fc2db9984e7466', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:49:38.453577 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-57e9f1f7-0c40-4573-9f8f-069ea3ffbaff tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] 10.222.0.11 "GET /compute/v2.1/servers/0698dc5b-5f47-46c4-ace8-f5e891a964a0" status: 200 len: 1218 microversion: 2.1 time: 0.102227 Nov 17 03:49:38.454292 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 1238/2285] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:49:38 2021] GET /compute/v2.1/servers/0698dc5b-5f47-46c4-ace8-f5e891a964a0 => generated 1218 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:49:39.474740 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-3467f2fa-51ac-496e-858b-ea0830100bda tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:49:39.475330 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-3467f2fa-51ac-496e-858b-ea0830100bda tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] [instance: 0698dc5b-5f47-46c4-ace8-f5e891a964a0] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:49:39.482105 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-3467f2fa-51ac-496e-858b-ea0830100bda tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:49:39.482549 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-3467f2fa-51ac-496e-858b-ea0830100bda tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:49:39.483318 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-3467f2fa-51ac-496e-858b-ea0830100bda tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:49:39.483744 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-3467f2fa-51ac-496e-858b-ea0830100bda tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:49:39.548964 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-3467f2fa-51ac-496e-858b-ea0830100bda tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '163b2f24a72649ac8084be1cac32fa09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e123e9b86124c93a7fc2db9984e7466', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:49:39.557257 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-3467f2fa-51ac-496e-858b-ea0830100bda tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] 10.222.0.11 "GET /compute/v2.1/servers/0698dc5b-5f47-46c4-ace8-f5e891a964a0" status: 200 len: 1218 microversion: 2.1 time: 0.086375 Nov 17 03:49:39.557800 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 1048/2286] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:49:39 2021] GET /compute/v2.1/servers/0698dc5b-5f47-46c4-ace8-f5e891a964a0 => generated 1218 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:49:40.574740 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-845560c0-b7c8-49a6-95b9-c64597748643 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:49:40.575368 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-845560c0-b7c8-49a6-95b9-c64597748643 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] [instance: 0698dc5b-5f47-46c4-ace8-f5e891a964a0] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:49:40.582036 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-845560c0-b7c8-49a6-95b9-c64597748643 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:49:40.582482 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-845560c0-b7c8-49a6-95b9-c64597748643 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:49:40.583248 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-845560c0-b7c8-49a6-95b9-c64597748643 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:49:40.583675 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-845560c0-b7c8-49a6-95b9-c64597748643 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:49:40.655895 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-845560c0-b7c8-49a6-95b9-c64597748643 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '163b2f24a72649ac8084be1cac32fa09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e123e9b86124c93a7fc2db9984e7466', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:49:40.664095 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-845560c0-b7c8-49a6-95b9-c64597748643 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] 10.222.0.11 "GET /compute/v2.1/servers/0698dc5b-5f47-46c4-ace8-f5e891a964a0" status: 200 len: 1218 microversion: 2.1 time: 0.093098 Nov 17 03:49:40.664654 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 1239/2287] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:49:40 2021] GET /compute/v2.1/servers/0698dc5b-5f47-46c4-ace8-f5e891a964a0 => generated 1218 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:49:41.686260 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-a4932d98-26d8-4f0b-bbbe-79d58158753f tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:49:41.687267 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-a4932d98-26d8-4f0b-bbbe-79d58158753f tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] [instance: 0698dc5b-5f47-46c4-ace8-f5e891a964a0] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:49:41.697691 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-a4932d98-26d8-4f0b-bbbe-79d58158753f tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:49:41.698453 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-a4932d98-26d8-4f0b-bbbe-79d58158753f tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:49:41.699733 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-a4932d98-26d8-4f0b-bbbe-79d58158753f tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:49:41.700458 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-a4932d98-26d8-4f0b-bbbe-79d58158753f tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:49:41.760293 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-a4932d98-26d8-4f0b-bbbe-79d58158753f tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '163b2f24a72649ac8084be1cac32fa09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e123e9b86124c93a7fc2db9984e7466', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:49:41.768205 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-a4932d98-26d8-4f0b-bbbe-79d58158753f tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] 10.222.0.11 "GET /compute/v2.1/servers/0698dc5b-5f47-46c4-ace8-f5e891a964a0" status: 200 len: 1218 microversion: 2.1 time: 0.088765 Nov 17 03:49:41.768767 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 1049/2288] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:49:41 2021] GET /compute/v2.1/servers/0698dc5b-5f47-46c4-ace8-f5e891a964a0 => generated 1218 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:49:42.789326 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-429abf59-aa75-402d-9353-2571c1bc3b78 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:49:42.790326 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-429abf59-aa75-402d-9353-2571c1bc3b78 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] [instance: 0698dc5b-5f47-46c4-ace8-f5e891a964a0] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:49:42.801085 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-429abf59-aa75-402d-9353-2571c1bc3b78 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:49:42.801817 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-429abf59-aa75-402d-9353-2571c1bc3b78 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:49:42.803465 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-429abf59-aa75-402d-9353-2571c1bc3b78 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:49:42.804174 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-429abf59-aa75-402d-9353-2571c1bc3b78 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:49:42.868348 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-429abf59-aa75-402d-9353-2571c1bc3b78 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '163b2f24a72649ac8084be1cac32fa09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e123e9b86124c93a7fc2db9984e7466', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:49:42.876240 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-429abf59-aa75-402d-9353-2571c1bc3b78 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] 10.222.0.11 "GET /compute/v2.1/servers/0698dc5b-5f47-46c4-ace8-f5e891a964a0" status: 200 len: 1218 microversion: 2.1 time: 0.093099 Nov 17 03:49:42.876811 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 1240/2289] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:49:42 2021] GET /compute/v2.1/servers/0698dc5b-5f47-46c4-ace8-f5e891a964a0 => generated 1218 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:49:43.896804 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-04c4542e-7347-4ce7-a86c-bf644bdd1105 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:49:43.897843 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-04c4542e-7347-4ce7-a86c-bf644bdd1105 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] [instance: 0698dc5b-5f47-46c4-ace8-f5e891a964a0] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:49:43.908643 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-04c4542e-7347-4ce7-a86c-bf644bdd1105 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:49:43.909447 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-04c4542e-7347-4ce7-a86c-bf644bdd1105 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:49:43.910733 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-04c4542e-7347-4ce7-a86c-bf644bdd1105 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:49:43.911456 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-04c4542e-7347-4ce7-a86c-bf644bdd1105 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:49:43.976390 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-04c4542e-7347-4ce7-a86c-bf644bdd1105 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '163b2f24a72649ac8084be1cac32fa09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e123e9b86124c93a7fc2db9984e7466', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:49:43.984634 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-04c4542e-7347-4ce7-a86c-bf644bdd1105 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] 10.222.0.11 "GET /compute/v2.1/servers/0698dc5b-5f47-46c4-ace8-f5e891a964a0" status: 200 len: 1218 microversion: 2.1 time: 0.094107 Nov 17 03:49:43.985283 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 1050/2290] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:49:43 2021] GET /compute/v2.1/servers/0698dc5b-5f47-46c4-ace8-f5e891a964a0 => generated 1218 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:49:45.007117 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-3eccd686-2d1f-4d32-b34f-0e550f4a25fb tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:49:45.008139 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-3eccd686-2d1f-4d32-b34f-0e550f4a25fb tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] [instance: 0698dc5b-5f47-46c4-ace8-f5e891a964a0] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:49:45.018646 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-3eccd686-2d1f-4d32-b34f-0e550f4a25fb tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:49:45.019382 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-3eccd686-2d1f-4d32-b34f-0e550f4a25fb tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:49:45.020640 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-3eccd686-2d1f-4d32-b34f-0e550f4a25fb tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:49:45.021396 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-3eccd686-2d1f-4d32-b34f-0e550f4a25fb tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:49:45.085927 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-3eccd686-2d1f-4d32-b34f-0e550f4a25fb tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '163b2f24a72649ac8084be1cac32fa09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e123e9b86124c93a7fc2db9984e7466', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:49:45.094744 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-3eccd686-2d1f-4d32-b34f-0e550f4a25fb tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] 10.222.0.11 "GET /compute/v2.1/servers/0698dc5b-5f47-46c4-ace8-f5e891a964a0" status: 200 len: 1218 microversion: 2.1 time: 0.094463 Nov 17 03:49:45.095296 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 1241/2291] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:49:44 2021] GET /compute/v2.1/servers/0698dc5b-5f47-46c4-ace8-f5e891a964a0 => generated 1218 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:49:46.114416 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-c34021ba-0640-4b99-8e2c-8ceb98ea2e68 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:49:46.115050 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-c34021ba-0640-4b99-8e2c-8ceb98ea2e68 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] [instance: 0698dc5b-5f47-46c4-ace8-f5e891a964a0] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:49:46.125511 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-c34021ba-0640-4b99-8e2c-8ceb98ea2e68 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:49:46.126018 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-c34021ba-0640-4b99-8e2c-8ceb98ea2e68 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:49:46.127192 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-c34021ba-0640-4b99-8e2c-8ceb98ea2e68 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:49:46.127779 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-c34021ba-0640-4b99-8e2c-8ceb98ea2e68 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:49:46.192286 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-c34021ba-0640-4b99-8e2c-8ceb98ea2e68 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '163b2f24a72649ac8084be1cac32fa09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e123e9b86124c93a7fc2db9984e7466', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:49:46.199985 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-c34021ba-0640-4b99-8e2c-8ceb98ea2e68 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] 10.222.0.11 "GET /compute/v2.1/servers/0698dc5b-5f47-46c4-ace8-f5e891a964a0" status: 200 len: 1218 microversion: 2.1 time: 0.091598 Nov 17 03:49:46.200554 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 1051/2292] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:49:46 2021] GET /compute/v2.1/servers/0698dc5b-5f47-46c4-ace8-f5e891a964a0 => generated 1218 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:49:47.221416 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-44e44956-ae3c-4ff5-a607-7cad18348b40 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:49:47.222194 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-44e44956-ae3c-4ff5-a607-7cad18348b40 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] [instance: 0698dc5b-5f47-46c4-ace8-f5e891a964a0] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:49:47.230879 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-44e44956-ae3c-4ff5-a607-7cad18348b40 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:49:47.231454 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-44e44956-ae3c-4ff5-a607-7cad18348b40 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:49:47.232471 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-44e44956-ae3c-4ff5-a607-7cad18348b40 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:49:47.233101 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-44e44956-ae3c-4ff5-a607-7cad18348b40 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:49:47.305167 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-44e44956-ae3c-4ff5-a607-7cad18348b40 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '163b2f24a72649ac8084be1cac32fa09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e123e9b86124c93a7fc2db9984e7466', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:49:47.316036 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-44e44956-ae3c-4ff5-a607-7cad18348b40 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] 10.222.0.11 "GET /compute/v2.1/servers/0698dc5b-5f47-46c4-ace8-f5e891a964a0" status: 200 len: 1218 microversion: 2.1 time: 0.100472 Nov 17 03:49:47.316746 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 1242/2293] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:49:47 2021] GET /compute/v2.1/servers/0698dc5b-5f47-46c4-ace8-f5e891a964a0 => generated 1218 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:49:48.337099 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-5aeeb663-46f0-45bb-a7ec-40fae9dbcd85 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:49:48.337988 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-5aeeb663-46f0-45bb-a7ec-40fae9dbcd85 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] [instance: 0698dc5b-5f47-46c4-ace8-f5e891a964a0] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:49:48.348934 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-5aeeb663-46f0-45bb-a7ec-40fae9dbcd85 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:49:48.349684 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-5aeeb663-46f0-45bb-a7ec-40fae9dbcd85 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:49:48.351054 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-5aeeb663-46f0-45bb-a7ec-40fae9dbcd85 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:49:48.351760 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-5aeeb663-46f0-45bb-a7ec-40fae9dbcd85 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:49:48.413967 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-5aeeb663-46f0-45bb-a7ec-40fae9dbcd85 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '163b2f24a72649ac8084be1cac32fa09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e123e9b86124c93a7fc2db9984e7466', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:49:48.421810 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-5aeeb663-46f0-45bb-a7ec-40fae9dbcd85 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] 10.222.0.11 "GET /compute/v2.1/servers/0698dc5b-5f47-46c4-ace8-f5e891a964a0" status: 200 len: 1218 microversion: 2.1 time: 0.090994 Nov 17 03:49:48.422386 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 1052/2294] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:49:48 2021] GET /compute/v2.1/servers/0698dc5b-5f47-46c4-ace8-f5e891a964a0 => generated 1218 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:49:49.441521 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-76abe6f2-e6fd-4c78-87d8-b47c602d0000 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:49:49.442472 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-76abe6f2-e6fd-4c78-87d8-b47c602d0000 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] [instance: 0698dc5b-5f47-46c4-ace8-f5e891a964a0] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:49:49.449673 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-76abe6f2-e6fd-4c78-87d8-b47c602d0000 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:49:49.450123 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-76abe6f2-e6fd-4c78-87d8-b47c602d0000 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:49:49.450931 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-76abe6f2-e6fd-4c78-87d8-b47c602d0000 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:49:49.451359 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-76abe6f2-e6fd-4c78-87d8-b47c602d0000 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:49:49.519334 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-76abe6f2-e6fd-4c78-87d8-b47c602d0000 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '163b2f24a72649ac8084be1cac32fa09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e123e9b86124c93a7fc2db9984e7466', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:49:49.526914 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-76abe6f2-e6fd-4c78-87d8-b47c602d0000 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] 10.222.0.11 "GET /compute/v2.1/servers/0698dc5b-5f47-46c4-ace8-f5e891a964a0" status: 200 len: 1218 microversion: 2.1 time: 0.090041 Nov 17 03:49:49.527475 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 1243/2295] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:49:49 2021] GET /compute/v2.1/servers/0698dc5b-5f47-46c4-ace8-f5e891a964a0 => generated 1218 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:49:50.547449 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-29934992-97bd-4e4b-8f63-b60f3c4702b1 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:49:50.548069 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-29934992-97bd-4e4b-8f63-b60f3c4702b1 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] [instance: 0698dc5b-5f47-46c4-ace8-f5e891a964a0] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:49:50.555854 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-29934992-97bd-4e4b-8f63-b60f3c4702b1 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:49:50.556346 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-29934992-97bd-4e4b-8f63-b60f3c4702b1 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:49:50.557251 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-29934992-97bd-4e4b-8f63-b60f3c4702b1 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:49:50.557715 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-29934992-97bd-4e4b-8f63-b60f3c4702b1 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:49:50.618592 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-29934992-97bd-4e4b-8f63-b60f3c4702b1 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '163b2f24a72649ac8084be1cac32fa09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e123e9b86124c93a7fc2db9984e7466', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:49:50.626163 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-29934992-97bd-4e4b-8f63-b60f3c4702b1 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] 10.222.0.11 "GET /compute/v2.1/servers/0698dc5b-5f47-46c4-ace8-f5e891a964a0" status: 200 len: 1218 microversion: 2.1 time: 0.084795 Nov 17 03:49:50.626728 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 1053/2296] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:49:50 2021] GET /compute/v2.1/servers/0698dc5b-5f47-46c4-ace8-f5e891a964a0 => generated 1218 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:49:51.646835 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-30d9b5b2-a9f4-4f83-afa4-c87b13c91255 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:49:51.647817 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-30d9b5b2-a9f4-4f83-afa4-c87b13c91255 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] [instance: 0698dc5b-5f47-46c4-ace8-f5e891a964a0] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:49:51.658182 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-30d9b5b2-a9f4-4f83-afa4-c87b13c91255 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:49:51.658627 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-30d9b5b2-a9f4-4f83-afa4-c87b13c91255 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:49:51.659393 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-30d9b5b2-a9f4-4f83-afa4-c87b13c91255 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:49:51.659933 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-30d9b5b2-a9f4-4f83-afa4-c87b13c91255 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:49:51.733811 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-30d9b5b2-a9f4-4f83-afa4-c87b13c91255 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '163b2f24a72649ac8084be1cac32fa09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e123e9b86124c93a7fc2db9984e7466', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:49:51.743597 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-30d9b5b2-a9f4-4f83-afa4-c87b13c91255 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] 10.222.0.11 "GET /compute/v2.1/servers/0698dc5b-5f47-46c4-ace8-f5e891a964a0" status: 200 len: 1218 microversion: 2.1 time: 0.102615 Nov 17 03:49:51.744712 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 1244/2297] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:49:51 2021] GET /compute/v2.1/servers/0698dc5b-5f47-46c4-ace8-f5e891a964a0 => generated 1218 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:49:52.765404 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-b95148c6-5f1a-46b5-8bdf-20868f62d2e9 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:49:52.766064 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-b95148c6-5f1a-46b5-8bdf-20868f62d2e9 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] [instance: 0698dc5b-5f47-46c4-ace8-f5e891a964a0] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:49:52.772707 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-b95148c6-5f1a-46b5-8bdf-20868f62d2e9 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:49:52.773174 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-b95148c6-5f1a-46b5-8bdf-20868f62d2e9 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:49:52.773932 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-b95148c6-5f1a-46b5-8bdf-20868f62d2e9 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:49:52.774363 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-b95148c6-5f1a-46b5-8bdf-20868f62d2e9 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:49:52.837463 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-b95148c6-5f1a-46b5-8bdf-20868f62d2e9 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '163b2f24a72649ac8084be1cac32fa09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e123e9b86124c93a7fc2db9984e7466', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:49:52.845762 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-b95148c6-5f1a-46b5-8bdf-20868f62d2e9 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] 10.222.0.11 "GET /compute/v2.1/servers/0698dc5b-5f47-46c4-ace8-f5e891a964a0" status: 200 len: 1218 microversion: 2.1 time: 0.086798 Nov 17 03:49:52.846331 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 1054/2298] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:49:52 2021] GET /compute/v2.1/servers/0698dc5b-5f47-46c4-ace8-f5e891a964a0 => generated 1218 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:49:53.866726 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-e780a371-94a5-46a1-94bf-7e13c912630b tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:49:53.867740 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-e780a371-94a5-46a1-94bf-7e13c912630b tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] [instance: 0698dc5b-5f47-46c4-ace8-f5e891a964a0] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:49:53.877161 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-e780a371-94a5-46a1-94bf-7e13c912630b tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:49:53.877611 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-e780a371-94a5-46a1-94bf-7e13c912630b tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:49:53.878383 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-e780a371-94a5-46a1-94bf-7e13c912630b tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:49:53.878811 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-e780a371-94a5-46a1-94bf-7e13c912630b tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:49:53.949285 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-e780a371-94a5-46a1-94bf-7e13c912630b tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '163b2f24a72649ac8084be1cac32fa09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e123e9b86124c93a7fc2db9984e7466', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:49:53.957203 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-e780a371-94a5-46a1-94bf-7e13c912630b tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] 10.222.0.11 "GET /compute/v2.1/servers/0698dc5b-5f47-46c4-ace8-f5e891a964a0" status: 200 len: 1218 microversion: 2.1 time: 0.096632 Nov 17 03:49:53.957774 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 1245/2299] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:49:53 2021] GET /compute/v2.1/servers/0698dc5b-5f47-46c4-ace8-f5e891a964a0 => generated 1218 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:49:54.976068 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-7a30cc57-b6ec-4224-ad73-f1ce8dbd9306 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:49:54.976827 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-7a30cc57-b6ec-4224-ad73-f1ce8dbd9306 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] [instance: 0698dc5b-5f47-46c4-ace8-f5e891a964a0] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:49:54.985049 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-7a30cc57-b6ec-4224-ad73-f1ce8dbd9306 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:49:54.985495 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-7a30cc57-b6ec-4224-ad73-f1ce8dbd9306 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:49:54.986258 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-7a30cc57-b6ec-4224-ad73-f1ce8dbd9306 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:49:54.986684 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-7a30cc57-b6ec-4224-ad73-f1ce8dbd9306 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:49:55.046547 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-7a30cc57-b6ec-4224-ad73-f1ce8dbd9306 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '163b2f24a72649ac8084be1cac32fa09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e123e9b86124c93a7fc2db9984e7466', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:49:55.054534 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-7a30cc57-b6ec-4224-ad73-f1ce8dbd9306 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] 10.222.0.11 "GET /compute/v2.1/servers/0698dc5b-5f47-46c4-ace8-f5e891a964a0" status: 200 len: 1218 microversion: 2.1 time: 0.083163 Nov 17 03:49:55.055074 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 1055/2300] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:49:54 2021] GET /compute/v2.1/servers/0698dc5b-5f47-46c4-ace8-f5e891a964a0 => generated 1218 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:49:56.071451 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-3131a777-ceac-42b9-a982-b2f9d5434b9a tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:49:56.072063 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-3131a777-ceac-42b9-a982-b2f9d5434b9a tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] [instance: 0698dc5b-5f47-46c4-ace8-f5e891a964a0] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:49:56.079059 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-3131a777-ceac-42b9-a982-b2f9d5434b9a tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:49:56.079507 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-3131a777-ceac-42b9-a982-b2f9d5434b9a tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:49:56.080297 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-3131a777-ceac-42b9-a982-b2f9d5434b9a tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:49:56.080720 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-3131a777-ceac-42b9-a982-b2f9d5434b9a tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:49:56.146212 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-3131a777-ceac-42b9-a982-b2f9d5434b9a tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '163b2f24a72649ac8084be1cac32fa09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e123e9b86124c93a7fc2db9984e7466', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:49:56.154420 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-3131a777-ceac-42b9-a982-b2f9d5434b9a tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] 10.222.0.11 "GET /compute/v2.1/servers/0698dc5b-5f47-46c4-ace8-f5e891a964a0" status: 200 len: 1218 microversion: 2.1 time: 0.086653 Nov 17 03:49:56.154973 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 1246/2301] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:49:56 2021] GET /compute/v2.1/servers/0698dc5b-5f47-46c4-ace8-f5e891a964a0 => generated 1218 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:49:56.653694 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 17 03:49:56.653994 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: Wed Nov 17 03:49:56 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Nov 17 03:49:57.175064 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-d04b635a-68b7-4e43-8d89-0ca71438d0d6 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:49:57.175668 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-d04b635a-68b7-4e43-8d89-0ca71438d0d6 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] [instance: 0698dc5b-5f47-46c4-ace8-f5e891a964a0] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:49:57.182777 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-d04b635a-68b7-4e43-8d89-0ca71438d0d6 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:49:57.183244 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-d04b635a-68b7-4e43-8d89-0ca71438d0d6 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:49:57.184036 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-d04b635a-68b7-4e43-8d89-0ca71438d0d6 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:49:57.184466 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-d04b635a-68b7-4e43-8d89-0ca71438d0d6 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:49:57.250976 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-d04b635a-68b7-4e43-8d89-0ca71438d0d6 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '163b2f24a72649ac8084be1cac32fa09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e123e9b86124c93a7fc2db9984e7466', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:49:57.263030 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-d04b635a-68b7-4e43-8d89-0ca71438d0d6 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] 10.222.0.11 "GET /compute/v2.1/servers/0698dc5b-5f47-46c4-ace8-f5e891a964a0" status: 200 len: 1218 microversion: 2.1 time: 0.092747 Nov 17 03:49:57.263902 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 1056/2302] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:49:57 2021] GET /compute/v2.1/servers/0698dc5b-5f47-46c4-ace8-f5e891a964a0 => generated 1218 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:49:58.283327 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-15af58fa-158a-4fcf-b883-c240ad21ff2d tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:49:58.283972 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-15af58fa-158a-4fcf-b883-c240ad21ff2d tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] [instance: 0698dc5b-5f47-46c4-ace8-f5e891a964a0] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:49:58.290708 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-15af58fa-158a-4fcf-b883-c240ad21ff2d tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:49:58.291156 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-15af58fa-158a-4fcf-b883-c240ad21ff2d tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:49:58.291925 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-15af58fa-158a-4fcf-b883-c240ad21ff2d tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:49:58.292355 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-15af58fa-158a-4fcf-b883-c240ad21ff2d tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:49:58.353043 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-15af58fa-158a-4fcf-b883-c240ad21ff2d tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '163b2f24a72649ac8084be1cac32fa09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e123e9b86124c93a7fc2db9984e7466', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:49:58.360484 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-15af58fa-158a-4fcf-b883-c240ad21ff2d tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] 10.222.0.11 "GET /compute/v2.1/servers/0698dc5b-5f47-46c4-ace8-f5e891a964a0" status: 200 len: 1218 microversion: 2.1 time: 0.081952 Nov 17 03:49:58.361176 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 1247/2303] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:49:58 2021] GET /compute/v2.1/servers/0698dc5b-5f47-46c4-ace8-f5e891a964a0 => generated 1218 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:49:59.381462 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-3a8cf2a4-3df6-4625-a6a3-1e2c51e015a4 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:49:59.382375 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-3a8cf2a4-3df6-4625-a6a3-1e2c51e015a4 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] [instance: 0698dc5b-5f47-46c4-ace8-f5e891a964a0] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:49:59.393052 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-3a8cf2a4-3df6-4625-a6a3-1e2c51e015a4 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:49:59.393868 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-3a8cf2a4-3df6-4625-a6a3-1e2c51e015a4 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:49:59.394713 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-3a8cf2a4-3df6-4625-a6a3-1e2c51e015a4 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:49:59.395142 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-3a8cf2a4-3df6-4625-a6a3-1e2c51e015a4 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:49:59.456602 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-3a8cf2a4-3df6-4625-a6a3-1e2c51e015a4 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '163b2f24a72649ac8084be1cac32fa09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e123e9b86124c93a7fc2db9984e7466', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:49:59.464124 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-3a8cf2a4-3df6-4625-a6a3-1e2c51e015a4 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] 10.222.0.11 "GET /compute/v2.1/servers/0698dc5b-5f47-46c4-ace8-f5e891a964a0" status: 200 len: 1218 microversion: 2.1 time: 0.089049 Nov 17 03:49:59.464673 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 1057/2304] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:49:59 2021] GET /compute/v2.1/servers/0698dc5b-5f47-46c4-ace8-f5e891a964a0 => generated 1218 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:50:00.485317 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-f1ef91a5-8344-4c21-93dc-ebbbaff9121d tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:50:00.486216 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-f1ef91a5-8344-4c21-93dc-ebbbaff9121d tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] [instance: 0698dc5b-5f47-46c4-ace8-f5e891a964a0] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:50:00.496769 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-f1ef91a5-8344-4c21-93dc-ebbbaff9121d tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:50:00.497554 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-f1ef91a5-8344-4c21-93dc-ebbbaff9121d tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:50:00.498812 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-f1ef91a5-8344-4c21-93dc-ebbbaff9121d tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:50:00.499519 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-f1ef91a5-8344-4c21-93dc-ebbbaff9121d tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:50:00.559546 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-f1ef91a5-8344-4c21-93dc-ebbbaff9121d tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '163b2f24a72649ac8084be1cac32fa09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e123e9b86124c93a7fc2db9984e7466', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:50:00.567122 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-f1ef91a5-8344-4c21-93dc-ebbbaff9121d tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] 10.222.0.11 "GET /compute/v2.1/servers/0698dc5b-5f47-46c4-ace8-f5e891a964a0" status: 200 len: 1218 microversion: 2.1 time: 0.088254 Nov 17 03:50:00.567786 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 1248/2305] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:50:00 2021] GET /compute/v2.1/servers/0698dc5b-5f47-46c4-ace8-f5e891a964a0 => generated 1218 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:50:01.591038 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-fe3ff582-16ee-41c8-91bc-069abeb0de05 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:50:01.592019 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-fe3ff582-16ee-41c8-91bc-069abeb0de05 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] [instance: 0698dc5b-5f47-46c4-ace8-f5e891a964a0] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:50:01.602827 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-fe3ff582-16ee-41c8-91bc-069abeb0de05 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:50:01.603576 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-fe3ff582-16ee-41c8-91bc-069abeb0de05 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:50:01.604872 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-fe3ff582-16ee-41c8-91bc-069abeb0de05 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:50:01.605637 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-fe3ff582-16ee-41c8-91bc-069abeb0de05 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:50:01.669052 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-fe3ff582-16ee-41c8-91bc-069abeb0de05 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '163b2f24a72649ac8084be1cac32fa09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e123e9b86124c93a7fc2db9984e7466', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:50:01.682307 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-fe3ff582-16ee-41c8-91bc-069abeb0de05 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] 10.222.0.11 "GET /compute/v2.1/servers/0698dc5b-5f47-46c4-ace8-f5e891a964a0" status: 200 len: 1218 microversion: 2.1 time: 0.096923 Nov 17 03:50:01.683936 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 1058/2306] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:50:01 2021] GET /compute/v2.1/servers/0698dc5b-5f47-46c4-ace8-f5e891a964a0 => generated 1218 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:50:02.711173 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-ed8c7d23-33ef-4756-b637-70a20f5c513e tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:50:02.712070 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-ed8c7d23-33ef-4756-b637-70a20f5c513e tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] [instance: 0698dc5b-5f47-46c4-ace8-f5e891a964a0] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:50:02.722919 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-ed8c7d23-33ef-4756-b637-70a20f5c513e tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:50:02.723640 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-ed8c7d23-33ef-4756-b637-70a20f5c513e tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:50:02.724411 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-ed8c7d23-33ef-4756-b637-70a20f5c513e tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:50:02.724882 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-ed8c7d23-33ef-4756-b637-70a20f5c513e tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:50:02.794962 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-ed8c7d23-33ef-4756-b637-70a20f5c513e tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '163b2f24a72649ac8084be1cac32fa09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e123e9b86124c93a7fc2db9984e7466', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:50:02.802992 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-ed8c7d23-33ef-4756-b637-70a20f5c513e tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] 10.222.0.11 "GET /compute/v2.1/servers/0698dc5b-5f47-46c4-ace8-f5e891a964a0" status: 200 len: 1218 microversion: 2.1 time: 0.098313 Nov 17 03:50:02.803556 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 1249/2307] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:50:02 2021] GET /compute/v2.1/servers/0698dc5b-5f47-46c4-ace8-f5e891a964a0 => generated 1218 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:50:03.823480 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-a07e88fa-161f-45a2-a377-14c2e258d511 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:50:03.824146 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-a07e88fa-161f-45a2-a377-14c2e258d511 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] [instance: 0698dc5b-5f47-46c4-ace8-f5e891a964a0] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:50:03.833747 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-a07e88fa-161f-45a2-a377-14c2e258d511 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:50:03.834196 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-a07e88fa-161f-45a2-a377-14c2e258d511 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:50:03.834971 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-a07e88fa-161f-45a2-a377-14c2e258d511 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:50:03.835403 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-a07e88fa-161f-45a2-a377-14c2e258d511 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:50:03.904664 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-a07e88fa-161f-45a2-a377-14c2e258d511 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '163b2f24a72649ac8084be1cac32fa09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e123e9b86124c93a7fc2db9984e7466', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:50:03.912701 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-a07e88fa-161f-45a2-a377-14c2e258d511 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] 10.222.0.11 "GET /compute/v2.1/servers/0698dc5b-5f47-46c4-ace8-f5e891a964a0" status: 200 len: 1218 microversion: 2.1 time: 0.095283 Nov 17 03:50:03.913304 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 1059/2308] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:50:03 2021] GET /compute/v2.1/servers/0698dc5b-5f47-46c4-ace8-f5e891a964a0 => generated 1218 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:50:04.934108 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-12774f47-4595-4de3-8bb8-8295df8886aa tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:50:04.935139 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-12774f47-4595-4de3-8bb8-8295df8886aa tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] [instance: 0698dc5b-5f47-46c4-ace8-f5e891a964a0] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:50:04.944390 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-12774f47-4595-4de3-8bb8-8295df8886aa tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:50:04.944869 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-12774f47-4595-4de3-8bb8-8295df8886aa tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:50:04.945643 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-12774f47-4595-4de3-8bb8-8295df8886aa tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:50:04.946072 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-12774f47-4595-4de3-8bb8-8295df8886aa tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:50:05.018229 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-12774f47-4595-4de3-8bb8-8295df8886aa tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '163b2f24a72649ac8084be1cac32fa09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e123e9b86124c93a7fc2db9984e7466', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:50:05.025871 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-12774f47-4595-4de3-8bb8-8295df8886aa tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] 10.222.0.11 "GET /compute/v2.1/servers/0698dc5b-5f47-46c4-ace8-f5e891a964a0" status: 200 len: 1218 microversion: 2.1 time: 0.098355 Nov 17 03:50:05.026430 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 1250/2309] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:50:04 2021] GET /compute/v2.1/servers/0698dc5b-5f47-46c4-ace8-f5e891a964a0 => generated 1218 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:50:06.046136 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-a823325c-f3fe-4e27-a398-77d563ea1ac3 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:50:06.047082 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-a823325c-f3fe-4e27-a398-77d563ea1ac3 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] [instance: 0698dc5b-5f47-46c4-ace8-f5e891a964a0] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:50:06.055974 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-a823325c-f3fe-4e27-a398-77d563ea1ac3 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:50:06.056848 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-a823325c-f3fe-4e27-a398-77d563ea1ac3 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:50:06.057680 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-a823325c-f3fe-4e27-a398-77d563ea1ac3 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:50:06.058114 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-a823325c-f3fe-4e27-a398-77d563ea1ac3 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:50:06.121520 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-a823325c-f3fe-4e27-a398-77d563ea1ac3 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '163b2f24a72649ac8084be1cac32fa09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e123e9b86124c93a7fc2db9984e7466', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:50:06.129957 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-a823325c-f3fe-4e27-a398-77d563ea1ac3 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] 10.222.0.11 "GET /compute/v2.1/servers/0698dc5b-5f47-46c4-ace8-f5e891a964a0" status: 200 len: 1218 microversion: 2.1 time: 0.089891 Nov 17 03:50:06.130552 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 1060/2310] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:50:06 2021] GET /compute/v2.1/servers/0698dc5b-5f47-46c4-ace8-f5e891a964a0 => generated 1218 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:50:07.151090 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-00937def-97da-47d0-8d8b-72772c361a1d tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:50:07.152105 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-00937def-97da-47d0-8d8b-72772c361a1d tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] [instance: 0698dc5b-5f47-46c4-ace8-f5e891a964a0] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:50:07.161586 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-00937def-97da-47d0-8d8b-72772c361a1d tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:50:07.162035 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-00937def-97da-47d0-8d8b-72772c361a1d tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:50:07.162799 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-00937def-97da-47d0-8d8b-72772c361a1d tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:50:07.163226 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-00937def-97da-47d0-8d8b-72772c361a1d tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:50:07.222892 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-00937def-97da-47d0-8d8b-72772c361a1d tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '163b2f24a72649ac8084be1cac32fa09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e123e9b86124c93a7fc2db9984e7466', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:50:07.232834 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-00937def-97da-47d0-8d8b-72772c361a1d tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] 10.222.0.11 "GET /compute/v2.1/servers/0698dc5b-5f47-46c4-ace8-f5e891a964a0" status: 200 len: 1218 microversion: 2.1 time: 0.087960 Nov 17 03:50:07.233610 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 1251/2311] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:50:07 2021] GET /compute/v2.1/servers/0698dc5b-5f47-46c4-ace8-f5e891a964a0 => generated 1218 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:50:08.256574 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-c5ef8f4f-be15-4b98-9573-f91deb053a4c tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:50:08.257336 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-c5ef8f4f-be15-4b98-9573-f91deb053a4c tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] [instance: 0698dc5b-5f47-46c4-ace8-f5e891a964a0] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:50:08.265289 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-c5ef8f4f-be15-4b98-9573-f91deb053a4c tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:50:08.265771 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-c5ef8f4f-be15-4b98-9573-f91deb053a4c tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:50:08.266702 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-c5ef8f4f-be15-4b98-9573-f91deb053a4c tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:50:08.267203 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-c5ef8f4f-be15-4b98-9573-f91deb053a4c tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:50:08.328621 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-c5ef8f4f-be15-4b98-9573-f91deb053a4c tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '163b2f24a72649ac8084be1cac32fa09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e123e9b86124c93a7fc2db9984e7466', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:50:08.336221 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-c5ef8f4f-be15-4b98-9573-f91deb053a4c tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] 10.222.0.11 "GET /compute/v2.1/servers/0698dc5b-5f47-46c4-ace8-f5e891a964a0" status: 200 len: 1218 microversion: 2.1 time: 0.084026 Nov 17 03:50:08.336801 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 1061/2312] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:50:08 2021] GET /compute/v2.1/servers/0698dc5b-5f47-46c4-ace8-f5e891a964a0 => generated 1218 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:50:09.356963 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-88cfc04a-ce6b-4153-ae2d-d60bfe3eee0e tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:50:09.357904 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-88cfc04a-ce6b-4153-ae2d-d60bfe3eee0e tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] [instance: 0698dc5b-5f47-46c4-ace8-f5e891a964a0] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:50:09.368493 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-88cfc04a-ce6b-4153-ae2d-d60bfe3eee0e tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:50:09.369287 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-88cfc04a-ce6b-4153-ae2d-d60bfe3eee0e tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:50:09.370540 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-88cfc04a-ce6b-4153-ae2d-d60bfe3eee0e tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:50:09.371246 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-88cfc04a-ce6b-4153-ae2d-d60bfe3eee0e tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:50:09.435247 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-88cfc04a-ce6b-4153-ae2d-d60bfe3eee0e tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '163b2f24a72649ac8084be1cac32fa09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e123e9b86124c93a7fc2db9984e7466', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:50:09.443719 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-88cfc04a-ce6b-4153-ae2d-d60bfe3eee0e tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] 10.222.0.11 "GET /compute/v2.1/servers/0698dc5b-5f47-46c4-ace8-f5e891a964a0" status: 200 len: 1218 microversion: 2.1 time: 0.093062 Nov 17 03:50:09.444285 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 1252/2313] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:50:09 2021] GET /compute/v2.1/servers/0698dc5b-5f47-46c4-ace8-f5e891a964a0 => generated 1218 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:50:09.966402 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 17 03:50:09.967226 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: Wed Nov 17 03:50:09 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Nov 17 03:50:10.463576 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-13f53078-8426-416a-923e-5f27702a4f87 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:50:10.464197 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-13f53078-8426-416a-923e-5f27702a4f87 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] [instance: 0698dc5b-5f47-46c4-ace8-f5e891a964a0] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:50:10.472037 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-13f53078-8426-416a-923e-5f27702a4f87 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:50:10.472565 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-13f53078-8426-416a-923e-5f27702a4f87 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:50:10.473575 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-13f53078-8426-416a-923e-5f27702a4f87 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:50:10.474116 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-13f53078-8426-416a-923e-5f27702a4f87 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:50:10.535336 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-13f53078-8426-416a-923e-5f27702a4f87 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '163b2f24a72649ac8084be1cac32fa09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e123e9b86124c93a7fc2db9984e7466', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:50:10.542876 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-13f53078-8426-416a-923e-5f27702a4f87 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] 10.222.0.11 "GET /compute/v2.1/servers/0698dc5b-5f47-46c4-ace8-f5e891a964a0" status: 200 len: 1218 microversion: 2.1 time: 0.084517 Nov 17 03:50:10.543445 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 1062/2314] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:50:10 2021] GET /compute/v2.1/servers/0698dc5b-5f47-46c4-ace8-f5e891a964a0 => generated 1218 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:50:11.563499 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-d660ac3c-9891-49f4-a6f3-46c45fafd2bd tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:50:11.564495 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-d660ac3c-9891-49f4-a6f3-46c45fafd2bd tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] [instance: 0698dc5b-5f47-46c4-ace8-f5e891a964a0] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:50:11.572552 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-d660ac3c-9891-49f4-a6f3-46c45fafd2bd tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:50:11.573043 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-d660ac3c-9891-49f4-a6f3-46c45fafd2bd tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:50:11.573807 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-d660ac3c-9891-49f4-a6f3-46c45fafd2bd tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:50:11.574235 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-d660ac3c-9891-49f4-a6f3-46c45fafd2bd tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:50:11.641927 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-d660ac3c-9891-49f4-a6f3-46c45fafd2bd tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '163b2f24a72649ac8084be1cac32fa09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e123e9b86124c93a7fc2db9984e7466', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:50:11.649776 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-d660ac3c-9891-49f4-a6f3-46c45fafd2bd tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] 10.222.0.11 "GET /compute/v2.1/servers/0698dc5b-5f47-46c4-ace8-f5e891a964a0" status: 200 len: 1218 microversion: 2.1 time: 0.092557 Nov 17 03:50:11.650314 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 1253/2315] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:50:11 2021] GET /compute/v2.1/servers/0698dc5b-5f47-46c4-ace8-f5e891a964a0 => generated 1218 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:50:12.674262 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-3bafec96-3a0e-43ac-abcc-342d2d7a0492 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:50:12.675235 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-3bafec96-3a0e-43ac-abcc-342d2d7a0492 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] [instance: 0698dc5b-5f47-46c4-ace8-f5e891a964a0] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:50:12.684838 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-3bafec96-3a0e-43ac-abcc-342d2d7a0492 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:50:12.685440 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-3bafec96-3a0e-43ac-abcc-342d2d7a0492 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:50:12.686567 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-3bafec96-3a0e-43ac-abcc-342d2d7a0492 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:50:12.687330 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-3bafec96-3a0e-43ac-abcc-342d2d7a0492 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:50:12.750199 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-3bafec96-3a0e-43ac-abcc-342d2d7a0492 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '163b2f24a72649ac8084be1cac32fa09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e123e9b86124c93a7fc2db9984e7466', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:50:12.758578 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-3bafec96-3a0e-43ac-abcc-342d2d7a0492 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] 10.222.0.11 "GET /compute/v2.1/servers/0698dc5b-5f47-46c4-ace8-f5e891a964a0" status: 200 len: 1218 microversion: 2.1 time: 0.090451 Nov 17 03:50:12.759141 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 1063/2316] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:50:12 2021] GET /compute/v2.1/servers/0698dc5b-5f47-46c4-ace8-f5e891a964a0 => generated 1218 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:50:13.779287 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-7c754e50-3c67-4b19-802d-a63ecb1a3c59 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:50:13.780206 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-7c754e50-3c67-4b19-802d-a63ecb1a3c59 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] [instance: 0698dc5b-5f47-46c4-ace8-f5e891a964a0] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:50:13.789436 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-7c754e50-3c67-4b19-802d-a63ecb1a3c59 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:50:13.789877 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-7c754e50-3c67-4b19-802d-a63ecb1a3c59 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:50:13.790638 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-7c754e50-3c67-4b19-802d-a63ecb1a3c59 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:50:13.791070 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-7c754e50-3c67-4b19-802d-a63ecb1a3c59 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:50:13.851587 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-7c754e50-3c67-4b19-802d-a63ecb1a3c59 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '163b2f24a72649ac8084be1cac32fa09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e123e9b86124c93a7fc2db9984e7466', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:50:13.859119 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-7c754e50-3c67-4b19-802d-a63ecb1a3c59 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] 10.222.0.11 "GET /compute/v2.1/servers/0698dc5b-5f47-46c4-ace8-f5e891a964a0" status: 200 len: 1218 microversion: 2.1 time: 0.086063 Nov 17 03:50:13.859679 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 1254/2317] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:50:13 2021] GET /compute/v2.1/servers/0698dc5b-5f47-46c4-ace8-f5e891a964a0 => generated 1218 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:50:14.879886 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-c9fc0b1a-80ec-4e23-bab2-0e30ef1cc0b6 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:50:14.880955 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-c9fc0b1a-80ec-4e23-bab2-0e30ef1cc0b6 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] [instance: 0698dc5b-5f47-46c4-ace8-f5e891a964a0] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:50:14.892608 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-c9fc0b1a-80ec-4e23-bab2-0e30ef1cc0b6 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:50:14.893424 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-c9fc0b1a-80ec-4e23-bab2-0e30ef1cc0b6 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:50:14.894703 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-c9fc0b1a-80ec-4e23-bab2-0e30ef1cc0b6 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:50:14.895435 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-c9fc0b1a-80ec-4e23-bab2-0e30ef1cc0b6 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:50:14.955426 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-c9fc0b1a-80ec-4e23-bab2-0e30ef1cc0b6 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '163b2f24a72649ac8084be1cac32fa09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e123e9b86124c93a7fc2db9984e7466', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:50:14.963200 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-c9fc0b1a-80ec-4e23-bab2-0e30ef1cc0b6 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] 10.222.0.11 "GET /compute/v2.1/servers/0698dc5b-5f47-46c4-ace8-f5e891a964a0" status: 200 len: 1218 microversion: 2.1 time: 0.089482 Nov 17 03:50:14.963839 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 1064/2318] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:50:14 2021] GET /compute/v2.1/servers/0698dc5b-5f47-46c4-ace8-f5e891a964a0 => generated 1218 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:50:15.984399 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-7238cd4d-ddcc-4a4b-a4e4-0e7e579ac3d9 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:50:15.985445 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-7238cd4d-ddcc-4a4b-a4e4-0e7e579ac3d9 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] [instance: 0698dc5b-5f47-46c4-ace8-f5e891a964a0] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:50:15.996332 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-7238cd4d-ddcc-4a4b-a4e4-0e7e579ac3d9 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:50:15.997144 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-7238cd4d-ddcc-4a4b-a4e4-0e7e579ac3d9 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:50:15.998422 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-7238cd4d-ddcc-4a4b-a4e4-0e7e579ac3d9 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:50:15.999127 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-7238cd4d-ddcc-4a4b-a4e4-0e7e579ac3d9 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:50:16.068715 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-7238cd4d-ddcc-4a4b-a4e4-0e7e579ac3d9 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '163b2f24a72649ac8084be1cac32fa09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e123e9b86124c93a7fc2db9984e7466', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:50:16.079437 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-7238cd4d-ddcc-4a4b-a4e4-0e7e579ac3d9 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] 10.222.0.11 "GET /compute/v2.1/servers/0698dc5b-5f47-46c4-ace8-f5e891a964a0" status: 200 len: 1218 microversion: 2.1 time: 0.101002 Nov 17 03:50:16.080126 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 1255/2319] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:50:15 2021] GET /compute/v2.1/servers/0698dc5b-5f47-46c4-ace8-f5e891a964a0 => generated 1218 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:50:17.102250 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-df147543-ba6c-4d95-ae60-d2947de56de1 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:50:17.102832 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-df147543-ba6c-4d95-ae60-d2947de56de1 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] [instance: 0698dc5b-5f47-46c4-ace8-f5e891a964a0] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:50:17.109988 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-df147543-ba6c-4d95-ae60-d2947de56de1 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:50:17.110432 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-df147543-ba6c-4d95-ae60-d2947de56de1 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:50:17.111193 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-df147543-ba6c-4d95-ae60-d2947de56de1 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:50:17.111701 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-df147543-ba6c-4d95-ae60-d2947de56de1 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:50:17.180809 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-df147543-ba6c-4d95-ae60-d2947de56de1 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '163b2f24a72649ac8084be1cac32fa09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e123e9b86124c93a7fc2db9984e7466', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:50:17.188322 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-df147543-ba6c-4d95-ae60-d2947de56de1 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] 10.222.0.11 "GET /compute/v2.1/servers/0698dc5b-5f47-46c4-ace8-f5e891a964a0" status: 200 len: 1218 microversion: 2.1 time: 0.090421 Nov 17 03:50:17.188900 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 1065/2320] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:50:17 2021] GET /compute/v2.1/servers/0698dc5b-5f47-46c4-ace8-f5e891a964a0 => generated 1218 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:50:18.209948 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-c1b1b685-f0eb-4804-bffe-9bee3396fb98 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:50:18.210863 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-c1b1b685-f0eb-4804-bffe-9bee3396fb98 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] [instance: 0698dc5b-5f47-46c4-ace8-f5e891a964a0] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:50:18.218087 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-c1b1b685-f0eb-4804-bffe-9bee3396fb98 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:50:18.218555 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-c1b1b685-f0eb-4804-bffe-9bee3396fb98 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:50:18.219393 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-c1b1b685-f0eb-4804-bffe-9bee3396fb98 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:50:18.219850 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-c1b1b685-f0eb-4804-bffe-9bee3396fb98 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:50:18.286578 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-c1b1b685-f0eb-4804-bffe-9bee3396fb98 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '163b2f24a72649ac8084be1cac32fa09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e123e9b86124c93a7fc2db9984e7466', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:50:18.294881 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-c1b1b685-f0eb-4804-bffe-9bee3396fb98 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] 10.222.0.11 "GET /compute/v2.1/servers/0698dc5b-5f47-46c4-ace8-f5e891a964a0" status: 200 len: 1218 microversion: 2.1 time: 0.091348 Nov 17 03:50:18.295445 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 1256/2321] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:50:18 2021] GET /compute/v2.1/servers/0698dc5b-5f47-46c4-ace8-f5e891a964a0 => generated 1218 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:50:19.320628 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-b83bdf45-3c18-417c-b04f-a9df5e536ac5 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:50:19.321346 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-b83bdf45-3c18-417c-b04f-a9df5e536ac5 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] [instance: 0698dc5b-5f47-46c4-ace8-f5e891a964a0] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:50:19.329537 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-b83bdf45-3c18-417c-b04f-a9df5e536ac5 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:50:19.330091 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-b83bdf45-3c18-417c-b04f-a9df5e536ac5 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:50:19.331052 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-b83bdf45-3c18-417c-b04f-a9df5e536ac5 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:50:19.331588 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-b83bdf45-3c18-417c-b04f-a9df5e536ac5 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:50:19.399458 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-b83bdf45-3c18-417c-b04f-a9df5e536ac5 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '163b2f24a72649ac8084be1cac32fa09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e123e9b86124c93a7fc2db9984e7466', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:50:19.407805 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-b83bdf45-3c18-417c-b04f-a9df5e536ac5 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] 10.222.0.11 "GET /compute/v2.1/servers/0698dc5b-5f47-46c4-ace8-f5e891a964a0" status: 200 len: 1218 microversion: 2.1 time: 0.093478 Nov 17 03:50:19.408378 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 1066/2322] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:50:19 2021] GET /compute/v2.1/servers/0698dc5b-5f47-46c4-ace8-f5e891a964a0 => generated 1218 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:50:20.426236 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-10cd9660-d9c5-494c-85c3-fdde790ca95d tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:50:20.426854 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-10cd9660-d9c5-494c-85c3-fdde790ca95d tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] [instance: 0698dc5b-5f47-46c4-ace8-f5e891a964a0] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:50:20.434320 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-10cd9660-d9c5-494c-85c3-fdde790ca95d tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:50:20.434922 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-10cd9660-d9c5-494c-85c3-fdde790ca95d tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:50:20.435702 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-10cd9660-d9c5-494c-85c3-fdde790ca95d tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:50:20.436143 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-10cd9660-d9c5-494c-85c3-fdde790ca95d tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:50:20.439787 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-c844395a-fb44-46f3-81dc-61e8cd4e813b tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:50:20.440811 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-c844395a-fb44-46f3-81dc-61e8cd4e813b tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] [instance: 5d54db85-b991-4890-abaa-952413baa2e7] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:50:20.447705 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-c844395a-fb44-46f3-81dc-61e8cd4e813b tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:50:20.448481 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-c844395a-fb44-46f3-81dc-61e8cd4e813b tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:50:20.449492 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-c844395a-fb44-46f3-81dc-61e8cd4e813b tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:50:20.450109 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-c844395a-fb44-46f3-81dc-61e8cd4e813b tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:50:20.483523 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-c844395a-fb44-46f3-81dc-61e8cd4e813b tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] [instance: 5d54db85-b991-4890-abaa-952413baa2e7] Going to try to terminate instance {{(pid=115916) delete /opt/stack/nova/nova/compute/api.py:2614}} Nov 17 03:50:20.502612 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-10cd9660-d9c5-494c-85c3-fdde790ca95d tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '163b2f24a72649ac8084be1cac32fa09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e123e9b86124c93a7fc2db9984e7466', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:50:20.510159 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-10cd9660-d9c5-494c-85c3-fdde790ca95d tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] 10.222.0.11 "GET /compute/v2.1/servers/0698dc5b-5f47-46c4-ace8-f5e891a964a0" status: 200 len: 1218 microversion: 2.1 time: 0.087829 Nov 17 03:50:20.510737 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 1257/2323] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:50:20 2021] GET /compute/v2.1/servers/0698dc5b-5f47-46c4-ace8-f5e891a964a0 => generated 1218 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:50:20.544943 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: ERROR oslo.messaging._drivers.impl_rabbit [None req-c844395a-fb44-46f3-81dc-61e8cd4e813b tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] [201d3e2d-67a7-4ecf-8825-2618ae09d16b] AMQP server on 10.222.0.11:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Nov 17 03:50:21.530969 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-5dc8df8e-b6be-4938-9799-707d6145cfd3 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:50:21.532034 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-5dc8df8e-b6be-4938-9799-707d6145cfd3 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] [instance: 0698dc5b-5f47-46c4-ace8-f5e891a964a0] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:50:21.542692 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-5dc8df8e-b6be-4938-9799-707d6145cfd3 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:50:21.543445 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-5dc8df8e-b6be-4938-9799-707d6145cfd3 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:50:21.544718 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-5dc8df8e-b6be-4938-9799-707d6145cfd3 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:50:21.545707 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-5dc8df8e-b6be-4938-9799-707d6145cfd3 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:50:21.565364 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO oslo.messaging._drivers.impl_rabbit [None req-c844395a-fb44-46f3-81dc-61e8cd4e813b tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] [201d3e2d-67a7-4ecf-8825-2618ae09d16b] Reconnected to AMQP server on 10.222.0.11:5672 via [amqp] client with port 44834. Nov 17 03:50:21.588731 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-c844395a-fb44-46f3-81dc-61e8cd4e813b tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] 10.222.0.11 "DELETE /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7" status: 204 len: 0 microversion: 2.20 time: 1.152380 Nov 17 03:50:21.593073 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 1067/2324] 10.222.0.11 () {60 vars in 1279 bytes} [Wed Nov 17 03:50:20 2021] DELETE /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7 => generated 0 bytes in 1154 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Nov 17 03:50:21.599873 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-ebdbcc3e-3289-439f-89b8-bed739ca841b tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:50:21.600571 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-ebdbcc3e-3289-439f-89b8-bed739ca841b tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] [instance: 5d54db85-b991-4890-abaa-952413baa2e7] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:50:21.606687 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-ebdbcc3e-3289-439f-89b8-bed739ca841b tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:50:21.607137 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-ebdbcc3e-3289-439f-89b8-bed739ca841b tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:50:21.608039 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-ebdbcc3e-3289-439f-89b8-bed739ca841b tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:50:21.608742 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-ebdbcc3e-3289-439f-89b8-bed739ca841b tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:50:21.610962 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-5dc8df8e-b6be-4938-9799-707d6145cfd3 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '163b2f24a72649ac8084be1cac32fa09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e123e9b86124c93a7fc2db9984e7466', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:50:21.618866 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-5dc8df8e-b6be-4938-9799-707d6145cfd3 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] 10.222.0.11 "GET /compute/v2.1/servers/0698dc5b-5f47-46c4-ace8-f5e891a964a0" status: 200 len: 1218 microversion: 2.1 time: 0.094106 Nov 17 03:50:21.619537 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 1258/2325] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:50:21 2021] GET /compute/v2.1/servers/0698dc5b-5f47-46c4-ace8-f5e891a964a0 => generated 1218 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:50:21.747100 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-ebdbcc3e-3289-439f-89b8-bed739ca841b tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37f21d6d15cf40a586edda211219fd08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ebb970305844dccacf48a7d8d47ecf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:50:21.759369 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-ebdbcc3e-3289-439f-89b8-bed739ca841b tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '37f21d6d15cf40a586edda211219fd08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ebb970305844dccacf48a7d8d47ecf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:50:21.760864 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-ebdbcc3e-3289-439f-89b8-bed739ca841b tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '37f21d6d15cf40a586edda211219fd08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ebb970305844dccacf48a7d8d47ecf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:50:21.762018 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-ebdbcc3e-3289-439f-89b8-bed739ca841b tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] 10.222.0.11 "GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7" status: 200 len: 1803 microversion: 2.20 time: 0.167555 Nov 17 03:50:21.762575 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 1068/2326] 10.222.0.11 () {60 vars in 1276 bytes} [Wed Nov 17 03:50:21 2021] GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7 => generated 1803 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 17 03:50:22.639712 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-5c2fa9b6-5423-4e49-914a-eb3d5c6e353a tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:50:22.640670 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-5c2fa9b6-5423-4e49-914a-eb3d5c6e353a tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] [instance: 0698dc5b-5f47-46c4-ace8-f5e891a964a0] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:50:22.651300 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-5c2fa9b6-5423-4e49-914a-eb3d5c6e353a tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:50:22.652055 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-5c2fa9b6-5423-4e49-914a-eb3d5c6e353a tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:50:22.653413 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-5c2fa9b6-5423-4e49-914a-eb3d5c6e353a tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:50:22.654123 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-5c2fa9b6-5423-4e49-914a-eb3d5c6e353a tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:50:22.718014 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-5c2fa9b6-5423-4e49-914a-eb3d5c6e353a tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '163b2f24a72649ac8084be1cac32fa09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e123e9b86124c93a7fc2db9984e7466', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:50:22.725588 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-5c2fa9b6-5423-4e49-914a-eb3d5c6e353a tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] 10.222.0.11 "GET /compute/v2.1/servers/0698dc5b-5f47-46c4-ace8-f5e891a964a0" status: 200 len: 1218 microversion: 2.1 time: 0.092429 Nov 17 03:50:22.726247 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 1259/2327] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:50:22 2021] GET /compute/v2.1/servers/0698dc5b-5f47-46c4-ace8-f5e891a964a0 => generated 1218 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:50:22.784009 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-a162c7f2-4c3e-4723-a82d-af77210b5572 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:50:22.784962 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-a162c7f2-4c3e-4723-a82d-af77210b5572 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] [instance: 5d54db85-b991-4890-abaa-952413baa2e7] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:50:22.795488 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-a162c7f2-4c3e-4723-a82d-af77210b5572 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:50:22.796313 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-a162c7f2-4c3e-4723-a82d-af77210b5572 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:50:22.797557 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-a162c7f2-4c3e-4723-a82d-af77210b5572 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:50:22.798277 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-a162c7f2-4c3e-4723-a82d-af77210b5572 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:50:22.941405 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-a162c7f2-4c3e-4723-a82d-af77210b5572 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37f21d6d15cf40a586edda211219fd08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ebb970305844dccacf48a7d8d47ecf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:50:22.954835 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-a162c7f2-4c3e-4723-a82d-af77210b5572 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '37f21d6d15cf40a586edda211219fd08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ebb970305844dccacf48a7d8d47ecf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:50:22.957269 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-a162c7f2-4c3e-4723-a82d-af77210b5572 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '37f21d6d15cf40a586edda211219fd08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ebb970305844dccacf48a7d8d47ecf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:50:22.958993 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-a162c7f2-4c3e-4723-a82d-af77210b5572 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] 10.222.0.11 "GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7" status: 200 len: 1803 microversion: 2.20 time: 0.180941 Nov 17 03:50:22.959785 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 1069/2328] 10.222.0.11 () {60 vars in 1276 bytes} [Wed Nov 17 03:50:22 2021] GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7 => generated 1803 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 17 03:50:23.747250 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-dc0e063c-627b-4e10-b411-d3cccca2ad48 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:50:23.748233 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-dc0e063c-627b-4e10-b411-d3cccca2ad48 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] [instance: 0698dc5b-5f47-46c4-ace8-f5e891a964a0] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:50:23.758787 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-dc0e063c-627b-4e10-b411-d3cccca2ad48 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:50:23.759534 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-dc0e063c-627b-4e10-b411-d3cccca2ad48 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:50:23.760825 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-dc0e063c-627b-4e10-b411-d3cccca2ad48 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:50:23.761561 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-dc0e063c-627b-4e10-b411-d3cccca2ad48 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:50:23.827030 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-dc0e063c-627b-4e10-b411-d3cccca2ad48 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '163b2f24a72649ac8084be1cac32fa09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e123e9b86124c93a7fc2db9984e7466', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:50:23.835155 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-dc0e063c-627b-4e10-b411-d3cccca2ad48 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] 10.222.0.11 "GET /compute/v2.1/servers/0698dc5b-5f47-46c4-ace8-f5e891a964a0" status: 200 len: 1218 microversion: 2.1 time: 0.094470 Nov 17 03:50:23.835742 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 1260/2329] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:50:23 2021] GET /compute/v2.1/servers/0698dc5b-5f47-46c4-ace8-f5e891a964a0 => generated 1218 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:50:23.981865 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-318e217d-44c9-4deb-9479-426f11be307e tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:50:23.982428 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-318e217d-44c9-4deb-9479-426f11be307e tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] [instance: 5d54db85-b991-4890-abaa-952413baa2e7] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:50:23.989248 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-318e217d-44c9-4deb-9479-426f11be307e tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:50:23.989705 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-318e217d-44c9-4deb-9479-426f11be307e tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:50:23.990474 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-318e217d-44c9-4deb-9479-426f11be307e tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:50:23.990912 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-318e217d-44c9-4deb-9479-426f11be307e tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:50:24.137821 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-318e217d-44c9-4deb-9479-426f11be307e tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37f21d6d15cf40a586edda211219fd08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ebb970305844dccacf48a7d8d47ecf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:50:24.147236 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-318e217d-44c9-4deb-9479-426f11be307e tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '37f21d6d15cf40a586edda211219fd08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ebb970305844dccacf48a7d8d47ecf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:50:24.148745 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-318e217d-44c9-4deb-9479-426f11be307e tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '37f21d6d15cf40a586edda211219fd08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ebb970305844dccacf48a7d8d47ecf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:50:24.150069 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-318e217d-44c9-4deb-9479-426f11be307e tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] 10.222.0.11 "GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7" status: 200 len: 1803 microversion: 2.20 time: 0.172703 Nov 17 03:50:24.150620 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 1070/2330] 10.222.0.11 () {60 vars in 1276 bytes} [Wed Nov 17 03:50:23 2021] GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7 => generated 1803 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 17 03:50:24.856345 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-dededd51-c033-408c-9d74-dee3bbbbc671 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:50:24.857405 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-dededd51-c033-408c-9d74-dee3bbbbc671 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] [instance: 0698dc5b-5f47-46c4-ace8-f5e891a964a0] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:50:24.868488 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-dededd51-c033-408c-9d74-dee3bbbbc671 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:50:24.869342 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-dededd51-c033-408c-9d74-dee3bbbbc671 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:50:24.870618 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-dededd51-c033-408c-9d74-dee3bbbbc671 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:50:24.871326 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-dededd51-c033-408c-9d74-dee3bbbbc671 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:50:24.936697 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-dededd51-c033-408c-9d74-dee3bbbbc671 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '163b2f24a72649ac8084be1cac32fa09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e123e9b86124c93a7fc2db9984e7466', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:50:24.944199 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-dededd51-c033-408c-9d74-dee3bbbbc671 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] 10.222.0.11 "GET /compute/v2.1/servers/0698dc5b-5f47-46c4-ace8-f5e891a964a0" status: 200 len: 1218 microversion: 2.1 time: 0.094142 Nov 17 03:50:24.944768 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 1261/2331] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:50:24 2021] GET /compute/v2.1/servers/0698dc5b-5f47-46c4-ace8-f5e891a964a0 => generated 1218 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:50:25.178094 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-6437a1ea-f09b-43e6-aadb-189f2070fcd9 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:50:25.179050 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-6437a1ea-f09b-43e6-aadb-189f2070fcd9 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] [instance: 5d54db85-b991-4890-abaa-952413baa2e7] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:50:25.186141 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-6437a1ea-f09b-43e6-aadb-189f2070fcd9 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:50:25.186585 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-6437a1ea-f09b-43e6-aadb-189f2070fcd9 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:50:25.187346 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-6437a1ea-f09b-43e6-aadb-189f2070fcd9 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:50:25.187772 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-6437a1ea-f09b-43e6-aadb-189f2070fcd9 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:50:25.332943 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-6437a1ea-f09b-43e6-aadb-189f2070fcd9 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37f21d6d15cf40a586edda211219fd08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ebb970305844dccacf48a7d8d47ecf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:50:25.344716 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-6437a1ea-f09b-43e6-aadb-189f2070fcd9 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '37f21d6d15cf40a586edda211219fd08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ebb970305844dccacf48a7d8d47ecf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:50:25.347109 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-6437a1ea-f09b-43e6-aadb-189f2070fcd9 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '37f21d6d15cf40a586edda211219fd08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ebb970305844dccacf48a7d8d47ecf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:50:25.348524 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-6437a1ea-f09b-43e6-aadb-189f2070fcd9 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] 10.222.0.11 "GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7" status: 200 len: 1803 microversion: 2.20 time: 0.176802 Nov 17 03:50:25.349390 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 1071/2332] 10.222.0.11 () {60 vars in 1276 bytes} [Wed Nov 17 03:50:25 2021] GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7 => generated 1803 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 17 03:50:25.964983 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-43cfec08-b6c7-4db5-922e-ee6feff04ba3 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:50:25.965965 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-43cfec08-b6c7-4db5-922e-ee6feff04ba3 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] [instance: 0698dc5b-5f47-46c4-ace8-f5e891a964a0] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:50:25.978235 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-43cfec08-b6c7-4db5-922e-ee6feff04ba3 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:50:25.978983 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-43cfec08-b6c7-4db5-922e-ee6feff04ba3 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:50:25.980263 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-43cfec08-b6c7-4db5-922e-ee6feff04ba3 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:50:25.981050 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-43cfec08-b6c7-4db5-922e-ee6feff04ba3 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:50:26.052116 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-43cfec08-b6c7-4db5-922e-ee6feff04ba3 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '163b2f24a72649ac8084be1cac32fa09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e123e9b86124c93a7fc2db9984e7466', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:50:26.062185 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-43cfec08-b6c7-4db5-922e-ee6feff04ba3 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] 10.222.0.11 "GET /compute/v2.1/servers/0698dc5b-5f47-46c4-ace8-f5e891a964a0" status: 200 len: 1218 microversion: 2.1 time: 0.103501 Nov 17 03:50:26.062765 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 1262/2333] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:50:25 2021] GET /compute/v2.1/servers/0698dc5b-5f47-46c4-ace8-f5e891a964a0 => generated 1218 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:50:26.371517 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-7634f3a7-53fc-452f-b0b5-153ce567aead tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:50:26.372206 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-7634f3a7-53fc-452f-b0b5-153ce567aead tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] [instance: 5d54db85-b991-4890-abaa-952413baa2e7] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:50:26.382735 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-7634f3a7-53fc-452f-b0b5-153ce567aead tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:50:26.383406 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-7634f3a7-53fc-452f-b0b5-153ce567aead tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:50:26.384688 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-7634f3a7-53fc-452f-b0b5-153ce567aead tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:50:26.385139 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-7634f3a7-53fc-452f-b0b5-153ce567aead tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:50:26.531290 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-7634f3a7-53fc-452f-b0b5-153ce567aead tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37f21d6d15cf40a586edda211219fd08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ebb970305844dccacf48a7d8d47ecf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:50:26.539966 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-7634f3a7-53fc-452f-b0b5-153ce567aead tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '37f21d6d15cf40a586edda211219fd08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ebb970305844dccacf48a7d8d47ecf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:50:26.541469 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-7634f3a7-53fc-452f-b0b5-153ce567aead tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '37f21d6d15cf40a586edda211219fd08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ebb970305844dccacf48a7d8d47ecf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:50:26.542619 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-7634f3a7-53fc-452f-b0b5-153ce567aead tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] 10.222.0.11 "GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7" status: 200 len: 1803 microversion: 2.20 time: 0.177473 Nov 17 03:50:26.543172 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 1072/2334] 10.222.0.11 () {60 vars in 1276 bytes} [Wed Nov 17 03:50:26 2021] GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7 => generated 1803 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 17 03:50:27.082399 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-466dd98d-0822-4e7e-bc0f-63a67ddd7bb4 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:50:27.083033 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-466dd98d-0822-4e7e-bc0f-63a67ddd7bb4 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] [instance: 0698dc5b-5f47-46c4-ace8-f5e891a964a0] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:50:27.089870 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-466dd98d-0822-4e7e-bc0f-63a67ddd7bb4 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:50:27.090304 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-466dd98d-0822-4e7e-bc0f-63a67ddd7bb4 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:50:27.091074 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-466dd98d-0822-4e7e-bc0f-63a67ddd7bb4 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:50:27.091502 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-466dd98d-0822-4e7e-bc0f-63a67ddd7bb4 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:50:27.150208 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-466dd98d-0822-4e7e-bc0f-63a67ddd7bb4 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '163b2f24a72649ac8084be1cac32fa09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e123e9b86124c93a7fc2db9984e7466', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:50:27.158107 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-466dd98d-0822-4e7e-bc0f-63a67ddd7bb4 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] 10.222.0.11 "GET /compute/v2.1/servers/0698dc5b-5f47-46c4-ace8-f5e891a964a0" status: 200 len: 1218 microversion: 2.1 time: 0.079484 Nov 17 03:50:27.158674 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 1263/2335] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:50:27 2021] GET /compute/v2.1/servers/0698dc5b-5f47-46c4-ace8-f5e891a964a0 => generated 1218 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:50:27.565819 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-fc98d0ad-7a0b-4d79-a21d-8948c14920e3 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:50:27.566814 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-fc98d0ad-7a0b-4d79-a21d-8948c14920e3 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] [instance: 5d54db85-b991-4890-abaa-952413baa2e7] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:50:27.575337 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-fc98d0ad-7a0b-4d79-a21d-8948c14920e3 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:50:27.575778 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-fc98d0ad-7a0b-4d79-a21d-8948c14920e3 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:50:27.576542 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-fc98d0ad-7a0b-4d79-a21d-8948c14920e3 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:50:27.577014 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-fc98d0ad-7a0b-4d79-a21d-8948c14920e3 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:50:27.720308 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-fc98d0ad-7a0b-4d79-a21d-8948c14920e3 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37f21d6d15cf40a586edda211219fd08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ebb970305844dccacf48a7d8d47ecf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:50:27.728985 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-fc98d0ad-7a0b-4d79-a21d-8948c14920e3 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '37f21d6d15cf40a586edda211219fd08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ebb970305844dccacf48a7d8d47ecf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:50:27.730476 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-fc98d0ad-7a0b-4d79-a21d-8948c14920e3 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '37f21d6d15cf40a586edda211219fd08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ebb970305844dccacf48a7d8d47ecf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:50:27.731648 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-fc98d0ad-7a0b-4d79-a21d-8948c14920e3 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] 10.222.0.11 "GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7" status: 200 len: 1803 microversion: 2.20 time: 0.172087 Nov 17 03:50:27.732206 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 1073/2336] 10.222.0.11 () {60 vars in 1276 bytes} [Wed Nov 17 03:50:27 2021] GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7 => generated 1803 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 17 03:50:28.179192 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-e38ac1cd-6041-4ece-8e23-86830ab50a26 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:50:28.180227 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-e38ac1cd-6041-4ece-8e23-86830ab50a26 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] [instance: 0698dc5b-5f47-46c4-ace8-f5e891a964a0] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:50:28.187818 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-e38ac1cd-6041-4ece-8e23-86830ab50a26 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:50:28.188271 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-e38ac1cd-6041-4ece-8e23-86830ab50a26 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:50:28.189081 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-e38ac1cd-6041-4ece-8e23-86830ab50a26 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:50:28.189517 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-e38ac1cd-6041-4ece-8e23-86830ab50a26 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:50:28.257600 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-e38ac1cd-6041-4ece-8e23-86830ab50a26 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '163b2f24a72649ac8084be1cac32fa09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e123e9b86124c93a7fc2db9984e7466', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:50:28.265649 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-e38ac1cd-6041-4ece-8e23-86830ab50a26 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] 10.222.0.11 "GET /compute/v2.1/servers/0698dc5b-5f47-46c4-ace8-f5e891a964a0" status: 200 len: 1218 microversion: 2.1 time: 0.093091 Nov 17 03:50:28.266215 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 1264/2337] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:50:28 2021] GET /compute/v2.1/servers/0698dc5b-5f47-46c4-ace8-f5e891a964a0 => generated 1218 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:50:28.750291 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-e30a6a4f-f369-446f-a873-ff4172f09f6c tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:50:28.750923 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-e30a6a4f-f369-446f-a873-ff4172f09f6c tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] [instance: 5d54db85-b991-4890-abaa-952413baa2e7] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:50:28.757928 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-e30a6a4f-f369-446f-a873-ff4172f09f6c tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:50:28.758399 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-e30a6a4f-f369-446f-a873-ff4172f09f6c tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:50:28.759200 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-e30a6a4f-f369-446f-a873-ff4172f09f6c tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:50:28.759645 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-e30a6a4f-f369-446f-a873-ff4172f09f6c tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:50:28.916229 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-e30a6a4f-f369-446f-a873-ff4172f09f6c tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37f21d6d15cf40a586edda211219fd08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ebb970305844dccacf48a7d8d47ecf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:50:28.929484 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-e30a6a4f-f369-446f-a873-ff4172f09f6c tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '37f21d6d15cf40a586edda211219fd08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ebb970305844dccacf48a7d8d47ecf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:50:28.931753 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-e30a6a4f-f369-446f-a873-ff4172f09f6c tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '37f21d6d15cf40a586edda211219fd08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ebb970305844dccacf48a7d8d47ecf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:50:28.933055 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-e30a6a4f-f369-446f-a873-ff4172f09f6c tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] 10.222.0.11 "GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7" status: 200 len: 1803 microversion: 2.20 time: 0.186720 Nov 17 03:50:28.933609 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 1074/2338] 10.222.0.11 () {60 vars in 1276 bytes} [Wed Nov 17 03:50:28 2021] GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7 => generated 1803 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 17 03:50:29.286792 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-19b15319-c41d-4a62-b923-94ec6718be93 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:50:29.287808 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-19b15319-c41d-4a62-b923-94ec6718be93 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] [instance: 0698dc5b-5f47-46c4-ace8-f5e891a964a0] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:50:29.296111 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-19b15319-c41d-4a62-b923-94ec6718be93 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:50:29.296567 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-19b15319-c41d-4a62-b923-94ec6718be93 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:50:29.297388 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-19b15319-c41d-4a62-b923-94ec6718be93 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:50:29.297834 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-19b15319-c41d-4a62-b923-94ec6718be93 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:50:29.362715 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-19b15319-c41d-4a62-b923-94ec6718be93 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '163b2f24a72649ac8084be1cac32fa09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e123e9b86124c93a7fc2db9984e7466', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:50:29.374343 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-19b15319-c41d-4a62-b923-94ec6718be93 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] 10.222.0.11 "GET /compute/v2.1/servers/0698dc5b-5f47-46c4-ace8-f5e891a964a0" status: 200 len: 1218 microversion: 2.1 time: 0.093592 Nov 17 03:50:29.375065 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 1265/2339] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:50:29 2021] GET /compute/v2.1/servers/0698dc5b-5f47-46c4-ace8-f5e891a964a0 => generated 1218 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:50:29.955638 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-fca37b90-4037-46e2-9b85-726a3f025cac tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:50:29.956633 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-fca37b90-4037-46e2-9b85-726a3f025cac tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] [instance: 5d54db85-b991-4890-abaa-952413baa2e7] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:50:29.967721 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-fca37b90-4037-46e2-9b85-726a3f025cac tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:50:29.968435 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-fca37b90-4037-46e2-9b85-726a3f025cac tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:50:29.970168 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-fca37b90-4037-46e2-9b85-726a3f025cac tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:50:29.970905 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-fca37b90-4037-46e2-9b85-726a3f025cac tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:50:30.115896 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-fca37b90-4037-46e2-9b85-726a3f025cac tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37f21d6d15cf40a586edda211219fd08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ebb970305844dccacf48a7d8d47ecf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:50:30.127043 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-fca37b90-4037-46e2-9b85-726a3f025cac tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '37f21d6d15cf40a586edda211219fd08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ebb970305844dccacf48a7d8d47ecf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:50:30.128623 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-fca37b90-4037-46e2-9b85-726a3f025cac tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '37f21d6d15cf40a586edda211219fd08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ebb970305844dccacf48a7d8d47ecf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:50:30.130507 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-fca37b90-4037-46e2-9b85-726a3f025cac tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] 10.222.0.11 "GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7" status: 200 len: 1803 microversion: 2.20 time: 0.181065 Nov 17 03:50:30.131285 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 1075/2340] 10.222.0.11 () {60 vars in 1276 bytes} [Wed Nov 17 03:50:29 2021] GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7 => generated 1803 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 17 03:50:30.395330 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-d33914b7-6006-4977-945a-9cdeddeb3daf tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:50:30.396090 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-d33914b7-6006-4977-945a-9cdeddeb3daf tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] [instance: 0698dc5b-5f47-46c4-ace8-f5e891a964a0] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:50:30.402800 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-d33914b7-6006-4977-945a-9cdeddeb3daf tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:50:30.403250 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-d33914b7-6006-4977-945a-9cdeddeb3daf tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:50:30.404038 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-d33914b7-6006-4977-945a-9cdeddeb3daf tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:50:30.404574 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-d33914b7-6006-4977-945a-9cdeddeb3daf tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:50:30.464557 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-d33914b7-6006-4977-945a-9cdeddeb3daf tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '163b2f24a72649ac8084be1cac32fa09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e123e9b86124c93a7fc2db9984e7466', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:50:30.472420 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-d33914b7-6006-4977-945a-9cdeddeb3daf tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] 10.222.0.11 "GET /compute/v2.1/servers/0698dc5b-5f47-46c4-ace8-f5e891a964a0" status: 200 len: 1218 microversion: 2.1 time: 0.080802 Nov 17 03:50:30.473025 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 1266/2341] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:50:30 2021] GET /compute/v2.1/servers/0698dc5b-5f47-46c4-ace8-f5e891a964a0 => generated 1218 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:50:31.152544 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-97c6ebe1-02f8-4213-8ede-be3934ee54b6 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:50:31.153424 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-97c6ebe1-02f8-4213-8ede-be3934ee54b6 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] [instance: 5d54db85-b991-4890-abaa-952413baa2e7] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:50:31.161518 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-97c6ebe1-02f8-4213-8ede-be3934ee54b6 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:50:31.162071 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-97c6ebe1-02f8-4213-8ede-be3934ee54b6 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:50:31.163014 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-97c6ebe1-02f8-4213-8ede-be3934ee54b6 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:50:31.163546 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-97c6ebe1-02f8-4213-8ede-be3934ee54b6 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:50:31.303222 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-97c6ebe1-02f8-4213-8ede-be3934ee54b6 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37f21d6d15cf40a586edda211219fd08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ebb970305844dccacf48a7d8d47ecf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:50:31.316719 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-97c6ebe1-02f8-4213-8ede-be3934ee54b6 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '37f21d6d15cf40a586edda211219fd08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ebb970305844dccacf48a7d8d47ecf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:50:31.319017 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-97c6ebe1-02f8-4213-8ede-be3934ee54b6 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '37f21d6d15cf40a586edda211219fd08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ebb970305844dccacf48a7d8d47ecf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:50:31.320765 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-97c6ebe1-02f8-4213-8ede-be3934ee54b6 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] 10.222.0.11 "GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7" status: 200 len: 1803 microversion: 2.20 time: 0.174075 Nov 17 03:50:31.321480 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 1076/2342] 10.222.0.11 () {60 vars in 1276 bytes} [Wed Nov 17 03:50:31 2021] GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7 => generated 1803 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 17 03:50:31.493640 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-6029789c-fc2c-4b35-8b65-d95f84a9be37 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:50:31.494629 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-6029789c-fc2c-4b35-8b65-d95f84a9be37 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] [instance: 0698dc5b-5f47-46c4-ace8-f5e891a964a0] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:50:31.505493 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-6029789c-fc2c-4b35-8b65-d95f84a9be37 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:50:31.506275 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-6029789c-fc2c-4b35-8b65-d95f84a9be37 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:50:31.507607 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-6029789c-fc2c-4b35-8b65-d95f84a9be37 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:50:31.508368 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-6029789c-fc2c-4b35-8b65-d95f84a9be37 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:50:31.568390 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-6029789c-fc2c-4b35-8b65-d95f84a9be37 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '163b2f24a72649ac8084be1cac32fa09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e123e9b86124c93a7fc2db9984e7466', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:50:31.576129 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-6029789c-fc2c-4b35-8b65-d95f84a9be37 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] 10.222.0.11 "GET /compute/v2.1/servers/0698dc5b-5f47-46c4-ace8-f5e891a964a0" status: 200 len: 1218 microversion: 2.1 time: 0.088873 Nov 17 03:50:31.576698 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 1267/2343] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:50:31 2021] GET /compute/v2.1/servers/0698dc5b-5f47-46c4-ace8-f5e891a964a0 => generated 1218 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:50:32.346882 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-e9f31662-4aed-4e46-b421-7d6bbab1c500 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:50:32.347490 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-e9f31662-4aed-4e46-b421-7d6bbab1c500 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] [instance: 5d54db85-b991-4890-abaa-952413baa2e7] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:50:32.354207 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-e9f31662-4aed-4e46-b421-7d6bbab1c500 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:50:32.355195 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-e9f31662-4aed-4e46-b421-7d6bbab1c500 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:50:32.355995 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-e9f31662-4aed-4e46-b421-7d6bbab1c500 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:50:32.356431 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-e9f31662-4aed-4e46-b421-7d6bbab1c500 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:50:32.517384 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-e9f31662-4aed-4e46-b421-7d6bbab1c500 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37f21d6d15cf40a586edda211219fd08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ebb970305844dccacf48a7d8d47ecf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:50:32.525779 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-e9f31662-4aed-4e46-b421-7d6bbab1c500 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '37f21d6d15cf40a586edda211219fd08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ebb970305844dccacf48a7d8d47ecf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:50:32.527373 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-e9f31662-4aed-4e46-b421-7d6bbab1c500 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '37f21d6d15cf40a586edda211219fd08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ebb970305844dccacf48a7d8d47ecf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:50:32.528506 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-e9f31662-4aed-4e46-b421-7d6bbab1c500 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] 10.222.0.11 "GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7" status: 200 len: 1803 microversion: 2.20 time: 0.186247 Nov 17 03:50:32.529114 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 1077/2344] 10.222.0.11 () {60 vars in 1276 bytes} [Wed Nov 17 03:50:32 2021] GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7 => generated 1803 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 17 03:50:32.596654 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-60249b61-67cc-419e-9c1d-8cc60e88433e tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:50:32.597721 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-60249b61-67cc-419e-9c1d-8cc60e88433e tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] [instance: 0698dc5b-5f47-46c4-ace8-f5e891a964a0] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:50:32.608462 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-60249b61-67cc-419e-9c1d-8cc60e88433e tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:50:32.609280 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-60249b61-67cc-419e-9c1d-8cc60e88433e tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:50:32.610569 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-60249b61-67cc-419e-9c1d-8cc60e88433e tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:50:32.611330 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-60249b61-67cc-419e-9c1d-8cc60e88433e tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:50:32.678564 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-60249b61-67cc-419e-9c1d-8cc60e88433e tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '163b2f24a72649ac8084be1cac32fa09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e123e9b86124c93a7fc2db9984e7466', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:50:32.686525 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-60249b61-67cc-419e-9c1d-8cc60e88433e tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] 10.222.0.11 "GET /compute/v2.1/servers/0698dc5b-5f47-46c4-ace8-f5e891a964a0" status: 200 len: 1218 microversion: 2.1 time: 0.095975 Nov 17 03:50:32.687090 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 1268/2345] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:50:32 2021] GET /compute/v2.1/servers/0698dc5b-5f47-46c4-ace8-f5e891a964a0 => generated 1218 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:50:32.823964 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 17 03:50:32.824201 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: Wed Nov 17 03:50:32 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Nov 17 03:50:33.554345 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-82a56008-bfb1-4573-992c-c90b968bbe99 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:50:33.555053 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-82a56008-bfb1-4573-992c-c90b968bbe99 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] [instance: 5d54db85-b991-4890-abaa-952413baa2e7] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:50:33.562806 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-82a56008-bfb1-4573-992c-c90b968bbe99 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:50:33.563337 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-82a56008-bfb1-4573-992c-c90b968bbe99 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:50:33.564238 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-82a56008-bfb1-4573-992c-c90b968bbe99 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:50:33.564753 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-82a56008-bfb1-4573-992c-c90b968bbe99 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:50:33.703561 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-902d78dd-67ee-4df1-842a-8158062f0315 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:50:33.704155 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-902d78dd-67ee-4df1-842a-8158062f0315 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] [instance: 0698dc5b-5f47-46c4-ace8-f5e891a964a0] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:50:33.711446 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-82a56008-bfb1-4573-992c-c90b968bbe99 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37f21d6d15cf40a586edda211219fd08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ebb970305844dccacf48a7d8d47ecf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:50:33.712317 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-902d78dd-67ee-4df1-842a-8158062f0315 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:50:33.713107 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-902d78dd-67ee-4df1-842a-8158062f0315 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:50:33.714121 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-902d78dd-67ee-4df1-842a-8158062f0315 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:50:33.714867 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-902d78dd-67ee-4df1-842a-8158062f0315 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:50:33.723562 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-82a56008-bfb1-4573-992c-c90b968bbe99 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '37f21d6d15cf40a586edda211219fd08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ebb970305844dccacf48a7d8d47ecf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:50:33.726016 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-82a56008-bfb1-4573-992c-c90b968bbe99 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '37f21d6d15cf40a586edda211219fd08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ebb970305844dccacf48a7d8d47ecf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:50:33.727776 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-82a56008-bfb1-4573-992c-c90b968bbe99 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] 10.222.0.11 "GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7" status: 200 len: 1803 microversion: 2.20 time: 0.178160 Nov 17 03:50:33.728616 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 1078/2346] 10.222.0.11 () {60 vars in 1276 bytes} [Wed Nov 17 03:50:33 2021] GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7 => generated 1803 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 17 03:50:33.779685 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-902d78dd-67ee-4df1-842a-8158062f0315 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '163b2f24a72649ac8084be1cac32fa09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e123e9b86124c93a7fc2db9984e7466', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:50:33.787656 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-902d78dd-67ee-4df1-842a-8158062f0315 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] 10.222.0.11 "GET /compute/v2.1/servers/0698dc5b-5f47-46c4-ace8-f5e891a964a0" status: 200 len: 1218 microversion: 2.1 time: 0.087866 Nov 17 03:50:33.788229 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 1269/2347] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:50:33 2021] GET /compute/v2.1/servers/0698dc5b-5f47-46c4-ace8-f5e891a964a0 => generated 1218 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:50:34.748937 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-c32cec42-cb4a-4e97-baa6-092ed155f883 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:50:34.749541 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-c32cec42-cb4a-4e97-baa6-092ed155f883 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] [instance: 5d54db85-b991-4890-abaa-952413baa2e7] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:50:34.756225 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-c32cec42-cb4a-4e97-baa6-092ed155f883 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:50:34.756645 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-c32cec42-cb4a-4e97-baa6-092ed155f883 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:50:34.757472 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-c32cec42-cb4a-4e97-baa6-092ed155f883 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:50:34.758004 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-c32cec42-cb4a-4e97-baa6-092ed155f883 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:50:34.804203 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-a916a740-7c86-4e7e-8273-20f7399009a7 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:50:34.804838 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-a916a740-7c86-4e7e-8273-20f7399009a7 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] [instance: 0698dc5b-5f47-46c4-ace8-f5e891a964a0] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:50:34.811906 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-a916a740-7c86-4e7e-8273-20f7399009a7 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:50:34.812349 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-a916a740-7c86-4e7e-8273-20f7399009a7 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:50:34.813183 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-a916a740-7c86-4e7e-8273-20f7399009a7 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:50:34.813609 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-a916a740-7c86-4e7e-8273-20f7399009a7 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:50:34.878159 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-a916a740-7c86-4e7e-8273-20f7399009a7 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '163b2f24a72649ac8084be1cac32fa09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e123e9b86124c93a7fc2db9984e7466', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:50:34.886229 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-a916a740-7c86-4e7e-8273-20f7399009a7 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] 10.222.0.11 "GET /compute/v2.1/servers/0698dc5b-5f47-46c4-ace8-f5e891a964a0" status: 200 len: 1218 microversion: 2.1 time: 0.086002 Nov 17 03:50:34.886824 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 1270/2348] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:50:34 2021] GET /compute/v2.1/servers/0698dc5b-5f47-46c4-ace8-f5e891a964a0 => generated 1218 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:50:34.899686 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-c32cec42-cb4a-4e97-baa6-092ed155f883 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37f21d6d15cf40a586edda211219fd08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ebb970305844dccacf48a7d8d47ecf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:50:34.909235 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-c32cec42-cb4a-4e97-baa6-092ed155f883 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '37f21d6d15cf40a586edda211219fd08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ebb970305844dccacf48a7d8d47ecf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:50:34.910730 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-c32cec42-cb4a-4e97-baa6-092ed155f883 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '37f21d6d15cf40a586edda211219fd08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ebb970305844dccacf48a7d8d47ecf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:50:34.911889 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-c32cec42-cb4a-4e97-baa6-092ed155f883 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] 10.222.0.11 "GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7" status: 200 len: 1803 microversion: 2.20 time: 0.167401 Nov 17 03:50:34.912422 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 1079/2349] 10.222.0.11 () {60 vars in 1276 bytes} [Wed Nov 17 03:50:34 2021] GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7 => generated 1803 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 17 03:50:35.908100 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-80d26e97-3e60-418c-a29f-1ab85e620290 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:50:35.909122 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-80d26e97-3e60-418c-a29f-1ab85e620290 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] [instance: 0698dc5b-5f47-46c4-ace8-f5e891a964a0] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:50:35.918578 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-80d26e97-3e60-418c-a29f-1ab85e620290 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:50:35.919226 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-80d26e97-3e60-418c-a29f-1ab85e620290 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:50:35.920218 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-80d26e97-3e60-418c-a29f-1ab85e620290 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:50:35.920649 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-80d26e97-3e60-418c-a29f-1ab85e620290 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:50:35.931471 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-38252de9-fdd1-4947-b254-3a5697134260 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:50:35.932051 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-38252de9-fdd1-4947-b254-3a5697134260 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] [instance: 5d54db85-b991-4890-abaa-952413baa2e7] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:50:35.938966 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-38252de9-fdd1-4947-b254-3a5697134260 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:50:35.939428 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-38252de9-fdd1-4947-b254-3a5697134260 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:50:35.940225 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-38252de9-fdd1-4947-b254-3a5697134260 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:50:35.940666 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-38252de9-fdd1-4947-b254-3a5697134260 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:50:35.981307 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-80d26e97-3e60-418c-a29f-1ab85e620290 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '163b2f24a72649ac8084be1cac32fa09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e123e9b86124c93a7fc2db9984e7466', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:50:35.988735 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-80d26e97-3e60-418c-a29f-1ab85e620290 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] 10.222.0.11 "GET /compute/v2.1/servers/0698dc5b-5f47-46c4-ace8-f5e891a964a0" status: 200 len: 1218 microversion: 2.1 time: 0.086690 Nov 17 03:50:35.989324 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 1271/2350] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:50:35 2021] GET /compute/v2.1/servers/0698dc5b-5f47-46c4-ace8-f5e891a964a0 => generated 1218 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:50:36.073814 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-38252de9-fdd1-4947-b254-3a5697134260 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37f21d6d15cf40a586edda211219fd08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ebb970305844dccacf48a7d8d47ecf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:50:36.082306 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-38252de9-fdd1-4947-b254-3a5697134260 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '37f21d6d15cf40a586edda211219fd08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ebb970305844dccacf48a7d8d47ecf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:50:36.083807 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-38252de9-fdd1-4947-b254-3a5697134260 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '37f21d6d15cf40a586edda211219fd08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ebb970305844dccacf48a7d8d47ecf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:50:36.084998 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-38252de9-fdd1-4947-b254-3a5697134260 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] 10.222.0.11 "GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7" status: 200 len: 1803 microversion: 2.20 time: 0.157900 Nov 17 03:50:36.085560 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 1080/2351] 10.222.0.11 () {60 vars in 1276 bytes} [Wed Nov 17 03:50:35 2021] GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7 => generated 1803 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 17 03:50:37.010010 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-4beab9fc-9fb0-40cb-8bc2-a738779d9cd3 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:50:37.011963 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-4beab9fc-9fb0-40cb-8bc2-a738779d9cd3 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] [instance: 0698dc5b-5f47-46c4-ace8-f5e891a964a0] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:50:37.022620 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-4beab9fc-9fb0-40cb-8bc2-a738779d9cd3 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:50:37.023376 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-4beab9fc-9fb0-40cb-8bc2-a738779d9cd3 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:50:37.024625 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-4beab9fc-9fb0-40cb-8bc2-a738779d9cd3 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:50:37.025386 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-4beab9fc-9fb0-40cb-8bc2-a738779d9cd3 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:50:37.085410 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-4beab9fc-9fb0-40cb-8bc2-a738779d9cd3 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '163b2f24a72649ac8084be1cac32fa09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e123e9b86124c93a7fc2db9984e7466', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:50:37.093181 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-4beab9fc-9fb0-40cb-8bc2-a738779d9cd3 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] 10.222.0.11 "GET /compute/v2.1/servers/0698dc5b-5f47-46c4-ace8-f5e891a964a0" status: 200 len: 1218 microversion: 2.1 time: 0.089357 Nov 17 03:50:37.093745 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 1272/2352] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:50:37 2021] GET /compute/v2.1/servers/0698dc5b-5f47-46c4-ace8-f5e891a964a0 => generated 1218 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:50:37.103361 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-ebd32fdc-f452-4df9-8abc-1e77adb9d71a tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:50:37.103998 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-ebd32fdc-f452-4df9-8abc-1e77adb9d71a tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] [instance: 5d54db85-b991-4890-abaa-952413baa2e7] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:50:37.110502 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-ebd32fdc-f452-4df9-8abc-1e77adb9d71a tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:50:37.110945 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-ebd32fdc-f452-4df9-8abc-1e77adb9d71a tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:50:37.111753 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-ebd32fdc-f452-4df9-8abc-1e77adb9d71a tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:50:37.112186 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-ebd32fdc-f452-4df9-8abc-1e77adb9d71a tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:50:37.243370 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-ebd32fdc-f452-4df9-8abc-1e77adb9d71a tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37f21d6d15cf40a586edda211219fd08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ebb970305844dccacf48a7d8d47ecf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:50:37.252178 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-ebd32fdc-f452-4df9-8abc-1e77adb9d71a tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '37f21d6d15cf40a586edda211219fd08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ebb970305844dccacf48a7d8d47ecf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:50:37.253691 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-ebd32fdc-f452-4df9-8abc-1e77adb9d71a tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '37f21d6d15cf40a586edda211219fd08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ebb970305844dccacf48a7d8d47ecf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:50:37.254844 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-ebd32fdc-f452-4df9-8abc-1e77adb9d71a tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] 10.222.0.11 "GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7" status: 200 len: 1803 microversion: 2.20 time: 0.155181 Nov 17 03:50:37.255400 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 1081/2353] 10.222.0.11 () {60 vars in 1276 bytes} [Wed Nov 17 03:50:37 2021] GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7 => generated 1803 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 17 03:50:38.114267 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-9c454ce3-0759-4f6f-bfa8-77ac1d6f3d42 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:50:38.115345 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-9c454ce3-0759-4f6f-bfa8-77ac1d6f3d42 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] [instance: 0698dc5b-5f47-46c4-ace8-f5e891a964a0] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:50:38.126187 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-9c454ce3-0759-4f6f-bfa8-77ac1d6f3d42 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:50:38.127009 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-9c454ce3-0759-4f6f-bfa8-77ac1d6f3d42 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:50:38.128344 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-9c454ce3-0759-4f6f-bfa8-77ac1d6f3d42 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:50:38.129100 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-9c454ce3-0759-4f6f-bfa8-77ac1d6f3d42 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:50:38.192975 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-9c454ce3-0759-4f6f-bfa8-77ac1d6f3d42 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '163b2f24a72649ac8084be1cac32fa09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e123e9b86124c93a7fc2db9984e7466', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:50:38.200992 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-9c454ce3-0759-4f6f-bfa8-77ac1d6f3d42 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] 10.222.0.11 "GET /compute/v2.1/servers/0698dc5b-5f47-46c4-ace8-f5e891a964a0" status: 200 len: 1218 microversion: 2.1 time: 0.092895 Nov 17 03:50:38.201558 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 1273/2354] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:50:38 2021] GET /compute/v2.1/servers/0698dc5b-5f47-46c4-ace8-f5e891a964a0 => generated 1218 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:50:38.273548 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-88c4d4ee-1d26-4452-a23c-6c5ad66df80a tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:50:38.274159 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-88c4d4ee-1d26-4452-a23c-6c5ad66df80a tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] [instance: 5d54db85-b991-4890-abaa-952413baa2e7] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:50:38.281375 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-88c4d4ee-1d26-4452-a23c-6c5ad66df80a tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:50:38.281824 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-88c4d4ee-1d26-4452-a23c-6c5ad66df80a tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:50:38.282659 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-88c4d4ee-1d26-4452-a23c-6c5ad66df80a tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:50:38.283087 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-88c4d4ee-1d26-4452-a23c-6c5ad66df80a tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:50:38.426132 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-88c4d4ee-1d26-4452-a23c-6c5ad66df80a tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37f21d6d15cf40a586edda211219fd08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ebb970305844dccacf48a7d8d47ecf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:50:38.437016 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-88c4d4ee-1d26-4452-a23c-6c5ad66df80a tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '37f21d6d15cf40a586edda211219fd08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ebb970305844dccacf48a7d8d47ecf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:50:38.438494 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-88c4d4ee-1d26-4452-a23c-6c5ad66df80a tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '37f21d6d15cf40a586edda211219fd08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ebb970305844dccacf48a7d8d47ecf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:50:38.439647 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-88c4d4ee-1d26-4452-a23c-6c5ad66df80a tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] 10.222.0.11 "GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7" status: 200 len: 1803 microversion: 2.20 time: 0.170020 Nov 17 03:50:38.440205 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 1082/2355] 10.222.0.11 () {60 vars in 1276 bytes} [Wed Nov 17 03:50:38 2021] GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7 => generated 1803 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 17 03:50:39.222474 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-b6c4b331-cbce-4dbd-9f4e-3a30174e650f tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:50:39.223449 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-b6c4b331-cbce-4dbd-9f4e-3a30174e650f tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] [instance: 0698dc5b-5f47-46c4-ace8-f5e891a964a0] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:50:39.234432 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-b6c4b331-cbce-4dbd-9f4e-3a30174e650f tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:50:39.235142 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-b6c4b331-cbce-4dbd-9f4e-3a30174e650f tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:50:39.236417 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-b6c4b331-cbce-4dbd-9f4e-3a30174e650f tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:50:39.237219 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-b6c4b331-cbce-4dbd-9f4e-3a30174e650f tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:50:39.302116 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-b6c4b331-cbce-4dbd-9f4e-3a30174e650f tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '163b2f24a72649ac8084be1cac32fa09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e123e9b86124c93a7fc2db9984e7466', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:50:39.310567 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-b6c4b331-cbce-4dbd-9f4e-3a30174e650f tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] 10.222.0.11 "GET /compute/v2.1/servers/0698dc5b-5f47-46c4-ace8-f5e891a964a0" status: 200 len: 1218 microversion: 2.1 time: 0.094345 Nov 17 03:50:39.311042 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 1274/2356] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:50:39 2021] GET /compute/v2.1/servers/0698dc5b-5f47-46c4-ace8-f5e891a964a0 => generated 1218 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:50:39.462118 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-3bf983fd-f8e7-458e-b8b9-f8ea485de7aa tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:50:39.463179 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-3bf983fd-f8e7-458e-b8b9-f8ea485de7aa tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] [instance: 5d54db85-b991-4890-abaa-952413baa2e7] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:50:39.469819 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-3bf983fd-f8e7-458e-b8b9-f8ea485de7aa tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:50:39.470268 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-3bf983fd-f8e7-458e-b8b9-f8ea485de7aa tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:50:39.471042 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-3bf983fd-f8e7-458e-b8b9-f8ea485de7aa tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:50:39.471498 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-3bf983fd-f8e7-458e-b8b9-f8ea485de7aa tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:50:39.611610 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-3bf983fd-f8e7-458e-b8b9-f8ea485de7aa tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37f21d6d15cf40a586edda211219fd08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ebb970305844dccacf48a7d8d47ecf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:50:39.620921 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-3bf983fd-f8e7-458e-b8b9-f8ea485de7aa tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '37f21d6d15cf40a586edda211219fd08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ebb970305844dccacf48a7d8d47ecf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:50:39.622427 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-3bf983fd-f8e7-458e-b8b9-f8ea485de7aa tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '37f21d6d15cf40a586edda211219fd08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ebb970305844dccacf48a7d8d47ecf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:50:39.623591 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-3bf983fd-f8e7-458e-b8b9-f8ea485de7aa tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] 10.222.0.11 "GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7" status: 200 len: 1803 microversion: 2.20 time: 0.167791 Nov 17 03:50:39.624127 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 1083/2357] 10.222.0.11 () {60 vars in 1276 bytes} [Wed Nov 17 03:50:39 2021] GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7 => generated 1803 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 17 03:50:40.327614 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-6d7b937e-c205-401c-938a-dac1c23c50a0 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:50:40.328217 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-6d7b937e-c205-401c-938a-dac1c23c50a0 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] [instance: 0698dc5b-5f47-46c4-ace8-f5e891a964a0] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:50:40.335042 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-6d7b937e-c205-401c-938a-dac1c23c50a0 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:50:40.335481 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-6d7b937e-c205-401c-938a-dac1c23c50a0 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:50:40.336245 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-6d7b937e-c205-401c-938a-dac1c23c50a0 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:50:40.336672 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-6d7b937e-c205-401c-938a-dac1c23c50a0 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:50:40.397081 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-6d7b937e-c205-401c-938a-dac1c23c50a0 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '163b2f24a72649ac8084be1cac32fa09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e123e9b86124c93a7fc2db9984e7466', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:50:40.408138 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-6d7b937e-c205-401c-938a-dac1c23c50a0 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] 10.222.0.11 "GET /compute/v2.1/servers/0698dc5b-5f47-46c4-ace8-f5e891a964a0" status: 200 len: 1218 microversion: 2.1 time: 0.084131 Nov 17 03:50:40.408956 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 1275/2358] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:50:40 2021] GET /compute/v2.1/servers/0698dc5b-5f47-46c4-ace8-f5e891a964a0 => generated 1218 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:50:40.646126 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-ed546458-52e2-4790-bdac-23e1aa4d531f tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:50:40.647017 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-ed546458-52e2-4790-bdac-23e1aa4d531f tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] [instance: 5d54db85-b991-4890-abaa-952413baa2e7] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:50:40.655571 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-ed546458-52e2-4790-bdac-23e1aa4d531f tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:50:40.656026 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-ed546458-52e2-4790-bdac-23e1aa4d531f tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:50:40.657111 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-ed546458-52e2-4790-bdac-23e1aa4d531f tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:50:40.657885 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-ed546458-52e2-4790-bdac-23e1aa4d531f tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:50:40.800394 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-ed546458-52e2-4790-bdac-23e1aa4d531f tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37f21d6d15cf40a586edda211219fd08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ebb970305844dccacf48a7d8d47ecf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:50:40.809627 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-ed546458-52e2-4790-bdac-23e1aa4d531f tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '37f21d6d15cf40a586edda211219fd08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ebb970305844dccacf48a7d8d47ecf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:50:40.811097 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-ed546458-52e2-4790-bdac-23e1aa4d531f tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '37f21d6d15cf40a586edda211219fd08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ebb970305844dccacf48a7d8d47ecf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:50:40.812264 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-ed546458-52e2-4790-bdac-23e1aa4d531f tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] 10.222.0.11 "GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7" status: 200 len: 1803 microversion: 2.20 time: 0.172593 Nov 17 03:50:40.812848 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 1084/2359] 10.222.0.11 () {60 vars in 1276 bytes} [Wed Nov 17 03:50:40 2021] GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7 => generated 1803 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 17 03:50:41.431717 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-68989073-281e-428f-bce1-8e6785027f63 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:50:41.432556 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-68989073-281e-428f-bce1-8e6785027f63 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] [instance: 0698dc5b-5f47-46c4-ace8-f5e891a964a0] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:50:41.439415 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-68989073-281e-428f-bce1-8e6785027f63 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:50:41.439880 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-68989073-281e-428f-bce1-8e6785027f63 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:50:41.440654 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-68989073-281e-428f-bce1-8e6785027f63 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:50:41.441111 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-68989073-281e-428f-bce1-8e6785027f63 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:50:41.500013 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-68989073-281e-428f-bce1-8e6785027f63 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '163b2f24a72649ac8084be1cac32fa09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e123e9b86124c93a7fc2db9984e7466', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:50:41.507663 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-68989073-281e-428f-bce1-8e6785027f63 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] 10.222.0.11 "GET /compute/v2.1/servers/0698dc5b-5f47-46c4-ace8-f5e891a964a0" status: 200 len: 1218 microversion: 2.1 time: 0.082654 Nov 17 03:50:41.508225 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 1276/2360] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:50:41 2021] GET /compute/v2.1/servers/0698dc5b-5f47-46c4-ace8-f5e891a964a0 => generated 1218 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:50:41.832249 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-dd5ccc01-5486-4598-b46c-0040bfb00c18 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:50:41.832905 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-dd5ccc01-5486-4598-b46c-0040bfb00c18 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] [instance: 5d54db85-b991-4890-abaa-952413baa2e7] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:50:41.839658 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-dd5ccc01-5486-4598-b46c-0040bfb00c18 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:50:41.840108 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-dd5ccc01-5486-4598-b46c-0040bfb00c18 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:50:41.840909 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-dd5ccc01-5486-4598-b46c-0040bfb00c18 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:50:41.841340 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-dd5ccc01-5486-4598-b46c-0040bfb00c18 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:50:42.000397 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-dd5ccc01-5486-4598-b46c-0040bfb00c18 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37f21d6d15cf40a586edda211219fd08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ebb970305844dccacf48a7d8d47ecf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:50:42.011686 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-dd5ccc01-5486-4598-b46c-0040bfb00c18 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '37f21d6d15cf40a586edda211219fd08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ebb970305844dccacf48a7d8d47ecf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:50:42.013201 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-dd5ccc01-5486-4598-b46c-0040bfb00c18 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '37f21d6d15cf40a586edda211219fd08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ebb970305844dccacf48a7d8d47ecf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:50:42.014344 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-dd5ccc01-5486-4598-b46c-0040bfb00c18 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] 10.222.0.11 "GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7" status: 200 len: 1803 microversion: 2.20 time: 0.187497 Nov 17 03:50:42.015763 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 1085/2361] 10.222.0.11 () {60 vars in 1276 bytes} [Wed Nov 17 03:50:41 2021] GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7 => generated 1803 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 17 03:50:42.528232 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-1e4623f9-dd03-4755-8c1a-5cd7b18bcead tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:50:42.528863 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-1e4623f9-dd03-4755-8c1a-5cd7b18bcead tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] [instance: 0698dc5b-5f47-46c4-ace8-f5e891a964a0] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:50:42.535569 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-1e4623f9-dd03-4755-8c1a-5cd7b18bcead tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:50:42.536108 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-1e4623f9-dd03-4755-8c1a-5cd7b18bcead tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:50:42.537025 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-1e4623f9-dd03-4755-8c1a-5cd7b18bcead tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:50:42.537537 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-1e4623f9-dd03-4755-8c1a-5cd7b18bcead tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:50:42.602868 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-1e4623f9-dd03-4755-8c1a-5cd7b18bcead tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '163b2f24a72649ac8084be1cac32fa09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e123e9b86124c93a7fc2db9984e7466', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:50:42.611506 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-1e4623f9-dd03-4755-8c1a-5cd7b18bcead tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] 10.222.0.11 "GET /compute/v2.1/servers/0698dc5b-5f47-46c4-ace8-f5e891a964a0" status: 200 len: 1218 microversion: 2.1 time: 0.087639 Nov 17 03:50:42.612072 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 1277/2362] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:50:42 2021] GET /compute/v2.1/servers/0698dc5b-5f47-46c4-ace8-f5e891a964a0 => generated 1218 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:50:43.032362 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-f47a5f84-453c-4ea3-ba5c-f35b63394b06 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:50:43.033012 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-f47a5f84-453c-4ea3-ba5c-f35b63394b06 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] [instance: 5d54db85-b991-4890-abaa-952413baa2e7] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:50:43.039693 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-f47a5f84-453c-4ea3-ba5c-f35b63394b06 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:50:43.040141 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-f47a5f84-453c-4ea3-ba5c-f35b63394b06 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:50:43.040937 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-f47a5f84-453c-4ea3-ba5c-f35b63394b06 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:50:43.041371 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-f47a5f84-453c-4ea3-ba5c-f35b63394b06 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:50:43.179298 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-f47a5f84-453c-4ea3-ba5c-f35b63394b06 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37f21d6d15cf40a586edda211219fd08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ebb970305844dccacf48a7d8d47ecf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:50:43.188333 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-f47a5f84-453c-4ea3-ba5c-f35b63394b06 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '37f21d6d15cf40a586edda211219fd08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ebb970305844dccacf48a7d8d47ecf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:50:43.189848 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-f47a5f84-453c-4ea3-ba5c-f35b63394b06 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '37f21d6d15cf40a586edda211219fd08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ebb970305844dccacf48a7d8d47ecf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:50:43.190999 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-f47a5f84-453c-4ea3-ba5c-f35b63394b06 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] 10.222.0.11 "GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7" status: 200 len: 1803 microversion: 2.20 time: 0.162435 Nov 17 03:50:43.191551 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 1086/2363] 10.222.0.11 () {60 vars in 1276 bytes} [Wed Nov 17 03:50:43 2021] GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7 => generated 1803 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 17 03:50:43.631385 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-8e79e929-672e-466b-902e-dbe527809036 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:50:43.632317 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-8e79e929-672e-466b-902e-dbe527809036 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] [instance: 0698dc5b-5f47-46c4-ace8-f5e891a964a0] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:50:43.643032 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-8e79e929-672e-466b-902e-dbe527809036 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:50:43.643774 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-8e79e929-672e-466b-902e-dbe527809036 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:50:43.645100 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-8e79e929-672e-466b-902e-dbe527809036 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:50:43.645818 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-8e79e929-672e-466b-902e-dbe527809036 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:50:43.707180 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-8e79e929-672e-466b-902e-dbe527809036 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '163b2f24a72649ac8084be1cac32fa09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e123e9b86124c93a7fc2db9984e7466', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:50:43.717147 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-8e79e929-672e-466b-902e-dbe527809036 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] 10.222.0.11 "GET /compute/v2.1/servers/0698dc5b-5f47-46c4-ace8-f5e891a964a0" status: 200 len: 1218 microversion: 2.1 time: 0.091942 Nov 17 03:50:43.717762 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 1278/2364] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:50:43 2021] GET /compute/v2.1/servers/0698dc5b-5f47-46c4-ace8-f5e891a964a0 => generated 1218 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:50:44.218582 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-ca1e167c-22eb-4cc1-a8ad-1de069a61187 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:50:44.219403 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-ca1e167c-22eb-4cc1-a8ad-1de069a61187 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] [instance: 5d54db85-b991-4890-abaa-952413baa2e7] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:50:44.228281 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-ca1e167c-22eb-4cc1-a8ad-1de069a61187 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:50:44.228936 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-ca1e167c-22eb-4cc1-a8ad-1de069a61187 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:50:44.229960 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-ca1e167c-22eb-4cc1-a8ad-1de069a61187 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:50:44.230536 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-ca1e167c-22eb-4cc1-a8ad-1de069a61187 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:50:44.371830 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-ca1e167c-22eb-4cc1-a8ad-1de069a61187 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37f21d6d15cf40a586edda211219fd08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ebb970305844dccacf48a7d8d47ecf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:50:44.381165 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-ca1e167c-22eb-4cc1-a8ad-1de069a61187 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '37f21d6d15cf40a586edda211219fd08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ebb970305844dccacf48a7d8d47ecf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:50:44.382658 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-ca1e167c-22eb-4cc1-a8ad-1de069a61187 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '37f21d6d15cf40a586edda211219fd08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ebb970305844dccacf48a7d8d47ecf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:50:44.383818 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-ca1e167c-22eb-4cc1-a8ad-1de069a61187 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] 10.222.0.11 "GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7" status: 200 len: 1803 microversion: 2.20 time: 0.170933 Nov 17 03:50:44.384372 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 1087/2365] 10.222.0.11 () {60 vars in 1276 bytes} [Wed Nov 17 03:50:44 2021] GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7 => generated 1803 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 17 03:50:44.735505 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-cc72b738-64c9-43fc-b584-19af79b5dd4b tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:50:44.736126 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-cc72b738-64c9-43fc-b584-19af79b5dd4b tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] [instance: 0698dc5b-5f47-46c4-ace8-f5e891a964a0] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:50:44.743213 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-cc72b738-64c9-43fc-b584-19af79b5dd4b tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:50:44.743691 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-cc72b738-64c9-43fc-b584-19af79b5dd4b tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:50:44.744511 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-cc72b738-64c9-43fc-b584-19af79b5dd4b tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:50:44.745015 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-cc72b738-64c9-43fc-b584-19af79b5dd4b tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:50:44.805004 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-cc72b738-64c9-43fc-b584-19af79b5dd4b tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '163b2f24a72649ac8084be1cac32fa09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e123e9b86124c93a7fc2db9984e7466', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:50:44.812642 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-cc72b738-64c9-43fc-b584-19af79b5dd4b tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] 10.222.0.11 "GET /compute/v2.1/servers/0698dc5b-5f47-46c4-ace8-f5e891a964a0" status: 200 len: 1218 microversion: 2.1 time: 0.081837 Nov 17 03:50:44.813247 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 1279/2366] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:50:44 2021] GET /compute/v2.1/servers/0698dc5b-5f47-46c4-ace8-f5e891a964a0 => generated 1218 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:50:45.405958 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-29031037-685f-4c11-b2e1-2e7245b07fd5 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:50:45.406530 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-29031037-685f-4c11-b2e1-2e7245b07fd5 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] [instance: 5d54db85-b991-4890-abaa-952413baa2e7] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:50:45.414943 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-29031037-685f-4c11-b2e1-2e7245b07fd5 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:50:45.415486 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-29031037-685f-4c11-b2e1-2e7245b07fd5 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:50:45.416268 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-29031037-685f-4c11-b2e1-2e7245b07fd5 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:50:45.416707 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-29031037-685f-4c11-b2e1-2e7245b07fd5 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:50:45.564086 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-29031037-685f-4c11-b2e1-2e7245b07fd5 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37f21d6d15cf40a586edda211219fd08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ebb970305844dccacf48a7d8d47ecf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:50:45.578120 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-29031037-685f-4c11-b2e1-2e7245b07fd5 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '37f21d6d15cf40a586edda211219fd08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ebb970305844dccacf48a7d8d47ecf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:50:45.579644 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-29031037-685f-4c11-b2e1-2e7245b07fd5 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '37f21d6d15cf40a586edda211219fd08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ebb970305844dccacf48a7d8d47ecf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:50:45.580819 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-29031037-685f-4c11-b2e1-2e7245b07fd5 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] 10.222.0.11 "GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7" status: 200 len: 1803 microversion: 2.20 time: 0.180830 Nov 17 03:50:45.581429 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 1088/2367] 10.222.0.11 () {60 vars in 1276 bytes} [Wed Nov 17 03:50:45 2021] GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7 => generated 1803 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 17 03:50:45.832664 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-126e715d-bf41-4ce6-8f47-f2f528bde289 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:50:45.833626 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-126e715d-bf41-4ce6-8f47-f2f528bde289 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] [instance: 0698dc5b-5f47-46c4-ace8-f5e891a964a0] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:50:45.843371 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-126e715d-bf41-4ce6-8f47-f2f528bde289 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:50:45.843814 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-126e715d-bf41-4ce6-8f47-f2f528bde289 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:50:45.844578 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-126e715d-bf41-4ce6-8f47-f2f528bde289 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:50:45.845038 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-126e715d-bf41-4ce6-8f47-f2f528bde289 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:50:45.909212 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-126e715d-bf41-4ce6-8f47-f2f528bde289 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '163b2f24a72649ac8084be1cac32fa09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e123e9b86124c93a7fc2db9984e7466', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:50:45.917173 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-126e715d-bf41-4ce6-8f47-f2f528bde289 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] 10.222.0.11 "GET /compute/v2.1/servers/0698dc5b-5f47-46c4-ace8-f5e891a964a0" status: 200 len: 1218 microversion: 2.1 time: 0.091383 Nov 17 03:50:45.917748 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 1280/2368] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:50:45 2021] GET /compute/v2.1/servers/0698dc5b-5f47-46c4-ace8-f5e891a964a0 => generated 1218 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:50:46.603242 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-db11d95c-f217-41fa-9e47-8105245850ea tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:50:46.604408 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-db11d95c-f217-41fa-9e47-8105245850ea tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] [instance: 5d54db85-b991-4890-abaa-952413baa2e7] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:50:46.614525 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-db11d95c-f217-41fa-9e47-8105245850ea tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:50:46.615267 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-db11d95c-f217-41fa-9e47-8105245850ea tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:50:46.616540 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-db11d95c-f217-41fa-9e47-8105245850ea tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:50:46.617306 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-db11d95c-f217-41fa-9e47-8105245850ea tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:50:46.757917 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-db11d95c-f217-41fa-9e47-8105245850ea tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37f21d6d15cf40a586edda211219fd08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ebb970305844dccacf48a7d8d47ecf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:50:46.766870 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-db11d95c-f217-41fa-9e47-8105245850ea tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '37f21d6d15cf40a586edda211219fd08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ebb970305844dccacf48a7d8d47ecf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:50:46.768351 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-db11d95c-f217-41fa-9e47-8105245850ea tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '37f21d6d15cf40a586edda211219fd08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ebb970305844dccacf48a7d8d47ecf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:50:46.769546 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-db11d95c-f217-41fa-9e47-8105245850ea tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] 10.222.0.11 "GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7" status: 200 len: 1803 microversion: 2.20 time: 0.172614 Nov 17 03:50:46.770110 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 1089/2369] 10.222.0.11 () {60 vars in 1276 bytes} [Wed Nov 17 03:50:46 2021] GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7 => generated 1803 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 17 03:50:46.937691 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-a4fbc919-87c6-4f4c-b6e7-3105ec6dc617 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:50:46.938356 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-a4fbc919-87c6-4f4c-b6e7-3105ec6dc617 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] [instance: 0698dc5b-5f47-46c4-ace8-f5e891a964a0] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:50:46.946582 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-a4fbc919-87c6-4f4c-b6e7-3105ec6dc617 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:50:46.947146 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-a4fbc919-87c6-4f4c-b6e7-3105ec6dc617 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:50:46.948102 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-a4fbc919-87c6-4f4c-b6e7-3105ec6dc617 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:50:46.948637 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-a4fbc919-87c6-4f4c-b6e7-3105ec6dc617 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:50:47.014113 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-a4fbc919-87c6-4f4c-b6e7-3105ec6dc617 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '163b2f24a72649ac8084be1cac32fa09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e123e9b86124c93a7fc2db9984e7466', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:50:47.022287 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-a4fbc919-87c6-4f4c-b6e7-3105ec6dc617 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] 10.222.0.11 "GET /compute/v2.1/servers/0698dc5b-5f47-46c4-ace8-f5e891a964a0" status: 200 len: 1218 microversion: 2.1 time: 0.090312 Nov 17 03:50:47.022899 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 1281/2370] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:50:46 2021] GET /compute/v2.1/servers/0698dc5b-5f47-46c4-ace8-f5e891a964a0 => generated 1218 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:50:47.788647 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-b7853db5-badf-4e9e-8d8a-eda35d4b3824 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:50:47.789295 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-b7853db5-badf-4e9e-8d8a-eda35d4b3824 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] [instance: 5d54db85-b991-4890-abaa-952413baa2e7] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:50:47.796131 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-b7853db5-badf-4e9e-8d8a-eda35d4b3824 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:50:47.796574 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-b7853db5-badf-4e9e-8d8a-eda35d4b3824 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:50:47.797403 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-b7853db5-badf-4e9e-8d8a-eda35d4b3824 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:50:47.797850 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-b7853db5-badf-4e9e-8d8a-eda35d4b3824 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:50:47.939202 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-b7853db5-badf-4e9e-8d8a-eda35d4b3824 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37f21d6d15cf40a586edda211219fd08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ebb970305844dccacf48a7d8d47ecf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:50:47.947930 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-b7853db5-badf-4e9e-8d8a-eda35d4b3824 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '37f21d6d15cf40a586edda211219fd08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ebb970305844dccacf48a7d8d47ecf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:50:47.949437 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-b7853db5-badf-4e9e-8d8a-eda35d4b3824 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '37f21d6d15cf40a586edda211219fd08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ebb970305844dccacf48a7d8d47ecf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:50:47.950701 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-b7853db5-badf-4e9e-8d8a-eda35d4b3824 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] 10.222.0.11 "GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7" status: 200 len: 1803 microversion: 2.20 time: 0.165897 Nov 17 03:50:47.951261 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 1090/2371] 10.222.0.11 () {60 vars in 1276 bytes} [Wed Nov 17 03:50:47 2021] GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7 => generated 1803 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 17 03:50:48.042701 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-96f1d7dc-31fb-4284-8baa-99d413de6bab tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:50:48.043562 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-96f1d7dc-31fb-4284-8baa-99d413de6bab tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] [instance: 0698dc5b-5f47-46c4-ace8-f5e891a964a0] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:50:48.051052 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-96f1d7dc-31fb-4284-8baa-99d413de6bab tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:50:48.051493 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-96f1d7dc-31fb-4284-8baa-99d413de6bab tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:50:48.052260 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-96f1d7dc-31fb-4284-8baa-99d413de6bab tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:50:48.053063 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-96f1d7dc-31fb-4284-8baa-99d413de6bab tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:50:48.117278 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-96f1d7dc-31fb-4284-8baa-99d413de6bab tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '163b2f24a72649ac8084be1cac32fa09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e123e9b86124c93a7fc2db9984e7466', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:50:48.125487 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-96f1d7dc-31fb-4284-8baa-99d413de6bab tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] 10.222.0.11 "GET /compute/v2.1/servers/0698dc5b-5f47-46c4-ace8-f5e891a964a0" status: 200 len: 1218 microversion: 2.1 time: 0.089077 Nov 17 03:50:48.126027 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 1282/2372] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:50:48 2021] GET /compute/v2.1/servers/0698dc5b-5f47-46c4-ace8-f5e891a964a0 => generated 1218 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:50:48.973839 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-1539ed83-9085-42ff-8f5c-27e2e13a5d1e tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:50:48.974763 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-1539ed83-9085-42ff-8f5c-27e2e13a5d1e tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] [instance: 5d54db85-b991-4890-abaa-952413baa2e7] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:50:48.985888 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-1539ed83-9085-42ff-8f5c-27e2e13a5d1e tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:50:48.986535 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-1539ed83-9085-42ff-8f5c-27e2e13a5d1e tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:50:48.987846 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-1539ed83-9085-42ff-8f5c-27e2e13a5d1e tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:50:48.988556 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-1539ed83-9085-42ff-8f5c-27e2e13a5d1e tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:50:49.142765 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-a355bb7a-748b-4428-bcc4-f9bd1f731e2a tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:50:49.143370 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-a355bb7a-748b-4428-bcc4-f9bd1f731e2a tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] [instance: 0698dc5b-5f47-46c4-ace8-f5e891a964a0] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:50:49.146309 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-1539ed83-9085-42ff-8f5c-27e2e13a5d1e tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37f21d6d15cf40a586edda211219fd08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ebb970305844dccacf48a7d8d47ecf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:50:49.149932 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-a355bb7a-748b-4428-bcc4-f9bd1f731e2a tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:50:49.150375 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-a355bb7a-748b-4428-bcc4-f9bd1f731e2a tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:50:49.151148 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-a355bb7a-748b-4428-bcc4-f9bd1f731e2a tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:50:49.151567 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-a355bb7a-748b-4428-bcc4-f9bd1f731e2a tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:50:49.157431 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-1539ed83-9085-42ff-8f5c-27e2e13a5d1e tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '37f21d6d15cf40a586edda211219fd08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ebb970305844dccacf48a7d8d47ecf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:50:49.158916 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-1539ed83-9085-42ff-8f5c-27e2e13a5d1e tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '37f21d6d15cf40a586edda211219fd08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ebb970305844dccacf48a7d8d47ecf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:50:49.160072 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-1539ed83-9085-42ff-8f5c-27e2e13a5d1e tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] 10.222.0.11 "GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7" status: 200 len: 1803 microversion: 2.20 time: 0.192751 Nov 17 03:50:49.160746 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 1091/2373] 10.222.0.11 () {60 vars in 1276 bytes} [Wed Nov 17 03:50:48 2021] GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7 => generated 1803 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 17 03:50:49.211321 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-a355bb7a-748b-4428-bcc4-f9bd1f731e2a tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '163b2f24a72649ac8084be1cac32fa09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e123e9b86124c93a7fc2db9984e7466', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:50:49.219171 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-a355bb7a-748b-4428-bcc4-f9bd1f731e2a tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] 10.222.0.11 "GET /compute/v2.1/servers/0698dc5b-5f47-46c4-ace8-f5e891a964a0" status: 200 len: 1218 microversion: 2.1 time: 0.080171 Nov 17 03:50:49.219733 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 1283/2374] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:50:49 2021] GET /compute/v2.1/servers/0698dc5b-5f47-46c4-ace8-f5e891a964a0 => generated 1218 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:50:50.179273 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-a5e3c242-5462-4434-8c7d-d35b814269cf tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:50:50.179885 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-a5e3c242-5462-4434-8c7d-d35b814269cf tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] [instance: 5d54db85-b991-4890-abaa-952413baa2e7] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:50:50.186609 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-a5e3c242-5462-4434-8c7d-d35b814269cf tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:50:50.187058 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-a5e3c242-5462-4434-8c7d-d35b814269cf tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:50:50.187822 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-a5e3c242-5462-4434-8c7d-d35b814269cf tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:50:50.188252 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-a5e3c242-5462-4434-8c7d-d35b814269cf tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:50:50.235531 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-e0be20a0-c797-4868-8c2c-941b5eaf295f tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:50:50.236204 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-e0be20a0-c797-4868-8c2c-941b5eaf295f tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] [instance: 0698dc5b-5f47-46c4-ace8-f5e891a964a0] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:50:50.242259 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-e0be20a0-c797-4868-8c2c-941b5eaf295f tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:50:50.242704 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-e0be20a0-c797-4868-8c2c-941b5eaf295f tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:50:50.243472 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-e0be20a0-c797-4868-8c2c-941b5eaf295f tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:50:50.243899 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-e0be20a0-c797-4868-8c2c-941b5eaf295f tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:50:50.302922 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-e0be20a0-c797-4868-8c2c-941b5eaf295f tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '163b2f24a72649ac8084be1cac32fa09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e123e9b86124c93a7fc2db9984e7466', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:50:50.310695 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-e0be20a0-c797-4868-8c2c-941b5eaf295f tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] 10.222.0.11 "GET /compute/v2.1/servers/0698dc5b-5f47-46c4-ace8-f5e891a964a0" status: 200 len: 1218 microversion: 2.1 time: 0.078694 Nov 17 03:50:50.311156 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 1284/2375] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:50:50 2021] GET /compute/v2.1/servers/0698dc5b-5f47-46c4-ace8-f5e891a964a0 => generated 1218 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:50:50.324174 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-a5e3c242-5462-4434-8c7d-d35b814269cf tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37f21d6d15cf40a586edda211219fd08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ebb970305844dccacf48a7d8d47ecf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:50:50.332883 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-a5e3c242-5462-4434-8c7d-d35b814269cf tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '37f21d6d15cf40a586edda211219fd08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ebb970305844dccacf48a7d8d47ecf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:50:50.334372 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-a5e3c242-5462-4434-8c7d-d35b814269cf tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '37f21d6d15cf40a586edda211219fd08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ebb970305844dccacf48a7d8d47ecf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:50:50.335517 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-a5e3c242-5462-4434-8c7d-d35b814269cf tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] 10.222.0.11 "GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7" status: 200 len: 1803 microversion: 2.20 time: 0.160428 Nov 17 03:50:50.336040 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 1092/2376] 10.222.0.11 () {60 vars in 1276 bytes} [Wed Nov 17 03:50:50 2021] GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7 => generated 1803 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 17 03:50:51.331760 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-acaaca61-b8e4-44a4-bbd6-96c7011d3653 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:50:51.332658 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-acaaca61-b8e4-44a4-bbd6-96c7011d3653 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] [instance: 0698dc5b-5f47-46c4-ace8-f5e891a964a0] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:50:51.342832 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-acaaca61-b8e4-44a4-bbd6-96c7011d3653 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:50:51.343274 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-acaaca61-b8e4-44a4-bbd6-96c7011d3653 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:50:51.344044 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-acaaca61-b8e4-44a4-bbd6-96c7011d3653 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:50:51.344469 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-acaaca61-b8e4-44a4-bbd6-96c7011d3653 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:50:51.354269 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-7941e10d-d06e-4895-b8b1-0b1aa6aac22e tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:50:51.354913 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-7941e10d-d06e-4895-b8b1-0b1aa6aac22e tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] [instance: 5d54db85-b991-4890-abaa-952413baa2e7] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:50:51.362038 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-7941e10d-d06e-4895-b8b1-0b1aa6aac22e tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:50:51.362480 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-7941e10d-d06e-4895-b8b1-0b1aa6aac22e tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:50:51.363426 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-7941e10d-d06e-4895-b8b1-0b1aa6aac22e tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:50:51.363869 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-7941e10d-d06e-4895-b8b1-0b1aa6aac22e tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:50:51.404475 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-acaaca61-b8e4-44a4-bbd6-96c7011d3653 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '163b2f24a72649ac8084be1cac32fa09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e123e9b86124c93a7fc2db9984e7466', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:50:51.412166 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-acaaca61-b8e4-44a4-bbd6-96c7011d3653 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] 10.222.0.11 "GET /compute/v2.1/servers/0698dc5b-5f47-46c4-ace8-f5e891a964a0" status: 200 len: 1218 microversion: 2.1 time: 0.086853 Nov 17 03:50:51.412703 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 1285/2377] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:50:51 2021] GET /compute/v2.1/servers/0698dc5b-5f47-46c4-ace8-f5e891a964a0 => generated 1218 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:50:51.494803 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-7941e10d-d06e-4895-b8b1-0b1aa6aac22e tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37f21d6d15cf40a586edda211219fd08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ebb970305844dccacf48a7d8d47ecf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:50:51.503608 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-7941e10d-d06e-4895-b8b1-0b1aa6aac22e tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '37f21d6d15cf40a586edda211219fd08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ebb970305844dccacf48a7d8d47ecf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:50:51.505128 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-7941e10d-d06e-4895-b8b1-0b1aa6aac22e tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '37f21d6d15cf40a586edda211219fd08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ebb970305844dccacf48a7d8d47ecf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:50:51.506284 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-7941e10d-d06e-4895-b8b1-0b1aa6aac22e tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] 10.222.0.11 "GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7" status: 200 len: 1803 microversion: 2.20 time: 0.155762 Nov 17 03:50:51.506845 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 1093/2378] 10.222.0.11 () {60 vars in 1276 bytes} [Wed Nov 17 03:50:51 2021] GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7 => generated 1803 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 17 03:50:52.433682 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-fc2303ee-b547-4b6e-b882-bcaa4a20c55e tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:50:52.434557 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-fc2303ee-b547-4b6e-b882-bcaa4a20c55e tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] [instance: 0698dc5b-5f47-46c4-ace8-f5e891a964a0] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:50:52.445819 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-fc2303ee-b547-4b6e-b882-bcaa4a20c55e tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:50:52.446564 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-fc2303ee-b547-4b6e-b882-bcaa4a20c55e tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:50:52.447824 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-fc2303ee-b547-4b6e-b882-bcaa4a20c55e tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:50:52.448536 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-fc2303ee-b547-4b6e-b882-bcaa4a20c55e tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:50:52.512103 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-fc2303ee-b547-4b6e-b882-bcaa4a20c55e tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '163b2f24a72649ac8084be1cac32fa09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e123e9b86124c93a7fc2db9984e7466', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:50:52.520677 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-fc2303ee-b547-4b6e-b882-bcaa4a20c55e tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] 10.222.0.11 "GET /compute/v2.1/servers/0698dc5b-5f47-46c4-ace8-f5e891a964a0" status: 200 len: 1218 microversion: 2.1 time: 0.093740 Nov 17 03:50:52.521289 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 1286/2379] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:50:52 2021] GET /compute/v2.1/servers/0698dc5b-5f47-46c4-ace8-f5e891a964a0 => generated 1218 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:50:52.525232 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-3c1d638d-1c7f-41b0-8e70-a64a683e3ab3 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:50:52.525836 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-3c1d638d-1c7f-41b0-8e70-a64a683e3ab3 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] [instance: 5d54db85-b991-4890-abaa-952413baa2e7] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:50:52.532931 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-3c1d638d-1c7f-41b0-8e70-a64a683e3ab3 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:50:52.533363 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-3c1d638d-1c7f-41b0-8e70-a64a683e3ab3 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:50:52.534141 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-3c1d638d-1c7f-41b0-8e70-a64a683e3ab3 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:50:52.534571 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-3c1d638d-1c7f-41b0-8e70-a64a683e3ab3 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:50:52.677004 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-3c1d638d-1c7f-41b0-8e70-a64a683e3ab3 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37f21d6d15cf40a586edda211219fd08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ebb970305844dccacf48a7d8d47ecf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:50:52.686593 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-3c1d638d-1c7f-41b0-8e70-a64a683e3ab3 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '37f21d6d15cf40a586edda211219fd08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ebb970305844dccacf48a7d8d47ecf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:50:52.688061 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-3c1d638d-1c7f-41b0-8e70-a64a683e3ab3 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '37f21d6d15cf40a586edda211219fd08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ebb970305844dccacf48a7d8d47ecf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:50:52.689268 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-3c1d638d-1c7f-41b0-8e70-a64a683e3ab3 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] 10.222.0.11 "GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7" status: 200 len: 1803 microversion: 2.20 time: 0.167760 Nov 17 03:50:52.689827 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 1094/2380] 10.222.0.11 () {60 vars in 1276 bytes} [Wed Nov 17 03:50:52 2021] GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7 => generated 1803 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 17 03:50:53.541785 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-c2837fb4-ffbb-4081-8c38-2796b4d19203 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:50:53.542716 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-c2837fb4-ffbb-4081-8c38-2796b4d19203 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] [instance: 0698dc5b-5f47-46c4-ace8-f5e891a964a0] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:50:53.554170 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-c2837fb4-ffbb-4081-8c38-2796b4d19203 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:50:53.554961 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-c2837fb4-ffbb-4081-8c38-2796b4d19203 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:50:53.556235 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-c2837fb4-ffbb-4081-8c38-2796b4d19203 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:50:53.557012 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-c2837fb4-ffbb-4081-8c38-2796b4d19203 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:50:53.618331 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-c2837fb4-ffbb-4081-8c38-2796b4d19203 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '163b2f24a72649ac8084be1cac32fa09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e123e9b86124c93a7fc2db9984e7466', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:50:53.626077 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-c2837fb4-ffbb-4081-8c38-2796b4d19203 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] 10.222.0.11 "GET /compute/v2.1/servers/0698dc5b-5f47-46c4-ace8-f5e891a964a0" status: 200 len: 1218 microversion: 2.1 time: 0.090570 Nov 17 03:50:53.626659 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 1287/2381] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:50:53 2021] GET /compute/v2.1/servers/0698dc5b-5f47-46c4-ace8-f5e891a964a0 => generated 1218 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:50:53.711249 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-340c952d-c211-42af-8e65-ad796ed381fb tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:50:53.712222 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-340c952d-c211-42af-8e65-ad796ed381fb tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] [instance: 5d54db85-b991-4890-abaa-952413baa2e7] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:50:53.723026 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-340c952d-c211-42af-8e65-ad796ed381fb tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:50:53.723786 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-340c952d-c211-42af-8e65-ad796ed381fb tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:50:53.725103 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-340c952d-c211-42af-8e65-ad796ed381fb tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:50:53.725822 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-340c952d-c211-42af-8e65-ad796ed381fb tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:50:53.859708 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-340c952d-c211-42af-8e65-ad796ed381fb tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37f21d6d15cf40a586edda211219fd08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ebb970305844dccacf48a7d8d47ecf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:50:53.868716 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-340c952d-c211-42af-8e65-ad796ed381fb tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '37f21d6d15cf40a586edda211219fd08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ebb970305844dccacf48a7d8d47ecf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:50:53.870249 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-340c952d-c211-42af-8e65-ad796ed381fb tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '37f21d6d15cf40a586edda211219fd08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ebb970305844dccacf48a7d8d47ecf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:50:53.871443 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-340c952d-c211-42af-8e65-ad796ed381fb tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] 10.222.0.11 "GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7" status: 200 len: 1803 microversion: 2.20 time: 0.166451 Nov 17 03:50:53.872006 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 1095/2382] 10.222.0.11 () {60 vars in 1276 bytes} [Wed Nov 17 03:50:53 2021] GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7 => generated 1803 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 17 03:50:54.647149 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-336daeb4-5712-4820-a110-b74e83787bab tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:50:54.648155 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-336daeb4-5712-4820-a110-b74e83787bab tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] [instance: 0698dc5b-5f47-46c4-ace8-f5e891a964a0] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:50:54.658724 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-336daeb4-5712-4820-a110-b74e83787bab tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:50:54.659475 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-336daeb4-5712-4820-a110-b74e83787bab tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:50:54.660744 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-336daeb4-5712-4820-a110-b74e83787bab tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:50:54.661520 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-336daeb4-5712-4820-a110-b74e83787bab tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:50:54.727102 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-336daeb4-5712-4820-a110-b74e83787bab tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '163b2f24a72649ac8084be1cac32fa09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e123e9b86124c93a7fc2db9984e7466', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:50:54.734788 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-336daeb4-5712-4820-a110-b74e83787bab tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] 10.222.0.11 "GET /compute/v2.1/servers/0698dc5b-5f47-46c4-ace8-f5e891a964a0" status: 200 len: 1218 microversion: 2.1 time: 0.093881 Nov 17 03:50:54.735356 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 1288/2383] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:50:54 2021] GET /compute/v2.1/servers/0698dc5b-5f47-46c4-ace8-f5e891a964a0 => generated 1218 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:50:54.899581 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-597db79f-318c-4faf-9954-6401e03a6dbc tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:50:54.900420 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-597db79f-318c-4faf-9954-6401e03a6dbc tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] [instance: 5d54db85-b991-4890-abaa-952413baa2e7] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:50:54.908760 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-597db79f-318c-4faf-9954-6401e03a6dbc tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:50:54.909241 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-597db79f-318c-4faf-9954-6401e03a6dbc tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:50:54.910014 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-597db79f-318c-4faf-9954-6401e03a6dbc tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:50:54.910445 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-597db79f-318c-4faf-9954-6401e03a6dbc tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:50:55.059748 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-597db79f-318c-4faf-9954-6401e03a6dbc tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37f21d6d15cf40a586edda211219fd08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ebb970305844dccacf48a7d8d47ecf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:50:55.068833 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-597db79f-318c-4faf-9954-6401e03a6dbc tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '37f21d6d15cf40a586edda211219fd08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ebb970305844dccacf48a7d8d47ecf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:50:55.070354 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-597db79f-318c-4faf-9954-6401e03a6dbc tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '37f21d6d15cf40a586edda211219fd08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ebb970305844dccacf48a7d8d47ecf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:50:55.071511 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-597db79f-318c-4faf-9954-6401e03a6dbc tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] 10.222.0.11 "GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7" status: 200 len: 1803 microversion: 2.20 time: 0.178215 Nov 17 03:50:55.072066 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 1096/2384] 10.222.0.11 () {60 vars in 1276 bytes} [Wed Nov 17 03:50:54 2021] GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7 => generated 1803 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 17 03:50:55.758031 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-0f22c6a2-e12c-4386-a098-3ad1c926af83 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:50:55.759067 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-0f22c6a2-e12c-4386-a098-3ad1c926af83 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] [instance: 0698dc5b-5f47-46c4-ace8-f5e891a964a0] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:50:55.770116 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-0f22c6a2-e12c-4386-a098-3ad1c926af83 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:50:55.770868 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-0f22c6a2-e12c-4386-a098-3ad1c926af83 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:50:55.772152 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-0f22c6a2-e12c-4386-a098-3ad1c926af83 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:50:55.772930 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-0f22c6a2-e12c-4386-a098-3ad1c926af83 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:50:55.833514 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-0f22c6a2-e12c-4386-a098-3ad1c926af83 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '163b2f24a72649ac8084be1cac32fa09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e123e9b86124c93a7fc2db9984e7466', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:50:55.841005 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-0f22c6a2-e12c-4386-a098-3ad1c926af83 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] 10.222.0.11 "GET /compute/v2.1/servers/0698dc5b-5f47-46c4-ace8-f5e891a964a0" status: 200 len: 1218 microversion: 2.1 time: 0.089179 Nov 17 03:50:55.841712 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 1289/2385] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:50:55 2021] GET /compute/v2.1/servers/0698dc5b-5f47-46c4-ace8-f5e891a964a0 => generated 1218 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:50:56.090565 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-6d5b68c0-44e7-4323-b3d4-f2181d7e5e25 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:50:56.091146 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-6d5b68c0-44e7-4323-b3d4-f2181d7e5e25 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] [instance: 5d54db85-b991-4890-abaa-952413baa2e7] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:50:56.097864 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-6d5b68c0-44e7-4323-b3d4-f2181d7e5e25 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:50:56.098306 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-6d5b68c0-44e7-4323-b3d4-f2181d7e5e25 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:50:56.099064 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-6d5b68c0-44e7-4323-b3d4-f2181d7e5e25 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:50:56.099489 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-6d5b68c0-44e7-4323-b3d4-f2181d7e5e25 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:50:56.242606 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-6d5b68c0-44e7-4323-b3d4-f2181d7e5e25 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37f21d6d15cf40a586edda211219fd08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ebb970305844dccacf48a7d8d47ecf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:50:56.251077 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-6d5b68c0-44e7-4323-b3d4-f2181d7e5e25 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '37f21d6d15cf40a586edda211219fd08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ebb970305844dccacf48a7d8d47ecf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:50:56.252567 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-6d5b68c0-44e7-4323-b3d4-f2181d7e5e25 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '37f21d6d15cf40a586edda211219fd08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ebb970305844dccacf48a7d8d47ecf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:50:56.253759 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-6d5b68c0-44e7-4323-b3d4-f2181d7e5e25 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] 10.222.0.11 "GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7" status: 200 len: 1803 microversion: 2.20 time: 0.166977 Nov 17 03:50:56.254323 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 1097/2386] 10.222.0.11 () {60 vars in 1276 bytes} [Wed Nov 17 03:50:56 2021] GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7 => generated 1803 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 17 03:50:56.862489 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-d6f278ad-9236-46a1-9ee3-e1362c36709c tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:50:56.863425 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-d6f278ad-9236-46a1-9ee3-e1362c36709c tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] [instance: 0698dc5b-5f47-46c4-ace8-f5e891a964a0] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:50:56.874334 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-d6f278ad-9236-46a1-9ee3-e1362c36709c tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:50:56.875084 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-d6f278ad-9236-46a1-9ee3-e1362c36709c tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:50:56.876332 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-d6f278ad-9236-46a1-9ee3-e1362c36709c tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:50:56.877100 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-d6f278ad-9236-46a1-9ee3-e1362c36709c tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:50:56.941580 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-d6f278ad-9236-46a1-9ee3-e1362c36709c tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '163b2f24a72649ac8084be1cac32fa09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e123e9b86124c93a7fc2db9984e7466', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:50:56.949421 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-d6f278ad-9236-46a1-9ee3-e1362c36709c tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] 10.222.0.11 "GET /compute/v2.1/servers/0698dc5b-5f47-46c4-ace8-f5e891a964a0" status: 200 len: 1218 microversion: 2.1 time: 0.093405 Nov 17 03:50:56.949979 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 1290/2387] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:50:56 2021] GET /compute/v2.1/servers/0698dc5b-5f47-46c4-ace8-f5e891a964a0 => generated 1218 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:50:57.276108 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-ef551216-eda6-4c6c-87a5-a447c5a54c56 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:50:57.277082 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-ef551216-eda6-4c6c-87a5-a447c5a54c56 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] [instance: 5d54db85-b991-4890-abaa-952413baa2e7] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:50:57.285190 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-ef551216-eda6-4c6c-87a5-a447c5a54c56 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:50:57.285637 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-ef551216-eda6-4c6c-87a5-a447c5a54c56 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:50:57.286405 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-ef551216-eda6-4c6c-87a5-a447c5a54c56 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:50:57.286838 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-ef551216-eda6-4c6c-87a5-a447c5a54c56 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:50:57.441128 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-ef551216-eda6-4c6c-87a5-a447c5a54c56 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37f21d6d15cf40a586edda211219fd08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ebb970305844dccacf48a7d8d47ecf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:50:57.450177 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-ef551216-eda6-4c6c-87a5-a447c5a54c56 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '37f21d6d15cf40a586edda211219fd08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ebb970305844dccacf48a7d8d47ecf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:50:57.451900 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-ef551216-eda6-4c6c-87a5-a447c5a54c56 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '37f21d6d15cf40a586edda211219fd08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ebb970305844dccacf48a7d8d47ecf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:50:57.453550 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-ef551216-eda6-4c6c-87a5-a447c5a54c56 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] 10.222.0.11 "GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7" status: 200 len: 1803 microversion: 2.20 time: 0.183599 Nov 17 03:50:57.454088 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 1098/2388] 10.222.0.11 () {60 vars in 1276 bytes} [Wed Nov 17 03:50:57 2021] GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7 => generated 1803 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 17 03:50:57.970206 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-9a78086d-5239-4b03-b82c-2c7c93471e48 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:50:57.970987 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-9a78086d-5239-4b03-b82c-2c7c93471e48 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] [instance: 0698dc5b-5f47-46c4-ace8-f5e891a964a0] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:50:57.979581 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-9a78086d-5239-4b03-b82c-2c7c93471e48 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:50:57.980170 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-9a78086d-5239-4b03-b82c-2c7c93471e48 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:50:57.981230 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-9a78086d-5239-4b03-b82c-2c7c93471e48 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:50:57.981798 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-9a78086d-5239-4b03-b82c-2c7c93471e48 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:50:58.044243 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-9a78086d-5239-4b03-b82c-2c7c93471e48 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '163b2f24a72649ac8084be1cac32fa09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e123e9b86124c93a7fc2db9984e7466', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:50:58.052103 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-9a78086d-5239-4b03-b82c-2c7c93471e48 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] 10.222.0.11 "GET /compute/v2.1/servers/0698dc5b-5f47-46c4-ace8-f5e891a964a0" status: 200 len: 1218 microversion: 2.1 time: 0.087777 Nov 17 03:50:58.053058 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 1291/2389] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:50:57 2021] GET /compute/v2.1/servers/0698dc5b-5f47-46c4-ace8-f5e891a964a0 => generated 1218 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:50:58.475679 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-05c43d4a-594b-4675-a463-3bea070a82c0 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:50:58.476283 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-05c43d4a-594b-4675-a463-3bea070a82c0 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] [instance: 5d54db85-b991-4890-abaa-952413baa2e7] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:50:58.486203 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-05c43d4a-594b-4675-a463-3bea070a82c0 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:50:58.486657 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-05c43d4a-594b-4675-a463-3bea070a82c0 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:50:58.487426 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-05c43d4a-594b-4675-a463-3bea070a82c0 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:50:58.487858 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-05c43d4a-594b-4675-a463-3bea070a82c0 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:50:58.624643 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-05c43d4a-594b-4675-a463-3bea070a82c0 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37f21d6d15cf40a586edda211219fd08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ebb970305844dccacf48a7d8d47ecf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:50:58.633040 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-05c43d4a-594b-4675-a463-3bea070a82c0 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '37f21d6d15cf40a586edda211219fd08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ebb970305844dccacf48a7d8d47ecf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:50:58.634522 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-05c43d4a-594b-4675-a463-3bea070a82c0 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '37f21d6d15cf40a586edda211219fd08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ebb970305844dccacf48a7d8d47ecf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:50:58.635666 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-05c43d4a-594b-4675-a463-3bea070a82c0 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] 10.222.0.11 "GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7" status: 200 len: 1803 microversion: 2.20 time: 0.166673 Nov 17 03:50:58.636222 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 1099/2390] 10.222.0.11 () {60 vars in 1276 bytes} [Wed Nov 17 03:50:58 2021] GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7 => generated 1803 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 17 03:50:59.073360 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-40f1fd57-3f23-413e-ad86-11fba1179a98 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:50:59.074448 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-40f1fd57-3f23-413e-ad86-11fba1179a98 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] [instance: 0698dc5b-5f47-46c4-ace8-f5e891a964a0] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:50:59.082574 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-40f1fd57-3f23-413e-ad86-11fba1179a98 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:50:59.083020 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-40f1fd57-3f23-413e-ad86-11fba1179a98 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:50:59.083785 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-40f1fd57-3f23-413e-ad86-11fba1179a98 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:50:59.084213 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-40f1fd57-3f23-413e-ad86-11fba1179a98 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:50:59.148424 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-40f1fd57-3f23-413e-ad86-11fba1179a98 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '163b2f24a72649ac8084be1cac32fa09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e123e9b86124c93a7fc2db9984e7466', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:50:59.156111 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-40f1fd57-3f23-413e-ad86-11fba1179a98 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] 10.222.0.11 "GET /compute/v2.1/servers/0698dc5b-5f47-46c4-ace8-f5e891a964a0" status: 200 len: 1218 microversion: 2.1 time: 0.088795 Nov 17 03:50:59.156650 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 1292/2391] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:50:59 2021] GET /compute/v2.1/servers/0698dc5b-5f47-46c4-ace8-f5e891a964a0 => generated 1218 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:50:59.658127 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-daa09a55-c323-4612-b3d5-9d9658d2f08d tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:50:59.659143 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-daa09a55-c323-4612-b3d5-9d9658d2f08d tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] [instance: 5d54db85-b991-4890-abaa-952413baa2e7] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:50:59.669764 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-daa09a55-c323-4612-b3d5-9d9658d2f08d tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:50:59.670517 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-daa09a55-c323-4612-b3d5-9d9658d2f08d tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:50:59.671943 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-daa09a55-c323-4612-b3d5-9d9658d2f08d tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:50:59.672404 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-daa09a55-c323-4612-b3d5-9d9658d2f08d tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:50:59.811153 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-daa09a55-c323-4612-b3d5-9d9658d2f08d tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37f21d6d15cf40a586edda211219fd08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ebb970305844dccacf48a7d8d47ecf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:50:59.824229 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-daa09a55-c323-4612-b3d5-9d9658d2f08d tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '37f21d6d15cf40a586edda211219fd08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ebb970305844dccacf48a7d8d47ecf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:50:59.826747 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-daa09a55-c323-4612-b3d5-9d9658d2f08d tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '37f21d6d15cf40a586edda211219fd08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ebb970305844dccacf48a7d8d47ecf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:50:59.828576 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-daa09a55-c323-4612-b3d5-9d9658d2f08d tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] 10.222.0.11 "GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7" status: 200 len: 1803 microversion: 2.20 time: 0.176643 Nov 17 03:50:59.829163 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 1100/2392] 10.222.0.11 () {60 vars in 1276 bytes} [Wed Nov 17 03:50:59 2021] GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7 => generated 1803 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 17 03:51:00.173114 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-d207d015-49c4-427f-902d-e352290e19f4 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:51:00.173759 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-d207d015-49c4-427f-902d-e352290e19f4 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] [instance: 0698dc5b-5f47-46c4-ace8-f5e891a964a0] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:51:00.180543 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-d207d015-49c4-427f-902d-e352290e19f4 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:51:00.181026 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-d207d015-49c4-427f-902d-e352290e19f4 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:51:00.181790 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-d207d015-49c4-427f-902d-e352290e19f4 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:51:00.182222 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-d207d015-49c4-427f-902d-e352290e19f4 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:51:00.241806 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-d207d015-49c4-427f-902d-e352290e19f4 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '163b2f24a72649ac8084be1cac32fa09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e123e9b86124c93a7fc2db9984e7466', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:51:00.252950 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-d207d015-49c4-427f-902d-e352290e19f4 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] 10.222.0.11 "GET /compute/v2.1/servers/0698dc5b-5f47-46c4-ace8-f5e891a964a0" status: 200 len: 1218 microversion: 2.1 time: 0.083542 Nov 17 03:51:00.253547 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 1293/2393] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:51:00 2021] GET /compute/v2.1/servers/0698dc5b-5f47-46c4-ace8-f5e891a964a0 => generated 1218 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:51:00.854111 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-68199fa0-9d3a-4766-88ee-d61fb05b1a35 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:51:00.855078 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-68199fa0-9d3a-4766-88ee-d61fb05b1a35 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] [instance: 5d54db85-b991-4890-abaa-952413baa2e7] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:51:00.865761 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-68199fa0-9d3a-4766-88ee-d61fb05b1a35 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:51:00.866512 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-68199fa0-9d3a-4766-88ee-d61fb05b1a35 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:51:00.867776 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-68199fa0-9d3a-4766-88ee-d61fb05b1a35 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:51:00.868507 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-68199fa0-9d3a-4766-88ee-d61fb05b1a35 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:51:01.011265 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-68199fa0-9d3a-4766-88ee-d61fb05b1a35 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37f21d6d15cf40a586edda211219fd08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ebb970305844dccacf48a7d8d47ecf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:51:01.023578 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-68199fa0-9d3a-4766-88ee-d61fb05b1a35 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '37f21d6d15cf40a586edda211219fd08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ebb970305844dccacf48a7d8d47ecf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:51:01.025936 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-68199fa0-9d3a-4766-88ee-d61fb05b1a35 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '37f21d6d15cf40a586edda211219fd08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ebb970305844dccacf48a7d8d47ecf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:51:01.027659 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-68199fa0-9d3a-4766-88ee-d61fb05b1a35 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] 10.222.0.11 "GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7" status: 200 len: 1803 microversion: 2.20 time: 0.179969 Nov 17 03:51:01.028385 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 1101/2394] 10.222.0.11 () {60 vars in 1276 bytes} [Wed Nov 17 03:51:00 2021] GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7 => generated 1803 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 17 03:51:01.274300 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-582ea9ed-16f0-4a9c-8ec8-ec8cfc2ed1cd tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:51:01.275161 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-582ea9ed-16f0-4a9c-8ec8-ec8cfc2ed1cd tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] [instance: 0698dc5b-5f47-46c4-ace8-f5e891a964a0] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:51:01.286192 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-582ea9ed-16f0-4a9c-8ec8-ec8cfc2ed1cd tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:51:01.286940 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-582ea9ed-16f0-4a9c-8ec8-ec8cfc2ed1cd tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:51:01.288220 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-582ea9ed-16f0-4a9c-8ec8-ec8cfc2ed1cd tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:51:01.288993 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-582ea9ed-16f0-4a9c-8ec8-ec8cfc2ed1cd tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:51:01.353550 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-582ea9ed-16f0-4a9c-8ec8-ec8cfc2ed1cd tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '163b2f24a72649ac8084be1cac32fa09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e123e9b86124c93a7fc2db9984e7466', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:51:01.361694 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-582ea9ed-16f0-4a9c-8ec8-ec8cfc2ed1cd tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] 10.222.0.11 "GET /compute/v2.1/servers/0698dc5b-5f47-46c4-ace8-f5e891a964a0" status: 200 len: 1218 microversion: 2.1 time: 0.093788 Nov 17 03:51:01.362252 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 1294/2395] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:51:01 2021] GET /compute/v2.1/servers/0698dc5b-5f47-46c4-ace8-f5e891a964a0 => generated 1218 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:51:02.049714 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-e1276b60-4180-4ab1-be4b-d43abf62b91a tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:51:02.050504 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-e1276b60-4180-4ab1-be4b-d43abf62b91a tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] [instance: 5d54db85-b991-4890-abaa-952413baa2e7] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:51:02.059053 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-e1276b60-4180-4ab1-be4b-d43abf62b91a tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:51:02.059612 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-e1276b60-4180-4ab1-be4b-d43abf62b91a tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:51:02.060571 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-e1276b60-4180-4ab1-be4b-d43abf62b91a tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:51:02.061138 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-e1276b60-4180-4ab1-be4b-d43abf62b91a tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:51:02.195994 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-e1276b60-4180-4ab1-be4b-d43abf62b91a tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37f21d6d15cf40a586edda211219fd08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ebb970305844dccacf48a7d8d47ecf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:51:02.205040 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-e1276b60-4180-4ab1-be4b-d43abf62b91a tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '37f21d6d15cf40a586edda211219fd08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ebb970305844dccacf48a7d8d47ecf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:51:02.206532 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-e1276b60-4180-4ab1-be4b-d43abf62b91a tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '37f21d6d15cf40a586edda211219fd08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ebb970305844dccacf48a7d8d47ecf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:51:02.207678 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-e1276b60-4180-4ab1-be4b-d43abf62b91a tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] 10.222.0.11 "GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7" status: 200 len: 1803 microversion: 2.20 time: 0.163482 Nov 17 03:51:02.208241 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 1102/2396] 10.222.0.11 () {60 vars in 1276 bytes} [Wed Nov 17 03:51:02 2021] GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7 => generated 1803 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 17 03:51:02.382433 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-a9fbf0f7-1a95-427f-8b49-c3ab58289ce8 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:51:02.383406 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-a9fbf0f7-1a95-427f-8b49-c3ab58289ce8 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] [instance: 0698dc5b-5f47-46c4-ace8-f5e891a964a0] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:51:02.394417 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-a9fbf0f7-1a95-427f-8b49-c3ab58289ce8 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:51:02.395167 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-a9fbf0f7-1a95-427f-8b49-c3ab58289ce8 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:51:02.396447 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-a9fbf0f7-1a95-427f-8b49-c3ab58289ce8 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:51:02.397226 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-a9fbf0f7-1a95-427f-8b49-c3ab58289ce8 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:51:02.463499 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-a9fbf0f7-1a95-427f-8b49-c3ab58289ce8 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '163b2f24a72649ac8084be1cac32fa09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e123e9b86124c93a7fc2db9984e7466', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:51:02.471557 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-a9fbf0f7-1a95-427f-8b49-c3ab58289ce8 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] 10.222.0.11 "GET /compute/v2.1/servers/0698dc5b-5f47-46c4-ace8-f5e891a964a0" status: 200 len: 1218 microversion: 2.1 time: 0.095707 Nov 17 03:51:02.472131 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 1295/2397] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:51:02 2021] GET /compute/v2.1/servers/0698dc5b-5f47-46c4-ace8-f5e891a964a0 => generated 1218 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:51:03.230094 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-31b16078-c588-4596-9e7c-ceee4161e3fe tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:51:03.231151 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-31b16078-c588-4596-9e7c-ceee4161e3fe tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] [instance: 5d54db85-b991-4890-abaa-952413baa2e7] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:51:03.242548 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-31b16078-c588-4596-9e7c-ceee4161e3fe tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:51:03.243347 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-31b16078-c588-4596-9e7c-ceee4161e3fe tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:51:03.244609 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-31b16078-c588-4596-9e7c-ceee4161e3fe tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:51:03.245391 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-31b16078-c588-4596-9e7c-ceee4161e3fe tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:51:03.395373 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-31b16078-c588-4596-9e7c-ceee4161e3fe tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37f21d6d15cf40a586edda211219fd08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ebb970305844dccacf48a7d8d47ecf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:51:03.408769 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-31b16078-c588-4596-9e7c-ceee4161e3fe tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '37f21d6d15cf40a586edda211219fd08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ebb970305844dccacf48a7d8d47ecf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:51:03.411073 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-31b16078-c588-4596-9e7c-ceee4161e3fe tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '37f21d6d15cf40a586edda211219fd08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ebb970305844dccacf48a7d8d47ecf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:51:03.412484 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-31b16078-c588-4596-9e7c-ceee4161e3fe tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] 10.222.0.11 "GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7" status: 200 len: 1803 microversion: 2.20 time: 0.188665 Nov 17 03:51:03.413312 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 1103/2398] 10.222.0.11 () {60 vars in 1276 bytes} [Wed Nov 17 03:51:03 2021] GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7 => generated 1803 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 17 03:51:03.491044 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-66848d2d-8a0a-40a6-9303-e400fc8b0c31 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:51:03.491929 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-66848d2d-8a0a-40a6-9303-e400fc8b0c31 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] [instance: 0698dc5b-5f47-46c4-ace8-f5e891a964a0] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:51:03.502112 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-66848d2d-8a0a-40a6-9303-e400fc8b0c31 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:51:03.502800 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-66848d2d-8a0a-40a6-9303-e400fc8b0c31 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:51:03.503963 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-66848d2d-8a0a-40a6-9303-e400fc8b0c31 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:51:03.504616 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-66848d2d-8a0a-40a6-9303-e400fc8b0c31 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:51:03.571571 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-66848d2d-8a0a-40a6-9303-e400fc8b0c31 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '163b2f24a72649ac8084be1cac32fa09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e123e9b86124c93a7fc2db9984e7466', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:51:03.579597 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-66848d2d-8a0a-40a6-9303-e400fc8b0c31 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] 10.222.0.11 "GET /compute/v2.1/servers/0698dc5b-5f47-46c4-ace8-f5e891a964a0" status: 200 len: 1218 microversion: 2.1 time: 0.094179 Nov 17 03:51:03.580172 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 1296/2399] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:51:03 2021] GET /compute/v2.1/servers/0698dc5b-5f47-46c4-ace8-f5e891a964a0 => generated 1218 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:51:04.438453 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-c7217f50-fe12-46e7-8f07-40840b22875d tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:51:04.439364 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-c7217f50-fe12-46e7-8f07-40840b22875d tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] [instance: 5d54db85-b991-4890-abaa-952413baa2e7] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:51:04.449886 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-c7217f50-fe12-46e7-8f07-40840b22875d tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:51:04.450636 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-c7217f50-fe12-46e7-8f07-40840b22875d tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:51:04.451920 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-c7217f50-fe12-46e7-8f07-40840b22875d tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:51:04.452632 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-c7217f50-fe12-46e7-8f07-40840b22875d tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:51:04.592136 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-c7217f50-fe12-46e7-8f07-40840b22875d tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37f21d6d15cf40a586edda211219fd08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ebb970305844dccacf48a7d8d47ecf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:51:04.601076 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-193463aa-6cc0-457a-91d5-944b2628e163 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:51:04.601661 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-193463aa-6cc0-457a-91d5-944b2628e163 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] [instance: 0698dc5b-5f47-46c4-ace8-f5e891a964a0] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:51:04.603228 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-c7217f50-fe12-46e7-8f07-40840b22875d tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '37f21d6d15cf40a586edda211219fd08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ebb970305844dccacf48a7d8d47ecf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:51:04.605325 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-c7217f50-fe12-46e7-8f07-40840b22875d tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '37f21d6d15cf40a586edda211219fd08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ebb970305844dccacf48a7d8d47ecf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:51:04.606965 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-c7217f50-fe12-46e7-8f07-40840b22875d tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] 10.222.0.11 "GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7" status: 200 len: 1803 microversion: 2.20 time: 0.174751 Nov 17 03:51:04.607739 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 1104/2400] 10.222.0.11 () {60 vars in 1276 bytes} [Wed Nov 17 03:51:04 2021] GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7 => generated 1803 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 17 03:51:04.608220 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-193463aa-6cc0-457a-91d5-944b2628e163 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:51:04.608662 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-193463aa-6cc0-457a-91d5-944b2628e163 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:51:04.609455 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-193463aa-6cc0-457a-91d5-944b2628e163 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:51:04.610013 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-193463aa-6cc0-457a-91d5-944b2628e163 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:51:04.667911 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-193463aa-6cc0-457a-91d5-944b2628e163 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '163b2f24a72649ac8084be1cac32fa09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e123e9b86124c93a7fc2db9984e7466', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:51:04.675444 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-193463aa-6cc0-457a-91d5-944b2628e163 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] 10.222.0.11 "GET /compute/v2.1/servers/0698dc5b-5f47-46c4-ace8-f5e891a964a0" status: 200 len: 1218 microversion: 2.1 time: 0.078014 Nov 17 03:51:04.676001 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 1297/2401] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:51:04 2021] GET /compute/v2.1/servers/0698dc5b-5f47-46c4-ace8-f5e891a964a0 => generated 1218 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 17 03:51:05.629889 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-c25b4f14-d71b-4f82-9a05-c40a38c9e417 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:51:05.631099 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-c25b4f14-d71b-4f82-9a05-c40a38c9e417 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] [instance: 5d54db85-b991-4890-abaa-952413baa2e7] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:51:05.639852 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-c25b4f14-d71b-4f82-9a05-c40a38c9e417 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:51:05.640440 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-c25b4f14-d71b-4f82-9a05-c40a38c9e417 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:51:05.641633 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-c25b4f14-d71b-4f82-9a05-c40a38c9e417 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:51:05.642112 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-c25b4f14-d71b-4f82-9a05-c40a38c9e417 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:51:05.697134 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-52e8e00b-22f6-4423-af64-692cb7b052e3 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:51:05.697751 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-52e8e00b-22f6-4423-af64-692cb7b052e3 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] [instance: 0698dc5b-5f47-46c4-ace8-f5e891a964a0] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:51:05.705034 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-52e8e00b-22f6-4423-af64-692cb7b052e3 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:51:05.705505 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-52e8e00b-22f6-4423-af64-692cb7b052e3 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:51:05.706278 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-52e8e00b-22f6-4423-af64-692cb7b052e3 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:51:05.707878 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-52e8e00b-22f6-4423-af64-692cb7b052e3 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:51:05.770012 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-52e8e00b-22f6-4423-af64-692cb7b052e3 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '163b2f24a72649ac8084be1cac32fa09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e123e9b86124c93a7fc2db9984e7466', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:51:05.774623 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-c25b4f14-d71b-4f82-9a05-c40a38c9e417 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37f21d6d15cf40a586edda211219fd08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ebb970305844dccacf48a7d8d47ecf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:51:05.777438 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-52e8e00b-22f6-4423-af64-692cb7b052e3 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] 10.222.0.11 "GET /compute/v2.1/servers/0698dc5b-5f47-46c4-ace8-f5e891a964a0" status: 200 len: 1218 microversion: 2.1 time: 0.084017 Nov 17 03:51:05.778007 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 1298/2402] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:51:05 2021] GET /compute/v2.1/servers/0698dc5b-5f47-46c4-ace8-f5e891a964a0 => generated 1218 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:51:05.783075 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-c25b4f14-d71b-4f82-9a05-c40a38c9e417 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '37f21d6d15cf40a586edda211219fd08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ebb970305844dccacf48a7d8d47ecf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:51:05.784558 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-c25b4f14-d71b-4f82-9a05-c40a38c9e417 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '37f21d6d15cf40a586edda211219fd08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ebb970305844dccacf48a7d8d47ecf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:51:05.785749 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-c25b4f14-d71b-4f82-9a05-c40a38c9e417 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] 10.222.0.11 "GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7" status: 200 len: 1803 microversion: 2.20 time: 0.161472 Nov 17 03:51:05.786296 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 1105/2403] 10.222.0.11 () {60 vars in 1276 bytes} [Wed Nov 17 03:51:05 2021] GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7 => generated 1803 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 17 03:51:06.796935 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-f0cf319a-09b4-4c20-93b0-45fe5722c412 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:51:06.797737 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-f0cf319a-09b4-4c20-93b0-45fe5722c412 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] [instance: 0698dc5b-5f47-46c4-ace8-f5e891a964a0] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:51:06.803655 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-98542ce0-3c21-40b8-8d57-b0a3be2326f7 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:51:06.804264 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-98542ce0-3c21-40b8-8d57-b0a3be2326f7 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] [instance: 5d54db85-b991-4890-abaa-952413baa2e7] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:51:06.804740 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-f0cf319a-09b4-4c20-93b0-45fe5722c412 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:51:06.805215 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-f0cf319a-09b4-4c20-93b0-45fe5722c412 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:51:06.805992 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-f0cf319a-09b4-4c20-93b0-45fe5722c412 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:51:06.806426 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-f0cf319a-09b4-4c20-93b0-45fe5722c412 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:51:06.811033 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-98542ce0-3c21-40b8-8d57-b0a3be2326f7 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:51:06.811491 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-98542ce0-3c21-40b8-8d57-b0a3be2326f7 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:51:06.812265 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-98542ce0-3c21-40b8-8d57-b0a3be2326f7 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:51:06.812704 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-98542ce0-3c21-40b8-8d57-b0a3be2326f7 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:51:06.865520 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-f0cf319a-09b4-4c20-93b0-45fe5722c412 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '163b2f24a72649ac8084be1cac32fa09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e123e9b86124c93a7fc2db9984e7466', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:51:06.873520 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-f0cf319a-09b4-4c20-93b0-45fe5722c412 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] 10.222.0.11 "GET /compute/v2.1/servers/0698dc5b-5f47-46c4-ace8-f5e891a964a0" status: 200 len: 1218 microversion: 2.1 time: 0.082506 Nov 17 03:51:06.874123 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 1299/2404] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:51:06 2021] GET /compute/v2.1/servers/0698dc5b-5f47-46c4-ace8-f5e891a964a0 => generated 1218 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:51:06.951718 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-98542ce0-3c21-40b8-8d57-b0a3be2326f7 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37f21d6d15cf40a586edda211219fd08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ebb970305844dccacf48a7d8d47ecf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:51:06.964393 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-98542ce0-3c21-40b8-8d57-b0a3be2326f7 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '37f21d6d15cf40a586edda211219fd08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ebb970305844dccacf48a7d8d47ecf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:51:06.966803 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-98542ce0-3c21-40b8-8d57-b0a3be2326f7 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '37f21d6d15cf40a586edda211219fd08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ebb970305844dccacf48a7d8d47ecf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:51:06.968674 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-98542ce0-3c21-40b8-8d57-b0a3be2326f7 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] 10.222.0.11 "GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7" status: 200 len: 1803 microversion: 2.20 time: 0.168757 Nov 17 03:51:06.969572 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 1106/2405] 10.222.0.11 () {60 vars in 1276 bytes} [Wed Nov 17 03:51:06 2021] GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7 => generated 1803 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 17 03:51:07.893157 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-e9bebf15-7d7c-4081-a54f-8bde07e6f6dc tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:51:07.893789 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-e9bebf15-7d7c-4081-a54f-8bde07e6f6dc tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] [instance: 0698dc5b-5f47-46c4-ace8-f5e891a964a0] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:51:07.900435 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-e9bebf15-7d7c-4081-a54f-8bde07e6f6dc tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:51:07.900913 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-e9bebf15-7d7c-4081-a54f-8bde07e6f6dc tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:51:07.901683 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-e9bebf15-7d7c-4081-a54f-8bde07e6f6dc tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:51:07.902110 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-e9bebf15-7d7c-4081-a54f-8bde07e6f6dc tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:51:07.968812 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-e9bebf15-7d7c-4081-a54f-8bde07e6f6dc tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '163b2f24a72649ac8084be1cac32fa09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e123e9b86124c93a7fc2db9984e7466', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:51:07.976587 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-e9bebf15-7d7c-4081-a54f-8bde07e6f6dc tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] 10.222.0.11 "GET /compute/v2.1/servers/0698dc5b-5f47-46c4-ace8-f5e891a964a0" status: 200 len: 1218 microversion: 2.1 time: 0.089248 Nov 17 03:51:07.977187 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 1300/2406] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:51:07 2021] GET /compute/v2.1/servers/0698dc5b-5f47-46c4-ace8-f5e891a964a0 => generated 1218 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:51:07.987733 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-07a810ab-9699-4c65-b258-7b1287eac995 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:51:07.988340 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-07a810ab-9699-4c65-b258-7b1287eac995 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] [instance: 5d54db85-b991-4890-abaa-952413baa2e7] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:51:07.995077 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-07a810ab-9699-4c65-b258-7b1287eac995 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:51:07.995523 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-07a810ab-9699-4c65-b258-7b1287eac995 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:51:07.996288 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-07a810ab-9699-4c65-b258-7b1287eac995 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:51:07.996723 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-07a810ab-9699-4c65-b258-7b1287eac995 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:51:08.129503 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-07a810ab-9699-4c65-b258-7b1287eac995 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37f21d6d15cf40a586edda211219fd08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ebb970305844dccacf48a7d8d47ecf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:51:08.138152 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-07a810ab-9699-4c65-b258-7b1287eac995 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '37f21d6d15cf40a586edda211219fd08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ebb970305844dccacf48a7d8d47ecf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:51:08.139679 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-07a810ab-9699-4c65-b258-7b1287eac995 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '37f21d6d15cf40a586edda211219fd08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ebb970305844dccacf48a7d8d47ecf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:51:08.140849 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-07a810ab-9699-4c65-b258-7b1287eac995 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] 10.222.0.11 "GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7" status: 200 len: 1803 microversion: 2.20 time: 0.157196 Nov 17 03:51:08.141662 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 1107/2407] 10.222.0.11 () {60 vars in 1276 bytes} [Wed Nov 17 03:51:07 2021] GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7 => generated 1803 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 17 03:51:08.997004 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-49907db4-ead4-41ef-9046-ce29db5c0cd6 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:51:08.999044 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-49907db4-ead4-41ef-9046-ce29db5c0cd6 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] [instance: 0698dc5b-5f47-46c4-ace8-f5e891a964a0] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:51:09.007247 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-49907db4-ead4-41ef-9046-ce29db5c0cd6 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:51:09.007635 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-49907db4-ead4-41ef-9046-ce29db5c0cd6 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:51:09.008408 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-49907db4-ead4-41ef-9046-ce29db5c0cd6 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:51:09.008861 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-49907db4-ead4-41ef-9046-ce29db5c0cd6 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:51:09.070546 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-49907db4-ead4-41ef-9046-ce29db5c0cd6 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '163b2f24a72649ac8084be1cac32fa09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e123e9b86124c93a7fc2db9984e7466', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:51:09.078672 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-49907db4-ead4-41ef-9046-ce29db5c0cd6 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] 10.222.0.11 "GET /compute/v2.1/servers/0698dc5b-5f47-46c4-ace8-f5e891a964a0" status: 200 len: 1218 microversion: 2.1 time: 0.087834 Nov 17 03:51:09.079354 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 1301/2408] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:51:08 2021] GET /compute/v2.1/servers/0698dc5b-5f47-46c4-ace8-f5e891a964a0 => generated 1218 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:51:09.161159 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-63ae5260-e876-437f-93e3-2e04186a71bc tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:51:09.161744 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-63ae5260-e876-437f-93e3-2e04186a71bc tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] [instance: 5d54db85-b991-4890-abaa-952413baa2e7] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:51:09.168405 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-63ae5260-e876-437f-93e3-2e04186a71bc tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:51:09.168893 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-63ae5260-e876-437f-93e3-2e04186a71bc tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:51:09.169660 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-63ae5260-e876-437f-93e3-2e04186a71bc tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:51:09.170102 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-63ae5260-e876-437f-93e3-2e04186a71bc tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:51:09.310941 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-63ae5260-e876-437f-93e3-2e04186a71bc tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37f21d6d15cf40a586edda211219fd08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ebb970305844dccacf48a7d8d47ecf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:51:09.319979 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-63ae5260-e876-437f-93e3-2e04186a71bc tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '37f21d6d15cf40a586edda211219fd08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ebb970305844dccacf48a7d8d47ecf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:51:09.321494 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-63ae5260-e876-437f-93e3-2e04186a71bc tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '37f21d6d15cf40a586edda211219fd08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ebb970305844dccacf48a7d8d47ecf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:51:09.322644 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-63ae5260-e876-437f-93e3-2e04186a71bc tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] 10.222.0.11 "GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7" status: 200 len: 1803 microversion: 2.20 time: 0.165334 Nov 17 03:51:09.323175 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 1108/2409] 10.222.0.11 () {60 vars in 1276 bytes} [Wed Nov 17 03:51:09 2021] GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7 => generated 1803 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 17 03:51:10.097144 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-8eac3ef0-d606-4978-b846-94910e582082 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:51:10.097763 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-8eac3ef0-d606-4978-b846-94910e582082 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] [instance: 0698dc5b-5f47-46c4-ace8-f5e891a964a0] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:51:10.105338 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-8eac3ef0-d606-4978-b846-94910e582082 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:51:10.105775 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-8eac3ef0-d606-4978-b846-94910e582082 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:51:10.106579 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-8eac3ef0-d606-4978-b846-94910e582082 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:51:10.106998 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-8eac3ef0-d606-4978-b846-94910e582082 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:51:10.172157 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-8eac3ef0-d606-4978-b846-94910e582082 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '163b2f24a72649ac8084be1cac32fa09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e123e9b86124c93a7fc2db9984e7466', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:51:10.180066 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-8eac3ef0-d606-4978-b846-94910e582082 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] 10.222.0.11 "GET /compute/v2.1/servers/0698dc5b-5f47-46c4-ace8-f5e891a964a0" status: 200 len: 1218 microversion: 2.1 time: 0.087737 Nov 17 03:51:10.180630 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 1302/2410] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:51:10 2021] GET /compute/v2.1/servers/0698dc5b-5f47-46c4-ace8-f5e891a964a0 => generated 1218 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:51:10.347071 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-aa5d45c8-29e0-4b2a-9f49-8c2b8e5daa5e tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:51:10.347930 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-aa5d45c8-29e0-4b2a-9f49-8c2b8e5daa5e tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] [instance: 5d54db85-b991-4890-abaa-952413baa2e7] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:51:10.358192 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-aa5d45c8-29e0-4b2a-9f49-8c2b8e5daa5e tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:51:10.358940 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-aa5d45c8-29e0-4b2a-9f49-8c2b8e5daa5e tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:51:10.360586 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-aa5d45c8-29e0-4b2a-9f49-8c2b8e5daa5e tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:51:10.361228 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-aa5d45c8-29e0-4b2a-9f49-8c2b8e5daa5e tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:51:10.496674 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-aa5d45c8-29e0-4b2a-9f49-8c2b8e5daa5e tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37f21d6d15cf40a586edda211219fd08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ebb970305844dccacf48a7d8d47ecf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:51:10.505684 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-aa5d45c8-29e0-4b2a-9f49-8c2b8e5daa5e tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '37f21d6d15cf40a586edda211219fd08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ebb970305844dccacf48a7d8d47ecf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:51:10.507171 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-aa5d45c8-29e0-4b2a-9f49-8c2b8e5daa5e tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '37f21d6d15cf40a586edda211219fd08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ebb970305844dccacf48a7d8d47ecf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:51:10.508323 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-aa5d45c8-29e0-4b2a-9f49-8c2b8e5daa5e tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] 10.222.0.11 "GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7" status: 200 len: 1803 microversion: 2.20 time: 0.168961 Nov 17 03:51:10.508911 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 1109/2411] 10.222.0.11 () {60 vars in 1276 bytes} [Wed Nov 17 03:51:10 2021] GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7 => generated 1803 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 17 03:51:11.200511 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-b552e4c7-af4b-41fe-8933-ff68c22f5bb0 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:51:11.201476 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-b552e4c7-af4b-41fe-8933-ff68c22f5bb0 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] [instance: 0698dc5b-5f47-46c4-ace8-f5e891a964a0] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:51:11.209271 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-b552e4c7-af4b-41fe-8933-ff68c22f5bb0 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:51:11.209724 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-b552e4c7-af4b-41fe-8933-ff68c22f5bb0 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:51:11.210531 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-b552e4c7-af4b-41fe-8933-ff68c22f5bb0 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:51:11.210966 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-b552e4c7-af4b-41fe-8933-ff68c22f5bb0 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:51:11.279246 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-b552e4c7-af4b-41fe-8933-ff68c22f5bb0 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '163b2f24a72649ac8084be1cac32fa09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e123e9b86124c93a7fc2db9984e7466', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:51:11.287113 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-b552e4c7-af4b-41fe-8933-ff68c22f5bb0 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] 10.222.0.11 "GET /compute/v2.1/servers/0698dc5b-5f47-46c4-ace8-f5e891a964a0" status: 200 len: 1218 microversion: 2.1 time: 0.092508 Nov 17 03:51:11.287690 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 1303/2412] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:51:11 2021] GET /compute/v2.1/servers/0698dc5b-5f47-46c4-ace8-f5e891a964a0 => generated 1218 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:51:11.530049 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-4ba506a7-3fae-4808-9783-08dbfe42f811 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:51:11.530712 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-4ba506a7-3fae-4808-9783-08dbfe42f811 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] [instance: 5d54db85-b991-4890-abaa-952413baa2e7] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:51:11.538110 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-4ba506a7-3fae-4808-9783-08dbfe42f811 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:51:11.538558 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-4ba506a7-3fae-4808-9783-08dbfe42f811 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:51:11.539329 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-4ba506a7-3fae-4808-9783-08dbfe42f811 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:51:11.539767 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-4ba506a7-3fae-4808-9783-08dbfe42f811 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:51:11.678930 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-4ba506a7-3fae-4808-9783-08dbfe42f811 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37f21d6d15cf40a586edda211219fd08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ebb970305844dccacf48a7d8d47ecf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:51:11.687930 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-4ba506a7-3fae-4808-9783-08dbfe42f811 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '37f21d6d15cf40a586edda211219fd08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ebb970305844dccacf48a7d8d47ecf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:51:11.689599 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-4ba506a7-3fae-4808-9783-08dbfe42f811 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '37f21d6d15cf40a586edda211219fd08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ebb970305844dccacf48a7d8d47ecf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:51:11.690751 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-4ba506a7-3fae-4808-9783-08dbfe42f811 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] 10.222.0.11 "GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7" status: 200 len: 1803 microversion: 2.20 time: 0.166743 Nov 17 03:51:11.691303 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 1110/2413] 10.222.0.11 () {60 vars in 1276 bytes} [Wed Nov 17 03:51:11 2021] GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7 => generated 1803 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 17 03:51:12.307609 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-e02d4250-c82c-464a-9d19-53a82a7b83dd tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:51:12.308641 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-e02d4250-c82c-464a-9d19-53a82a7b83dd tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] [instance: 0698dc5b-5f47-46c4-ace8-f5e891a964a0] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:51:12.319383 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-e02d4250-c82c-464a-9d19-53a82a7b83dd tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:51:12.319887 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-e02d4250-c82c-464a-9d19-53a82a7b83dd tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:51:12.320920 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-e02d4250-c82c-464a-9d19-53a82a7b83dd tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:51:12.321348 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-e02d4250-c82c-464a-9d19-53a82a7b83dd tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:51:12.394194 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-e02d4250-c82c-464a-9d19-53a82a7b83dd tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '163b2f24a72649ac8084be1cac32fa09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e123e9b86124c93a7fc2db9984e7466', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:51:12.405956 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-e02d4250-c82c-464a-9d19-53a82a7b83dd tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] 10.222.0.11 "GET /compute/v2.1/servers/0698dc5b-5f47-46c4-ace8-f5e891a964a0" status: 200 len: 1218 microversion: 2.1 time: 0.104566 Nov 17 03:51:12.406721 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 1304/2414] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:51:12 2021] GET /compute/v2.1/servers/0698dc5b-5f47-46c4-ace8-f5e891a964a0 => generated 1218 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:51:12.713929 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-a0266092-1198-45ac-b7c5-956c81905c31 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:51:12.714808 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-a0266092-1198-45ac-b7c5-956c81905c31 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] [instance: 5d54db85-b991-4890-abaa-952413baa2e7] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:51:12.723811 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-a0266092-1198-45ac-b7c5-956c81905c31 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:51:12.724248 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-a0266092-1198-45ac-b7c5-956c81905c31 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:51:12.725055 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-a0266092-1198-45ac-b7c5-956c81905c31 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:51:12.725487 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-a0266092-1198-45ac-b7c5-956c81905c31 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:51:12.857507 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-a0266092-1198-45ac-b7c5-956c81905c31 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37f21d6d15cf40a586edda211219fd08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ebb970305844dccacf48a7d8d47ecf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:51:12.866385 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-a0266092-1198-45ac-b7c5-956c81905c31 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '37f21d6d15cf40a586edda211219fd08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ebb970305844dccacf48a7d8d47ecf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:51:12.867851 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-a0266092-1198-45ac-b7c5-956c81905c31 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '37f21d6d15cf40a586edda211219fd08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ebb970305844dccacf48a7d8d47ecf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:51:12.869032 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-a0266092-1198-45ac-b7c5-956c81905c31 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] 10.222.0.11 "GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7" status: 200 len: 1803 microversion: 2.20 time: 0.161614 Nov 17 03:51:12.869590 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 1111/2415] 10.222.0.11 () {60 vars in 1276 bytes} [Wed Nov 17 03:51:12 2021] GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7 => generated 1803 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 17 03:51:13.424576 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-9d80ccce-de24-49f7-b36f-c966a8bc6e84 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:51:13.425205 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-9d80ccce-de24-49f7-b36f-c966a8bc6e84 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] [instance: 0698dc5b-5f47-46c4-ace8-f5e891a964a0] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:51:13.432150 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-9d80ccce-de24-49f7-b36f-c966a8bc6e84 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:51:13.432592 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-9d80ccce-de24-49f7-b36f-c966a8bc6e84 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:51:13.433393 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-9d80ccce-de24-49f7-b36f-c966a8bc6e84 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:51:13.433820 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-9d80ccce-de24-49f7-b36f-c966a8bc6e84 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:51:13.493432 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-9d80ccce-de24-49f7-b36f-c966a8bc6e84 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '163b2f24a72649ac8084be1cac32fa09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e123e9b86124c93a7fc2db9984e7466', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:51:13.501286 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-9d80ccce-de24-49f7-b36f-c966a8bc6e84 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] 10.222.0.11 "GET /compute/v2.1/servers/0698dc5b-5f47-46c4-ace8-f5e891a964a0" status: 200 len: 1218 microversion: 2.1 time: 0.081214 Nov 17 03:51:13.502025 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 1305/2416] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:51:13 2021] GET /compute/v2.1/servers/0698dc5b-5f47-46c4-ace8-f5e891a964a0 => generated 1218 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:51:13.891446 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-5441e4bf-1414-4182-a203-ddfbc1a3c47d tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:51:13.892458 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-5441e4bf-1414-4182-a203-ddfbc1a3c47d tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] [instance: 5d54db85-b991-4890-abaa-952413baa2e7] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:51:13.900135 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-5441e4bf-1414-4182-a203-ddfbc1a3c47d tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:51:13.900656 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-5441e4bf-1414-4182-a203-ddfbc1a3c47d tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:51:13.901551 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-5441e4bf-1414-4182-a203-ddfbc1a3c47d tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:51:13.902032 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-5441e4bf-1414-4182-a203-ddfbc1a3c47d tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:51:14.036124 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-5441e4bf-1414-4182-a203-ddfbc1a3c47d tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37f21d6d15cf40a586edda211219fd08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ebb970305844dccacf48a7d8d47ecf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:51:14.049060 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-5441e4bf-1414-4182-a203-ddfbc1a3c47d tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '37f21d6d15cf40a586edda211219fd08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ebb970305844dccacf48a7d8d47ecf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:51:14.050590 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-5441e4bf-1414-4182-a203-ddfbc1a3c47d tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '37f21d6d15cf40a586edda211219fd08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ebb970305844dccacf48a7d8d47ecf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:51:14.051773 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-5441e4bf-1414-4182-a203-ddfbc1a3c47d tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] 10.222.0.11 "GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7" status: 200 len: 1803 microversion: 2.20 time: 0.166593 Nov 17 03:51:14.052700 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 1112/2417] 10.222.0.11 () {60 vars in 1276 bytes} [Wed Nov 17 03:51:13 2021] GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7 => generated 1803 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 17 03:51:14.522690 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-b1957903-22cc-4df9-bcfb-fa53caeaaf17 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:51:14.523666 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-b1957903-22cc-4df9-bcfb-fa53caeaaf17 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] [instance: 0698dc5b-5f47-46c4-ace8-f5e891a964a0] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:51:14.533988 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-b1957903-22cc-4df9-bcfb-fa53caeaaf17 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:51:14.534426 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-b1957903-22cc-4df9-bcfb-fa53caeaaf17 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:51:14.535188 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-b1957903-22cc-4df9-bcfb-fa53caeaaf17 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:51:14.535612 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-b1957903-22cc-4df9-bcfb-fa53caeaaf17 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:51:14.594569 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-b1957903-22cc-4df9-bcfb-fa53caeaaf17 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '163b2f24a72649ac8084be1cac32fa09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e123e9b86124c93a7fc2db9984e7466', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:51:14.602175 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-b1957903-22cc-4df9-bcfb-fa53caeaaf17 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] 10.222.0.11 "GET /compute/v2.1/servers/0698dc5b-5f47-46c4-ace8-f5e891a964a0" status: 200 len: 1218 microversion: 2.1 time: 0.085984 Nov 17 03:51:14.602753 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 1306/2418] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:51:14 2021] GET /compute/v2.1/servers/0698dc5b-5f47-46c4-ace8-f5e891a964a0 => generated 1218 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:51:15.077648 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-89012963-349e-4380-b3e7-ef68d63e455e tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:51:15.078277 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-89012963-349e-4380-b3e7-ef68d63e455e tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] [instance: 5d54db85-b991-4890-abaa-952413baa2e7] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:51:15.088871 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-89012963-349e-4380-b3e7-ef68d63e455e tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:51:15.089498 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-89012963-349e-4380-b3e7-ef68d63e455e tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:51:15.090690 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-89012963-349e-4380-b3e7-ef68d63e455e tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:51:15.091268 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-89012963-349e-4380-b3e7-ef68d63e455e tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:51:15.227788 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-89012963-349e-4380-b3e7-ef68d63e455e tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37f21d6d15cf40a586edda211219fd08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ebb970305844dccacf48a7d8d47ecf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:51:15.236196 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-89012963-349e-4380-b3e7-ef68d63e455e tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '37f21d6d15cf40a586edda211219fd08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ebb970305844dccacf48a7d8d47ecf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:51:15.237958 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-89012963-349e-4380-b3e7-ef68d63e455e tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '37f21d6d15cf40a586edda211219fd08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ebb970305844dccacf48a7d8d47ecf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:51:15.239212 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-89012963-349e-4380-b3e7-ef68d63e455e tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] 10.222.0.11 "GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7" status: 200 len: 1803 microversion: 2.20 time: 0.167385 Nov 17 03:51:15.239968 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 1113/2419] 10.222.0.11 () {60 vars in 1276 bytes} [Wed Nov 17 03:51:15 2021] GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7 => generated 1803 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 17 03:51:15.623415 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-e762a744-6117-45fc-bf90-f45502cf4cc7 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:51:15.624413 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-e762a744-6117-45fc-bf90-f45502cf4cc7 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] [instance: 0698dc5b-5f47-46c4-ace8-f5e891a964a0] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:51:15.635543 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-e762a744-6117-45fc-bf90-f45502cf4cc7 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:51:15.636263 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-e762a744-6117-45fc-bf90-f45502cf4cc7 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:51:15.637614 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-e762a744-6117-45fc-bf90-f45502cf4cc7 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:51:15.638340 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-e762a744-6117-45fc-bf90-f45502cf4cc7 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:51:15.703378 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-e762a744-6117-45fc-bf90-f45502cf4cc7 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '163b2f24a72649ac8084be1cac32fa09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e123e9b86124c93a7fc2db9984e7466', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:51:15.715049 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-e762a744-6117-45fc-bf90-f45502cf4cc7 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] 10.222.0.11 "GET /compute/v2.1/servers/0698dc5b-5f47-46c4-ace8-f5e891a964a0" status: 200 len: 1218 microversion: 2.1 time: 0.097450 Nov 17 03:51:15.715923 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 1307/2420] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:51:15 2021] GET /compute/v2.1/servers/0698dc5b-5f47-46c4-ace8-f5e891a964a0 => generated 1218 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:51:16.263898 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-e60b73c0-46d7-4b7c-b7e7-a5982f4ccd3e tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:51:16.264696 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-e60b73c0-46d7-4b7c-b7e7-a5982f4ccd3e tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] [instance: 5d54db85-b991-4890-abaa-952413baa2e7] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:51:16.272749 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-e60b73c0-46d7-4b7c-b7e7-a5982f4ccd3e tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:51:16.273237 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-e60b73c0-46d7-4b7c-b7e7-a5982f4ccd3e tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:51:16.274002 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-e60b73c0-46d7-4b7c-b7e7-a5982f4ccd3e tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:51:16.274455 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-e60b73c0-46d7-4b7c-b7e7-a5982f4ccd3e tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:51:16.420637 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-e60b73c0-46d7-4b7c-b7e7-a5982f4ccd3e tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37f21d6d15cf40a586edda211219fd08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ebb970305844dccacf48a7d8d47ecf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:51:16.430299 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-e60b73c0-46d7-4b7c-b7e7-a5982f4ccd3e tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '37f21d6d15cf40a586edda211219fd08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ebb970305844dccacf48a7d8d47ecf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:51:16.431793 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-e60b73c0-46d7-4b7c-b7e7-a5982f4ccd3e tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '37f21d6d15cf40a586edda211219fd08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ebb970305844dccacf48a7d8d47ecf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:51:16.432989 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-e60b73c0-46d7-4b7c-b7e7-a5982f4ccd3e tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] 10.222.0.11 "GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7" status: 200 len: 1803 microversion: 2.20 time: 0.173687 Nov 17 03:51:16.433520 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 1114/2421] 10.222.0.11 () {60 vars in 1276 bytes} [Wed Nov 17 03:51:16 2021] GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7 => generated 1803 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 17 03:51:16.735118 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-b8675f35-923b-4afd-9eab-8ba6bff885e0 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:51:16.735680 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-b8675f35-923b-4afd-9eab-8ba6bff885e0 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] [instance: 0698dc5b-5f47-46c4-ace8-f5e891a964a0] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:51:16.742323 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-b8675f35-923b-4afd-9eab-8ba6bff885e0 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:51:16.742773 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-b8675f35-923b-4afd-9eab-8ba6bff885e0 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:51:16.743550 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-b8675f35-923b-4afd-9eab-8ba6bff885e0 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:51:16.743994 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-b8675f35-923b-4afd-9eab-8ba6bff885e0 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:51:16.808492 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-b8675f35-923b-4afd-9eab-8ba6bff885e0 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '163b2f24a72649ac8084be1cac32fa09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e123e9b86124c93a7fc2db9984e7466', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:51:16.817690 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-b8675f35-923b-4afd-9eab-8ba6bff885e0 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] 10.222.0.11 "GET /compute/v2.1/servers/0698dc5b-5f47-46c4-ace8-f5e891a964a0" status: 200 len: 1218 microversion: 2.1 time: 0.086407 Nov 17 03:51:16.818264 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 1308/2422] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:51:16 2021] GET /compute/v2.1/servers/0698dc5b-5f47-46c4-ace8-f5e891a964a0 => generated 1218 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:51:17.456130 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-0dcb2a1e-0c48-48c2-a056-8650c5c59887 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:51:17.457578 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-0dcb2a1e-0c48-48c2-a056-8650c5c59887 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] [instance: 5d54db85-b991-4890-abaa-952413baa2e7] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:51:17.468274 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-0dcb2a1e-0c48-48c2-a056-8650c5c59887 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:51:17.469098 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-0dcb2a1e-0c48-48c2-a056-8650c5c59887 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:51:17.470361 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-0dcb2a1e-0c48-48c2-a056-8650c5c59887 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:51:17.471075 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-0dcb2a1e-0c48-48c2-a056-8650c5c59887 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:51:17.612308 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-0dcb2a1e-0c48-48c2-a056-8650c5c59887 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37f21d6d15cf40a586edda211219fd08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ebb970305844dccacf48a7d8d47ecf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:51:17.621171 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-0dcb2a1e-0c48-48c2-a056-8650c5c59887 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '37f21d6d15cf40a586edda211219fd08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ebb970305844dccacf48a7d8d47ecf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:51:17.622663 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-0dcb2a1e-0c48-48c2-a056-8650c5c59887 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '37f21d6d15cf40a586edda211219fd08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ebb970305844dccacf48a7d8d47ecf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:51:17.623809 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-0dcb2a1e-0c48-48c2-a056-8650c5c59887 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] 10.222.0.11 "GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7" status: 200 len: 1803 microversion: 2.20 time: 0.174260 Nov 17 03:51:17.624370 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 1115/2423] 10.222.0.11 () {60 vars in 1276 bytes} [Wed Nov 17 03:51:17 2021] GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7 => generated 1803 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 17 03:51:17.834909 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-31f6a26b-6315-4f70-91be-d35229292fd6 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:51:17.835536 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-31f6a26b-6315-4f70-91be-d35229292fd6 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] [instance: 0698dc5b-5f47-46c4-ace8-f5e891a964a0] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:51:17.842003 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-31f6a26b-6315-4f70-91be-d35229292fd6 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:51:17.842808 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-31f6a26b-6315-4f70-91be-d35229292fd6 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:51:17.843574 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-31f6a26b-6315-4f70-91be-d35229292fd6 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:51:17.844007 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-31f6a26b-6315-4f70-91be-d35229292fd6 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:51:17.903031 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-31f6a26b-6315-4f70-91be-d35229292fd6 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '163b2f24a72649ac8084be1cac32fa09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e123e9b86124c93a7fc2db9984e7466', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:51:17.911362 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-31f6a26b-6315-4f70-91be-d35229292fd6 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] 10.222.0.11 "GET /compute/v2.1/servers/0698dc5b-5f47-46c4-ace8-f5e891a964a0" status: 200 len: 1218 microversion: 2.1 time: 0.080106 Nov 17 03:51:17.912016 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 1309/2424] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:51:17 2021] GET /compute/v2.1/servers/0698dc5b-5f47-46c4-ace8-f5e891a964a0 => generated 1218 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:51:18.786609 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-29c7aed9-ade3-428c-a7b5-7348859fee33 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:51:18.787214 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-29c7aed9-ade3-428c-a7b5-7348859fee33 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] [instance: 5d54db85-b991-4890-abaa-952413baa2e7] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:51:18.793445 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-29c7aed9-ade3-428c-a7b5-7348859fee33 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:51:18.793888 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-29c7aed9-ade3-428c-a7b5-7348859fee33 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:51:18.794656 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-29c7aed9-ade3-428c-a7b5-7348859fee33 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:51:18.795079 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-29c7aed9-ade3-428c-a7b5-7348859fee33 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:51:18.928843 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-3bf6b524-8c20-4202-a800-74b3d832c2ab tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:51:18.929405 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-3bf6b524-8c20-4202-a800-74b3d832c2ab tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] [instance: 0698dc5b-5f47-46c4-ace8-f5e891a964a0] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:51:18.935736 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-3bf6b524-8c20-4202-a800-74b3d832c2ab tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:51:18.936178 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-3bf6b524-8c20-4202-a800-74b3d832c2ab tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:51:18.936622 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-29c7aed9-ade3-428c-a7b5-7348859fee33 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37f21d6d15cf40a586edda211219fd08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ebb970305844dccacf48a7d8d47ecf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:51:18.936973 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-3bf6b524-8c20-4202-a800-74b3d832c2ab tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:51:18.937403 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-3bf6b524-8c20-4202-a800-74b3d832c2ab tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:51:18.945156 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-29c7aed9-ade3-428c-a7b5-7348859fee33 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '37f21d6d15cf40a586edda211219fd08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ebb970305844dccacf48a7d8d47ecf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:51:18.946618 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-29c7aed9-ade3-428c-a7b5-7348859fee33 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '37f21d6d15cf40a586edda211219fd08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ebb970305844dccacf48a7d8d47ecf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:51:18.947757 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-29c7aed9-ade3-428c-a7b5-7348859fee33 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] 10.222.0.11 "GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7" status: 200 len: 1803 microversion: 2.20 time: 0.307612 Nov 17 03:51:18.948312 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 1116/2425] 10.222.0.11 () {60 vars in 1276 bytes} [Wed Nov 17 03:51:18 2021] GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7 => generated 1803 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 17 03:51:19.123897 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-3bf6b524-8c20-4202-a800-74b3d832c2ab tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '163b2f24a72649ac8084be1cac32fa09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e123e9b86124c93a7fc2db9984e7466', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:51:19.131895 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-3bf6b524-8c20-4202-a800-74b3d832c2ab tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] 10.222.0.11 "GET /compute/v2.1/servers/0698dc5b-5f47-46c4-ace8-f5e891a964a0" status: 200 len: 1218 microversion: 2.1 time: 0.207191 Nov 17 03:51:19.132460 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 1310/2426] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:51:18 2021] GET /compute/v2.1/servers/0698dc5b-5f47-46c4-ace8-f5e891a964a0 => generated 1218 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:51:19.971126 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-7bf005fb-28c4-4079-ad54-f4d8e04fe2b1 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:51:19.972343 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-7bf005fb-28c4-4079-ad54-f4d8e04fe2b1 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] [instance: 5d54db85-b991-4890-abaa-952413baa2e7] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:51:19.983148 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-7bf005fb-28c4-4079-ad54-f4d8e04fe2b1 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:51:19.983932 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-7bf005fb-28c4-4079-ad54-f4d8e04fe2b1 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:51:19.985239 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-7bf005fb-28c4-4079-ad54-f4d8e04fe2b1 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:51:19.985964 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-7bf005fb-28c4-4079-ad54-f4d8e04fe2b1 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:51:20.127614 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-7bf005fb-28c4-4079-ad54-f4d8e04fe2b1 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37f21d6d15cf40a586edda211219fd08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ebb970305844dccacf48a7d8d47ecf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:51:20.136329 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-7bf005fb-28c4-4079-ad54-f4d8e04fe2b1 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '37f21d6d15cf40a586edda211219fd08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ebb970305844dccacf48a7d8d47ecf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:51:20.137869 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-7bf005fb-28c4-4079-ad54-f4d8e04fe2b1 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '37f21d6d15cf40a586edda211219fd08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ebb970305844dccacf48a7d8d47ecf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:51:20.139032 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-7bf005fb-28c4-4079-ad54-f4d8e04fe2b1 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] 10.222.0.11 "GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7" status: 200 len: 1803 microversion: 2.20 time: 0.174106 Nov 17 03:51:20.139590 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 1117/2427] 10.222.0.11 () {60 vars in 1276 bytes} [Wed Nov 17 03:51:19 2021] GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7 => generated 1803 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 17 03:51:20.149790 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-b87b5ac6-4c9e-4322-bad5-0fcd9a12bbd5 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:51:20.150433 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-b87b5ac6-4c9e-4322-bad5-0fcd9a12bbd5 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] [instance: 0698dc5b-5f47-46c4-ace8-f5e891a964a0] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:51:20.156890 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-b87b5ac6-4c9e-4322-bad5-0fcd9a12bbd5 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:51:20.157366 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-b87b5ac6-4c9e-4322-bad5-0fcd9a12bbd5 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:51:20.158139 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-b87b5ac6-4c9e-4322-bad5-0fcd9a12bbd5 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:51:20.158595 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-b87b5ac6-4c9e-4322-bad5-0fcd9a12bbd5 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:51:20.225655 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-b87b5ac6-4c9e-4322-bad5-0fcd9a12bbd5 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '163b2f24a72649ac8084be1cac32fa09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e123e9b86124c93a7fc2db9984e7466', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:51:20.233435 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-b87b5ac6-4c9e-4322-bad5-0fcd9a12bbd5 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] 10.222.0.11 "GET /compute/v2.1/servers/0698dc5b-5f47-46c4-ace8-f5e891a964a0" status: 200 len: 1218 microversion: 2.1 time: 0.088053 Nov 17 03:51:20.234002 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 1311/2428] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:51:20 2021] GET /compute/v2.1/servers/0698dc5b-5f47-46c4-ace8-f5e891a964a0 => generated 1218 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:51:21.161943 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-0aaf7fef-d511-4ec6-8ef9-30d715fa674e tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:51:21.162660 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-0aaf7fef-d511-4ec6-8ef9-30d715fa674e tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] [instance: 5d54db85-b991-4890-abaa-952413baa2e7] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:51:21.170406 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-0aaf7fef-d511-4ec6-8ef9-30d715fa674e tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:51:21.170929 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-0aaf7fef-d511-4ec6-8ef9-30d715fa674e tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:51:21.171821 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-0aaf7fef-d511-4ec6-8ef9-30d715fa674e tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:51:21.172329 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-0aaf7fef-d511-4ec6-8ef9-30d715fa674e tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:51:21.250332 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-f2cb7eba-9b21-4d98-952e-99bdabbf592e tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:51:21.250942 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-f2cb7eba-9b21-4d98-952e-99bdabbf592e tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] [instance: 0698dc5b-5f47-46c4-ace8-f5e891a964a0] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:51:21.258222 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-f2cb7eba-9b21-4d98-952e-99bdabbf592e tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:51:21.258671 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-f2cb7eba-9b21-4d98-952e-99bdabbf592e tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:51:21.259455 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-f2cb7eba-9b21-4d98-952e-99bdabbf592e tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:51:21.259890 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-f2cb7eba-9b21-4d98-952e-99bdabbf592e tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:51:21.317584 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-0aaf7fef-d511-4ec6-8ef9-30d715fa674e tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37f21d6d15cf40a586edda211219fd08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ebb970305844dccacf48a7d8d47ecf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:51:21.325268 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-f2cb7eba-9b21-4d98-952e-99bdabbf592e tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '163b2f24a72649ac8084be1cac32fa09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e123e9b86124c93a7fc2db9984e7466', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:51:21.331524 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-0aaf7fef-d511-4ec6-8ef9-30d715fa674e tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '37f21d6d15cf40a586edda211219fd08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ebb970305844dccacf48a7d8d47ecf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:51:21.333345 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-0aaf7fef-d511-4ec6-8ef9-30d715fa674e tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '37f21d6d15cf40a586edda211219fd08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ebb970305844dccacf48a7d8d47ecf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:51:21.333499 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-f2cb7eba-9b21-4d98-952e-99bdabbf592e tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] 10.222.0.11 "GET /compute/v2.1/servers/0698dc5b-5f47-46c4-ace8-f5e891a964a0" status: 200 len: 1218 microversion: 2.1 time: 0.086829 Nov 17 03:51:21.334024 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 1312/2429] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:51:21 2021] GET /compute/v2.1/servers/0698dc5b-5f47-46c4-ace8-f5e891a964a0 => generated 1218 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:51:21.334893 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-0aaf7fef-d511-4ec6-8ef9-30d715fa674e tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] 10.222.0.11 "GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7" status: 200 len: 1803 microversion: 2.20 time: 0.177934 Nov 17 03:51:21.335512 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 1118/2430] 10.222.0.11 () {60 vars in 1276 bytes} [Wed Nov 17 03:51:21 2021] GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7 => generated 1803 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 17 03:51:22.354686 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-b111034a-33cd-421a-91e2-8df83337784c tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:51:22.355554 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-b111034a-33cd-421a-91e2-8df83337784c tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] [instance: 0698dc5b-5f47-46c4-ace8-f5e891a964a0] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:51:22.357631 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-b0897d4a-3fc9-4f4c-9876-182be0bb1b88 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:51:22.358619 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-b0897d4a-3fc9-4f4c-9876-182be0bb1b88 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] [instance: 5d54db85-b991-4890-abaa-952413baa2e7] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:51:22.364640 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-b111034a-33cd-421a-91e2-8df83337784c tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:51:22.365138 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-b111034a-33cd-421a-91e2-8df83337784c tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:51:22.365981 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-b111034a-33cd-421a-91e2-8df83337784c tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:51:22.366408 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-b111034a-33cd-421a-91e2-8df83337784c tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:51:22.366688 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-b0897d4a-3fc9-4f4c-9876-182be0bb1b88 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:51:22.367226 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-b0897d4a-3fc9-4f4c-9876-182be0bb1b88 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:51:22.368012 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-b0897d4a-3fc9-4f4c-9876-182be0bb1b88 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:51:22.368448 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-b0897d4a-3fc9-4f4c-9876-182be0bb1b88 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:51:22.428482 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-b111034a-33cd-421a-91e2-8df83337784c tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '163b2f24a72649ac8084be1cac32fa09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e123e9b86124c93a7fc2db9984e7466', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:51:22.436267 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-b111034a-33cd-421a-91e2-8df83337784c tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] 10.222.0.11 "GET /compute/v2.1/servers/0698dc5b-5f47-46c4-ace8-f5e891a964a0" status: 200 len: 1218 microversion: 2.1 time: 0.087787 Nov 17 03:51:22.436853 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 1313/2431] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:51:22 2021] GET /compute/v2.1/servers/0698dc5b-5f47-46c4-ace8-f5e891a964a0 => generated 1218 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:51:22.506345 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-b0897d4a-3fc9-4f4c-9876-182be0bb1b88 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37f21d6d15cf40a586edda211219fd08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ebb970305844dccacf48a7d8d47ecf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:51:22.514694 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-b0897d4a-3fc9-4f4c-9876-182be0bb1b88 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '37f21d6d15cf40a586edda211219fd08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ebb970305844dccacf48a7d8d47ecf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:51:22.516186 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-b0897d4a-3fc9-4f4c-9876-182be0bb1b88 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '37f21d6d15cf40a586edda211219fd08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ebb970305844dccacf48a7d8d47ecf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:51:22.517402 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-b0897d4a-3fc9-4f4c-9876-182be0bb1b88 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] 10.222.0.11 "GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7" status: 200 len: 1803 microversion: 2.20 time: 0.166062 Nov 17 03:51:22.517955 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 1119/2432] 10.222.0.11 () {60 vars in 1276 bytes} [Wed Nov 17 03:51:22 2021] GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7 => generated 1803 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 17 03:51:23.456575 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-5d0313bb-5007-4de6-a743-48eae7ec6197 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:51:23.457203 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-5d0313bb-5007-4de6-a743-48eae7ec6197 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] [instance: 0698dc5b-5f47-46c4-ace8-f5e891a964a0] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:51:23.463596 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-5d0313bb-5007-4de6-a743-48eae7ec6197 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:51:23.464046 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-5d0313bb-5007-4de6-a743-48eae7ec6197 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:51:23.464808 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-5d0313bb-5007-4de6-a743-48eae7ec6197 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:51:23.465278 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-5d0313bb-5007-4de6-a743-48eae7ec6197 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:51:23.527915 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-5d0313bb-5007-4de6-a743-48eae7ec6197 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '163b2f24a72649ac8084be1cac32fa09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e123e9b86124c93a7fc2db9984e7466', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:51:23.535794 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-c0fd6a36-ff2b-45c9-93a9-f1be7cce5427 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:51:23.536483 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-c0fd6a36-ff2b-45c9-93a9-f1be7cce5427 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] [instance: 5d54db85-b991-4890-abaa-952413baa2e7] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:51:23.536600 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-5d0313bb-5007-4de6-a743-48eae7ec6197 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] 10.222.0.11 "GET /compute/v2.1/servers/0698dc5b-5f47-46c4-ace8-f5e891a964a0" status: 200 len: 1218 microversion: 2.1 time: 0.085952 Nov 17 03:51:23.537147 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 1314/2433] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:51:23 2021] GET /compute/v2.1/servers/0698dc5b-5f47-46c4-ace8-f5e891a964a0 => generated 1218 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:51:23.543079 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-c0fd6a36-ff2b-45c9-93a9-f1be7cce5427 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:51:23.543603 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-c0fd6a36-ff2b-45c9-93a9-f1be7cce5427 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:51:23.544375 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-c0fd6a36-ff2b-45c9-93a9-f1be7cce5427 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:51:23.544800 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-c0fd6a36-ff2b-45c9-93a9-f1be7cce5427 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:51:23.685543 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-c0fd6a36-ff2b-45c9-93a9-f1be7cce5427 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37f21d6d15cf40a586edda211219fd08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ebb970305844dccacf48a7d8d47ecf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:51:23.697299 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-c0fd6a36-ff2b-45c9-93a9-f1be7cce5427 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '37f21d6d15cf40a586edda211219fd08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ebb970305844dccacf48a7d8d47ecf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:51:23.699590 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-c0fd6a36-ff2b-45c9-93a9-f1be7cce5427 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '37f21d6d15cf40a586edda211219fd08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ebb970305844dccacf48a7d8d47ecf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:51:23.701240 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-c0fd6a36-ff2b-45c9-93a9-f1be7cce5427 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] 10.222.0.11 "GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7" status: 200 len: 1803 microversion: 2.20 time: 0.169059 Nov 17 03:51:23.701954 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 1120/2434] 10.222.0.11 () {60 vars in 1276 bytes} [Wed Nov 17 03:51:23 2021] GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7 => generated 1803 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 17 03:51:24.554793 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-be63d4fa-fd4e-436a-9d77-d61cd37793a5 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:51:24.555720 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-be63d4fa-fd4e-436a-9d77-d61cd37793a5 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] [instance: 0698dc5b-5f47-46c4-ace8-f5e891a964a0] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:51:24.566571 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-be63d4fa-fd4e-436a-9d77-d61cd37793a5 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:51:24.567238 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-be63d4fa-fd4e-436a-9d77-d61cd37793a5 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:51:24.568463 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-be63d4fa-fd4e-436a-9d77-d61cd37793a5 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:51:24.569178 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-be63d4fa-fd4e-436a-9d77-d61cd37793a5 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:51:24.634070 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-be63d4fa-fd4e-436a-9d77-d61cd37793a5 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '163b2f24a72649ac8084be1cac32fa09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e123e9b86124c93a7fc2db9984e7466', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:51:24.641624 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-be63d4fa-fd4e-436a-9d77-d61cd37793a5 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] 10.222.0.11 "GET /compute/v2.1/servers/0698dc5b-5f47-46c4-ace8-f5e891a964a0" status: 200 len: 1218 microversion: 2.1 time: 0.091592 Nov 17 03:51:24.642184 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 1315/2435] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:51:24 2021] GET /compute/v2.1/servers/0698dc5b-5f47-46c4-ace8-f5e891a964a0 => generated 1218 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:51:24.724117 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-5953b660-292e-486c-b6df-526f2e2c19f0 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:51:24.725171 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-5953b660-292e-486c-b6df-526f2e2c19f0 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] [instance: 5d54db85-b991-4890-abaa-952413baa2e7] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:51:24.735618 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-5953b660-292e-486c-b6df-526f2e2c19f0 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:51:24.736360 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-5953b660-292e-486c-b6df-526f2e2c19f0 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:51:24.737944 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-5953b660-292e-486c-b6df-526f2e2c19f0 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:51:24.738662 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-5953b660-292e-486c-b6df-526f2e2c19f0 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:51:24.883565 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-5953b660-292e-486c-b6df-526f2e2c19f0 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37f21d6d15cf40a586edda211219fd08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ebb970305844dccacf48a7d8d47ecf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:51:24.892343 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-5953b660-292e-486c-b6df-526f2e2c19f0 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '37f21d6d15cf40a586edda211219fd08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ebb970305844dccacf48a7d8d47ecf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:51:24.894066 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-5953b660-292e-486c-b6df-526f2e2c19f0 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '37f21d6d15cf40a586edda211219fd08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ebb970305844dccacf48a7d8d47ecf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:51:24.895252 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-5953b660-292e-486c-b6df-526f2e2c19f0 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] 10.222.0.11 "GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7" status: 200 len: 1803 microversion: 2.20 time: 0.177336 Nov 17 03:51:24.895816 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 1121/2436] 10.222.0.11 () {60 vars in 1276 bytes} [Wed Nov 17 03:51:24 2021] GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7 => generated 1803 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 17 03:51:25.661276 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-2755a44b-0a80-447e-b946-d566cb5fb405 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:51:25.662016 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-2755a44b-0a80-447e-b946-d566cb5fb405 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] [instance: 0698dc5b-5f47-46c4-ace8-f5e891a964a0] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:51:25.670220 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-2755a44b-0a80-447e-b946-d566cb5fb405 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:51:25.670793 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-2755a44b-0a80-447e-b946-d566cb5fb405 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:51:25.671738 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-2755a44b-0a80-447e-b946-d566cb5fb405 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:51:25.672274 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-2755a44b-0a80-447e-b946-d566cb5fb405 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:51:25.745804 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-2755a44b-0a80-447e-b946-d566cb5fb405 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '163b2f24a72649ac8084be1cac32fa09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e123e9b86124c93a7fc2db9984e7466', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:51:25.756009 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-2755a44b-0a80-447e-b946-d566cb5fb405 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] 10.222.0.11 "GET /compute/v2.1/servers/0698dc5b-5f47-46c4-ace8-f5e891a964a0" status: 200 len: 1218 microversion: 2.1 time: 0.100281 Nov 17 03:51:25.756553 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 1316/2437] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:51:25 2021] GET /compute/v2.1/servers/0698dc5b-5f47-46c4-ace8-f5e891a964a0 => generated 1218 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:51:25.915657 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-347c3529-1383-44b3-b47f-1e939ba14b41 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:51:25.916299 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-347c3529-1383-44b3-b47f-1e939ba14b41 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] [instance: 5d54db85-b991-4890-abaa-952413baa2e7] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:51:25.924466 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-347c3529-1383-44b3-b47f-1e939ba14b41 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:51:25.925088 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-347c3529-1383-44b3-b47f-1e939ba14b41 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:51:25.926252 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-347c3529-1383-44b3-b47f-1e939ba14b41 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:51:25.926684 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-347c3529-1383-44b3-b47f-1e939ba14b41 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:51:26.075278 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-347c3529-1383-44b3-b47f-1e939ba14b41 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37f21d6d15cf40a586edda211219fd08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ebb970305844dccacf48a7d8d47ecf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:51:26.083697 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-347c3529-1383-44b3-b47f-1e939ba14b41 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '37f21d6d15cf40a586edda211219fd08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ebb970305844dccacf48a7d8d47ecf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:51:26.085196 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-347c3529-1383-44b3-b47f-1e939ba14b41 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '37f21d6d15cf40a586edda211219fd08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ebb970305844dccacf48a7d8d47ecf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:51:26.086352 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-347c3529-1383-44b3-b47f-1e939ba14b41 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] 10.222.0.11 "GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7" status: 200 len: 1803 microversion: 2.20 time: 0.175726 Nov 17 03:51:26.086913 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 1122/2438] 10.222.0.11 () {60 vars in 1276 bytes} [Wed Nov 17 03:51:25 2021] GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7 => generated 1803 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 17 03:51:26.774557 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-c2bac637-608b-47fe-bdfb-c174d1795c39 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:51:26.775184 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-c2bac637-608b-47fe-bdfb-c174d1795c39 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] [instance: 0698dc5b-5f47-46c4-ace8-f5e891a964a0] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:51:26.782135 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-c2bac637-608b-47fe-bdfb-c174d1795c39 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:51:26.782597 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-c2bac637-608b-47fe-bdfb-c174d1795c39 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:51:26.783397 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-c2bac637-608b-47fe-bdfb-c174d1795c39 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:51:26.783847 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-c2bac637-608b-47fe-bdfb-c174d1795c39 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:51:26.850387 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-c2bac637-608b-47fe-bdfb-c174d1795c39 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '163b2f24a72649ac8084be1cac32fa09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e123e9b86124c93a7fc2db9984e7466', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:51:26.861600 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-c2bac637-608b-47fe-bdfb-c174d1795c39 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] 10.222.0.11 "GET /compute/v2.1/servers/0698dc5b-5f47-46c4-ace8-f5e891a964a0" status: 200 len: 1218 microversion: 2.1 time: 0.090815 Nov 17 03:51:26.862283 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 1317/2439] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:51:26 2021] GET /compute/v2.1/servers/0698dc5b-5f47-46c4-ace8-f5e891a964a0 => generated 1218 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:51:27.108580 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-98ae404e-d27a-4663-985f-ff96901984d0 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:51:27.109626 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-98ae404e-d27a-4663-985f-ff96901984d0 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] [instance: 5d54db85-b991-4890-abaa-952413baa2e7] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:51:27.120265 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-98ae404e-d27a-4663-985f-ff96901984d0 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:51:27.121092 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-98ae404e-d27a-4663-985f-ff96901984d0 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:51:27.122371 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-98ae404e-d27a-4663-985f-ff96901984d0 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:51:27.123101 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-98ae404e-d27a-4663-985f-ff96901984d0 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:51:27.265932 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-98ae404e-d27a-4663-985f-ff96901984d0 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37f21d6d15cf40a586edda211219fd08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ebb970305844dccacf48a7d8d47ecf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:51:27.277622 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-98ae404e-d27a-4663-985f-ff96901984d0 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '37f21d6d15cf40a586edda211219fd08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ebb970305844dccacf48a7d8d47ecf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:51:27.279973 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-98ae404e-d27a-4663-985f-ff96901984d0 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '37f21d6d15cf40a586edda211219fd08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ebb970305844dccacf48a7d8d47ecf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:51:27.281750 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-98ae404e-d27a-4663-985f-ff96901984d0 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] 10.222.0.11 "GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7" status: 200 len: 1803 microversion: 2.20 time: 0.179209 Nov 17 03:51:27.282550 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 1123/2440] 10.222.0.11 () {60 vars in 1276 bytes} [Wed Nov 17 03:51:27 2021] GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7 => generated 1803 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 17 03:51:27.882426 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-27ebd7f8-11b9-4904-8373-5cb8ae3b2f47 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:51:27.883419 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-27ebd7f8-11b9-4904-8373-5cb8ae3b2f47 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] [instance: 0698dc5b-5f47-46c4-ace8-f5e891a964a0] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:51:27.893952 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-27ebd7f8-11b9-4904-8373-5cb8ae3b2f47 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:51:27.894700 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-27ebd7f8-11b9-4904-8373-5cb8ae3b2f47 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:51:27.896240 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-27ebd7f8-11b9-4904-8373-5cb8ae3b2f47 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:51:27.897006 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-27ebd7f8-11b9-4904-8373-5cb8ae3b2f47 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:51:27.966597 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-27ebd7f8-11b9-4904-8373-5cb8ae3b2f47 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '163b2f24a72649ac8084be1cac32fa09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e123e9b86124c93a7fc2db9984e7466', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:51:27.974534 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-27ebd7f8-11b9-4904-8373-5cb8ae3b2f47 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] 10.222.0.11 "GET /compute/v2.1/servers/0698dc5b-5f47-46c4-ace8-f5e891a964a0" status: 200 len: 1218 microversion: 2.1 time: 0.098525 Nov 17 03:51:27.975095 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 1318/2441] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:51:27 2021] GET /compute/v2.1/servers/0698dc5b-5f47-46c4-ace8-f5e891a964a0 => generated 1218 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:51:28.306323 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-2573fdcd-b05f-43a3-b2c0-105faae56d7f tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:51:28.307329 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-2573fdcd-b05f-43a3-b2c0-105faae56d7f tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] [instance: 5d54db85-b991-4890-abaa-952413baa2e7] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:51:28.318007 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-2573fdcd-b05f-43a3-b2c0-105faae56d7f tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:51:28.318745 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-2573fdcd-b05f-43a3-b2c0-105faae56d7f tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:51:28.319996 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-2573fdcd-b05f-43a3-b2c0-105faae56d7f tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:51:28.320720 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-2573fdcd-b05f-43a3-b2c0-105faae56d7f tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:51:28.461962 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-2573fdcd-b05f-43a3-b2c0-105faae56d7f tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37f21d6d15cf40a586edda211219fd08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ebb970305844dccacf48a7d8d47ecf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:51:28.474474 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-2573fdcd-b05f-43a3-b2c0-105faae56d7f tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '37f21d6d15cf40a586edda211219fd08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ebb970305844dccacf48a7d8d47ecf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:51:28.475976 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-2573fdcd-b05f-43a3-b2c0-105faae56d7f tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '37f21d6d15cf40a586edda211219fd08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ebb970305844dccacf48a7d8d47ecf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:51:28.477156 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-2573fdcd-b05f-43a3-b2c0-105faae56d7f tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] 10.222.0.11 "GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7" status: 200 len: 1803 microversion: 2.20 time: 0.177542 Nov 17 03:51:28.477710 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 1124/2442] 10.222.0.11 () {60 vars in 1276 bytes} [Wed Nov 17 03:51:28 2021] GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7 => generated 1803 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 17 03:51:28.994788 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-cf7d8195-b1d7-44fc-886f-cfb6907ed457 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:51:28.995781 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-cf7d8195-b1d7-44fc-886f-cfb6907ed457 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] [instance: 0698dc5b-5f47-46c4-ace8-f5e891a964a0] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:51:29.006678 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-cf7d8195-b1d7-44fc-886f-cfb6907ed457 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:51:29.007422 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-cf7d8195-b1d7-44fc-886f-cfb6907ed457 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:51:29.008666 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-cf7d8195-b1d7-44fc-886f-cfb6907ed457 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:51:29.009434 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-cf7d8195-b1d7-44fc-886f-cfb6907ed457 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:51:29.075160 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-cf7d8195-b1d7-44fc-886f-cfb6907ed457 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '163b2f24a72649ac8084be1cac32fa09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e123e9b86124c93a7fc2db9984e7466', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:51:29.082972 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-cf7d8195-b1d7-44fc-886f-cfb6907ed457 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] 10.222.0.11 "GET /compute/v2.1/servers/0698dc5b-5f47-46c4-ace8-f5e891a964a0" status: 200 len: 1218 microversion: 2.1 time: 0.094347 Nov 17 03:51:29.083352 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 1319/2443] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:51:28 2021] GET /compute/v2.1/servers/0698dc5b-5f47-46c4-ace8-f5e891a964a0 => generated 1218 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:51:29.496082 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-9dbe477b-87d9-4cc3-8867-90c902e6997a tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:51:29.496624 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-9dbe477b-87d9-4cc3-8867-90c902e6997a tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] [instance: 5d54db85-b991-4890-abaa-952413baa2e7] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:51:29.503700 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-9dbe477b-87d9-4cc3-8867-90c902e6997a tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:51:29.504171 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-9dbe477b-87d9-4cc3-8867-90c902e6997a tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:51:29.505056 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-9dbe477b-87d9-4cc3-8867-90c902e6997a tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:51:29.505514 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-9dbe477b-87d9-4cc3-8867-90c902e6997a tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:51:29.657443 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-9dbe477b-87d9-4cc3-8867-90c902e6997a tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37f21d6d15cf40a586edda211219fd08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ebb970305844dccacf48a7d8d47ecf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:51:29.666502 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-9dbe477b-87d9-4cc3-8867-90c902e6997a tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '37f21d6d15cf40a586edda211219fd08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ebb970305844dccacf48a7d8d47ecf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:51:29.667973 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-9dbe477b-87d9-4cc3-8867-90c902e6997a tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '37f21d6d15cf40a586edda211219fd08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ebb970305844dccacf48a7d8d47ecf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:51:29.669148 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-9dbe477b-87d9-4cc3-8867-90c902e6997a tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] 10.222.0.11 "GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7" status: 200 len: 1803 microversion: 2.20 time: 0.176989 Nov 17 03:51:29.669701 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 1125/2444] 10.222.0.11 () {60 vars in 1276 bytes} [Wed Nov 17 03:51:29 2021] GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7 => generated 1803 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 17 03:51:30.099373 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-0ffdfc59-89c6-4d94-a612-b06347d5c68e tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:51:30.099976 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-0ffdfc59-89c6-4d94-a612-b06347d5c68e tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] [instance: 0698dc5b-5f47-46c4-ace8-f5e891a964a0] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:51:30.106530 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-0ffdfc59-89c6-4d94-a612-b06347d5c68e tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:51:30.106974 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-0ffdfc59-89c6-4d94-a612-b06347d5c68e tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:51:30.107731 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-0ffdfc59-89c6-4d94-a612-b06347d5c68e tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:51:30.108158 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-0ffdfc59-89c6-4d94-a612-b06347d5c68e tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:51:30.169568 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-0ffdfc59-89c6-4d94-a612-b06347d5c68e tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '163b2f24a72649ac8084be1cac32fa09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e123e9b86124c93a7fc2db9984e7466', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:51:30.177784 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-0ffdfc59-89c6-4d94-a612-b06347d5c68e tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] 10.222.0.11 "GET /compute/v2.1/servers/0698dc5b-5f47-46c4-ace8-f5e891a964a0" status: 200 len: 1218 microversion: 2.1 time: 0.081694 Nov 17 03:51:30.178610 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 1320/2445] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:51:30 2021] GET /compute/v2.1/servers/0698dc5b-5f47-46c4-ace8-f5e891a964a0 => generated 1218 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:51:30.692170 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-a3e65247-9442-4cc5-bf7f-df636bf8cdb6 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:51:30.692912 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-a3e65247-9442-4cc5-bf7f-df636bf8cdb6 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] [instance: 5d54db85-b991-4890-abaa-952413baa2e7] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:51:30.700680 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-a3e65247-9442-4cc5-bf7f-df636bf8cdb6 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:51:30.701237 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-a3e65247-9442-4cc5-bf7f-df636bf8cdb6 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:51:30.702146 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-a3e65247-9442-4cc5-bf7f-df636bf8cdb6 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:51:30.702653 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-a3e65247-9442-4cc5-bf7f-df636bf8cdb6 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:51:30.858330 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-a3e65247-9442-4cc5-bf7f-df636bf8cdb6 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37f21d6d15cf40a586edda211219fd08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ebb970305844dccacf48a7d8d47ecf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:51:30.867155 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-a3e65247-9442-4cc5-bf7f-df636bf8cdb6 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '37f21d6d15cf40a586edda211219fd08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ebb970305844dccacf48a7d8d47ecf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:51:30.868644 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-a3e65247-9442-4cc5-bf7f-df636bf8cdb6 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '37f21d6d15cf40a586edda211219fd08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ebb970305844dccacf48a7d8d47ecf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:51:30.869828 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-a3e65247-9442-4cc5-bf7f-df636bf8cdb6 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] 10.222.0.11 "GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7" status: 200 len: 1803 microversion: 2.20 time: 0.184111 Nov 17 03:51:30.870386 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 1126/2446] 10.222.0.11 () {60 vars in 1276 bytes} [Wed Nov 17 03:51:30 2021] GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7 => generated 1803 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 17 03:51:31.198509 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-eb88ac19-d9cd-4451-84cf-7cf5538f7429 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:51:31.199539 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-eb88ac19-d9cd-4451-84cf-7cf5538f7429 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] [instance: 0698dc5b-5f47-46c4-ace8-f5e891a964a0] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:51:31.209398 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-eb88ac19-d9cd-4451-84cf-7cf5538f7429 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:51:31.209841 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-eb88ac19-d9cd-4451-84cf-7cf5538f7429 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:51:31.210607 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-eb88ac19-d9cd-4451-84cf-7cf5538f7429 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:51:31.211036 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-eb88ac19-d9cd-4451-84cf-7cf5538f7429 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:51:31.269160 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-eb88ac19-d9cd-4451-84cf-7cf5538f7429 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '163b2f24a72649ac8084be1cac32fa09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e123e9b86124c93a7fc2db9984e7466', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:51:31.276820 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-eb88ac19-d9cd-4451-84cf-7cf5538f7429 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] 10.222.0.11 "GET /compute/v2.1/servers/0698dc5b-5f47-46c4-ace8-f5e891a964a0" status: 200 len: 1218 microversion: 2.1 time: 0.084389 Nov 17 03:51:31.277409 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 1321/2447] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:51:31 2021] GET /compute/v2.1/servers/0698dc5b-5f47-46c4-ace8-f5e891a964a0 => generated 1218 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:51:31.892217 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-951ac013-7ffe-4d2d-8cb5-45670cad5dce tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:51:31.893236 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-951ac013-7ffe-4d2d-8cb5-45670cad5dce tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] [instance: 5d54db85-b991-4890-abaa-952413baa2e7] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:51:31.904953 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-951ac013-7ffe-4d2d-8cb5-45670cad5dce tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:51:31.905405 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-951ac013-7ffe-4d2d-8cb5-45670cad5dce tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:51:31.906166 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-951ac013-7ffe-4d2d-8cb5-45670cad5dce tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:51:31.906597 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-951ac013-7ffe-4d2d-8cb5-45670cad5dce tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:51:32.047989 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-951ac013-7ffe-4d2d-8cb5-45670cad5dce tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37f21d6d15cf40a586edda211219fd08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ebb970305844dccacf48a7d8d47ecf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:51:32.057472 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-951ac013-7ffe-4d2d-8cb5-45670cad5dce tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '37f21d6d15cf40a586edda211219fd08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ebb970305844dccacf48a7d8d47ecf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:51:32.058949 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-951ac013-7ffe-4d2d-8cb5-45670cad5dce tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '37f21d6d15cf40a586edda211219fd08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ebb970305844dccacf48a7d8d47ecf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:51:32.060107 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-951ac013-7ffe-4d2d-8cb5-45670cad5dce tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] 10.222.0.11 "GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7" status: 200 len: 1803 microversion: 2.20 time: 0.174054 Nov 17 03:51:32.060662 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 1127/2448] 10.222.0.11 () {60 vars in 1276 bytes} [Wed Nov 17 03:51:31 2021] GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7 => generated 1803 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 17 03:51:32.295802 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-292f3ba0-4d2a-4eb4-aabc-3b35f0bf47f7 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:51:32.296530 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-292f3ba0-4d2a-4eb4-aabc-3b35f0bf47f7 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] [instance: 0698dc5b-5f47-46c4-ace8-f5e891a964a0] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:51:32.305241 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-292f3ba0-4d2a-4eb4-aabc-3b35f0bf47f7 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:51:32.305797 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-292f3ba0-4d2a-4eb4-aabc-3b35f0bf47f7 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:51:32.306746 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-292f3ba0-4d2a-4eb4-aabc-3b35f0bf47f7 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:51:32.307284 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-292f3ba0-4d2a-4eb4-aabc-3b35f0bf47f7 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:51:32.373975 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-292f3ba0-4d2a-4eb4-aabc-3b35f0bf47f7 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '163b2f24a72649ac8084be1cac32fa09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e123e9b86124c93a7fc2db9984e7466', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:51:32.382218 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-292f3ba0-4d2a-4eb4-aabc-3b35f0bf47f7 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] 10.222.0.11 "GET /compute/v2.1/servers/0698dc5b-5f47-46c4-ace8-f5e891a964a0" status: 200 len: 1218 microversion: 2.1 time: 0.091124 Nov 17 03:51:32.382789 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 1322/2449] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:51:32 2021] GET /compute/v2.1/servers/0698dc5b-5f47-46c4-ace8-f5e891a964a0 => generated 1218 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:51:33.081239 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-31d64e99-3dca-4490-bbb4-7ba45b2a1e49 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:51:33.081855 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-31d64e99-3dca-4490-bbb4-7ba45b2a1e49 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] [instance: 5d54db85-b991-4890-abaa-952413baa2e7] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:51:33.091685 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-31d64e99-3dca-4490-bbb4-7ba45b2a1e49 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:51:33.092136 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-31d64e99-3dca-4490-bbb4-7ba45b2a1e49 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:51:33.093313 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-31d64e99-3dca-4490-bbb4-7ba45b2a1e49 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:51:33.093899 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-31d64e99-3dca-4490-bbb4-7ba45b2a1e49 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:51:33.228934 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-31d64e99-3dca-4490-bbb4-7ba45b2a1e49 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37f21d6d15cf40a586edda211219fd08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ebb970305844dccacf48a7d8d47ecf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:51:33.237919 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-31d64e99-3dca-4490-bbb4-7ba45b2a1e49 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '37f21d6d15cf40a586edda211219fd08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ebb970305844dccacf48a7d8d47ecf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:51:33.239400 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-31d64e99-3dca-4490-bbb4-7ba45b2a1e49 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '37f21d6d15cf40a586edda211219fd08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ebb970305844dccacf48a7d8d47ecf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:51:33.240545 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-31d64e99-3dca-4490-bbb4-7ba45b2a1e49 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] 10.222.0.11 "GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7" status: 200 len: 1803 microversion: 2.20 time: 0.165384 Nov 17 03:51:33.241135 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 1128/2450] 10.222.0.11 () {60 vars in 1276 bytes} [Wed Nov 17 03:51:33 2021] GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7 => generated 1803 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 17 03:51:33.400377 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-713390a6-775d-48ba-9c0b-1a303f158922 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:51:33.400992 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-713390a6-775d-48ba-9c0b-1a303f158922 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] [instance: 0698dc5b-5f47-46c4-ace8-f5e891a964a0] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:51:33.407708 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-713390a6-775d-48ba-9c0b-1a303f158922 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:51:33.408150 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-713390a6-775d-48ba-9c0b-1a303f158922 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:51:33.408965 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-713390a6-775d-48ba-9c0b-1a303f158922 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:51:33.409396 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-713390a6-775d-48ba-9c0b-1a303f158922 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:51:33.473733 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-713390a6-775d-48ba-9c0b-1a303f158922 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '163b2f24a72649ac8084be1cac32fa09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e123e9b86124c93a7fc2db9984e7466', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:51:33.481577 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-713390a6-775d-48ba-9c0b-1a303f158922 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] 10.222.0.11 "GET /compute/v2.1/servers/0698dc5b-5f47-46c4-ace8-f5e891a964a0" status: 200 len: 1218 microversion: 2.1 time: 0.084969 Nov 17 03:51:33.482141 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 1323/2451] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:51:33 2021] GET /compute/v2.1/servers/0698dc5b-5f47-46c4-ace8-f5e891a964a0 => generated 1218 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:51:34.260768 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-67aabbe5-033c-4cc0-bb33-33a20ad437e0 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:51:34.261484 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-67aabbe5-033c-4cc0-bb33-33a20ad437e0 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] [instance: 5d54db85-b991-4890-abaa-952413baa2e7] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:51:34.268314 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-67aabbe5-033c-4cc0-bb33-33a20ad437e0 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:51:34.268729 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-67aabbe5-033c-4cc0-bb33-33a20ad437e0 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:51:34.269554 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-67aabbe5-033c-4cc0-bb33-33a20ad437e0 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:51:34.270153 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-67aabbe5-033c-4cc0-bb33-33a20ad437e0 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:51:34.399294 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-67aabbe5-033c-4cc0-bb33-33a20ad437e0 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37f21d6d15cf40a586edda211219fd08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ebb970305844dccacf48a7d8d47ecf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:51:34.407557 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-67aabbe5-033c-4cc0-bb33-33a20ad437e0 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '37f21d6d15cf40a586edda211219fd08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ebb970305844dccacf48a7d8d47ecf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:51:34.409077 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-67aabbe5-033c-4cc0-bb33-33a20ad437e0 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '37f21d6d15cf40a586edda211219fd08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ebb970305844dccacf48a7d8d47ecf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:51:34.410202 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-67aabbe5-033c-4cc0-bb33-33a20ad437e0 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] 10.222.0.11 "GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7" status: 200 len: 1803 microversion: 2.20 time: 0.153927 Nov 17 03:51:34.411076 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 1129/2452] 10.222.0.11 () {60 vars in 1276 bytes} [Wed Nov 17 03:51:34 2021] GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7 => generated 1803 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 17 03:51:34.498826 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-ba16290d-3635-4cf3-a983-3ed28620b148 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:51:34.499423 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-ba16290d-3635-4cf3-a983-3ed28620b148 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] [instance: 0698dc5b-5f47-46c4-ace8-f5e891a964a0] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:51:34.506315 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-ba16290d-3635-4cf3-a983-3ed28620b148 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:51:34.506764 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-ba16290d-3635-4cf3-a983-3ed28620b148 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:51:34.507573 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-ba16290d-3635-4cf3-a983-3ed28620b148 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:51:34.508005 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-ba16290d-3635-4cf3-a983-3ed28620b148 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:51:34.568361 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-ba16290d-3635-4cf3-a983-3ed28620b148 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '163b2f24a72649ac8084be1cac32fa09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e123e9b86124c93a7fc2db9984e7466', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:51:34.578794 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-ba16290d-3635-4cf3-a983-3ed28620b148 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] 10.222.0.11 "GET /compute/v2.1/servers/0698dc5b-5f47-46c4-ace8-f5e891a964a0" status: 200 len: 1218 microversion: 2.1 time: 0.083389 Nov 17 03:51:34.579505 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 1324/2453] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:51:34 2021] GET /compute/v2.1/servers/0698dc5b-5f47-46c4-ace8-f5e891a964a0 => generated 1218 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:51:35.434427 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-91a581d6-e069-44bb-8b8b-26d126e1bfb2 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:51:35.435333 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-91a581d6-e069-44bb-8b8b-26d126e1bfb2 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] [instance: 5d54db85-b991-4890-abaa-952413baa2e7] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:51:35.447470 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-91a581d6-e069-44bb-8b8b-26d126e1bfb2 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:51:35.447939 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-91a581d6-e069-44bb-8b8b-26d126e1bfb2 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:51:35.448809 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-91a581d6-e069-44bb-8b8b-26d126e1bfb2 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:51:35.449316 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-91a581d6-e069-44bb-8b8b-26d126e1bfb2 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:51:35.597211 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-e1214bad-f3e3-4996-8df6-f01bf96c5577 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:51:35.597813 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-e1214bad-f3e3-4996-8df6-f01bf96c5577 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] [instance: 0698dc5b-5f47-46c4-ace8-f5e891a964a0] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:51:35.601860 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-91a581d6-e069-44bb-8b8b-26d126e1bfb2 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37f21d6d15cf40a586edda211219fd08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ebb970305844dccacf48a7d8d47ecf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:51:35.607437 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-e1214bad-f3e3-4996-8df6-f01bf96c5577 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:51:35.608175 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-e1214bad-f3e3-4996-8df6-f01bf96c5577 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:51:35.609473 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-e1214bad-f3e3-4996-8df6-f01bf96c5577 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:51:35.610139 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-e1214bad-f3e3-4996-8df6-f01bf96c5577 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:51:35.614900 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-91a581d6-e069-44bb-8b8b-26d126e1bfb2 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '37f21d6d15cf40a586edda211219fd08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ebb970305844dccacf48a7d8d47ecf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:51:35.616607 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-91a581d6-e069-44bb-8b8b-26d126e1bfb2 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '37f21d6d15cf40a586edda211219fd08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ebb970305844dccacf48a7d8d47ecf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:51:35.617793 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-91a581d6-e069-44bb-8b8b-26d126e1bfb2 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] 10.222.0.11 "GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7" status: 200 len: 1803 microversion: 2.20 time: 0.190991 Nov 17 03:51:35.618352 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 1130/2454] 10.222.0.11 () {60 vars in 1276 bytes} [Wed Nov 17 03:51:35 2021] GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7 => generated 1803 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 17 03:51:35.671979 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-e1214bad-f3e3-4996-8df6-f01bf96c5577 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '163b2f24a72649ac8084be1cac32fa09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e123e9b86124c93a7fc2db9984e7466', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:51:35.680165 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-e1214bad-f3e3-4996-8df6-f01bf96c5577 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] 10.222.0.11 "GET /compute/v2.1/servers/0698dc5b-5f47-46c4-ace8-f5e891a964a0" status: 200 len: 1218 microversion: 2.1 time: 0.086919 Nov 17 03:51:35.680737 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 1325/2455] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:51:35 2021] GET /compute/v2.1/servers/0698dc5b-5f47-46c4-ace8-f5e891a964a0 => generated 1218 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:51:36.639717 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-ebcba2d7-45f1-44a6-a706-6673ca0d72bc tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:51:36.640686 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-ebcba2d7-45f1-44a6-a706-6673ca0d72bc tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] [instance: 5d54db85-b991-4890-abaa-952413baa2e7] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:51:36.651502 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-ebcba2d7-45f1-44a6-a706-6673ca0d72bc tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:51:36.652252 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-ebcba2d7-45f1-44a6-a706-6673ca0d72bc tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:51:36.653560 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-ebcba2d7-45f1-44a6-a706-6673ca0d72bc tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:51:36.654272 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-ebcba2d7-45f1-44a6-a706-6673ca0d72bc tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:51:36.696913 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-a373e7b9-a958-4b7e-995e-ba22dd2299b3 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:51:36.697517 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-a373e7b9-a958-4b7e-995e-ba22dd2299b3 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] [instance: 0698dc5b-5f47-46c4-ace8-f5e891a964a0] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:51:36.704177 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-a373e7b9-a958-4b7e-995e-ba22dd2299b3 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:51:36.704628 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-a373e7b9-a958-4b7e-995e-ba22dd2299b3 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:51:36.705446 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-a373e7b9-a958-4b7e-995e-ba22dd2299b3 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:51:36.705884 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-a373e7b9-a958-4b7e-995e-ba22dd2299b3 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:51:36.765561 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-a373e7b9-a958-4b7e-995e-ba22dd2299b3 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '163b2f24a72649ac8084be1cac32fa09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e123e9b86124c93a7fc2db9984e7466', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:51:36.773194 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-a373e7b9-a958-4b7e-995e-ba22dd2299b3 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] 10.222.0.11 "GET /compute/v2.1/servers/0698dc5b-5f47-46c4-ace8-f5e891a964a0" status: 200 len: 1218 microversion: 2.1 time: 0.080035 Nov 17 03:51:36.773762 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 1326/2456] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:51:36 2021] GET /compute/v2.1/servers/0698dc5b-5f47-46c4-ace8-f5e891a964a0 => generated 1218 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:51:36.793197 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-ebcba2d7-45f1-44a6-a706-6673ca0d72bc tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37f21d6d15cf40a586edda211219fd08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ebb970305844dccacf48a7d8d47ecf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:51:36.801357 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-ebcba2d7-45f1-44a6-a706-6673ca0d72bc tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '37f21d6d15cf40a586edda211219fd08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ebb970305844dccacf48a7d8d47ecf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:51:36.803183 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-ebcba2d7-45f1-44a6-a706-6673ca0d72bc tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '37f21d6d15cf40a586edda211219fd08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ebb970305844dccacf48a7d8d47ecf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:51:36.804408 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-ebcba2d7-45f1-44a6-a706-6673ca0d72bc tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] 10.222.0.11 "GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7" status: 200 len: 1803 microversion: 2.20 time: 0.170831 Nov 17 03:51:36.804994 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 1131/2457] 10.222.0.11 () {60 vars in 1276 bytes} [Wed Nov 17 03:51:36 2021] GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7 => generated 1803 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 17 03:51:37.790246 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-035a9d39-173f-4d1f-ab99-cc77428db320 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:51:37.791009 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-035a9d39-173f-4d1f-ab99-cc77428db320 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] [instance: 0698dc5b-5f47-46c4-ace8-f5e891a964a0] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:51:37.798028 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-035a9d39-173f-4d1f-ab99-cc77428db320 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:51:37.798488 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-035a9d39-173f-4d1f-ab99-cc77428db320 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:51:37.799287 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-035a9d39-173f-4d1f-ab99-cc77428db320 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:51:37.799733 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-035a9d39-173f-4d1f-ab99-cc77428db320 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:51:37.822575 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-a87f88be-afed-49e4-8c25-f8be7cbe5bdd tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:51:37.823182 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-a87f88be-afed-49e4-8c25-f8be7cbe5bdd tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] [instance: 5d54db85-b991-4890-abaa-952413baa2e7] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:51:37.829798 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-a87f88be-afed-49e4-8c25-f8be7cbe5bdd tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:51:37.830359 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-a87f88be-afed-49e4-8c25-f8be7cbe5bdd tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:51:37.831115 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-a87f88be-afed-49e4-8c25-f8be7cbe5bdd tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:51:37.831568 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-a87f88be-afed-49e4-8c25-f8be7cbe5bdd tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:51:37.858585 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-035a9d39-173f-4d1f-ab99-cc77428db320 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '163b2f24a72649ac8084be1cac32fa09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e123e9b86124c93a7fc2db9984e7466', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:51:37.866483 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-035a9d39-173f-4d1f-ab99-cc77428db320 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] 10.222.0.11 "GET /compute/v2.1/servers/0698dc5b-5f47-46c4-ace8-f5e891a964a0" status: 200 len: 1218 microversion: 2.1 time: 0.080106 Nov 17 03:51:37.867057 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 1327/2458] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:51:37 2021] GET /compute/v2.1/servers/0698dc5b-5f47-46c4-ace8-f5e891a964a0 => generated 1218 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:51:37.965734 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-a87f88be-afed-49e4-8c25-f8be7cbe5bdd tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37f21d6d15cf40a586edda211219fd08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ebb970305844dccacf48a7d8d47ecf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:51:37.979089 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-a87f88be-afed-49e4-8c25-f8be7cbe5bdd tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '37f21d6d15cf40a586edda211219fd08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ebb970305844dccacf48a7d8d47ecf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:51:37.981489 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-a87f88be-afed-49e4-8c25-f8be7cbe5bdd tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '37f21d6d15cf40a586edda211219fd08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ebb970305844dccacf48a7d8d47ecf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:51:37.983214 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-a87f88be-afed-49e4-8c25-f8be7cbe5bdd tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] 10.222.0.11 "GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7" status: 200 len: 1803 microversion: 2.20 time: 0.164122 Nov 17 03:51:37.984027 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 1132/2459] 10.222.0.11 () {60 vars in 1276 bytes} [Wed Nov 17 03:51:37 2021] GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7 => generated 1803 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 17 03:51:38.887446 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-9c699c1e-cc43-4d1f-8947-9170ce18cfd0 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:51:38.888432 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-9c699c1e-cc43-4d1f-8947-9170ce18cfd0 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] [instance: 0698dc5b-5f47-46c4-ace8-f5e891a964a0] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:51:38.899465 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-9c699c1e-cc43-4d1f-8947-9170ce18cfd0 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:51:38.900218 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-9c699c1e-cc43-4d1f-8947-9170ce18cfd0 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:51:38.901525 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-9c699c1e-cc43-4d1f-8947-9170ce18cfd0 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:51:38.902238 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-9c699c1e-cc43-4d1f-8947-9170ce18cfd0 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:51:38.969256 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-9c699c1e-cc43-4d1f-8947-9170ce18cfd0 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '163b2f24a72649ac8084be1cac32fa09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e123e9b86124c93a7fc2db9984e7466', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:51:38.977409 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-9c699c1e-cc43-4d1f-8947-9170ce18cfd0 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] 10.222.0.11 "GET /compute/v2.1/servers/0698dc5b-5f47-46c4-ace8-f5e891a964a0" status: 200 len: 1218 microversion: 2.1 time: 0.096769 Nov 17 03:51:38.977975 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 1328/2460] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:51:38 2021] GET /compute/v2.1/servers/0698dc5b-5f47-46c4-ace8-f5e891a964a0 => generated 1218 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:51:39.002534 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-8a28820e-0bc1-4a29-aeb3-3b6e72f3bc56 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:51:39.003148 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-8a28820e-0bc1-4a29-aeb3-3b6e72f3bc56 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] [instance: 5d54db85-b991-4890-abaa-952413baa2e7] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:51:39.010179 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-8a28820e-0bc1-4a29-aeb3-3b6e72f3bc56 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:51:39.010634 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-8a28820e-0bc1-4a29-aeb3-3b6e72f3bc56 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:51:39.011410 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-8a28820e-0bc1-4a29-aeb3-3b6e72f3bc56 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:51:39.011845 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-8a28820e-0bc1-4a29-aeb3-3b6e72f3bc56 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:51:39.150856 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-8a28820e-0bc1-4a29-aeb3-3b6e72f3bc56 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37f21d6d15cf40a586edda211219fd08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ebb970305844dccacf48a7d8d47ecf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:51:39.163436 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-8a28820e-0bc1-4a29-aeb3-3b6e72f3bc56 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '37f21d6d15cf40a586edda211219fd08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ebb970305844dccacf48a7d8d47ecf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:51:39.164968 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-8a28820e-0bc1-4a29-aeb3-3b6e72f3bc56 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '37f21d6d15cf40a586edda211219fd08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ebb970305844dccacf48a7d8d47ecf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:51:39.166163 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-8a28820e-0bc1-4a29-aeb3-3b6e72f3bc56 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] 10.222.0.11 "GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7" status: 200 len: 1803 microversion: 2.20 time: 0.167341 Nov 17 03:51:39.166756 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 1133/2461] 10.222.0.11 () {60 vars in 1276 bytes} [Wed Nov 17 03:51:38 2021] GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7 => generated 1803 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 17 03:51:39.995988 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-9ea9fe0c-9db3-4103-89e5-fbae22c7812b tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:51:39.996754 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-9ea9fe0c-9db3-4103-89e5-fbae22c7812b tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] [instance: 0698dc5b-5f47-46c4-ace8-f5e891a964a0] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:51:40.005042 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-9ea9fe0c-9db3-4103-89e5-fbae22c7812b tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:51:40.005608 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-9ea9fe0c-9db3-4103-89e5-fbae22c7812b tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:51:40.006571 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-9ea9fe0c-9db3-4103-89e5-fbae22c7812b tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:51:40.007104 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-9ea9fe0c-9db3-4103-89e5-fbae22c7812b tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:51:40.078542 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-9ea9fe0c-9db3-4103-89e5-fbae22c7812b tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '163b2f24a72649ac8084be1cac32fa09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e123e9b86124c93a7fc2db9984e7466', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:51:40.087522 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-9ea9fe0c-9db3-4103-89e5-fbae22c7812b tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] 10.222.0.11 "GET /compute/v2.1/servers/0698dc5b-5f47-46c4-ace8-f5e891a964a0" status: 200 len: 1218 microversion: 2.1 time: 0.096331 Nov 17 03:51:40.088301 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 1329/2462] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:51:39 2021] GET /compute/v2.1/servers/0698dc5b-5f47-46c4-ace8-f5e891a964a0 => generated 1218 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:51:40.188842 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-45d2ee0c-4563-4452-a3d3-e1113cd02c80 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:51:40.189758 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-45d2ee0c-4563-4452-a3d3-e1113cd02c80 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] [instance: 5d54db85-b991-4890-abaa-952413baa2e7] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:51:40.201190 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-45d2ee0c-4563-4452-a3d3-e1113cd02c80 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:51:40.202140 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-45d2ee0c-4563-4452-a3d3-e1113cd02c80 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:51:40.203307 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-45d2ee0c-4563-4452-a3d3-e1113cd02c80 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:51:40.203958 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-45d2ee0c-4563-4452-a3d3-e1113cd02c80 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:51:40.339372 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-45d2ee0c-4563-4452-a3d3-e1113cd02c80 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37f21d6d15cf40a586edda211219fd08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ebb970305844dccacf48a7d8d47ecf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:51:40.348490 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-45d2ee0c-4563-4452-a3d3-e1113cd02c80 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '37f21d6d15cf40a586edda211219fd08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ebb970305844dccacf48a7d8d47ecf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:51:40.350034 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-45d2ee0c-4563-4452-a3d3-e1113cd02c80 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '37f21d6d15cf40a586edda211219fd08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ebb970305844dccacf48a7d8d47ecf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:51:40.351447 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-45d2ee0c-4563-4452-a3d3-e1113cd02c80 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] 10.222.0.11 "GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7" status: 200 len: 1803 microversion: 2.20 time: 0.168266 Nov 17 03:51:40.352019 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 1134/2463] 10.222.0.11 () {60 vars in 1276 bytes} [Wed Nov 17 03:51:40 2021] GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7 => generated 1803 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 17 03:51:41.107558 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-cf81e011-a02d-4e69-a4ec-4b01ef5fdbc0 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:51:41.108425 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-cf81e011-a02d-4e69-a4ec-4b01ef5fdbc0 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] [instance: 0698dc5b-5f47-46c4-ace8-f5e891a964a0] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:51:41.117478 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-cf81e011-a02d-4e69-a4ec-4b01ef5fdbc0 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:51:41.118104 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-cf81e011-a02d-4e69-a4ec-4b01ef5fdbc0 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:51:41.119185 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-cf81e011-a02d-4e69-a4ec-4b01ef5fdbc0 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:51:41.119791 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-cf81e011-a02d-4e69-a4ec-4b01ef5fdbc0 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:51:41.188087 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-cf81e011-a02d-4e69-a4ec-4b01ef5fdbc0 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '163b2f24a72649ac8084be1cac32fa09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e123e9b86124c93a7fc2db9984e7466', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:51:41.195598 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-cf81e011-a02d-4e69-a4ec-4b01ef5fdbc0 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] 10.222.0.11 "GET /compute/v2.1/servers/0698dc5b-5f47-46c4-ace8-f5e891a964a0" status: 200 len: 1218 microversion: 2.1 time: 0.093300 Nov 17 03:51:41.196159 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 1330/2464] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:51:41 2021] GET /compute/v2.1/servers/0698dc5b-5f47-46c4-ace8-f5e891a964a0 => generated 1218 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:51:41.374072 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-466a5454-ad57-452e-9a1e-074e5dc74dd9 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:51:41.374931 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-466a5454-ad57-452e-9a1e-074e5dc74dd9 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] [instance: 5d54db85-b991-4890-abaa-952413baa2e7] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:51:41.384366 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-466a5454-ad57-452e-9a1e-074e5dc74dd9 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:51:41.384816 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-466a5454-ad57-452e-9a1e-074e5dc74dd9 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:51:41.385621 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-466a5454-ad57-452e-9a1e-074e5dc74dd9 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:51:41.386051 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-466a5454-ad57-452e-9a1e-074e5dc74dd9 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:51:41.529655 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-466a5454-ad57-452e-9a1e-074e5dc74dd9 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37f21d6d15cf40a586edda211219fd08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ebb970305844dccacf48a7d8d47ecf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:51:41.542954 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-466a5454-ad57-452e-9a1e-074e5dc74dd9 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '37f21d6d15cf40a586edda211219fd08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ebb970305844dccacf48a7d8d47ecf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:51:41.545358 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-466a5454-ad57-452e-9a1e-074e5dc74dd9 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '37f21d6d15cf40a586edda211219fd08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ebb970305844dccacf48a7d8d47ecf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:51:41.547052 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-466a5454-ad57-452e-9a1e-074e5dc74dd9 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] 10.222.0.11 "GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7" status: 200 len: 1803 microversion: 2.20 time: 0.179007 Nov 17 03:51:41.547795 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 1135/2465] 10.222.0.11 () {60 vars in 1276 bytes} [Wed Nov 17 03:51:41 2021] GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7 => generated 1803 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 17 03:51:42.213993 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-bbd773b3-7725-4038-a42a-1a94c0fd6dba tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:51:42.214598 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-bbd773b3-7725-4038-a42a-1a94c0fd6dba tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] [instance: 0698dc5b-5f47-46c4-ace8-f5e891a964a0] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:51:42.221109 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-bbd773b3-7725-4038-a42a-1a94c0fd6dba tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:51:42.221551 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-bbd773b3-7725-4038-a42a-1a94c0fd6dba tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:51:42.222302 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-bbd773b3-7725-4038-a42a-1a94c0fd6dba tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:51:42.222730 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-bbd773b3-7725-4038-a42a-1a94c0fd6dba tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:51:42.283953 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-bbd773b3-7725-4038-a42a-1a94c0fd6dba tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '163b2f24a72649ac8084be1cac32fa09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e123e9b86124c93a7fc2db9984e7466', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:51:42.295563 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-bbd773b3-7725-4038-a42a-1a94c0fd6dba tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] 10.222.0.11 "GET /compute/v2.1/servers/0698dc5b-5f47-46c4-ace8-f5e891a964a0" status: 200 len: 1218 microversion: 2.1 time: 0.085346 Nov 17 03:51:42.296317 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 1331/2466] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:51:42 2021] GET /compute/v2.1/servers/0698dc5b-5f47-46c4-ace8-f5e891a964a0 => generated 1218 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:51:42.570506 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-31744bc6-6c6d-4f65-8c2a-521b3cc3cb16 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:51:42.571119 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-31744bc6-6c6d-4f65-8c2a-521b3cc3cb16 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] [instance: 5d54db85-b991-4890-abaa-952413baa2e7] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:51:42.577807 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-31744bc6-6c6d-4f65-8c2a-521b3cc3cb16 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:51:42.578261 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-31744bc6-6c6d-4f65-8c2a-521b3cc3cb16 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:51:42.579034 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-31744bc6-6c6d-4f65-8c2a-521b3cc3cb16 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:51:42.579442 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-31744bc6-6c6d-4f65-8c2a-521b3cc3cb16 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:51:42.727119 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-31744bc6-6c6d-4f65-8c2a-521b3cc3cb16 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37f21d6d15cf40a586edda211219fd08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ebb970305844dccacf48a7d8d47ecf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:51:42.737968 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-31744bc6-6c6d-4f65-8c2a-521b3cc3cb16 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '37f21d6d15cf40a586edda211219fd08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ebb970305844dccacf48a7d8d47ecf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:51:42.739512 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-31744bc6-6c6d-4f65-8c2a-521b3cc3cb16 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '37f21d6d15cf40a586edda211219fd08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ebb970305844dccacf48a7d8d47ecf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:51:42.740694 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-31744bc6-6c6d-4f65-8c2a-521b3cc3cb16 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] 10.222.0.11 "GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7" status: 200 len: 1803 microversion: 2.20 time: 0.175648 Nov 17 03:51:42.741306 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 1136/2467] 10.222.0.11 () {60 vars in 1276 bytes} [Wed Nov 17 03:51:42 2021] GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7 => generated 1803 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 17 03:51:43.314322 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-7c241e6c-ad99-464c-a258-4fba71e37929 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:51:43.314927 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-7c241e6c-ad99-464c-a258-4fba71e37929 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] [instance: 0698dc5b-5f47-46c4-ace8-f5e891a964a0] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:51:43.323277 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-7c241e6c-ad99-464c-a258-4fba71e37929 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:51:43.323730 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-7c241e6c-ad99-464c-a258-4fba71e37929 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:51:43.324513 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-7c241e6c-ad99-464c-a258-4fba71e37929 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:51:43.324982 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-7c241e6c-ad99-464c-a258-4fba71e37929 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:51:43.391326 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-7c241e6c-ad99-464c-a258-4fba71e37929 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '163b2f24a72649ac8084be1cac32fa09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e123e9b86124c93a7fc2db9984e7466', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:51:43.398796 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-7c241e6c-ad99-464c-a258-4fba71e37929 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] 10.222.0.11 "GET /compute/v2.1/servers/0698dc5b-5f47-46c4-ace8-f5e891a964a0" status: 200 len: 1218 microversion: 2.1 time: 0.089225 Nov 17 03:51:43.399359 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 1332/2468] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:51:43 2021] GET /compute/v2.1/servers/0698dc5b-5f47-46c4-ace8-f5e891a964a0 => generated 1218 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:51:43.765131 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-fac583e9-b142-4b80-857c-9854ccea6b13 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:51:43.766088 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-fac583e9-b142-4b80-857c-9854ccea6b13 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] [instance: 5d54db85-b991-4890-abaa-952413baa2e7] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:51:43.775096 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-fac583e9-b142-4b80-857c-9854ccea6b13 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:51:43.775535 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-fac583e9-b142-4b80-857c-9854ccea6b13 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:51:43.776299 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-fac583e9-b142-4b80-857c-9854ccea6b13 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:51:43.776728 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-fac583e9-b142-4b80-857c-9854ccea6b13 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:51:43.922461 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-fac583e9-b142-4b80-857c-9854ccea6b13 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37f21d6d15cf40a586edda211219fd08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ebb970305844dccacf48a7d8d47ecf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:51:43.931815 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-fac583e9-b142-4b80-857c-9854ccea6b13 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '37f21d6d15cf40a586edda211219fd08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ebb970305844dccacf48a7d8d47ecf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:51:43.933336 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-fac583e9-b142-4b80-857c-9854ccea6b13 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '37f21d6d15cf40a586edda211219fd08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ebb970305844dccacf48a7d8d47ecf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:51:43.934483 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-fac583e9-b142-4b80-857c-9854ccea6b13 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] 10.222.0.11 "GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7" status: 200 len: 1803 microversion: 2.20 time: 0.175569 Nov 17 03:51:43.935036 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 1137/2469] 10.222.0.11 () {60 vars in 1276 bytes} [Wed Nov 17 03:51:43 2021] GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7 => generated 1803 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 17 03:51:44.422366 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-94c325b0-8b52-4ca0-a930-cd95f35954a4 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:51:44.423257 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-94c325b0-8b52-4ca0-a930-cd95f35954a4 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] [instance: 0698dc5b-5f47-46c4-ace8-f5e891a964a0] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:51:44.434099 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-94c325b0-8b52-4ca0-a930-cd95f35954a4 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:51:44.434830 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-94c325b0-8b52-4ca0-a930-cd95f35954a4 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:51:44.436086 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-94c325b0-8b52-4ca0-a930-cd95f35954a4 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:51:44.436851 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-94c325b0-8b52-4ca0-a930-cd95f35954a4 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:51:44.500284 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-94c325b0-8b52-4ca0-a930-cd95f35954a4 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '163b2f24a72649ac8084be1cac32fa09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e123e9b86124c93a7fc2db9984e7466', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:51:44.507843 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-94c325b0-8b52-4ca0-a930-cd95f35954a4 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] 10.222.0.11 "GET /compute/v2.1/servers/0698dc5b-5f47-46c4-ace8-f5e891a964a0" status: 200 len: 1218 microversion: 2.1 time: 0.091742 Nov 17 03:51:44.508398 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 1333/2470] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:51:44 2021] GET /compute/v2.1/servers/0698dc5b-5f47-46c4-ace8-f5e891a964a0 => generated 1218 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:51:44.956694 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-44ec3b51-afc8-4a99-b075-fd703b97a7ad tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:51:44.957770 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-44ec3b51-afc8-4a99-b075-fd703b97a7ad tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] [instance: 5d54db85-b991-4890-abaa-952413baa2e7] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:51:44.968869 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-44ec3b51-afc8-4a99-b075-fd703b97a7ad tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:51:44.969662 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-44ec3b51-afc8-4a99-b075-fd703b97a7ad tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:51:44.970937 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-44ec3b51-afc8-4a99-b075-fd703b97a7ad tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:51:44.971662 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-44ec3b51-afc8-4a99-b075-fd703b97a7ad tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:51:45.105716 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-44ec3b51-afc8-4a99-b075-fd703b97a7ad tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37f21d6d15cf40a586edda211219fd08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ebb970305844dccacf48a7d8d47ecf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:51:45.119606 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-44ec3b51-afc8-4a99-b075-fd703b97a7ad tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '37f21d6d15cf40a586edda211219fd08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ebb970305844dccacf48a7d8d47ecf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:51:45.122100 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-44ec3b51-afc8-4a99-b075-fd703b97a7ad tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '37f21d6d15cf40a586edda211219fd08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ebb970305844dccacf48a7d8d47ecf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:51:45.124016 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-44ec3b51-afc8-4a99-b075-fd703b97a7ad tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] 10.222.0.11 "GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7" status: 200 len: 1803 microversion: 2.20 time: 0.173221 Nov 17 03:51:45.124949 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 1138/2471] 10.222.0.11 () {60 vars in 1276 bytes} [Wed Nov 17 03:51:44 2021] GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7 => generated 1803 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 17 03:51:45.528363 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-f2ae8621-9aa8-4aa4-8755-2634ee40aca9 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:51:45.529101 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-f2ae8621-9aa8-4aa4-8755-2634ee40aca9 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] [instance: 0698dc5b-5f47-46c4-ace8-f5e891a964a0] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:51:45.537072 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-f2ae8621-9aa8-4aa4-8755-2634ee40aca9 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:51:45.537595 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-f2ae8621-9aa8-4aa4-8755-2634ee40aca9 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:51:45.538987 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-f2ae8621-9aa8-4aa4-8755-2634ee40aca9 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:51:45.539861 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-f2ae8621-9aa8-4aa4-8755-2634ee40aca9 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:51:45.615310 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-f2ae8621-9aa8-4aa4-8755-2634ee40aca9 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '163b2f24a72649ac8084be1cac32fa09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e123e9b86124c93a7fc2db9984e7466', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:51:45.623824 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-f2ae8621-9aa8-4aa4-8755-2634ee40aca9 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] 10.222.0.11 "GET /compute/v2.1/servers/0698dc5b-5f47-46c4-ace8-f5e891a964a0" status: 200 len: 1218 microversion: 2.1 time: 0.101521 Nov 17 03:51:45.624399 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 1334/2472] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:51:45 2021] GET /compute/v2.1/servers/0698dc5b-5f47-46c4-ace8-f5e891a964a0 => generated 1218 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:51:46.145834 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-2538722b-ade5-4de6-a7f3-1f09cf64aefc tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:51:46.146396 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-2538722b-ade5-4de6-a7f3-1f09cf64aefc tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] [instance: 5d54db85-b991-4890-abaa-952413baa2e7] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:51:46.153394 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-2538722b-ade5-4de6-a7f3-1f09cf64aefc tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:51:46.153841 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-2538722b-ade5-4de6-a7f3-1f09cf64aefc tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:51:46.154599 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-2538722b-ade5-4de6-a7f3-1f09cf64aefc tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:51:46.155028 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-2538722b-ade5-4de6-a7f3-1f09cf64aefc tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:51:46.291084 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-2538722b-ade5-4de6-a7f3-1f09cf64aefc tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37f21d6d15cf40a586edda211219fd08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ebb970305844dccacf48a7d8d47ecf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:51:46.304352 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-2538722b-ade5-4de6-a7f3-1f09cf64aefc tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '37f21d6d15cf40a586edda211219fd08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ebb970305844dccacf48a7d8d47ecf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:51:46.305860 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-2538722b-ade5-4de6-a7f3-1f09cf64aefc tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '37f21d6d15cf40a586edda211219fd08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ebb970305844dccacf48a7d8d47ecf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:51:46.306998 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-2538722b-ade5-4de6-a7f3-1f09cf64aefc tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] 10.222.0.11 "GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7" status: 200 len: 1803 microversion: 2.20 time: 0.165043 Nov 17 03:51:46.307554 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 1139/2473] 10.222.0.11 () {60 vars in 1276 bytes} [Wed Nov 17 03:51:46 2021] GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7 => generated 1803 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 17 03:51:46.645098 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-0d8df95e-cb2e-452b-ad19-611d7e329439 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:51:46.646158 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-0d8df95e-cb2e-452b-ad19-611d7e329439 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] [instance: 0698dc5b-5f47-46c4-ace8-f5e891a964a0] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:51:46.657903 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-0d8df95e-cb2e-452b-ad19-611d7e329439 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:51:46.658641 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-0d8df95e-cb2e-452b-ad19-611d7e329439 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:51:46.659912 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-0d8df95e-cb2e-452b-ad19-611d7e329439 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:51:46.660650 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-0d8df95e-cb2e-452b-ad19-611d7e329439 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:51:46.726612 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-0d8df95e-cb2e-452b-ad19-611d7e329439 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '163b2f24a72649ac8084be1cac32fa09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e123e9b86124c93a7fc2db9984e7466', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:51:46.737701 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-0d8df95e-cb2e-452b-ad19-611d7e329439 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] 10.222.0.11 "GET /compute/v2.1/servers/0698dc5b-5f47-46c4-ace8-f5e891a964a0" status: 200 len: 1218 microversion: 2.1 time: 0.098487 Nov 17 03:51:46.738553 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 1335/2474] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:51:46 2021] GET /compute/v2.1/servers/0698dc5b-5f47-46c4-ace8-f5e891a964a0 => generated 1218 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:51:47.329277 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-fa8b96b9-14d1-4f78-b3a0-f1cf3fb271a9 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:51:47.330131 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-fa8b96b9-14d1-4f78-b3a0-f1cf3fb271a9 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] [instance: 5d54db85-b991-4890-abaa-952413baa2e7] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:51:47.339792 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-fa8b96b9-14d1-4f78-b3a0-f1cf3fb271a9 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:51:47.340238 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-fa8b96b9-14d1-4f78-b3a0-f1cf3fb271a9 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:51:47.341037 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-fa8b96b9-14d1-4f78-b3a0-f1cf3fb271a9 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:51:47.341465 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-fa8b96b9-14d1-4f78-b3a0-f1cf3fb271a9 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:51:47.490458 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-fa8b96b9-14d1-4f78-b3a0-f1cf3fb271a9 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37f21d6d15cf40a586edda211219fd08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ebb970305844dccacf48a7d8d47ecf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:51:47.503863 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-fa8b96b9-14d1-4f78-b3a0-f1cf3fb271a9 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '37f21d6d15cf40a586edda211219fd08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ebb970305844dccacf48a7d8d47ecf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:51:47.506358 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-fa8b96b9-14d1-4f78-b3a0-f1cf3fb271a9 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '37f21d6d15cf40a586edda211219fd08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ebb970305844dccacf48a7d8d47ecf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:51:47.508395 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-fa8b96b9-14d1-4f78-b3a0-f1cf3fb271a9 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] 10.222.0.11 "GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7" status: 200 len: 1803 microversion: 2.20 time: 0.185151 Nov 17 03:51:47.509100 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 1140/2475] 10.222.0.11 () {60 vars in 1276 bytes} [Wed Nov 17 03:51:47 2021] GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7 => generated 1803 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 17 03:51:47.758036 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-f33357eb-3cb6-4eec-8f24-f4058a257714 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:51:47.759257 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-f33357eb-3cb6-4eec-8f24-f4058a257714 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] [instance: 0698dc5b-5f47-46c4-ace8-f5e891a964a0] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:51:47.765951 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-f33357eb-3cb6-4eec-8f24-f4058a257714 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:51:47.766397 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-f33357eb-3cb6-4eec-8f24-f4058a257714 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:51:47.767164 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-f33357eb-3cb6-4eec-8f24-f4058a257714 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:51:47.767594 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-f33357eb-3cb6-4eec-8f24-f4058a257714 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:51:47.828806 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-f33357eb-3cb6-4eec-8f24-f4058a257714 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '163b2f24a72649ac8084be1cac32fa09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e123e9b86124c93a7fc2db9984e7466', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:51:47.837575 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-f33357eb-3cb6-4eec-8f24-f4058a257714 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] 10.222.0.11 "GET /compute/v2.1/servers/0698dc5b-5f47-46c4-ace8-f5e891a964a0" status: 200 len: 1218 microversion: 2.1 time: 0.085651 Nov 17 03:51:47.838149 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 1336/2476] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:51:47 2021] GET /compute/v2.1/servers/0698dc5b-5f47-46c4-ace8-f5e891a964a0 => generated 1218 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:51:48.531423 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-12193d03-629e-4801-992a-7156e8cb1203 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:51:48.532390 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-12193d03-629e-4801-992a-7156e8cb1203 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] [instance: 5d54db85-b991-4890-abaa-952413baa2e7] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:51:48.541918 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-12193d03-629e-4801-992a-7156e8cb1203 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:51:48.542362 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-12193d03-629e-4801-992a-7156e8cb1203 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:51:48.543116 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-12193d03-629e-4801-992a-7156e8cb1203 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:51:48.543537 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-12193d03-629e-4801-992a-7156e8cb1203 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:51:48.684765 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-12193d03-629e-4801-992a-7156e8cb1203 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37f21d6d15cf40a586edda211219fd08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ebb970305844dccacf48a7d8d47ecf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:51:48.693096 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-12193d03-629e-4801-992a-7156e8cb1203 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '37f21d6d15cf40a586edda211219fd08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ebb970305844dccacf48a7d8d47ecf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:51:48.694569 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-12193d03-629e-4801-992a-7156e8cb1203 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '37f21d6d15cf40a586edda211219fd08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ebb970305844dccacf48a7d8d47ecf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:51:48.695686 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-12193d03-629e-4801-992a-7156e8cb1203 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] 10.222.0.11 "GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7" status: 200 len: 1803 microversion: 2.20 time: 0.170625 Nov 17 03:51:48.696264 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 1141/2477] 10.222.0.11 () {60 vars in 1276 bytes} [Wed Nov 17 03:51:48 2021] GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7 => generated 1803 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 17 03:51:48.858219 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-afaf77b1-402d-4197-a6af-81140eac4b0e tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:51:48.859111 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-afaf77b1-402d-4197-a6af-81140eac4b0e tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] [instance: 0698dc5b-5f47-46c4-ace8-f5e891a964a0] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:51:48.869239 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-afaf77b1-402d-4197-a6af-81140eac4b0e tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:51:48.869687 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-afaf77b1-402d-4197-a6af-81140eac4b0e tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:51:48.870456 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-afaf77b1-402d-4197-a6af-81140eac4b0e tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:51:48.870883 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-afaf77b1-402d-4197-a6af-81140eac4b0e tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:51:48.941084 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-afaf77b1-402d-4197-a6af-81140eac4b0e tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '163b2f24a72649ac8084be1cac32fa09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e123e9b86124c93a7fc2db9984e7466', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:51:48.949817 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-afaf77b1-402d-4197-a6af-81140eac4b0e tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] 10.222.0.11 "GET /compute/v2.1/servers/0698dc5b-5f47-46c4-ace8-f5e891a964a0" status: 200 len: 1218 microversion: 2.1 time: 0.097880 Nov 17 03:51:48.950388 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 1337/2478] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:51:48 2021] GET /compute/v2.1/servers/0698dc5b-5f47-46c4-ace8-f5e891a964a0 => generated 1218 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:51:49.718062 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-570775f0-41d7-4865-9da5-284ab4f11a1b tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:51:49.718995 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-570775f0-41d7-4865-9da5-284ab4f11a1b tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] [instance: 5d54db85-b991-4890-abaa-952413baa2e7] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:51:49.728712 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-570775f0-41d7-4865-9da5-284ab4f11a1b tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:51:49.729191 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-570775f0-41d7-4865-9da5-284ab4f11a1b tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:51:49.729960 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-570775f0-41d7-4865-9da5-284ab4f11a1b tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:51:49.730392 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-570775f0-41d7-4865-9da5-284ab4f11a1b tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:51:49.878734 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-570775f0-41d7-4865-9da5-284ab4f11a1b tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37f21d6d15cf40a586edda211219fd08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ebb970305844dccacf48a7d8d47ecf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:51:49.887225 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-570775f0-41d7-4865-9da5-284ab4f11a1b tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '37f21d6d15cf40a586edda211219fd08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ebb970305844dccacf48a7d8d47ecf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:51:49.888689 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-570775f0-41d7-4865-9da5-284ab4f11a1b tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '37f21d6d15cf40a586edda211219fd08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ebb970305844dccacf48a7d8d47ecf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:51:49.889885 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-570775f0-41d7-4865-9da5-284ab4f11a1b tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] 10.222.0.11 "GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7" status: 200 len: 1803 microversion: 2.20 time: 0.178103 Nov 17 03:51:49.890450 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 1142/2479] 10.222.0.11 () {60 vars in 1276 bytes} [Wed Nov 17 03:51:49 2021] GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7 => generated 1803 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 17 03:51:49.970625 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-6fc34fe7-eb82-4419-afb5-e278052b723f tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:51:49.971576 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-6fc34fe7-eb82-4419-afb5-e278052b723f tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] [instance: 0698dc5b-5f47-46c4-ace8-f5e891a964a0] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:51:49.980509 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-6fc34fe7-eb82-4419-afb5-e278052b723f tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:51:49.981008 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-6fc34fe7-eb82-4419-afb5-e278052b723f tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:51:49.981783 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-6fc34fe7-eb82-4419-afb5-e278052b723f tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:51:49.982216 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-6fc34fe7-eb82-4419-afb5-e278052b723f tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:51:50.049307 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-6fc34fe7-eb82-4419-afb5-e278052b723f tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '163b2f24a72649ac8084be1cac32fa09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e123e9b86124c93a7fc2db9984e7466', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:51:50.057316 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-6fc34fe7-eb82-4419-afb5-e278052b723f tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] 10.222.0.11 "GET /compute/v2.1/servers/0698dc5b-5f47-46c4-ace8-f5e891a964a0" status: 200 len: 1218 microversion: 2.1 time: 0.093084 Nov 17 03:51:50.057889 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 1338/2480] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:51:49 2021] GET /compute/v2.1/servers/0698dc5b-5f47-46c4-ace8-f5e891a964a0 => generated 1218 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:51:50.912325 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-0bacbf41-9d93-4292-bade-296a5941bff3 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:51:50.913381 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-0bacbf41-9d93-4292-bade-296a5941bff3 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] [instance: 5d54db85-b991-4890-abaa-952413baa2e7] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:51:50.924295 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-0bacbf41-9d93-4292-bade-296a5941bff3 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:51:50.925107 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-0bacbf41-9d93-4292-bade-296a5941bff3 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:51:50.926371 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-0bacbf41-9d93-4292-bade-296a5941bff3 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:51:50.927416 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-0bacbf41-9d93-4292-bade-296a5941bff3 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:51:51.068299 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-0bacbf41-9d93-4292-bade-296a5941bff3 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37f21d6d15cf40a586edda211219fd08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ebb970305844dccacf48a7d8d47ecf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:51:51.076531 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-b63933b0-46ef-437e-9322-4067b71b38f7 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:51:51.077156 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-b63933b0-46ef-437e-9322-4067b71b38f7 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] [instance: 0698dc5b-5f47-46c4-ace8-f5e891a964a0] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:51:51.078199 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-0bacbf41-9d93-4292-bade-296a5941bff3 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '37f21d6d15cf40a586edda211219fd08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ebb970305844dccacf48a7d8d47ecf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:51:51.079838 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-0bacbf41-9d93-4292-bade-296a5941bff3 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '37f21d6d15cf40a586edda211219fd08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ebb970305844dccacf48a7d8d47ecf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:51:51.081046 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-0bacbf41-9d93-4292-bade-296a5941bff3 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] 10.222.0.11 "GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7" status: 200 len: 1803 microversion: 2.20 time: 0.174971 Nov 17 03:51:51.081582 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 1143/2481] 10.222.0.11 () {60 vars in 1276 bytes} [Wed Nov 17 03:51:50 2021] GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7 => generated 1803 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 17 03:51:51.083585 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-b63933b0-46ef-437e-9322-4067b71b38f7 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:51:51.084025 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-b63933b0-46ef-437e-9322-4067b71b38f7 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:51:51.084818 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-b63933b0-46ef-437e-9322-4067b71b38f7 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:51:51.085230 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-b63933b0-46ef-437e-9322-4067b71b38f7 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:51:51.152962 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-b63933b0-46ef-437e-9322-4067b71b38f7 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '163b2f24a72649ac8084be1cac32fa09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e123e9b86124c93a7fc2db9984e7466', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:51:51.164444 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-b63933b0-46ef-437e-9322-4067b71b38f7 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] 10.222.0.11 "GET /compute/v2.1/servers/0698dc5b-5f47-46c4-ace8-f5e891a964a0" status: 200 len: 1218 microversion: 2.1 time: 0.091100 Nov 17 03:51:51.165330 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 1339/2482] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:51:51 2021] GET /compute/v2.1/servers/0698dc5b-5f47-46c4-ace8-f5e891a964a0 => generated 1218 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 17 03:51:52.103109 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-2429530c-0690-412b-bf07-4c8c48ca700a tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:51:52.103722 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-2429530c-0690-412b-bf07-4c8c48ca700a tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] [instance: 5d54db85-b991-4890-abaa-952413baa2e7] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:51:52.110365 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-2429530c-0690-412b-bf07-4c8c48ca700a tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:51:52.110844 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-2429530c-0690-412b-bf07-4c8c48ca700a tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:51:52.111614 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-2429530c-0690-412b-bf07-4c8c48ca700a tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:51:52.112044 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-2429530c-0690-412b-bf07-4c8c48ca700a tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:51:52.187659 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-2397c3a4-471a-45b1-b5fb-a838ff243199 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:51:52.188274 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-2397c3a4-471a-45b1-b5fb-a838ff243199 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] [instance: 0698dc5b-5f47-46c4-ace8-f5e891a964a0] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:51:52.194526 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-2397c3a4-471a-45b1-b5fb-a838ff243199 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:51:52.194977 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-2397c3a4-471a-45b1-b5fb-a838ff243199 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:51:52.195870 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-2397c3a4-471a-45b1-b5fb-a838ff243199 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:51:52.196331 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-2397c3a4-471a-45b1-b5fb-a838ff243199 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:51:52.252230 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-2429530c-0690-412b-bf07-4c8c48ca700a tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37f21d6d15cf40a586edda211219fd08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ebb970305844dccacf48a7d8d47ecf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:51:52.259333 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-2397c3a4-471a-45b1-b5fb-a838ff243199 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '163b2f24a72649ac8084be1cac32fa09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e123e9b86124c93a7fc2db9984e7466', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:51:52.261236 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-2429530c-0690-412b-bf07-4c8c48ca700a tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '37f21d6d15cf40a586edda211219fd08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ebb970305844dccacf48a7d8d47ecf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:51:52.262737 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-2429530c-0690-412b-bf07-4c8c48ca700a tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '37f21d6d15cf40a586edda211219fd08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ebb970305844dccacf48a7d8d47ecf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:51:52.263903 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-2429530c-0690-412b-bf07-4c8c48ca700a tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] 10.222.0.11 "GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7" status: 200 len: 1803 microversion: 2.20 time: 0.167065 Nov 17 03:51:52.264478 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 1144/2483] 10.222.0.11 () {60 vars in 1276 bytes} [Wed Nov 17 03:51:52 2021] GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7 => generated 1803 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 17 03:51:52.266910 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-2397c3a4-471a-45b1-b5fb-a838ff243199 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] 10.222.0.11 "GET /compute/v2.1/servers/0698dc5b-5f47-46c4-ace8-f5e891a964a0" status: 200 len: 1218 microversion: 2.1 time: 0.084005 Nov 17 03:51:52.267463 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 1340/2484] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:51:52 2021] GET /compute/v2.1/servers/0698dc5b-5f47-46c4-ace8-f5e891a964a0 => generated 1218 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:51:53.286083 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-7ff0f91b-a93e-459b-97ff-28282c14495c tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:51:53.286933 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-b7ab182a-6ced-40e8-bffa-8d32280afd55 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:51:53.287558 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-7ff0f91b-a93e-459b-97ff-28282c14495c tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] [instance: 5d54db85-b991-4890-abaa-952413baa2e7] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:51:53.287754 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-b7ab182a-6ced-40e8-bffa-8d32280afd55 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] [instance: 0698dc5b-5f47-46c4-ace8-f5e891a964a0] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:51:53.297956 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-7ff0f91b-a93e-459b-97ff-28282c14495c tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:51:53.298638 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-b7ab182a-6ced-40e8-bffa-8d32280afd55 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:51:53.298882 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-7ff0f91b-a93e-459b-97ff-28282c14495c tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:51:53.299385 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-b7ab182a-6ced-40e8-bffa-8d32280afd55 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:51:53.299943 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-7ff0f91b-a93e-459b-97ff-28282c14495c tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:51:53.300645 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-b7ab182a-6ced-40e8-bffa-8d32280afd55 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:51:53.300952 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-7ff0f91b-a93e-459b-97ff-28282c14495c tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:51:53.301450 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-b7ab182a-6ced-40e8-bffa-8d32280afd55 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:51:53.362726 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-b7ab182a-6ced-40e8-bffa-8d32280afd55 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '163b2f24a72649ac8084be1cac32fa09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e123e9b86124c93a7fc2db9984e7466', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:51:53.370313 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-b7ab182a-6ced-40e8-bffa-8d32280afd55 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] 10.222.0.11 "GET /compute/v2.1/servers/0698dc5b-5f47-46c4-ace8-f5e891a964a0" status: 200 len: 1218 microversion: 2.1 time: 0.089841 Nov 17 03:51:53.371093 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 1341/2485] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:51:53 2021] GET /compute/v2.1/servers/0698dc5b-5f47-46c4-ace8-f5e891a964a0 => generated 1218 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:51:53.439157 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-7ff0f91b-a93e-459b-97ff-28282c14495c tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37f21d6d15cf40a586edda211219fd08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ebb970305844dccacf48a7d8d47ecf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:51:53.447774 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-7ff0f91b-a93e-459b-97ff-28282c14495c tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '37f21d6d15cf40a586edda211219fd08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ebb970305844dccacf48a7d8d47ecf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:51:53.449274 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-7ff0f91b-a93e-459b-97ff-28282c14495c tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '37f21d6d15cf40a586edda211219fd08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ebb970305844dccacf48a7d8d47ecf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:51:53.450405 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-7ff0f91b-a93e-459b-97ff-28282c14495c tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] 10.222.0.11 "GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7" status: 200 len: 1803 microversion: 2.20 time: 0.170491 Nov 17 03:51:53.450957 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 1145/2486] 10.222.0.11 () {60 vars in 1276 bytes} [Wed Nov 17 03:51:53 2021] GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7 => generated 1803 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 17 03:51:54.442391 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-a1744c62-4d66-44e0-8c9c-e1d6cd939799 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:51:54.443283 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-a1744c62-4d66-44e0-8c9c-e1d6cd939799 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] [instance: 0698dc5b-5f47-46c4-ace8-f5e891a964a0] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:51:54.450526 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-a1744c62-4d66-44e0-8c9c-e1d6cd939799 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:51:54.450977 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-a1744c62-4d66-44e0-8c9c-e1d6cd939799 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:51:54.451742 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-a1744c62-4d66-44e0-8c9c-e1d6cd939799 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:51:54.452175 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-a1744c62-4d66-44e0-8c9c-e1d6cd939799 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:51:54.468680 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-681e351f-bf6f-4b61-80c7-06db91e34c11 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:51:54.469323 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-681e351f-bf6f-4b61-80c7-06db91e34c11 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] [instance: 5d54db85-b991-4890-abaa-952413baa2e7] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:51:54.475775 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-681e351f-bf6f-4b61-80c7-06db91e34c11 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:51:54.476221 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-681e351f-bf6f-4b61-80c7-06db91e34c11 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:51:54.477232 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-681e351f-bf6f-4b61-80c7-06db91e34c11 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:51:54.477999 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-681e351f-bf6f-4b61-80c7-06db91e34c11 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:51:54.512265 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-a1744c62-4d66-44e0-8c9c-e1d6cd939799 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '163b2f24a72649ac8084be1cac32fa09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e123e9b86124c93a7fc2db9984e7466', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:51:54.520054 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-a1744c62-4d66-44e0-8c9c-e1d6cd939799 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] 10.222.0.11 "GET /compute/v2.1/servers/0698dc5b-5f47-46c4-ace8-f5e891a964a0" status: 200 len: 1218 microversion: 2.1 time: 0.084109 Nov 17 03:51:54.520667 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 1342/2487] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:51:54 2021] GET /compute/v2.1/servers/0698dc5b-5f47-46c4-ace8-f5e891a964a0 => generated 1218 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:51:54.612838 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-681e351f-bf6f-4b61-80c7-06db91e34c11 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37f21d6d15cf40a586edda211219fd08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ebb970305844dccacf48a7d8d47ecf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:51:54.621142 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-681e351f-bf6f-4b61-80c7-06db91e34c11 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '37f21d6d15cf40a586edda211219fd08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ebb970305844dccacf48a7d8d47ecf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:51:54.622615 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-681e351f-bf6f-4b61-80c7-06db91e34c11 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '37f21d6d15cf40a586edda211219fd08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ebb970305844dccacf48a7d8d47ecf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:51:54.623761 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-681e351f-bf6f-4b61-80c7-06db91e34c11 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] 10.222.0.11 "GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7" status: 200 len: 1803 microversion: 2.20 time: 0.158742 Nov 17 03:51:54.624316 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 1146/2488] 10.222.0.11 () {60 vars in 1276 bytes} [Wed Nov 17 03:51:54 2021] GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7 => generated 1803 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 17 03:51:55.537784 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-08cd92aa-990d-429c-a6ef-0901e8aa8c40 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:51:55.538387 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-08cd92aa-990d-429c-a6ef-0901e8aa8c40 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] [instance: 0698dc5b-5f47-46c4-ace8-f5e891a964a0] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:51:55.545906 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-08cd92aa-990d-429c-a6ef-0901e8aa8c40 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:51:55.546568 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-08cd92aa-990d-429c-a6ef-0901e8aa8c40 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:51:55.547858 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-08cd92aa-990d-429c-a6ef-0901e8aa8c40 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:51:55.548437 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-08cd92aa-990d-429c-a6ef-0901e8aa8c40 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:51:55.613381 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-08cd92aa-990d-429c-a6ef-0901e8aa8c40 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '163b2f24a72649ac8084be1cac32fa09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e123e9b86124c93a7fc2db9984e7466', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:51:55.621709 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-08cd92aa-990d-429c-a6ef-0901e8aa8c40 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] 10.222.0.11 "GET /compute/v2.1/servers/0698dc5b-5f47-46c4-ace8-f5e891a964a0" status: 200 len: 1218 microversion: 2.1 time: 0.088474 Nov 17 03:51:55.622255 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 1343/2489] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:51:55 2021] GET /compute/v2.1/servers/0698dc5b-5f47-46c4-ace8-f5e891a964a0 => generated 1218 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:51:55.642577 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-e823ade5-60b7-47a3-a8f8-529113609083 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:51:55.643148 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-e823ade5-60b7-47a3-a8f8-529113609083 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] [instance: 5d54db85-b991-4890-abaa-952413baa2e7] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:51:55.650346 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-e823ade5-60b7-47a3-a8f8-529113609083 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:51:55.650796 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-e823ade5-60b7-47a3-a8f8-529113609083 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:51:55.651568 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-e823ade5-60b7-47a3-a8f8-529113609083 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:51:55.652002 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-e823ade5-60b7-47a3-a8f8-529113609083 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:51:55.789425 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-e823ade5-60b7-47a3-a8f8-529113609083 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37f21d6d15cf40a586edda211219fd08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ebb970305844dccacf48a7d8d47ecf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:51:55.798106 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-e823ade5-60b7-47a3-a8f8-529113609083 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '37f21d6d15cf40a586edda211219fd08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ebb970305844dccacf48a7d8d47ecf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:51:55.799602 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-e823ade5-60b7-47a3-a8f8-529113609083 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '37f21d6d15cf40a586edda211219fd08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ebb970305844dccacf48a7d8d47ecf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:51:55.800754 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-e823ade5-60b7-47a3-a8f8-529113609083 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] 10.222.0.11 "GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7" status: 200 len: 1803 microversion: 2.20 time: 0.161906 Nov 17 03:51:55.801345 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 1147/2490] 10.222.0.11 () {60 vars in 1276 bytes} [Wed Nov 17 03:51:55 2021] GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7 => generated 1803 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 17 03:51:56.642602 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-55de3813-0adc-4dec-99cd-f458b76b1037 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:51:56.643680 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-55de3813-0adc-4dec-99cd-f458b76b1037 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] [instance: 0698dc5b-5f47-46c4-ace8-f5e891a964a0] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:51:56.654427 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-55de3813-0adc-4dec-99cd-f458b76b1037 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:51:56.655197 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-55de3813-0adc-4dec-99cd-f458b76b1037 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:51:56.656477 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-55de3813-0adc-4dec-99cd-f458b76b1037 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:51:56.657265 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-55de3813-0adc-4dec-99cd-f458b76b1037 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:51:56.720801 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-55de3813-0adc-4dec-99cd-f458b76b1037 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '163b2f24a72649ac8084be1cac32fa09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e123e9b86124c93a7fc2db9984e7466', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:51:56.729039 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-55de3813-0adc-4dec-99cd-f458b76b1037 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] 10.222.0.11 "GET /compute/v2.1/servers/0698dc5b-5f47-46c4-ace8-f5e891a964a0" status: 200 len: 1218 microversion: 2.1 time: 0.092526 Nov 17 03:51:56.729601 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 1344/2491] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:51:56 2021] GET /compute/v2.1/servers/0698dc5b-5f47-46c4-ace8-f5e891a964a0 => generated 1218 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:51:56.823365 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-f2249f77-9a47-419f-996b-e401b05b8153 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:51:56.824394 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-f2249f77-9a47-419f-996b-e401b05b8153 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] [instance: 5d54db85-b991-4890-abaa-952413baa2e7] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:51:56.835047 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-f2249f77-9a47-419f-996b-e401b05b8153 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:51:56.835792 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-f2249f77-9a47-419f-996b-e401b05b8153 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:51:56.837106 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-f2249f77-9a47-419f-996b-e401b05b8153 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:51:56.837630 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-f2249f77-9a47-419f-996b-e401b05b8153 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:51:56.979043 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-f2249f77-9a47-419f-996b-e401b05b8153 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37f21d6d15cf40a586edda211219fd08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ebb970305844dccacf48a7d8d47ecf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:51:56.988062 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-f2249f77-9a47-419f-996b-e401b05b8153 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '37f21d6d15cf40a586edda211219fd08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ebb970305844dccacf48a7d8d47ecf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:51:56.989651 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-f2249f77-9a47-419f-996b-e401b05b8153 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '37f21d6d15cf40a586edda211219fd08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ebb970305844dccacf48a7d8d47ecf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:51:56.990813 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-f2249f77-9a47-419f-996b-e401b05b8153 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] 10.222.0.11 "GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7" status: 200 len: 1803 microversion: 2.20 time: 0.173792 Nov 17 03:51:56.991378 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 1148/2492] 10.222.0.11 () {60 vars in 1276 bytes} [Wed Nov 17 03:51:56 2021] GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7 => generated 1803 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 17 03:51:57.747387 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-5ed0a820-5258-44c3-b962-0d3e5205ab61 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:51:57.748102 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-5ed0a820-5258-44c3-b962-0d3e5205ab61 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] [instance: 0698dc5b-5f47-46c4-ace8-f5e891a964a0] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:51:57.755885 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-5ed0a820-5258-44c3-b962-0d3e5205ab61 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:51:57.756401 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-5ed0a820-5258-44c3-b962-0d3e5205ab61 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:51:57.757346 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-5ed0a820-5258-44c3-b962-0d3e5205ab61 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:51:57.757850 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-5ed0a820-5258-44c3-b962-0d3e5205ab61 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:51:57.822593 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-5ed0a820-5258-44c3-b962-0d3e5205ab61 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '163b2f24a72649ac8084be1cac32fa09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e123e9b86124c93a7fc2db9984e7466', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:51:57.830220 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-5ed0a820-5258-44c3-b962-0d3e5205ab61 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] 10.222.0.11 "GET /compute/v2.1/servers/0698dc5b-5f47-46c4-ace8-f5e891a964a0" status: 200 len: 1218 microversion: 2.1 time: 0.087290 Nov 17 03:51:57.830818 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 1345/2493] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:51:57 2021] GET /compute/v2.1/servers/0698dc5b-5f47-46c4-ace8-f5e891a964a0 => generated 1218 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:51:58.010108 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-16214c4c-1223-4d1e-82f5-44b4da6939ae tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:51:58.010704 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-16214c4c-1223-4d1e-82f5-44b4da6939ae tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] [instance: 5d54db85-b991-4890-abaa-952413baa2e7] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:51:58.017244 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-16214c4c-1223-4d1e-82f5-44b4da6939ae tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:51:58.017684 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-16214c4c-1223-4d1e-82f5-44b4da6939ae tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:51:58.018437 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-16214c4c-1223-4d1e-82f5-44b4da6939ae tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:51:58.018860 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-16214c4c-1223-4d1e-82f5-44b4da6939ae tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:51:58.383056 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-16214c4c-1223-4d1e-82f5-44b4da6939ae tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37f21d6d15cf40a586edda211219fd08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ebb970305844dccacf48a7d8d47ecf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:51:58.391619 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-16214c4c-1223-4d1e-82f5-44b4da6939ae tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '37f21d6d15cf40a586edda211219fd08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ebb970305844dccacf48a7d8d47ecf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:51:58.393133 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-16214c4c-1223-4d1e-82f5-44b4da6939ae tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '37f21d6d15cf40a586edda211219fd08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ebb970305844dccacf48a7d8d47ecf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:51:58.394278 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-16214c4c-1223-4d1e-82f5-44b4da6939ae tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] 10.222.0.11 "GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7" status: 200 len: 1803 microversion: 2.20 time: 0.387927 Nov 17 03:51:58.394836 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 1149/2494] 10.222.0.11 () {60 vars in 1276 bytes} [Wed Nov 17 03:51:58 2021] GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7 => generated 1803 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 17 03:51:58.847931 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-1b9e1905-0950-4030-90b5-95391d31ba70 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:51:58.848598 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-1b9e1905-0950-4030-90b5-95391d31ba70 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] [instance: 0698dc5b-5f47-46c4-ace8-f5e891a964a0] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:51:58.855710 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-1b9e1905-0950-4030-90b5-95391d31ba70 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:51:58.856153 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-1b9e1905-0950-4030-90b5-95391d31ba70 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:51:58.856953 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-1b9e1905-0950-4030-90b5-95391d31ba70 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:51:58.857380 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-1b9e1905-0950-4030-90b5-95391d31ba70 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:51:58.920266 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-1b9e1905-0950-4030-90b5-95391d31ba70 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '163b2f24a72649ac8084be1cac32fa09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e123e9b86124c93a7fc2db9984e7466', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:51:58.927896 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-1b9e1905-0950-4030-90b5-95391d31ba70 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] 10.222.0.11 "GET /compute/v2.1/servers/0698dc5b-5f47-46c4-ace8-f5e891a964a0" status: 200 len: 1218 microversion: 2.1 time: 0.084175 Nov 17 03:51:58.928452 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 1346/2495] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:51:58 2021] GET /compute/v2.1/servers/0698dc5b-5f47-46c4-ace8-f5e891a964a0 => generated 1218 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:51:59.416917 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-d462d1f0-461a-4c82-abb7-b66127961d82 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:51:59.417600 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-d462d1f0-461a-4c82-abb7-b66127961d82 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] [instance: 5d54db85-b991-4890-abaa-952413baa2e7] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:51:59.424259 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-d462d1f0-461a-4c82-abb7-b66127961d82 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:51:59.424702 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-d462d1f0-461a-4c82-abb7-b66127961d82 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:51:59.425499 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-d462d1f0-461a-4c82-abb7-b66127961d82 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:51:59.425934 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-d462d1f0-461a-4c82-abb7-b66127961d82 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:51:59.556363 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-d462d1f0-461a-4c82-abb7-b66127961d82 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37f21d6d15cf40a586edda211219fd08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ebb970305844dccacf48a7d8d47ecf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:51:59.564716 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-d462d1f0-461a-4c82-abb7-b66127961d82 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '37f21d6d15cf40a586edda211219fd08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ebb970305844dccacf48a7d8d47ecf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:51:59.566227 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-d462d1f0-461a-4c82-abb7-b66127961d82 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '37f21d6d15cf40a586edda211219fd08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ebb970305844dccacf48a7d8d47ecf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:51:59.567369 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-d462d1f0-461a-4c82-abb7-b66127961d82 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] 10.222.0.11 "GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7" status: 200 len: 1803 microversion: 2.20 time: 0.156977 Nov 17 03:51:59.567924 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 1150/2496] 10.222.0.11 () {60 vars in 1276 bytes} [Wed Nov 17 03:51:59 2021] GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7 => generated 1803 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 17 03:51:59.948186 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-28dc6db2-6e21-48a2-886a-d4669767bd85 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:51:59.949190 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-28dc6db2-6e21-48a2-886a-d4669767bd85 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] [instance: 0698dc5b-5f47-46c4-ace8-f5e891a964a0] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:51:59.959677 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-28dc6db2-6e21-48a2-886a-d4669767bd85 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:51:59.960417 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-28dc6db2-6e21-48a2-886a-d4669767bd85 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:51:59.961740 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-28dc6db2-6e21-48a2-886a-d4669767bd85 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:51:59.962448 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-28dc6db2-6e21-48a2-886a-d4669767bd85 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:52:00.025415 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-28dc6db2-6e21-48a2-886a-d4669767bd85 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '163b2f24a72649ac8084be1cac32fa09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e123e9b86124c93a7fc2db9984e7466', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:52:00.034062 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-28dc6db2-6e21-48a2-886a-d4669767bd85 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] 10.222.0.11 "GET /compute/v2.1/servers/0698dc5b-5f47-46c4-ace8-f5e891a964a0" status: 200 len: 1218 microversion: 2.1 time: 0.092008 Nov 17 03:52:00.034659 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 1347/2497] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:51:59 2021] GET /compute/v2.1/servers/0698dc5b-5f47-46c4-ace8-f5e891a964a0 => generated 1218 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:52:00.591436 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-c9eaee6b-69ea-450c-89ba-a7fad4757117 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:52:00.592261 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-c9eaee6b-69ea-450c-89ba-a7fad4757117 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] [instance: 5d54db85-b991-4890-abaa-952413baa2e7] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:52:00.600758 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-c9eaee6b-69ea-450c-89ba-a7fad4757117 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:52:00.601398 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-c9eaee6b-69ea-450c-89ba-a7fad4757117 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:52:00.602403 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-c9eaee6b-69ea-450c-89ba-a7fad4757117 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:52:00.602966 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-c9eaee6b-69ea-450c-89ba-a7fad4757117 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:52:00.751240 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-c9eaee6b-69ea-450c-89ba-a7fad4757117 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37f21d6d15cf40a586edda211219fd08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ebb970305844dccacf48a7d8d47ecf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:52:00.763929 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-c9eaee6b-69ea-450c-89ba-a7fad4757117 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '37f21d6d15cf40a586edda211219fd08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ebb970305844dccacf48a7d8d47ecf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:52:00.766296 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-c9eaee6b-69ea-450c-89ba-a7fad4757117 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '37f21d6d15cf40a586edda211219fd08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ebb970305844dccacf48a7d8d47ecf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:52:00.768050 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-c9eaee6b-69ea-450c-89ba-a7fad4757117 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] 10.222.0.11 "GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7" status: 200 len: 1803 microversion: 2.20 time: 0.182380 Nov 17 03:52:00.768804 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 1151/2498] 10.222.0.11 () {60 vars in 1276 bytes} [Wed Nov 17 03:52:00 2021] GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7 => generated 1803 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 17 03:52:01.055399 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-5363e43a-36ce-4cc3-9537-add7669ed9f7 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:52:01.057361 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-5363e43a-36ce-4cc3-9537-add7669ed9f7 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] [instance: 0698dc5b-5f47-46c4-ace8-f5e891a964a0] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:52:01.069057 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-5363e43a-36ce-4cc3-9537-add7669ed9f7 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:52:01.069858 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-5363e43a-36ce-4cc3-9537-add7669ed9f7 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:52:01.071120 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-5363e43a-36ce-4cc3-9537-add7669ed9f7 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:52:01.071851 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-5363e43a-36ce-4cc3-9537-add7669ed9f7 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:52:01.131644 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-5363e43a-36ce-4cc3-9537-add7669ed9f7 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '163b2f24a72649ac8084be1cac32fa09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e123e9b86124c93a7fc2db9984e7466', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:52:01.139659 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-5363e43a-36ce-4cc3-9537-add7669ed9f7 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] 10.222.0.11 "GET /compute/v2.1/servers/0698dc5b-5f47-46c4-ace8-f5e891a964a0" status: 200 len: 1218 microversion: 2.1 time: 0.090890 Nov 17 03:52:01.140225 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 1348/2499] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:52:01 2021] GET /compute/v2.1/servers/0698dc5b-5f47-46c4-ace8-f5e891a964a0 => generated 1218 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:52:01.790241 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-0357b126-cf0a-4714-87b8-27d9ec7523a9 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:52:01.790876 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-0357b126-cf0a-4714-87b8-27d9ec7523a9 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] [instance: 5d54db85-b991-4890-abaa-952413baa2e7] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:52:01.798036 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-0357b126-cf0a-4714-87b8-27d9ec7523a9 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:52:01.798488 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-0357b126-cf0a-4714-87b8-27d9ec7523a9 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:52:01.799254 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-0357b126-cf0a-4714-87b8-27d9ec7523a9 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:52:01.799689 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-0357b126-cf0a-4714-87b8-27d9ec7523a9 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:52:01.949238 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-0357b126-cf0a-4714-87b8-27d9ec7523a9 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37f21d6d15cf40a586edda211219fd08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ebb970305844dccacf48a7d8d47ecf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:52:01.961254 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-0357b126-cf0a-4714-87b8-27d9ec7523a9 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '37f21d6d15cf40a586edda211219fd08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ebb970305844dccacf48a7d8d47ecf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:52:01.962766 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-0357b126-cf0a-4714-87b8-27d9ec7523a9 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '37f21d6d15cf40a586edda211219fd08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ebb970305844dccacf48a7d8d47ecf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:52:01.963871 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-0357b126-cf0a-4714-87b8-27d9ec7523a9 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] 10.222.0.11 "GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7" status: 200 len: 1803 microversion: 2.20 time: 0.177551 Nov 17 03:52:01.964424 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 1152/2500] 10.222.0.11 () {60 vars in 1276 bytes} [Wed Nov 17 03:52:01 2021] GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7 => generated 1803 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 17 03:52:02.162495 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-ebc1dea9-f260-423a-8fce-e61f2e3f1117 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:52:02.163393 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-ebc1dea9-f260-423a-8fce-e61f2e3f1117 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] [instance: 0698dc5b-5f47-46c4-ace8-f5e891a964a0] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:52:02.173193 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-ebc1dea9-f260-423a-8fce-e61f2e3f1117 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:52:02.173830 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-ebc1dea9-f260-423a-8fce-e61f2e3f1117 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:52:02.174921 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-ebc1dea9-f260-423a-8fce-e61f2e3f1117 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:52:02.175542 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-ebc1dea9-f260-423a-8fce-e61f2e3f1117 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:52:02.241045 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-ebc1dea9-f260-423a-8fce-e61f2e3f1117 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '163b2f24a72649ac8084be1cac32fa09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e123e9b86124c93a7fc2db9984e7466', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:52:02.249490 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-ebc1dea9-f260-423a-8fce-e61f2e3f1117 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] 10.222.0.11 "GET /compute/v2.1/servers/0698dc5b-5f47-46c4-ace8-f5e891a964a0" status: 200 len: 1218 microversion: 2.1 time: 0.095810 Nov 17 03:52:02.250053 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 1349/2501] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:52:02 2021] GET /compute/v2.1/servers/0698dc5b-5f47-46c4-ace8-f5e891a964a0 => generated 1218 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:52:02.982745 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-4c4c5aeb-6c04-4e90-8376-b7415ebda03d tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:52:02.983558 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-4c4c5aeb-6c04-4e90-8376-b7415ebda03d tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] [instance: 5d54db85-b991-4890-abaa-952413baa2e7] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:52:02.990629 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-4c4c5aeb-6c04-4e90-8376-b7415ebda03d tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:52:02.991077 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-4c4c5aeb-6c04-4e90-8376-b7415ebda03d tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:52:02.991849 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-4c4c5aeb-6c04-4e90-8376-b7415ebda03d tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:52:02.992270 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-4c4c5aeb-6c04-4e90-8376-b7415ebda03d tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:52:03.134959 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-4c4c5aeb-6c04-4e90-8376-b7415ebda03d tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37f21d6d15cf40a586edda211219fd08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ebb970305844dccacf48a7d8d47ecf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:52:03.143898 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-4c4c5aeb-6c04-4e90-8376-b7415ebda03d tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '37f21d6d15cf40a586edda211219fd08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ebb970305844dccacf48a7d8d47ecf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:52:03.145410 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-4c4c5aeb-6c04-4e90-8376-b7415ebda03d tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '37f21d6d15cf40a586edda211219fd08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ebb970305844dccacf48a7d8d47ecf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:52:03.146560 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-4c4c5aeb-6c04-4e90-8376-b7415ebda03d tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] 10.222.0.11 "GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7" status: 200 len: 1803 microversion: 2.20 time: 0.167635 Nov 17 03:52:03.147117 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 1153/2502] 10.222.0.11 () {60 vars in 1276 bytes} [Wed Nov 17 03:52:02 2021] GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7 => generated 1803 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 17 03:52:03.270255 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-58569617-2f94-4527-b6b9-7c46535f724a tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:52:03.271199 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-58569617-2f94-4527-b6b9-7c46535f724a tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] [instance: 0698dc5b-5f47-46c4-ace8-f5e891a964a0] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:52:03.282168 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-58569617-2f94-4527-b6b9-7c46535f724a tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:52:03.282924 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-58569617-2f94-4527-b6b9-7c46535f724a tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:52:03.284219 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-58569617-2f94-4527-b6b9-7c46535f724a tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:52:03.284987 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-58569617-2f94-4527-b6b9-7c46535f724a tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:52:03.351949 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-58569617-2f94-4527-b6b9-7c46535f724a tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '163b2f24a72649ac8084be1cac32fa09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e123e9b86124c93a7fc2db9984e7466', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:52:03.359677 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-58569617-2f94-4527-b6b9-7c46535f724a tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] 10.222.0.11 "GET /compute/v2.1/servers/0698dc5b-5f47-46c4-ace8-f5e891a964a0" status: 200 len: 1218 microversion: 2.1 time: 0.095687 Nov 17 03:52:03.360244 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 1350/2503] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:52:03 2021] GET /compute/v2.1/servers/0698dc5b-5f47-46c4-ace8-f5e891a964a0 => generated 1218 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:52:04.168390 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-75cd9cda-919c-4c46-a6b9-d36094de6134 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:52:04.169095 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-75cd9cda-919c-4c46-a6b9-d36094de6134 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] [instance: 5d54db85-b991-4890-abaa-952413baa2e7] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:52:04.178480 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-75cd9cda-919c-4c46-a6b9-d36094de6134 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:52:04.178931 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-75cd9cda-919c-4c46-a6b9-d36094de6134 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:52:04.179704 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-75cd9cda-919c-4c46-a6b9-d36094de6134 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:52:04.180138 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-75cd9cda-919c-4c46-a6b9-d36094de6134 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:52:04.343980 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-75cd9cda-919c-4c46-a6b9-d36094de6134 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37f21d6d15cf40a586edda211219fd08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ebb970305844dccacf48a7d8d47ecf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:52:04.352724 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-75cd9cda-919c-4c46-a6b9-d36094de6134 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '37f21d6d15cf40a586edda211219fd08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ebb970305844dccacf48a7d8d47ecf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:52:04.354368 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-75cd9cda-919c-4c46-a6b9-d36094de6134 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '37f21d6d15cf40a586edda211219fd08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ebb970305844dccacf48a7d8d47ecf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:52:04.355523 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-75cd9cda-919c-4c46-a6b9-d36094de6134 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] 10.222.0.11 "GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7" status: 200 len: 1803 microversion: 2.20 time: 0.192935 Nov 17 03:52:04.356083 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 1154/2504] 10.222.0.11 () {60 vars in 1276 bytes} [Wed Nov 17 03:52:04 2021] GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7 => generated 1803 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 17 03:52:04.382462 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-16522e3d-68e5-4716-b001-f2048180887b tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:52:04.383160 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-16522e3d-68e5-4716-b001-f2048180887b tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] [instance: 0698dc5b-5f47-46c4-ace8-f5e891a964a0] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:52:04.390367 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-16522e3d-68e5-4716-b001-f2048180887b tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:52:04.390820 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-16522e3d-68e5-4716-b001-f2048180887b tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:52:04.391593 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-16522e3d-68e5-4716-b001-f2048180887b tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:52:04.392023 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-16522e3d-68e5-4716-b001-f2048180887b tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:52:04.457907 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-16522e3d-68e5-4716-b001-f2048180887b tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '163b2f24a72649ac8084be1cac32fa09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e123e9b86124c93a7fc2db9984e7466', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:52:04.465883 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-16522e3d-68e5-4716-b001-f2048180887b tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] 10.222.0.11 "GET /compute/v2.1/servers/0698dc5b-5f47-46c4-ace8-f5e891a964a0" status: 200 len: 1218 microversion: 2.1 time: 0.087125 Nov 17 03:52:04.466500 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 1351/2505] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:52:04 2021] GET /compute/v2.1/servers/0698dc5b-5f47-46c4-ace8-f5e891a964a0 => generated 1218 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:52:05.378534 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-85fbdb04-649c-4c62-9b66-99d169cd2948 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:52:05.379511 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-85fbdb04-649c-4c62-9b66-99d169cd2948 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] [instance: 5d54db85-b991-4890-abaa-952413baa2e7] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:52:05.389593 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-85fbdb04-649c-4c62-9b66-99d169cd2948 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:52:05.390038 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-85fbdb04-649c-4c62-9b66-99d169cd2948 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:52:05.390812 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-85fbdb04-649c-4c62-9b66-99d169cd2948 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:52:05.391244 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-85fbdb04-649c-4c62-9b66-99d169cd2948 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:52:05.483211 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-c965422a-b82c-49c8-9e6c-6e0ab7304059 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:52:05.483802 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-c965422a-b82c-49c8-9e6c-6e0ab7304059 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] [instance: 0698dc5b-5f47-46c4-ace8-f5e891a964a0] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:52:05.490770 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-c965422a-b82c-49c8-9e6c-6e0ab7304059 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:52:05.491216 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-c965422a-b82c-49c8-9e6c-6e0ab7304059 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:52:05.491992 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-c965422a-b82c-49c8-9e6c-6e0ab7304059 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:52:05.492429 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-c965422a-b82c-49c8-9e6c-6e0ab7304059 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:52:05.528071 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-85fbdb04-649c-4c62-9b66-99d169cd2948 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37f21d6d15cf40a586edda211219fd08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ebb970305844dccacf48a7d8d47ecf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:52:05.536682 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-85fbdb04-649c-4c62-9b66-99d169cd2948 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '37f21d6d15cf40a586edda211219fd08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ebb970305844dccacf48a7d8d47ecf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:52:05.538188 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-85fbdb04-649c-4c62-9b66-99d169cd2948 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '37f21d6d15cf40a586edda211219fd08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ebb970305844dccacf48a7d8d47ecf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:52:05.539336 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-85fbdb04-649c-4c62-9b66-99d169cd2948 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] 10.222.0.11 "GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7" status: 200 len: 1803 microversion: 2.20 time: 0.167535 Nov 17 03:52:05.539930 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 1155/2506] 10.222.0.11 () {60 vars in 1276 bytes} [Wed Nov 17 03:52:05 2021] GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7 => generated 1803 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 17 03:52:05.557033 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-c965422a-b82c-49c8-9e6c-6e0ab7304059 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '163b2f24a72649ac8084be1cac32fa09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e123e9b86124c93a7fc2db9984e7466', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:52:05.565428 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-c965422a-b82c-49c8-9e6c-6e0ab7304059 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] 10.222.0.11 "GET /compute/v2.1/servers/0698dc5b-5f47-46c4-ace8-f5e891a964a0" status: 200 len: 1218 microversion: 2.1 time: 0.086221 Nov 17 03:52:05.565993 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 1352/2507] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:52:05 2021] GET /compute/v2.1/servers/0698dc5b-5f47-46c4-ace8-f5e891a964a0 => generated 1218 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:52:06.562474 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-72969cb8-f9db-4b9b-862d-8239fd86fb20 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:52:06.563286 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-72969cb8-f9db-4b9b-862d-8239fd86fb20 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] [instance: 5d54db85-b991-4890-abaa-952413baa2e7] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:52:06.572949 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-72969cb8-f9db-4b9b-862d-8239fd86fb20 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:52:06.573554 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-72969cb8-f9db-4b9b-862d-8239fd86fb20 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:52:06.574721 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-72969cb8-f9db-4b9b-862d-8239fd86fb20 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:52:06.575169 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-72969cb8-f9db-4b9b-862d-8239fd86fb20 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:52:06.586382 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-7248ae32-d1bf-4b35-a4b2-14f0b9672bd3 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:52:06.587025 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-7248ae32-d1bf-4b35-a4b2-14f0b9672bd3 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] [instance: 0698dc5b-5f47-46c4-ace8-f5e891a964a0] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:52:06.594467 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-7248ae32-d1bf-4b35-a4b2-14f0b9672bd3 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:52:06.594918 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-7248ae32-d1bf-4b35-a4b2-14f0b9672bd3 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:52:06.595693 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-7248ae32-d1bf-4b35-a4b2-14f0b9672bd3 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:52:06.596119 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-7248ae32-d1bf-4b35-a4b2-14f0b9672bd3 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:52:06.723843 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-72969cb8-f9db-4b9b-862d-8239fd86fb20 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37f21d6d15cf40a586edda211219fd08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ebb970305844dccacf48a7d8d47ecf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:52:06.733002 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-72969cb8-f9db-4b9b-862d-8239fd86fb20 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '37f21d6d15cf40a586edda211219fd08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ebb970305844dccacf48a7d8d47ecf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:52:06.734502 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-72969cb8-f9db-4b9b-862d-8239fd86fb20 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '37f21d6d15cf40a586edda211219fd08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ebb970305844dccacf48a7d8d47ecf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:52:06.735686 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-72969cb8-f9db-4b9b-862d-8239fd86fb20 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] 10.222.0.11 "GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7" status: 200 len: 1803 microversion: 2.20 time: 0.179559 Nov 17 03:52:06.736329 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 1156/2508] 10.222.0.11 () {60 vars in 1276 bytes} [Wed Nov 17 03:52:06 2021] GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7 => generated 1803 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 17 03:52:06.835212 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-7248ae32-d1bf-4b35-a4b2-14f0b9672bd3 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '163b2f24a72649ac8084be1cac32fa09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e123e9b86124c93a7fc2db9984e7466', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:52:06.843104 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-7248ae32-d1bf-4b35-a4b2-14f0b9672bd3 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] 10.222.0.11 "GET /compute/v2.1/servers/0698dc5b-5f47-46c4-ace8-f5e891a964a0" status: 200 len: 1218 microversion: 2.1 time: 0.260612 Nov 17 03:52:06.843670 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 1353/2509] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:52:06 2021] GET /compute/v2.1/servers/0698dc5b-5f47-46c4-ace8-f5e891a964a0 => generated 1218 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:52:07.756601 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-b4622628-02b5-4dff-8d32-54f73b86573f tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:52:07.757409 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-b4622628-02b5-4dff-8d32-54f73b86573f tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] [instance: 5d54db85-b991-4890-abaa-952413baa2e7] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:52:07.765554 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-b4622628-02b5-4dff-8d32-54f73b86573f tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:52:07.765992 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-b4622628-02b5-4dff-8d32-54f73b86573f tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:52:07.766822 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-b4622628-02b5-4dff-8d32-54f73b86573f tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:52:07.767247 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-b4622628-02b5-4dff-8d32-54f73b86573f tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:52:07.859546 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-d9cf651f-fe58-4e60-b76b-99f56f63ba24 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:52:07.860126 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-d9cf651f-fe58-4e60-b76b-99f56f63ba24 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] [instance: 0698dc5b-5f47-46c4-ace8-f5e891a964a0] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:52:07.866799 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-d9cf651f-fe58-4e60-b76b-99f56f63ba24 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:52:07.867254 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-d9cf651f-fe58-4e60-b76b-99f56f63ba24 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:52:07.868041 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-d9cf651f-fe58-4e60-b76b-99f56f63ba24 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:52:07.868520 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-d9cf651f-fe58-4e60-b76b-99f56f63ba24 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:52:07.899445 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-b4622628-02b5-4dff-8d32-54f73b86573f tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37f21d6d15cf40a586edda211219fd08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ebb970305844dccacf48a7d8d47ecf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:52:07.908575 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-b4622628-02b5-4dff-8d32-54f73b86573f tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '37f21d6d15cf40a586edda211219fd08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ebb970305844dccacf48a7d8d47ecf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:52:07.910091 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-b4622628-02b5-4dff-8d32-54f73b86573f tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '37f21d6d15cf40a586edda211219fd08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ebb970305844dccacf48a7d8d47ecf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:52:07.911254 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-b4622628-02b5-4dff-8d32-54f73b86573f tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] 10.222.0.11 "GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7" status: 200 len: 1803 microversion: 2.20 time: 0.160187 Nov 17 03:52:07.911867 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 1157/2510] 10.222.0.11 () {60 vars in 1276 bytes} [Wed Nov 17 03:52:07 2021] GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7 => generated 1803 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 17 03:52:07.928959 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-d9cf651f-fe58-4e60-b76b-99f56f63ba24 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '163b2f24a72649ac8084be1cac32fa09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e123e9b86124c93a7fc2db9984e7466', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:52:07.936577 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-d9cf651f-fe58-4e60-b76b-99f56f63ba24 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] 10.222.0.11 "GET /compute/v2.1/servers/0698dc5b-5f47-46c4-ace8-f5e891a964a0" status: 200 len: 1218 microversion: 2.1 time: 0.080897 Nov 17 03:52:07.937167 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 1354/2511] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:52:07 2021] GET /compute/v2.1/servers/0698dc5b-5f47-46c4-ace8-f5e891a964a0 => generated 1218 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:52:08.934269 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-034f4b20-fe98-4428-9636-cdcb30120a9f tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:52:08.935284 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-034f4b20-fe98-4428-9636-cdcb30120a9f tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] [instance: 5d54db85-b991-4890-abaa-952413baa2e7] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:52:08.942720 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-034f4b20-fe98-4428-9636-cdcb30120a9f tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:52:08.943220 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-034f4b20-fe98-4428-9636-cdcb30120a9f tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:52:08.944079 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-034f4b20-fe98-4428-9636-cdcb30120a9f tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:52:08.944601 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-034f4b20-fe98-4428-9636-cdcb30120a9f tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:52:08.953668 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-13a9bf8b-efeb-4e96-8b2e-4cebc93cbc71 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:52:08.954343 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-13a9bf8b-efeb-4e96-8b2e-4cebc93cbc71 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] [instance: 0698dc5b-5f47-46c4-ace8-f5e891a964a0] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:52:08.961503 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-13a9bf8b-efeb-4e96-8b2e-4cebc93cbc71 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:52:08.962008 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-13a9bf8b-efeb-4e96-8b2e-4cebc93cbc71 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:52:08.962865 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-13a9bf8b-efeb-4e96-8b2e-4cebc93cbc71 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:52:08.963850 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-13a9bf8b-efeb-4e96-8b2e-4cebc93cbc71 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:52:09.026325 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-13a9bf8b-efeb-4e96-8b2e-4cebc93cbc71 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '163b2f24a72649ac8084be1cac32fa09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e123e9b86124c93a7fc2db9984e7466', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:52:09.034199 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-13a9bf8b-efeb-4e96-8b2e-4cebc93cbc71 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] 10.222.0.11 "GET /compute/v2.1/servers/0698dc5b-5f47-46c4-ace8-f5e891a964a0" status: 200 len: 1218 microversion: 2.1 time: 0.085014 Nov 17 03:52:09.035024 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 1355/2512] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:52:08 2021] GET /compute/v2.1/servers/0698dc5b-5f47-46c4-ace8-f5e891a964a0 => generated 1218 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:52:09.081753 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-034f4b20-fe98-4428-9636-cdcb30120a9f tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37f21d6d15cf40a586edda211219fd08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ebb970305844dccacf48a7d8d47ecf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:52:09.090414 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-034f4b20-fe98-4428-9636-cdcb30120a9f tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '37f21d6d15cf40a586edda211219fd08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ebb970305844dccacf48a7d8d47ecf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:52:09.091877 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-034f4b20-fe98-4428-9636-cdcb30120a9f tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '37f21d6d15cf40a586edda211219fd08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ebb970305844dccacf48a7d8d47ecf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:52:09.093053 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-034f4b20-fe98-4428-9636-cdcb30120a9f tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] 10.222.0.11 "GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7" status: 200 len: 1803 microversion: 2.20 time: 0.165115 Nov 17 03:52:09.093607 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 1158/2513] 10.222.0.11 () {60 vars in 1276 bytes} [Wed Nov 17 03:52:08 2021] GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7 => generated 1803 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 17 03:52:10.055654 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-84f3d469-c58d-4e04-8123-f154f31ed6b3 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:52:10.056535 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-84f3d469-c58d-4e04-8123-f154f31ed6b3 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] [instance: 0698dc5b-5f47-46c4-ace8-f5e891a964a0] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:52:10.067468 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-84f3d469-c58d-4e04-8123-f154f31ed6b3 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:52:10.068203 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-84f3d469-c58d-4e04-8123-f154f31ed6b3 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:52:10.069519 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-84f3d469-c58d-4e04-8123-f154f31ed6b3 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:52:10.070230 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-84f3d469-c58d-4e04-8123-f154f31ed6b3 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:52:10.117972 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-9e1964f8-ac54-47cc-a5d8-e5f3552cfafb tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:52:10.119065 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-9e1964f8-ac54-47cc-a5d8-e5f3552cfafb tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] [instance: 5d54db85-b991-4890-abaa-952413baa2e7] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:52:10.126350 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-9e1964f8-ac54-47cc-a5d8-e5f3552cfafb tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:52:10.126777 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-9e1964f8-ac54-47cc-a5d8-e5f3552cfafb tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:52:10.127561 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-9e1964f8-ac54-47cc-a5d8-e5f3552cfafb tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:52:10.127992 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-9e1964f8-ac54-47cc-a5d8-e5f3552cfafb tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:52:10.142576 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-84f3d469-c58d-4e04-8123-f154f31ed6b3 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '163b2f24a72649ac8084be1cac32fa09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e123e9b86124c93a7fc2db9984e7466', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:52:10.151914 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-84f3d469-c58d-4e04-8123-f154f31ed6b3 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] 10.222.0.11 "GET /compute/v2.1/servers/0698dc5b-5f47-46c4-ace8-f5e891a964a0" status: 200 len: 1218 microversion: 2.1 time: 0.103186 Nov 17 03:52:10.152620 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 1356/2514] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:52:10 2021] GET /compute/v2.1/servers/0698dc5b-5f47-46c4-ace8-f5e891a964a0 => generated 1218 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:52:10.270920 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-9e1964f8-ac54-47cc-a5d8-e5f3552cfafb tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37f21d6d15cf40a586edda211219fd08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ebb970305844dccacf48a7d8d47ecf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:52:10.279317 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-9e1964f8-ac54-47cc-a5d8-e5f3552cfafb tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '37f21d6d15cf40a586edda211219fd08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ebb970305844dccacf48a7d8d47ecf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:52:10.281047 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-9e1964f8-ac54-47cc-a5d8-e5f3552cfafb tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '37f21d6d15cf40a586edda211219fd08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ebb970305844dccacf48a7d8d47ecf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:52:10.282207 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-9e1964f8-ac54-47cc-a5d8-e5f3552cfafb tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] 10.222.0.11 "GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7" status: 200 len: 1803 microversion: 2.20 time: 0.173005 Nov 17 03:52:10.282737 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 1159/2515] 10.222.0.11 () {60 vars in 1276 bytes} [Wed Nov 17 03:52:10 2021] GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7 => generated 1803 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 17 03:52:11.171018 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-ad67f3cb-9eff-4ad6-928d-f3489590f590 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:52:11.171622 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-ad67f3cb-9eff-4ad6-928d-f3489590f590 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] [instance: 0698dc5b-5f47-46c4-ace8-f5e891a964a0] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:52:11.179466 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-ad67f3cb-9eff-4ad6-928d-f3489590f590 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:52:11.179985 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-ad67f3cb-9eff-4ad6-928d-f3489590f590 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:52:11.180824 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-ad67f3cb-9eff-4ad6-928d-f3489590f590 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:52:11.181353 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-ad67f3cb-9eff-4ad6-928d-f3489590f590 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:52:11.245689 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-ad67f3cb-9eff-4ad6-928d-f3489590f590 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '163b2f24a72649ac8084be1cac32fa09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e123e9b86124c93a7fc2db9984e7466', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:52:11.257597 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-ad67f3cb-9eff-4ad6-928d-f3489590f590 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] 10.222.0.11 "GET /compute/v2.1/servers/0698dc5b-5f47-46c4-ace8-f5e891a964a0" status: 200 len: 1218 microversion: 2.1 time: 0.090384 Nov 17 03:52:11.258365 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 1357/2516] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:52:11 2021] GET /compute/v2.1/servers/0698dc5b-5f47-46c4-ace8-f5e891a964a0 => generated 1218 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:52:11.301188 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-a0a757b3-40f0-4945-b4fb-53362ab1202b tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:52:11.301825 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-a0a757b3-40f0-4945-b4fb-53362ab1202b tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] [instance: 5d54db85-b991-4890-abaa-952413baa2e7] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:52:11.308864 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-a0a757b3-40f0-4945-b4fb-53362ab1202b tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:52:11.309318 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-a0a757b3-40f0-4945-b4fb-53362ab1202b tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:52:11.310087 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-a0a757b3-40f0-4945-b4fb-53362ab1202b tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:52:11.310518 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-a0a757b3-40f0-4945-b4fb-53362ab1202b tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:52:11.442765 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-a0a757b3-40f0-4945-b4fb-53362ab1202b tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37f21d6d15cf40a586edda211219fd08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ebb970305844dccacf48a7d8d47ecf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:52:11.454285 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-a0a757b3-40f0-4945-b4fb-53362ab1202b tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '37f21d6d15cf40a586edda211219fd08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ebb970305844dccacf48a7d8d47ecf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:52:11.455752 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-a0a757b3-40f0-4945-b4fb-53362ab1202b tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '37f21d6d15cf40a586edda211219fd08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ebb970305844dccacf48a7d8d47ecf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:52:11.456931 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-a0a757b3-40f0-4945-b4fb-53362ab1202b tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] 10.222.0.11 "GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7" status: 200 len: 1803 microversion: 2.20 time: 0.159716 Nov 17 03:52:11.457506 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 1160/2517] 10.222.0.11 () {60 vars in 1276 bytes} [Wed Nov 17 03:52:11 2021] GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7 => generated 1803 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 17 03:52:12.281963 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-208ef635-ff6c-4eb5-a18a-e9c3df1b72d0 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:52:12.283024 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-208ef635-ff6c-4eb5-a18a-e9c3df1b72d0 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] [instance: 0698dc5b-5f47-46c4-ace8-f5e891a964a0] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:52:12.293647 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-208ef635-ff6c-4eb5-a18a-e9c3df1b72d0 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:52:12.294421 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-208ef635-ff6c-4eb5-a18a-e9c3df1b72d0 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:52:12.295717 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-208ef635-ff6c-4eb5-a18a-e9c3df1b72d0 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:52:12.296431 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-208ef635-ff6c-4eb5-a18a-e9c3df1b72d0 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:52:12.359574 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-208ef635-ff6c-4eb5-a18a-e9c3df1b72d0 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '163b2f24a72649ac8084be1cac32fa09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e123e9b86124c93a7fc2db9984e7466', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:52:12.367804 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-208ef635-ff6c-4eb5-a18a-e9c3df1b72d0 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] 10.222.0.11 "GET /compute/v2.1/servers/0698dc5b-5f47-46c4-ace8-f5e891a964a0" status: 200 len: 1218 microversion: 2.1 time: 0.092288 Nov 17 03:52:12.368358 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 1358/2518] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:52:12 2021] GET /compute/v2.1/servers/0698dc5b-5f47-46c4-ace8-f5e891a964a0 => generated 1218 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:52:12.479218 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-7f9906ab-14a6-4e17-8a96-8a19a010b064 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:52:12.480223 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-7f9906ab-14a6-4e17-8a96-8a19a010b064 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] [instance: 5d54db85-b991-4890-abaa-952413baa2e7] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:52:12.491261 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-7f9906ab-14a6-4e17-8a96-8a19a010b064 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:52:12.492008 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-7f9906ab-14a6-4e17-8a96-8a19a010b064 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:52:12.493327 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-7f9906ab-14a6-4e17-8a96-8a19a010b064 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:52:12.494046 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-7f9906ab-14a6-4e17-8a96-8a19a010b064 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:52:12.630331 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-7f9906ab-14a6-4e17-8a96-8a19a010b064 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37f21d6d15cf40a586edda211219fd08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ebb970305844dccacf48a7d8d47ecf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:52:12.639415 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-7f9906ab-14a6-4e17-8a96-8a19a010b064 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '37f21d6d15cf40a586edda211219fd08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ebb970305844dccacf48a7d8d47ecf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:52:12.641092 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-7f9906ab-14a6-4e17-8a96-8a19a010b064 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '37f21d6d15cf40a586edda211219fd08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ebb970305844dccacf48a7d8d47ecf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:52:12.642253 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-7f9906ab-14a6-4e17-8a96-8a19a010b064 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] 10.222.0.11 "GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7" status: 200 len: 1803 microversion: 2.20 time: 0.169173 Nov 17 03:52:12.642786 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 1161/2519] 10.222.0.11 () {60 vars in 1276 bytes} [Wed Nov 17 03:52:12 2021] GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7 => generated 1803 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 17 03:52:13.389658 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-18859970-47e9-4031-9060-d3207ba6425e tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:52:13.390558 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-18859970-47e9-4031-9060-d3207ba6425e tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] [instance: 0698dc5b-5f47-46c4-ace8-f5e891a964a0] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:52:13.401489 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-18859970-47e9-4031-9060-d3207ba6425e tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:52:13.402258 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-18859970-47e9-4031-9060-d3207ba6425e tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:52:13.403535 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-18859970-47e9-4031-9060-d3207ba6425e tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:52:13.404240 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-18859970-47e9-4031-9060-d3207ba6425e tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:52:13.467315 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-18859970-47e9-4031-9060-d3207ba6425e tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '163b2f24a72649ac8084be1cac32fa09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e123e9b86124c93a7fc2db9984e7466', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:52:13.475138 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-18859970-47e9-4031-9060-d3207ba6425e tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] 10.222.0.11 "GET /compute/v2.1/servers/0698dc5b-5f47-46c4-ace8-f5e891a964a0" status: 200 len: 1218 microversion: 2.1 time: 0.091929 Nov 17 03:52:13.475686 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 1359/2520] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:52:13 2021] GET /compute/v2.1/servers/0698dc5b-5f47-46c4-ace8-f5e891a964a0 => generated 1218 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:52:13.664443 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-a22b01ac-f278-4045-8451-5155bfb4e67e tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:52:13.665378 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-a22b01ac-f278-4045-8451-5155bfb4e67e tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] [instance: 5d54db85-b991-4890-abaa-952413baa2e7] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:52:13.674719 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-a22b01ac-f278-4045-8451-5155bfb4e67e tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:52:13.675170 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-a22b01ac-f278-4045-8451-5155bfb4e67e tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:52:13.675936 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-a22b01ac-f278-4045-8451-5155bfb4e67e tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:52:13.676370 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-a22b01ac-f278-4045-8451-5155bfb4e67e tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:52:13.822272 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-a22b01ac-f278-4045-8451-5155bfb4e67e tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37f21d6d15cf40a586edda211219fd08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ebb970305844dccacf48a7d8d47ecf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:52:13.833532 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-a22b01ac-f278-4045-8451-5155bfb4e67e tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '37f21d6d15cf40a586edda211219fd08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ebb970305844dccacf48a7d8d47ecf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:52:13.835028 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-a22b01ac-f278-4045-8451-5155bfb4e67e tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '37f21d6d15cf40a586edda211219fd08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ebb970305844dccacf48a7d8d47ecf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:52:13.836186 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-a22b01ac-f278-4045-8451-5155bfb4e67e tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] 10.222.0.11 "GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7" status: 200 len: 1803 microversion: 2.20 time: 0.178045 Nov 17 03:52:13.836732 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 1162/2521] 10.222.0.11 () {60 vars in 1276 bytes} [Wed Nov 17 03:52:13 2021] GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7 => generated 1803 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 17 03:52:14.495364 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-418160a6-62ad-41e2-b630-14234e1867b4 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:52:14.496239 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-418160a6-62ad-41e2-b630-14234e1867b4 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] [instance: 0698dc5b-5f47-46c4-ace8-f5e891a964a0] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:52:14.506764 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-418160a6-62ad-41e2-b630-14234e1867b4 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:52:14.507508 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-418160a6-62ad-41e2-b630-14234e1867b4 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:52:14.508770 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-418160a6-62ad-41e2-b630-14234e1867b4 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:52:14.509520 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-418160a6-62ad-41e2-b630-14234e1867b4 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:52:14.571100 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-418160a6-62ad-41e2-b630-14234e1867b4 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '163b2f24a72649ac8084be1cac32fa09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e123e9b86124c93a7fc2db9984e7466', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:52:14.579169 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-418160a6-62ad-41e2-b630-14234e1867b4 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] 10.222.0.11 "GET /compute/v2.1/servers/0698dc5b-5f47-46c4-ace8-f5e891a964a0" status: 200 len: 1218 microversion: 2.1 time: 0.089944 Nov 17 03:52:14.579732 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 1360/2522] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:52:14 2021] GET /compute/v2.1/servers/0698dc5b-5f47-46c4-ace8-f5e891a964a0 => generated 1218 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:52:14.862469 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-093b9d02-43bf-4cf9-8d11-8bb7df453e49 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:52:14.863218 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-093b9d02-43bf-4cf9-8d11-8bb7df453e49 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] [instance: 5d54db85-b991-4890-abaa-952413baa2e7] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:52:14.871494 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-093b9d02-43bf-4cf9-8d11-8bb7df453e49 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:52:14.872045 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-093b9d02-43bf-4cf9-8d11-8bb7df453e49 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:52:14.873038 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-093b9d02-43bf-4cf9-8d11-8bb7df453e49 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:52:14.873571 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-093b9d02-43bf-4cf9-8d11-8bb7df453e49 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:52:15.014177 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-093b9d02-43bf-4cf9-8d11-8bb7df453e49 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37f21d6d15cf40a586edda211219fd08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ebb970305844dccacf48a7d8d47ecf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:52:15.023337 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-093b9d02-43bf-4cf9-8d11-8bb7df453e49 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '37f21d6d15cf40a586edda211219fd08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ebb970305844dccacf48a7d8d47ecf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:52:15.024819 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-093b9d02-43bf-4cf9-8d11-8bb7df453e49 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '37f21d6d15cf40a586edda211219fd08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ebb970305844dccacf48a7d8d47ecf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:52:15.026026 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-093b9d02-43bf-4cf9-8d11-8bb7df453e49 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] 10.222.0.11 "GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7" status: 200 len: 1803 microversion: 2.20 time: 0.168242 Nov 17 03:52:15.026580 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 1163/2523] 10.222.0.11 () {60 vars in 1276 bytes} [Wed Nov 17 03:52:14 2021] GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7 => generated 1803 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 17 03:52:15.600359 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-caab8de5-add2-4260-8c90-ce27b5fc29d3 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:52:15.601335 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-caab8de5-add2-4260-8c90-ce27b5fc29d3 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] [instance: 0698dc5b-5f47-46c4-ace8-f5e891a964a0] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:52:15.612268 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-caab8de5-add2-4260-8c90-ce27b5fc29d3 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:52:15.613086 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-caab8de5-add2-4260-8c90-ce27b5fc29d3 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:52:15.614370 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-caab8de5-add2-4260-8c90-ce27b5fc29d3 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:52:15.615091 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-caab8de5-add2-4260-8c90-ce27b5fc29d3 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:52:15.679209 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-caab8de5-add2-4260-8c90-ce27b5fc29d3 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '163b2f24a72649ac8084be1cac32fa09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e123e9b86124c93a7fc2db9984e7466', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:52:15.686761 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-caab8de5-add2-4260-8c90-ce27b5fc29d3 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] 10.222.0.11 "GET /compute/v2.1/servers/0698dc5b-5f47-46c4-ace8-f5e891a964a0" status: 200 len: 1218 microversion: 2.1 time: 0.092928 Nov 17 03:52:15.687311 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 1361/2524] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:52:15 2021] GET /compute/v2.1/servers/0698dc5b-5f47-46c4-ace8-f5e891a964a0 => generated 1218 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:52:16.048035 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-56aedc68-db20-49e5-baff-f7a8472a271c tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:52:16.048755 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-56aedc68-db20-49e5-baff-f7a8472a271c tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] [instance: 5d54db85-b991-4890-abaa-952413baa2e7] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:52:16.056998 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-56aedc68-db20-49e5-baff-f7a8472a271c tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:52:16.057573 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-56aedc68-db20-49e5-baff-f7a8472a271c tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:52:16.058483 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-56aedc68-db20-49e5-baff-f7a8472a271c tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:52:16.058992 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-56aedc68-db20-49e5-baff-f7a8472a271c tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:52:16.203406 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-56aedc68-db20-49e5-baff-f7a8472a271c tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37f21d6d15cf40a586edda211219fd08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ebb970305844dccacf48a7d8d47ecf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:52:16.212312 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-56aedc68-db20-49e5-baff-f7a8472a271c tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '37f21d6d15cf40a586edda211219fd08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ebb970305844dccacf48a7d8d47ecf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:52:16.213835 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-56aedc68-db20-49e5-baff-f7a8472a271c tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '37f21d6d15cf40a586edda211219fd08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ebb970305844dccacf48a7d8d47ecf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:52:16.215002 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-56aedc68-db20-49e5-baff-f7a8472a271c tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] 10.222.0.11 "GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7" status: 200 len: 1803 microversion: 2.20 time: 0.173087 Nov 17 03:52:16.215570 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 1164/2525] 10.222.0.11 () {60 vars in 1276 bytes} [Wed Nov 17 03:52:16 2021] GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7 => generated 1803 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 17 03:52:16.707387 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-e040ef36-805a-41b5-87de-2b0a6328ba25 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:52:16.708316 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-e040ef36-805a-41b5-87de-2b0a6328ba25 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] [instance: 0698dc5b-5f47-46c4-ace8-f5e891a964a0] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:52:16.719280 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-e040ef36-805a-41b5-87de-2b0a6328ba25 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:52:16.720072 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-e040ef36-805a-41b5-87de-2b0a6328ba25 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:52:16.721404 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-e040ef36-805a-41b5-87de-2b0a6328ba25 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:52:16.722117 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-e040ef36-805a-41b5-87de-2b0a6328ba25 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:52:16.788114 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-e040ef36-805a-41b5-87de-2b0a6328ba25 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '163b2f24a72649ac8084be1cac32fa09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e123e9b86124c93a7fc2db9984e7466', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:52:16.798854 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-e040ef36-805a-41b5-87de-2b0a6328ba25 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] 10.222.0.11 "GET /compute/v2.1/servers/0698dc5b-5f47-46c4-ace8-f5e891a964a0" status: 200 len: 1218 microversion: 2.1 time: 0.098071 Nov 17 03:52:16.799417 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 1362/2526] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:52:16 2021] GET /compute/v2.1/servers/0698dc5b-5f47-46c4-ace8-f5e891a964a0 => generated 1218 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:52:17.236840 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-da40be8d-c72c-4cf5-a82b-ffea802ea073 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:52:17.237409 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-da40be8d-c72c-4cf5-a82b-ffea802ea073 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] [instance: 5d54db85-b991-4890-abaa-952413baa2e7] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:52:17.244215 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-da40be8d-c72c-4cf5-a82b-ffea802ea073 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:52:17.244665 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-da40be8d-c72c-4cf5-a82b-ffea802ea073 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:52:17.245483 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-da40be8d-c72c-4cf5-a82b-ffea802ea073 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:52:17.245915 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-da40be8d-c72c-4cf5-a82b-ffea802ea073 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:52:17.394835 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-da40be8d-c72c-4cf5-a82b-ffea802ea073 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37f21d6d15cf40a586edda211219fd08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ebb970305844dccacf48a7d8d47ecf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:52:17.407337 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-da40be8d-c72c-4cf5-a82b-ffea802ea073 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '37f21d6d15cf40a586edda211219fd08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ebb970305844dccacf48a7d8d47ecf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:52:17.409684 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-da40be8d-c72c-4cf5-a82b-ffea802ea073 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '37f21d6d15cf40a586edda211219fd08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ebb970305844dccacf48a7d8d47ecf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:52:17.411483 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-da40be8d-c72c-4cf5-a82b-ffea802ea073 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] 10.222.0.11 "GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7" status: 200 len: 1803 microversion: 2.20 time: 0.179335 Nov 17 03:52:17.412336 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 1165/2527] 10.222.0.11 () {60 vars in 1276 bytes} [Wed Nov 17 03:52:17 2021] GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7 => generated 1803 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 17 03:52:17.817540 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-ea4f2b45-8e0f-471f-8742-6fce90d7c9ca tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:52:17.818150 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-ea4f2b45-8e0f-471f-8742-6fce90d7c9ca tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] [instance: 0698dc5b-5f47-46c4-ace8-f5e891a964a0] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:52:17.824790 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-ea4f2b45-8e0f-471f-8742-6fce90d7c9ca tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:52:17.825239 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-ea4f2b45-8e0f-471f-8742-6fce90d7c9ca tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:52:17.826003 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-ea4f2b45-8e0f-471f-8742-6fce90d7c9ca tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:52:17.826428 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-ea4f2b45-8e0f-471f-8742-6fce90d7c9ca tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:52:17.893702 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-ea4f2b45-8e0f-471f-8742-6fce90d7c9ca tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '163b2f24a72649ac8084be1cac32fa09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e123e9b86124c93a7fc2db9984e7466', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:52:17.901638 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-ea4f2b45-8e0f-471f-8742-6fce90d7c9ca tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] 10.222.0.11 "GET /compute/v2.1/servers/0698dc5b-5f47-46c4-ace8-f5e891a964a0" status: 200 len: 1218 microversion: 2.1 time: 0.087802 Nov 17 03:52:17.902208 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 1363/2528] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:52:17 2021] GET /compute/v2.1/servers/0698dc5b-5f47-46c4-ace8-f5e891a964a0 => generated 1218 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:52:18.438471 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-3c640284-5640-45e5-86ef-a5ac90ef157a tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:52:18.439088 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-3c640284-5640-45e5-86ef-a5ac90ef157a tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] [instance: 5d54db85-b991-4890-abaa-952413baa2e7] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:52:18.446080 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-3c640284-5640-45e5-86ef-a5ac90ef157a tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:52:18.446524 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-3c640284-5640-45e5-86ef-a5ac90ef157a tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:52:18.447297 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-3c640284-5640-45e5-86ef-a5ac90ef157a tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:52:18.447730 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-3c640284-5640-45e5-86ef-a5ac90ef157a tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:52:18.595403 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-3c640284-5640-45e5-86ef-a5ac90ef157a tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37f21d6d15cf40a586edda211219fd08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ebb970305844dccacf48a7d8d47ecf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:52:18.603989 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-3c640284-5640-45e5-86ef-a5ac90ef157a tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '37f21d6d15cf40a586edda211219fd08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ebb970305844dccacf48a7d8d47ecf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:52:18.605515 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-3c640284-5640-45e5-86ef-a5ac90ef157a tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '37f21d6d15cf40a586edda211219fd08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ebb970305844dccacf48a7d8d47ecf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:52:18.606659 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-3c640284-5640-45e5-86ef-a5ac90ef157a tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] 10.222.0.11 "GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7" status: 200 len: 1803 microversion: 2.20 time: 0.174652 Nov 17 03:52:18.607188 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 1166/2529] 10.222.0.11 () {60 vars in 1276 bytes} [Wed Nov 17 03:52:18 2021] GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7 => generated 1803 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 17 03:52:18.922902 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-870bd578-46c6-453a-99d2-2914ef1f2baa tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:52:18.923653 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-870bd578-46c6-453a-99d2-2914ef1f2baa tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] [instance: 0698dc5b-5f47-46c4-ace8-f5e891a964a0] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:52:18.932138 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-870bd578-46c6-453a-99d2-2914ef1f2baa tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:52:18.932675 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-870bd578-46c6-453a-99d2-2914ef1f2baa tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:52:18.933626 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-870bd578-46c6-453a-99d2-2914ef1f2baa tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:52:18.934143 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-870bd578-46c6-453a-99d2-2914ef1f2baa tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:52:19.005870 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-870bd578-46c6-453a-99d2-2914ef1f2baa tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '163b2f24a72649ac8084be1cac32fa09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e123e9b86124c93a7fc2db9984e7466', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:52:19.017393 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-870bd578-46c6-453a-99d2-2914ef1f2baa tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] 10.222.0.11 "GET /compute/v2.1/servers/0698dc5b-5f47-46c4-ace8-f5e891a964a0" status: 200 len: 1218 microversion: 2.1 time: 0.101081 Nov 17 03:52:19.017954 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 1364/2530] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:52:18 2021] GET /compute/v2.1/servers/0698dc5b-5f47-46c4-ace8-f5e891a964a0 => generated 1218 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:52:19.629393 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-048582f6-1457-4a2c-bf74-cf07797a9a97 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:52:19.630459 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-048582f6-1457-4a2c-bf74-cf07797a9a97 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] [instance: 5d54db85-b991-4890-abaa-952413baa2e7] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:52:19.641115 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-048582f6-1457-4a2c-bf74-cf07797a9a97 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:52:19.641563 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-048582f6-1457-4a2c-bf74-cf07797a9a97 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:52:19.642334 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-048582f6-1457-4a2c-bf74-cf07797a9a97 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:52:19.642762 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-048582f6-1457-4a2c-bf74-cf07797a9a97 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:52:19.782817 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-048582f6-1457-4a2c-bf74-cf07797a9a97 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37f21d6d15cf40a586edda211219fd08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ebb970305844dccacf48a7d8d47ecf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:52:19.791136 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-048582f6-1457-4a2c-bf74-cf07797a9a97 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '37f21d6d15cf40a586edda211219fd08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ebb970305844dccacf48a7d8d47ecf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:52:19.792622 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-048582f6-1457-4a2c-bf74-cf07797a9a97 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '37f21d6d15cf40a586edda211219fd08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ebb970305844dccacf48a7d8d47ecf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:52:19.793841 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-048582f6-1457-4a2c-bf74-cf07797a9a97 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] 10.222.0.11 "GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7" status: 200 len: 1803 microversion: 2.20 time: 0.170735 Nov 17 03:52:19.794371 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 1167/2531] 10.222.0.11 () {60 vars in 1276 bytes} [Wed Nov 17 03:52:19 2021] GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7 => generated 1803 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 17 03:52:20.035868 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-6f36ec97-d394-400c-8282-06b5abb6fd23 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:52:20.036557 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-6f36ec97-d394-400c-8282-06b5abb6fd23 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] [instance: 0698dc5b-5f47-46c4-ace8-f5e891a964a0] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:52:20.044202 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-6f36ec97-d394-400c-8282-06b5abb6fd23 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:52:20.044691 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-6f36ec97-d394-400c-8282-06b5abb6fd23 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:52:20.045587 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-6f36ec97-d394-400c-8282-06b5abb6fd23 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:52:20.046066 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-6f36ec97-d394-400c-8282-06b5abb6fd23 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:52:20.108441 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-6f36ec97-d394-400c-8282-06b5abb6fd23 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '163b2f24a72649ac8084be1cac32fa09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e123e9b86124c93a7fc2db9984e7466', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:52:20.116385 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-6f36ec97-d394-400c-8282-06b5abb6fd23 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] 10.222.0.11 "GET /compute/v2.1/servers/0698dc5b-5f47-46c4-ace8-f5e891a964a0" status: 200 len: 1218 microversion: 2.1 time: 0.084836 Nov 17 03:52:20.116992 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 1365/2532] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:52:20 2021] GET /compute/v2.1/servers/0698dc5b-5f47-46c4-ace8-f5e891a964a0 => generated 1218 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:52:20.812836 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-d57161f2-87c8-413c-8ae9-0cc16f8a4067 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:52:20.813446 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-d57161f2-87c8-413c-8ae9-0cc16f8a4067 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] [instance: 5d54db85-b991-4890-abaa-952413baa2e7] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:52:20.825729 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-d57161f2-87c8-413c-8ae9-0cc16f8a4067 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:52:20.825729 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-d57161f2-87c8-413c-8ae9-0cc16f8a4067 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:52:20.825729 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-d57161f2-87c8-413c-8ae9-0cc16f8a4067 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:52:20.825729 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-d57161f2-87c8-413c-8ae9-0cc16f8a4067 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:52:20.871971 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-bcb05558-5684-42e2-a7d9-a1264ed8a855 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:52:20.872534 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-bcb05558-5684-42e2-a7d9-a1264ed8a855 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] [instance: 15abb40f-daf9-4c4b-ac9c-55f57ee7b938] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:52:20.878977 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-bcb05558-5684-42e2-a7d9-a1264ed8a855 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:52:20.879432 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-bcb05558-5684-42e2-a7d9-a1264ed8a855 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:52:20.880312 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-bcb05558-5684-42e2-a7d9-a1264ed8a855 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:52:20.880874 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-bcb05558-5684-42e2-a7d9-a1264ed8a855 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:52:20.905564 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-bcb05558-5684-42e2-a7d9-a1264ed8a855 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] [instance: 15abb40f-daf9-4c4b-ac9c-55f57ee7b938] Going to try to terminate instance {{(pid=115917) delete /opt/stack/nova/nova/compute/api.py:2614}} Nov 17 03:52:20.959345 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-d57161f2-87c8-413c-8ae9-0cc16f8a4067 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37f21d6d15cf40a586edda211219fd08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ebb970305844dccacf48a7d8d47ecf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:52:20.967739 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-d57161f2-87c8-413c-8ae9-0cc16f8a4067 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '37f21d6d15cf40a586edda211219fd08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ebb970305844dccacf48a7d8d47ecf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:52:20.969420 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-d57161f2-87c8-413c-8ae9-0cc16f8a4067 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '37f21d6d15cf40a586edda211219fd08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ebb970305844dccacf48a7d8d47ecf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:52:20.970608 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-d57161f2-87c8-413c-8ae9-0cc16f8a4067 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] 10.222.0.11 "GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7" status: 200 len: 1803 microversion: 2.20 time: 0.161701 Nov 17 03:52:20.971162 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 1168/2533] 10.222.0.11 () {60 vars in 1276 bytes} [Wed Nov 17 03:52:20 2021] GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7 => generated 1803 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 17 03:52:20.990466 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-bcb05558-5684-42e2-a7d9-a1264ed8a855 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] 10.222.0.11 "DELETE /compute/v2.1/servers/15abb40f-daf9-4c4b-ac9c-55f57ee7b938" status: 204 len: 0 microversion: 2.1 time: 0.121623 Nov 17 03:52:20.991041 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 1366/2534] 10.222.0.11 () {58 vars in 1238 bytes} [Wed Nov 17 03:52:20 2021] DELETE /compute/v2.1/servers/15abb40f-daf9-4c4b-ac9c-55f57ee7b938 => generated 0 bytes in 123 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 17 03:52:20.999040 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-ea3a4c4f-51ba-4d7c-a683-cf28b395b109 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:52:20.999586 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-ea3a4c4f-51ba-4d7c-a683-cf28b395b109 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] [instance: 15abb40f-daf9-4c4b-ac9c-55f57ee7b938] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:52:21.005672 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-ea3a4c4f-51ba-4d7c-a683-cf28b395b109 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:52:21.006112 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-ea3a4c4f-51ba-4d7c-a683-cf28b395b109 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:52:21.006873 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-ea3a4c4f-51ba-4d7c-a683-cf28b395b109 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:52:21.007318 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-ea3a4c4f-51ba-4d7c-a683-cf28b395b109 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:52:21.134222 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-6b0433ee-855e-4b65-8e2d-bc163767e775 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:52:21.134916 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-6b0433ee-855e-4b65-8e2d-bc163767e775 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] [instance: 0698dc5b-5f47-46c4-ace8-f5e891a964a0] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:52:21.140327 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-ea3a4c4f-51ba-4d7c-a683-cf28b395b109 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a792b5b7e6f7461b8d802a5abaaa9518', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e843a3fb49f41dcb376184d7e156528', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:52:21.141657 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-6b0433ee-855e-4b65-8e2d-bc163767e775 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:52:21.142093 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-6b0433ee-855e-4b65-8e2d-bc163767e775 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:52:21.142866 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-6b0433ee-855e-4b65-8e2d-bc163767e775 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:52:21.143293 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-6b0433ee-855e-4b65-8e2d-bc163767e775 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:52:21.148528 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-ea3a4c4f-51ba-4d7c-a683-cf28b395b109 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] 10.222.0.11 "GET /compute/v2.1/servers/15abb40f-daf9-4c4b-ac9c-55f57ee7b938" status: 200 len: 1558 microversion: 2.1 time: 0.153152 Nov 17 03:52:21.149139 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 1169/2535] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:52:20 2021] GET /compute/v2.1/servers/15abb40f-daf9-4c4b-ac9c-55f57ee7b938 => generated 1558 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:52:21.212588 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-6b0433ee-855e-4b65-8e2d-bc163767e775 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '163b2f24a72649ac8084be1cac32fa09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e123e9b86124c93a7fc2db9984e7466', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:52:21.220451 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-6b0433ee-855e-4b65-8e2d-bc163767e775 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] 10.222.0.11 "GET /compute/v2.1/servers/0698dc5b-5f47-46c4-ace8-f5e891a964a0" status: 200 len: 1218 microversion: 2.1 time: 0.090297 Nov 17 03:52:21.221014 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 1367/2536] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:52:21 2021] GET /compute/v2.1/servers/0698dc5b-5f47-46c4-ace8-f5e891a964a0 => generated 1218 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:52:21.993792 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-5b8ca860-42ad-461d-aa8a-475c42fd7d70 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:52:21.994737 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-5b8ca860-42ad-461d-aa8a-475c42fd7d70 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] [instance: 5d54db85-b991-4890-abaa-952413baa2e7] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:52:22.005603 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-5b8ca860-42ad-461d-aa8a-475c42fd7d70 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:52:22.006334 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-5b8ca860-42ad-461d-aa8a-475c42fd7d70 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:52:22.007598 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-5b8ca860-42ad-461d-aa8a-475c42fd7d70 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:52:22.008304 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-5b8ca860-42ad-461d-aa8a-475c42fd7d70 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:52:22.149032 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-5b8ca860-42ad-461d-aa8a-475c42fd7d70 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37f21d6d15cf40a586edda211219fd08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ebb970305844dccacf48a7d8d47ecf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:52:22.158449 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-5b8ca860-42ad-461d-aa8a-475c42fd7d70 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '37f21d6d15cf40a586edda211219fd08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ebb970305844dccacf48a7d8d47ecf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:52:22.159943 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-5b8ca860-42ad-461d-aa8a-475c42fd7d70 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '37f21d6d15cf40a586edda211219fd08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ebb970305844dccacf48a7d8d47ecf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:52:22.161105 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-5b8ca860-42ad-461d-aa8a-475c42fd7d70 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] 10.222.0.11 "GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7" status: 200 len: 1803 microversion: 2.20 time: 0.173743 Nov 17 03:52:22.161644 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 1170/2537] 10.222.0.11 () {60 vars in 1276 bytes} [Wed Nov 17 03:52:21 2021] GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7 => generated 1803 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 17 03:52:22.167419 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-84f67ef6-8c68-4f53-be28-7a8c074e24cd tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:52:22.168037 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-84f67ef6-8c68-4f53-be28-7a8c074e24cd tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] [instance: 15abb40f-daf9-4c4b-ac9c-55f57ee7b938] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:52:22.174680 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-84f67ef6-8c68-4f53-be28-7a8c074e24cd tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:52:22.175131 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-84f67ef6-8c68-4f53-be28-7a8c074e24cd tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:52:22.175907 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-84f67ef6-8c68-4f53-be28-7a8c074e24cd tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:52:22.176338 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-84f67ef6-8c68-4f53-be28-7a8c074e24cd tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:52:22.237507 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-8decf1d1-651e-4cbe-98c1-cb43aab00cd5 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:52:22.238117 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-8decf1d1-651e-4cbe-98c1-cb43aab00cd5 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] [instance: 0698dc5b-5f47-46c4-ace8-f5e891a964a0] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:52:22.244516 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-8decf1d1-651e-4cbe-98c1-cb43aab00cd5 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:52:22.244916 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-8decf1d1-651e-4cbe-98c1-cb43aab00cd5 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:52:22.245697 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-8decf1d1-651e-4cbe-98c1-cb43aab00cd5 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:52:22.246139 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-8decf1d1-651e-4cbe-98c1-cb43aab00cd5 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:52:22.309853 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-8decf1d1-651e-4cbe-98c1-cb43aab00cd5 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '163b2f24a72649ac8084be1cac32fa09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e123e9b86124c93a7fc2db9984e7466', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:52:22.311456 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-84f67ef6-8c68-4f53-be28-7a8c074e24cd tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a792b5b7e6f7461b8d802a5abaaa9518', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e843a3fb49f41dcb376184d7e156528', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:52:22.318741 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-8decf1d1-651e-4cbe-98c1-cb43aab00cd5 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] 10.222.0.11 "GET /compute/v2.1/servers/0698dc5b-5f47-46c4-ace8-f5e891a964a0" status: 200 len: 1218 microversion: 2.1 time: 0.085094 Nov 17 03:52:22.319405 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 1171/2538] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:52:22 2021] GET /compute/v2.1/servers/0698dc5b-5f47-46c4-ace8-f5e891a964a0 => generated 1218 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 17 03:52:22.319558 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-84f67ef6-8c68-4f53-be28-7a8c074e24cd tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] 10.222.0.11 "GET /compute/v2.1/servers/15abb40f-daf9-4c4b-ac9c-55f57ee7b938" status: 200 len: 1558 microversion: 2.1 time: 0.155816 Nov 17 03:52:22.320113 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 1368/2539] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:52:22 2021] GET /compute/v2.1/servers/15abb40f-daf9-4c4b-ac9c-55f57ee7b938 => generated 1558 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:52:23.184208 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-2cab4bd1-98b4-49de-aa4b-4d69e7977124 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:52:23.185161 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-2cab4bd1-98b4-49de-aa4b-4d69e7977124 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] [instance: 5d54db85-b991-4890-abaa-952413baa2e7] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:52:23.195630 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-2cab4bd1-98b4-49de-aa4b-4d69e7977124 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:52:23.196369 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-2cab4bd1-98b4-49de-aa4b-4d69e7977124 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:52:23.197676 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-2cab4bd1-98b4-49de-aa4b-4d69e7977124 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:52:23.198383 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-2cab4bd1-98b4-49de-aa4b-4d69e7977124 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:52:23.335855 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-453a4998-e53b-4311-b921-ed73ffc42b2c tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:52:23.336485 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-453a4998-e53b-4311-b921-ed73ffc42b2c tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] [instance: 0698dc5b-5f47-46c4-ace8-f5e891a964a0] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:52:23.338964 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-2cab4bd1-98b4-49de-aa4b-4d69e7977124 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37f21d6d15cf40a586edda211219fd08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ebb970305844dccacf48a7d8d47ecf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:52:23.343658 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-453a4998-e53b-4311-b921-ed73ffc42b2c tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:52:23.344100 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-453a4998-e53b-4311-b921-ed73ffc42b2c tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:52:23.344923 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-453a4998-e53b-4311-b921-ed73ffc42b2c tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:52:23.345959 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-453a4998-e53b-4311-b921-ed73ffc42b2c tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:52:23.348084 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-2cab4bd1-98b4-49de-aa4b-4d69e7977124 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '37f21d6d15cf40a586edda211219fd08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ebb970305844dccacf48a7d8d47ecf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:52:23.349665 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-2cab4bd1-98b4-49de-aa4b-4d69e7977124 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '37f21d6d15cf40a586edda211219fd08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ebb970305844dccacf48a7d8d47ecf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:52:23.350860 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-2cab4bd1-98b4-49de-aa4b-4d69e7977124 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] 10.222.0.11 "GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7" status: 200 len: 1803 microversion: 2.20 time: 0.172938 Nov 17 03:52:23.351426 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 1172/2540] 10.222.0.11 () {60 vars in 1276 bytes} [Wed Nov 17 03:52:23 2021] GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7 => generated 1803 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 17 03:52:23.356135 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-4d6e1f6e-e68e-4e31-beb7-1bcb9a180377 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:52:23.356723 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-4d6e1f6e-e68e-4e31-beb7-1bcb9a180377 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] [instance: 15abb40f-daf9-4c4b-ac9c-55f57ee7b938] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:52:23.362960 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-4d6e1f6e-e68e-4e31-beb7-1bcb9a180377 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:52:23.363391 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-4d6e1f6e-e68e-4e31-beb7-1bcb9a180377 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:52:23.364158 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-4d6e1f6e-e68e-4e31-beb7-1bcb9a180377 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:52:23.364592 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-4d6e1f6e-e68e-4e31-beb7-1bcb9a180377 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:52:23.409200 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-453a4998-e53b-4311-b921-ed73ffc42b2c tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '163b2f24a72649ac8084be1cac32fa09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e123e9b86124c93a7fc2db9984e7466', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:52:23.416513 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-453a4998-e53b-4311-b921-ed73ffc42b2c tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] 10.222.0.11 "GET /compute/v2.1/servers/0698dc5b-5f47-46c4-ace8-f5e891a964a0" status: 200 len: 1218 microversion: 2.1 time: 0.084378 Nov 17 03:52:23.417104 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 1369/2541] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:52:23 2021] GET /compute/v2.1/servers/0698dc5b-5f47-46c4-ace8-f5e891a964a0 => generated 1218 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:52:23.493330 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-4d6e1f6e-e68e-4e31-beb7-1bcb9a180377 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a792b5b7e6f7461b8d802a5abaaa9518', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e843a3fb49f41dcb376184d7e156528', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:52:23.501954 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-4d6e1f6e-e68e-4e31-beb7-1bcb9a180377 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] 10.222.0.11 "GET /compute/v2.1/servers/15abb40f-daf9-4c4b-ac9c-55f57ee7b938" status: 200 len: 1558 microversion: 2.1 time: 0.149292 Nov 17 03:52:23.502531 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 1173/2542] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:52:23 2021] GET /compute/v2.1/servers/15abb40f-daf9-4c4b-ac9c-55f57ee7b938 => generated 1558 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:52:24.371898 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-5e74412c-55d5-485c-89fb-58d91f708741 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:52:24.372595 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-5e74412c-55d5-485c-89fb-58d91f708741 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] [instance: 5d54db85-b991-4890-abaa-952413baa2e7] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:52:24.381363 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-5e74412c-55d5-485c-89fb-58d91f708741 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:52:24.381968 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-5e74412c-55d5-485c-89fb-58d91f708741 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:52:24.382960 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-5e74412c-55d5-485c-89fb-58d91f708741 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:52:24.383538 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-5e74412c-55d5-485c-89fb-58d91f708741 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:52:24.433847 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-bdf30e35-e783-43be-8450-d020ba1b7e6d tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:52:24.434475 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-bdf30e35-e783-43be-8450-d020ba1b7e6d tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] [instance: 0698dc5b-5f47-46c4-ace8-f5e891a964a0] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:52:24.441399 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-bdf30e35-e783-43be-8450-d020ba1b7e6d tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:52:24.441844 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-bdf30e35-e783-43be-8450-d020ba1b7e6d tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:52:24.442615 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-bdf30e35-e783-43be-8450-d020ba1b7e6d tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:52:24.443040 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-bdf30e35-e783-43be-8450-d020ba1b7e6d tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:52:24.506503 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-bdf30e35-e783-43be-8450-d020ba1b7e6d tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '163b2f24a72649ac8084be1cac32fa09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e123e9b86124c93a7fc2db9984e7466', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:52:24.514125 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-bdf30e35-e783-43be-8450-d020ba1b7e6d tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] 10.222.0.11 "GET /compute/v2.1/servers/0698dc5b-5f47-46c4-ace8-f5e891a964a0" status: 200 len: 1218 microversion: 2.1 time: 0.083908 Nov 17 03:52:24.514673 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 1174/2543] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:52:24 2021] GET /compute/v2.1/servers/0698dc5b-5f47-46c4-ace8-f5e891a964a0 => generated 1218 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 17 03:52:24.519272 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-9bd70008-8a02-4a5d-8a42-298599f596d3 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:52:24.519853 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-9bd70008-8a02-4a5d-8a42-298599f596d3 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] [instance: 15abb40f-daf9-4c4b-ac9c-55f57ee7b938] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:52:24.525549 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-9bd70008-8a02-4a5d-8a42-298599f596d3 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:52:24.525993 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-9bd70008-8a02-4a5d-8a42-298599f596d3 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:52:24.526758 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-9bd70008-8a02-4a5d-8a42-298599f596d3 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:52:24.527184 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-9bd70008-8a02-4a5d-8a42-298599f596d3 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:52:24.527298 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-5e74412c-55d5-485c-89fb-58d91f708741 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37f21d6d15cf40a586edda211219fd08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ebb970305844dccacf48a7d8d47ecf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:52:24.536129 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-5e74412c-55d5-485c-89fb-58d91f708741 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '37f21d6d15cf40a586edda211219fd08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ebb970305844dccacf48a7d8d47ecf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:52:24.537751 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-5e74412c-55d5-485c-89fb-58d91f708741 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '37f21d6d15cf40a586edda211219fd08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ebb970305844dccacf48a7d8d47ecf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:52:24.538933 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-5e74412c-55d5-485c-89fb-58d91f708741 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] 10.222.0.11 "GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7" status: 200 len: 1803 microversion: 2.20 time: 0.172151 Nov 17 03:52:24.539488 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 1370/2544] 10.222.0.11 () {60 vars in 1276 bytes} [Wed Nov 17 03:52:24 2021] GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7 => generated 1803 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 17 03:52:24.684144 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-9bd70008-8a02-4a5d-8a42-298599f596d3 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a792b5b7e6f7461b8d802a5abaaa9518', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e843a3fb49f41dcb376184d7e156528', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:52:24.694593 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-9bd70008-8a02-4a5d-8a42-298599f596d3 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] 10.222.0.11 "GET /compute/v2.1/servers/15abb40f-daf9-4c4b-ac9c-55f57ee7b938" status: 200 len: 1558 microversion: 2.1 time: 0.178945 Nov 17 03:52:24.695170 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 1175/2545] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:52:24 2021] GET /compute/v2.1/servers/15abb40f-daf9-4c4b-ac9c-55f57ee7b938 => generated 1558 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:52:25.535183 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-90f13877-3041-4d6f-bdd5-253835fd357d tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:52:25.535764 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-90f13877-3041-4d6f-bdd5-253835fd357d tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] [instance: 0698dc5b-5f47-46c4-ace8-f5e891a964a0] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:52:25.542442 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-90f13877-3041-4d6f-bdd5-253835fd357d tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:52:25.542888 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-90f13877-3041-4d6f-bdd5-253835fd357d tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:52:25.543651 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-90f13877-3041-4d6f-bdd5-253835fd357d tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:52:25.544079 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-90f13877-3041-4d6f-bdd5-253835fd357d tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:52:25.557655 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-f01c5801-3668-4470-bfb6-565d9db2ca70 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:52:25.558210 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-f01c5801-3668-4470-bfb6-565d9db2ca70 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] [instance: 5d54db85-b991-4890-abaa-952413baa2e7] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:52:25.564944 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-f01c5801-3668-4470-bfb6-565d9db2ca70 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:52:25.565980 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-f01c5801-3668-4470-bfb6-565d9db2ca70 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:52:25.566781 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-f01c5801-3668-4470-bfb6-565d9db2ca70 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:52:25.567896 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-f01c5801-3668-4470-bfb6-565d9db2ca70 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:52:25.619936 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-90f13877-3041-4d6f-bdd5-253835fd357d tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '163b2f24a72649ac8084be1cac32fa09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e123e9b86124c93a7fc2db9984e7466', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:52:25.627422 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-90f13877-3041-4d6f-bdd5-253835fd357d tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] 10.222.0.11 "GET /compute/v2.1/servers/0698dc5b-5f47-46c4-ace8-f5e891a964a0" status: 200 len: 1218 microversion: 2.1 time: 0.098452 Nov 17 03:52:25.628266 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 1371/2546] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:52:25 2021] GET /compute/v2.1/servers/0698dc5b-5f47-46c4-ace8-f5e891a964a0 => generated 1218 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:52:25.699039 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-f01c5801-3668-4470-bfb6-565d9db2ca70 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37f21d6d15cf40a586edda211219fd08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ebb970305844dccacf48a7d8d47ecf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:52:25.707503 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-f01c5801-3668-4470-bfb6-565d9db2ca70 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '37f21d6d15cf40a586edda211219fd08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ebb970305844dccacf48a7d8d47ecf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:52:25.709018 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-f01c5801-3668-4470-bfb6-565d9db2ca70 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '37f21d6d15cf40a586edda211219fd08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ebb970305844dccacf48a7d8d47ecf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:52:25.710752 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-f01c5801-3668-4470-bfb6-565d9db2ca70 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] 10.222.0.11 "GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7" status: 200 len: 1803 microversion: 2.20 time: 0.156886 Nov 17 03:52:25.711310 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 1176/2547] 10.222.0.11 () {60 vars in 1276 bytes} [Wed Nov 17 03:52:25 2021] GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7 => generated 1803 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 17 03:52:25.719696 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-80ab98bb-cdf2-4e11-bd3d-f93fa5e425e4 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:52:25.720562 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-80ab98bb-cdf2-4e11-bd3d-f93fa5e425e4 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] [instance: 15abb40f-daf9-4c4b-ac9c-55f57ee7b938] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:52:25.727669 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-80ab98bb-cdf2-4e11-bd3d-f93fa5e425e4 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:52:25.728110 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-80ab98bb-cdf2-4e11-bd3d-f93fa5e425e4 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:52:25.728907 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-80ab98bb-cdf2-4e11-bd3d-f93fa5e425e4 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:52:25.729354 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-80ab98bb-cdf2-4e11-bd3d-f93fa5e425e4 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:52:25.864704 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-80ab98bb-cdf2-4e11-bd3d-f93fa5e425e4 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a792b5b7e6f7461b8d802a5abaaa9518', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e843a3fb49f41dcb376184d7e156528', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:52:25.873210 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-80ab98bb-cdf2-4e11-bd3d-f93fa5e425e4 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] 10.222.0.11 "GET /compute/v2.1/servers/15abb40f-daf9-4c4b-ac9c-55f57ee7b938" status: 200 len: 1558 microversion: 2.1 time: 0.159533 Nov 17 03:52:25.873780 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 1372/2548] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:52:25 2021] GET /compute/v2.1/servers/15abb40f-daf9-4c4b-ac9c-55f57ee7b938 => generated 1558 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:52:26.648560 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-c46d70b2-41ff-4651-9872-76216ab0602d tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:52:26.649563 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-c46d70b2-41ff-4651-9872-76216ab0602d tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] [instance: 0698dc5b-5f47-46c4-ace8-f5e891a964a0] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:52:26.660135 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-c46d70b2-41ff-4651-9872-76216ab0602d tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:52:26.660909 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-c46d70b2-41ff-4651-9872-76216ab0602d tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:52:26.662177 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-c46d70b2-41ff-4651-9872-76216ab0602d tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:52:26.662876 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-c46d70b2-41ff-4651-9872-76216ab0602d tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:52:26.731322 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-c46d70b2-41ff-4651-9872-76216ab0602d tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '163b2f24a72649ac8084be1cac32fa09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e123e9b86124c93a7fc2db9984e7466', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:52:26.733295 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-54ec8802-5e0d-4452-8792-48fe8343d195 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:52:26.733953 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-54ec8802-5e0d-4452-8792-48fe8343d195 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] [instance: 5d54db85-b991-4890-abaa-952413baa2e7] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:52:26.739709 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-c46d70b2-41ff-4651-9872-76216ab0602d tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] 10.222.0.11 "GET /compute/v2.1/servers/0698dc5b-5f47-46c4-ace8-f5e891a964a0" status: 200 len: 1218 microversion: 2.1 time: 0.097371 Nov 17 03:52:26.740282 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 1177/2549] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:52:26 2021] GET /compute/v2.1/servers/0698dc5b-5f47-46c4-ace8-f5e891a964a0 => generated 1218 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:52:26.741111 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-54ec8802-5e0d-4452-8792-48fe8343d195 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:52:26.741566 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-54ec8802-5e0d-4452-8792-48fe8343d195 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:52:26.742351 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-54ec8802-5e0d-4452-8792-48fe8343d195 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:52:26.742783 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-54ec8802-5e0d-4452-8792-48fe8343d195 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:52:26.884752 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-54ec8802-5e0d-4452-8792-48fe8343d195 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37f21d6d15cf40a586edda211219fd08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ebb970305844dccacf48a7d8d47ecf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:52:26.889468 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-166893bc-91a9-475f-9448-2f0506e606bb tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:52:26.890081 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-166893bc-91a9-475f-9448-2f0506e606bb tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] [instance: 15abb40f-daf9-4c4b-ac9c-55f57ee7b938] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:52:26.893575 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-54ec8802-5e0d-4452-8792-48fe8343d195 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '37f21d6d15cf40a586edda211219fd08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ebb970305844dccacf48a7d8d47ecf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:52:26.895283 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-54ec8802-5e0d-4452-8792-48fe8343d195 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '37f21d6d15cf40a586edda211219fd08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ebb970305844dccacf48a7d8d47ecf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:52:26.896516 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-166893bc-91a9-475f-9448-2f0506e606bb tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:52:26.896664 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-54ec8802-5e0d-4452-8792-48fe8343d195 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] 10.222.0.11 "GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7" status: 200 len: 1803 microversion: 2.20 time: 0.167142 Nov 17 03:52:26.897000 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-166893bc-91a9-475f-9448-2f0506e606bb tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:52:26.897433 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 1373/2550] 10.222.0.11 () {60 vars in 1276 bytes} [Wed Nov 17 03:52:26 2021] GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7 => generated 1803 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 17 03:52:26.898415 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-166893bc-91a9-475f-9448-2f0506e606bb tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:52:26.899016 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-166893bc-91a9-475f-9448-2f0506e606bb tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:52:27.029312 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-166893bc-91a9-475f-9448-2f0506e606bb tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a792b5b7e6f7461b8d802a5abaaa9518', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e843a3fb49f41dcb376184d7e156528', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:52:27.037254 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-166893bc-91a9-475f-9448-2f0506e606bb tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] 10.222.0.11 "GET /compute/v2.1/servers/15abb40f-daf9-4c4b-ac9c-55f57ee7b938" status: 200 len: 1558 microversion: 2.1 time: 0.151353 Nov 17 03:52:27.037798 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 1178/2551] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:52:26 2021] GET /compute/v2.1/servers/15abb40f-daf9-4c4b-ac9c-55f57ee7b938 => generated 1558 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:52:27.763190 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-b41e8fe1-b74d-46d4-8d9f-c71b6cef655d tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:52:27.764174 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-b41e8fe1-b74d-46d4-8d9f-c71b6cef655d tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] [instance: 0698dc5b-5f47-46c4-ace8-f5e891a964a0] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:52:27.774728 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-b41e8fe1-b74d-46d4-8d9f-c71b6cef655d tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:52:27.775463 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-b41e8fe1-b74d-46d4-8d9f-c71b6cef655d tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:52:27.776710 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-b41e8fe1-b74d-46d4-8d9f-c71b6cef655d tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:52:27.777491 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-b41e8fe1-b74d-46d4-8d9f-c71b6cef655d tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:52:27.839775 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-b41e8fe1-b74d-46d4-8d9f-c71b6cef655d tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '163b2f24a72649ac8084be1cac32fa09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e123e9b86124c93a7fc2db9984e7466', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:52:27.847494 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-b41e8fe1-b74d-46d4-8d9f-c71b6cef655d tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] 10.222.0.11 "GET /compute/v2.1/servers/0698dc5b-5f47-46c4-ace8-f5e891a964a0" status: 200 len: 1218 microversion: 2.1 time: 0.090445 Nov 17 03:52:27.848057 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 1374/2552] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:52:27 2021] GET /compute/v2.1/servers/0698dc5b-5f47-46c4-ace8-f5e891a964a0 => generated 1218 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:52:27.926023 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-76e4c9b1-90c0-45fc-b012-98a2713d7b47 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:52:27.927380 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-76e4c9b1-90c0-45fc-b012-98a2713d7b47 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] [instance: 5d54db85-b991-4890-abaa-952413baa2e7] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:52:27.938341 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-76e4c9b1-90c0-45fc-b012-98a2713d7b47 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:52:27.939146 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-76e4c9b1-90c0-45fc-b012-98a2713d7b47 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:52:27.940591 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-76e4c9b1-90c0-45fc-b012-98a2713d7b47 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:52:27.941307 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-76e4c9b1-90c0-45fc-b012-98a2713d7b47 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:52:28.054766 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-cdc4bf6d-a564-4862-9b12-88a587bf8c14 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:52:28.055519 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-cdc4bf6d-a564-4862-9b12-88a587bf8c14 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] [instance: 15abb40f-daf9-4c4b-ac9c-55f57ee7b938] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:52:28.061396 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-cdc4bf6d-a564-4862-9b12-88a587bf8c14 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:52:28.061837 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-cdc4bf6d-a564-4862-9b12-88a587bf8c14 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:52:28.062608 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-cdc4bf6d-a564-4862-9b12-88a587bf8c14 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:52:28.063031 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-cdc4bf6d-a564-4862-9b12-88a587bf8c14 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:52:28.086592 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-76e4c9b1-90c0-45fc-b012-98a2713d7b47 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37f21d6d15cf40a586edda211219fd08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ebb970305844dccacf48a7d8d47ecf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:52:28.095239 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-76e4c9b1-90c0-45fc-b012-98a2713d7b47 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '37f21d6d15cf40a586edda211219fd08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ebb970305844dccacf48a7d8d47ecf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:52:28.096852 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-76e4c9b1-90c0-45fc-b012-98a2713d7b47 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '37f21d6d15cf40a586edda211219fd08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ebb970305844dccacf48a7d8d47ecf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:52:28.098353 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-76e4c9b1-90c0-45fc-b012-98a2713d7b47 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] 10.222.0.11 "GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7" status: 200 len: 1803 microversion: 2.20 time: 0.185149 Nov 17 03:52:28.099187 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 1179/2553] 10.222.0.11 () {60 vars in 1276 bytes} [Wed Nov 17 03:52:27 2021] GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7 => generated 1803 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 17 03:52:28.195454 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-cdc4bf6d-a564-4862-9b12-88a587bf8c14 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a792b5b7e6f7461b8d802a5abaaa9518', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e843a3fb49f41dcb376184d7e156528', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:52:28.203995 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-cdc4bf6d-a564-4862-9b12-88a587bf8c14 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] 10.222.0.11 "GET /compute/v2.1/servers/15abb40f-daf9-4c4b-ac9c-55f57ee7b938" status: 200 len: 1558 microversion: 2.1 time: 0.153276 Nov 17 03:52:28.204559 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 1375/2554] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:52:28 2021] GET /compute/v2.1/servers/15abb40f-daf9-4c4b-ac9c-55f57ee7b938 => generated 1558 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:52:28.863743 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-472322ef-a967-4acd-8209-84fc481c4c9f tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:52:28.864420 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-472322ef-a967-4acd-8209-84fc481c4c9f tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] [instance: 0698dc5b-5f47-46c4-ace8-f5e891a964a0] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:52:28.870945 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-472322ef-a967-4acd-8209-84fc481c4c9f tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:52:28.871389 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-472322ef-a967-4acd-8209-84fc481c4c9f tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:52:28.872147 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-472322ef-a967-4acd-8209-84fc481c4c9f tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:52:28.872569 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-472322ef-a967-4acd-8209-84fc481c4c9f tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:52:28.935992 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-472322ef-a967-4acd-8209-84fc481c4c9f tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '163b2f24a72649ac8084be1cac32fa09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e123e9b86124c93a7fc2db9984e7466', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:52:28.943564 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-472322ef-a967-4acd-8209-84fc481c4c9f tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] 10.222.0.11 "GET /compute/v2.1/servers/0698dc5b-5f47-46c4-ace8-f5e891a964a0" status: 200 len: 1218 microversion: 2.1 time: 0.083766 Nov 17 03:52:28.944122 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 1180/2555] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:52:28 2021] GET /compute/v2.1/servers/0698dc5b-5f47-46c4-ace8-f5e891a964a0 => generated 1218 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:52:29.118438 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-ea5cea80-1ec0-4ce5-84df-698b601724b1 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:52:29.119530 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-ea5cea80-1ec0-4ce5-84df-698b601724b1 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] [instance: 5d54db85-b991-4890-abaa-952413baa2e7] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:52:29.128796 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-ea5cea80-1ec0-4ce5-84df-698b601724b1 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:52:29.129790 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-ea5cea80-1ec0-4ce5-84df-698b601724b1 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:52:29.131134 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-ea5cea80-1ec0-4ce5-84df-698b601724b1 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:52:29.131748 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-ea5cea80-1ec0-4ce5-84df-698b601724b1 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:52:29.221213 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-fee5ee0d-32b3-4236-b6f4-17537d724345 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:52:29.221821 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-fee5ee0d-32b3-4236-b6f4-17537d724345 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] [instance: 15abb40f-daf9-4c4b-ac9c-55f57ee7b938] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:52:29.228721 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-fee5ee0d-32b3-4236-b6f4-17537d724345 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:52:29.229215 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-fee5ee0d-32b3-4236-b6f4-17537d724345 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:52:29.230001 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-fee5ee0d-32b3-4236-b6f4-17537d724345 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:52:29.230433 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-fee5ee0d-32b3-4236-b6f4-17537d724345 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:52:29.267144 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-ea5cea80-1ec0-4ce5-84df-698b601724b1 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37f21d6d15cf40a586edda211219fd08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ebb970305844dccacf48a7d8d47ecf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:52:29.276155 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-ea5cea80-1ec0-4ce5-84df-698b601724b1 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '37f21d6d15cf40a586edda211219fd08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ebb970305844dccacf48a7d8d47ecf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:52:29.277673 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-ea5cea80-1ec0-4ce5-84df-698b601724b1 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '37f21d6d15cf40a586edda211219fd08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ebb970305844dccacf48a7d8d47ecf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:52:29.278832 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-ea5cea80-1ec0-4ce5-84df-698b601724b1 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] 10.222.0.11 "GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7" status: 200 len: 1803 microversion: 2.20 time: 0.165892 Nov 17 03:52:29.279386 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 1376/2556] 10.222.0.11 () {60 vars in 1276 bytes} [Wed Nov 17 03:52:29 2021] GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7 => generated 1803 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 17 03:52:29.365179 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-fee5ee0d-32b3-4236-b6f4-17537d724345 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a792b5b7e6f7461b8d802a5abaaa9518', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e843a3fb49f41dcb376184d7e156528', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:52:29.376916 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-fee5ee0d-32b3-4236-b6f4-17537d724345 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] 10.222.0.11 "GET /compute/v2.1/servers/15abb40f-daf9-4c4b-ac9c-55f57ee7b938" status: 200 len: 1558 microversion: 2.1 time: 0.159009 Nov 17 03:52:29.377571 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 1181/2557] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:52:29 2021] GET /compute/v2.1/servers/15abb40f-daf9-4c4b-ac9c-55f57ee7b938 => generated 1558 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:52:29.963521 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-72a14005-dad6-4dc4-925b-38758a35b02f tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:52:29.964333 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-72a14005-dad6-4dc4-925b-38758a35b02f tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] [instance: 0698dc5b-5f47-46c4-ace8-f5e891a964a0] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:52:29.973802 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-72a14005-dad6-4dc4-925b-38758a35b02f tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:52:29.974619 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-72a14005-dad6-4dc4-925b-38758a35b02f tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:52:29.975860 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-72a14005-dad6-4dc4-925b-38758a35b02f tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:52:29.976478 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-72a14005-dad6-4dc4-925b-38758a35b02f tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:52:30.043253 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-72a14005-dad6-4dc4-925b-38758a35b02f tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '163b2f24a72649ac8084be1cac32fa09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e123e9b86124c93a7fc2db9984e7466', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:52:30.054484 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-72a14005-dad6-4dc4-925b-38758a35b02f tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] 10.222.0.11 "GET /compute/v2.1/servers/0698dc5b-5f47-46c4-ace8-f5e891a964a0" status: 200 len: 1218 microversion: 2.1 time: 0.097323 Nov 17 03:52:30.055078 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 1377/2558] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:52:29 2021] GET /compute/v2.1/servers/0698dc5b-5f47-46c4-ace8-f5e891a964a0 => generated 1218 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:52:30.299234 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-9c84db56-b2d2-49df-b288-134d443ab779 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:52:30.300037 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-9c84db56-b2d2-49df-b288-134d443ab779 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] [instance: 5d54db85-b991-4890-abaa-952413baa2e7] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:52:30.309220 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-9c84db56-b2d2-49df-b288-134d443ab779 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:52:30.309818 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-9c84db56-b2d2-49df-b288-134d443ab779 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:52:30.310844 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-9c84db56-b2d2-49df-b288-134d443ab779 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:52:30.311415 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-9c84db56-b2d2-49df-b288-134d443ab779 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:52:30.394288 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-810d1e07-c1ed-4926-a31b-a42941e32bc7 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:52:30.394966 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-810d1e07-c1ed-4926-a31b-a42941e32bc7 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] [instance: 15abb40f-daf9-4c4b-ac9c-55f57ee7b938] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:52:30.401441 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-810d1e07-c1ed-4926-a31b-a42941e32bc7 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:52:30.401883 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-810d1e07-c1ed-4926-a31b-a42941e32bc7 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:52:30.402642 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-810d1e07-c1ed-4926-a31b-a42941e32bc7 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:52:30.403092 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-810d1e07-c1ed-4926-a31b-a42941e32bc7 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:52:30.452952 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-9c84db56-b2d2-49df-b288-134d443ab779 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37f21d6d15cf40a586edda211219fd08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ebb970305844dccacf48a7d8d47ecf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:52:30.461966 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-9c84db56-b2d2-49df-b288-134d443ab779 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '37f21d6d15cf40a586edda211219fd08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ebb970305844dccacf48a7d8d47ecf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:52:30.463466 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-9c84db56-b2d2-49df-b288-134d443ab779 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '37f21d6d15cf40a586edda211219fd08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ebb970305844dccacf48a7d8d47ecf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:52:30.464643 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-9c84db56-b2d2-49df-b288-134d443ab779 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] 10.222.0.11 "GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7" status: 200 len: 1803 microversion: 2.20 time: 0.170419 Nov 17 03:52:30.465350 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 1182/2559] 10.222.0.11 () {60 vars in 1276 bytes} [Wed Nov 17 03:52:30 2021] GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7 => generated 1803 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 17 03:52:30.538930 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-810d1e07-c1ed-4926-a31b-a42941e32bc7 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a792b5b7e6f7461b8d802a5abaaa9518', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e843a3fb49f41dcb376184d7e156528', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:52:30.550506 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-810d1e07-c1ed-4926-a31b-a42941e32bc7 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] 10.222.0.11 "GET /compute/v2.1/servers/15abb40f-daf9-4c4b-ac9c-55f57ee7b938" status: 200 len: 1558 microversion: 2.1 time: 0.159707 Nov 17 03:52:30.551161 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 1378/2560] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:52:30 2021] GET /compute/v2.1/servers/15abb40f-daf9-4c4b-ac9c-55f57ee7b938 => generated 1558 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:52:31.072890 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-1cce143e-5be9-4bc4-8946-94e85d372e5b tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:52:31.073572 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-1cce143e-5be9-4bc4-8946-94e85d372e5b tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] [instance: 0698dc5b-5f47-46c4-ace8-f5e891a964a0] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:52:31.080158 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-1cce143e-5be9-4bc4-8946-94e85d372e5b tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:52:31.080478 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-1cce143e-5be9-4bc4-8946-94e85d372e5b tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:52:31.081291 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-1cce143e-5be9-4bc4-8946-94e85d372e5b tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:52:31.081939 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-1cce143e-5be9-4bc4-8946-94e85d372e5b tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:52:31.144902 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-1cce143e-5be9-4bc4-8946-94e85d372e5b tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '163b2f24a72649ac8084be1cac32fa09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e123e9b86124c93a7fc2db9984e7466', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:52:31.152753 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-1cce143e-5be9-4bc4-8946-94e85d372e5b tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] 10.222.0.11 "GET /compute/v2.1/servers/0698dc5b-5f47-46c4-ace8-f5e891a964a0" status: 200 len: 1218 microversion: 2.1 time: 0.083698 Nov 17 03:52:31.153374 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 1183/2561] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:52:31 2021] GET /compute/v2.1/servers/0698dc5b-5f47-46c4-ace8-f5e891a964a0 => generated 1218 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:52:31.487130 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-869988c7-baad-4fc4-90c1-4cc12244d44f tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:52:31.487971 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-869988c7-baad-4fc4-90c1-4cc12244d44f tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] [instance: 5d54db85-b991-4890-abaa-952413baa2e7] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:52:31.495912 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-869988c7-baad-4fc4-90c1-4cc12244d44f tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:52:31.496349 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-869988c7-baad-4fc4-90c1-4cc12244d44f tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:52:31.497175 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-869988c7-baad-4fc4-90c1-4cc12244d44f tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:52:31.497614 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-869988c7-baad-4fc4-90c1-4cc12244d44f tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:52:31.571717 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-b3b8080e-fbd1-44a8-bdd1-c73f22e02aca tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:52:31.572340 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-b3b8080e-fbd1-44a8-bdd1-c73f22e02aca tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] [instance: 15abb40f-daf9-4c4b-ac9c-55f57ee7b938] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:52:31.578954 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-b3b8080e-fbd1-44a8-bdd1-c73f22e02aca tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:52:31.579432 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-b3b8080e-fbd1-44a8-bdd1-c73f22e02aca tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:52:31.580672 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-b3b8080e-fbd1-44a8-bdd1-c73f22e02aca tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:52:31.580811 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-b3b8080e-fbd1-44a8-bdd1-c73f22e02aca tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:52:31.633125 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-869988c7-baad-4fc4-90c1-4cc12244d44f tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37f21d6d15cf40a586edda211219fd08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ebb970305844dccacf48a7d8d47ecf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:52:31.641532 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-869988c7-baad-4fc4-90c1-4cc12244d44f tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '37f21d6d15cf40a586edda211219fd08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ebb970305844dccacf48a7d8d47ecf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:52:31.643017 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-869988c7-baad-4fc4-90c1-4cc12244d44f tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '37f21d6d15cf40a586edda211219fd08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ebb970305844dccacf48a7d8d47ecf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:52:31.644165 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-869988c7-baad-4fc4-90c1-4cc12244d44f tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] 10.222.0.11 "GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7" status: 200 len: 1803 microversion: 2.20 time: 0.163489 Nov 17 03:52:31.644712 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 1379/2562] 10.222.0.11 () {60 vars in 1276 bytes} [Wed Nov 17 03:52:31 2021] GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7 => generated 1803 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 17 03:52:31.713651 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-b3b8080e-fbd1-44a8-bdd1-c73f22e02aca tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a792b5b7e6f7461b8d802a5abaaa9518', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e843a3fb49f41dcb376184d7e156528', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:52:31.723127 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-b3b8080e-fbd1-44a8-bdd1-c73f22e02aca tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] 10.222.0.11 "GET /compute/v2.1/servers/15abb40f-daf9-4c4b-ac9c-55f57ee7b938" status: 200 len: 1558 microversion: 2.1 time: 0.155056 Nov 17 03:52:31.723705 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 1184/2563] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:52:31 2021] GET /compute/v2.1/servers/15abb40f-daf9-4c4b-ac9c-55f57ee7b938 => generated 1558 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:52:32.173674 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-cac0edd7-9255-4f9e-99b8-647b944bddf5 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:52:32.174670 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-cac0edd7-9255-4f9e-99b8-647b944bddf5 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] [instance: 0698dc5b-5f47-46c4-ace8-f5e891a964a0] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:52:32.182435 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-cac0edd7-9255-4f9e-99b8-647b944bddf5 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:52:32.182882 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-cac0edd7-9255-4f9e-99b8-647b944bddf5 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:52:32.183638 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-cac0edd7-9255-4f9e-99b8-647b944bddf5 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:52:32.184056 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-cac0edd7-9255-4f9e-99b8-647b944bddf5 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:52:32.244610 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-cac0edd7-9255-4f9e-99b8-647b944bddf5 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '163b2f24a72649ac8084be1cac32fa09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e123e9b86124c93a7fc2db9984e7466', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:52:32.257077 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-cac0edd7-9255-4f9e-99b8-647b944bddf5 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] 10.222.0.11 "GET /compute/v2.1/servers/0698dc5b-5f47-46c4-ace8-f5e891a964a0" status: 200 len: 1218 microversion: 2.1 time: 0.088645 Nov 17 03:52:32.257852 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 1380/2564] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:52:32 2021] GET /compute/v2.1/servers/0698dc5b-5f47-46c4-ace8-f5e891a964a0 => generated 1218 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:52:32.664948 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-f2cb2f76-6749-4db8-a010-62bb31026655 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:52:32.665574 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-f2cb2f76-6749-4db8-a010-62bb31026655 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] [instance: 5d54db85-b991-4890-abaa-952413baa2e7] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:52:32.672334 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-f2cb2f76-6749-4db8-a010-62bb31026655 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:52:32.672804 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-f2cb2f76-6749-4db8-a010-62bb31026655 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:52:32.673571 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-f2cb2f76-6749-4db8-a010-62bb31026655 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:52:32.673995 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-f2cb2f76-6749-4db8-a010-62bb31026655 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:52:32.745664 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-8a7076a3-2600-47c9-bc4d-e44dfe7e2946 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:52:32.746268 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-8a7076a3-2600-47c9-bc4d-e44dfe7e2946 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] [instance: 15abb40f-daf9-4c4b-ac9c-55f57ee7b938] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:52:32.752719 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-8a7076a3-2600-47c9-bc4d-e44dfe7e2946 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:52:32.753411 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-8a7076a3-2600-47c9-bc4d-e44dfe7e2946 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:52:32.754244 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-8a7076a3-2600-47c9-bc4d-e44dfe7e2946 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:52:32.754735 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-8a7076a3-2600-47c9-bc4d-e44dfe7e2946 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:52:32.809479 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-f2cb2f76-6749-4db8-a010-62bb31026655 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37f21d6d15cf40a586edda211219fd08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ebb970305844dccacf48a7d8d47ecf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:52:32.818425 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-f2cb2f76-6749-4db8-a010-62bb31026655 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '37f21d6d15cf40a586edda211219fd08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ebb970305844dccacf48a7d8d47ecf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:52:32.819906 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-f2cb2f76-6749-4db8-a010-62bb31026655 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '37f21d6d15cf40a586edda211219fd08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ebb970305844dccacf48a7d8d47ecf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:52:32.821094 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-f2cb2f76-6749-4db8-a010-62bb31026655 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] 10.222.0.11 "GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7" status: 200 len: 1803 microversion: 2.20 time: 0.160723 Nov 17 03:52:32.822007 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 1185/2565] 10.222.0.11 () {60 vars in 1276 bytes} [Wed Nov 17 03:52:32 2021] GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7 => generated 1803 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 17 03:52:32.888145 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-8a7076a3-2600-47c9-bc4d-e44dfe7e2946 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a792b5b7e6f7461b8d802a5abaaa9518', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e843a3fb49f41dcb376184d7e156528', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:52:32.899111 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-8a7076a3-2600-47c9-bc4d-e44dfe7e2946 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] 10.222.0.11 "GET /compute/v2.1/servers/15abb40f-daf9-4c4b-ac9c-55f57ee7b938" status: 200 len: 1558 microversion: 2.1 time: 0.157166 Nov 17 03:52:32.899683 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 1381/2566] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:52:32 2021] GET /compute/v2.1/servers/15abb40f-daf9-4c4b-ac9c-55f57ee7b938 => generated 1558 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:52:33.278400 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-7d5470a2-2fbd-48de-827f-4660aad41976 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:52:33.279480 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-7d5470a2-2fbd-48de-827f-4660aad41976 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] [instance: 0698dc5b-5f47-46c4-ace8-f5e891a964a0] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:52:33.289216 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-7d5470a2-2fbd-48de-827f-4660aad41976 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:52:33.289698 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-7d5470a2-2fbd-48de-827f-4660aad41976 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:52:33.290471 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-7d5470a2-2fbd-48de-827f-4660aad41976 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:52:33.290929 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-7d5470a2-2fbd-48de-827f-4660aad41976 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:52:33.370357 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-7d5470a2-2fbd-48de-827f-4660aad41976 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '163b2f24a72649ac8084be1cac32fa09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e123e9b86124c93a7fc2db9984e7466', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:52:33.378650 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-7d5470a2-2fbd-48de-827f-4660aad41976 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] 10.222.0.11 "GET /compute/v2.1/servers/0698dc5b-5f47-46c4-ace8-f5e891a964a0" status: 200 len: 1218 microversion: 2.1 time: 0.106474 Nov 17 03:52:33.379280 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 1186/2567] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:52:33 2021] GET /compute/v2.1/servers/0698dc5b-5f47-46c4-ace8-f5e891a964a0 => generated 1218 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:52:33.838586 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-23b05a1c-1c7c-4983-b06b-27feafaf8df6 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:52:33.839243 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-23b05a1c-1c7c-4983-b06b-27feafaf8df6 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] [instance: 5d54db85-b991-4890-abaa-952413baa2e7] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:52:33.845848 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-23b05a1c-1c7c-4983-b06b-27feafaf8df6 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:52:33.846289 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-23b05a1c-1c7c-4983-b06b-27feafaf8df6 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:52:33.847055 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-23b05a1c-1c7c-4983-b06b-27feafaf8df6 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:52:33.847494 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-23b05a1c-1c7c-4983-b06b-27feafaf8df6 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:52:33.921598 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-8e4b6ff9-b5c2-4a1a-9d75-22b46ac1a578 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:52:33.922316 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-8e4b6ff9-b5c2-4a1a-9d75-22b46ac1a578 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] [instance: 15abb40f-daf9-4c4b-ac9c-55f57ee7b938] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:52:33.929627 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-8e4b6ff9-b5c2-4a1a-9d75-22b46ac1a578 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:52:33.930081 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-8e4b6ff9-b5c2-4a1a-9d75-22b46ac1a578 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:52:33.930860 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-8e4b6ff9-b5c2-4a1a-9d75-22b46ac1a578 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:52:33.931267 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-8e4b6ff9-b5c2-4a1a-9d75-22b46ac1a578 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:52:34.076673 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-8e4b6ff9-b5c2-4a1a-9d75-22b46ac1a578 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a792b5b7e6f7461b8d802a5abaaa9518', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e843a3fb49f41dcb376184d7e156528', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:52:34.085464 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-8e4b6ff9-b5c2-4a1a-9d75-22b46ac1a578 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] 10.222.0.11 "GET /compute/v2.1/servers/15abb40f-daf9-4c4b-ac9c-55f57ee7b938" status: 200 len: 1558 microversion: 2.1 time: 0.167503 Nov 17 03:52:34.086065 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 1187/2568] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:52:33 2021] GET /compute/v2.1/servers/15abb40f-daf9-4c4b-ac9c-55f57ee7b938 => generated 1558 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:52:34.297380 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-23b05a1c-1c7c-4983-b06b-27feafaf8df6 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37f21d6d15cf40a586edda211219fd08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ebb970305844dccacf48a7d8d47ecf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:52:34.306659 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-23b05a1c-1c7c-4983-b06b-27feafaf8df6 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '37f21d6d15cf40a586edda211219fd08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ebb970305844dccacf48a7d8d47ecf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:52:34.308249 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-23b05a1c-1c7c-4983-b06b-27feafaf8df6 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '37f21d6d15cf40a586edda211219fd08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ebb970305844dccacf48a7d8d47ecf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:52:34.309538 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-23b05a1c-1c7c-4983-b06b-27feafaf8df6 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] 10.222.0.11 "GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7" status: 200 len: 1803 microversion: 2.20 time: 0.474737 Nov 17 03:52:34.310147 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 1382/2569] 10.222.0.11 () {60 vars in 1276 bytes} [Wed Nov 17 03:52:33 2021] GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7 => generated 1803 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 17 03:52:34.395768 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-d7c25a8a-7618-4f70-8985-d08aaaaa3c59 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:52:34.396558 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-d7c25a8a-7618-4f70-8985-d08aaaaa3c59 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] [instance: 0698dc5b-5f47-46c4-ace8-f5e891a964a0] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:52:34.403171 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-d7c25a8a-7618-4f70-8985-d08aaaaa3c59 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:52:34.403617 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-d7c25a8a-7618-4f70-8985-d08aaaaa3c59 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:52:34.404401 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-d7c25a8a-7618-4f70-8985-d08aaaaa3c59 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:52:34.404835 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-d7c25a8a-7618-4f70-8985-d08aaaaa3c59 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:52:34.465291 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-d7c25a8a-7618-4f70-8985-d08aaaaa3c59 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '163b2f24a72649ac8084be1cac32fa09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e123e9b86124c93a7fc2db9984e7466', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:52:34.473170 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-d7c25a8a-7618-4f70-8985-d08aaaaa3c59 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] 10.222.0.11 "GET /compute/v2.1/servers/0698dc5b-5f47-46c4-ace8-f5e891a964a0" status: 200 len: 1218 microversion: 2.1 time: 0.081115 Nov 17 03:52:34.473739 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 1188/2570] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:52:34 2021] GET /compute/v2.1/servers/0698dc5b-5f47-46c4-ace8-f5e891a964a0 => generated 1218 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:52:34.562215 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 17 03:52:34.562394 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: Wed Nov 17 03:52:34 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Nov 17 03:52:34.760354 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 17 03:52:34.760693 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: Wed Nov 17 03:52:34 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Nov 17 03:52:35.103416 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-4dabb01c-9754-4c79-91fd-399aec9c280a tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:52:35.103940 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-4dabb01c-9754-4c79-91fd-399aec9c280a tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] [instance: 15abb40f-daf9-4c4b-ac9c-55f57ee7b938] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:52:35.110807 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-4dabb01c-9754-4c79-91fd-399aec9c280a tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:52:35.111258 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-4dabb01c-9754-4c79-91fd-399aec9c280a tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:52:35.112031 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-4dabb01c-9754-4c79-91fd-399aec9c280a tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:52:35.112464 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-4dabb01c-9754-4c79-91fd-399aec9c280a tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:52:35.259360 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-4dabb01c-9754-4c79-91fd-399aec9c280a tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a792b5b7e6f7461b8d802a5abaaa9518', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e843a3fb49f41dcb376184d7e156528', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:52:35.267854 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-4dabb01c-9754-4c79-91fd-399aec9c280a tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] 10.222.0.11 "GET /compute/v2.1/servers/15abb40f-daf9-4c4b-ac9c-55f57ee7b938" status: 200 len: 1558 microversion: 2.1 time: 0.168538 Nov 17 03:52:35.268443 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 1383/2571] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:52:35 2021] GET /compute/v2.1/servers/15abb40f-daf9-4c4b-ac9c-55f57ee7b938 => generated 1558 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:52:35.331771 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-b07e4afc-6b03-4c39-9d65-d541028e1e6e tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:52:35.332370 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-b07e4afc-6b03-4c39-9d65-d541028e1e6e tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] [instance: 5d54db85-b991-4890-abaa-952413baa2e7] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:52:35.339948 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-b07e4afc-6b03-4c39-9d65-d541028e1e6e tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:52:35.340459 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-b07e4afc-6b03-4c39-9d65-d541028e1e6e tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:52:35.341586 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-b07e4afc-6b03-4c39-9d65-d541028e1e6e tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:52:35.342157 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-b07e4afc-6b03-4c39-9d65-d541028e1e6e tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:52:35.481107 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-b07e4afc-6b03-4c39-9d65-d541028e1e6e tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37f21d6d15cf40a586edda211219fd08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ebb970305844dccacf48a7d8d47ecf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:52:35.489919 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-b07e4afc-6b03-4c39-9d65-d541028e1e6e tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '37f21d6d15cf40a586edda211219fd08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ebb970305844dccacf48a7d8d47ecf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:52:35.490945 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-f40f8d0b-8715-423f-9f2d-c7b1bc78a2ba tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:52:35.491424 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-b07e4afc-6b03-4c39-9d65-d541028e1e6e tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '37f21d6d15cf40a586edda211219fd08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ebb970305844dccacf48a7d8d47ecf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:52:35.491597 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-f40f8d0b-8715-423f-9f2d-c7b1bc78a2ba tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] [instance: 0698dc5b-5f47-46c4-ace8-f5e891a964a0] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:52:35.492585 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-b07e4afc-6b03-4c39-9d65-d541028e1e6e tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] 10.222.0.11 "GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7" status: 200 len: 1803 microversion: 2.20 time: 0.167109 Nov 17 03:52:35.493169 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 1189/2572] 10.222.0.11 () {60 vars in 1276 bytes} [Wed Nov 17 03:52:35 2021] GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7 => generated 1803 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 17 03:52:35.497437 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-f40f8d0b-8715-423f-9f2d-c7b1bc78a2ba tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:52:35.497946 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-f40f8d0b-8715-423f-9f2d-c7b1bc78a2ba tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:52:35.498718 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-f40f8d0b-8715-423f-9f2d-c7b1bc78a2ba tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:52:35.499152 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-f40f8d0b-8715-423f-9f2d-c7b1bc78a2ba tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:52:35.559660 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-f40f8d0b-8715-423f-9f2d-c7b1bc78a2ba tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '163b2f24a72649ac8084be1cac32fa09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e123e9b86124c93a7fc2db9984e7466', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:52:35.570362 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-f40f8d0b-8715-423f-9f2d-c7b1bc78a2ba tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] 10.222.0.11 "GET /compute/v2.1/servers/0698dc5b-5f47-46c4-ace8-f5e891a964a0" status: 200 len: 1218 microversion: 2.1 time: 0.083466 Nov 17 03:52:35.570924 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 1384/2573] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:52:35 2021] GET /compute/v2.1/servers/0698dc5b-5f47-46c4-ace8-f5e891a964a0 => generated 1218 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 17 03:52:36.288499 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-98104dc7-23ee-4717-ba71-4ef8b6b56931 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:52:36.289135 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-98104dc7-23ee-4717-ba71-4ef8b6b56931 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] [instance: 15abb40f-daf9-4c4b-ac9c-55f57ee7b938] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:52:36.295455 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-98104dc7-23ee-4717-ba71-4ef8b6b56931 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:52:36.295898 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-98104dc7-23ee-4717-ba71-4ef8b6b56931 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:52:36.296655 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-98104dc7-23ee-4717-ba71-4ef8b6b56931 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:52:36.297113 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-98104dc7-23ee-4717-ba71-4ef8b6b56931 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:52:36.438491 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-98104dc7-23ee-4717-ba71-4ef8b6b56931 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a792b5b7e6f7461b8d802a5abaaa9518', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e843a3fb49f41dcb376184d7e156528', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:52:36.447064 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-98104dc7-23ee-4717-ba71-4ef8b6b56931 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] 10.222.0.11 "GET /compute/v2.1/servers/15abb40f-daf9-4c4b-ac9c-55f57ee7b938" status: 200 len: 1558 microversion: 2.1 time: 0.163850 Nov 17 03:52:36.447629 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 1190/2574] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:52:36 2021] GET /compute/v2.1/servers/15abb40f-daf9-4c4b-ac9c-55f57ee7b938 => generated 1558 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:52:36.514749 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-9871f530-c926-4b8b-9159-30dd24882e7b tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:52:36.515733 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-9871f530-c926-4b8b-9159-30dd24882e7b tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] [instance: 5d54db85-b991-4890-abaa-952413baa2e7] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:52:36.526352 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-9871f530-c926-4b8b-9159-30dd24882e7b tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:52:36.527058 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-9871f530-c926-4b8b-9159-30dd24882e7b tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:52:36.528319 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-9871f530-c926-4b8b-9159-30dd24882e7b tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:52:36.529086 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-9871f530-c926-4b8b-9159-30dd24882e7b tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:52:36.587555 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-8eca8b30-9a18-4a13-b79e-424c6949f7ad tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:52:36.588150 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-8eca8b30-9a18-4a13-b79e-424c6949f7ad tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] [instance: 0698dc5b-5f47-46c4-ace8-f5e891a964a0] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:52:36.594279 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-8eca8b30-9a18-4a13-b79e-424c6949f7ad tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:52:36.594783 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-8eca8b30-9a18-4a13-b79e-424c6949f7ad tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:52:36.595514 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-8eca8b30-9a18-4a13-b79e-424c6949f7ad tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:52:36.595923 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-8eca8b30-9a18-4a13-b79e-424c6949f7ad tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:52:36.656547 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-8eca8b30-9a18-4a13-b79e-424c6949f7ad tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '163b2f24a72649ac8084be1cac32fa09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e123e9b86124c93a7fc2db9984e7466', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:52:36.663074 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-9871f530-c926-4b8b-9159-30dd24882e7b tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37f21d6d15cf40a586edda211219fd08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ebb970305844dccacf48a7d8d47ecf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:52:36.664024 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-8eca8b30-9a18-4a13-b79e-424c6949f7ad tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] 10.222.0.11 "GET /compute/v2.1/servers/0698dc5b-5f47-46c4-ace8-f5e891a964a0" status: 200 len: 1218 microversion: 2.1 time: 0.080355 Nov 17 03:52:36.664633 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 1191/2575] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:52:36 2021] GET /compute/v2.1/servers/0698dc5b-5f47-46c4-ace8-f5e891a964a0 => generated 1218 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:52:36.671892 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-9871f530-c926-4b8b-9159-30dd24882e7b tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '37f21d6d15cf40a586edda211219fd08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ebb970305844dccacf48a7d8d47ecf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:52:36.673450 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-9871f530-c926-4b8b-9159-30dd24882e7b tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '37f21d6d15cf40a586edda211219fd08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ebb970305844dccacf48a7d8d47ecf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:52:36.674627 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-9871f530-c926-4b8b-9159-30dd24882e7b tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] 10.222.0.11 "GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7" status: 200 len: 1803 microversion: 2.20 time: 0.166162 Nov 17 03:52:36.675177 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 1385/2576] 10.222.0.11 () {60 vars in 1276 bytes} [Wed Nov 17 03:52:36 2021] GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7 => generated 1803 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 17 03:52:37.468177 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-1f4bdcc2-70db-4ffa-ba0f-8195610ead11 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:52:37.469144 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-1f4bdcc2-70db-4ffa-ba0f-8195610ead11 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] [instance: 15abb40f-daf9-4c4b-ac9c-55f57ee7b938] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:52:37.479940 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-1f4bdcc2-70db-4ffa-ba0f-8195610ead11 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:52:37.480675 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-1f4bdcc2-70db-4ffa-ba0f-8195610ead11 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:52:37.481980 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-1f4bdcc2-70db-4ffa-ba0f-8195610ead11 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:52:37.482682 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-1f4bdcc2-70db-4ffa-ba0f-8195610ead11 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:52:37.626828 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-1f4bdcc2-70db-4ffa-ba0f-8195610ead11 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a792b5b7e6f7461b8d802a5abaaa9518', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e843a3fb49f41dcb376184d7e156528', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:52:37.638884 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-1f4bdcc2-70db-4ffa-ba0f-8195610ead11 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] 10.222.0.11 "GET /compute/v2.1/servers/15abb40f-daf9-4c4b-ac9c-55f57ee7b938" status: 200 len: 1558 microversion: 2.1 time: 0.176702 Nov 17 03:52:37.639538 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 1192/2577] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:52:37 2021] GET /compute/v2.1/servers/15abb40f-daf9-4c4b-ac9c-55f57ee7b938 => generated 1558 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:52:37.688631 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-5dc89047-bd12-4bfd-957f-fe8a84928868 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:52:37.690761 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-5dc89047-bd12-4bfd-957f-fe8a84928868 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] [instance: 0698dc5b-5f47-46c4-ace8-f5e891a964a0] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:52:37.693357 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-cd61d7df-c89c-4939-8c89-095ea60b5ec2 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:52:37.694212 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-cd61d7df-c89c-4939-8c89-095ea60b5ec2 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] [instance: 5d54db85-b991-4890-abaa-952413baa2e7] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:52:37.698437 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-5dc89047-bd12-4bfd-957f-fe8a84928868 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:52:37.699011 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-5dc89047-bd12-4bfd-957f-fe8a84928868 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:52:37.699857 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-5dc89047-bd12-4bfd-957f-fe8a84928868 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:52:37.700669 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-5dc89047-bd12-4bfd-957f-fe8a84928868 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:52:37.701499 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-cd61d7df-c89c-4939-8c89-095ea60b5ec2 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:52:37.701945 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-cd61d7df-c89c-4939-8c89-095ea60b5ec2 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:52:37.702724 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-cd61d7df-c89c-4939-8c89-095ea60b5ec2 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:52:37.703152 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-cd61d7df-c89c-4939-8c89-095ea60b5ec2 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:52:37.765372 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-5dc89047-bd12-4bfd-957f-fe8a84928868 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '163b2f24a72649ac8084be1cac32fa09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e123e9b86124c93a7fc2db9984e7466', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:52:37.773192 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-5dc89047-bd12-4bfd-957f-fe8a84928868 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] 10.222.0.11 "GET /compute/v2.1/servers/0698dc5b-5f47-46c4-ace8-f5e891a964a0" status: 200 len: 1218 microversion: 2.1 time: 0.094046 Nov 17 03:52:37.773769 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 1386/2578] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:52:37 2021] GET /compute/v2.1/servers/0698dc5b-5f47-46c4-ace8-f5e891a964a0 => generated 1218 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:52:37.840235 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-cd61d7df-c89c-4939-8c89-095ea60b5ec2 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37f21d6d15cf40a586edda211219fd08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ebb970305844dccacf48a7d8d47ecf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:52:37.852023 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-cd61d7df-c89c-4939-8c89-095ea60b5ec2 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '37f21d6d15cf40a586edda211219fd08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ebb970305844dccacf48a7d8d47ecf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:52:37.853558 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-cd61d7df-c89c-4939-8c89-095ea60b5ec2 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '37f21d6d15cf40a586edda211219fd08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ebb970305844dccacf48a7d8d47ecf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:52:37.854709 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-cd61d7df-c89c-4939-8c89-095ea60b5ec2 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] 10.222.0.11 "GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7" status: 200 len: 1803 microversion: 2.20 time: 0.165132 Nov 17 03:52:37.855269 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 1193/2579] 10.222.0.11 () {60 vars in 1276 bytes} [Wed Nov 17 03:52:37 2021] GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7 => generated 1803 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 17 03:52:38.662390 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-ebe0adee-170d-4474-94d3-38fa97403976 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:52:38.662993 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-ebe0adee-170d-4474-94d3-38fa97403976 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] [instance: 15abb40f-daf9-4c4b-ac9c-55f57ee7b938] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:52:38.669497 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-ebe0adee-170d-4474-94d3-38fa97403976 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:52:38.669942 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-ebe0adee-170d-4474-94d3-38fa97403976 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:52:38.670702 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-ebe0adee-170d-4474-94d3-38fa97403976 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:52:38.671133 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-ebe0adee-170d-4474-94d3-38fa97403976 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:52:38.789664 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-9f23fc4a-a17c-4713-a98b-9f1e7e174c23 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:52:38.790242 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-9f23fc4a-a17c-4713-a98b-9f1e7e174c23 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] [instance: 0698dc5b-5f47-46c4-ace8-f5e891a964a0] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:52:38.796639 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-9f23fc4a-a17c-4713-a98b-9f1e7e174c23 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:52:38.797118 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-9f23fc4a-a17c-4713-a98b-9f1e7e174c23 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:52:38.797849 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-9f23fc4a-a17c-4713-a98b-9f1e7e174c23 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:52:38.798276 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-9f23fc4a-a17c-4713-a98b-9f1e7e174c23 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:52:38.818647 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-ebe0adee-170d-4474-94d3-38fa97403976 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a792b5b7e6f7461b8d802a5abaaa9518', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e843a3fb49f41dcb376184d7e156528', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:52:38.826647 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-ebe0adee-170d-4474-94d3-38fa97403976 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] 10.222.0.11 "GET /compute/v2.1/servers/15abb40f-daf9-4c4b-ac9c-55f57ee7b938" status: 200 len: 1558 microversion: 2.1 time: 0.170133 Nov 17 03:52:38.827221 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 1387/2580] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:52:38 2021] GET /compute/v2.1/servers/15abb40f-daf9-4c4b-ac9c-55f57ee7b938 => generated 1558 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:52:38.857553 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-9f23fc4a-a17c-4713-a98b-9f1e7e174c23 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '163b2f24a72649ac8084be1cac32fa09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e123e9b86124c93a7fc2db9984e7466', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:52:38.865509 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-9f23fc4a-a17c-4713-a98b-9f1e7e174c23 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] 10.222.0.11 "GET /compute/v2.1/servers/0698dc5b-5f47-46c4-ace8-f5e891a964a0" status: 200 len: 1218 microversion: 2.1 time: 0.079601 Nov 17 03:52:38.866114 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 1194/2581] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:52:38 2021] GET /compute/v2.1/servers/0698dc5b-5f47-46c4-ace8-f5e891a964a0 => generated 1218 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:52:38.872405 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-491d61b6-d4f3-4463-a36f-94bc9c98bf0d tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:52:38.873057 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-491d61b6-d4f3-4463-a36f-94bc9c98bf0d tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] [instance: 5d54db85-b991-4890-abaa-952413baa2e7] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:52:38.878978 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-491d61b6-d4f3-4463-a36f-94bc9c98bf0d tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:52:38.879439 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-491d61b6-d4f3-4463-a36f-94bc9c98bf0d tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:52:38.880845 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-491d61b6-d4f3-4463-a36f-94bc9c98bf0d tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:52:38.881319 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-491d61b6-d4f3-4463-a36f-94bc9c98bf0d tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:52:39.020287 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-491d61b6-d4f3-4463-a36f-94bc9c98bf0d tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37f21d6d15cf40a586edda211219fd08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ebb970305844dccacf48a7d8d47ecf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:52:39.029425 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-491d61b6-d4f3-4463-a36f-94bc9c98bf0d tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '37f21d6d15cf40a586edda211219fd08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ebb970305844dccacf48a7d8d47ecf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:52:39.030928 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-491d61b6-d4f3-4463-a36f-94bc9c98bf0d tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '37f21d6d15cf40a586edda211219fd08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ebb970305844dccacf48a7d8d47ecf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:52:39.032085 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-491d61b6-d4f3-4463-a36f-94bc9c98bf0d tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] 10.222.0.11 "GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7" status: 200 len: 1803 microversion: 2.20 time: 0.163451 Nov 17 03:52:39.032648 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 1388/2582] 10.222.0.11 () {60 vars in 1276 bytes} [Wed Nov 17 03:52:38 2021] GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7 => generated 1803 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 17 03:52:39.845891 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-57491d40-dc68-483c-aeb0-02baf36a1666 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:52:39.846699 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-57491d40-dc68-483c-aeb0-02baf36a1666 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] [instance: 15abb40f-daf9-4c4b-ac9c-55f57ee7b938] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:52:39.856526 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-57491d40-dc68-483c-aeb0-02baf36a1666 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:52:39.857634 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-57491d40-dc68-483c-aeb0-02baf36a1666 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:52:39.859396 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-57491d40-dc68-483c-aeb0-02baf36a1666 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:52:39.860447 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-57491d40-dc68-483c-aeb0-02baf36a1666 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:52:39.882510 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-2f25ca50-16c0-4c3c-8f15-e7c4c0a20c43 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:52:39.883157 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-2f25ca50-16c0-4c3c-8f15-e7c4c0a20c43 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] [instance: 0698dc5b-5f47-46c4-ace8-f5e891a964a0] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:52:39.889783 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-2f25ca50-16c0-4c3c-8f15-e7c4c0a20c43 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:52:39.890232 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-2f25ca50-16c0-4c3c-8f15-e7c4c0a20c43 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:52:39.891006 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-2f25ca50-16c0-4c3c-8f15-e7c4c0a20c43 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:52:39.891439 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-2f25ca50-16c0-4c3c-8f15-e7c4c0a20c43 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:52:39.951469 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-2f25ca50-16c0-4c3c-8f15-e7c4c0a20c43 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '163b2f24a72649ac8084be1cac32fa09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e123e9b86124c93a7fc2db9984e7466', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:52:39.959412 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-2f25ca50-16c0-4c3c-8f15-e7c4c0a20c43 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] 10.222.0.11 "GET /compute/v2.1/servers/0698dc5b-5f47-46c4-ace8-f5e891a964a0" status: 200 len: 1218 microversion: 2.1 time: 0.080259 Nov 17 03:52:39.959853 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 1389/2583] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:52:39 2021] GET /compute/v2.1/servers/0698dc5b-5f47-46c4-ace8-f5e891a964a0 => generated 1218 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:52:40.051539 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-ca35ad36-5b8b-4424-be43-90df015b7f11 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:52:40.052822 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-ca35ad36-5b8b-4424-be43-90df015b7f11 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] [instance: 5d54db85-b991-4890-abaa-952413baa2e7] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:52:40.063504 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-ca35ad36-5b8b-4424-be43-90df015b7f11 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:52:40.064316 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-ca35ad36-5b8b-4424-be43-90df015b7f11 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:52:40.065261 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-ca35ad36-5b8b-4424-be43-90df015b7f11 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:52:40.065761 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-ca35ad36-5b8b-4424-be43-90df015b7f11 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:52:40.071398 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-57491d40-dc68-483c-aeb0-02baf36a1666 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a792b5b7e6f7461b8d802a5abaaa9518', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e843a3fb49f41dcb376184d7e156528', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:52:40.080497 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-57491d40-dc68-483c-aeb0-02baf36a1666 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] 10.222.0.11 "GET /compute/v2.1/servers/15abb40f-daf9-4c4b-ac9c-55f57ee7b938" status: 200 len: 1558 microversion: 2.1 time: 0.239398 Nov 17 03:52:40.081105 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 1195/2584] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:52:39 2021] GET /compute/v2.1/servers/15abb40f-daf9-4c4b-ac9c-55f57ee7b938 => generated 1558 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:52:40.223021 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-ca35ad36-5b8b-4424-be43-90df015b7f11 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37f21d6d15cf40a586edda211219fd08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ebb970305844dccacf48a7d8d47ecf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:52:40.231897 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-ca35ad36-5b8b-4424-be43-90df015b7f11 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '37f21d6d15cf40a586edda211219fd08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ebb970305844dccacf48a7d8d47ecf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:52:40.233412 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-ca35ad36-5b8b-4424-be43-90df015b7f11 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '37f21d6d15cf40a586edda211219fd08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ebb970305844dccacf48a7d8d47ecf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:52:40.234559 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-ca35ad36-5b8b-4424-be43-90df015b7f11 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] 10.222.0.11 "GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7" status: 200 len: 1803 microversion: 2.20 time: 0.186846 Nov 17 03:52:40.235113 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 1390/2585] 10.222.0.11 () {60 vars in 1276 bytes} [Wed Nov 17 03:52:40 2021] GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7 => generated 1803 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 17 03:52:40.979721 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-30b7fdbb-f8a5-4542-b789-50621844bfc3 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:52:40.980719 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-30b7fdbb-f8a5-4542-b789-50621844bfc3 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] [instance: 0698dc5b-5f47-46c4-ace8-f5e891a964a0] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:52:40.990825 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-30b7fdbb-f8a5-4542-b789-50621844bfc3 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:52:40.991574 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-30b7fdbb-f8a5-4542-b789-50621844bfc3 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:52:40.992859 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-30b7fdbb-f8a5-4542-b789-50621844bfc3 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:52:40.993583 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-30b7fdbb-f8a5-4542-b789-50621844bfc3 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:52:41.058407 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-30b7fdbb-f8a5-4542-b789-50621844bfc3 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '163b2f24a72649ac8084be1cac32fa09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e123e9b86124c93a7fc2db9984e7466', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:52:41.066343 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-30b7fdbb-f8a5-4542-b789-50621844bfc3 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] 10.222.0.11 "GET /compute/v2.1/servers/0698dc5b-5f47-46c4-ace8-f5e891a964a0" status: 200 len: 1218 microversion: 2.1 time: 0.093375 Nov 17 03:52:41.066886 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 1196/2586] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:52:40 2021] GET /compute/v2.1/servers/0698dc5b-5f47-46c4-ace8-f5e891a964a0 => generated 1218 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:52:41.097886 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-9f09eec7-2e3a-429a-ba0e-ea0f24e2ed37 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:52:41.098419 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-9f09eec7-2e3a-429a-ba0e-ea0f24e2ed37 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] [instance: 15abb40f-daf9-4c4b-ac9c-55f57ee7b938] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:52:41.105373 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-9f09eec7-2e3a-429a-ba0e-ea0f24e2ed37 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:52:41.105889 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-9f09eec7-2e3a-429a-ba0e-ea0f24e2ed37 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:52:41.106802 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-9f09eec7-2e3a-429a-ba0e-ea0f24e2ed37 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:52:41.107303 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-9f09eec7-2e3a-429a-ba0e-ea0f24e2ed37 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:52:41.254665 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-0da6adc3-7359-434a-9a5e-9b3010e8361c tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:52:41.255498 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-0da6adc3-7359-434a-9a5e-9b3010e8361c tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] [instance: 5d54db85-b991-4890-abaa-952413baa2e7] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:52:41.261862 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-0da6adc3-7359-434a-9a5e-9b3010e8361c tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:52:41.262320 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-0da6adc3-7359-434a-9a5e-9b3010e8361c tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:52:41.263100 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-0da6adc3-7359-434a-9a5e-9b3010e8361c tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:52:41.263537 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-0da6adc3-7359-434a-9a5e-9b3010e8361c tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:52:41.291156 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-9f09eec7-2e3a-429a-ba0e-ea0f24e2ed37 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a792b5b7e6f7461b8d802a5abaaa9518', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e843a3fb49f41dcb376184d7e156528', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:52:41.303357 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-9f09eec7-2e3a-429a-ba0e-ea0f24e2ed37 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] 10.222.0.11 "GET /compute/v2.1/servers/15abb40f-daf9-4c4b-ac9c-55f57ee7b938" status: 200 len: 1558 microversion: 2.1 time: 0.207954 Nov 17 03:52:41.304823 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 1391/2587] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:52:41 2021] GET /compute/v2.1/servers/15abb40f-daf9-4c4b-ac9c-55f57ee7b938 => generated 1558 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:52:41.309815 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-8a48fb5f-08b7-4551-aa4b-6ee0f557a414 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] Calling method '.version_select at 0x7f9e1dc721f0>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:52:41.348130 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-8a48fb5f-08b7-4551-aa4b-6ee0f557a414 tempest-TestShelveInstance-2076673301 tempest-TestShelveInstance-2076673301-project] 10.222.0.11 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1227147341" status: 202 len: 0 microversion: 2.1 time: 0.041014 Nov 17 03:52:41.356469 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 1392/2588] 10.222.0.11 () {58 vars in 1253 bytes} [Wed Nov 17 03:52:41 2021] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1227147341 => generated 0 bytes in 51 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 17 03:52:41.459906 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-0da6adc3-7359-434a-9a5e-9b3010e8361c tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37f21d6d15cf40a586edda211219fd08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ebb970305844dccacf48a7d8d47ecf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:52:41.468641 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-0da6adc3-7359-434a-9a5e-9b3010e8361c tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '37f21d6d15cf40a586edda211219fd08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ebb970305844dccacf48a7d8d47ecf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:52:41.470611 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-0da6adc3-7359-434a-9a5e-9b3010e8361c tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '37f21d6d15cf40a586edda211219fd08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ebb970305844dccacf48a7d8d47ecf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:52:41.471781 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-0da6adc3-7359-434a-9a5e-9b3010e8361c tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] 10.222.0.11 "GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7" status: 200 len: 1803 microversion: 2.20 time: 0.223156 Nov 17 03:52:41.472438 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 1197/2589] 10.222.0.11 () {60 vars in 1276 bytes} [Wed Nov 17 03:52:41 2021] GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7 => generated 1803 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 17 03:52:42.321907 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-d587479d-c5b5-473c-af25-d040a7f2e170 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:52:42.322520 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-d587479d-c5b5-473c-af25-d040a7f2e170 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] [instance: 15abb40f-daf9-4c4b-ac9c-55f57ee7b938] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:52:42.328321 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-d587479d-c5b5-473c-af25-d040a7f2e170 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:52:42.328770 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-d587479d-c5b5-473c-af25-d040a7f2e170 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:52:42.329557 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-d587479d-c5b5-473c-af25-d040a7f2e170 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:52:42.329986 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-d587479d-c5b5-473c-af25-d040a7f2e170 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:52:42.490189 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-581c84fd-885e-47c6-bf48-d355d801133b tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:52:42.490763 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-581c84fd-885e-47c6-bf48-d355d801133b tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] [instance: 5d54db85-b991-4890-abaa-952413baa2e7] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:52:42.497552 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-581c84fd-885e-47c6-bf48-d355d801133b tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:52:42.498007 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-581c84fd-885e-47c6-bf48-d355d801133b tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:52:42.498786 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-581c84fd-885e-47c6-bf48-d355d801133b tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:52:42.499366 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-581c84fd-885e-47c6-bf48-d355d801133b tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:52:42.548139 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-d587479d-c5b5-473c-af25-d040a7f2e170 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a792b5b7e6f7461b8d802a5abaaa9518', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e843a3fb49f41dcb376184d7e156528', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:52:42.557341 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-d587479d-c5b5-473c-af25-d040a7f2e170 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] 10.222.0.11 "GET /compute/v2.1/servers/15abb40f-daf9-4c4b-ac9c-55f57ee7b938" status: 200 len: 1558 microversion: 2.1 time: 0.239970 Nov 17 03:52:42.558183 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 1393/2590] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:52:42 2021] GET /compute/v2.1/servers/15abb40f-daf9-4c4b-ac9c-55f57ee7b938 => generated 1558 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:52:42.636424 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-581c84fd-885e-47c6-bf48-d355d801133b tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37f21d6d15cf40a586edda211219fd08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ebb970305844dccacf48a7d8d47ecf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:52:42.644804 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-581c84fd-885e-47c6-bf48-d355d801133b tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '37f21d6d15cf40a586edda211219fd08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ebb970305844dccacf48a7d8d47ecf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:52:42.646442 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-581c84fd-885e-47c6-bf48-d355d801133b tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '37f21d6d15cf40a586edda211219fd08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ebb970305844dccacf48a7d8d47ecf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:52:42.647663 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-581c84fd-885e-47c6-bf48-d355d801133b tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] 10.222.0.11 "GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7" status: 200 len: 1803 microversion: 2.20 time: 0.161307 Nov 17 03:52:42.648226 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 1198/2591] 10.222.0.11 () {60 vars in 1276 bytes} [Wed Nov 17 03:52:42 2021] GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7 => generated 1803 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 17 03:52:43.575222 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-9d2cc95b-68c1-4167-8b03-66c09a9c7174 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:52:43.575861 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-9d2cc95b-68c1-4167-8b03-66c09a9c7174 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] [instance: 15abb40f-daf9-4c4b-ac9c-55f57ee7b938] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:52:43.582891 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-9d2cc95b-68c1-4167-8b03-66c09a9c7174 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:52:43.584067 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-9d2cc95b-68c1-4167-8b03-66c09a9c7174 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:52:43.584870 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-9d2cc95b-68c1-4167-8b03-66c09a9c7174 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:52:43.585318 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-9d2cc95b-68c1-4167-8b03-66c09a9c7174 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:52:43.665513 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-256273e1-ac23-460d-bf3e-f19fb09ac88f tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:52:43.666090 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-256273e1-ac23-460d-bf3e-f19fb09ac88f tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] [instance: 5d54db85-b991-4890-abaa-952413baa2e7] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:52:43.672300 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-256273e1-ac23-460d-bf3e-f19fb09ac88f tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:52:43.673098 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-256273e1-ac23-460d-bf3e-f19fb09ac88f tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:52:43.674164 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-256273e1-ac23-460d-bf3e-f19fb09ac88f tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:52:43.674702 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-256273e1-ac23-460d-bf3e-f19fb09ac88f tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:52:43.798810 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-9d2cc95b-68c1-4167-8b03-66c09a9c7174 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a792b5b7e6f7461b8d802a5abaaa9518', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e843a3fb49f41dcb376184d7e156528', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:52:43.814800 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-256273e1-ac23-460d-bf3e-f19fb09ac88f tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37f21d6d15cf40a586edda211219fd08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ebb970305844dccacf48a7d8d47ecf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:52:43.815997 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-9d2cc95b-68c1-4167-8b03-66c09a9c7174 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] 10.222.0.11 "GET /compute/v2.1/servers/15abb40f-daf9-4c4b-ac9c-55f57ee7b938" status: 200 len: 1558 microversion: 2.1 time: 0.244533 Nov 17 03:52:43.816826 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 1394/2592] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:52:43 2021] GET /compute/v2.1/servers/15abb40f-daf9-4c4b-ac9c-55f57ee7b938 => generated 1558 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:52:43.826074 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-256273e1-ac23-460d-bf3e-f19fb09ac88f tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '37f21d6d15cf40a586edda211219fd08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ebb970305844dccacf48a7d8d47ecf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:52:43.827743 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-256273e1-ac23-460d-bf3e-f19fb09ac88f tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '37f21d6d15cf40a586edda211219fd08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ebb970305844dccacf48a7d8d47ecf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:52:43.828952 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-256273e1-ac23-460d-bf3e-f19fb09ac88f tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] 10.222.0.11 "GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7" status: 200 len: 1803 microversion: 2.20 time: 0.167324 Nov 17 03:52:43.829509 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 1199/2593] 10.222.0.11 () {60 vars in 1276 bytes} [Wed Nov 17 03:52:43 2021] GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7 => generated 1803 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 17 03:52:44.833605 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-a5b95ff6-dc3e-4d3a-987f-f431014ba208 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:52:44.834244 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-a5b95ff6-dc3e-4d3a-987f-f431014ba208 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] [instance: 15abb40f-daf9-4c4b-ac9c-55f57ee7b938] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:52:44.842336 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-a5b95ff6-dc3e-4d3a-987f-f431014ba208 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:52:44.842336 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-a5b95ff6-dc3e-4d3a-987f-f431014ba208 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:52:44.842336 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-a5b95ff6-dc3e-4d3a-987f-f431014ba208 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:52:44.842732 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-a5b95ff6-dc3e-4d3a-987f-f431014ba208 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:52:44.849979 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-3b21254c-aa9b-4aea-aacc-54bfc580a1d6 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:52:44.850689 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-3b21254c-aa9b-4aea-aacc-54bfc580a1d6 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] [instance: 5d54db85-b991-4890-abaa-952413baa2e7] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:52:44.860812 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-3b21254c-aa9b-4aea-aacc-54bfc580a1d6 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:52:44.861453 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-3b21254c-aa9b-4aea-aacc-54bfc580a1d6 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:52:44.862243 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-3b21254c-aa9b-4aea-aacc-54bfc580a1d6 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:52:44.862687 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-3b21254c-aa9b-4aea-aacc-54bfc580a1d6 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:52:45.017262 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-3b21254c-aa9b-4aea-aacc-54bfc580a1d6 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37f21d6d15cf40a586edda211219fd08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ebb970305844dccacf48a7d8d47ecf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:52:45.026410 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-3b21254c-aa9b-4aea-aacc-54bfc580a1d6 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '37f21d6d15cf40a586edda211219fd08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ebb970305844dccacf48a7d8d47ecf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:52:45.027902 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-3b21254c-aa9b-4aea-aacc-54bfc580a1d6 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '37f21d6d15cf40a586edda211219fd08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ebb970305844dccacf48a7d8d47ecf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:52:45.029151 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-3b21254c-aa9b-4aea-aacc-54bfc580a1d6 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] 10.222.0.11 "GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7" status: 200 len: 1803 microversion: 2.20 time: 0.184494 Nov 17 03:52:45.029846 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 1200/2594] 10.222.0.11 () {60 vars in 1276 bytes} [Wed Nov 17 03:52:44 2021] GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7 => generated 1803 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 17 03:52:45.140174 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-a5b95ff6-dc3e-4d3a-987f-f431014ba208 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a792b5b7e6f7461b8d802a5abaaa9518', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e843a3fb49f41dcb376184d7e156528', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:52:45.148715 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-a5b95ff6-dc3e-4d3a-987f-f431014ba208 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] 10.222.0.11 "GET /compute/v2.1/servers/15abb40f-daf9-4c4b-ac9c-55f57ee7b938" status: 200 len: 1558 microversion: 2.1 time: 0.318806 Nov 17 03:52:45.149717 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 1395/2595] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:52:44 2021] GET /compute/v2.1/servers/15abb40f-daf9-4c4b-ac9c-55f57ee7b938 => generated 1558 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:52:46.047574 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-f5ac8b6e-df34-436e-bd07-f380a96e99b3 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:52:46.048198 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-f5ac8b6e-df34-436e-bd07-f380a96e99b3 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] [instance: 5d54db85-b991-4890-abaa-952413baa2e7] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:52:46.055708 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-f5ac8b6e-df34-436e-bd07-f380a96e99b3 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:52:46.056223 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-f5ac8b6e-df34-436e-bd07-f380a96e99b3 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:52:46.057058 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-f5ac8b6e-df34-436e-bd07-f380a96e99b3 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:52:46.057474 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-f5ac8b6e-df34-436e-bd07-f380a96e99b3 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:52:46.165633 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-3952b8fa-43e1-47a8-8f02-f35abc39d746 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:52:46.169691 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-3952b8fa-43e1-47a8-8f02-f35abc39d746 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] [instance: 15abb40f-daf9-4c4b-ac9c-55f57ee7b938] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:52:46.177285 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-3952b8fa-43e1-47a8-8f02-f35abc39d746 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:52:46.178006 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-3952b8fa-43e1-47a8-8f02-f35abc39d746 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:52:46.179043 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-3952b8fa-43e1-47a8-8f02-f35abc39d746 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:52:46.179695 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-3952b8fa-43e1-47a8-8f02-f35abc39d746 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:52:46.266395 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-f5ac8b6e-df34-436e-bd07-f380a96e99b3 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37f21d6d15cf40a586edda211219fd08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ebb970305844dccacf48a7d8d47ecf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:52:46.276022 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-f5ac8b6e-df34-436e-bd07-f380a96e99b3 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '37f21d6d15cf40a586edda211219fd08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ebb970305844dccacf48a7d8d47ecf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:52:46.277672 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-f5ac8b6e-df34-436e-bd07-f380a96e99b3 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '37f21d6d15cf40a586edda211219fd08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ebb970305844dccacf48a7d8d47ecf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:52:46.278988 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-f5ac8b6e-df34-436e-bd07-f380a96e99b3 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] 10.222.0.11 "GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7" status: 200 len: 1803 microversion: 2.20 time: 0.235195 Nov 17 03:52:46.281964 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 1201/2596] 10.222.0.11 () {60 vars in 1276 bytes} [Wed Nov 17 03:52:46 2021] GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7 => generated 1803 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 17 03:52:46.320788 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-3952b8fa-43e1-47a8-8f02-f35abc39d746 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a792b5b7e6f7461b8d802a5abaaa9518', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e843a3fb49f41dcb376184d7e156528', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:52:46.328679 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-3952b8fa-43e1-47a8-8f02-f35abc39d746 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] 10.222.0.11 "GET /compute/v2.1/servers/15abb40f-daf9-4c4b-ac9c-55f57ee7b938" status: 200 len: 1558 microversion: 2.1 time: 0.167130 Nov 17 03:52:46.329271 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 1396/2597] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:52:46 2021] GET /compute/v2.1/servers/15abb40f-daf9-4c4b-ac9c-55f57ee7b938 => generated 1558 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:52:47.300242 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-c0e39884-3c3a-4559-9820-bbb1005f4191 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:52:47.302267 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-c0e39884-3c3a-4559-9820-bbb1005f4191 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] [instance: 5d54db85-b991-4890-abaa-952413baa2e7] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:52:47.309330 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-c0e39884-3c3a-4559-9820-bbb1005f4191 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:52:47.309768 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-c0e39884-3c3a-4559-9820-bbb1005f4191 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:52:47.310745 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-c0e39884-3c3a-4559-9820-bbb1005f4191 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:52:47.311362 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-c0e39884-3c3a-4559-9820-bbb1005f4191 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:52:47.347737 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-d1f80826-35e9-4bce-8dee-727b71d33ec0 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:52:47.348818 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-d1f80826-35e9-4bce-8dee-727b71d33ec0 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] [instance: 15abb40f-daf9-4c4b-ac9c-55f57ee7b938] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:52:47.354978 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-d1f80826-35e9-4bce-8dee-727b71d33ec0 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:52:47.356054 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-d1f80826-35e9-4bce-8dee-727b71d33ec0 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:52:47.356882 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-d1f80826-35e9-4bce-8dee-727b71d33ec0 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:52:47.357531 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-d1f80826-35e9-4bce-8dee-727b71d33ec0 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:52:47.501151 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-d1f80826-35e9-4bce-8dee-727b71d33ec0 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a792b5b7e6f7461b8d802a5abaaa9518', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e843a3fb49f41dcb376184d7e156528', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:52:47.509871 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-d1f80826-35e9-4bce-8dee-727b71d33ec0 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] 10.222.0.11 "GET /compute/v2.1/servers/15abb40f-daf9-4c4b-ac9c-55f57ee7b938" status: 200 len: 1558 microversion: 2.1 time: 0.167381 Nov 17 03:52:47.510746 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 1397/2598] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:52:47 2021] GET /compute/v2.1/servers/15abb40f-daf9-4c4b-ac9c-55f57ee7b938 => generated 1558 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:52:47.770861 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-c0e39884-3c3a-4559-9820-bbb1005f4191 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37f21d6d15cf40a586edda211219fd08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ebb970305844dccacf48a7d8d47ecf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:52:47.779668 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-c0e39884-3c3a-4559-9820-bbb1005f4191 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '37f21d6d15cf40a586edda211219fd08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ebb970305844dccacf48a7d8d47ecf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:52:47.781174 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-c0e39884-3c3a-4559-9820-bbb1005f4191 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '37f21d6d15cf40a586edda211219fd08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ebb970305844dccacf48a7d8d47ecf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:52:47.782512 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-c0e39884-3c3a-4559-9820-bbb1005f4191 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] 10.222.0.11 "GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7" status: 200 len: 1803 microversion: 2.20 time: 0.486859 Nov 17 03:52:47.783228 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 1202/2599] 10.222.0.11 () {60 vars in 1276 bytes} [Wed Nov 17 03:52:47 2021] GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7 => generated 1803 bytes in 488 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 17 03:52:48.528979 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-45833229-48ac-463e-ae11-ef5d4273873f tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:52:48.529572 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-45833229-48ac-463e-ae11-ef5d4273873f tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] [instance: 15abb40f-daf9-4c4b-ac9c-55f57ee7b938] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:52:48.536699 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-45833229-48ac-463e-ae11-ef5d4273873f tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:52:48.538496 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-45833229-48ac-463e-ae11-ef5d4273873f tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:52:48.539486 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-45833229-48ac-463e-ae11-ef5d4273873f tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:52:48.540078 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-45833229-48ac-463e-ae11-ef5d4273873f tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:52:48.771643 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-45833229-48ac-463e-ae11-ef5d4273873f tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a792b5b7e6f7461b8d802a5abaaa9518', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e843a3fb49f41dcb376184d7e156528', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:52:48.780969 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-45833229-48ac-463e-ae11-ef5d4273873f tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] 10.222.0.11 "GET /compute/v2.1/servers/15abb40f-daf9-4c4b-ac9c-55f57ee7b938" status: 200 len: 1558 microversion: 2.1 time: 0.255997 Nov 17 03:52:48.781627 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 1398/2600] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:52:48 2021] GET /compute/v2.1/servers/15abb40f-daf9-4c4b-ac9c-55f57ee7b938 => generated 1558 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:52:48.803134 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-dbabef6a-e558-4d47-bac0-54e5a37aefad tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:52:48.804718 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-dbabef6a-e558-4d47-bac0-54e5a37aefad tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] [instance: 5d54db85-b991-4890-abaa-952413baa2e7] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:52:48.815216 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-dbabef6a-e558-4d47-bac0-54e5a37aefad tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:52:48.815738 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-dbabef6a-e558-4d47-bac0-54e5a37aefad tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:52:48.816649 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-dbabef6a-e558-4d47-bac0-54e5a37aefad tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:52:48.817317 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-dbabef6a-e558-4d47-bac0-54e5a37aefad tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:52:48.984900 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-dbabef6a-e558-4d47-bac0-54e5a37aefad tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37f21d6d15cf40a586edda211219fd08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ebb970305844dccacf48a7d8d47ecf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:52:48.999052 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-dbabef6a-e558-4d47-bac0-54e5a37aefad tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '37f21d6d15cf40a586edda211219fd08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ebb970305844dccacf48a7d8d47ecf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:52:49.000614 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-dbabef6a-e558-4d47-bac0-54e5a37aefad tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '37f21d6d15cf40a586edda211219fd08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ebb970305844dccacf48a7d8d47ecf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:52:49.001822 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-dbabef6a-e558-4d47-bac0-54e5a37aefad tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] 10.222.0.11 "GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7" status: 200 len: 1803 microversion: 2.20 time: 0.203443 Nov 17 03:52:49.002385 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 1203/2601] 10.222.0.11 () {60 vars in 1276 bytes} [Wed Nov 17 03:52:48 2021] GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7 => generated 1803 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 17 03:52:49.798442 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-3acb9256-c595-4047-8777-a4b73551270d tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:52:49.799057 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-3acb9256-c595-4047-8777-a4b73551270d tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] [instance: 15abb40f-daf9-4c4b-ac9c-55f57ee7b938] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:52:49.806695 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-3acb9256-c595-4047-8777-a4b73551270d tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:52:49.807137 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-3acb9256-c595-4047-8777-a4b73551270d tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:52:49.807963 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-3acb9256-c595-4047-8777-a4b73551270d tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:52:49.808424 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-3acb9256-c595-4047-8777-a4b73551270d tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:52:49.944809 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-3acb9256-c595-4047-8777-a4b73551270d tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a792b5b7e6f7461b8d802a5abaaa9518', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e843a3fb49f41dcb376184d7e156528', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:52:49.952606 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-3acb9256-c595-4047-8777-a4b73551270d tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] 10.222.0.11 "GET /compute/v2.1/servers/15abb40f-daf9-4c4b-ac9c-55f57ee7b938" status: 200 len: 1558 microversion: 2.1 time: 0.157872 Nov 17 03:52:49.953332 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 1399/2602] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:52:49 2021] GET /compute/v2.1/servers/15abb40f-daf9-4c4b-ac9c-55f57ee7b938 => generated 1558 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:52:50.019513 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-54ec1be4-3be8-4b09-8445-4583fa6dc348 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:52:50.020163 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-54ec1be4-3be8-4b09-8445-4583fa6dc348 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] [instance: 5d54db85-b991-4890-abaa-952413baa2e7] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:52:50.027191 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-54ec1be4-3be8-4b09-8445-4583fa6dc348 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:52:50.027644 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-54ec1be4-3be8-4b09-8445-4583fa6dc348 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:52:50.028444 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-54ec1be4-3be8-4b09-8445-4583fa6dc348 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:52:50.028917 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-54ec1be4-3be8-4b09-8445-4583fa6dc348 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:52:50.173017 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-54ec1be4-3be8-4b09-8445-4583fa6dc348 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37f21d6d15cf40a586edda211219fd08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ebb970305844dccacf48a7d8d47ecf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:52:50.182984 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-54ec1be4-3be8-4b09-8445-4583fa6dc348 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '37f21d6d15cf40a586edda211219fd08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ebb970305844dccacf48a7d8d47ecf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:52:50.184575 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-54ec1be4-3be8-4b09-8445-4583fa6dc348 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '37f21d6d15cf40a586edda211219fd08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ebb970305844dccacf48a7d8d47ecf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:52:50.185886 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-54ec1be4-3be8-4b09-8445-4583fa6dc348 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] 10.222.0.11 "GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7" status: 200 len: 1803 microversion: 2.20 time: 0.170302 Nov 17 03:52:50.186464 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 1204/2603] 10.222.0.11 () {60 vars in 1276 bytes} [Wed Nov 17 03:52:50 2021] GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7 => generated 1803 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 17 03:52:50.974494 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-0f82b6ec-0e8b-4639-8f97-d9d9a34fb74c tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:52:50.975502 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-0f82b6ec-0e8b-4639-8f97-d9d9a34fb74c tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] [instance: 15abb40f-daf9-4c4b-ac9c-55f57ee7b938] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:52:50.986187 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-0f82b6ec-0e8b-4639-8f97-d9d9a34fb74c tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:52:50.986938 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-0f82b6ec-0e8b-4639-8f97-d9d9a34fb74c tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:52:50.988279 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-0f82b6ec-0e8b-4639-8f97-d9d9a34fb74c tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:52:50.989044 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-0f82b6ec-0e8b-4639-8f97-d9d9a34fb74c tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:52:51.128291 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-0f82b6ec-0e8b-4639-8f97-d9d9a34fb74c tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a792b5b7e6f7461b8d802a5abaaa9518', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e843a3fb49f41dcb376184d7e156528', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:52:51.140730 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-0f82b6ec-0e8b-4639-8f97-d9d9a34fb74c tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] 10.222.0.11 "GET /compute/v2.1/servers/15abb40f-daf9-4c4b-ac9c-55f57ee7b938" status: 200 len: 1558 microversion: 2.1 time: 0.172563 Nov 17 03:52:51.141570 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 1400/2604] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:52:50 2021] GET /compute/v2.1/servers/15abb40f-daf9-4c4b-ac9c-55f57ee7b938 => generated 1558 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:52:51.207810 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-d1cd9e88-e323-440b-a0a8-7e6820417c54 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:52:51.208873 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-d1cd9e88-e323-440b-a0a8-7e6820417c54 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] [instance: 5d54db85-b991-4890-abaa-952413baa2e7] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:52:51.219514 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-d1cd9e88-e323-440b-a0a8-7e6820417c54 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:52:51.220282 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-d1cd9e88-e323-440b-a0a8-7e6820417c54 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:52:51.221624 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-d1cd9e88-e323-440b-a0a8-7e6820417c54 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:52:51.222354 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-d1cd9e88-e323-440b-a0a8-7e6820417c54 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:52:51.361430 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-d1cd9e88-e323-440b-a0a8-7e6820417c54 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37f21d6d15cf40a586edda211219fd08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ebb970305844dccacf48a7d8d47ecf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:52:51.374847 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-d1cd9e88-e323-440b-a0a8-7e6820417c54 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '37f21d6d15cf40a586edda211219fd08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ebb970305844dccacf48a7d8d47ecf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:52:51.377238 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-d1cd9e88-e323-440b-a0a8-7e6820417c54 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '37f21d6d15cf40a586edda211219fd08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ebb970305844dccacf48a7d8d47ecf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:52:51.379235 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-d1cd9e88-e323-440b-a0a8-7e6820417c54 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] 10.222.0.11 "GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7" status: 200 len: 1803 microversion: 2.20 time: 0.177373 Nov 17 03:52:51.380122 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 1205/2605] 10.222.0.11 () {60 vars in 1276 bytes} [Wed Nov 17 03:52:51 2021] GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7 => generated 1803 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 17 03:52:52.161689 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-e6cc9e81-d3cd-4bfb-9eb1-beb2418599b9 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:52:52.162301 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-e6cc9e81-d3cd-4bfb-9eb1-beb2418599b9 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] [instance: 15abb40f-daf9-4c4b-ac9c-55f57ee7b938] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:52:52.169951 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-e6cc9e81-d3cd-4bfb-9eb1-beb2418599b9 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:52:52.169951 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-e6cc9e81-d3cd-4bfb-9eb1-beb2418599b9 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:52:52.170827 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-e6cc9e81-d3cd-4bfb-9eb1-beb2418599b9 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:52:52.171048 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-e6cc9e81-d3cd-4bfb-9eb1-beb2418599b9 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:52:52.315194 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-e6cc9e81-d3cd-4bfb-9eb1-beb2418599b9 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a792b5b7e6f7461b8d802a5abaaa9518', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e843a3fb49f41dcb376184d7e156528', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:52:52.327545 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-e6cc9e81-d3cd-4bfb-9eb1-beb2418599b9 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] 10.222.0.11 "GET /compute/v2.1/servers/15abb40f-daf9-4c4b-ac9c-55f57ee7b938" status: 200 len: 1558 microversion: 2.1 time: 0.169339 Nov 17 03:52:52.328343 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 1401/2606] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:52:52 2021] GET /compute/v2.1/servers/15abb40f-daf9-4c4b-ac9c-55f57ee7b938 => generated 1558 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:52:52.403710 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-8fd2cad9-f797-40d2-b24e-66eba8c5b699 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:52:52.404264 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-8fd2cad9-f797-40d2-b24e-66eba8c5b699 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] [instance: 5d54db85-b991-4890-abaa-952413baa2e7] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:52:52.411014 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-8fd2cad9-f797-40d2-b24e-66eba8c5b699 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:52:52.411457 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-8fd2cad9-f797-40d2-b24e-66eba8c5b699 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:52:52.412221 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-8fd2cad9-f797-40d2-b24e-66eba8c5b699 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:52:52.412652 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-8fd2cad9-f797-40d2-b24e-66eba8c5b699 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:52:52.545512 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-8fd2cad9-f797-40d2-b24e-66eba8c5b699 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37f21d6d15cf40a586edda211219fd08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ebb970305844dccacf48a7d8d47ecf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:52:52.558055 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-8fd2cad9-f797-40d2-b24e-66eba8c5b699 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '37f21d6d15cf40a586edda211219fd08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ebb970305844dccacf48a7d8d47ecf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:52:52.559521 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-8fd2cad9-f797-40d2-b24e-66eba8c5b699 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '37f21d6d15cf40a586edda211219fd08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ebb970305844dccacf48a7d8d47ecf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:52:52.560676 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-8fd2cad9-f797-40d2-b24e-66eba8c5b699 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] 10.222.0.11 "GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7" status: 200 len: 1803 microversion: 2.20 time: 0.162663 Nov 17 03:52:52.561237 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 1206/2607] 10.222.0.11 () {60 vars in 1276 bytes} [Wed Nov 17 03:52:52 2021] GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7 => generated 1803 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 17 03:52:53.351420 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-063359bb-744f-4ed3-8dda-6d54ffcb008c tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:52:53.352586 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-063359bb-744f-4ed3-8dda-6d54ffcb008c tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] [instance: 15abb40f-daf9-4c4b-ac9c-55f57ee7b938] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:52:53.362968 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-063359bb-744f-4ed3-8dda-6d54ffcb008c tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:52:53.363705 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-063359bb-744f-4ed3-8dda-6d54ffcb008c tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:52:53.365026 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-063359bb-744f-4ed3-8dda-6d54ffcb008c tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:52:53.365739 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-063359bb-744f-4ed3-8dda-6d54ffcb008c tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:52:53.518168 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-063359bb-744f-4ed3-8dda-6d54ffcb008c tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a792b5b7e6f7461b8d802a5abaaa9518', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e843a3fb49f41dcb376184d7e156528', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:52:53.526088 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-063359bb-744f-4ed3-8dda-6d54ffcb008c tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] 10.222.0.11 "GET /compute/v2.1/servers/15abb40f-daf9-4c4b-ac9c-55f57ee7b938" status: 200 len: 1558 microversion: 2.1 time: 0.180943 Nov 17 03:52:53.526650 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 1402/2608] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:52:53 2021] GET /compute/v2.1/servers/15abb40f-daf9-4c4b-ac9c-55f57ee7b938 => generated 1558 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:52:53.587183 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-65d6c245-d0a7-44dd-9def-058d7a69ad30 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:52:53.588441 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-65d6c245-d0a7-44dd-9def-058d7a69ad30 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] [instance: 5d54db85-b991-4890-abaa-952413baa2e7] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:52:53.599046 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-65d6c245-d0a7-44dd-9def-058d7a69ad30 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:52:53.599800 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-65d6c245-d0a7-44dd-9def-058d7a69ad30 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:52:53.601169 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-65d6c245-d0a7-44dd-9def-058d7a69ad30 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:52:53.601984 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-65d6c245-d0a7-44dd-9def-058d7a69ad30 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:52:53.760613 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-65d6c245-d0a7-44dd-9def-058d7a69ad30 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37f21d6d15cf40a586edda211219fd08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ebb970305844dccacf48a7d8d47ecf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:52:53.772392 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-65d6c245-d0a7-44dd-9def-058d7a69ad30 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '37f21d6d15cf40a586edda211219fd08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ebb970305844dccacf48a7d8d47ecf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:52:53.775035 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-65d6c245-d0a7-44dd-9def-058d7a69ad30 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '37f21d6d15cf40a586edda211219fd08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ebb970305844dccacf48a7d8d47ecf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:52:53.777065 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-65d6c245-d0a7-44dd-9def-058d7a69ad30 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] 10.222.0.11 "GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7" status: 200 len: 1803 microversion: 2.20 time: 0.195840 Nov 17 03:52:53.778146 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 1207/2609] 10.222.0.11 () {60 vars in 1276 bytes} [Wed Nov 17 03:52:53 2021] GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7 => generated 1803 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 17 03:52:54.547365 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-53616998-6b56-493c-a6c0-c96dbabac2ee tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:52:54.548342 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-53616998-6b56-493c-a6c0-c96dbabac2ee tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] [instance: 15abb40f-daf9-4c4b-ac9c-55f57ee7b938] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:52:54.558913 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-53616998-6b56-493c-a6c0-c96dbabac2ee tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:52:54.559365 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-53616998-6b56-493c-a6c0-c96dbabac2ee tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:52:54.560144 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-53616998-6b56-493c-a6c0-c96dbabac2ee tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:52:54.560580 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-53616998-6b56-493c-a6c0-c96dbabac2ee tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:52:54.697411 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-53616998-6b56-493c-a6c0-c96dbabac2ee tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a792b5b7e6f7461b8d802a5abaaa9518', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e843a3fb49f41dcb376184d7e156528', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:52:54.710388 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-53616998-6b56-493c-a6c0-c96dbabac2ee tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] 10.222.0.11 "GET /compute/v2.1/servers/15abb40f-daf9-4c4b-ac9c-55f57ee7b938" status: 200 len: 1558 microversion: 2.1 time: 0.169007 Nov 17 03:52:54.711295 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 1403/2610] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:52:54 2021] GET /compute/v2.1/servers/15abb40f-daf9-4c4b-ac9c-55f57ee7b938 => generated 1558 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:52:54.804909 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-1edd7f18-b28c-4bac-820c-21743ee4a117 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:52:54.805813 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-1edd7f18-b28c-4bac-820c-21743ee4a117 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] [instance: 5d54db85-b991-4890-abaa-952413baa2e7] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:52:54.813145 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-1edd7f18-b28c-4bac-820c-21743ee4a117 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:52:54.813637 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-1edd7f18-b28c-4bac-820c-21743ee4a117 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:52:54.814483 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-1edd7f18-b28c-4bac-820c-21743ee4a117 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:52:54.814953 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-1edd7f18-b28c-4bac-820c-21743ee4a117 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:52:54.962023 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-1edd7f18-b28c-4bac-820c-21743ee4a117 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37f21d6d15cf40a586edda211219fd08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ebb970305844dccacf48a7d8d47ecf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:52:54.975002 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-1edd7f18-b28c-4bac-820c-21743ee4a117 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '37f21d6d15cf40a586edda211219fd08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ebb970305844dccacf48a7d8d47ecf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:52:54.977534 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-1edd7f18-b28c-4bac-820c-21743ee4a117 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '37f21d6d15cf40a586edda211219fd08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ebb970305844dccacf48a7d8d47ecf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:52:54.978702 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-1edd7f18-b28c-4bac-820c-21743ee4a117 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] 10.222.0.11 "GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7" status: 200 len: 1803 microversion: 2.20 time: 0.180399 Nov 17 03:52:54.979253 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 1208/2611] 10.222.0.11 () {60 vars in 1276 bytes} [Wed Nov 17 03:52:54 2021] GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7 => generated 1803 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 17 03:52:55.732492 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-cf546cad-74b4-443c-ad36-62ef58cdd621 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:52:55.733555 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-cf546cad-74b4-443c-ad36-62ef58cdd621 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] [instance: 15abb40f-daf9-4c4b-ac9c-55f57ee7b938] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:52:55.744504 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-cf546cad-74b4-443c-ad36-62ef58cdd621 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:52:55.745338 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-cf546cad-74b4-443c-ad36-62ef58cdd621 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:52:55.746639 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-cf546cad-74b4-443c-ad36-62ef58cdd621 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:52:55.747370 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-cf546cad-74b4-443c-ad36-62ef58cdd621 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:52:55.895826 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-cf546cad-74b4-443c-ad36-62ef58cdd621 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a792b5b7e6f7461b8d802a5abaaa9518', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e843a3fb49f41dcb376184d7e156528', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:52:55.907768 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-cf546cad-74b4-443c-ad36-62ef58cdd621 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] 10.222.0.11 "GET /compute/v2.1/servers/15abb40f-daf9-4c4b-ac9c-55f57ee7b938" status: 200 len: 1558 microversion: 2.1 time: 0.181401 Nov 17 03:52:55.908519 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 1404/2612] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:52:55 2021] GET /compute/v2.1/servers/15abb40f-daf9-4c4b-ac9c-55f57ee7b938 => generated 1558 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:52:56.001502 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-cea05df2-0a1d-4149-969f-54dc0ffc0de0 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:52:56.002618 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-cea05df2-0a1d-4149-969f-54dc0ffc0de0 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] [instance: 5d54db85-b991-4890-abaa-952413baa2e7] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:52:56.011685 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-cea05df2-0a1d-4149-969f-54dc0ffc0de0 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:52:56.012151 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-cea05df2-0a1d-4149-969f-54dc0ffc0de0 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:52:56.012932 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-cea05df2-0a1d-4149-969f-54dc0ffc0de0 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:52:56.013357 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-cea05df2-0a1d-4149-969f-54dc0ffc0de0 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:52:56.144599 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-cea05df2-0a1d-4149-969f-54dc0ffc0de0 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37f21d6d15cf40a586edda211219fd08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ebb970305844dccacf48a7d8d47ecf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:52:56.153301 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-cea05df2-0a1d-4149-969f-54dc0ffc0de0 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '37f21d6d15cf40a586edda211219fd08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ebb970305844dccacf48a7d8d47ecf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:52:56.154762 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-cea05df2-0a1d-4149-969f-54dc0ffc0de0 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '37f21d6d15cf40a586edda211219fd08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ebb970305844dccacf48a7d8d47ecf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:52:56.155909 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-cea05df2-0a1d-4149-969f-54dc0ffc0de0 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] 10.222.0.11 "GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7" status: 200 len: 1803 microversion: 2.20 time: 0.160724 Nov 17 03:52:56.156467 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 1209/2613] 10.222.0.11 () {60 vars in 1276 bytes} [Wed Nov 17 03:52:55 2021] GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7 => generated 1803 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 17 03:52:56.929917 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-d259b263-d63b-414d-8594-3d29e3f44d33 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:52:56.931042 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-d259b263-d63b-414d-8594-3d29e3f44d33 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] [instance: 15abb40f-daf9-4c4b-ac9c-55f57ee7b938] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:52:56.937774 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-d259b263-d63b-414d-8594-3d29e3f44d33 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:52:56.938212 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-d259b263-d63b-414d-8594-3d29e3f44d33 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:52:56.938975 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-d259b263-d63b-414d-8594-3d29e3f44d33 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:52:56.939398 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-d259b263-d63b-414d-8594-3d29e3f44d33 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:52:57.078757 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-d259b263-d63b-414d-8594-3d29e3f44d33 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a792b5b7e6f7461b8d802a5abaaa9518', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e843a3fb49f41dcb376184d7e156528', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:52:57.087253 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-d259b263-d63b-414d-8594-3d29e3f44d33 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] 10.222.0.11 "GET /compute/v2.1/servers/15abb40f-daf9-4c4b-ac9c-55f57ee7b938" status: 200 len: 1558 microversion: 2.1 time: 0.163812 Nov 17 03:52:57.087814 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 1405/2614] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:52:56 2021] GET /compute/v2.1/servers/15abb40f-daf9-4c4b-ac9c-55f57ee7b938 => generated 1558 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:52:57.178593 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-57766f1f-39ca-46ba-848e-0e3c1e0e2085 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:52:57.179437 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-57766f1f-39ca-46ba-848e-0e3c1e0e2085 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] [instance: 5d54db85-b991-4890-abaa-952413baa2e7] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:52:57.187124 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-57766f1f-39ca-46ba-848e-0e3c1e0e2085 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:52:57.187567 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-57766f1f-39ca-46ba-848e-0e3c1e0e2085 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:52:57.188326 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-57766f1f-39ca-46ba-848e-0e3c1e0e2085 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:52:57.188755 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-57766f1f-39ca-46ba-848e-0e3c1e0e2085 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:52:57.324840 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-57766f1f-39ca-46ba-848e-0e3c1e0e2085 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37f21d6d15cf40a586edda211219fd08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ebb970305844dccacf48a7d8d47ecf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:52:57.337660 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-57766f1f-39ca-46ba-848e-0e3c1e0e2085 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '37f21d6d15cf40a586edda211219fd08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ebb970305844dccacf48a7d8d47ecf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:52:57.339487 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-57766f1f-39ca-46ba-848e-0e3c1e0e2085 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '37f21d6d15cf40a586edda211219fd08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ebb970305844dccacf48a7d8d47ecf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:52:57.340630 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-57766f1f-39ca-46ba-848e-0e3c1e0e2085 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] 10.222.0.11 "GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7" status: 200 len: 1803 microversion: 2.20 time: 0.168719 Nov 17 03:52:57.341215 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 1210/2615] 10.222.0.11 () {60 vars in 1276 bytes} [Wed Nov 17 03:52:57 2021] GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7 => generated 1803 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 17 03:52:58.105330 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-7ee7162a-7ef0-4db1-9c94-7e50a1a757dd tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:52:58.105889 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-7ee7162a-7ef0-4db1-9c94-7e50a1a757dd tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] [instance: 15abb40f-daf9-4c4b-ac9c-55f57ee7b938] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:52:58.112688 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-7ee7162a-7ef0-4db1-9c94-7e50a1a757dd tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:52:58.113156 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-7ee7162a-7ef0-4db1-9c94-7e50a1a757dd tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:52:58.113945 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-7ee7162a-7ef0-4db1-9c94-7e50a1a757dd tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:52:58.114382 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-7ee7162a-7ef0-4db1-9c94-7e50a1a757dd tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:52:58.259722 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-7ee7162a-7ef0-4db1-9c94-7e50a1a757dd tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a792b5b7e6f7461b8d802a5abaaa9518', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e843a3fb49f41dcb376184d7e156528', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:52:58.269038 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-7ee7162a-7ef0-4db1-9c94-7e50a1a757dd tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] 10.222.0.11 "GET /compute/v2.1/servers/15abb40f-daf9-4c4b-ac9c-55f57ee7b938" status: 200 len: 1558 microversion: 2.1 time: 0.167480 Nov 17 03:52:58.269612 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 1406/2616] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:52:58 2021] GET /compute/v2.1/servers/15abb40f-daf9-4c4b-ac9c-55f57ee7b938 => generated 1558 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:52:58.364001 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-3e7a90cb-4ae6-487c-b09e-4ec5cc5c8dd7 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:52:58.364991 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-3e7a90cb-4ae6-487c-b09e-4ec5cc5c8dd7 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] [instance: 5d54db85-b991-4890-abaa-952413baa2e7] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:52:58.375683 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-3e7a90cb-4ae6-487c-b09e-4ec5cc5c8dd7 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:52:58.376443 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-3e7a90cb-4ae6-487c-b09e-4ec5cc5c8dd7 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:52:58.377762 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-3e7a90cb-4ae6-487c-b09e-4ec5cc5c8dd7 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:52:58.378487 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-3e7a90cb-4ae6-487c-b09e-4ec5cc5c8dd7 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:52:58.522936 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-3e7a90cb-4ae6-487c-b09e-4ec5cc5c8dd7 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37f21d6d15cf40a586edda211219fd08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ebb970305844dccacf48a7d8d47ecf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:52:58.534995 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-3e7a90cb-4ae6-487c-b09e-4ec5cc5c8dd7 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '37f21d6d15cf40a586edda211219fd08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ebb970305844dccacf48a7d8d47ecf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:52:58.537360 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-3e7a90cb-4ae6-487c-b09e-4ec5cc5c8dd7 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '37f21d6d15cf40a586edda211219fd08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ebb970305844dccacf48a7d8d47ecf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:52:58.539142 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-3e7a90cb-4ae6-487c-b09e-4ec5cc5c8dd7 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] 10.222.0.11 "GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7" status: 200 len: 1803 microversion: 2.20 time: 0.181224 Nov 17 03:52:58.539819 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 1211/2617] 10.222.0.11 () {60 vars in 1276 bytes} [Wed Nov 17 03:52:58 2021] GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7 => generated 1803 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 17 03:52:59.294560 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-fb06f6a0-51d8-4981-b84d-c055b6a7da53 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:52:59.295268 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-fb06f6a0-51d8-4981-b84d-c055b6a7da53 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] [instance: 15abb40f-daf9-4c4b-ac9c-55f57ee7b938] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:52:59.304356 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-fb06f6a0-51d8-4981-b84d-c055b6a7da53 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:52:59.304910 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-fb06f6a0-51d8-4981-b84d-c055b6a7da53 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:52:59.305908 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-fb06f6a0-51d8-4981-b84d-c055b6a7da53 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:52:59.306451 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-fb06f6a0-51d8-4981-b84d-c055b6a7da53 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:52:59.448304 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-fb06f6a0-51d8-4981-b84d-c055b6a7da53 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a792b5b7e6f7461b8d802a5abaaa9518', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e843a3fb49f41dcb376184d7e156528', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:52:59.456610 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-fb06f6a0-51d8-4981-b84d-c055b6a7da53 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] 10.222.0.11 "GET /compute/v2.1/servers/15abb40f-daf9-4c4b-ac9c-55f57ee7b938" status: 200 len: 1558 microversion: 2.1 time: 0.168036 Nov 17 03:52:59.457190 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 1407/2618] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:52:59 2021] GET /compute/v2.1/servers/15abb40f-daf9-4c4b-ac9c-55f57ee7b938 => generated 1558 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:52:59.558990 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-46e4c505-861d-425a-b995-b79fdc061a66 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:52:59.559542 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-46e4c505-861d-425a-b995-b79fdc061a66 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] [instance: 5d54db85-b991-4890-abaa-952413baa2e7] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:52:59.566324 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-46e4c505-861d-425a-b995-b79fdc061a66 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:52:59.566773 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-46e4c505-861d-425a-b995-b79fdc061a66 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:52:59.567532 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-46e4c505-861d-425a-b995-b79fdc061a66 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:52:59.567962 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-46e4c505-861d-425a-b995-b79fdc061a66 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:52:59.717280 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-46e4c505-861d-425a-b995-b79fdc061a66 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37f21d6d15cf40a586edda211219fd08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ebb970305844dccacf48a7d8d47ecf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:52:59.729245 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-46e4c505-861d-425a-b995-b79fdc061a66 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '37f21d6d15cf40a586edda211219fd08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ebb970305844dccacf48a7d8d47ecf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:52:59.731491 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-46e4c505-861d-425a-b995-b79fdc061a66 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '37f21d6d15cf40a586edda211219fd08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ebb970305844dccacf48a7d8d47ecf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:52:59.733304 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-46e4c505-861d-425a-b995-b79fdc061a66 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] 10.222.0.11 "GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7" status: 200 len: 1803 microversion: 2.20 time: 0.178130 Nov 17 03:52:59.734096 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 1212/2619] 10.222.0.11 () {60 vars in 1276 bytes} [Wed Nov 17 03:52:59 2021] GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7 => generated 1803 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 17 03:53:00.478424 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-a214b2d5-2328-46a7-a3ab-dd22ebfc0346 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:53:00.479309 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-a214b2d5-2328-46a7-a3ab-dd22ebfc0346 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] [instance: 15abb40f-daf9-4c4b-ac9c-55f57ee7b938] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:53:00.489885 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-a214b2d5-2328-46a7-a3ab-dd22ebfc0346 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:53:00.490616 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-a214b2d5-2328-46a7-a3ab-dd22ebfc0346 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:53:00.491873 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-a214b2d5-2328-46a7-a3ab-dd22ebfc0346 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:53:00.492589 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-a214b2d5-2328-46a7-a3ab-dd22ebfc0346 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:53:00.645532 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-a214b2d5-2328-46a7-a3ab-dd22ebfc0346 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a792b5b7e6f7461b8d802a5abaaa9518', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e843a3fb49f41dcb376184d7e156528', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:53:00.654187 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-a214b2d5-2328-46a7-a3ab-dd22ebfc0346 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] 10.222.0.11 "GET /compute/v2.1/servers/15abb40f-daf9-4c4b-ac9c-55f57ee7b938" status: 200 len: 1558 microversion: 2.1 time: 0.182101 Nov 17 03:53:00.654755 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 1408/2620] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:53:00 2021] GET /compute/v2.1/servers/15abb40f-daf9-4c4b-ac9c-55f57ee7b938 => generated 1558 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:53:00.712577 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Too many heartbeats missed Nov 17 03:53:00.755385 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-b8565a92-512f-4be2-bfa9-440f6059c160 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:53:00.756384 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-b8565a92-512f-4be2-bfa9-440f6059c160 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] [instance: 5d54db85-b991-4890-abaa-952413baa2e7] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:53:00.765189 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-b8565a92-512f-4be2-bfa9-440f6059c160 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:53:00.765636 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-b8565a92-512f-4be2-bfa9-440f6059c160 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:53:00.766408 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-b8565a92-512f-4be2-bfa9-440f6059c160 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:53:00.766849 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-b8565a92-512f-4be2-bfa9-440f6059c160 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:53:00.910559 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-b8565a92-512f-4be2-bfa9-440f6059c160 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37f21d6d15cf40a586edda211219fd08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ebb970305844dccacf48a7d8d47ecf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:53:00.923070 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-b8565a92-512f-4be2-bfa9-440f6059c160 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '37f21d6d15cf40a586edda211219fd08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ebb970305844dccacf48a7d8d47ecf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:53:00.925346 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-b8565a92-512f-4be2-bfa9-440f6059c160 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '37f21d6d15cf40a586edda211219fd08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ebb970305844dccacf48a7d8d47ecf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:53:00.927463 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-b8565a92-512f-4be2-bfa9-440f6059c160 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] 10.222.0.11 "GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7" status: 200 len: 1803 microversion: 2.20 time: 0.177365 Nov 17 03:53:00.928235 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 1213/2621] 10.222.0.11 () {60 vars in 1276 bytes} [Wed Nov 17 03:53:00 2021] GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7 => generated 1803 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 17 03:53:01.675391 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-a880068b-2fb1-495c-ac75-33199fe54766 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:53:01.676396 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-a880068b-2fb1-495c-ac75-33199fe54766 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] [instance: 15abb40f-daf9-4c4b-ac9c-55f57ee7b938] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:53:01.686235 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-a880068b-2fb1-495c-ac75-33199fe54766 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:53:01.686680 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-a880068b-2fb1-495c-ac75-33199fe54766 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:53:01.687469 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-a880068b-2fb1-495c-ac75-33199fe54766 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:53:01.687901 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-a880068b-2fb1-495c-ac75-33199fe54766 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:53:01.837370 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-a880068b-2fb1-495c-ac75-33199fe54766 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a792b5b7e6f7461b8d802a5abaaa9518', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e843a3fb49f41dcb376184d7e156528', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:53:01.846941 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-a880068b-2fb1-495c-ac75-33199fe54766 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] 10.222.0.11 "GET /compute/v2.1/servers/15abb40f-daf9-4c4b-ac9c-55f57ee7b938" status: 200 len: 1558 microversion: 2.1 time: 0.177790 Nov 17 03:53:01.847485 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 1409/2622] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:53:01 2021] GET /compute/v2.1/servers/15abb40f-daf9-4c4b-ac9c-55f57ee7b938 => generated 1558 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:53:01.951431 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-3884ec61-6ebb-464d-ae0c-5d6cfabfa61f tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:53:01.952291 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-3884ec61-6ebb-464d-ae0c-5d6cfabfa61f tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] [instance: 5d54db85-b991-4890-abaa-952413baa2e7] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:53:01.963055 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-3884ec61-6ebb-464d-ae0c-5d6cfabfa61f tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:53:01.963795 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-3884ec61-6ebb-464d-ae0c-5d6cfabfa61f tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:53:01.965136 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-3884ec61-6ebb-464d-ae0c-5d6cfabfa61f tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:53:01.965483 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-3884ec61-6ebb-464d-ae0c-5d6cfabfa61f tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:53:02.104346 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-3884ec61-6ebb-464d-ae0c-5d6cfabfa61f tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37f21d6d15cf40a586edda211219fd08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ebb970305844dccacf48a7d8d47ecf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:53:02.112715 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-3884ec61-6ebb-464d-ae0c-5d6cfabfa61f tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '37f21d6d15cf40a586edda211219fd08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ebb970305844dccacf48a7d8d47ecf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:53:02.114218 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-3884ec61-6ebb-464d-ae0c-5d6cfabfa61f tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '37f21d6d15cf40a586edda211219fd08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ebb970305844dccacf48a7d8d47ecf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:53:02.115366 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-3884ec61-6ebb-464d-ae0c-5d6cfabfa61f tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] 10.222.0.11 "GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7" status: 200 len: 1803 microversion: 2.20 time: 0.170259 Nov 17 03:53:02.115897 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 1214/2623] 10.222.0.11 () {60 vars in 1276 bytes} [Wed Nov 17 03:53:01 2021] GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7 => generated 1803 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 17 03:53:02.868221 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-326aedad-0aac-4572-99c1-ed157317421c tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:53:02.869229 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-326aedad-0aac-4572-99c1-ed157317421c tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] [instance: 15abb40f-daf9-4c4b-ac9c-55f57ee7b938] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:53:02.879624 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-326aedad-0aac-4572-99c1-ed157317421c tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:53:02.880361 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-326aedad-0aac-4572-99c1-ed157317421c tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:53:02.881665 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-326aedad-0aac-4572-99c1-ed157317421c tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:53:02.882379 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-326aedad-0aac-4572-99c1-ed157317421c tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:53:03.023012 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-326aedad-0aac-4572-99c1-ed157317421c tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a792b5b7e6f7461b8d802a5abaaa9518', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e843a3fb49f41dcb376184d7e156528', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:53:03.035445 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-326aedad-0aac-4572-99c1-ed157317421c tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] 10.222.0.11 "GET /compute/v2.1/servers/15abb40f-daf9-4c4b-ac9c-55f57ee7b938" status: 200 len: 1558 microversion: 2.1 time: 0.172968 Nov 17 03:53:03.036200 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 1410/2624] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:53:02 2021] GET /compute/v2.1/servers/15abb40f-daf9-4c4b-ac9c-55f57ee7b938 => generated 1558 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:53:03.138164 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-9cb6e35a-c794-45f9-b006-d92685e1c570 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:53:03.138989 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-9cb6e35a-c794-45f9-b006-d92685e1c570 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] [instance: 5d54db85-b991-4890-abaa-952413baa2e7] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:53:03.149455 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-9cb6e35a-c794-45f9-b006-d92685e1c570 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:53:03.150198 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-9cb6e35a-c794-45f9-b006-d92685e1c570 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:53:03.151477 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-9cb6e35a-c794-45f9-b006-d92685e1c570 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:53:03.152191 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-9cb6e35a-c794-45f9-b006-d92685e1c570 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:53:03.300923 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-9cb6e35a-c794-45f9-b006-d92685e1c570 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37f21d6d15cf40a586edda211219fd08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ebb970305844dccacf48a7d8d47ecf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:53:03.310743 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-9cb6e35a-c794-45f9-b006-d92685e1c570 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '37f21d6d15cf40a586edda211219fd08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ebb970305844dccacf48a7d8d47ecf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:53:03.312226 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-9cb6e35a-c794-45f9-b006-d92685e1c570 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '37f21d6d15cf40a586edda211219fd08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ebb970305844dccacf48a7d8d47ecf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:53:03.313437 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-9cb6e35a-c794-45f9-b006-d92685e1c570 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] 10.222.0.11 "GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7" status: 200 len: 1803 microversion: 2.20 time: 0.182443 Nov 17 03:53:03.313998 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 1215/2625] 10.222.0.11 () {60 vars in 1276 bytes} [Wed Nov 17 03:53:03 2021] GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7 => generated 1803 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 17 03:53:04.060163 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-c4506d2e-0245-4c20-945f-2c101cd04b6b tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:53:04.060794 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-c4506d2e-0245-4c20-945f-2c101cd04b6b tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] [instance: 15abb40f-daf9-4c4b-ac9c-55f57ee7b938] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:53:04.067540 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-c4506d2e-0245-4c20-945f-2c101cd04b6b tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:53:04.068002 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-c4506d2e-0245-4c20-945f-2c101cd04b6b tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:53:04.068801 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-c4506d2e-0245-4c20-945f-2c101cd04b6b tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:53:04.069256 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-c4506d2e-0245-4c20-945f-2c101cd04b6b tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:53:04.211286 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-c4506d2e-0245-4c20-945f-2c101cd04b6b tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a792b5b7e6f7461b8d802a5abaaa9518', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e843a3fb49f41dcb376184d7e156528', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:53:04.219405 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-c4506d2e-0245-4c20-945f-2c101cd04b6b tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] 10.222.0.11 "GET /compute/v2.1/servers/15abb40f-daf9-4c4b-ac9c-55f57ee7b938" status: 200 len: 1558 microversion: 2.1 time: 0.165333 Nov 17 03:53:04.219965 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 1411/2626] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:53:04 2021] GET /compute/v2.1/servers/15abb40f-daf9-4c4b-ac9c-55f57ee7b938 => generated 1558 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:53:04.341306 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-a600709a-8933-4a31-918a-ec66125a214b tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:53:04.342184 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-a600709a-8933-4a31-918a-ec66125a214b tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] [instance: 5d54db85-b991-4890-abaa-952413baa2e7] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:53:04.352856 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-a600709a-8933-4a31-918a-ec66125a214b tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:53:04.353658 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-a600709a-8933-4a31-918a-ec66125a214b tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:53:04.354985 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-a600709a-8933-4a31-918a-ec66125a214b tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:53:04.355879 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-a600709a-8933-4a31-918a-ec66125a214b tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:53:04.487919 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-a600709a-8933-4a31-918a-ec66125a214b tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37f21d6d15cf40a586edda211219fd08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ebb970305844dccacf48a7d8d47ecf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:53:04.496181 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-a600709a-8933-4a31-918a-ec66125a214b tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '37f21d6d15cf40a586edda211219fd08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ebb970305844dccacf48a7d8d47ecf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:53:04.497776 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-a600709a-8933-4a31-918a-ec66125a214b tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '37f21d6d15cf40a586edda211219fd08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ebb970305844dccacf48a7d8d47ecf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:53:04.498921 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-a600709a-8933-4a31-918a-ec66125a214b tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] 10.222.0.11 "GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7" status: 200 len: 1803 microversion: 2.20 time: 0.163865 Nov 17 03:53:04.499452 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 1216/2627] 10.222.0.11 () {60 vars in 1276 bytes} [Wed Nov 17 03:53:04 2021] GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7 => generated 1803 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 17 03:53:05.239834 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-c1f1dffc-d449-4d73-ab76-c7998a5b27a0 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:53:05.240931 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-c1f1dffc-d449-4d73-ab76-c7998a5b27a0 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] [instance: 15abb40f-daf9-4c4b-ac9c-55f57ee7b938] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:53:05.251039 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-c1f1dffc-d449-4d73-ab76-c7998a5b27a0 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:53:05.251785 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-c1f1dffc-d449-4d73-ab76-c7998a5b27a0 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:53:05.253093 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-c1f1dffc-d449-4d73-ab76-c7998a5b27a0 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:53:05.253810 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-c1f1dffc-d449-4d73-ab76-c7998a5b27a0 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:53:05.390368 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-c1f1dffc-d449-4d73-ab76-c7998a5b27a0 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a792b5b7e6f7461b8d802a5abaaa9518', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e843a3fb49f41dcb376184d7e156528', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:53:05.406061 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-c1f1dffc-d449-4d73-ab76-c7998a5b27a0 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] 10.222.0.11 "GET /compute/v2.1/servers/15abb40f-daf9-4c4b-ac9c-55f57ee7b938" status: 200 len: 1558 microversion: 2.1 time: 0.172465 Nov 17 03:53:05.406630 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 1412/2628] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:53:05 2021] GET /compute/v2.1/servers/15abb40f-daf9-4c4b-ac9c-55f57ee7b938 => generated 1558 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:53:05.521992 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-1585dc91-834b-40dd-92eb-4d0aec1f5633 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:53:05.523014 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-1585dc91-834b-40dd-92eb-4d0aec1f5633 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] [instance: 5d54db85-b991-4890-abaa-952413baa2e7] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:53:05.531635 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-1585dc91-834b-40dd-92eb-4d0aec1f5633 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:53:05.532078 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-1585dc91-834b-40dd-92eb-4d0aec1f5633 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:53:05.532836 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-1585dc91-834b-40dd-92eb-4d0aec1f5633 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:53:05.533290 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-1585dc91-834b-40dd-92eb-4d0aec1f5633 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:53:05.673608 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-1585dc91-834b-40dd-92eb-4d0aec1f5633 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37f21d6d15cf40a586edda211219fd08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ebb970305844dccacf48a7d8d47ecf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:53:05.685795 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-1585dc91-834b-40dd-92eb-4d0aec1f5633 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '37f21d6d15cf40a586edda211219fd08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ebb970305844dccacf48a7d8d47ecf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:53:05.687296 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-1585dc91-834b-40dd-92eb-4d0aec1f5633 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '37f21d6d15cf40a586edda211219fd08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ebb970305844dccacf48a7d8d47ecf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:53:05.688422 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-1585dc91-834b-40dd-92eb-4d0aec1f5633 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] 10.222.0.11 "GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7" status: 200 len: 1803 microversion: 2.20 time: 0.172634 Nov 17 03:53:05.689004 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 1217/2629] 10.222.0.11 () {60 vars in 1276 bytes} [Wed Nov 17 03:53:05 2021] GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7 => generated 1803 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 17 03:53:06.434186 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-82d5ac09-eb7b-41b9-a0ee-c206578124bb tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:53:06.434889 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-82d5ac09-eb7b-41b9-a0ee-c206578124bb tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] [instance: 15abb40f-daf9-4c4b-ac9c-55f57ee7b938] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:53:06.441730 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-82d5ac09-eb7b-41b9-a0ee-c206578124bb tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:53:06.442176 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-82d5ac09-eb7b-41b9-a0ee-c206578124bb tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:53:06.442933 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-82d5ac09-eb7b-41b9-a0ee-c206578124bb tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:53:06.443360 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-82d5ac09-eb7b-41b9-a0ee-c206578124bb tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:53:06.589859 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-82d5ac09-eb7b-41b9-a0ee-c206578124bb tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a792b5b7e6f7461b8d802a5abaaa9518', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e843a3fb49f41dcb376184d7e156528', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:53:06.598497 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-82d5ac09-eb7b-41b9-a0ee-c206578124bb tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] 10.222.0.11 "GET /compute/v2.1/servers/15abb40f-daf9-4c4b-ac9c-55f57ee7b938" status: 200 len: 1558 microversion: 2.1 time: 0.170639 Nov 17 03:53:06.599071 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 1413/2630] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:53:06 2021] GET /compute/v2.1/servers/15abb40f-daf9-4c4b-ac9c-55f57ee7b938 => generated 1558 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:53:06.710290 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-c563e064-f2f2-4a9b-8367-bc44d69e82d8 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:53:06.711172 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-c563e064-f2f2-4a9b-8367-bc44d69e82d8 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] [instance: 5d54db85-b991-4890-abaa-952413baa2e7] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:53:06.721932 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-c563e064-f2f2-4a9b-8367-bc44d69e82d8 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:53:06.722691 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-c563e064-f2f2-4a9b-8367-bc44d69e82d8 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:53:06.723950 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-c563e064-f2f2-4a9b-8367-bc44d69e82d8 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:53:06.724668 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-c563e064-f2f2-4a9b-8367-bc44d69e82d8 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:53:06.863382 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-c563e064-f2f2-4a9b-8367-bc44d69e82d8 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37f21d6d15cf40a586edda211219fd08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ebb970305844dccacf48a7d8d47ecf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:53:06.874955 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-c563e064-f2f2-4a9b-8367-bc44d69e82d8 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '37f21d6d15cf40a586edda211219fd08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ebb970305844dccacf48a7d8d47ecf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:53:06.876459 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-c563e064-f2f2-4a9b-8367-bc44d69e82d8 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '37f21d6d15cf40a586edda211219fd08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ebb970305844dccacf48a7d8d47ecf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:53:06.877647 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-c563e064-f2f2-4a9b-8367-bc44d69e82d8 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] 10.222.0.11 "GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7" status: 200 len: 1803 microversion: 2.20 time: 0.173864 Nov 17 03:53:06.878215 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 1218/2631] 10.222.0.11 () {60 vars in 1276 bytes} [Wed Nov 17 03:53:06 2021] GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7 => generated 1803 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 17 03:53:07.619414 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-c361eb80-c160-41cd-a222-09998a5b6484 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:53:07.620340 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-c361eb80-c160-41cd-a222-09998a5b6484 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] [instance: 15abb40f-daf9-4c4b-ac9c-55f57ee7b938] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:53:07.627902 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-c361eb80-c160-41cd-a222-09998a5b6484 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:53:07.628977 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-c361eb80-c160-41cd-a222-09998a5b6484 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:53:07.629145 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-c361eb80-c160-41cd-a222-09998a5b6484 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:53:07.629572 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-c361eb80-c160-41cd-a222-09998a5b6484 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:53:07.765801 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-c361eb80-c160-41cd-a222-09998a5b6484 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a792b5b7e6f7461b8d802a5abaaa9518', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e843a3fb49f41dcb376184d7e156528', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:53:07.774538 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-c361eb80-c160-41cd-a222-09998a5b6484 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] 10.222.0.11 "GET /compute/v2.1/servers/15abb40f-daf9-4c4b-ac9c-55f57ee7b938" status: 200 len: 1558 microversion: 2.1 time: 0.161404 Nov 17 03:53:07.775104 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 1414/2632] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:53:07 2021] GET /compute/v2.1/servers/15abb40f-daf9-4c4b-ac9c-55f57ee7b938 => generated 1558 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:53:07.897785 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-40a84a95-6900-4bad-ad6d-2bb4b7def6b8 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:53:07.898371 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-40a84a95-6900-4bad-ad6d-2bb4b7def6b8 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] [instance: 5d54db85-b991-4890-abaa-952413baa2e7] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:53:07.905565 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-40a84a95-6900-4bad-ad6d-2bb4b7def6b8 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:53:07.906018 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-40a84a95-6900-4bad-ad6d-2bb4b7def6b8 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:53:07.906825 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-40a84a95-6900-4bad-ad6d-2bb4b7def6b8 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:53:07.907260 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-40a84a95-6900-4bad-ad6d-2bb4b7def6b8 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:53:08.052272 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-40a84a95-6900-4bad-ad6d-2bb4b7def6b8 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37f21d6d15cf40a586edda211219fd08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ebb970305844dccacf48a7d8d47ecf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:53:08.061276 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-40a84a95-6900-4bad-ad6d-2bb4b7def6b8 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '37f21d6d15cf40a586edda211219fd08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ebb970305844dccacf48a7d8d47ecf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:53:08.062769 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-40a84a95-6900-4bad-ad6d-2bb4b7def6b8 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '37f21d6d15cf40a586edda211219fd08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ebb970305844dccacf48a7d8d47ecf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:53:08.063934 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-40a84a95-6900-4bad-ad6d-2bb4b7def6b8 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] 10.222.0.11 "GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7" status: 200 len: 1803 microversion: 2.20 time: 0.170949 Nov 17 03:53:08.064526 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 1219/2633] 10.222.0.11 () {60 vars in 1276 bytes} [Wed Nov 17 03:53:07 2021] GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7 => generated 1803 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 17 03:53:08.795971 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-b9f888ec-ca7a-4f48-b7f5-31cf94b440d8 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:53:08.796985 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-b9f888ec-ca7a-4f48-b7f5-31cf94b440d8 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] [instance: 15abb40f-daf9-4c4b-ac9c-55f57ee7b938] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:53:08.805824 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-b9f888ec-ca7a-4f48-b7f5-31cf94b440d8 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:53:08.806271 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-b9f888ec-ca7a-4f48-b7f5-31cf94b440d8 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:53:08.807030 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-b9f888ec-ca7a-4f48-b7f5-31cf94b440d8 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:53:08.807439 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-b9f888ec-ca7a-4f48-b7f5-31cf94b440d8 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:53:08.941339 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-b9f888ec-ca7a-4f48-b7f5-31cf94b440d8 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a792b5b7e6f7461b8d802a5abaaa9518', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e843a3fb49f41dcb376184d7e156528', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:53:08.954707 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-b9f888ec-ca7a-4f48-b7f5-31cf94b440d8 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] 10.222.0.11 "GET /compute/v2.1/servers/15abb40f-daf9-4c4b-ac9c-55f57ee7b938" status: 200 len: 1558 microversion: 2.1 time: 0.164486 Nov 17 03:53:08.955614 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 1415/2634] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:53:08 2021] GET /compute/v2.1/servers/15abb40f-daf9-4c4b-ac9c-55f57ee7b938 => generated 1558 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:53:09.086172 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-6365076b-16eb-457a-9f3c-e19adb38663e tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:53:09.087042 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-6365076b-16eb-457a-9f3c-e19adb38663e tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] [instance: 5d54db85-b991-4890-abaa-952413baa2e7] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:53:09.096558 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-6365076b-16eb-457a-9f3c-e19adb38663e tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:53:09.097369 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-6365076b-16eb-457a-9f3c-e19adb38663e tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:53:09.098333 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-6365076b-16eb-457a-9f3c-e19adb38663e tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:53:09.098774 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-6365076b-16eb-457a-9f3c-e19adb38663e tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:53:09.239732 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-6365076b-16eb-457a-9f3c-e19adb38663e tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37f21d6d15cf40a586edda211219fd08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ebb970305844dccacf48a7d8d47ecf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:53:09.248011 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-6365076b-16eb-457a-9f3c-e19adb38663e tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '37f21d6d15cf40a586edda211219fd08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ebb970305844dccacf48a7d8d47ecf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:53:09.249525 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-6365076b-16eb-457a-9f3c-e19adb38663e tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '37f21d6d15cf40a586edda211219fd08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ebb970305844dccacf48a7d8d47ecf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:53:09.250668 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-6365076b-16eb-457a-9f3c-e19adb38663e tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] 10.222.0.11 "GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7" status: 200 len: 1803 microversion: 2.20 time: 0.170848 Nov 17 03:53:09.251205 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 1220/2635] 10.222.0.11 () {60 vars in 1276 bytes} [Wed Nov 17 03:53:09 2021] GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7 => generated 1803 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 17 03:53:09.979657 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-69813295-5e4f-4720-b0d3-1e6b90ea6129 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:53:09.980445 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-69813295-5e4f-4720-b0d3-1e6b90ea6129 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] [instance: 15abb40f-daf9-4c4b-ac9c-55f57ee7b938] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:53:09.989233 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-69813295-5e4f-4720-b0d3-1e6b90ea6129 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:53:09.989818 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-69813295-5e4f-4720-b0d3-1e6b90ea6129 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:53:09.990824 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-69813295-5e4f-4720-b0d3-1e6b90ea6129 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:53:09.991394 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-69813295-5e4f-4720-b0d3-1e6b90ea6129 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:53:10.131975 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-69813295-5e4f-4720-b0d3-1e6b90ea6129 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a792b5b7e6f7461b8d802a5abaaa9518', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e843a3fb49f41dcb376184d7e156528', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:53:10.140084 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-69813295-5e4f-4720-b0d3-1e6b90ea6129 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] 10.222.0.11 "GET /compute/v2.1/servers/15abb40f-daf9-4c4b-ac9c-55f57ee7b938" status: 200 len: 1558 microversion: 2.1 time: 0.165552 Nov 17 03:53:10.140650 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 1416/2636] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:53:09 2021] GET /compute/v2.1/servers/15abb40f-daf9-4c4b-ac9c-55f57ee7b938 => generated 1558 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:53:10.269279 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-cb5cf67b-93d6-4e3d-8489-9a271363a573 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:53:10.269979 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-cb5cf67b-93d6-4e3d-8489-9a271363a573 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] [instance: 5d54db85-b991-4890-abaa-952413baa2e7] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:53:10.276950 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-cb5cf67b-93d6-4e3d-8489-9a271363a573 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:53:10.277434 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-cb5cf67b-93d6-4e3d-8489-9a271363a573 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:53:10.278230 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-cb5cf67b-93d6-4e3d-8489-9a271363a573 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:53:10.278661 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-cb5cf67b-93d6-4e3d-8489-9a271363a573 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:53:10.414215 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-cb5cf67b-93d6-4e3d-8489-9a271363a573 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37f21d6d15cf40a586edda211219fd08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ebb970305844dccacf48a7d8d47ecf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:53:10.422596 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-cb5cf67b-93d6-4e3d-8489-9a271363a573 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '37f21d6d15cf40a586edda211219fd08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ebb970305844dccacf48a7d8d47ecf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:53:10.424081 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-cb5cf67b-93d6-4e3d-8489-9a271363a573 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '37f21d6d15cf40a586edda211219fd08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ebb970305844dccacf48a7d8d47ecf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:53:10.425544 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-cb5cf67b-93d6-4e3d-8489-9a271363a573 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] 10.222.0.11 "GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7" status: 200 len: 1803 microversion: 2.20 time: 0.160621 Nov 17 03:53:10.430724 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 1221/2637] 10.222.0.11 () {60 vars in 1276 bytes} [Wed Nov 17 03:53:10 2021] GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7 => generated 1803 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 17 03:53:11.162119 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-e9ba28cc-9d06-4afe-8d5c-a09b22299adc tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:53:11.162940 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-e9ba28cc-9d06-4afe-8d5c-a09b22299adc tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] [instance: 15abb40f-daf9-4c4b-ac9c-55f57ee7b938] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:53:11.173754 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-e9ba28cc-9d06-4afe-8d5c-a09b22299adc tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:53:11.174538 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-e9ba28cc-9d06-4afe-8d5c-a09b22299adc tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:53:11.175659 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-e9ba28cc-9d06-4afe-8d5c-a09b22299adc tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:53:11.176101 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-e9ba28cc-9d06-4afe-8d5c-a09b22299adc tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:53:11.318951 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-e9ba28cc-9d06-4afe-8d5c-a09b22299adc tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a792b5b7e6f7461b8d802a5abaaa9518', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e843a3fb49f41dcb376184d7e156528', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:53:11.327574 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-e9ba28cc-9d06-4afe-8d5c-a09b22299adc tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] 10.222.0.11 "GET /compute/v2.1/servers/15abb40f-daf9-4c4b-ac9c-55f57ee7b938" status: 200 len: 1558 microversion: 2.1 time: 0.172596 Nov 17 03:53:11.328146 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 1417/2638] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:53:11 2021] GET /compute/v2.1/servers/15abb40f-daf9-4c4b-ac9c-55f57ee7b938 => generated 1558 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:53:11.448487 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-a8960fa7-eb63-4894-a388-182fd4a68e0a tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:53:11.449370 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-a8960fa7-eb63-4894-a388-182fd4a68e0a tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] [instance: 5d54db85-b991-4890-abaa-952413baa2e7] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:53:11.459915 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-a8960fa7-eb63-4894-a388-182fd4a68e0a tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:53:11.460657 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-a8960fa7-eb63-4894-a388-182fd4a68e0a tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:53:11.462022 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-a8960fa7-eb63-4894-a388-182fd4a68e0a tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:53:11.462733 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-a8960fa7-eb63-4894-a388-182fd4a68e0a tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:53:11.604989 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-a8960fa7-eb63-4894-a388-182fd4a68e0a tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37f21d6d15cf40a586edda211219fd08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ebb970305844dccacf48a7d8d47ecf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:53:11.614267 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-a8960fa7-eb63-4894-a388-182fd4a68e0a tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '37f21d6d15cf40a586edda211219fd08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ebb970305844dccacf48a7d8d47ecf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:53:11.615760 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-a8960fa7-eb63-4894-a388-182fd4a68e0a tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '37f21d6d15cf40a586edda211219fd08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ebb970305844dccacf48a7d8d47ecf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:53:11.616961 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-a8960fa7-eb63-4894-a388-182fd4a68e0a tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] 10.222.0.11 "GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7" status: 200 len: 1803 microversion: 2.20 time: 0.174627 Nov 17 03:53:11.617524 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 1222/2639] 10.222.0.11 () {60 vars in 1276 bytes} [Wed Nov 17 03:53:11 2021] GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7 => generated 1803 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 17 03:53:12.355163 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-3c17bab4-26a0-46a4-ab7b-00c46708259d tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:53:12.356130 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-3c17bab4-26a0-46a4-ab7b-00c46708259d tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] [instance: 15abb40f-daf9-4c4b-ac9c-55f57ee7b938] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:53:12.365796 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-3c17bab4-26a0-46a4-ab7b-00c46708259d tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:53:12.366241 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-3c17bab4-26a0-46a4-ab7b-00c46708259d tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:53:12.367078 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-3c17bab4-26a0-46a4-ab7b-00c46708259d tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:53:12.367513 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-3c17bab4-26a0-46a4-ab7b-00c46708259d tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:53:12.513712 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-3c17bab4-26a0-46a4-ab7b-00c46708259d tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a792b5b7e6f7461b8d802a5abaaa9518', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e843a3fb49f41dcb376184d7e156528', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:53:12.522342 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-3c17bab4-26a0-46a4-ab7b-00c46708259d tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] 10.222.0.11 "GET /compute/v2.1/servers/15abb40f-daf9-4c4b-ac9c-55f57ee7b938" status: 200 len: 1558 microversion: 2.1 time: 0.173602 Nov 17 03:53:12.522941 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 1418/2640] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:53:12 2021] GET /compute/v2.1/servers/15abb40f-daf9-4c4b-ac9c-55f57ee7b938 => generated 1558 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:53:12.639373 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-6ae2374d-d951-4bbb-9b3a-5f99aae7c5fc tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:53:12.640362 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-6ae2374d-d951-4bbb-9b3a-5f99aae7c5fc tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] [instance: 5d54db85-b991-4890-abaa-952413baa2e7] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:53:12.648754 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-6ae2374d-d951-4bbb-9b3a-5f99aae7c5fc tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:53:12.649229 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-6ae2374d-d951-4bbb-9b3a-5f99aae7c5fc tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:53:12.649998 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-6ae2374d-d951-4bbb-9b3a-5f99aae7c5fc tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:53:12.650423 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-6ae2374d-d951-4bbb-9b3a-5f99aae7c5fc tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:53:12.788448 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-6ae2374d-d951-4bbb-9b3a-5f99aae7c5fc tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37f21d6d15cf40a586edda211219fd08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ebb970305844dccacf48a7d8d47ecf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:53:12.797124 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-6ae2374d-d951-4bbb-9b3a-5f99aae7c5fc tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '37f21d6d15cf40a586edda211219fd08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ebb970305844dccacf48a7d8d47ecf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:53:12.798619 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-6ae2374d-d951-4bbb-9b3a-5f99aae7c5fc tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '37f21d6d15cf40a586edda211219fd08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ebb970305844dccacf48a7d8d47ecf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:53:12.799759 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-6ae2374d-d951-4bbb-9b3a-5f99aae7c5fc tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] 10.222.0.11 "GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7" status: 200 len: 1803 microversion: 2.20 time: 0.166727 Nov 17 03:53:12.800335 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 1223/2641] 10.222.0.11 () {60 vars in 1276 bytes} [Wed Nov 17 03:53:12 2021] GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7 => generated 1803 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 17 03:53:13.540750 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-2cca1d26-604b-4b9a-b752-0c265bcda6a2 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:53:13.541428 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-2cca1d26-604b-4b9a-b752-0c265bcda6a2 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] [instance: 15abb40f-daf9-4c4b-ac9c-55f57ee7b938] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:53:13.548615 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-2cca1d26-604b-4b9a-b752-0c265bcda6a2 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:53:13.549086 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-2cca1d26-604b-4b9a-b752-0c265bcda6a2 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:53:13.549876 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-2cca1d26-604b-4b9a-b752-0c265bcda6a2 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:53:13.550357 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-2cca1d26-604b-4b9a-b752-0c265bcda6a2 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:53:13.684706 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-2cca1d26-604b-4b9a-b752-0c265bcda6a2 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a792b5b7e6f7461b8d802a5abaaa9518', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e843a3fb49f41dcb376184d7e156528', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:53:13.692800 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-2cca1d26-604b-4b9a-b752-0c265bcda6a2 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] 10.222.0.11 "GET /compute/v2.1/servers/15abb40f-daf9-4c4b-ac9c-55f57ee7b938" status: 200 len: 1558 microversion: 2.1 time: 0.155972 Nov 17 03:53:13.693390 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 1419/2642] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:53:13 2021] GET /compute/v2.1/servers/15abb40f-daf9-4c4b-ac9c-55f57ee7b938 => generated 1558 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:53:13.822934 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-b2708540-49a0-4516-bbd7-74e9ae3dd262 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:53:13.823927 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-b2708540-49a0-4516-bbd7-74e9ae3dd262 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] [instance: 5d54db85-b991-4890-abaa-952413baa2e7] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:53:13.833715 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-b2708540-49a0-4516-bbd7-74e9ae3dd262 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:53:13.834157 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-b2708540-49a0-4516-bbd7-74e9ae3dd262 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:53:13.834920 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-b2708540-49a0-4516-bbd7-74e9ae3dd262 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:53:13.835342 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-b2708540-49a0-4516-bbd7-74e9ae3dd262 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:53:13.978867 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-b2708540-49a0-4516-bbd7-74e9ae3dd262 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37f21d6d15cf40a586edda211219fd08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ebb970305844dccacf48a7d8d47ecf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:53:13.987288 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-b2708540-49a0-4516-bbd7-74e9ae3dd262 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '37f21d6d15cf40a586edda211219fd08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ebb970305844dccacf48a7d8d47ecf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:53:13.988919 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-b2708540-49a0-4516-bbd7-74e9ae3dd262 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '37f21d6d15cf40a586edda211219fd08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ebb970305844dccacf48a7d8d47ecf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:53:13.990075 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-b2708540-49a0-4516-bbd7-74e9ae3dd262 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] 10.222.0.11 "GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7" status: 200 len: 1803 microversion: 2.20 time: 0.173818 Nov 17 03:53:13.990650 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 1224/2643] 10.222.0.11 () {60 vars in 1276 bytes} [Wed Nov 17 03:53:13 2021] GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7 => generated 1803 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 17 03:53:14.713469 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-06bfe80e-45c3-4f9e-8f06-f41cc90db9d2 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:53:14.714165 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-06bfe80e-45c3-4f9e-8f06-f41cc90db9d2 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] [instance: 15abb40f-daf9-4c4b-ac9c-55f57ee7b938] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:53:14.723430 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-06bfe80e-45c3-4f9e-8f06-f41cc90db9d2 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:53:14.724037 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-06bfe80e-45c3-4f9e-8f06-f41cc90db9d2 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:53:14.725320 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-06bfe80e-45c3-4f9e-8f06-f41cc90db9d2 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:53:14.725928 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-06bfe80e-45c3-4f9e-8f06-f41cc90db9d2 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:53:14.866721 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-06bfe80e-45c3-4f9e-8f06-f41cc90db9d2 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a792b5b7e6f7461b8d802a5abaaa9518', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e843a3fb49f41dcb376184d7e156528', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:53:14.878888 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-06bfe80e-45c3-4f9e-8f06-f41cc90db9d2 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] 10.222.0.11 "GET /compute/v2.1/servers/15abb40f-daf9-4c4b-ac9c-55f57ee7b938" status: 200 len: 1558 microversion: 2.1 time: 0.170761 Nov 17 03:53:14.879488 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 1420/2644] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:53:14 2021] GET /compute/v2.1/servers/15abb40f-daf9-4c4b-ac9c-55f57ee7b938 => generated 1558 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:53:15.011888 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-155aa9af-cb81-470e-959b-c30bc6456998 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:53:15.012938 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-155aa9af-cb81-470e-959b-c30bc6456998 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] [instance: 5d54db85-b991-4890-abaa-952413baa2e7] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:53:15.024414 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-155aa9af-cb81-470e-959b-c30bc6456998 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:53:15.025218 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-155aa9af-cb81-470e-959b-c30bc6456998 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:53:15.026486 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-155aa9af-cb81-470e-959b-c30bc6456998 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:53:15.027205 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-155aa9af-cb81-470e-959b-c30bc6456998 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:53:15.166063 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-155aa9af-cb81-470e-959b-c30bc6456998 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37f21d6d15cf40a586edda211219fd08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ebb970305844dccacf48a7d8d47ecf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:53:15.175339 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-155aa9af-cb81-470e-959b-c30bc6456998 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '37f21d6d15cf40a586edda211219fd08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ebb970305844dccacf48a7d8d47ecf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:53:15.177506 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-155aa9af-cb81-470e-959b-c30bc6456998 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '37f21d6d15cf40a586edda211219fd08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ebb970305844dccacf48a7d8d47ecf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:53:15.178678 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-155aa9af-cb81-470e-959b-c30bc6456998 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] 10.222.0.11 "GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7" status: 200 len: 1803 microversion: 2.20 time: 0.172926 Nov 17 03:53:15.179239 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 1225/2645] 10.222.0.11 () {60 vars in 1276 bytes} [Wed Nov 17 03:53:15 2021] GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7 => generated 1803 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 17 03:53:15.905387 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-bc5f3566-9585-4e93-8d03-bb2df3183e10 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:53:15.906337 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-bc5f3566-9585-4e93-8d03-bb2df3183e10 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] [instance: 15abb40f-daf9-4c4b-ac9c-55f57ee7b938] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:53:15.915046 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-bc5f3566-9585-4e93-8d03-bb2df3183e10 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:53:15.915490 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-bc5f3566-9585-4e93-8d03-bb2df3183e10 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:53:15.916251 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-bc5f3566-9585-4e93-8d03-bb2df3183e10 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:53:15.916682 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-bc5f3566-9585-4e93-8d03-bb2df3183e10 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:53:16.057028 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-bc5f3566-9585-4e93-8d03-bb2df3183e10 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a792b5b7e6f7461b8d802a5abaaa9518', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e843a3fb49f41dcb376184d7e156528', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:53:16.064985 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-bc5f3566-9585-4e93-8d03-bb2df3183e10 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] 10.222.0.11 "GET /compute/v2.1/servers/15abb40f-daf9-4c4b-ac9c-55f57ee7b938" status: 200 len: 1558 microversion: 2.1 time: 0.165732 Nov 17 03:53:16.065549 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 1421/2646] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:53:15 2021] GET /compute/v2.1/servers/15abb40f-daf9-4c4b-ac9c-55f57ee7b938 => generated 1558 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:53:16.201145 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-6ff7994d-0d46-4ef1-91c1-7208fcfb286e tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:53:16.202060 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-6ff7994d-0d46-4ef1-91c1-7208fcfb286e tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] [instance: 5d54db85-b991-4890-abaa-952413baa2e7] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:53:16.210752 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-6ff7994d-0d46-4ef1-91c1-7208fcfb286e tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:53:16.211195 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-6ff7994d-0d46-4ef1-91c1-7208fcfb286e tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:53:16.211960 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-6ff7994d-0d46-4ef1-91c1-7208fcfb286e tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:53:16.212387 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-6ff7994d-0d46-4ef1-91c1-7208fcfb286e tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:53:16.347078 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-6ff7994d-0d46-4ef1-91c1-7208fcfb286e tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37f21d6d15cf40a586edda211219fd08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ebb970305844dccacf48a7d8d47ecf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:53:16.356091 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-6ff7994d-0d46-4ef1-91c1-7208fcfb286e tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '37f21d6d15cf40a586edda211219fd08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ebb970305844dccacf48a7d8d47ecf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:53:16.357614 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-6ff7994d-0d46-4ef1-91c1-7208fcfb286e tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '37f21d6d15cf40a586edda211219fd08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ebb970305844dccacf48a7d8d47ecf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:53:16.358773 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-6ff7994d-0d46-4ef1-91c1-7208fcfb286e tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] 10.222.0.11 "GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7" status: 200 len: 1803 microversion: 2.20 time: 0.163985 Nov 17 03:53:16.359336 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 1226/2647] 10.222.0.11 () {60 vars in 1276 bytes} [Wed Nov 17 03:53:16 2021] GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7 => generated 1803 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 17 03:53:17.088755 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-1faba0db-9ea2-4522-bb70-4a099866c4f2 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:53:17.089389 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-1faba0db-9ea2-4522-bb70-4a099866c4f2 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] [instance: 15abb40f-daf9-4c4b-ac9c-55f57ee7b938] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:53:17.096173 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-1faba0db-9ea2-4522-bb70-4a099866c4f2 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:53:17.096623 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-1faba0db-9ea2-4522-bb70-4a099866c4f2 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:53:17.097913 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-1faba0db-9ea2-4522-bb70-4a099866c4f2 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:53:17.098056 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-1faba0db-9ea2-4522-bb70-4a099866c4f2 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:53:17.235692 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-1faba0db-9ea2-4522-bb70-4a099866c4f2 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a792b5b7e6f7461b8d802a5abaaa9518', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e843a3fb49f41dcb376184d7e156528', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:53:17.243726 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-1faba0db-9ea2-4522-bb70-4a099866c4f2 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] 10.222.0.11 "GET /compute/v2.1/servers/15abb40f-daf9-4c4b-ac9c-55f57ee7b938" status: 200 len: 1558 microversion: 2.1 time: 0.158699 Nov 17 03:53:17.244302 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 1422/2648] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:53:17 2021] GET /compute/v2.1/servers/15abb40f-daf9-4c4b-ac9c-55f57ee7b938 => generated 1558 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:53:17.378188 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-81dd3b2b-8327-4ee1-9771-bf9356b2db25 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:53:17.379016 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-81dd3b2b-8327-4ee1-9771-bf9356b2db25 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] [instance: 5d54db85-b991-4890-abaa-952413baa2e7] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:53:17.385345 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-81dd3b2b-8327-4ee1-9771-bf9356b2db25 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:53:17.385775 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-81dd3b2b-8327-4ee1-9771-bf9356b2db25 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:53:17.386530 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-81dd3b2b-8327-4ee1-9771-bf9356b2db25 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:53:17.386940 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-81dd3b2b-8327-4ee1-9771-bf9356b2db25 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:53:17.526741 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-81dd3b2b-8327-4ee1-9771-bf9356b2db25 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37f21d6d15cf40a586edda211219fd08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ebb970305844dccacf48a7d8d47ecf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:53:17.535497 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-81dd3b2b-8327-4ee1-9771-bf9356b2db25 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '37f21d6d15cf40a586edda211219fd08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ebb970305844dccacf48a7d8d47ecf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:53:17.537006 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-81dd3b2b-8327-4ee1-9771-bf9356b2db25 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '37f21d6d15cf40a586edda211219fd08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ebb970305844dccacf48a7d8d47ecf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:53:17.538159 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-81dd3b2b-8327-4ee1-9771-bf9356b2db25 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] 10.222.0.11 "GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7" status: 200 len: 1803 microversion: 2.20 time: 0.164454 Nov 17 03:53:17.538703 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 1227/2649] 10.222.0.11 () {60 vars in 1276 bytes} [Wed Nov 17 03:53:17 2021] GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7 => generated 1803 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 17 03:53:18.264601 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-b4899c4f-e9cc-4e3d-b83a-76a2f7fe6c26 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:53:18.265717 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-b4899c4f-e9cc-4e3d-b83a-76a2f7fe6c26 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] [instance: 15abb40f-daf9-4c4b-ac9c-55f57ee7b938] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:53:18.277187 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-b4899c4f-e9cc-4e3d-b83a-76a2f7fe6c26 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:53:18.277939 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-b4899c4f-e9cc-4e3d-b83a-76a2f7fe6c26 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:53:18.279208 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-b4899c4f-e9cc-4e3d-b83a-76a2f7fe6c26 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:53:18.279943 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-b4899c4f-e9cc-4e3d-b83a-76a2f7fe6c26 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:53:18.420805 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-b4899c4f-e9cc-4e3d-b83a-76a2f7fe6c26 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a792b5b7e6f7461b8d802a5abaaa9518', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e843a3fb49f41dcb376184d7e156528', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:53:18.430526 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-b4899c4f-e9cc-4e3d-b83a-76a2f7fe6c26 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] 10.222.0.11 "GET /compute/v2.1/servers/15abb40f-daf9-4c4b-ac9c-55f57ee7b938" status: 200 len: 1558 microversion: 2.1 time: 0.172012 Nov 17 03:53:18.431078 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 1423/2650] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:53:18 2021] GET /compute/v2.1/servers/15abb40f-daf9-4c4b-ac9c-55f57ee7b938 => generated 1558 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:53:18.560937 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-261122f6-b6e7-4206-9fa4-ae409655160e tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:53:18.561945 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-261122f6-b6e7-4206-9fa4-ae409655160e tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] [instance: 5d54db85-b991-4890-abaa-952413baa2e7] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:53:18.573311 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-261122f6-b6e7-4206-9fa4-ae409655160e tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:53:18.574061 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-261122f6-b6e7-4206-9fa4-ae409655160e tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:53:18.575326 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-261122f6-b6e7-4206-9fa4-ae409655160e tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:53:18.576055 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-261122f6-b6e7-4206-9fa4-ae409655160e tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:53:18.709633 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-261122f6-b6e7-4206-9fa4-ae409655160e tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37f21d6d15cf40a586edda211219fd08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ebb970305844dccacf48a7d8d47ecf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:53:18.718203 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-261122f6-b6e7-4206-9fa4-ae409655160e tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '37f21d6d15cf40a586edda211219fd08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ebb970305844dccacf48a7d8d47ecf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:53:18.719665 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-261122f6-b6e7-4206-9fa4-ae409655160e tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '37f21d6d15cf40a586edda211219fd08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ebb970305844dccacf48a7d8d47ecf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:53:18.720810 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-261122f6-b6e7-4206-9fa4-ae409655160e tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] 10.222.0.11 "GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7" status: 200 len: 1803 microversion: 2.20 time: 0.166175 Nov 17 03:53:18.721390 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 1228/2651] 10.222.0.11 () {60 vars in 1276 bytes} [Wed Nov 17 03:53:18 2021] GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7 => generated 1803 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 17 03:53:19.451949 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-418f5cd6-e43f-490f-85d3-d738260d3537 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:53:19.453055 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-418f5cd6-e43f-490f-85d3-d738260d3537 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] [instance: 15abb40f-daf9-4c4b-ac9c-55f57ee7b938] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:53:19.464057 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-418f5cd6-e43f-490f-85d3-d738260d3537 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:53:19.464769 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-418f5cd6-e43f-490f-85d3-d738260d3537 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:53:19.466133 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-418f5cd6-e43f-490f-85d3-d738260d3537 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:53:19.466908 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-418f5cd6-e43f-490f-85d3-d738260d3537 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:53:19.604144 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-418f5cd6-e43f-490f-85d3-d738260d3537 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a792b5b7e6f7461b8d802a5abaaa9518', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e843a3fb49f41dcb376184d7e156528', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:53:19.617676 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-418f5cd6-e43f-490f-85d3-d738260d3537 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] 10.222.0.11 "GET /compute/v2.1/servers/15abb40f-daf9-4c4b-ac9c-55f57ee7b938" status: 200 len: 1558 microversion: 2.1 time: 0.171861 Nov 17 03:53:19.618415 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 1424/2652] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:53:19 2021] GET /compute/v2.1/servers/15abb40f-daf9-4c4b-ac9c-55f57ee7b938 => generated 1558 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:53:19.749317 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-7268d854-3023-4807-9a09-f4f98b9ca30e tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:53:19.750158 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-7268d854-3023-4807-9a09-f4f98b9ca30e tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] [instance: 5d54db85-b991-4890-abaa-952413baa2e7] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:53:19.758517 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-7268d854-3023-4807-9a09-f4f98b9ca30e tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:53:19.758973 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-7268d854-3023-4807-9a09-f4f98b9ca30e tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:53:19.759736 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-7268d854-3023-4807-9a09-f4f98b9ca30e tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:53:19.760167 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-7268d854-3023-4807-9a09-f4f98b9ca30e tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:53:19.895131 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-7268d854-3023-4807-9a09-f4f98b9ca30e tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37f21d6d15cf40a586edda211219fd08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ebb970305844dccacf48a7d8d47ecf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:53:19.903627 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-7268d854-3023-4807-9a09-f4f98b9ca30e tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '37f21d6d15cf40a586edda211219fd08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ebb970305844dccacf48a7d8d47ecf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:53:19.905136 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-7268d854-3023-4807-9a09-f4f98b9ca30e tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '37f21d6d15cf40a586edda211219fd08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ebb970305844dccacf48a7d8d47ecf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:53:19.906289 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-7268d854-3023-4807-9a09-f4f98b9ca30e tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] 10.222.0.11 "GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7" status: 200 len: 1803 microversion: 2.20 time: 0.163366 Nov 17 03:53:19.906861 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 1229/2653] 10.222.0.11 () {60 vars in 1276 bytes} [Wed Nov 17 03:53:19 2021] GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7 => generated 1803 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 17 03:53:20.643106 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-f3c0af07-66fa-47e5-a4f9-38a41286f51f tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:53:20.644041 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-f3c0af07-66fa-47e5-a4f9-38a41286f51f tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] [instance: 15abb40f-daf9-4c4b-ac9c-55f57ee7b938] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:53:20.651281 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-f3c0af07-66fa-47e5-a4f9-38a41286f51f tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:53:20.651735 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-f3c0af07-66fa-47e5-a4f9-38a41286f51f tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:53:20.652514 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-f3c0af07-66fa-47e5-a4f9-38a41286f51f tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:53:20.652982 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-f3c0af07-66fa-47e5-a4f9-38a41286f51f tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:53:20.795857 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-f3c0af07-66fa-47e5-a4f9-38a41286f51f tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a792b5b7e6f7461b8d802a5abaaa9518', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e843a3fb49f41dcb376184d7e156528', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:53:20.804800 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-f3c0af07-66fa-47e5-a4f9-38a41286f51f tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] 10.222.0.11 "GET /compute/v2.1/servers/15abb40f-daf9-4c4b-ac9c-55f57ee7b938" status: 200 len: 1558 microversion: 2.1 time: 0.167876 Nov 17 03:53:20.805396 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 1425/2654] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:53:20 2021] GET /compute/v2.1/servers/15abb40f-daf9-4c4b-ac9c-55f57ee7b938 => generated 1558 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:53:20.929381 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-8d8c79a4-86f8-4a00-8498-db254a0e15e2 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:53:20.930280 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-8d8c79a4-86f8-4a00-8498-db254a0e15e2 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] [instance: 5d54db85-b991-4890-abaa-952413baa2e7] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:53:20.941282 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-8d8c79a4-86f8-4a00-8498-db254a0e15e2 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:53:20.942140 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-8d8c79a4-86f8-4a00-8498-db254a0e15e2 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:53:20.943120 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-8d8c79a4-86f8-4a00-8498-db254a0e15e2 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:53:20.943558 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-8d8c79a4-86f8-4a00-8498-db254a0e15e2 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:53:21.093634 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-8d8c79a4-86f8-4a00-8498-db254a0e15e2 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37f21d6d15cf40a586edda211219fd08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ebb970305844dccacf48a7d8d47ecf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:53:21.102108 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-8d8c79a4-86f8-4a00-8498-db254a0e15e2 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '37f21d6d15cf40a586edda211219fd08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ebb970305844dccacf48a7d8d47ecf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:53:21.103576 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-8d8c79a4-86f8-4a00-8498-db254a0e15e2 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '37f21d6d15cf40a586edda211219fd08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ebb970305844dccacf48a7d8d47ecf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:53:21.104720 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-8d8c79a4-86f8-4a00-8498-db254a0e15e2 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] 10.222.0.11 "GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7" status: 200 len: 1803 microversion: 2.20 time: 0.182459 Nov 17 03:53:21.105343 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 1230/2655] 10.222.0.11 () {60 vars in 1276 bytes} [Wed Nov 17 03:53:20 2021] GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7 => generated 1803 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 17 03:53:21.823067 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-f2c18995-5b0c-4f37-9543-2f87e96a1ffe tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:53:21.823703 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-f2c18995-5b0c-4f37-9543-2f87e96a1ffe tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] [instance: 15abb40f-daf9-4c4b-ac9c-55f57ee7b938] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:53:21.832247 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-f2c18995-5b0c-4f37-9543-2f87e96a1ffe tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:53:21.832795 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-f2c18995-5b0c-4f37-9543-2f87e96a1ffe tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:53:21.833954 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-f2c18995-5b0c-4f37-9543-2f87e96a1ffe tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:53:21.834621 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-f2c18995-5b0c-4f37-9543-2f87e96a1ffe tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:53:22.009089 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-f2c18995-5b0c-4f37-9543-2f87e96a1ffe tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a792b5b7e6f7461b8d802a5abaaa9518', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e843a3fb49f41dcb376184d7e156528', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:53:22.021705 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-f2c18995-5b0c-4f37-9543-2f87e96a1ffe tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] 10.222.0.11 "GET /compute/v2.1/servers/15abb40f-daf9-4c4b-ac9c-55f57ee7b938" status: 200 len: 1558 microversion: 2.1 time: 0.202080 Nov 17 03:53:22.022457 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 1426/2656] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:53:21 2021] GET /compute/v2.1/servers/15abb40f-daf9-4c4b-ac9c-55f57ee7b938 => generated 1558 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:53:22.126943 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-554646c0-df56-41d4-ad75-1d0a974f990b tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:53:22.127886 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-554646c0-df56-41d4-ad75-1d0a974f990b tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] [instance: 5d54db85-b991-4890-abaa-952413baa2e7] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:53:22.138650 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-554646c0-df56-41d4-ad75-1d0a974f990b tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:53:22.139400 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-554646c0-df56-41d4-ad75-1d0a974f990b tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:53:22.140676 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-554646c0-df56-41d4-ad75-1d0a974f990b tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:53:22.141461 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-554646c0-df56-41d4-ad75-1d0a974f990b tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:53:22.281541 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-554646c0-df56-41d4-ad75-1d0a974f990b tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37f21d6d15cf40a586edda211219fd08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ebb970305844dccacf48a7d8d47ecf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:53:22.290235 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-554646c0-df56-41d4-ad75-1d0a974f990b tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '37f21d6d15cf40a586edda211219fd08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ebb970305844dccacf48a7d8d47ecf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:53:22.291716 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-554646c0-df56-41d4-ad75-1d0a974f990b tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '37f21d6d15cf40a586edda211219fd08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ebb970305844dccacf48a7d8d47ecf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:53:22.292917 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-554646c0-df56-41d4-ad75-1d0a974f990b tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] 10.222.0.11 "GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7" status: 200 len: 1803 microversion: 2.20 time: 0.172445 Nov 17 03:53:22.293483 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 1231/2657] 10.222.0.11 () {60 vars in 1276 bytes} [Wed Nov 17 03:53:22 2021] GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7 => generated 1803 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 17 03:53:23.042230 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-b0382afe-4783-44a8-9d13-5936f4364877 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:53:23.043076 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-b0382afe-4783-44a8-9d13-5936f4364877 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] [instance: 15abb40f-daf9-4c4b-ac9c-55f57ee7b938] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:53:23.053066 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-b0382afe-4783-44a8-9d13-5936f4364877 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:53:23.053518 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-b0382afe-4783-44a8-9d13-5936f4364877 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:53:23.054287 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-b0382afe-4783-44a8-9d13-5936f4364877 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:53:23.054714 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-b0382afe-4783-44a8-9d13-5936f4364877 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:53:23.187986 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-b0382afe-4783-44a8-9d13-5936f4364877 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a792b5b7e6f7461b8d802a5abaaa9518', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e843a3fb49f41dcb376184d7e156528', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:53:23.197378 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-b0382afe-4783-44a8-9d13-5936f4364877 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] 10.222.0.11 "GET /compute/v2.1/servers/15abb40f-daf9-4c4b-ac9c-55f57ee7b938" status: 200 len: 1558 microversion: 2.1 time: 0.160616 Nov 17 03:53:23.197944 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 1427/2658] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:53:23 2021] GET /compute/v2.1/servers/15abb40f-daf9-4c4b-ac9c-55f57ee7b938 => generated 1558 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:53:23.315102 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-0e9a3c05-02ed-472d-8b9d-8c2fd69b2047 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:53:23.316088 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-0e9a3c05-02ed-472d-8b9d-8c2fd69b2047 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] [instance: 5d54db85-b991-4890-abaa-952413baa2e7] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:53:23.323119 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-0e9a3c05-02ed-472d-8b9d-8c2fd69b2047 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:53:23.323565 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-0e9a3c05-02ed-472d-8b9d-8c2fd69b2047 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:53:23.324362 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-0e9a3c05-02ed-472d-8b9d-8c2fd69b2047 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:53:23.324810 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-0e9a3c05-02ed-472d-8b9d-8c2fd69b2047 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:53:23.461412 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-0e9a3c05-02ed-472d-8b9d-8c2fd69b2047 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37f21d6d15cf40a586edda211219fd08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ebb970305844dccacf48a7d8d47ecf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:53:23.473543 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-0e9a3c05-02ed-472d-8b9d-8c2fd69b2047 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '37f21d6d15cf40a586edda211219fd08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ebb970305844dccacf48a7d8d47ecf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:53:23.475160 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-0e9a3c05-02ed-472d-8b9d-8c2fd69b2047 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '37f21d6d15cf40a586edda211219fd08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ebb970305844dccacf48a7d8d47ecf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:53:23.476307 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-0e9a3c05-02ed-472d-8b9d-8c2fd69b2047 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] 10.222.0.11 "GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7" status: 200 len: 1803 microversion: 2.20 time: 0.167398 Nov 17 03:53:23.476885 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 1232/2659] 10.222.0.11 () {60 vars in 1276 bytes} [Wed Nov 17 03:53:23 2021] GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7 => generated 1803 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 17 03:53:24.217707 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-447364d2-6060-4960-a8ba-3b027ddb2793 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:53:24.218541 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-447364d2-6060-4960-a8ba-3b027ddb2793 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] [instance: 15abb40f-daf9-4c4b-ac9c-55f57ee7b938] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:53:24.226443 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-447364d2-6060-4960-a8ba-3b027ddb2793 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:53:24.227124 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-447364d2-6060-4960-a8ba-3b027ddb2793 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:53:24.227777 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-447364d2-6060-4960-a8ba-3b027ddb2793 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:53:24.228045 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-447364d2-6060-4960-a8ba-3b027ddb2793 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:53:24.372388 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-447364d2-6060-4960-a8ba-3b027ddb2793 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a792b5b7e6f7461b8d802a5abaaa9518', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e843a3fb49f41dcb376184d7e156528', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:53:24.380677 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-447364d2-6060-4960-a8ba-3b027ddb2793 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] 10.222.0.11 "GET /compute/v2.1/servers/15abb40f-daf9-4c4b-ac9c-55f57ee7b938" status: 200 len: 1558 microversion: 2.1 time: 0.169270 Nov 17 03:53:24.381249 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 1428/2660] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:53:24 2021] GET /compute/v2.1/servers/15abb40f-daf9-4c4b-ac9c-55f57ee7b938 => generated 1558 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:53:24.504056 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-d701aa2b-63c6-4a3e-94a4-545527f5a2de tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:53:24.505531 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-d701aa2b-63c6-4a3e-94a4-545527f5a2de tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] [instance: 5d54db85-b991-4890-abaa-952413baa2e7] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:53:24.518292 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-d701aa2b-63c6-4a3e-94a4-545527f5a2de tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:53:24.518997 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-d701aa2b-63c6-4a3e-94a4-545527f5a2de tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:53:24.520311 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-d701aa2b-63c6-4a3e-94a4-545527f5a2de tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:53:24.520745 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-d701aa2b-63c6-4a3e-94a4-545527f5a2de tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:53:24.663660 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-d701aa2b-63c6-4a3e-94a4-545527f5a2de tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37f21d6d15cf40a586edda211219fd08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ebb970305844dccacf48a7d8d47ecf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:53:24.672661 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-d701aa2b-63c6-4a3e-94a4-545527f5a2de tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '37f21d6d15cf40a586edda211219fd08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ebb970305844dccacf48a7d8d47ecf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:53:24.674182 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-d701aa2b-63c6-4a3e-94a4-545527f5a2de tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '37f21d6d15cf40a586edda211219fd08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ebb970305844dccacf48a7d8d47ecf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:53:24.675349 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-d701aa2b-63c6-4a3e-94a4-545527f5a2de tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] 10.222.0.11 "GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7" status: 200 len: 1803 microversion: 2.20 time: 0.177566 Nov 17 03:53:24.675884 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 1233/2661] 10.222.0.11 () {60 vars in 1276 bytes} [Wed Nov 17 03:53:24 2021] GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7 => generated 1803 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 17 03:53:25.402632 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-2deae917-ff6e-4256-b465-0ae858e7ef42 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:53:25.403691 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-2deae917-ff6e-4256-b465-0ae858e7ef42 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] [instance: 15abb40f-daf9-4c4b-ac9c-55f57ee7b938] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:53:25.413160 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-2deae917-ff6e-4256-b465-0ae858e7ef42 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:53:25.413614 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-2deae917-ff6e-4256-b465-0ae858e7ef42 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:53:25.414393 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-2deae917-ff6e-4256-b465-0ae858e7ef42 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:53:25.414833 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-2deae917-ff6e-4256-b465-0ae858e7ef42 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:53:25.555622 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-2deae917-ff6e-4256-b465-0ae858e7ef42 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a792b5b7e6f7461b8d802a5abaaa9518', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e843a3fb49f41dcb376184d7e156528', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:53:25.563966 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-2deae917-ff6e-4256-b465-0ae858e7ef42 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] 10.222.0.11 "GET /compute/v2.1/servers/15abb40f-daf9-4c4b-ac9c-55f57ee7b938" status: 200 len: 1558 microversion: 2.1 time: 0.167581 Nov 17 03:53:25.564507 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 1429/2662] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:53:25 2021] GET /compute/v2.1/servers/15abb40f-daf9-4c4b-ac9c-55f57ee7b938 => generated 1558 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:53:25.701477 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-f4cfd081-efbc-4fd7-b129-23c49accf984 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:53:25.702078 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-f4cfd081-efbc-4fd7-b129-23c49accf984 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] [instance: 5d54db85-b991-4890-abaa-952413baa2e7] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:53:25.709658 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-f4cfd081-efbc-4fd7-b129-23c49accf984 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:53:25.710113 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-f4cfd081-efbc-4fd7-b129-23c49accf984 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:53:25.710881 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-f4cfd081-efbc-4fd7-b129-23c49accf984 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:53:25.711314 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-f4cfd081-efbc-4fd7-b129-23c49accf984 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:53:25.859802 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-f4cfd081-efbc-4fd7-b129-23c49accf984 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37f21d6d15cf40a586edda211219fd08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ebb970305844dccacf48a7d8d47ecf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:53:25.868969 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-f4cfd081-efbc-4fd7-b129-23c49accf984 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '37f21d6d15cf40a586edda211219fd08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ebb970305844dccacf48a7d8d47ecf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:53:25.870464 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-f4cfd081-efbc-4fd7-b129-23c49accf984 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '37f21d6d15cf40a586edda211219fd08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ebb970305844dccacf48a7d8d47ecf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:53:25.871635 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-f4cfd081-efbc-4fd7-b129-23c49accf984 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] 10.222.0.11 "GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7" status: 200 len: 1803 microversion: 2.20 time: 0.174067 Nov 17 03:53:25.872196 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 1234/2663] 10.222.0.11 () {60 vars in 1276 bytes} [Wed Nov 17 03:53:25 2021] GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7 => generated 1803 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 17 03:53:26.585628 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-c9181178-e6e1-4abd-9bfb-bc0e6ceab793 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:53:26.586603 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-c9181178-e6e1-4abd-9bfb-bc0e6ceab793 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] [instance: 15abb40f-daf9-4c4b-ac9c-55f57ee7b938] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:53:26.597157 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-c9181178-e6e1-4abd-9bfb-bc0e6ceab793 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:53:26.597893 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-c9181178-e6e1-4abd-9bfb-bc0e6ceab793 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:53:26.599353 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-c9181178-e6e1-4abd-9bfb-bc0e6ceab793 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:53:26.600069 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-c9181178-e6e1-4abd-9bfb-bc0e6ceab793 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:53:26.741301 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-c9181178-e6e1-4abd-9bfb-bc0e6ceab793 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a792b5b7e6f7461b8d802a5abaaa9518', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e843a3fb49f41dcb376184d7e156528', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:53:26.749189 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-c9181178-e6e1-4abd-9bfb-bc0e6ceab793 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] 10.222.0.11 "GET /compute/v2.1/servers/15abb40f-daf9-4c4b-ac9c-55f57ee7b938" status: 200 len: 1558 microversion: 2.1 time: 0.169911 Nov 17 03:53:26.749727 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 1430/2664] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:53:26 2021] GET /compute/v2.1/servers/15abb40f-daf9-4c4b-ac9c-55f57ee7b938 => generated 1558 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:53:26.893720 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-50c07c56-f2f4-4bac-94fa-306d54f80947 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:53:26.894720 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-50c07c56-f2f4-4bac-94fa-306d54f80947 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] [instance: 5d54db85-b991-4890-abaa-952413baa2e7] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:53:26.901961 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-50c07c56-f2f4-4bac-94fa-306d54f80947 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:53:26.902401 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-50c07c56-f2f4-4bac-94fa-306d54f80947 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:53:26.903146 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-50c07c56-f2f4-4bac-94fa-306d54f80947 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:53:26.903591 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-50c07c56-f2f4-4bac-94fa-306d54f80947 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:53:27.040823 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-50c07c56-f2f4-4bac-94fa-306d54f80947 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37f21d6d15cf40a586edda211219fd08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ebb970305844dccacf48a7d8d47ecf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:53:27.049712 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-50c07c56-f2f4-4bac-94fa-306d54f80947 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '37f21d6d15cf40a586edda211219fd08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ebb970305844dccacf48a7d8d47ecf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:53:27.051207 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-50c07c56-f2f4-4bac-94fa-306d54f80947 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '37f21d6d15cf40a586edda211219fd08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ebb970305844dccacf48a7d8d47ecf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:53:27.052874 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-50c07c56-f2f4-4bac-94fa-306d54f80947 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] 10.222.0.11 "GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7" status: 200 len: 1803 microversion: 2.20 time: 0.165294 Nov 17 03:53:27.053440 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 1235/2665] 10.222.0.11 () {60 vars in 1276 bytes} [Wed Nov 17 03:53:26 2021] GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7 => generated 1803 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 17 03:53:27.769525 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-42bed6be-e29f-45b2-9d84-fd3004ad9b59 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:53:27.770501 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-42bed6be-e29f-45b2-9d84-fd3004ad9b59 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] [instance: 15abb40f-daf9-4c4b-ac9c-55f57ee7b938] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:53:27.781309 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-42bed6be-e29f-45b2-9d84-fd3004ad9b59 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:53:27.782058 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-42bed6be-e29f-45b2-9d84-fd3004ad9b59 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:53:27.783330 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-42bed6be-e29f-45b2-9d84-fd3004ad9b59 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:53:27.784055 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-42bed6be-e29f-45b2-9d84-fd3004ad9b59 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:53:27.919467 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-42bed6be-e29f-45b2-9d84-fd3004ad9b59 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a792b5b7e6f7461b8d802a5abaaa9518', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e843a3fb49f41dcb376184d7e156528', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:53:27.927844 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-42bed6be-e29f-45b2-9d84-fd3004ad9b59 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] 10.222.0.11 "GET /compute/v2.1/servers/15abb40f-daf9-4c4b-ac9c-55f57ee7b938" status: 200 len: 1558 microversion: 2.1 time: 0.164451 Nov 17 03:53:27.928416 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 1431/2666] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:53:27 2021] GET /compute/v2.1/servers/15abb40f-daf9-4c4b-ac9c-55f57ee7b938 => generated 1558 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:53:28.077116 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-a9f07dc3-1c69-4868-990f-73aa7c33b7d1 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:53:28.077826 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-a9f07dc3-1c69-4868-990f-73aa7c33b7d1 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] [instance: 5d54db85-b991-4890-abaa-952413baa2e7] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:53:28.088004 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-a9f07dc3-1c69-4868-990f-73aa7c33b7d1 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:53:28.088661 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-a9f07dc3-1c69-4868-990f-73aa7c33b7d1 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:53:28.089916 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-a9f07dc3-1c69-4868-990f-73aa7c33b7d1 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:53:28.090527 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-a9f07dc3-1c69-4868-990f-73aa7c33b7d1 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:53:28.233148 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-a9f07dc3-1c69-4868-990f-73aa7c33b7d1 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37f21d6d15cf40a586edda211219fd08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ebb970305844dccacf48a7d8d47ecf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:53:28.241829 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-a9f07dc3-1c69-4868-990f-73aa7c33b7d1 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '37f21d6d15cf40a586edda211219fd08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ebb970305844dccacf48a7d8d47ecf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:53:28.243312 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-a9f07dc3-1c69-4868-990f-73aa7c33b7d1 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '37f21d6d15cf40a586edda211219fd08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ebb970305844dccacf48a7d8d47ecf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:53:28.244459 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-a9f07dc3-1c69-4868-990f-73aa7c33b7d1 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] 10.222.0.11 "GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7" status: 200 len: 1803 microversion: 2.20 time: 0.172515 Nov 17 03:53:28.245052 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 1236/2667] 10.222.0.11 () {60 vars in 1276 bytes} [Wed Nov 17 03:53:28 2021] GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7 => generated 1803 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 17 03:53:28.948984 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-e0876ef9-a448-495a-a003-617bd1c28c73 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:53:28.949998 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-e0876ef9-a448-495a-a003-617bd1c28c73 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] [instance: 15abb40f-daf9-4c4b-ac9c-55f57ee7b938] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:53:28.960346 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-e0876ef9-a448-495a-a003-617bd1c28c73 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:53:28.960802 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-e0876ef9-a448-495a-a003-617bd1c28c73 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:53:28.961584 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-e0876ef9-a448-495a-a003-617bd1c28c73 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:53:28.962012 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-e0876ef9-a448-495a-a003-617bd1c28c73 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:53:29.099988 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-e0876ef9-a448-495a-a003-617bd1c28c73 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a792b5b7e6f7461b8d802a5abaaa9518', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e843a3fb49f41dcb376184d7e156528', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:53:29.109031 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-e0876ef9-a448-495a-a003-617bd1c28c73 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] 10.222.0.11 "GET /compute/v2.1/servers/15abb40f-daf9-4c4b-ac9c-55f57ee7b938" status: 200 len: 1558 microversion: 2.1 time: 0.166241 Nov 17 03:53:29.109617 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 1432/2668] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:53:28 2021] GET /compute/v2.1/servers/15abb40f-daf9-4c4b-ac9c-55f57ee7b938 => generated 1558 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:53:29.267655 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-53a07725-1994-4533-b147-e45fdfa5a495 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:53:29.268719 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-53a07725-1994-4533-b147-e45fdfa5a495 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] [instance: 5d54db85-b991-4890-abaa-952413baa2e7] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:53:29.279967 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-53a07725-1994-4533-b147-e45fdfa5a495 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:53:29.280721 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-53a07725-1994-4533-b147-e45fdfa5a495 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:53:29.282040 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-53a07725-1994-4533-b147-e45fdfa5a495 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:53:29.282773 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-53a07725-1994-4533-b147-e45fdfa5a495 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:53:29.423585 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-53a07725-1994-4533-b147-e45fdfa5a495 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37f21d6d15cf40a586edda211219fd08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ebb970305844dccacf48a7d8d47ecf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:53:29.438121 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-53a07725-1994-4533-b147-e45fdfa5a495 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '37f21d6d15cf40a586edda211219fd08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ebb970305844dccacf48a7d8d47ecf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:53:29.440520 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-53a07725-1994-4533-b147-e45fdfa5a495 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '37f21d6d15cf40a586edda211219fd08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ebb970305844dccacf48a7d8d47ecf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:53:29.442372 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-53a07725-1994-4533-b147-e45fdfa5a495 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] 10.222.0.11 "GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7" status: 200 len: 1803 microversion: 2.20 time: 0.181418 Nov 17 03:53:29.443076 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 1237/2669] 10.222.0.11 () {60 vars in 1276 bytes} [Wed Nov 17 03:53:29 2021] GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7 => generated 1803 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 17 03:53:30.134694 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-dc91f384-bba7-479f-9356-828c3f93ec72 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:53:30.135269 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-dc91f384-bba7-479f-9356-828c3f93ec72 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] [instance: 15abb40f-daf9-4c4b-ac9c-55f57ee7b938] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:53:30.142098 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-dc91f384-bba7-479f-9356-828c3f93ec72 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:53:30.142547 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-dc91f384-bba7-479f-9356-828c3f93ec72 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:53:30.143330 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-dc91f384-bba7-479f-9356-828c3f93ec72 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:53:30.143762 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-dc91f384-bba7-479f-9356-828c3f93ec72 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:53:30.466358 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-008b4033-41a1-40f4-880d-de5d925fb64f tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:53:30.466933 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-008b4033-41a1-40f4-880d-de5d925fb64f tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] [instance: 5d54db85-b991-4890-abaa-952413baa2e7] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:53:30.473465 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-008b4033-41a1-40f4-880d-de5d925fb64f tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:53:30.473916 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-008b4033-41a1-40f4-880d-de5d925fb64f tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:53:30.474681 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-008b4033-41a1-40f4-880d-de5d925fb64f tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:53:30.475108 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-008b4033-41a1-40f4-880d-de5d925fb64f tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:53:30.554679 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-dc91f384-bba7-479f-9356-828c3f93ec72 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a792b5b7e6f7461b8d802a5abaaa9518', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e843a3fb49f41dcb376184d7e156528', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:53:30.565357 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-dc91f384-bba7-479f-9356-828c3f93ec72 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] 10.222.0.11 "GET /compute/v2.1/servers/15abb40f-daf9-4c4b-ac9c-55f57ee7b938" status: 200 len: 1558 microversion: 2.1 time: 0.436094 Nov 17 03:53:30.565945 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 1433/2670] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:53:30 2021] GET /compute/v2.1/servers/15abb40f-daf9-4c4b-ac9c-55f57ee7b938 => generated 1558 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:53:30.610886 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-008b4033-41a1-40f4-880d-de5d925fb64f tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37f21d6d15cf40a586edda211219fd08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ebb970305844dccacf48a7d8d47ecf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:53:30.620740 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-008b4033-41a1-40f4-880d-de5d925fb64f tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '37f21d6d15cf40a586edda211219fd08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ebb970305844dccacf48a7d8d47ecf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:53:30.622235 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-008b4033-41a1-40f4-880d-de5d925fb64f tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '37f21d6d15cf40a586edda211219fd08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ebb970305844dccacf48a7d8d47ecf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:53:30.623376 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-008b4033-41a1-40f4-880d-de5d925fb64f tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] 10.222.0.11 "GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7" status: 200 len: 1803 microversion: 2.20 time: 0.160941 Nov 17 03:53:30.624070 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 1238/2671] 10.222.0.11 () {60 vars in 1276 bytes} [Wed Nov 17 03:53:30 2021] GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7 => generated 1803 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 17 03:53:31.587024 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-d65c5e7d-6ea7-40ec-95a4-d41ccc92d8c1 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:53:31.587971 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-d65c5e7d-6ea7-40ec-95a4-d41ccc92d8c1 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] [instance: 15abb40f-daf9-4c4b-ac9c-55f57ee7b938] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:53:31.598563 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-d65c5e7d-6ea7-40ec-95a4-d41ccc92d8c1 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:53:31.599315 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-d65c5e7d-6ea7-40ec-95a4-d41ccc92d8c1 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:53:31.600590 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-d65c5e7d-6ea7-40ec-95a4-d41ccc92d8c1 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:53:31.601349 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-d65c5e7d-6ea7-40ec-95a4-d41ccc92d8c1 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:53:31.645827 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-5cd29823-260c-4389-90f9-9aaa7573c421 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:53:31.646487 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-5cd29823-260c-4389-90f9-9aaa7573c421 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] [instance: 5d54db85-b991-4890-abaa-952413baa2e7] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:53:31.653586 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-5cd29823-260c-4389-90f9-9aaa7573c421 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:53:31.654108 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-5cd29823-260c-4389-90f9-9aaa7573c421 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:53:31.654947 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-5cd29823-260c-4389-90f9-9aaa7573c421 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:53:31.655443 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-5cd29823-260c-4389-90f9-9aaa7573c421 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:53:31.741681 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-d65c5e7d-6ea7-40ec-95a4-d41ccc92d8c1 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a792b5b7e6f7461b8d802a5abaaa9518', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e843a3fb49f41dcb376184d7e156528', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:53:31.749705 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-d65c5e7d-6ea7-40ec-95a4-d41ccc92d8c1 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] 10.222.0.11 "GET /compute/v2.1/servers/15abb40f-daf9-4c4b-ac9c-55f57ee7b938" status: 200 len: 1558 microversion: 2.1 time: 0.168977 Nov 17 03:53:31.750272 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 1434/2672] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:53:31 2021] GET /compute/v2.1/servers/15abb40f-daf9-4c4b-ac9c-55f57ee7b938 => generated 1558 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:53:31.790585 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-5cd29823-260c-4389-90f9-9aaa7573c421 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37f21d6d15cf40a586edda211219fd08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ebb970305844dccacf48a7d8d47ecf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:53:31.799084 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-5cd29823-260c-4389-90f9-9aaa7573c421 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '37f21d6d15cf40a586edda211219fd08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ebb970305844dccacf48a7d8d47ecf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:53:31.800557 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-5cd29823-260c-4389-90f9-9aaa7573c421 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '37f21d6d15cf40a586edda211219fd08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ebb970305844dccacf48a7d8d47ecf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:53:31.802108 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-5cd29823-260c-4389-90f9-9aaa7573c421 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] 10.222.0.11 "GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7" status: 200 len: 1803 microversion: 2.20 time: 0.159758 Nov 17 03:53:31.802696 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 1239/2673] 10.222.0.11 () {60 vars in 1276 bytes} [Wed Nov 17 03:53:31 2021] GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7 => generated 1803 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 17 03:53:32.771264 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-02463422-8950-4672-b9e6-706894b39162 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:53:32.772221 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-02463422-8950-4672-b9e6-706894b39162 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] [instance: 15abb40f-daf9-4c4b-ac9c-55f57ee7b938] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:53:32.780168 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-02463422-8950-4672-b9e6-706894b39162 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:53:32.780626 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-02463422-8950-4672-b9e6-706894b39162 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:53:32.781425 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-02463422-8950-4672-b9e6-706894b39162 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:53:32.781861 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-02463422-8950-4672-b9e6-706894b39162 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:53:32.819924 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-088f30e8-6a54-434d-a1dd-b6a1b8ce72cc tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:53:32.820493 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-088f30e8-6a54-434d-a1dd-b6a1b8ce72cc tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] [instance: 5d54db85-b991-4890-abaa-952413baa2e7] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:53:32.827243 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-088f30e8-6a54-434d-a1dd-b6a1b8ce72cc tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:53:32.827688 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-088f30e8-6a54-434d-a1dd-b6a1b8ce72cc tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:53:32.828450 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-088f30e8-6a54-434d-a1dd-b6a1b8ce72cc tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:53:32.828913 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-088f30e8-6a54-434d-a1dd-b6a1b8ce72cc tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:53:32.915133 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-02463422-8950-4672-b9e6-706894b39162 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a792b5b7e6f7461b8d802a5abaaa9518', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e843a3fb49f41dcb376184d7e156528', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:53:32.923110 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-02463422-8950-4672-b9e6-706894b39162 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] 10.222.0.11 "GET /compute/v2.1/servers/15abb40f-daf9-4c4b-ac9c-55f57ee7b938" status: 200 len: 1558 microversion: 2.1 time: 0.158064 Nov 17 03:53:32.923685 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 1435/2674] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:53:32 2021] GET /compute/v2.1/servers/15abb40f-daf9-4c4b-ac9c-55f57ee7b938 => generated 1558 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:53:32.959732 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-088f30e8-6a54-434d-a1dd-b6a1b8ce72cc tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37f21d6d15cf40a586edda211219fd08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ebb970305844dccacf48a7d8d47ecf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:53:32.968114 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-088f30e8-6a54-434d-a1dd-b6a1b8ce72cc tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '37f21d6d15cf40a586edda211219fd08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ebb970305844dccacf48a7d8d47ecf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:53:32.969624 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-088f30e8-6a54-434d-a1dd-b6a1b8ce72cc tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '37f21d6d15cf40a586edda211219fd08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ebb970305844dccacf48a7d8d47ecf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:53:32.970769 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-088f30e8-6a54-434d-a1dd-b6a1b8ce72cc tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] 10.222.0.11 "GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7" status: 200 len: 1803 microversion: 2.20 time: 0.154551 Nov 17 03:53:32.971326 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 1240/2675] 10.222.0.11 () {60 vars in 1276 bytes} [Wed Nov 17 03:53:32 2021] GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7 => generated 1803 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 17 03:53:33.944564 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-5be424dd-599d-428b-b126-a342bd007b7c tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:53:33.945555 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-5be424dd-599d-428b-b126-a342bd007b7c tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] [instance: 15abb40f-daf9-4c4b-ac9c-55f57ee7b938] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:53:33.956206 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-5be424dd-599d-428b-b126-a342bd007b7c tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:53:33.957037 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-5be424dd-599d-428b-b126-a342bd007b7c tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:53:33.958314 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-5be424dd-599d-428b-b126-a342bd007b7c tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:53:33.959033 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-5be424dd-599d-428b-b126-a342bd007b7c tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:53:33.989404 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-89f90ceb-5891-4877-a716-52f883551573 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:53:33.989999 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-89f90ceb-5891-4877-a716-52f883551573 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] [instance: 5d54db85-b991-4890-abaa-952413baa2e7] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:53:33.996748 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-89f90ceb-5891-4877-a716-52f883551573 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:53:33.997225 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-89f90ceb-5891-4877-a716-52f883551573 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:53:33.997995 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-89f90ceb-5891-4877-a716-52f883551573 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:53:33.998422 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-89f90ceb-5891-4877-a716-52f883551573 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:53:34.090167 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-5be424dd-599d-428b-b126-a342bd007b7c tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a792b5b7e6f7461b8d802a5abaaa9518', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e843a3fb49f41dcb376184d7e156528', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:53:34.098230 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-5be424dd-599d-428b-b126-a342bd007b7c tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] 10.222.0.11 "GET /compute/v2.1/servers/15abb40f-daf9-4c4b-ac9c-55f57ee7b938" status: 200 len: 1558 microversion: 2.1 time: 0.159767 Nov 17 03:53:34.098771 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 1436/2676] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:53:33 2021] GET /compute/v2.1/servers/15abb40f-daf9-4c4b-ac9c-55f57ee7b938 => generated 1558 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:53:34.132797 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-89f90ceb-5891-4877-a716-52f883551573 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37f21d6d15cf40a586edda211219fd08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ebb970305844dccacf48a7d8d47ecf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:53:34.141362 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-89f90ceb-5891-4877-a716-52f883551573 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '37f21d6d15cf40a586edda211219fd08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ebb970305844dccacf48a7d8d47ecf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:53:34.142829 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-89f90ceb-5891-4877-a716-52f883551573 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '37f21d6d15cf40a586edda211219fd08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ebb970305844dccacf48a7d8d47ecf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:53:34.143996 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-89f90ceb-5891-4877-a716-52f883551573 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] 10.222.0.11 "GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7" status: 200 len: 1803 microversion: 2.20 time: 0.158252 Nov 17 03:53:34.144548 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 1241/2677] 10.222.0.11 () {60 vars in 1276 bytes} [Wed Nov 17 03:53:33 2021] GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7 => generated 1803 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 17 03:53:35.118005 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-a13228a5-f2bf-4c08-8c9d-55b86a615dbb tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:53:35.118655 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-a13228a5-f2bf-4c08-8c9d-55b86a615dbb tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] [instance: 15abb40f-daf9-4c4b-ac9c-55f57ee7b938] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:53:35.125512 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-a13228a5-f2bf-4c08-8c9d-55b86a615dbb tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:53:35.125966 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-a13228a5-f2bf-4c08-8c9d-55b86a615dbb tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:53:35.126968 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-a13228a5-f2bf-4c08-8c9d-55b86a615dbb tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:53:35.127405 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-a13228a5-f2bf-4c08-8c9d-55b86a615dbb tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:53:35.162795 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-f0feeefa-035f-449b-9a78-a7fae8313b50 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:53:35.163583 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-f0feeefa-035f-449b-9a78-a7fae8313b50 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] [instance: 5d54db85-b991-4890-abaa-952413baa2e7] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:53:35.170981 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-f0feeefa-035f-449b-9a78-a7fae8313b50 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:53:35.171526 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-f0feeefa-035f-449b-9a78-a7fae8313b50 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:53:35.172286 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-f0feeefa-035f-449b-9a78-a7fae8313b50 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:53:35.172709 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-f0feeefa-035f-449b-9a78-a7fae8313b50 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:53:35.300954 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-f0feeefa-035f-449b-9a78-a7fae8313b50 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37f21d6d15cf40a586edda211219fd08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ebb970305844dccacf48a7d8d47ecf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:53:35.310391 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-f0feeefa-035f-449b-9a78-a7fae8313b50 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '37f21d6d15cf40a586edda211219fd08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ebb970305844dccacf48a7d8d47ecf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:53:35.311828 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-f0feeefa-035f-449b-9a78-a7fae8313b50 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '37f21d6d15cf40a586edda211219fd08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ebb970305844dccacf48a7d8d47ecf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:53:35.313011 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-f0feeefa-035f-449b-9a78-a7fae8313b50 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] 10.222.0.11 "GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7" status: 200 len: 1803 microversion: 2.20 time: 0.154027 Nov 17 03:53:35.313560 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 1242/2678] 10.222.0.11 () {60 vars in 1276 bytes} [Wed Nov 17 03:53:35 2021] GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7 => generated 1803 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 17 03:53:35.348186 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-a13228a5-f2bf-4c08-8c9d-55b86a615dbb tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a792b5b7e6f7461b8d802a5abaaa9518', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e843a3fb49f41dcb376184d7e156528', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:53:35.356751 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-a13228a5-f2bf-4c08-8c9d-55b86a615dbb tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] 10.222.0.11 "GET /compute/v2.1/servers/15abb40f-daf9-4c4b-ac9c-55f57ee7b938" status: 200 len: 1558 microversion: 2.1 time: 0.244490 Nov 17 03:53:35.357355 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 1437/2679] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:53:35 2021] GET /compute/v2.1/servers/15abb40f-daf9-4c4b-ac9c-55f57ee7b938 => generated 1558 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:53:36.334874 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-d3ed414f-fee3-4339-87d0-4124249002e3 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:53:36.335685 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-d3ed414f-fee3-4339-87d0-4124249002e3 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] [instance: 5d54db85-b991-4890-abaa-952413baa2e7] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:53:36.343862 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-d3ed414f-fee3-4339-87d0-4124249002e3 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:53:36.344319 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-d3ed414f-fee3-4339-87d0-4124249002e3 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:53:36.345132 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-d3ed414f-fee3-4339-87d0-4124249002e3 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:53:36.345563 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-d3ed414f-fee3-4339-87d0-4124249002e3 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:53:36.375318 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-522cfa42-8d35-4606-b741-3c138f9e55e2 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:53:36.375871 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-522cfa42-8d35-4606-b741-3c138f9e55e2 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] [instance: 15abb40f-daf9-4c4b-ac9c-55f57ee7b938] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:53:36.382765 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-522cfa42-8d35-4606-b741-3c138f9e55e2 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:53:36.383208 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-522cfa42-8d35-4606-b741-3c138f9e55e2 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:53:36.383953 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-522cfa42-8d35-4606-b741-3c138f9e55e2 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:53:36.384409 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-522cfa42-8d35-4606-b741-3c138f9e55e2 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:53:36.477616 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-d3ed414f-fee3-4339-87d0-4124249002e3 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37f21d6d15cf40a586edda211219fd08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ebb970305844dccacf48a7d8d47ecf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:53:36.486439 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-d3ed414f-fee3-4339-87d0-4124249002e3 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '37f21d6d15cf40a586edda211219fd08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ebb970305844dccacf48a7d8d47ecf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:53:36.487912 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-d3ed414f-fee3-4339-87d0-4124249002e3 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '37f21d6d15cf40a586edda211219fd08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ebb970305844dccacf48a7d8d47ecf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:53:36.489133 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-d3ed414f-fee3-4339-87d0-4124249002e3 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] 10.222.0.11 "GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7" status: 200 len: 1803 microversion: 2.20 time: 0.160259 Nov 17 03:53:36.489722 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 1243/2680] 10.222.0.11 () {60 vars in 1276 bytes} [Wed Nov 17 03:53:36 2021] GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7 => generated 1803 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 17 03:53:36.516219 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-522cfa42-8d35-4606-b741-3c138f9e55e2 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a792b5b7e6f7461b8d802a5abaaa9518', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e843a3fb49f41dcb376184d7e156528', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:53:36.524616 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-522cfa42-8d35-4606-b741-3c138f9e55e2 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] 10.222.0.11 "GET /compute/v2.1/servers/15abb40f-daf9-4c4b-ac9c-55f57ee7b938" status: 200 len: 1558 microversion: 2.1 time: 0.152990 Nov 17 03:53:36.525240 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 1438/2681] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:53:36 2021] GET /compute/v2.1/servers/15abb40f-daf9-4c4b-ac9c-55f57ee7b938 => generated 1558 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:53:37.512014 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-e214b4aa-8f59-4917-afe1-8a2165c0d8f9 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:53:37.512698 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-e214b4aa-8f59-4917-afe1-8a2165c0d8f9 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] [instance: 5d54db85-b991-4890-abaa-952413baa2e7] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:53:37.519870 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-e214b4aa-8f59-4917-afe1-8a2165c0d8f9 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:53:37.520309 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-e214b4aa-8f59-4917-afe1-8a2165c0d8f9 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:53:37.521112 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-e214b4aa-8f59-4917-afe1-8a2165c0d8f9 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:53:37.521533 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-e214b4aa-8f59-4917-afe1-8a2165c0d8f9 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:53:37.542657 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-de6b71d7-2cfd-4bb3-9df5-a19e332964f2 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:53:37.543466 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-de6b71d7-2cfd-4bb3-9df5-a19e332964f2 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] [instance: 15abb40f-daf9-4c4b-ac9c-55f57ee7b938] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:53:37.551318 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-de6b71d7-2cfd-4bb3-9df5-a19e332964f2 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:53:37.552483 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-de6b71d7-2cfd-4bb3-9df5-a19e332964f2 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:53:37.553952 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-de6b71d7-2cfd-4bb3-9df5-a19e332964f2 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:53:37.554699 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-de6b71d7-2cfd-4bb3-9df5-a19e332964f2 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:53:37.658387 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-e214b4aa-8f59-4917-afe1-8a2165c0d8f9 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37f21d6d15cf40a586edda211219fd08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ebb970305844dccacf48a7d8d47ecf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:53:37.673175 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-e214b4aa-8f59-4917-afe1-8a2165c0d8f9 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '37f21d6d15cf40a586edda211219fd08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ebb970305844dccacf48a7d8d47ecf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:53:37.674669 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-e214b4aa-8f59-4917-afe1-8a2165c0d8f9 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '37f21d6d15cf40a586edda211219fd08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ebb970305844dccacf48a7d8d47ecf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:53:37.676206 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-e214b4aa-8f59-4917-afe1-8a2165c0d8f9 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] 10.222.0.11 "GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7" status: 200 len: 1803 microversion: 2.20 time: 0.170695 Nov 17 03:53:37.677944 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 1244/2682] 10.222.0.11 () {60 vars in 1276 bytes} [Wed Nov 17 03:53:37 2021] GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7 => generated 1803 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 17 03:53:37.691729 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-de6b71d7-2cfd-4bb3-9df5-a19e332964f2 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a792b5b7e6f7461b8d802a5abaaa9518', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e843a3fb49f41dcb376184d7e156528', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:53:37.699590 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-de6b71d7-2cfd-4bb3-9df5-a19e332964f2 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] 10.222.0.11 "GET /compute/v2.1/servers/15abb40f-daf9-4c4b-ac9c-55f57ee7b938" status: 200 len: 1558 microversion: 2.1 time: 0.161279 Nov 17 03:53:37.700288 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 1439/2683] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:53:37 2021] GET /compute/v2.1/servers/15abb40f-daf9-4c4b-ac9c-55f57ee7b938 => generated 1558 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:53:38.700564 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-430adf7e-c31e-44c9-8504-05d45275e8f0 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:53:38.701597 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-430adf7e-c31e-44c9-8504-05d45275e8f0 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] [instance: 5d54db85-b991-4890-abaa-952413baa2e7] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:53:38.712366 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-430adf7e-c31e-44c9-8504-05d45275e8f0 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:53:38.713302 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-430adf7e-c31e-44c9-8504-05d45275e8f0 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:53:38.714500 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-430adf7e-c31e-44c9-8504-05d45275e8f0 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:53:38.714939 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-430adf7e-c31e-44c9-8504-05d45275e8f0 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:53:38.718374 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-4ecc8483-4456-486f-b0e4-c4d35b492b60 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:53:38.718978 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-4ecc8483-4456-486f-b0e4-c4d35b492b60 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] [instance: 15abb40f-daf9-4c4b-ac9c-55f57ee7b938] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:53:38.725588 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-4ecc8483-4456-486f-b0e4-c4d35b492b60 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:53:38.726036 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-4ecc8483-4456-486f-b0e4-c4d35b492b60 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:53:38.726801 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-4ecc8483-4456-486f-b0e4-c4d35b492b60 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:53:38.727226 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-4ecc8483-4456-486f-b0e4-c4d35b492b60 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:53:38.845676 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-430adf7e-c31e-44c9-8504-05d45275e8f0 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37f21d6d15cf40a586edda211219fd08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ebb970305844dccacf48a7d8d47ecf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:53:38.854049 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-430adf7e-c31e-44c9-8504-05d45275e8f0 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '37f21d6d15cf40a586edda211219fd08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ebb970305844dccacf48a7d8d47ecf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:53:38.855548 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-430adf7e-c31e-44c9-8504-05d45275e8f0 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '37f21d6d15cf40a586edda211219fd08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ebb970305844dccacf48a7d8d47ecf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:53:38.856753 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-430adf7e-c31e-44c9-8504-05d45275e8f0 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] 10.222.0.11 "GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7" status: 200 len: 1803 microversion: 2.20 time: 0.162888 Nov 17 03:53:38.857385 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 1245/2684] 10.222.0.11 () {60 vars in 1276 bytes} [Wed Nov 17 03:53:38 2021] GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7 => generated 1803 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 17 03:53:38.862771 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-4ecc8483-4456-486f-b0e4-c4d35b492b60 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a792b5b7e6f7461b8d802a5abaaa9518', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e843a3fb49f41dcb376184d7e156528', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:53:38.873670 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-4ecc8483-4456-486f-b0e4-c4d35b492b60 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] 10.222.0.11 "GET /compute/v2.1/servers/15abb40f-daf9-4c4b-ac9c-55f57ee7b938" status: 200 len: 1558 microversion: 2.1 time: 0.158465 Nov 17 03:53:38.874487 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 1440/2685] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:53:38 2021] GET /compute/v2.1/servers/15abb40f-daf9-4c4b-ac9c-55f57ee7b938 => generated 1558 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:53:39.876312 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-c0ac8890-08e6-4ef2-a05a-6b284fae21d7 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:53:39.876939 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-c0ac8890-08e6-4ef2-a05a-6b284fae21d7 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] [instance: 5d54db85-b991-4890-abaa-952413baa2e7] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:53:39.883376 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-c0ac8890-08e6-4ef2-a05a-6b284fae21d7 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:53:39.883821 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-c0ac8890-08e6-4ef2-a05a-6b284fae21d7 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:53:39.884575 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-c0ac8890-08e6-4ef2-a05a-6b284fae21d7 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:53:39.885026 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-c0ac8890-08e6-4ef2-a05a-6b284fae21d7 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:53:39.891084 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-05be6c17-3737-4070-b8c9-451e4084b64e tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:53:39.891677 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-05be6c17-3737-4070-b8c9-451e4084b64e tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] [instance: 15abb40f-daf9-4c4b-ac9c-55f57ee7b938] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:53:39.897955 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-05be6c17-3737-4070-b8c9-451e4084b64e tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:53:39.898399 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-05be6c17-3737-4070-b8c9-451e4084b64e tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:53:39.899180 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-05be6c17-3737-4070-b8c9-451e4084b64e tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:53:39.899626 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-05be6c17-3737-4070-b8c9-451e4084b64e tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:53:40.021917 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-c0ac8890-08e6-4ef2-a05a-6b284fae21d7 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37f21d6d15cf40a586edda211219fd08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ebb970305844dccacf48a7d8d47ecf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:53:40.030332 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-c0ac8890-08e6-4ef2-a05a-6b284fae21d7 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '37f21d6d15cf40a586edda211219fd08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ebb970305844dccacf48a7d8d47ecf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:53:40.032037 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-c0ac8890-08e6-4ef2-a05a-6b284fae21d7 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '37f21d6d15cf40a586edda211219fd08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ebb970305844dccacf48a7d8d47ecf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:53:40.032207 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-05be6c17-3737-4070-b8c9-451e4084b64e tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a792b5b7e6f7461b8d802a5abaaa9518', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e843a3fb49f41dcb376184d7e156528', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:53:40.033281 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-c0ac8890-08e6-4ef2-a05a-6b284fae21d7 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] 10.222.0.11 "GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7" status: 200 len: 1803 microversion: 2.20 time: 0.160806 Nov 17 03:53:40.033858 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 1246/2686] 10.222.0.11 () {60 vars in 1276 bytes} [Wed Nov 17 03:53:39 2021] GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7 => generated 1803 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 17 03:53:40.040652 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-05be6c17-3737-4070-b8c9-451e4084b64e tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] 10.222.0.11 "GET /compute/v2.1/servers/15abb40f-daf9-4c4b-ac9c-55f57ee7b938" status: 200 len: 1558 microversion: 2.1 time: 0.153368 Nov 17 03:53:40.041238 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 1441/2687] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:53:39 2021] GET /compute/v2.1/servers/15abb40f-daf9-4c4b-ac9c-55f57ee7b938 => generated 1558 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:53:41.055947 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-79946cec-4301-4687-83b4-1a49346374ef tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:53:41.057958 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-79946cec-4301-4687-83b4-1a49346374ef tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] [instance: 5d54db85-b991-4890-abaa-952413baa2e7] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:53:41.063563 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-313c3997-7981-4fe7-81f0-0ef408e2ab9d tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:53:41.064563 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-313c3997-7981-4fe7-81f0-0ef408e2ab9d tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] [instance: 15abb40f-daf9-4c4b-ac9c-55f57ee7b938] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:53:41.068448 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-79946cec-4301-4687-83b4-1a49346374ef tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:53:41.069272 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-79946cec-4301-4687-83b4-1a49346374ef tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:53:41.070556 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-79946cec-4301-4687-83b4-1a49346374ef tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:53:41.071285 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-79946cec-4301-4687-83b4-1a49346374ef tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:53:41.074841 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-313c3997-7981-4fe7-81f0-0ef408e2ab9d tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:53:41.075685 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-313c3997-7981-4fe7-81f0-0ef408e2ab9d tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:53:41.076613 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-313c3997-7981-4fe7-81f0-0ef408e2ab9d tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:53:41.077071 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-313c3997-7981-4fe7-81f0-0ef408e2ab9d tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:53:41.204221 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-79946cec-4301-4687-83b4-1a49346374ef tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37f21d6d15cf40a586edda211219fd08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ebb970305844dccacf48a7d8d47ecf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:53:41.208995 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-313c3997-7981-4fe7-81f0-0ef408e2ab9d tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a792b5b7e6f7461b8d802a5abaaa9518', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e843a3fb49f41dcb376184d7e156528', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:53:41.212812 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-79946cec-4301-4687-83b4-1a49346374ef tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '37f21d6d15cf40a586edda211219fd08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ebb970305844dccacf48a7d8d47ecf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:53:41.214318 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-79946cec-4301-4687-83b4-1a49346374ef tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '37f21d6d15cf40a586edda211219fd08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ebb970305844dccacf48a7d8d47ecf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:53:41.215485 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-79946cec-4301-4687-83b4-1a49346374ef tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] 10.222.0.11 "GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7" status: 200 len: 1803 microversion: 2.20 time: 0.166454 Nov 17 03:53:41.216283 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 1247/2688] 10.222.0.11 () {60 vars in 1276 bytes} [Wed Nov 17 03:53:41 2021] GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7 => generated 1803 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 17 03:53:41.217173 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-313c3997-7981-4fe7-81f0-0ef408e2ab9d tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] 10.222.0.11 "GET /compute/v2.1/servers/15abb40f-daf9-4c4b-ac9c-55f57ee7b938" status: 200 len: 1558 microversion: 2.1 time: 0.160012 Nov 17 03:53:41.217736 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 1442/2689] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:53:41 2021] GET /compute/v2.1/servers/15abb40f-daf9-4c4b-ac9c-55f57ee7b938 => generated 1558 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:53:42.238076 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-e837853e-3829-4ead-bd77-85d521eb9d13 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:53:42.239044 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-45f06837-59ae-4cee-b0c4-2e9f73aad0ea tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:53:42.239719 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-e837853e-3829-4ead-bd77-85d521eb9d13 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] [instance: 5d54db85-b991-4890-abaa-952413baa2e7] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:53:42.239880 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-45f06837-59ae-4cee-b0c4-2e9f73aad0ea tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] [instance: 15abb40f-daf9-4c4b-ac9c-55f57ee7b938] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:53:42.249080 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-45f06837-59ae-4cee-b0c4-2e9f73aad0ea tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:53:42.249250 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-e837853e-3829-4ead-bd77-85d521eb9d13 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:53:42.249541 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-45f06837-59ae-4cee-b0c4-2e9f73aad0ea tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:53:42.249740 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-e837853e-3829-4ead-bd77-85d521eb9d13 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:53:42.250293 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-45f06837-59ae-4cee-b0c4-2e9f73aad0ea tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:53:42.250554 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-e837853e-3829-4ead-bd77-85d521eb9d13 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:53:42.250715 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-45f06837-59ae-4cee-b0c4-2e9f73aad0ea tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:53:42.250985 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-e837853e-3829-4ead-bd77-85d521eb9d13 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:53:42.386241 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-45f06837-59ae-4cee-b0c4-2e9f73aad0ea tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a792b5b7e6f7461b8d802a5abaaa9518', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e843a3fb49f41dcb376184d7e156528', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:53:42.389217 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-e837853e-3829-4ead-bd77-85d521eb9d13 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37f21d6d15cf40a586edda211219fd08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ebb970305844dccacf48a7d8d47ecf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:53:42.395247 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-45f06837-59ae-4cee-b0c4-2e9f73aad0ea tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] 10.222.0.11 "GET /compute/v2.1/servers/15abb40f-daf9-4c4b-ac9c-55f57ee7b938" status: 200 len: 1558 microversion: 2.1 time: 0.163134 Nov 17 03:53:42.395824 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 1443/2690] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:53:42 2021] GET /compute/v2.1/servers/15abb40f-daf9-4c4b-ac9c-55f57ee7b938 => generated 1558 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:53:42.397556 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-e837853e-3829-4ead-bd77-85d521eb9d13 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '37f21d6d15cf40a586edda211219fd08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ebb970305844dccacf48a7d8d47ecf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:53:42.399017 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-e837853e-3829-4ead-bd77-85d521eb9d13 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '37f21d6d15cf40a586edda211219fd08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ebb970305844dccacf48a7d8d47ecf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:53:42.400173 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-e837853e-3829-4ead-bd77-85d521eb9d13 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] 10.222.0.11 "GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7" status: 200 len: 1803 microversion: 2.20 time: 0.168491 Nov 17 03:53:42.400727 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 1248/2691] 10.222.0.11 () {60 vars in 1276 bytes} [Wed Nov 17 03:53:42 2021] GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7 => generated 1803 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 17 03:53:43.413206 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-a23c716a-8c25-45f2-81c6-d7a695abe3db tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:53:43.413920 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-a23c716a-8c25-45f2-81c6-d7a695abe3db tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] [instance: 15abb40f-daf9-4c4b-ac9c-55f57ee7b938] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:53:43.419768 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-311439b4-681f-4684-8060-dd4490ca2ff2 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:53:43.420642 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-311439b4-681f-4684-8060-dd4490ca2ff2 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] [instance: 5d54db85-b991-4890-abaa-952413baa2e7] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:53:43.421093 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-a23c716a-8c25-45f2-81c6-d7a695abe3db tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:53:43.421537 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-a23c716a-8c25-45f2-81c6-d7a695abe3db tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:53:43.422296 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-a23c716a-8c25-45f2-81c6-d7a695abe3db tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:53:43.422723 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-a23c716a-8c25-45f2-81c6-d7a695abe3db tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:53:43.429052 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-311439b4-681f-4684-8060-dd4490ca2ff2 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:53:43.429502 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-311439b4-681f-4684-8060-dd4490ca2ff2 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:53:43.431082 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-311439b4-681f-4684-8060-dd4490ca2ff2 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:53:43.431515 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-311439b4-681f-4684-8060-dd4490ca2ff2 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:53:43.554093 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-a23c716a-8c25-45f2-81c6-d7a695abe3db tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a792b5b7e6f7461b8d802a5abaaa9518', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e843a3fb49f41dcb376184d7e156528', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:53:43.561971 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-a23c716a-8c25-45f2-81c6-d7a695abe3db tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] 10.222.0.11 "GET /compute/v2.1/servers/15abb40f-daf9-4c4b-ac9c-55f57ee7b938" status: 200 len: 1558 microversion: 2.1 time: 0.152641 Nov 17 03:53:43.562511 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 1444/2692] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:53:43 2021] GET /compute/v2.1/servers/15abb40f-daf9-4c4b-ac9c-55f57ee7b938 => generated 1558 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:53:43.565600 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-311439b4-681f-4684-8060-dd4490ca2ff2 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37f21d6d15cf40a586edda211219fd08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ebb970305844dccacf48a7d8d47ecf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:53:43.573800 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-311439b4-681f-4684-8060-dd4490ca2ff2 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '37f21d6d15cf40a586edda211219fd08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ebb970305844dccacf48a7d8d47ecf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:53:43.575261 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-311439b4-681f-4684-8060-dd4490ca2ff2 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '37f21d6d15cf40a586edda211219fd08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ebb970305844dccacf48a7d8d47ecf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:53:43.576388 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-311439b4-681f-4684-8060-dd4490ca2ff2 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] 10.222.0.11 "GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7" status: 200 len: 1803 microversion: 2.20 time: 0.160997 Nov 17 03:53:43.576999 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 1249/2693] 10.222.0.11 () {60 vars in 1276 bytes} [Wed Nov 17 03:53:43 2021] GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7 => generated 1803 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 17 03:53:44.583250 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-ac82ce7d-60f1-4b6d-8eab-1092ac64f4c3 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:53:44.584207 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-ac82ce7d-60f1-4b6d-8eab-1092ac64f4c3 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] [instance: 15abb40f-daf9-4c4b-ac9c-55f57ee7b938] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:53:44.593724 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-ac82ce7d-60f1-4b6d-8eab-1092ac64f4c3 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:53:44.594164 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-ac82ce7d-60f1-4b6d-8eab-1092ac64f4c3 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:53:44.594933 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-ac82ce7d-60f1-4b6d-8eab-1092ac64f4c3 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:53:44.595359 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-ac82ce7d-60f1-4b6d-8eab-1092ac64f4c3 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:53:44.595959 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-088a2b67-47a3-450c-95ad-4dbc2b1d4cca tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:53:44.596589 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-088a2b67-47a3-450c-95ad-4dbc2b1d4cca tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] [instance: 5d54db85-b991-4890-abaa-952413baa2e7] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:53:44.603247 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-088a2b67-47a3-450c-95ad-4dbc2b1d4cca tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:53:44.603697 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-088a2b67-47a3-450c-95ad-4dbc2b1d4cca tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:53:44.604462 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-088a2b67-47a3-450c-95ad-4dbc2b1d4cca tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:53:44.604933 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-088a2b67-47a3-450c-95ad-4dbc2b1d4cca tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:53:44.735215 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-ac82ce7d-60f1-4b6d-8eab-1092ac64f4c3 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a792b5b7e6f7461b8d802a5abaaa9518', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e843a3fb49f41dcb376184d7e156528', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:53:44.735483 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-088a2b67-47a3-450c-95ad-4dbc2b1d4cca tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37f21d6d15cf40a586edda211219fd08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ebb970305844dccacf48a7d8d47ecf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:53:44.743629 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-ac82ce7d-60f1-4b6d-8eab-1092ac64f4c3 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] 10.222.0.11 "GET /compute/v2.1/servers/15abb40f-daf9-4c4b-ac9c-55f57ee7b938" status: 200 len: 1558 microversion: 2.1 time: 0.166574 Nov 17 03:53:44.744064 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-088a2b67-47a3-450c-95ad-4dbc2b1d4cca tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '37f21d6d15cf40a586edda211219fd08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ebb970305844dccacf48a7d8d47ecf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:53:44.744221 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 1445/2694] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:53:44 2021] GET /compute/v2.1/servers/15abb40f-daf9-4c4b-ac9c-55f57ee7b938 => generated 1558 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:53:44.745778 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-088a2b67-47a3-450c-95ad-4dbc2b1d4cca tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '37f21d6d15cf40a586edda211219fd08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ebb970305844dccacf48a7d8d47ecf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:53:44.746950 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-088a2b67-47a3-450c-95ad-4dbc2b1d4cca tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] 10.222.0.11 "GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7" status: 200 len: 1803 microversion: 2.20 time: 0.154738 Nov 17 03:53:44.747535 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 1250/2695] 10.222.0.11 () {60 vars in 1276 bytes} [Wed Nov 17 03:53:44 2021] GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7 => generated 1803 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 17 03:53:45.766677 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-5b69acf5-5a26-41fa-939d-7f767fb139d4 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:53:45.767311 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-5b69acf5-5a26-41fa-939d-7f767fb139d4 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] [instance: 5d54db85-b991-4890-abaa-952413baa2e7] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:53:45.768837 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-d45aa9e3-61b4-4041-bef6-640909152dcf tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:53:45.770041 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-d45aa9e3-61b4-4041-bef6-640909152dcf tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] [instance: 15abb40f-daf9-4c4b-ac9c-55f57ee7b938] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:53:45.774823 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-5b69acf5-5a26-41fa-939d-7f767fb139d4 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:53:45.775380 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-5b69acf5-5a26-41fa-939d-7f767fb139d4 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:53:45.776458 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-5b69acf5-5a26-41fa-939d-7f767fb139d4 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:53:45.777246 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-5b69acf5-5a26-41fa-939d-7f767fb139d4 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:53:45.777490 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-d45aa9e3-61b4-4041-bef6-640909152dcf tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:53:45.778126 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-d45aa9e3-61b4-4041-bef6-640909152dcf tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:53:45.778932 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-d45aa9e3-61b4-4041-bef6-640909152dcf tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:53:45.779382 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-d45aa9e3-61b4-4041-bef6-640909152dcf tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:53:45.925847 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-5b69acf5-5a26-41fa-939d-7f767fb139d4 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37f21d6d15cf40a586edda211219fd08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ebb970305844dccacf48a7d8d47ecf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:53:45.931374 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-d45aa9e3-61b4-4041-bef6-640909152dcf tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a792b5b7e6f7461b8d802a5abaaa9518', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e843a3fb49f41dcb376184d7e156528', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:53:45.934864 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-5b69acf5-5a26-41fa-939d-7f767fb139d4 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '37f21d6d15cf40a586edda211219fd08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ebb970305844dccacf48a7d8d47ecf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:53:45.936702 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-5b69acf5-5a26-41fa-939d-7f767fb139d4 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '37f21d6d15cf40a586edda211219fd08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ebb970305844dccacf48a7d8d47ecf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:53:45.938528 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-5b69acf5-5a26-41fa-939d-7f767fb139d4 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] 10.222.0.11 "GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7" status: 200 len: 1803 microversion: 2.20 time: 0.175908 Nov 17 03:53:45.939088 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 1446/2696] 10.222.0.11 () {60 vars in 1276 bytes} [Wed Nov 17 03:53:45 2021] GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7 => generated 1803 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 17 03:53:45.939436 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-d45aa9e3-61b4-4041-bef6-640909152dcf tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] 10.222.0.11 "GET /compute/v2.1/servers/15abb40f-daf9-4c4b-ac9c-55f57ee7b938" status: 200 len: 1558 microversion: 2.1 time: 0.174862 Nov 17 03:53:45.940174 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 1251/2697] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:53:45 2021] GET /compute/v2.1/servers/15abb40f-daf9-4c4b-ac9c-55f57ee7b938 => generated 1558 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:53:46.960725 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-eb0fcfeb-b3ab-47ce-b4a4-a683cfab7587 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:53:46.961632 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-508c238f-ada8-4121-9d91-a102e8479590 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:53:46.962285 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-eb0fcfeb-b3ab-47ce-b4a4-a683cfab7587 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] [instance: 15abb40f-daf9-4c4b-ac9c-55f57ee7b938] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:53:46.962445 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-508c238f-ada8-4121-9d91-a102e8479590 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] [instance: 5d54db85-b991-4890-abaa-952413baa2e7] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:53:46.972445 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-eb0fcfeb-b3ab-47ce-b4a4-a683cfab7587 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:53:46.972744 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-508c238f-ada8-4121-9d91-a102e8479590 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:53:46.973318 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-508c238f-ada8-4121-9d91-a102e8479590 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:53:46.973581 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-eb0fcfeb-b3ab-47ce-b4a4-a683cfab7587 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:53:46.974565 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-508c238f-ada8-4121-9d91-a102e8479590 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:53:46.975034 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-eb0fcfeb-b3ab-47ce-b4a4-a683cfab7587 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:53:46.975449 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-508c238f-ada8-4121-9d91-a102e8479590 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:53:46.975740 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-eb0fcfeb-b3ab-47ce-b4a4-a683cfab7587 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:53:47.111707 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-508c238f-ada8-4121-9d91-a102e8479590 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37f21d6d15cf40a586edda211219fd08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ebb970305844dccacf48a7d8d47ecf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:53:47.120123 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-508c238f-ada8-4121-9d91-a102e8479590 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '37f21d6d15cf40a586edda211219fd08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ebb970305844dccacf48a7d8d47ecf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:53:47.120900 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-eb0fcfeb-b3ab-47ce-b4a4-a683cfab7587 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a792b5b7e6f7461b8d802a5abaaa9518', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e843a3fb49f41dcb376184d7e156528', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:53:47.121640 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-508c238f-ada8-4121-9d91-a102e8479590 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '37f21d6d15cf40a586edda211219fd08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ebb970305844dccacf48a7d8d47ecf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:53:47.122884 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-508c238f-ada8-4121-9d91-a102e8479590 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] 10.222.0.11 "GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7" status: 200 len: 1803 microversion: 2.20 time: 0.168196 Nov 17 03:53:47.123417 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 1252/2698] 10.222.0.11 () {60 vars in 1276 bytes} [Wed Nov 17 03:53:46 2021] GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7 => generated 1803 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 17 03:53:47.128931 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-eb0fcfeb-b3ab-47ce-b4a4-a683cfab7587 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] 10.222.0.11 "GET /compute/v2.1/servers/15abb40f-daf9-4c4b-ac9c-55f57ee7b938" status: 200 len: 1558 microversion: 2.1 time: 0.174282 Nov 17 03:53:47.129489 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 1447/2699] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:53:46 2021] GET /compute/v2.1/servers/15abb40f-daf9-4c4b-ac9c-55f57ee7b938 => generated 1558 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:53:48.144755 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-391bf875-6145-4288-9e2d-ec05fb324e1e tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:53:48.145737 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-391bf875-6145-4288-9e2d-ec05fb324e1e tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] [instance: 5d54db85-b991-4890-abaa-952413baa2e7] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:53:48.150964 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-e35b5e93-f234-4991-882a-ae23e69fc9ff tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:53:48.151674 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-e35b5e93-f234-4991-882a-ae23e69fc9ff tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] [instance: 15abb40f-daf9-4c4b-ac9c-55f57ee7b938] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:53:48.155776 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-391bf875-6145-4288-9e2d-ec05fb324e1e tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:53:48.156226 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-391bf875-6145-4288-9e2d-ec05fb324e1e tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:53:48.157203 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-391bf875-6145-4288-9e2d-ec05fb324e1e tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:53:48.157625 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-391bf875-6145-4288-9e2d-ec05fb324e1e tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:53:48.158964 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-e35b5e93-f234-4991-882a-ae23e69fc9ff tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:53:48.159389 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-e35b5e93-f234-4991-882a-ae23e69fc9ff tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:53:48.160181 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-e35b5e93-f234-4991-882a-ae23e69fc9ff tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:53:48.160604 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-e35b5e93-f234-4991-882a-ae23e69fc9ff tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:53:48.289112 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-e35b5e93-f234-4991-882a-ae23e69fc9ff tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a792b5b7e6f7461b8d802a5abaaa9518', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e843a3fb49f41dcb376184d7e156528', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:53:48.290848 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-391bf875-6145-4288-9e2d-ec05fb324e1e tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37f21d6d15cf40a586edda211219fd08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ebb970305844dccacf48a7d8d47ecf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:53:48.297708 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-e35b5e93-f234-4991-882a-ae23e69fc9ff tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] 10.222.0.11 "GET /compute/v2.1/servers/15abb40f-daf9-4c4b-ac9c-55f57ee7b938" status: 200 len: 1558 microversion: 2.1 time: 0.153145 Nov 17 03:53:48.298282 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 1448/2700] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:53:48 2021] GET /compute/v2.1/servers/15abb40f-daf9-4c4b-ac9c-55f57ee7b938 => generated 1558 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:53:48.299131 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-391bf875-6145-4288-9e2d-ec05fb324e1e tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '37f21d6d15cf40a586edda211219fd08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ebb970305844dccacf48a7d8d47ecf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:53:48.300621 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-391bf875-6145-4288-9e2d-ec05fb324e1e tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '37f21d6d15cf40a586edda211219fd08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ebb970305844dccacf48a7d8d47ecf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:53:48.302236 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-391bf875-6145-4288-9e2d-ec05fb324e1e tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] 10.222.0.11 "GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7" status: 200 len: 1803 microversion: 2.20 time: 0.163146 Nov 17 03:53:48.302946 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 1253/2701] 10.222.0.11 () {60 vars in 1276 bytes} [Wed Nov 17 03:53:48 2021] GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7 => generated 1803 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 17 03:53:49.317118 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-d71c7b6d-f1ee-4cf1-967c-e86001e10b45 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:53:49.317858 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-d71c7b6d-f1ee-4cf1-967c-e86001e10b45 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] [instance: 15abb40f-daf9-4c4b-ac9c-55f57ee7b938] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:53:49.321900 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-c24dfc8b-2967-457a-ad17-47ad6eae7d88 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:53:49.322700 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-c24dfc8b-2967-457a-ad17-47ad6eae7d88 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] [instance: 5d54db85-b991-4890-abaa-952413baa2e7] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:53:49.326164 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-d71c7b6d-f1ee-4cf1-967c-e86001e10b45 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:53:49.326612 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-d71c7b6d-f1ee-4cf1-967c-e86001e10b45 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:53:49.327460 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-d71c7b6d-f1ee-4cf1-967c-e86001e10b45 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:53:49.327884 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-d71c7b6d-f1ee-4cf1-967c-e86001e10b45 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:53:49.329803 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-c24dfc8b-2967-457a-ad17-47ad6eae7d88 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:53:49.330219 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-c24dfc8b-2967-457a-ad17-47ad6eae7d88 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:53:49.331044 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-c24dfc8b-2967-457a-ad17-47ad6eae7d88 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:53:49.331482 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-c24dfc8b-2967-457a-ad17-47ad6eae7d88 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:53:49.463936 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-c24dfc8b-2967-457a-ad17-47ad6eae7d88 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37f21d6d15cf40a586edda211219fd08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ebb970305844dccacf48a7d8d47ecf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:53:49.467105 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-d71c7b6d-f1ee-4cf1-967c-e86001e10b45 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a792b5b7e6f7461b8d802a5abaaa9518', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e843a3fb49f41dcb376184d7e156528', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:53:49.473693 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-c24dfc8b-2967-457a-ad17-47ad6eae7d88 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '37f21d6d15cf40a586edda211219fd08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ebb970305844dccacf48a7d8d47ecf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:53:49.475094 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-d71c7b6d-f1ee-4cf1-967c-e86001e10b45 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] 10.222.0.11 "GET /compute/v2.1/servers/15abb40f-daf9-4c4b-ac9c-55f57ee7b938" status: 200 len: 1558 microversion: 2.1 time: 0.162697 Nov 17 03:53:49.475296 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-c24dfc8b-2967-457a-ad17-47ad6eae7d88 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '37f21d6d15cf40a586edda211219fd08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ebb970305844dccacf48a7d8d47ecf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:53:49.475642 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 1449/2702] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:53:49 2021] GET /compute/v2.1/servers/15abb40f-daf9-4c4b-ac9c-55f57ee7b938 => generated 1558 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:53:49.476638 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-c24dfc8b-2967-457a-ad17-47ad6eae7d88 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] 10.222.0.11 "GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7" status: 200 len: 1803 microversion: 2.20 time: 0.159364 Nov 17 03:53:49.477254 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 1254/2703] 10.222.0.11 () {60 vars in 1276 bytes} [Wed Nov 17 03:53:49 2021] GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7 => generated 1803 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 17 03:53:50.497739 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-fc1e09c3-307a-4055-9596-31fc2b59e157 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:53:50.498583 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-fc1e09c3-307a-4055-9596-31fc2b59e157 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] [instance: 15abb40f-daf9-4c4b-ac9c-55f57ee7b938] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:53:50.498745 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-7d0f7cc5-df6f-4d9c-8c09-194c98920298 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:53:50.499145 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-7d0f7cc5-df6f-4d9c-8c09-194c98920298 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] [instance: 5d54db85-b991-4890-abaa-952413baa2e7] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:53:50.505406 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-fc1e09c3-307a-4055-9596-31fc2b59e157 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:53:50.505670 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-7d0f7cc5-df6f-4d9c-8c09-194c98920298 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:53:50.505818 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-fc1e09c3-307a-4055-9596-31fc2b59e157 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:53:50.506101 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-7d0f7cc5-df6f-4d9c-8c09-194c98920298 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:53:50.506600 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-fc1e09c3-307a-4055-9596-31fc2b59e157 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:53:50.506876 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-7d0f7cc5-df6f-4d9c-8c09-194c98920298 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:53:50.507023 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-fc1e09c3-307a-4055-9596-31fc2b59e157 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:53:50.507298 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-7d0f7cc5-df6f-4d9c-8c09-194c98920298 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:53:50.636946 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-7d0f7cc5-df6f-4d9c-8c09-194c98920298 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37f21d6d15cf40a586edda211219fd08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ebb970305844dccacf48a7d8d47ecf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:53:50.638249 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-fc1e09c3-307a-4055-9596-31fc2b59e157 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a792b5b7e6f7461b8d802a5abaaa9518', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e843a3fb49f41dcb376184d7e156528', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:53:50.645735 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-7d0f7cc5-df6f-4d9c-8c09-194c98920298 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '37f21d6d15cf40a586edda211219fd08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ebb970305844dccacf48a7d8d47ecf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:53:50.646418 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-fc1e09c3-307a-4055-9596-31fc2b59e157 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] 10.222.0.11 "GET /compute/v2.1/servers/15abb40f-daf9-4c4b-ac9c-55f57ee7b938" status: 200 len: 1558 microversion: 2.1 time: 0.155138 Nov 17 03:53:50.647275 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 1450/2704] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:53:50 2021] GET /compute/v2.1/servers/15abb40f-daf9-4c4b-ac9c-55f57ee7b938 => generated 1558 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:53:50.647433 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-7d0f7cc5-df6f-4d9c-8c09-194c98920298 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '37f21d6d15cf40a586edda211219fd08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ebb970305844dccacf48a7d8d47ecf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:53:50.648342 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-7d0f7cc5-df6f-4d9c-8c09-194c98920298 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] 10.222.0.11 "GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7" status: 200 len: 1803 microversion: 2.20 time: 0.155679 Nov 17 03:53:50.648904 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 1255/2705] 10.222.0.11 () {60 vars in 1276 bytes} [Wed Nov 17 03:53:50 2021] GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7 => generated 1803 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 17 03:53:51.667706 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-d451cf41-6389-4ee5-a852-416ddee78e29 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:53:51.668644 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-d451cf41-6389-4ee5-a852-416ddee78e29 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] [instance: 15abb40f-daf9-4c4b-ac9c-55f57ee7b938] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:53:51.670751 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-f3f9d875-5f4f-4f43-8259-182e473d07a0 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:53:51.671357 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-f3f9d875-5f4f-4f43-8259-182e473d07a0 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] [instance: 5d54db85-b991-4890-abaa-952413baa2e7] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:53:51.675811 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-d451cf41-6389-4ee5-a852-416ddee78e29 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:53:51.676241 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-d451cf41-6389-4ee5-a852-416ddee78e29 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:53:51.677414 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-d451cf41-6389-4ee5-a852-416ddee78e29 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:53:51.677840 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-d451cf41-6389-4ee5-a852-416ddee78e29 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:53:51.678240 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-f3f9d875-5f4f-4f43-8259-182e473d07a0 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:53:51.678684 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-f3f9d875-5f4f-4f43-8259-182e473d07a0 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:53:51.679463 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-f3f9d875-5f4f-4f43-8259-182e473d07a0 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:53:51.679891 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-f3f9d875-5f4f-4f43-8259-182e473d07a0 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:53:51.811256 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-d451cf41-6389-4ee5-a852-416ddee78e29 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a792b5b7e6f7461b8d802a5abaaa9518', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e843a3fb49f41dcb376184d7e156528', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:53:51.811436 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-f3f9d875-5f4f-4f43-8259-182e473d07a0 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37f21d6d15cf40a586edda211219fd08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ebb970305844dccacf48a7d8d47ecf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:53:51.819273 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-d451cf41-6389-4ee5-a852-416ddee78e29 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] 10.222.0.11 "GET /compute/v2.1/servers/15abb40f-daf9-4c4b-ac9c-55f57ee7b938" status: 200 len: 1558 microversion: 2.1 time: 0.157670 Nov 17 03:53:51.819588 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-f3f9d875-5f4f-4f43-8259-182e473d07a0 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '37f21d6d15cf40a586edda211219fd08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ebb970305844dccacf48a7d8d47ecf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:53:51.819852 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 1451/2706] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:53:51 2021] GET /compute/v2.1/servers/15abb40f-daf9-4c4b-ac9c-55f57ee7b938 => generated 1558 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:53:51.821257 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-f3f9d875-5f4f-4f43-8259-182e473d07a0 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '37f21d6d15cf40a586edda211219fd08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ebb970305844dccacf48a7d8d47ecf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:53:51.822394 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-f3f9d875-5f4f-4f43-8259-182e473d07a0 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] 10.222.0.11 "GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7" status: 200 len: 1803 microversion: 2.20 time: 0.157543 Nov 17 03:53:51.822909 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 1256/2707] 10.222.0.11 () {60 vars in 1276 bytes} [Wed Nov 17 03:53:51 2021] GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7 => generated 1803 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 17 03:53:52.840145 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-d2a96568-c56a-4bf8-b15a-39fde74c1060 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:53:52.841137 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-d2a96568-c56a-4bf8-b15a-39fde74c1060 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] [instance: 15abb40f-daf9-4c4b-ac9c-55f57ee7b938] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:53:52.842813 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-9cca9c19-f2a4-4e88-b50c-cd18fa82a2d3 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:53:52.843428 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-9cca9c19-f2a4-4e88-b50c-cd18fa82a2d3 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] [instance: 5d54db85-b991-4890-abaa-952413baa2e7] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:53:52.848538 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-d2a96568-c56a-4bf8-b15a-39fde74c1060 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:53:52.849035 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-d2a96568-c56a-4bf8-b15a-39fde74c1060 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:53:52.849821 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-d2a96568-c56a-4bf8-b15a-39fde74c1060 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:53:52.850008 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-9cca9c19-f2a4-4e88-b50c-cd18fa82a2d3 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:53:52.850257 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-d2a96568-c56a-4bf8-b15a-39fde74c1060 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:53:52.850491 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-9cca9c19-f2a4-4e88-b50c-cd18fa82a2d3 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:53:52.851286 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-9cca9c19-f2a4-4e88-b50c-cd18fa82a2d3 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:53:52.851714 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-9cca9c19-f2a4-4e88-b50c-cd18fa82a2d3 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:53:52.983447 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-9cca9c19-f2a4-4e88-b50c-cd18fa82a2d3 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37f21d6d15cf40a586edda211219fd08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ebb970305844dccacf48a7d8d47ecf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:53:52.983940 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-d2a96568-c56a-4bf8-b15a-39fde74c1060 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a792b5b7e6f7461b8d802a5abaaa9518', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e843a3fb49f41dcb376184d7e156528', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:53:52.991711 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-d2a96568-c56a-4bf8-b15a-39fde74c1060 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] 10.222.0.11 "GET /compute/v2.1/servers/15abb40f-daf9-4c4b-ac9c-55f57ee7b938" status: 200 len: 1558 microversion: 2.1 time: 0.157684 Nov 17 03:53:52.992186 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-9cca9c19-f2a4-4e88-b50c-cd18fa82a2d3 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '37f21d6d15cf40a586edda211219fd08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ebb970305844dccacf48a7d8d47ecf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:53:52.992632 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 1452/2708] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:53:52 2021] GET /compute/v2.1/servers/15abb40f-daf9-4c4b-ac9c-55f57ee7b938 => generated 1558 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:53:52.994513 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-9cca9c19-f2a4-4e88-b50c-cd18fa82a2d3 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '37f21d6d15cf40a586edda211219fd08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ebb970305844dccacf48a7d8d47ecf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:53:52.995800 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-9cca9c19-f2a4-4e88-b50c-cd18fa82a2d3 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] 10.222.0.11 "GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7" status: 200 len: 1803 microversion: 2.20 time: 0.158788 Nov 17 03:53:52.996420 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 1257/2709] 10.222.0.11 () {60 vars in 1276 bytes} [Wed Nov 17 03:53:52 2021] GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7 => generated 1803 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 17 03:53:54.013502 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-a23fc2ed-7624-4c00-a99a-d58f125d66da tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:53:54.014276 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-a23fc2ed-7624-4c00-a99a-d58f125d66da tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] [instance: 15abb40f-daf9-4c4b-ac9c-55f57ee7b938] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:53:54.016301 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-8738219a-4fec-4ccf-a09f-0151419dfe6a tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:53:54.017001 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-8738219a-4fec-4ccf-a09f-0151419dfe6a tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] [instance: 5d54db85-b991-4890-abaa-952413baa2e7] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:53:54.020206 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-a23fc2ed-7624-4c00-a99a-d58f125d66da tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:53:54.020660 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-a23fc2ed-7624-4c00-a99a-d58f125d66da tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:53:54.021513 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-a23fc2ed-7624-4c00-a99a-d58f125d66da tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:53:54.021953 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-a23fc2ed-7624-4c00-a99a-d58f125d66da tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:53:54.023364 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-8738219a-4fec-4ccf-a09f-0151419dfe6a tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:53:54.023828 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-8738219a-4fec-4ccf-a09f-0151419dfe6a tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:53:54.024594 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-8738219a-4fec-4ccf-a09f-0151419dfe6a tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:53:54.025064 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-8738219a-4fec-4ccf-a09f-0151419dfe6a tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:53:54.158728 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-a23fc2ed-7624-4c00-a99a-d58f125d66da tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a792b5b7e6f7461b8d802a5abaaa9518', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e843a3fb49f41dcb376184d7e156528', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:53:54.159929 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-8738219a-4fec-4ccf-a09f-0151419dfe6a tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37f21d6d15cf40a586edda211219fd08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ebb970305844dccacf48a7d8d47ecf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:53:54.166827 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-a23fc2ed-7624-4c00-a99a-d58f125d66da tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] 10.222.0.11 "GET /compute/v2.1/servers/15abb40f-daf9-4c4b-ac9c-55f57ee7b938" status: 200 len: 1558 microversion: 2.1 time: 0.159851 Nov 17 03:53:54.167661 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 1453/2710] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:53:54 2021] GET /compute/v2.1/servers/15abb40f-daf9-4c4b-ac9c-55f57ee7b938 => generated 1558 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:53:54.168565 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-8738219a-4fec-4ccf-a09f-0151419dfe6a tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '37f21d6d15cf40a586edda211219fd08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ebb970305844dccacf48a7d8d47ecf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:53:54.170166 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-8738219a-4fec-4ccf-a09f-0151419dfe6a tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '37f21d6d15cf40a586edda211219fd08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ebb970305844dccacf48a7d8d47ecf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:53:54.171469 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-8738219a-4fec-4ccf-a09f-0151419dfe6a tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] 10.222.0.11 "GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7" status: 200 len: 1803 microversion: 2.20 time: 0.160349 Nov 17 03:53:54.172067 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 1258/2711] 10.222.0.11 () {60 vars in 1276 bytes} [Wed Nov 17 03:53:54 2021] GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7 => generated 1803 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 17 03:53:55.189948 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-64e9cf17-f9c4-41e4-9f6c-33a177160dcd tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:53:55.190866 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-64e9cf17-f9c4-41e4-9f6c-33a177160dcd tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] [instance: 15abb40f-daf9-4c4b-ac9c-55f57ee7b938] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:53:55.194428 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-48b6de7f-39d2-4aef-89fa-841ce53c5101 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:53:55.195440 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-48b6de7f-39d2-4aef-89fa-841ce53c5101 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] [instance: 5d54db85-b991-4890-abaa-952413baa2e7] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:53:55.201970 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-64e9cf17-f9c4-41e4-9f6c-33a177160dcd tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:53:55.202431 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-64e9cf17-f9c4-41e4-9f6c-33a177160dcd tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:53:55.203253 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-64e9cf17-f9c4-41e4-9f6c-33a177160dcd tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:53:55.203689 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-64e9cf17-f9c4-41e4-9f6c-33a177160dcd tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:53:55.204245 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-48b6de7f-39d2-4aef-89fa-841ce53c5101 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:53:55.204700 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-48b6de7f-39d2-4aef-89fa-841ce53c5101 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:53:55.205508 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-48b6de7f-39d2-4aef-89fa-841ce53c5101 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:53:55.206062 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-48b6de7f-39d2-4aef-89fa-841ce53c5101 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:53:55.349051 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-64e9cf17-f9c4-41e4-9f6c-33a177160dcd tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a792b5b7e6f7461b8d802a5abaaa9518', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e843a3fb49f41dcb376184d7e156528', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:53:55.357728 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-64e9cf17-f9c4-41e4-9f6c-33a177160dcd tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] 10.222.0.11 "GET /compute/v2.1/servers/15abb40f-daf9-4c4b-ac9c-55f57ee7b938" status: 200 len: 1558 microversion: 2.1 time: 0.174201 Nov 17 03:53:55.358340 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 1454/2712] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:53:55 2021] GET /compute/v2.1/servers/15abb40f-daf9-4c4b-ac9c-55f57ee7b938 => generated 1558 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:53:55.507814 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-48b6de7f-39d2-4aef-89fa-841ce53c5101 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37f21d6d15cf40a586edda211219fd08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ebb970305844dccacf48a7d8d47ecf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:53:55.517028 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-48b6de7f-39d2-4aef-89fa-841ce53c5101 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '37f21d6d15cf40a586edda211219fd08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ebb970305844dccacf48a7d8d47ecf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:53:55.518507 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-48b6de7f-39d2-4aef-89fa-841ce53c5101 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '37f21d6d15cf40a586edda211219fd08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ebb970305844dccacf48a7d8d47ecf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:53:55.519675 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-48b6de7f-39d2-4aef-89fa-841ce53c5101 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] 10.222.0.11 "GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7" status: 200 len: 1803 microversion: 2.20 time: 0.331457 Nov 17 03:53:55.520231 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 1259/2713] 10.222.0.11 () {60 vars in 1276 bytes} [Wed Nov 17 03:53:55 2021] GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7 => generated 1803 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 17 03:53:56.376732 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-30597654-93a3-4247-89c7-1cebc2b84be7 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:53:56.377452 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-30597654-93a3-4247-89c7-1cebc2b84be7 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] [instance: 15abb40f-daf9-4c4b-ac9c-55f57ee7b938] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:53:56.385655 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-30597654-93a3-4247-89c7-1cebc2b84be7 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:53:56.386204 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-30597654-93a3-4247-89c7-1cebc2b84be7 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:53:56.387153 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-30597654-93a3-4247-89c7-1cebc2b84be7 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:53:56.387681 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-30597654-93a3-4247-89c7-1cebc2b84be7 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:53:56.520441 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-30597654-93a3-4247-89c7-1cebc2b84be7 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a792b5b7e6f7461b8d802a5abaaa9518', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e843a3fb49f41dcb376184d7e156528', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:53:56.529543 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-30597654-93a3-4247-89c7-1cebc2b84be7 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] 10.222.0.11 "GET /compute/v2.1/servers/15abb40f-daf9-4c4b-ac9c-55f57ee7b938" status: 200 len: 1558 microversion: 2.1 time: 0.157532 Nov 17 03:53:56.530105 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 1455/2714] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:53:56 2021] GET /compute/v2.1/servers/15abb40f-daf9-4c4b-ac9c-55f57ee7b938 => generated 1558 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:53:56.538754 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-4e18ca03-097c-4c71-9119-db3e463154ff tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:53:56.539334 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-4e18ca03-097c-4c71-9119-db3e463154ff tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] [instance: 5d54db85-b991-4890-abaa-952413baa2e7] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:53:56.546365 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-4e18ca03-097c-4c71-9119-db3e463154ff tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:53:56.546810 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-4e18ca03-097c-4c71-9119-db3e463154ff tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:53:56.547577 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-4e18ca03-097c-4c71-9119-db3e463154ff tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:53:56.548013 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-4e18ca03-097c-4c71-9119-db3e463154ff tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:53:56.681854 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-4e18ca03-097c-4c71-9119-db3e463154ff tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37f21d6d15cf40a586edda211219fd08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ebb970305844dccacf48a7d8d47ecf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:53:56.690932 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-4e18ca03-097c-4c71-9119-db3e463154ff tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '37f21d6d15cf40a586edda211219fd08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ebb970305844dccacf48a7d8d47ecf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:53:56.692413 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-4e18ca03-097c-4c71-9119-db3e463154ff tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '37f21d6d15cf40a586edda211219fd08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ebb970305844dccacf48a7d8d47ecf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:53:56.693597 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-4e18ca03-097c-4c71-9119-db3e463154ff tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] 10.222.0.11 "GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7" status: 200 len: 1803 microversion: 2.20 time: 0.158731 Nov 17 03:53:56.694144 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 1260/2715] 10.222.0.11 () {60 vars in 1276 bytes} [Wed Nov 17 03:53:56 2021] GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7 => generated 1803 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 17 03:53:57.549923 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-754b5547-4b1f-4979-8188-c947071e01b6 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:53:57.550729 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-754b5547-4b1f-4979-8188-c947071e01b6 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] [instance: 15abb40f-daf9-4c4b-ac9c-55f57ee7b938] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:53:57.559780 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-754b5547-4b1f-4979-8188-c947071e01b6 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:53:57.560350 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-754b5547-4b1f-4979-8188-c947071e01b6 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:53:57.561879 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-754b5547-4b1f-4979-8188-c947071e01b6 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:53:57.562487 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-754b5547-4b1f-4979-8188-c947071e01b6 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:53:57.710086 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-754b5547-4b1f-4979-8188-c947071e01b6 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a792b5b7e6f7461b8d802a5abaaa9518', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e843a3fb49f41dcb376184d7e156528', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:53:57.714414 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-03847137-5ccb-4a7e-9fa9-207909c4342d tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:53:57.715431 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-03847137-5ccb-4a7e-9fa9-207909c4342d tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] [instance: 5d54db85-b991-4890-abaa-952413baa2e7] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:53:57.720564 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-754b5547-4b1f-4979-8188-c947071e01b6 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] 10.222.0.11 "GET /compute/v2.1/servers/15abb40f-daf9-4c4b-ac9c-55f57ee7b938" status: 200 len: 1558 microversion: 2.1 time: 0.176197 Nov 17 03:53:57.721176 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 1456/2716] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:53:57 2021] GET /compute/v2.1/servers/15abb40f-daf9-4c4b-ac9c-55f57ee7b938 => generated 1558 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:53:57.723059 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-03847137-5ccb-4a7e-9fa9-207909c4342d tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:53:57.723733 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-03847137-5ccb-4a7e-9fa9-207909c4342d tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:53:57.724830 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-03847137-5ccb-4a7e-9fa9-207909c4342d tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:53:57.725462 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-03847137-5ccb-4a7e-9fa9-207909c4342d tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:53:57.858880 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-03847137-5ccb-4a7e-9fa9-207909c4342d tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37f21d6d15cf40a586edda211219fd08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ebb970305844dccacf48a7d8d47ecf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:53:57.867401 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-03847137-5ccb-4a7e-9fa9-207909c4342d tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '37f21d6d15cf40a586edda211219fd08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ebb970305844dccacf48a7d8d47ecf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:53:57.868901 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-03847137-5ccb-4a7e-9fa9-207909c4342d tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '37f21d6d15cf40a586edda211219fd08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ebb970305844dccacf48a7d8d47ecf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:53:57.870054 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-03847137-5ccb-4a7e-9fa9-207909c4342d tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] 10.222.0.11 "GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7" status: 200 len: 1803 microversion: 2.20 time: 0.161807 Nov 17 03:53:57.870635 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 1261/2717] 10.222.0.11 () {60 vars in 1276 bytes} [Wed Nov 17 03:53:57 2021] GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7 => generated 1803 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 17 03:53:58.746960 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-b52d1f5d-a8a5-4489-b7ae-a0475b377b8f tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:53:58.748072 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-b52d1f5d-a8a5-4489-b7ae-a0475b377b8f tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] [instance: 15abb40f-daf9-4c4b-ac9c-55f57ee7b938] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:53:58.755337 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-b52d1f5d-a8a5-4489-b7ae-a0475b377b8f tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:53:58.755898 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-b52d1f5d-a8a5-4489-b7ae-a0475b377b8f tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:53:58.756688 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-b52d1f5d-a8a5-4489-b7ae-a0475b377b8f tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:53:58.757157 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-b52d1f5d-a8a5-4489-b7ae-a0475b377b8f tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:53:58.889519 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-9861d3a2-a929-4b27-b43d-2b18e0478450 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:53:58.890302 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-9861d3a2-a929-4b27-b43d-2b18e0478450 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] [instance: 5d54db85-b991-4890-abaa-952413baa2e7] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:53:58.896924 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-9861d3a2-a929-4b27-b43d-2b18e0478450 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:53:58.897407 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-9861d3a2-a929-4b27-b43d-2b18e0478450 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:53:58.898168 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-9861d3a2-a929-4b27-b43d-2b18e0478450 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:53:58.898600 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-9861d3a2-a929-4b27-b43d-2b18e0478450 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:53:58.904289 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-b52d1f5d-a8a5-4489-b7ae-a0475b377b8f tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a792b5b7e6f7461b8d802a5abaaa9518', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e843a3fb49f41dcb376184d7e156528', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:53:58.912612 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-b52d1f5d-a8a5-4489-b7ae-a0475b377b8f tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] 10.222.0.11 "GET /compute/v2.1/servers/15abb40f-daf9-4c4b-ac9c-55f57ee7b938" status: 200 len: 1558 microversion: 2.1 time: 0.171855 Nov 17 03:53:58.913238 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 1457/2718] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:53:58 2021] GET /compute/v2.1/servers/15abb40f-daf9-4c4b-ac9c-55f57ee7b938 => generated 1558 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:53:59.036613 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-9861d3a2-a929-4b27-b43d-2b18e0478450 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37f21d6d15cf40a586edda211219fd08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ebb970305844dccacf48a7d8d47ecf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:53:59.046030 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-9861d3a2-a929-4b27-b43d-2b18e0478450 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '37f21d6d15cf40a586edda211219fd08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ebb970305844dccacf48a7d8d47ecf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:53:59.047524 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-9861d3a2-a929-4b27-b43d-2b18e0478450 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '37f21d6d15cf40a586edda211219fd08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ebb970305844dccacf48a7d8d47ecf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:53:59.048732 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-9861d3a2-a929-4b27-b43d-2b18e0478450 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] 10.222.0.11 "GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7" status: 200 len: 1803 microversion: 2.20 time: 0.163402 Nov 17 03:53:59.049264 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 1262/2719] 10.222.0.11 () {60 vars in 1276 bytes} [Wed Nov 17 03:53:58 2021] GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7 => generated 1803 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 17 03:53:59.934903 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-2a74633a-85a4-4841-a8b1-e4db019134a3 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:53:59.935863 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-2a74633a-85a4-4841-a8b1-e4db019134a3 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] [instance: 15abb40f-daf9-4c4b-ac9c-55f57ee7b938] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:53:59.946483 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-2a74633a-85a4-4841-a8b1-e4db019134a3 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:53:59.947219 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-2a74633a-85a4-4841-a8b1-e4db019134a3 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:53:59.948517 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-2a74633a-85a4-4841-a8b1-e4db019134a3 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:53:59.949268 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-2a74633a-85a4-4841-a8b1-e4db019134a3 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:54:00.067729 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-f8ba0381-a49b-4abc-9717-ed7459b7f837 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:54:00.068301 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-f8ba0381-a49b-4abc-9717-ed7459b7f837 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] [instance: 5d54db85-b991-4890-abaa-952413baa2e7] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:54:00.074766 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-f8ba0381-a49b-4abc-9717-ed7459b7f837 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:54:00.075216 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-f8ba0381-a49b-4abc-9717-ed7459b7f837 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:54:00.075979 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-f8ba0381-a49b-4abc-9717-ed7459b7f837 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:54:00.076434 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-f8ba0381-a49b-4abc-9717-ed7459b7f837 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:54:00.086736 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-2a74633a-85a4-4841-a8b1-e4db019134a3 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a792b5b7e6f7461b8d802a5abaaa9518', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e843a3fb49f41dcb376184d7e156528', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:54:00.095015 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-2a74633a-85a4-4841-a8b1-e4db019134a3 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] 10.222.0.11 "GET /compute/v2.1/servers/15abb40f-daf9-4c4b-ac9c-55f57ee7b938" status: 200 len: 1558 microversion: 2.1 time: 0.166508 Nov 17 03:54:00.095653 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 1458/2720] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:53:59 2021] GET /compute/v2.1/servers/15abb40f-daf9-4c4b-ac9c-55f57ee7b938 => generated 1558 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:54:00.219715 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-f8ba0381-a49b-4abc-9717-ed7459b7f837 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37f21d6d15cf40a586edda211219fd08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ebb970305844dccacf48a7d8d47ecf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:54:00.228458 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-f8ba0381-a49b-4abc-9717-ed7459b7f837 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '37f21d6d15cf40a586edda211219fd08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ebb970305844dccacf48a7d8d47ecf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:54:00.229993 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-f8ba0381-a49b-4abc-9717-ed7459b7f837 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '37f21d6d15cf40a586edda211219fd08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ebb970305844dccacf48a7d8d47ecf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:54:00.231148 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-f8ba0381-a49b-4abc-9717-ed7459b7f837 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] 10.222.0.11 "GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7" status: 200 len: 1803 microversion: 2.20 time: 0.167236 Nov 17 03:54:00.231667 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 1263/2721] 10.222.0.11 () {60 vars in 1276 bytes} [Wed Nov 17 03:54:00 2021] GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7 => generated 1803 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 17 03:54:01.116316 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-da20bec1-4738-48a4-ba6b-32453b5ae017 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:54:01.117375 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-da20bec1-4738-48a4-ba6b-32453b5ae017 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] [instance: 15abb40f-daf9-4c4b-ac9c-55f57ee7b938] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:54:01.126455 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-da20bec1-4738-48a4-ba6b-32453b5ae017 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:54:01.126901 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-da20bec1-4738-48a4-ba6b-32453b5ae017 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:54:01.127660 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-da20bec1-4738-48a4-ba6b-32453b5ae017 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:54:01.128088 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-da20bec1-4738-48a4-ba6b-32453b5ae017 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:54:01.249774 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-3a693091-5b0d-4cc3-b99d-9b0eb9e29810 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:54:01.250350 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-3a693091-5b0d-4cc3-b99d-9b0eb9e29810 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] [instance: 5d54db85-b991-4890-abaa-952413baa2e7] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:54:01.256693 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-3a693091-5b0d-4cc3-b99d-9b0eb9e29810 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:54:01.257178 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-3a693091-5b0d-4cc3-b99d-9b0eb9e29810 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:54:01.257934 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-3a693091-5b0d-4cc3-b99d-9b0eb9e29810 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:54:01.258345 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-3a693091-5b0d-4cc3-b99d-9b0eb9e29810 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:54:01.263903 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-da20bec1-4738-48a4-ba6b-32453b5ae017 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a792b5b7e6f7461b8d802a5abaaa9518', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e843a3fb49f41dcb376184d7e156528', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:54:01.272431 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-da20bec1-4738-48a4-ba6b-32453b5ae017 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] 10.222.0.11 "GET /compute/v2.1/servers/15abb40f-daf9-4c4b-ac9c-55f57ee7b938" status: 200 len: 1558 microversion: 2.1 time: 0.162301 Nov 17 03:54:01.273034 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 1459/2722] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:54:01 2021] GET /compute/v2.1/servers/15abb40f-daf9-4c4b-ac9c-55f57ee7b938 => generated 1558 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:54:01.386421 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-3a693091-5b0d-4cc3-b99d-9b0eb9e29810 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37f21d6d15cf40a586edda211219fd08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ebb970305844dccacf48a7d8d47ecf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:54:01.395556 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-3a693091-5b0d-4cc3-b99d-9b0eb9e29810 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '37f21d6d15cf40a586edda211219fd08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ebb970305844dccacf48a7d8d47ecf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:54:01.397077 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-3a693091-5b0d-4cc3-b99d-9b0eb9e29810 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '37f21d6d15cf40a586edda211219fd08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ebb970305844dccacf48a7d8d47ecf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:54:01.398228 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-3a693091-5b0d-4cc3-b99d-9b0eb9e29810 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] 10.222.0.11 "GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7" status: 200 len: 1803 microversion: 2.20 time: 0.152270 Nov 17 03:54:01.398803 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 1264/2723] 10.222.0.11 () {60 vars in 1276 bytes} [Wed Nov 17 03:54:01 2021] GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7 => generated 1803 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 17 03:54:02.293752 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-e53088ec-5d4e-4103-b945-fff7fc4f35e2 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:54:02.294789 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-e53088ec-5d4e-4103-b945-fff7fc4f35e2 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] [instance: 15abb40f-daf9-4c4b-ac9c-55f57ee7b938] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:54:02.305987 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-e53088ec-5d4e-4103-b945-fff7fc4f35e2 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:54:02.306759 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-e53088ec-5d4e-4103-b945-fff7fc4f35e2 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:54:02.307980 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-e53088ec-5d4e-4103-b945-fff7fc4f35e2 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:54:02.308686 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-e53088ec-5d4e-4103-b945-fff7fc4f35e2 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:54:02.423465 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-27651bee-b718-487f-8f1b-1f6d612b393d tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:54:02.424048 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-27651bee-b718-487f-8f1b-1f6d612b393d tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] [instance: 5d54db85-b991-4890-abaa-952413baa2e7] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:54:02.430589 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-27651bee-b718-487f-8f1b-1f6d612b393d tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:54:02.431035 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-27651bee-b718-487f-8f1b-1f6d612b393d tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:54:02.431794 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-27651bee-b718-487f-8f1b-1f6d612b393d tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:54:02.432219 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-27651bee-b718-487f-8f1b-1f6d612b393d tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:54:02.442230 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-e53088ec-5d4e-4103-b945-fff7fc4f35e2 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a792b5b7e6f7461b8d802a5abaaa9518', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e843a3fb49f41dcb376184d7e156528', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:54:02.450539 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-e53088ec-5d4e-4103-b945-fff7fc4f35e2 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] 10.222.0.11 "GET /compute/v2.1/servers/15abb40f-daf9-4c4b-ac9c-55f57ee7b938" status: 200 len: 1558 microversion: 2.1 time: 0.163117 Nov 17 03:54:02.451113 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 1460/2724] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:54:02 2021] GET /compute/v2.1/servers/15abb40f-daf9-4c4b-ac9c-55f57ee7b938 => generated 1558 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:54:02.572248 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-27651bee-b718-487f-8f1b-1f6d612b393d tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37f21d6d15cf40a586edda211219fd08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ebb970305844dccacf48a7d8d47ecf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:54:02.581290 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-27651bee-b718-487f-8f1b-1f6d612b393d tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '37f21d6d15cf40a586edda211219fd08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ebb970305844dccacf48a7d8d47ecf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:54:02.582777 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-27651bee-b718-487f-8f1b-1f6d612b393d tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '37f21d6d15cf40a586edda211219fd08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ebb970305844dccacf48a7d8d47ecf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:54:02.583937 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-27651bee-b718-487f-8f1b-1f6d612b393d tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] 10.222.0.11 "GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7" status: 200 len: 1803 microversion: 2.20 time: 0.164235 Nov 17 03:54:02.584461 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 1265/2725] 10.222.0.11 () {60 vars in 1276 bytes} [Wed Nov 17 03:54:02 2021] GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7 => generated 1803 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 17 03:54:03.472068 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-e68840a8-3c20-4a1b-8972-2cb6076a9a90 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:54:03.473499 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-e68840a8-3c20-4a1b-8972-2cb6076a9a90 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] [instance: 15abb40f-daf9-4c4b-ac9c-55f57ee7b938] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:54:03.484200 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-e68840a8-3c20-4a1b-8972-2cb6076a9a90 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:54:03.484663 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-e68840a8-3c20-4a1b-8972-2cb6076a9a90 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:54:03.485475 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-e68840a8-3c20-4a1b-8972-2cb6076a9a90 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:54:03.485901 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-e68840a8-3c20-4a1b-8972-2cb6076a9a90 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:54:03.602450 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-7b248f8d-e84e-4aa4-90f7-91935a8c1d4c tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:54:03.603071 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-7b248f8d-e84e-4aa4-90f7-91935a8c1d4c tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] [instance: 5d54db85-b991-4890-abaa-952413baa2e7] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:54:03.610251 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-7b248f8d-e84e-4aa4-90f7-91935a8c1d4c tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:54:03.610691 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-7b248f8d-e84e-4aa4-90f7-91935a8c1d4c tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:54:03.611474 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-7b248f8d-e84e-4aa4-90f7-91935a8c1d4c tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:54:03.611909 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-7b248f8d-e84e-4aa4-90f7-91935a8c1d4c tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:54:03.624395 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-e68840a8-3c20-4a1b-8972-2cb6076a9a90 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a792b5b7e6f7461b8d802a5abaaa9518', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e843a3fb49f41dcb376184d7e156528', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:54:03.632558 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-e68840a8-3c20-4a1b-8972-2cb6076a9a90 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] 10.222.0.11 "GET /compute/v2.1/servers/15abb40f-daf9-4c4b-ac9c-55f57ee7b938" status: 200 len: 1558 microversion: 2.1 time: 0.166683 Nov 17 03:54:03.633159 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 1461/2726] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:54:03 2021] GET /compute/v2.1/servers/15abb40f-daf9-4c4b-ac9c-55f57ee7b938 => generated 1558 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:54:03.744076 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-7b248f8d-e84e-4aa4-90f7-91935a8c1d4c tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37f21d6d15cf40a586edda211219fd08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ebb970305844dccacf48a7d8d47ecf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:54:03.753517 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-7b248f8d-e84e-4aa4-90f7-91935a8c1d4c tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '37f21d6d15cf40a586edda211219fd08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ebb970305844dccacf48a7d8d47ecf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:54:03.755034 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-7b248f8d-e84e-4aa4-90f7-91935a8c1d4c tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '37f21d6d15cf40a586edda211219fd08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ebb970305844dccacf48a7d8d47ecf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:54:03.756176 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-7b248f8d-e84e-4aa4-90f7-91935a8c1d4c tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] 10.222.0.11 "GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7" status: 200 len: 1803 microversion: 2.20 time: 0.157577 Nov 17 03:54:03.756755 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 1266/2727] 10.222.0.11 () {60 vars in 1276 bytes} [Wed Nov 17 03:54:03 2021] GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7 => generated 1803 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 17 03:54:04.651530 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-01082400-6723-4dbc-bf5e-579648ce9acf tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:54:04.652286 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-01082400-6723-4dbc-bf5e-579648ce9acf tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] [instance: 15abb40f-daf9-4c4b-ac9c-55f57ee7b938] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:54:04.659990 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-01082400-6723-4dbc-bf5e-579648ce9acf tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:54:04.660432 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-01082400-6723-4dbc-bf5e-579648ce9acf tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:54:04.661235 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-01082400-6723-4dbc-bf5e-579648ce9acf tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:54:04.661662 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-01082400-6723-4dbc-bf5e-579648ce9acf tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:54:04.774951 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-3c741bf4-a8dc-468c-b3e2-9d291d09f363 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:54:04.775553 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-3c741bf4-a8dc-468c-b3e2-9d291d09f363 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] [instance: 5d54db85-b991-4890-abaa-952413baa2e7] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:54:04.782636 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-3c741bf4-a8dc-468c-b3e2-9d291d09f363 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:54:04.783079 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-3c741bf4-a8dc-468c-b3e2-9d291d09f363 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:54:04.783844 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-3c741bf4-a8dc-468c-b3e2-9d291d09f363 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:54:04.784276 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-3c741bf4-a8dc-468c-b3e2-9d291d09f363 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:54:04.807917 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-01082400-6723-4dbc-bf5e-579648ce9acf tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a792b5b7e6f7461b8d802a5abaaa9518', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e843a3fb49f41dcb376184d7e156528', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:54:04.816709 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-01082400-6723-4dbc-bf5e-579648ce9acf tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] 10.222.0.11 "GET /compute/v2.1/servers/15abb40f-daf9-4c4b-ac9c-55f57ee7b938" status: 200 len: 1558 microversion: 2.1 time: 0.169809 Nov 17 03:54:04.817318 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 1462/2728] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:54:04 2021] GET /compute/v2.1/servers/15abb40f-daf9-4c4b-ac9c-55f57ee7b938 => generated 1558 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:54:04.915110 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-3c741bf4-a8dc-468c-b3e2-9d291d09f363 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37f21d6d15cf40a586edda211219fd08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ebb970305844dccacf48a7d8d47ecf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:54:04.923911 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-3c741bf4-a8dc-468c-b3e2-9d291d09f363 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '37f21d6d15cf40a586edda211219fd08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ebb970305844dccacf48a7d8d47ecf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:54:04.925435 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-3c741bf4-a8dc-468c-b3e2-9d291d09f363 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '37f21d6d15cf40a586edda211219fd08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ebb970305844dccacf48a7d8d47ecf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:54:04.926938 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-3c741bf4-a8dc-468c-b3e2-9d291d09f363 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] 10.222.0.11 "GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7" status: 200 len: 1803 microversion: 2.20 time: 0.155337 Nov 17 03:54:04.927483 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 1267/2729] 10.222.0.11 () {60 vars in 1276 bytes} [Wed Nov 17 03:54:04 2021] GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7 => generated 1803 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 17 03:54:05.838128 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-9c62536f-368f-4ab2-9093-98c4df763da1 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:54:05.839084 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-9c62536f-368f-4ab2-9093-98c4df763da1 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] [instance: 15abb40f-daf9-4c4b-ac9c-55f57ee7b938] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:54:05.849977 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-9c62536f-368f-4ab2-9093-98c4df763da1 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:54:05.850726 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-9c62536f-368f-4ab2-9093-98c4df763da1 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:54:05.852037 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-9c62536f-368f-4ab2-9093-98c4df763da1 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:54:05.852718 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-9c62536f-368f-4ab2-9093-98c4df763da1 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:54:05.945568 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-cc1c7b7a-bb39-49ab-bdd8-6ffc429ecf30 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:54:05.946146 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-cc1c7b7a-bb39-49ab-bdd8-6ffc429ecf30 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] [instance: 5d54db85-b991-4890-abaa-952413baa2e7] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:54:05.953274 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-cc1c7b7a-bb39-49ab-bdd8-6ffc429ecf30 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:54:05.953748 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-cc1c7b7a-bb39-49ab-bdd8-6ffc429ecf30 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:54:05.954529 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-cc1c7b7a-bb39-49ab-bdd8-6ffc429ecf30 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:54:05.954962 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-cc1c7b7a-bb39-49ab-bdd8-6ffc429ecf30 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:54:05.990839 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-9c62536f-368f-4ab2-9093-98c4df763da1 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a792b5b7e6f7461b8d802a5abaaa9518', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e843a3fb49f41dcb376184d7e156528', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:54:05.999184 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-9c62536f-368f-4ab2-9093-98c4df763da1 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] 10.222.0.11 "GET /compute/v2.1/servers/15abb40f-daf9-4c4b-ac9c-55f57ee7b938" status: 200 len: 1558 microversion: 2.1 time: 0.167177 Nov 17 03:54:06.000007 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 1463/2730] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:54:05 2021] GET /compute/v2.1/servers/15abb40f-daf9-4c4b-ac9c-55f57ee7b938 => generated 1558 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:54:06.087151 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-cc1c7b7a-bb39-49ab-bdd8-6ffc429ecf30 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37f21d6d15cf40a586edda211219fd08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ebb970305844dccacf48a7d8d47ecf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:54:06.096250 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-cc1c7b7a-bb39-49ab-bdd8-6ffc429ecf30 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '37f21d6d15cf40a586edda211219fd08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ebb970305844dccacf48a7d8d47ecf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:54:06.097719 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-cc1c7b7a-bb39-49ab-bdd8-6ffc429ecf30 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '37f21d6d15cf40a586edda211219fd08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ebb970305844dccacf48a7d8d47ecf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:54:06.098878 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-cc1c7b7a-bb39-49ab-bdd8-6ffc429ecf30 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] 10.222.0.11 "GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7" status: 200 len: 1803 microversion: 2.20 time: 0.157048 Nov 17 03:54:06.099424 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 1268/2731] 10.222.0.11 () {60 vars in 1276 bytes} [Wed Nov 17 03:54:05 2021] GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7 => generated 1803 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 17 03:54:07.021225 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-dba9bf92-bf65-4a29-9099-1d1bcf66ba62 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:54:07.022229 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-dba9bf92-bf65-4a29-9099-1d1bcf66ba62 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] [instance: 15abb40f-daf9-4c4b-ac9c-55f57ee7b938] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:54:07.032691 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-dba9bf92-bf65-4a29-9099-1d1bcf66ba62 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:54:07.033168 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-dba9bf92-bf65-4a29-9099-1d1bcf66ba62 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:54:07.033946 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-dba9bf92-bf65-4a29-9099-1d1bcf66ba62 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:54:07.034378 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-dba9bf92-bf65-4a29-9099-1d1bcf66ba62 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:54:07.123084 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-fdaf766a-49ff-443f-a661-fc6755618feb tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:54:07.123661 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-fdaf766a-49ff-443f-a661-fc6755618feb tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] [instance: 5d54db85-b991-4890-abaa-952413baa2e7] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:54:07.130619 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-fdaf766a-49ff-443f-a661-fc6755618feb tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:54:07.131012 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-fdaf766a-49ff-443f-a661-fc6755618feb tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:54:07.131791 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-fdaf766a-49ff-443f-a661-fc6755618feb tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:54:07.132225 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-fdaf766a-49ff-443f-a661-fc6755618feb tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:54:07.182583 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-dba9bf92-bf65-4a29-9099-1d1bcf66ba62 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a792b5b7e6f7461b8d802a5abaaa9518', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e843a3fb49f41dcb376184d7e156528', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:54:07.191078 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-dba9bf92-bf65-4a29-9099-1d1bcf66ba62 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] 10.222.0.11 "GET /compute/v2.1/servers/15abb40f-daf9-4c4b-ac9c-55f57ee7b938" status: 200 len: 1558 microversion: 2.1 time: 0.176792 Nov 17 03:54:07.191621 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 1464/2732] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:54:07 2021] GET /compute/v2.1/servers/15abb40f-daf9-4c4b-ac9c-55f57ee7b938 => generated 1558 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:54:07.261790 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-fdaf766a-49ff-443f-a661-fc6755618feb tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37f21d6d15cf40a586edda211219fd08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ebb970305844dccacf48a7d8d47ecf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:54:07.270657 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-fdaf766a-49ff-443f-a661-fc6755618feb tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '37f21d6d15cf40a586edda211219fd08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ebb970305844dccacf48a7d8d47ecf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:54:07.272146 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-fdaf766a-49ff-443f-a661-fc6755618feb tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '37f21d6d15cf40a586edda211219fd08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ebb970305844dccacf48a7d8d47ecf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:54:07.273332 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-fdaf766a-49ff-443f-a661-fc6755618feb tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] 10.222.0.11 "GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7" status: 200 len: 1803 microversion: 2.20 time: 0.154036 Nov 17 03:54:07.273881 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 1269/2733] 10.222.0.11 () {60 vars in 1276 bytes} [Wed Nov 17 03:54:07 2021] GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7 => generated 1803 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 17 03:54:08.209690 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-83c6fcf2-4a32-4606-8035-d7e87e3c4329 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:54:08.210348 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-83c6fcf2-4a32-4606-8035-d7e87e3c4329 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] [instance: 15abb40f-daf9-4c4b-ac9c-55f57ee7b938] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:54:08.217675 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-83c6fcf2-4a32-4606-8035-d7e87e3c4329 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:54:08.218164 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-83c6fcf2-4a32-4606-8035-d7e87e3c4329 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:54:08.219013 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-83c6fcf2-4a32-4606-8035-d7e87e3c4329 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:54:08.219486 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-83c6fcf2-4a32-4606-8035-d7e87e3c4329 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:54:08.291751 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-ae6164bf-4cee-4fc9-bfbb-36de6a8bd489 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:54:08.292384 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-ae6164bf-4cee-4fc9-bfbb-36de6a8bd489 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] [instance: 5d54db85-b991-4890-abaa-952413baa2e7] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:54:08.299004 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-ae6164bf-4cee-4fc9-bfbb-36de6a8bd489 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:54:08.299487 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-ae6164bf-4cee-4fc9-bfbb-36de6a8bd489 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:54:08.300427 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-ae6164bf-4cee-4fc9-bfbb-36de6a8bd489 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:54:08.300894 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-ae6164bf-4cee-4fc9-bfbb-36de6a8bd489 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:54:08.370546 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-83c6fcf2-4a32-4606-8035-d7e87e3c4329 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a792b5b7e6f7461b8d802a5abaaa9518', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e843a3fb49f41dcb376184d7e156528', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:54:08.379227 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-83c6fcf2-4a32-4606-8035-d7e87e3c4329 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] 10.222.0.11 "GET /compute/v2.1/servers/15abb40f-daf9-4c4b-ac9c-55f57ee7b938" status: 200 len: 1558 microversion: 2.1 time: 0.173671 Nov 17 03:54:08.379803 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 1465/2734] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:54:08 2021] GET /compute/v2.1/servers/15abb40f-daf9-4c4b-ac9c-55f57ee7b938 => generated 1558 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:54:08.433426 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-ae6164bf-4cee-4fc9-bfbb-36de6a8bd489 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37f21d6d15cf40a586edda211219fd08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ebb970305844dccacf48a7d8d47ecf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:54:08.442430 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-ae6164bf-4cee-4fc9-bfbb-36de6a8bd489 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '37f21d6d15cf40a586edda211219fd08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ebb970305844dccacf48a7d8d47ecf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:54:08.443901 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-ae6164bf-4cee-4fc9-bfbb-36de6a8bd489 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '37f21d6d15cf40a586edda211219fd08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ebb970305844dccacf48a7d8d47ecf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:54:08.445096 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-ae6164bf-4cee-4fc9-bfbb-36de6a8bd489 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] 10.222.0.11 "GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7" status: 200 len: 1803 microversion: 2.20 time: 0.157127 Nov 17 03:54:08.445623 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 1270/2735] 10.222.0.11 () {60 vars in 1276 bytes} [Wed Nov 17 03:54:08 2021] GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7 => generated 1803 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 17 03:54:09.399895 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-d2027ef3-369c-4c04-87f8-feae00eb6ae5 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:54:09.400761 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-d2027ef3-369c-4c04-87f8-feae00eb6ae5 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] [instance: 15abb40f-daf9-4c4b-ac9c-55f57ee7b938] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:54:09.410810 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-d2027ef3-369c-4c04-87f8-feae00eb6ae5 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:54:09.411487 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-d2027ef3-369c-4c04-87f8-feae00eb6ae5 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:54:09.412648 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-d2027ef3-369c-4c04-87f8-feae00eb6ae5 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:54:09.413490 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-d2027ef3-369c-4c04-87f8-feae00eb6ae5 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:54:09.464022 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-d2cef66f-4c64-4ffa-a055-a2ea1d883923 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:54:09.464635 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-d2cef66f-4c64-4ffa-a055-a2ea1d883923 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] [instance: 5d54db85-b991-4890-abaa-952413baa2e7] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:54:09.471296 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-d2cef66f-4c64-4ffa-a055-a2ea1d883923 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:54:09.471746 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-d2cef66f-4c64-4ffa-a055-a2ea1d883923 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:54:09.472554 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-d2cef66f-4c64-4ffa-a055-a2ea1d883923 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:54:09.472977 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-d2cef66f-4c64-4ffa-a055-a2ea1d883923 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:54:09.555382 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-d2027ef3-369c-4c04-87f8-feae00eb6ae5 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a792b5b7e6f7461b8d802a5abaaa9518', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e843a3fb49f41dcb376184d7e156528', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:54:09.563353 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-d2027ef3-369c-4c04-87f8-feae00eb6ae5 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] 10.222.0.11 "GET /compute/v2.1/servers/15abb40f-daf9-4c4b-ac9c-55f57ee7b938" status: 200 len: 1558 microversion: 2.1 time: 0.169014 Nov 17 03:54:09.563917 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 1466/2736] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:54:09 2021] GET /compute/v2.1/servers/15abb40f-daf9-4c4b-ac9c-55f57ee7b938 => generated 1558 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 17 03:54:09.603489 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-d2cef66f-4c64-4ffa-a055-a2ea1d883923 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37f21d6d15cf40a586edda211219fd08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ebb970305844dccacf48a7d8d47ecf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:54:09.612051 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-d2cef66f-4c64-4ffa-a055-a2ea1d883923 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '37f21d6d15cf40a586edda211219fd08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ebb970305844dccacf48a7d8d47ecf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:54:09.613636 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-d2cef66f-4c64-4ffa-a055-a2ea1d883923 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '37f21d6d15cf40a586edda211219fd08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ebb970305844dccacf48a7d8d47ecf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:54:09.614814 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-d2cef66f-4c64-4ffa-a055-a2ea1d883923 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] 10.222.0.11 "GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7" status: 200 len: 1803 microversion: 2.20 time: 0.154500 Nov 17 03:54:09.615401 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 1271/2737] 10.222.0.11 () {60 vars in 1276 bytes} [Wed Nov 17 03:54:09 2021] GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7 => generated 1803 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 17 03:54:10.584360 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-31121beb-71e5-4c95-bf40-97e4f98a057e tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:54:10.585436 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-31121beb-71e5-4c95-bf40-97e4f98a057e tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] [instance: 15abb40f-daf9-4c4b-ac9c-55f57ee7b938] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:54:10.595206 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-31121beb-71e5-4c95-bf40-97e4f98a057e tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:54:10.595650 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-31121beb-71e5-4c95-bf40-97e4f98a057e tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:54:10.596388 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-31121beb-71e5-4c95-bf40-97e4f98a057e tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:54:10.596887 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-31121beb-71e5-4c95-bf40-97e4f98a057e tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:54:10.633380 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-a384c143-63cd-419d-b254-a831eb2b284a tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:54:10.633979 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-a384c143-63cd-419d-b254-a831eb2b284a tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] [instance: 5d54db85-b991-4890-abaa-952413baa2e7] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:54:10.640320 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-a384c143-63cd-419d-b254-a831eb2b284a tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:54:10.640881 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-a384c143-63cd-419d-b254-a831eb2b284a tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:54:10.641682 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-a384c143-63cd-419d-b254-a831eb2b284a tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:54:10.642137 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-a384c143-63cd-419d-b254-a831eb2b284a tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:54:10.731112 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-31121beb-71e5-4c95-bf40-97e4f98a057e tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a792b5b7e6f7461b8d802a5abaaa9518', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e843a3fb49f41dcb376184d7e156528', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:54:10.739678 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-31121beb-71e5-4c95-bf40-97e4f98a057e tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] 10.222.0.11 "GET /compute/v2.1/servers/15abb40f-daf9-4c4b-ac9c-55f57ee7b938" status: 200 len: 1558 microversion: 2.1 time: 0.162606 Nov 17 03:54:10.740246 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 1467/2738] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:54:10 2021] GET /compute/v2.1/servers/15abb40f-daf9-4c4b-ac9c-55f57ee7b938 => generated 1558 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:54:10.782095 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-a384c143-63cd-419d-b254-a831eb2b284a tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37f21d6d15cf40a586edda211219fd08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ebb970305844dccacf48a7d8d47ecf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:54:10.791218 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-a384c143-63cd-419d-b254-a831eb2b284a tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '37f21d6d15cf40a586edda211219fd08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ebb970305844dccacf48a7d8d47ecf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:54:10.792718 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-a384c143-63cd-419d-b254-a831eb2b284a tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '37f21d6d15cf40a586edda211219fd08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ebb970305844dccacf48a7d8d47ecf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:54:10.793941 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-a384c143-63cd-419d-b254-a831eb2b284a tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] 10.222.0.11 "GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7" status: 200 len: 1803 microversion: 2.20 time: 0.164294 Nov 17 03:54:10.794492 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 1272/2739] 10.222.0.11 () {60 vars in 1276 bytes} [Wed Nov 17 03:54:10 2021] GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7 => generated 1803 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 17 03:54:11.759632 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-d639d937-2582-4810-b820-730899d2d95a tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:54:11.760251 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-d639d937-2582-4810-b820-730899d2d95a tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] [instance: 15abb40f-daf9-4c4b-ac9c-55f57ee7b938] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:54:11.767618 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-d639d937-2582-4810-b820-730899d2d95a tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:54:11.768269 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-d639d937-2582-4810-b820-730899d2d95a tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:54:11.769163 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-d639d937-2582-4810-b820-730899d2d95a tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:54:11.769589 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-d639d937-2582-4810-b820-730899d2d95a tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:54:11.816338 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-cdbb70f0-abb8-4fbb-92c5-190544eb58c0 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:54:11.816953 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-cdbb70f0-abb8-4fbb-92c5-190544eb58c0 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] [instance: 5d54db85-b991-4890-abaa-952413baa2e7] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:54:11.823649 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-cdbb70f0-abb8-4fbb-92c5-190544eb58c0 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:54:11.824094 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-cdbb70f0-abb8-4fbb-92c5-190544eb58c0 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:54:11.824916 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-cdbb70f0-abb8-4fbb-92c5-190544eb58c0 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:54:11.825350 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-cdbb70f0-abb8-4fbb-92c5-190544eb58c0 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:54:11.905263 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-d639d937-2582-4810-b820-730899d2d95a tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a792b5b7e6f7461b8d802a5abaaa9518', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e843a3fb49f41dcb376184d7e156528', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:54:11.913257 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-d639d937-2582-4810-b820-730899d2d95a tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] 10.222.0.11 "GET /compute/v2.1/servers/15abb40f-daf9-4c4b-ac9c-55f57ee7b938" status: 200 len: 1558 microversion: 2.1 time: 0.157325 Nov 17 03:54:11.913831 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 1468/2740] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:54:11 2021] GET /compute/v2.1/servers/15abb40f-daf9-4c4b-ac9c-55f57ee7b938 => generated 1558 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:54:11.960339 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-cdbb70f0-abb8-4fbb-92c5-190544eb58c0 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37f21d6d15cf40a586edda211219fd08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ebb970305844dccacf48a7d8d47ecf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:54:11.971543 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-cdbb70f0-abb8-4fbb-92c5-190544eb58c0 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '37f21d6d15cf40a586edda211219fd08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ebb970305844dccacf48a7d8d47ecf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:54:11.973093 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-cdbb70f0-abb8-4fbb-92c5-190544eb58c0 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '37f21d6d15cf40a586edda211219fd08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ebb970305844dccacf48a7d8d47ecf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:54:11.974252 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-cdbb70f0-abb8-4fbb-92c5-190544eb58c0 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] 10.222.0.11 "GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7" status: 200 len: 1803 microversion: 2.20 time: 0.163938 Nov 17 03:54:11.974800 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 1273/2741] 10.222.0.11 () {60 vars in 1276 bytes} [Wed Nov 17 03:54:11 2021] GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7 => generated 1803 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 17 03:54:12.930901 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-3a57d261-5bd4-4cac-aaaf-c6844013d10a tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:54:12.931581 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-3a57d261-5bd4-4cac-aaaf-c6844013d10a tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] [instance: 15abb40f-daf9-4c4b-ac9c-55f57ee7b938] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:54:12.939207 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-3a57d261-5bd4-4cac-aaaf-c6844013d10a tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:54:12.939688 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-3a57d261-5bd4-4cac-aaaf-c6844013d10a tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:54:12.940462 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-3a57d261-5bd4-4cac-aaaf-c6844013d10a tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:54:12.940925 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-3a57d261-5bd4-4cac-aaaf-c6844013d10a tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:54:12.994850 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-8de5aaa7-94c6-4d2c-af43-7ca4013ebb32 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:54:12.995580 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-8de5aaa7-94c6-4d2c-af43-7ca4013ebb32 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] [instance: 5d54db85-b991-4890-abaa-952413baa2e7] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:54:13.002984 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-8de5aaa7-94c6-4d2c-af43-7ca4013ebb32 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:54:13.003727 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-8de5aaa7-94c6-4d2c-af43-7ca4013ebb32 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:54:13.004532 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-8de5aaa7-94c6-4d2c-af43-7ca4013ebb32 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:54:13.005046 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-8de5aaa7-94c6-4d2c-af43-7ca4013ebb32 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:54:13.088816 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-3a57d261-5bd4-4cac-aaaf-c6844013d10a tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a792b5b7e6f7461b8d802a5abaaa9518', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e843a3fb49f41dcb376184d7e156528', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:54:13.096904 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-3a57d261-5bd4-4cac-aaaf-c6844013d10a tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] 10.222.0.11 "GET /compute/v2.1/servers/15abb40f-daf9-4c4b-ac9c-55f57ee7b938" status: 200 len: 1558 microversion: 2.1 time: 0.170060 Nov 17 03:54:13.097596 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 1469/2742] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:54:12 2021] GET /compute/v2.1/servers/15abb40f-daf9-4c4b-ac9c-55f57ee7b938 => generated 1558 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:54:13.144164 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-8de5aaa7-94c6-4d2c-af43-7ca4013ebb32 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37f21d6d15cf40a586edda211219fd08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ebb970305844dccacf48a7d8d47ecf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:54:13.156911 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-8de5aaa7-94c6-4d2c-af43-7ca4013ebb32 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '37f21d6d15cf40a586edda211219fd08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ebb970305844dccacf48a7d8d47ecf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:54:13.159545 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-8de5aaa7-94c6-4d2c-af43-7ca4013ebb32 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '37f21d6d15cf40a586edda211219fd08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ebb970305844dccacf48a7d8d47ecf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:54:13.161312 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-8de5aaa7-94c6-4d2c-af43-7ca4013ebb32 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] 10.222.0.11 "GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7" status: 200 len: 1803 microversion: 2.20 time: 0.171455 Nov 17 03:54:13.162059 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 1274/2743] 10.222.0.11 () {60 vars in 1276 bytes} [Wed Nov 17 03:54:12 2021] GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7 => generated 1803 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 17 03:54:14.116813 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-5d132b28-1275-44f9-84af-81bd3f3cefac tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:54:14.117764 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-5d132b28-1275-44f9-84af-81bd3f3cefac tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] [instance: 15abb40f-daf9-4c4b-ac9c-55f57ee7b938] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:54:14.128151 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-5d132b28-1275-44f9-84af-81bd3f3cefac tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:54:14.128853 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-5d132b28-1275-44f9-84af-81bd3f3cefac tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:54:14.130060 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-5d132b28-1275-44f9-84af-81bd3f3cefac tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:54:14.130712 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-5d132b28-1275-44f9-84af-81bd3f3cefac tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:54:14.179832 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-122aa4bf-8ff9-4d4f-b329-07e93ea6cdbd tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:54:14.180458 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-122aa4bf-8ff9-4d4f-b329-07e93ea6cdbd tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] [instance: 5d54db85-b991-4890-abaa-952413baa2e7] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:54:14.186726 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-122aa4bf-8ff9-4d4f-b329-07e93ea6cdbd tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:54:14.187174 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-122aa4bf-8ff9-4d4f-b329-07e93ea6cdbd tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:54:14.187941 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-122aa4bf-8ff9-4d4f-b329-07e93ea6cdbd tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:54:14.188367 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-122aa4bf-8ff9-4d4f-b329-07e93ea6cdbd tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:54:14.268692 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-5d132b28-1275-44f9-84af-81bd3f3cefac tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a792b5b7e6f7461b8d802a5abaaa9518', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e843a3fb49f41dcb376184d7e156528', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:54:14.276916 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-5d132b28-1275-44f9-84af-81bd3f3cefac tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] 10.222.0.11 "GET /compute/v2.1/servers/15abb40f-daf9-4c4b-ac9c-55f57ee7b938" status: 200 len: 1558 microversion: 2.1 time: 0.165874 Nov 17 03:54:14.277494 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 1470/2744] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:54:14 2021] GET /compute/v2.1/servers/15abb40f-daf9-4c4b-ac9c-55f57ee7b938 => generated 1558 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:54:14.321295 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-122aa4bf-8ff9-4d4f-b329-07e93ea6cdbd tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37f21d6d15cf40a586edda211219fd08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ebb970305844dccacf48a7d8d47ecf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:54:14.329974 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-122aa4bf-8ff9-4d4f-b329-07e93ea6cdbd tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '37f21d6d15cf40a586edda211219fd08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ebb970305844dccacf48a7d8d47ecf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:54:14.331456 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-122aa4bf-8ff9-4d4f-b329-07e93ea6cdbd tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '37f21d6d15cf40a586edda211219fd08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ebb970305844dccacf48a7d8d47ecf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:54:14.332617 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-122aa4bf-8ff9-4d4f-b329-07e93ea6cdbd tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] 10.222.0.11 "GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7" status: 200 len: 1803 microversion: 2.20 time: 0.156933 Nov 17 03:54:14.333214 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 1275/2745] 10.222.0.11 () {60 vars in 1276 bytes} [Wed Nov 17 03:54:14 2021] GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7 => generated 1803 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 17 03:54:15.298592 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-be1bc4f5-2ed2-4feb-9cc0-e287abf1d35a tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:54:15.299503 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-be1bc4f5-2ed2-4feb-9cc0-e287abf1d35a tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] [instance: 15abb40f-daf9-4c4b-ac9c-55f57ee7b938] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:54:15.306759 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-be1bc4f5-2ed2-4feb-9cc0-e287abf1d35a tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:54:15.307198 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-be1bc4f5-2ed2-4feb-9cc0-e287abf1d35a tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:54:15.307965 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-be1bc4f5-2ed2-4feb-9cc0-e287abf1d35a tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:54:15.308391 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-be1bc4f5-2ed2-4feb-9cc0-e287abf1d35a tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:54:15.350808 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-aed472e2-a0df-42d7-a949-760ee21d4fa4 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:54:15.351425 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-aed472e2-a0df-42d7-a949-760ee21d4fa4 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] [instance: 5d54db85-b991-4890-abaa-952413baa2e7] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:54:15.357937 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-aed472e2-a0df-42d7-a949-760ee21d4fa4 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:54:15.358377 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-aed472e2-a0df-42d7-a949-760ee21d4fa4 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:54:15.359832 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-aed472e2-a0df-42d7-a949-760ee21d4fa4 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:54:15.360392 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-aed472e2-a0df-42d7-a949-760ee21d4fa4 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:54:15.447656 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-be1bc4f5-2ed2-4feb-9cc0-e287abf1d35a tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a792b5b7e6f7461b8d802a5abaaa9518', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e843a3fb49f41dcb376184d7e156528', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:54:15.455561 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-be1bc4f5-2ed2-4feb-9cc0-e287abf1d35a tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] 10.222.0.11 "GET /compute/v2.1/servers/15abb40f-daf9-4c4b-ac9c-55f57ee7b938" status: 200 len: 1558 microversion: 2.1 time: 0.163235 Nov 17 03:54:15.456133 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 1471/2746] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:54:15 2021] GET /compute/v2.1/servers/15abb40f-daf9-4c4b-ac9c-55f57ee7b938 => generated 1558 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:54:15.492874 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-aed472e2-a0df-42d7-a949-760ee21d4fa4 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37f21d6d15cf40a586edda211219fd08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ebb970305844dccacf48a7d8d47ecf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:54:15.501968 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-aed472e2-a0df-42d7-a949-760ee21d4fa4 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '37f21d6d15cf40a586edda211219fd08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ebb970305844dccacf48a7d8d47ecf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:54:15.503574 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-aed472e2-a0df-42d7-a949-760ee21d4fa4 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '37f21d6d15cf40a586edda211219fd08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ebb970305844dccacf48a7d8d47ecf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:54:15.504739 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-aed472e2-a0df-42d7-a949-760ee21d4fa4 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] 10.222.0.11 "GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7" status: 200 len: 1803 microversion: 2.20 time: 0.157659 Nov 17 03:54:15.505349 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 1276/2747] 10.222.0.11 () {60 vars in 1276 bytes} [Wed Nov 17 03:54:15 2021] GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7 => generated 1803 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 17 03:54:16.477641 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-71b05f39-3dfc-4ee2-a1cd-9afcd6907252 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:54:16.478526 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-71b05f39-3dfc-4ee2-a1cd-9afcd6907252 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] [instance: 15abb40f-daf9-4c4b-ac9c-55f57ee7b938] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:54:16.489282 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-71b05f39-3dfc-4ee2-a1cd-9afcd6907252 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:54:16.490034 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-71b05f39-3dfc-4ee2-a1cd-9afcd6907252 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:54:16.491353 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-71b05f39-3dfc-4ee2-a1cd-9afcd6907252 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:54:16.492073 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-71b05f39-3dfc-4ee2-a1cd-9afcd6907252 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:54:16.527334 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-874013da-fcdd-4320-a13f-790dd3d31a8e tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:54:16.527946 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-874013da-fcdd-4320-a13f-790dd3d31a8e tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] [instance: 5d54db85-b991-4890-abaa-952413baa2e7] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:54:16.534760 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-874013da-fcdd-4320-a13f-790dd3d31a8e tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:54:16.535196 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-874013da-fcdd-4320-a13f-790dd3d31a8e tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:54:16.535970 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-874013da-fcdd-4320-a13f-790dd3d31a8e tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:54:16.536397 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-874013da-fcdd-4320-a13f-790dd3d31a8e tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:54:16.626413 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-71b05f39-3dfc-4ee2-a1cd-9afcd6907252 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a792b5b7e6f7461b8d802a5abaaa9518', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e843a3fb49f41dcb376184d7e156528', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:54:16.634844 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-71b05f39-3dfc-4ee2-a1cd-9afcd6907252 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] 10.222.0.11 "GET /compute/v2.1/servers/15abb40f-daf9-4c4b-ac9c-55f57ee7b938" status: 200 len: 1558 microversion: 2.1 time: 0.164173 Nov 17 03:54:16.635417 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 1472/2748] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:54:16 2021] GET /compute/v2.1/servers/15abb40f-daf9-4c4b-ac9c-55f57ee7b938 => generated 1558 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:54:16.668179 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-874013da-fcdd-4320-a13f-790dd3d31a8e tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37f21d6d15cf40a586edda211219fd08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ebb970305844dccacf48a7d8d47ecf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:54:16.677330 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-874013da-fcdd-4320-a13f-790dd3d31a8e tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '37f21d6d15cf40a586edda211219fd08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ebb970305844dccacf48a7d8d47ecf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:54:16.678797 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-874013da-fcdd-4320-a13f-790dd3d31a8e tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '37f21d6d15cf40a586edda211219fd08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ebb970305844dccacf48a7d8d47ecf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:54:16.679931 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-874013da-fcdd-4320-a13f-790dd3d31a8e tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] 10.222.0.11 "GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7" status: 200 len: 1803 microversion: 2.20 time: 0.156291 Nov 17 03:54:16.680477 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 1277/2749] 10.222.0.11 () {60 vars in 1276 bytes} [Wed Nov 17 03:54:16 2021] GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7 => generated 1803 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 17 03:54:17.652496 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-6ff335e6-4131-4989-87b7-0b447d35e41b tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:54:17.653410 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-6ff335e6-4131-4989-87b7-0b447d35e41b tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] [instance: 15abb40f-daf9-4c4b-ac9c-55f57ee7b938] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:54:17.660224 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-6ff335e6-4131-4989-87b7-0b447d35e41b tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:54:17.660681 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-6ff335e6-4131-4989-87b7-0b447d35e41b tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:54:17.661494 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-6ff335e6-4131-4989-87b7-0b447d35e41b tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:54:17.661920 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-6ff335e6-4131-4989-87b7-0b447d35e41b tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:54:17.698365 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-30e5974f-e6d7-4562-b2ab-ca76d79fc207 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:54:17.698968 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-30e5974f-e6d7-4562-b2ab-ca76d79fc207 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] [instance: 5d54db85-b991-4890-abaa-952413baa2e7] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:54:17.705691 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-30e5974f-e6d7-4562-b2ab-ca76d79fc207 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:54:17.706141 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-30e5974f-e6d7-4562-b2ab-ca76d79fc207 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:54:17.706917 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-30e5974f-e6d7-4562-b2ab-ca76d79fc207 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:54:17.707353 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-30e5974f-e6d7-4562-b2ab-ca76d79fc207 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:54:17.800168 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-6ff335e6-4131-4989-87b7-0b447d35e41b tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a792b5b7e6f7461b8d802a5abaaa9518', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e843a3fb49f41dcb376184d7e156528', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:54:17.808555 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-6ff335e6-4131-4989-87b7-0b447d35e41b tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] 10.222.0.11 "GET /compute/v2.1/servers/15abb40f-daf9-4c4b-ac9c-55f57ee7b938" status: 200 len: 1558 microversion: 2.1 time: 0.160541 Nov 17 03:54:17.809156 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 1473/2750] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:54:17 2021] GET /compute/v2.1/servers/15abb40f-daf9-4c4b-ac9c-55f57ee7b938 => generated 1558 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:54:17.837255 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-30e5974f-e6d7-4562-b2ab-ca76d79fc207 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37f21d6d15cf40a586edda211219fd08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ebb970305844dccacf48a7d8d47ecf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:54:17.845436 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-30e5974f-e6d7-4562-b2ab-ca76d79fc207 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '37f21d6d15cf40a586edda211219fd08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ebb970305844dccacf48a7d8d47ecf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:54:17.847354 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-30e5974f-e6d7-4562-b2ab-ca76d79fc207 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '37f21d6d15cf40a586edda211219fd08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ebb970305844dccacf48a7d8d47ecf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:54:17.848511 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-30e5974f-e6d7-4562-b2ab-ca76d79fc207 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] 10.222.0.11 "GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7" status: 200 len: 1803 microversion: 2.20 time: 0.153872 Nov 17 03:54:17.849130 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 1278/2751] 10.222.0.11 () {60 vars in 1276 bytes} [Wed Nov 17 03:54:17 2021] GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7 => generated 1803 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 17 03:54:18.830189 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-22275847-a4af-437b-8889-26f98d702876 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:54:18.831118 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-22275847-a4af-437b-8889-26f98d702876 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] [instance: 15abb40f-daf9-4c4b-ac9c-55f57ee7b938] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:54:18.841484 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-22275847-a4af-437b-8889-26f98d702876 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:54:18.842214 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-22275847-a4af-437b-8889-26f98d702876 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:54:18.843467 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-22275847-a4af-437b-8889-26f98d702876 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:54:18.844172 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-22275847-a4af-437b-8889-26f98d702876 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:54:18.866857 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-e8a780db-5297-4b08-9ba2-8ab36bc1dd59 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:54:18.867493 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-e8a780db-5297-4b08-9ba2-8ab36bc1dd59 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] [instance: 5d54db85-b991-4890-abaa-952413baa2e7] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:54:18.874061 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-e8a780db-5297-4b08-9ba2-8ab36bc1dd59 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:54:18.874505 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-e8a780db-5297-4b08-9ba2-8ab36bc1dd59 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:54:18.875269 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-e8a780db-5297-4b08-9ba2-8ab36bc1dd59 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:54:18.875740 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-e8a780db-5297-4b08-9ba2-8ab36bc1dd59 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:54:18.975886 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-22275847-a4af-437b-8889-26f98d702876 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a792b5b7e6f7461b8d802a5abaaa9518', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e843a3fb49f41dcb376184d7e156528', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:54:18.984074 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-22275847-a4af-437b-8889-26f98d702876 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] 10.222.0.11 "GET /compute/v2.1/servers/15abb40f-daf9-4c4b-ac9c-55f57ee7b938" status: 200 len: 1558 microversion: 2.1 time: 0.160407 Nov 17 03:54:18.984895 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 1474/2752] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:54:18 2021] GET /compute/v2.1/servers/15abb40f-daf9-4c4b-ac9c-55f57ee7b938 => generated 1558 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:54:19.007439 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-e8a780db-5297-4b08-9ba2-8ab36bc1dd59 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37f21d6d15cf40a586edda211219fd08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ebb970305844dccacf48a7d8d47ecf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:54:19.015625 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-e8a780db-5297-4b08-9ba2-8ab36bc1dd59 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '37f21d6d15cf40a586edda211219fd08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ebb970305844dccacf48a7d8d47ecf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:54:19.017122 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-e8a780db-5297-4b08-9ba2-8ab36bc1dd59 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '37f21d6d15cf40a586edda211219fd08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ebb970305844dccacf48a7d8d47ecf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:54:19.018694 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-e8a780db-5297-4b08-9ba2-8ab36bc1dd59 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] 10.222.0.11 "GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7" status: 200 len: 1803 microversion: 2.20 time: 0.155625 Nov 17 03:54:19.019273 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 1279/2753] 10.222.0.11 () {60 vars in 1276 bytes} [Wed Nov 17 03:54:18 2021] GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7 => generated 1803 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 17 03:54:20.005875 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-2b458785-b82a-4698-9851-1fbf91964580 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:54:20.006814 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-2b458785-b82a-4698-9851-1fbf91964580 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] [instance: 15abb40f-daf9-4c4b-ac9c-55f57ee7b938] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:54:20.017712 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-2b458785-b82a-4698-9851-1fbf91964580 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:54:20.018651 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-2b458785-b82a-4698-9851-1fbf91964580 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:54:20.019402 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-2b458785-b82a-4698-9851-1fbf91964580 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:54:20.019833 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-2b458785-b82a-4698-9851-1fbf91964580 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:54:20.038818 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-5ede0ab9-5e43-4970-9077-d6211303dfc7 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:54:20.039544 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-5ede0ab9-5e43-4970-9077-d6211303dfc7 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] [instance: 5d54db85-b991-4890-abaa-952413baa2e7] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:54:20.046115 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-5ede0ab9-5e43-4970-9077-d6211303dfc7 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:54:20.046556 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-5ede0ab9-5e43-4970-9077-d6211303dfc7 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:54:20.047324 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-5ede0ab9-5e43-4970-9077-d6211303dfc7 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:54:20.047759 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-5ede0ab9-5e43-4970-9077-d6211303dfc7 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:54:20.157509 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-2b458785-b82a-4698-9851-1fbf91964580 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a792b5b7e6f7461b8d802a5abaaa9518', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e843a3fb49f41dcb376184d7e156528', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:54:20.165824 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-2b458785-b82a-4698-9851-1fbf91964580 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] 10.222.0.11 "GET /compute/v2.1/servers/15abb40f-daf9-4c4b-ac9c-55f57ee7b938" status: 200 len: 1558 microversion: 2.1 time: 0.166668 Nov 17 03:54:20.166432 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 1475/2754] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:54:19 2021] GET /compute/v2.1/servers/15abb40f-daf9-4c4b-ac9c-55f57ee7b938 => generated 1558 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:54:20.183947 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-5ede0ab9-5e43-4970-9077-d6211303dfc7 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37f21d6d15cf40a586edda211219fd08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ebb970305844dccacf48a7d8d47ecf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:54:20.192738 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-5ede0ab9-5e43-4970-9077-d6211303dfc7 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '37f21d6d15cf40a586edda211219fd08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ebb970305844dccacf48a7d8d47ecf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:54:20.194237 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-5ede0ab9-5e43-4970-9077-d6211303dfc7 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '37f21d6d15cf40a586edda211219fd08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ebb970305844dccacf48a7d8d47ecf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:54:20.195389 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-5ede0ab9-5e43-4970-9077-d6211303dfc7 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] 10.222.0.11 "GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7" status: 200 len: 1803 microversion: 2.20 time: 0.160445 Nov 17 03:54:20.195970 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 1280/2755] 10.222.0.11 () {60 vars in 1276 bytes} [Wed Nov 17 03:54:20 2021] GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7 => generated 1803 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 17 03:54:21.184399 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-a50abaf1-a11c-4fba-895e-45acf67ddd62 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:54:21.185170 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-a50abaf1-a11c-4fba-895e-45acf67ddd62 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] [instance: 15abb40f-daf9-4c4b-ac9c-55f57ee7b938] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:54:21.191843 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-a50abaf1-a11c-4fba-895e-45acf67ddd62 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:54:21.192297 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-a50abaf1-a11c-4fba-895e-45acf67ddd62 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:54:21.193122 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-a50abaf1-a11c-4fba-895e-45acf67ddd62 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:54:21.193544 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-a50abaf1-a11c-4fba-895e-45acf67ddd62 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:54:21.213204 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-062ecda8-9d3b-417f-b506-148d863283da tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:54:21.213799 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-062ecda8-9d3b-417f-b506-148d863283da tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] [instance: 5d54db85-b991-4890-abaa-952413baa2e7] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:54:21.219862 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-062ecda8-9d3b-417f-b506-148d863283da tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:54:21.220312 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-062ecda8-9d3b-417f-b506-148d863283da tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:54:21.221139 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-062ecda8-9d3b-417f-b506-148d863283da tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:54:21.221704 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-062ecda8-9d3b-417f-b506-148d863283da tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:54:21.336223 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-a50abaf1-a11c-4fba-895e-45acf67ddd62 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a792b5b7e6f7461b8d802a5abaaa9518', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e843a3fb49f41dcb376184d7e156528', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:54:21.344815 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-a50abaf1-a11c-4fba-895e-45acf67ddd62 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] 10.222.0.11 "GET /compute/v2.1/servers/15abb40f-daf9-4c4b-ac9c-55f57ee7b938" status: 200 len: 1558 microversion: 2.1 time: 0.164870 Nov 17 03:54:21.345955 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 1476/2756] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:54:21 2021] GET /compute/v2.1/servers/15abb40f-daf9-4c4b-ac9c-55f57ee7b938 => generated 1558 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:54:21.366678 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-062ecda8-9d3b-417f-b506-148d863283da tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37f21d6d15cf40a586edda211219fd08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ebb970305844dccacf48a7d8d47ecf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:54:21.375431 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-062ecda8-9d3b-417f-b506-148d863283da tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '37f21d6d15cf40a586edda211219fd08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ebb970305844dccacf48a7d8d47ecf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:54:21.377154 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-062ecda8-9d3b-417f-b506-148d863283da tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '37f21d6d15cf40a586edda211219fd08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ebb970305844dccacf48a7d8d47ecf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:54:21.378474 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-062ecda8-9d3b-417f-b506-148d863283da tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] 10.222.0.11 "GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7" status: 200 len: 1803 microversion: 2.20 time: 0.168927 Nov 17 03:54:21.379103 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 1281/2757] 10.222.0.11 () {60 vars in 1276 bytes} [Wed Nov 17 03:54:21 2021] GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7 => generated 1803 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 17 03:54:21.495542 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-42cb2c1c-9372-4cd5-b606-53bcb8d0037d tempest-AttachVolumeTestJSON-1651611701 tempest-AttachVolumeTestJSON-1651611701-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:54:21.496410 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-42cb2c1c-9372-4cd5-b606-53bcb8d0037d tempest-AttachVolumeTestJSON-1651611701 tempest-AttachVolumeTestJSON-1651611701-project] [instance: 5e11ea9c-f66a-4962-b5ca-b95784624824] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:54:21.503526 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-42cb2c1c-9372-4cd5-b606-53bcb8d0037d tempest-AttachVolumeTestJSON-1651611701 tempest-AttachVolumeTestJSON-1651611701-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:54:21.503919 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-42cb2c1c-9372-4cd5-b606-53bcb8d0037d tempest-AttachVolumeTestJSON-1651611701 tempest-AttachVolumeTestJSON-1651611701-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:54:21.504710 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-42cb2c1c-9372-4cd5-b606-53bcb8d0037d tempest-AttachVolumeTestJSON-1651611701 tempest-AttachVolumeTestJSON-1651611701-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:54:21.505178 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-42cb2c1c-9372-4cd5-b606-53bcb8d0037d tempest-AttachVolumeTestJSON-1651611701 tempest-AttachVolumeTestJSON-1651611701-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:54:21.526106 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.wsgi [None req-42cb2c1c-9372-4cd5-b606-53bcb8d0037d tempest-AttachVolumeTestJSON-1651611701 tempest-AttachVolumeTestJSON-1651611701-project] HTTP exception thrown: Instance 5e11ea9c-f66a-4962-b5ca-b95784624824 could not be found. Nov 17 03:54:21.533246 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-42cb2c1c-9372-4cd5-b606-53bcb8d0037d tempest-AttachVolumeTestJSON-1651611701 tempest-AttachVolumeTestJSON-1651611701-project] Returning 404 to user: Instance 5e11ea9c-f66a-4962-b5ca-b95784624824 could not be found. {{(pid=115917) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 17 03:54:21.535050 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-42cb2c1c-9372-4cd5-b606-53bcb8d0037d tempest-AttachVolumeTestJSON-1651611701 tempest-AttachVolumeTestJSON-1651611701-project] 10.222.0.11 "DELETE /compute/v2.1/servers/5e11ea9c-f66a-4962-b5ca-b95784624824" status: 404 len: 111 microversion: 2.1 time: 0.043648 Nov 17 03:54:21.535787 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 1477/2758] 10.222.0.11 () {58 vars in 1238 bytes} [Wed Nov 17 03:54:21 2021] DELETE /compute/v2.1/servers/5e11ea9c-f66a-4962-b5ca-b95784624824 => generated 111 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 17 03:54:21.548142 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-10435991-f55b-4acf-8a22-eefa2c3c1279 tempest-AttachVolumeTestJSON-1651611701 tempest-AttachVolumeTestJSON-1651611701-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:54:21.549363 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-10435991-f55b-4acf-8a22-eefa2c3c1279 tempest-AttachVolumeTestJSON-1651611701 tempest-AttachVolumeTestJSON-1651611701-project] [instance: 5e11ea9c-f66a-4962-b5ca-b95784624824] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:54:21.556335 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-10435991-f55b-4acf-8a22-eefa2c3c1279 tempest-AttachVolumeTestJSON-1651611701 tempest-AttachVolumeTestJSON-1651611701-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:54:21.557115 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-10435991-f55b-4acf-8a22-eefa2c3c1279 tempest-AttachVolumeTestJSON-1651611701 tempest-AttachVolumeTestJSON-1651611701-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:54:21.558087 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-10435991-f55b-4acf-8a22-eefa2c3c1279 tempest-AttachVolumeTestJSON-1651611701 tempest-AttachVolumeTestJSON-1651611701-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:54:21.558528 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-10435991-f55b-4acf-8a22-eefa2c3c1279 tempest-AttachVolumeTestJSON-1651611701 tempest-AttachVolumeTestJSON-1651611701-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:54:21.572870 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.wsgi [None req-10435991-f55b-4acf-8a22-eefa2c3c1279 tempest-AttachVolumeTestJSON-1651611701 tempest-AttachVolumeTestJSON-1651611701-project] HTTP exception thrown: Instance 5e11ea9c-f66a-4962-b5ca-b95784624824 could not be found. Nov 17 03:54:21.573616 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-10435991-f55b-4acf-8a22-eefa2c3c1279 tempest-AttachVolumeTestJSON-1651611701 tempest-AttachVolumeTestJSON-1651611701-project] Returning 404 to user: Instance 5e11ea9c-f66a-4962-b5ca-b95784624824 could not be found. {{(pid=115916) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 17 03:54:21.574460 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-10435991-f55b-4acf-8a22-eefa2c3c1279 tempest-AttachVolumeTestJSON-1651611701 tempest-AttachVolumeTestJSON-1651611701-project] 10.222.0.11 "GET /compute/v2.1/servers/5e11ea9c-f66a-4962-b5ca-b95784624824" status: 404 len: 111 microversion: 2.1 time: 0.034019 Nov 17 03:54:21.575005 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 1282/2759] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:54:21 2021] GET /compute/v2.1/servers/5e11ea9c-f66a-4962-b5ca-b95784624824 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Nov 17 03:54:21.629605 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-c1bcc4b3-dd3d-4b42-bed9-9781e4d5a2a9 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] Calling method '.version_select at 0x7f9e1dc72790>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:54:21.653070 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-c1bcc4b3-dd3d-4b42-bed9-9781e4d5a2a9 tempest-TestVolumeBootPattern-2087897668 tempest-TestVolumeBootPattern-2087897668-project] 10.222.0.11 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-1852819525" status: 202 len: 0 microversion: 2.1 time: 0.026860 Nov 17 03:54:21.654659 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 1478/2760] 10.222.0.11 () {58 vars in 1262 bytes} [Wed Nov 17 03:54:21 2021] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-1852819525 => generated 0 bytes in 29 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 17 03:54:22.362543 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-6bfbc657-a404-4357-815f-13ad1468eb0e tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:54:22.363152 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-6bfbc657-a404-4357-815f-13ad1468eb0e tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] [instance: 15abb40f-daf9-4c4b-ac9c-55f57ee7b938] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:54:22.370104 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-6bfbc657-a404-4357-815f-13ad1468eb0e tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:54:22.370683 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-6bfbc657-a404-4357-815f-13ad1468eb0e tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:54:22.371572 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-6bfbc657-a404-4357-815f-13ad1468eb0e tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:54:22.372095 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-6bfbc657-a404-4357-815f-13ad1468eb0e tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:54:22.397233 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-d8f11444-e817-41a5-975d-2a43aa0e1227 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:54:22.398427 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-d8f11444-e817-41a5-975d-2a43aa0e1227 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] [instance: 5d54db85-b991-4890-abaa-952413baa2e7] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:54:22.405184 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-d8f11444-e817-41a5-975d-2a43aa0e1227 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:54:22.405911 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-d8f11444-e817-41a5-975d-2a43aa0e1227 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:54:22.406922 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-d8f11444-e817-41a5-975d-2a43aa0e1227 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:54:22.407666 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-d8f11444-e817-41a5-975d-2a43aa0e1227 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:54:22.657079 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-6bfbc657-a404-4357-815f-13ad1468eb0e tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a792b5b7e6f7461b8d802a5abaaa9518', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e843a3fb49f41dcb376184d7e156528', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:54:22.666280 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-6bfbc657-a404-4357-815f-13ad1468eb0e tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] 10.222.0.11 "GET /compute/v2.1/servers/15abb40f-daf9-4c4b-ac9c-55f57ee7b938" status: 200 len: 1558 microversion: 2.1 time: 0.307500 Nov 17 03:54:22.667611 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 1283/2761] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:54:22 2021] GET /compute/v2.1/servers/15abb40f-daf9-4c4b-ac9c-55f57ee7b938 => generated 1558 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:54:22.716484 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-d8f11444-e817-41a5-975d-2a43aa0e1227 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37f21d6d15cf40a586edda211219fd08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ebb970305844dccacf48a7d8d47ecf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:54:22.728357 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-d8f11444-e817-41a5-975d-2a43aa0e1227 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '37f21d6d15cf40a586edda211219fd08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ebb970305844dccacf48a7d8d47ecf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:54:22.729905 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-d8f11444-e817-41a5-975d-2a43aa0e1227 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '37f21d6d15cf40a586edda211219fd08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ebb970305844dccacf48a7d8d47ecf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:54:22.733385 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-d8f11444-e817-41a5-975d-2a43aa0e1227 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] 10.222.0.11 "GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7" status: 200 len: 1803 microversion: 2.20 time: 0.340206 Nov 17 03:54:22.734222 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 1479/2762] 10.222.0.11 () {60 vars in 1276 bytes} [Wed Nov 17 03:54:22 2021] GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7 => generated 1803 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 17 03:54:23.686843 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-4c60b539-3196-4b60-8cf2-6dcf03b69a65 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:54:23.687689 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-4c60b539-3196-4b60-8cf2-6dcf03b69a65 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] [instance: 15abb40f-daf9-4c4b-ac9c-55f57ee7b938] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:54:23.702612 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-4c60b539-3196-4b60-8cf2-6dcf03b69a65 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:54:23.715006 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-4c60b539-3196-4b60-8cf2-6dcf03b69a65 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:54:23.716256 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-4c60b539-3196-4b60-8cf2-6dcf03b69a65 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:54:23.717055 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-4c60b539-3196-4b60-8cf2-6dcf03b69a65 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:54:23.866849 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [req-62a6648f-0cab-4d70-8de1-defa7fb7fbdf req-dabfc699-013b-4514-bea3-439b976217dc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5d54db85-b991-4890-abaa-952413baa2e7", "name": "network-vif-deleted", "tag": "51f39c10-57ce-4106-ab58-635a3319ff11"}]} {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 17 03:54:23.869900 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 17 03:54:23.869900 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: warnings.warn(msg) Nov 17 03:54:23.884066 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [req-62a6648f-0cab-4d70-8de1-defa7fb7fbdf req-dabfc699-013b-4514-bea3-439b976217dc service nova] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:54:23.885834 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [req-62a6648f-0cab-4d70-8de1-defa7fb7fbdf req-dabfc699-013b-4514-bea3-439b976217dc service nova] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:54:23.939142 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.compute.server_external_events [req-62a6648f-0cab-4d70-8de1-defa7fb7fbdf req-dabfc699-013b-4514-bea3-439b976217dc service nova] Creating event network-vif-deleted:51f39c10-57ce-4106-ab58-635a3319ff11 for instance 5d54db85-b991-4890-abaa-952413baa2e7 on hv-cinder-81803 Nov 17 03:54:23.951331 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [req-62a6648f-0cab-4d70-8de1-defa7fb7fbdf req-dabfc699-013b-4514-bea3-439b976217dc service nova] 10.222.0.11 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.380446 Nov 17 03:54:23.957097 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 1284/2763] 10.222.0.11 () {64 vars in 1317 bytes} [Wed Nov 17 03:54:23 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 17 03:54:23.972846 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-995aeb64-685c-44d7-a895-13fa3aad8934 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:54:23.974016 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-995aeb64-685c-44d7-a895-13fa3aad8934 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] [instance: 5d54db85-b991-4890-abaa-952413baa2e7] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:54:23.981053 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-995aeb64-685c-44d7-a895-13fa3aad8934 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:54:23.982186 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-995aeb64-685c-44d7-a895-13fa3aad8934 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:54:23.983357 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-995aeb64-685c-44d7-a895-13fa3aad8934 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:54:23.984029 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-995aeb64-685c-44d7-a895-13fa3aad8934 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:54:24.124627 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-4c60b539-3196-4b60-8cf2-6dcf03b69a65 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a792b5b7e6f7461b8d802a5abaaa9518', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e843a3fb49f41dcb376184d7e156528', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:54:24.138233 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-4c60b539-3196-4b60-8cf2-6dcf03b69a65 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] 10.222.0.11 "GET /compute/v2.1/servers/15abb40f-daf9-4c4b-ac9c-55f57ee7b938" status: 200 len: 1558 microversion: 2.1 time: 0.458009 Nov 17 03:54:24.139994 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 1480/2764] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:54:23 2021] GET /compute/v2.1/servers/15abb40f-daf9-4c4b-ac9c-55f57ee7b938 => generated 1558 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:54:24.162787 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-995aeb64-685c-44d7-a895-13fa3aad8934 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37f21d6d15cf40a586edda211219fd08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ebb970305844dccacf48a7d8d47ecf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:54:24.172290 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-995aeb64-685c-44d7-a895-13fa3aad8934 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '37f21d6d15cf40a586edda211219fd08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ebb970305844dccacf48a7d8d47ecf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:54:24.178130 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-995aeb64-685c-44d7-a895-13fa3aad8934 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '37f21d6d15cf40a586edda211219fd08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ebb970305844dccacf48a7d8d47ecf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:54:24.182963 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-995aeb64-685c-44d7-a895-13fa3aad8934 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] 10.222.0.11 "GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7" status: 200 len: 1444 microversion: 2.20 time: 0.222609 Nov 17 03:54:24.183663 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 1285/2765] 10.222.0.11 () {60 vars in 1276 bytes} [Wed Nov 17 03:54:23 2021] GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7 => generated 1444 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 17 03:54:25.156757 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-25f5f9ba-2977-425b-a027-541207d28f66 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:54:25.158007 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-25f5f9ba-2977-425b-a027-541207d28f66 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] [instance: 15abb40f-daf9-4c4b-ac9c-55f57ee7b938] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:54:25.168966 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-25f5f9ba-2977-425b-a027-541207d28f66 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:54:25.170175 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-25f5f9ba-2977-425b-a027-541207d28f66 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:54:25.171238 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-25f5f9ba-2977-425b-a027-541207d28f66 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:54:25.171941 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-25f5f9ba-2977-425b-a027-541207d28f66 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:54:25.203651 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-f6c52f1f-90d9-4b8c-9f09-5e6108e9a7aa tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:54:25.205545 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-f6c52f1f-90d9-4b8c-9f09-5e6108e9a7aa tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] [instance: 5d54db85-b991-4890-abaa-952413baa2e7] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:54:25.216206 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-f6c52f1f-90d9-4b8c-9f09-5e6108e9a7aa tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:54:25.218036 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-f6c52f1f-90d9-4b8c-9f09-5e6108e9a7aa tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:54:25.219563 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-f6c52f1f-90d9-4b8c-9f09-5e6108e9a7aa tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:54:25.220432 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-f6c52f1f-90d9-4b8c-9f09-5e6108e9a7aa tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:54:25.409853 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-f6c52f1f-90d9-4b8c-9f09-5e6108e9a7aa tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37f21d6d15cf40a586edda211219fd08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ebb970305844dccacf48a7d8d47ecf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:54:25.433042 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-f6c52f1f-90d9-4b8c-9f09-5e6108e9a7aa tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '37f21d6d15cf40a586edda211219fd08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ebb970305844dccacf48a7d8d47ecf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:54:25.437215 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-f6c52f1f-90d9-4b8c-9f09-5e6108e9a7aa tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '37f21d6d15cf40a586edda211219fd08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ebb970305844dccacf48a7d8d47ecf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:54:25.439164 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-f6c52f1f-90d9-4b8c-9f09-5e6108e9a7aa tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] 10.222.0.11 "GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7" status: 200 len: 1444 microversion: 2.20 time: 0.240712 Nov 17 03:54:25.451971 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 1286/2766] 10.222.0.11 () {60 vars in 1276 bytes} [Wed Nov 17 03:54:25 2021] GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7 => generated 1444 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 17 03:54:25.539360 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-25f5f9ba-2977-425b-a027-541207d28f66 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a792b5b7e6f7461b8d802a5abaaa9518', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e843a3fb49f41dcb376184d7e156528', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:54:25.550797 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-25f5f9ba-2977-425b-a027-541207d28f66 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] 10.222.0.11 "GET /compute/v2.1/servers/15abb40f-daf9-4c4b-ac9c-55f57ee7b938" status: 200 len: 1558 microversion: 2.1 time: 0.398008 Nov 17 03:54:25.562583 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 1481/2767] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:54:25 2021] GET /compute/v2.1/servers/15abb40f-daf9-4c4b-ac9c-55f57ee7b938 => generated 1558 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:54:26.477966 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-18b61cd9-0264-4a5b-ade2-c239b3af6b03 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:54:26.481949 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-18b61cd9-0264-4a5b-ade2-c239b3af6b03 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] [instance: 5d54db85-b991-4890-abaa-952413baa2e7] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:54:26.492579 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-18b61cd9-0264-4a5b-ade2-c239b3af6b03 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:54:26.493797 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-18b61cd9-0264-4a5b-ade2-c239b3af6b03 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:54:26.494849 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-18b61cd9-0264-4a5b-ade2-c239b3af6b03 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:54:26.496856 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-18b61cd9-0264-4a5b-ade2-c239b3af6b03 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:54:26.569565 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-8bbd9d4a-592b-46ed-876d-d1c52281ed46 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:54:26.570929 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-8bbd9d4a-592b-46ed-876d-d1c52281ed46 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] [instance: 15abb40f-daf9-4c4b-ac9c-55f57ee7b938] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:54:26.579717 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-8bbd9d4a-592b-46ed-876d-d1c52281ed46 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:54:26.580575 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-8bbd9d4a-592b-46ed-876d-d1c52281ed46 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:54:26.585192 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-8bbd9d4a-592b-46ed-876d-d1c52281ed46 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:54:26.585716 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-8bbd9d4a-592b-46ed-876d-d1c52281ed46 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:54:26.591181 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-18b61cd9-0264-4a5b-ade2-c239b3af6b03 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37f21d6d15cf40a586edda211219fd08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ebb970305844dccacf48a7d8d47ecf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:54:26.641537 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-18b61cd9-0264-4a5b-ade2-c239b3af6b03 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '37f21d6d15cf40a586edda211219fd08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ebb970305844dccacf48a7d8d47ecf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:54:26.643521 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-18b61cd9-0264-4a5b-ade2-c239b3af6b03 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '37f21d6d15cf40a586edda211219fd08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ebb970305844dccacf48a7d8d47ecf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:54:26.645153 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-18b61cd9-0264-4a5b-ade2-c239b3af6b03 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] 10.222.0.11 "GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7" status: 200 len: 1444 microversion: 2.20 time: 0.187667 Nov 17 03:54:26.658988 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 1287/2768] 10.222.0.11 () {60 vars in 1276 bytes} [Wed Nov 17 03:54:26 2021] GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7 => generated 1444 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 17 03:54:26.864653 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-8bbd9d4a-592b-46ed-876d-d1c52281ed46 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a792b5b7e6f7461b8d802a5abaaa9518', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e843a3fb49f41dcb376184d7e156528', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:54:26.877714 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-8bbd9d4a-592b-46ed-876d-d1c52281ed46 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] 10.222.0.11 "GET /compute/v2.1/servers/15abb40f-daf9-4c4b-ac9c-55f57ee7b938" status: 200 len: 1558 microversion: 2.1 time: 0.312122 Nov 17 03:54:26.895763 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 1482/2769] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:54:26 2021] GET /compute/v2.1/servers/15abb40f-daf9-4c4b-ac9c-55f57ee7b938 => generated 1558 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:54:27.666052 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-6993eeb5-ee70-4ba1-919f-ecd0e1d085f3 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:54:27.667392 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-6993eeb5-ee70-4ba1-919f-ecd0e1d085f3 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] [instance: 5d54db85-b991-4890-abaa-952413baa2e7] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:54:27.674071 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-6993eeb5-ee70-4ba1-919f-ecd0e1d085f3 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:54:27.674555 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-6993eeb5-ee70-4ba1-919f-ecd0e1d085f3 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:54:27.675403 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-6993eeb5-ee70-4ba1-919f-ecd0e1d085f3 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:54:27.675965 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-6993eeb5-ee70-4ba1-919f-ecd0e1d085f3 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:54:27.742240 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-6993eeb5-ee70-4ba1-919f-ecd0e1d085f3 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37f21d6d15cf40a586edda211219fd08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ebb970305844dccacf48a7d8d47ecf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:54:27.750829 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-6993eeb5-ee70-4ba1-919f-ecd0e1d085f3 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '37f21d6d15cf40a586edda211219fd08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ebb970305844dccacf48a7d8d47ecf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:54:27.752540 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-6993eeb5-ee70-4ba1-919f-ecd0e1d085f3 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '37f21d6d15cf40a586edda211219fd08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ebb970305844dccacf48a7d8d47ecf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:54:27.754174 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-6993eeb5-ee70-4ba1-919f-ecd0e1d085f3 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] 10.222.0.11 "GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7" status: 200 len: 1444 microversion: 2.20 time: 0.092816 Nov 17 03:54:27.755045 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 1288/2770] 10.222.0.11 () {60 vars in 1276 bytes} [Wed Nov 17 03:54:27 2021] GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7 => generated 1444 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 17 03:54:27.895805 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-13e93ee4-9c14-4c8a-ad2f-2fc5e6ea2039 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:54:27.897347 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-13e93ee4-9c14-4c8a-ad2f-2fc5e6ea2039 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] [instance: 15abb40f-daf9-4c4b-ac9c-55f57ee7b938] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:54:27.903838 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-13e93ee4-9c14-4c8a-ad2f-2fc5e6ea2039 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:54:27.904484 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-13e93ee4-9c14-4c8a-ad2f-2fc5e6ea2039 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:54:27.905328 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-13e93ee4-9c14-4c8a-ad2f-2fc5e6ea2039 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:54:27.905766 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-13e93ee4-9c14-4c8a-ad2f-2fc5e6ea2039 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:54:28.149638 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-13e93ee4-9c14-4c8a-ad2f-2fc5e6ea2039 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a792b5b7e6f7461b8d802a5abaaa9518', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e843a3fb49f41dcb376184d7e156528', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:54:28.157799 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-13e93ee4-9c14-4c8a-ad2f-2fc5e6ea2039 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] 10.222.0.11 "GET /compute/v2.1/servers/15abb40f-daf9-4c4b-ac9c-55f57ee7b938" status: 200 len: 1558 microversion: 2.1 time: 0.266152 Nov 17 03:54:28.158466 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 1483/2771] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:54:27 2021] GET /compute/v2.1/servers/15abb40f-daf9-4c4b-ac9c-55f57ee7b938 => generated 1558 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:54:28.771649 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-98aa2eb8-2375-4c3c-a222-b742bbc3be56 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:54:28.772289 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-98aa2eb8-2375-4c3c-a222-b742bbc3be56 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] [instance: 5d54db85-b991-4890-abaa-952413baa2e7] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:54:28.779941 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-98aa2eb8-2375-4c3c-a222-b742bbc3be56 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:54:28.780394 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-98aa2eb8-2375-4c3c-a222-b742bbc3be56 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:54:28.781201 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-98aa2eb8-2375-4c3c-a222-b742bbc3be56 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:54:28.781637 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-98aa2eb8-2375-4c3c-a222-b742bbc3be56 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:54:28.866877 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-98aa2eb8-2375-4c3c-a222-b742bbc3be56 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37f21d6d15cf40a586edda211219fd08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ebb970305844dccacf48a7d8d47ecf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:54:28.876416 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-98aa2eb8-2375-4c3c-a222-b742bbc3be56 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '37f21d6d15cf40a586edda211219fd08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ebb970305844dccacf48a7d8d47ecf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:54:28.878429 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-98aa2eb8-2375-4c3c-a222-b742bbc3be56 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '37f21d6d15cf40a586edda211219fd08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ebb970305844dccacf48a7d8d47ecf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:54:28.879955 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-98aa2eb8-2375-4c3c-a222-b742bbc3be56 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] 10.222.0.11 "GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7" status: 200 len: 1444 microversion: 2.20 time: 0.112118 Nov 17 03:54:28.881232 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 1289/2772] 10.222.0.11 () {60 vars in 1276 bytes} [Wed Nov 17 03:54:28 2021] GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7 => generated 1444 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 17 03:54:28.934492 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-e8d048e6-61ab-41af-8d54-7abedceb4a23 tempest-VolumesNegativeTest-1679335271 tempest-VolumesNegativeTest-1679335271-project] Action: 'create', calling method: .version_select at 0x7f9e1d9badc0>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-1994682946", "metadata": {"Type": "work"}}} {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 17 03:54:28.936171 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-e8d048e6-61ab-41af-8d54-7abedceb4a23 tempest-VolumesNegativeTest-1679335271 tempest-VolumesNegativeTest-1679335271-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=115917) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 17 03:54:28.937539 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-e8d048e6-61ab-41af-8d54-7abedceb4a23 tempest-VolumesNegativeTest-1679335271 tempest-VolumesNegativeTest-1679335271-project] 10.222.0.11 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 0.153416 Nov 17 03:54:28.938252 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 1484/2773] 10.222.0.11 () {60 vars in 1155 bytes} [Wed Nov 17 03:54:28 2021] POST /compute/v2.1/os-volumes => generated 127 bytes in 155 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Nov 17 03:54:28.947596 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-e9e688fc-6177-49aa-afae-2278638e42d2 tempest-VolumesNegativeTest-1679335271 tempest-VolumesNegativeTest-1679335271-project] Action: 'create', calling method: .version_select at 0x7f9e22074ee0>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-21972082", "metadata": {"Type": "work"}}} {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 17 03:54:28.949222 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-e9e688fc-6177-49aa-afae-2278638e42d2 tempest-VolumesNegativeTest-1679335271 tempest-VolumesNegativeTest-1679335271-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=115916) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 17 03:54:28.950063 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-e9e688fc-6177-49aa-afae-2278638e42d2 tempest-VolumesNegativeTest-1679335271 tempest-VolumesNegativeTest-1679335271-project] 10.222.0.11 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.006263 Nov 17 03:54:28.953283 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 1290/2774] 10.222.0.11 () {60 vars in 1155 bytes} [Wed Nov 17 03:54:28 2021] POST /compute/v2.1/os-volumes => generated 125 bytes in 10 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Nov 17 03:54:28.965342 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-9427f67e-44c0-4981-8060-f209bae16445 tempest-VolumesNegativeTest-1679335271 tempest-VolumesNegativeTest-1679335271-project] Action: 'create', calling method: .version_select at 0x7f9e1daa6af0>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-674220054", "metadata": {"Type": "work"}}} {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 17 03:54:28.969359 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-9427f67e-44c0-4981-8060-f209bae16445 tempest-VolumesNegativeTest-1679335271 tempest-VolumesNegativeTest-1679335271-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=115917) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 17 03:54:28.971517 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-9427f67e-44c0-4981-8060-f209bae16445 tempest-VolumesNegativeTest-1679335271 tempest-VolumesNegativeTest-1679335271-project] 10.222.0.11 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.012681 Nov 17 03:54:28.975689 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 1485/2775] 10.222.0.11 () {60 vars in 1155 bytes} [Wed Nov 17 03:54:28 2021] POST /compute/v2.1/os-volumes => generated 121 bytes in 17 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Nov 17 03:54:28.986230 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-c60953c2-186d-48cf-977e-12c9b75012c6 tempest-VolumesNegativeTest-1679335271 tempest-VolumesNegativeTest-1679335271-project] Calling method '.version_select at 0x7f9e221244c0>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:54:29.176151 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-4b741812-43c4-4009-8929-7353540dd565 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:54:29.177411 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-4b741812-43c4-4009-8929-7353540dd565 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] [instance: 15abb40f-daf9-4c4b-ac9c-55f57ee7b938] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:54:29.183528 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-4b741812-43c4-4009-8929-7353540dd565 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:54:29.183970 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-4b741812-43c4-4009-8929-7353540dd565 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:54:29.184732 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-4b741812-43c4-4009-8929-7353540dd565 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:54:29.185199 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-4b741812-43c4-4009-8929-7353540dd565 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:54:29.403445 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-4b741812-43c4-4009-8929-7353540dd565 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a792b5b7e6f7461b8d802a5abaaa9518', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e843a3fb49f41dcb376184d7e156528', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:54:29.411912 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-4b741812-43c4-4009-8929-7353540dd565 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] 10.222.0.11 "GET /compute/v2.1/servers/15abb40f-daf9-4c4b-ac9c-55f57ee7b938" status: 200 len: 1558 microversion: 2.1 time: 0.240284 Nov 17 03:54:29.412460 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 1486/2776] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:54:29 2021] GET /compute/v2.1/servers/15abb40f-daf9-4c4b-ac9c-55f57ee7b938 => generated 1558 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 17 03:54:29.900109 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-a75ff17a-2954-497d-aa46-f82652a2deac tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:54:29.901011 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-a75ff17a-2954-497d-aa46-f82652a2deac tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] [instance: 5d54db85-b991-4890-abaa-952413baa2e7] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:54:29.909065 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-a75ff17a-2954-497d-aa46-f82652a2deac tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:54:29.909512 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-a75ff17a-2954-497d-aa46-f82652a2deac tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:54:29.910305 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-a75ff17a-2954-497d-aa46-f82652a2deac tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:54:29.910738 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-a75ff17a-2954-497d-aa46-f82652a2deac tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:54:29.984491 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-a75ff17a-2954-497d-aa46-f82652a2deac tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37f21d6d15cf40a586edda211219fd08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ebb970305844dccacf48a7d8d47ecf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:54:29.993301 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-a75ff17a-2954-497d-aa46-f82652a2deac tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '37f21d6d15cf40a586edda211219fd08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ebb970305844dccacf48a7d8d47ecf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:54:29.994716 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-a75ff17a-2954-497d-aa46-f82652a2deac tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '37f21d6d15cf40a586edda211219fd08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ebb970305844dccacf48a7d8d47ecf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:54:29.995841 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-a75ff17a-2954-497d-aa46-f82652a2deac tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] 10.222.0.11 "GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7" status: 200 len: 1444 microversion: 2.20 time: 0.101038 Nov 17 03:54:29.996382 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 1487/2777] 10.222.0.11 () {60 vars in 1276 bytes} [Wed Nov 17 03:54:29 2021] GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7 => generated 1444 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 17 03:54:30.430532 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-6a84ac44-97eb-49f5-859c-644d466b254d tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:54:30.431217 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-6a84ac44-97eb-49f5-859c-644d466b254d tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] [instance: 15abb40f-daf9-4c4b-ac9c-55f57ee7b938] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:54:30.437583 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-6a84ac44-97eb-49f5-859c-644d466b254d tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:54:30.438022 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-6a84ac44-97eb-49f5-859c-644d466b254d tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:54:30.438816 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-6a84ac44-97eb-49f5-859c-644d466b254d tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:54:30.439435 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-6a84ac44-97eb-49f5-859c-644d466b254d tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:54:30.701080 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-6a84ac44-97eb-49f5-859c-644d466b254d tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a792b5b7e6f7461b8d802a5abaaa9518', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e843a3fb49f41dcb376184d7e156528', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:54:30.709358 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-6a84ac44-97eb-49f5-859c-644d466b254d tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] 10.222.0.11 "GET /compute/v2.1/servers/15abb40f-daf9-4c4b-ac9c-55f57ee7b938" status: 200 len: 1558 microversion: 2.1 time: 0.283034 Nov 17 03:54:30.710033 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 1488/2778] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:54:30 2021] GET /compute/v2.1/servers/15abb40f-daf9-4c4b-ac9c-55f57ee7b938 => generated 1558 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:54:31.014709 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-1b8a24f1-6641-4c66-9c16-3eb31f73a7f2 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:54:31.015382 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-1b8a24f1-6641-4c66-9c16-3eb31f73a7f2 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] [instance: 5d54db85-b991-4890-abaa-952413baa2e7] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:54:31.023090 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-1b8a24f1-6641-4c66-9c16-3eb31f73a7f2 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:54:31.023514 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-1b8a24f1-6641-4c66-9c16-3eb31f73a7f2 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:54:31.024304 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-1b8a24f1-6641-4c66-9c16-3eb31f73a7f2 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:54:31.024738 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-1b8a24f1-6641-4c66-9c16-3eb31f73a7f2 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:54:31.100068 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-1b8a24f1-6641-4c66-9c16-3eb31f73a7f2 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37f21d6d15cf40a586edda211219fd08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ebb970305844dccacf48a7d8d47ecf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:54:31.108320 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-1b8a24f1-6641-4c66-9c16-3eb31f73a7f2 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '37f21d6d15cf40a586edda211219fd08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ebb970305844dccacf48a7d8d47ecf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:54:31.109826 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-1b8a24f1-6641-4c66-9c16-3eb31f73a7f2 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '37f21d6d15cf40a586edda211219fd08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ebb970305844dccacf48a7d8d47ecf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:54:31.114471 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-1b8a24f1-6641-4c66-9c16-3eb31f73a7f2 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] 10.222.0.11 "GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7" status: 200 len: 1444 microversion: 2.20 time: 0.101279 Nov 17 03:54:31.115076 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 1489/2779] 10.222.0.11 () {60 vars in 1276 bytes} [Wed Nov 17 03:54:31 2021] GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7 => generated 1444 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 17 03:54:31.727937 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-e5cc1449-fe8c-40cd-995c-cd8dfb3df059 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:54:31.729007 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-e5cc1449-fe8c-40cd-995c-cd8dfb3df059 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] [instance: 15abb40f-daf9-4c4b-ac9c-55f57ee7b938] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:54:31.740155 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-e5cc1449-fe8c-40cd-995c-cd8dfb3df059 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:54:31.740616 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-e5cc1449-fe8c-40cd-995c-cd8dfb3df059 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:54:31.741425 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-e5cc1449-fe8c-40cd-995c-cd8dfb3df059 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:54:31.741833 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-e5cc1449-fe8c-40cd-995c-cd8dfb3df059 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:54:31.878560 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-e5cc1449-fe8c-40cd-995c-cd8dfb3df059 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a792b5b7e6f7461b8d802a5abaaa9518', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e843a3fb49f41dcb376184d7e156528', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:54:31.887002 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-e5cc1449-fe8c-40cd-995c-cd8dfb3df059 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] 10.222.0.11 "GET /compute/v2.1/servers/15abb40f-daf9-4c4b-ac9c-55f57ee7b938" status: 200 len: 1558 microversion: 2.1 time: 0.162922 Nov 17 03:54:31.887559 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 1490/2780] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:54:31 2021] GET /compute/v2.1/servers/15abb40f-daf9-4c4b-ac9c-55f57ee7b938 => generated 1558 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:54:32.135598 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-cc5b2e5c-8ebb-4e24-8ba1-9f5c1c8a114c tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:54:32.136272 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-cc5b2e5c-8ebb-4e24-8ba1-9f5c1c8a114c tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] [instance: 5d54db85-b991-4890-abaa-952413baa2e7] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:54:32.143275 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-cc5b2e5c-8ebb-4e24-8ba1-9f5c1c8a114c tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:54:32.143727 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-cc5b2e5c-8ebb-4e24-8ba1-9f5c1c8a114c tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:54:32.144498 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-cc5b2e5c-8ebb-4e24-8ba1-9f5c1c8a114c tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:54:32.144972 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-cc5b2e5c-8ebb-4e24-8ba1-9f5c1c8a114c tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:54:32.212287 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-cc5b2e5c-8ebb-4e24-8ba1-9f5c1c8a114c tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37f21d6d15cf40a586edda211219fd08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ebb970305844dccacf48a7d8d47ecf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:54:32.224740 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-cc5b2e5c-8ebb-4e24-8ba1-9f5c1c8a114c tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '37f21d6d15cf40a586edda211219fd08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ebb970305844dccacf48a7d8d47ecf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:54:32.226272 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-cc5b2e5c-8ebb-4e24-8ba1-9f5c1c8a114c tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '37f21d6d15cf40a586edda211219fd08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ebb970305844dccacf48a7d8d47ecf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:54:32.227414 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-cc5b2e5c-8ebb-4e24-8ba1-9f5c1c8a114c tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] 10.222.0.11 "GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7" status: 200 len: 1444 microversion: 2.20 time: 0.095673 Nov 17 03:54:32.228055 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 1491/2781] 10.222.0.11 () {60 vars in 1276 bytes} [Wed Nov 17 03:54:32 2021] GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7 => generated 1444 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 17 03:54:32.908281 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-04cf1929-28b2-465c-9fdf-d2c534cd24f1 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:54:32.909216 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-04cf1929-28b2-465c-9fdf-d2c534cd24f1 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] [instance: 15abb40f-daf9-4c4b-ac9c-55f57ee7b938] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:54:32.915650 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-04cf1929-28b2-465c-9fdf-d2c534cd24f1 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:54:32.916099 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-04cf1929-28b2-465c-9fdf-d2c534cd24f1 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:54:32.916909 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-04cf1929-28b2-465c-9fdf-d2c534cd24f1 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:54:32.917346 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-04cf1929-28b2-465c-9fdf-d2c534cd24f1 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:54:33.055454 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-04cf1929-28b2-465c-9fdf-d2c534cd24f1 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a792b5b7e6f7461b8d802a5abaaa9518', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e843a3fb49f41dcb376184d7e156528', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:54:33.064663 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-04cf1929-28b2-465c-9fdf-d2c534cd24f1 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] 10.222.0.11 "GET /compute/v2.1/servers/15abb40f-daf9-4c4b-ac9c-55f57ee7b938" status: 200 len: 1558 microversion: 2.1 time: 0.162501 Nov 17 03:54:33.065466 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 1492/2782] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:54:32 2021] GET /compute/v2.1/servers/15abb40f-daf9-4c4b-ac9c-55f57ee7b938 => generated 1558 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:54:33.250128 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-3a17dd7c-b14d-4b69-8c18-5fc07e602f88 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:54:33.251200 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-3a17dd7c-b14d-4b69-8c18-5fc07e602f88 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] [instance: 5d54db85-b991-4890-abaa-952413baa2e7] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:54:33.258920 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-3a17dd7c-b14d-4b69-8c18-5fc07e602f88 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:54:33.259371 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-3a17dd7c-b14d-4b69-8c18-5fc07e602f88 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:54:33.260135 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-3a17dd7c-b14d-4b69-8c18-5fc07e602f88 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:54:33.260569 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-3a17dd7c-b14d-4b69-8c18-5fc07e602f88 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:54:33.325665 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-3a17dd7c-b14d-4b69-8c18-5fc07e602f88 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37f21d6d15cf40a586edda211219fd08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ebb970305844dccacf48a7d8d47ecf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:54:33.334761 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-3a17dd7c-b14d-4b69-8c18-5fc07e602f88 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '37f21d6d15cf40a586edda211219fd08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ebb970305844dccacf48a7d8d47ecf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:54:33.336241 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-3a17dd7c-b14d-4b69-8c18-5fc07e602f88 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '37f21d6d15cf40a586edda211219fd08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ebb970305844dccacf48a7d8d47ecf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:54:33.337424 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-3a17dd7c-b14d-4b69-8c18-5fc07e602f88 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] 10.222.0.11 "GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7" status: 200 len: 1444 microversion: 2.20 time: 0.093678 Nov 17 03:54:33.337983 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 1493/2783] 10.222.0.11 () {60 vars in 1276 bytes} [Wed Nov 17 03:54:33 2021] GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7 => generated 1444 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 17 03:54:34.083093 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-4728c1d4-3b47-4cc3-9a6d-8ec2f013dfe8 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:54:34.083704 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-4728c1d4-3b47-4cc3-9a6d-8ec2f013dfe8 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] [instance: 15abb40f-daf9-4c4b-ac9c-55f57ee7b938] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:54:34.089830 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-4728c1d4-3b47-4cc3-9a6d-8ec2f013dfe8 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:54:34.090318 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-4728c1d4-3b47-4cc3-9a6d-8ec2f013dfe8 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:54:34.091090 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-4728c1d4-3b47-4cc3-9a6d-8ec2f013dfe8 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:54:34.091525 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-4728c1d4-3b47-4cc3-9a6d-8ec2f013dfe8 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:54:34.227662 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-4728c1d4-3b47-4cc3-9a6d-8ec2f013dfe8 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a792b5b7e6f7461b8d802a5abaaa9518', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e843a3fb49f41dcb376184d7e156528', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:54:34.235810 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-4728c1d4-3b47-4cc3-9a6d-8ec2f013dfe8 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] 10.222.0.11 "GET /compute/v2.1/servers/15abb40f-daf9-4c4b-ac9c-55f57ee7b938" status: 200 len: 1558 microversion: 2.1 time: 0.156680 Nov 17 03:54:34.236450 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 1494/2784] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:54:34 2021] GET /compute/v2.1/servers/15abb40f-daf9-4c4b-ac9c-55f57ee7b938 => generated 1558 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 17 03:54:34.355825 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-6a07e86c-ecdd-492d-aa2f-8246ff0d9be0 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:54:34.356466 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-6a07e86c-ecdd-492d-aa2f-8246ff0d9be0 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] [instance: 5d54db85-b991-4890-abaa-952413baa2e7] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:54:34.363082 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-6a07e86c-ecdd-492d-aa2f-8246ff0d9be0 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:54:34.363534 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-6a07e86c-ecdd-492d-aa2f-8246ff0d9be0 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:54:34.364315 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-6a07e86c-ecdd-492d-aa2f-8246ff0d9be0 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:54:34.364739 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-6a07e86c-ecdd-492d-aa2f-8246ff0d9be0 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:54:34.428843 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-6a07e86c-ecdd-492d-aa2f-8246ff0d9be0 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37f21d6d15cf40a586edda211219fd08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ebb970305844dccacf48a7d8d47ecf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:54:34.437799 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-6a07e86c-ecdd-492d-aa2f-8246ff0d9be0 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '37f21d6d15cf40a586edda211219fd08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ebb970305844dccacf48a7d8d47ecf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:54:34.439291 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-6a07e86c-ecdd-492d-aa2f-8246ff0d9be0 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '37f21d6d15cf40a586edda211219fd08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ebb970305844dccacf48a7d8d47ecf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:54:34.440427 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-6a07e86c-ecdd-492d-aa2f-8246ff0d9be0 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] 10.222.0.11 "GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7" status: 200 len: 1444 microversion: 2.20 time: 0.088518 Nov 17 03:54:34.441222 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 1495/2785] 10.222.0.11 () {60 vars in 1276 bytes} [Wed Nov 17 03:54:34 2021] GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7 => generated 1444 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 17 03:54:35.256623 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-23c5c413-81b9-4470-a252-20f1838b314a tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:54:35.257403 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-23c5c413-81b9-4470-a252-20f1838b314a tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] [instance: 15abb40f-daf9-4c4b-ac9c-55f57ee7b938] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:54:35.265149 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-23c5c413-81b9-4470-a252-20f1838b314a tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:54:35.265702 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-23c5c413-81b9-4470-a252-20f1838b314a tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:54:35.266647 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-23c5c413-81b9-4470-a252-20f1838b314a tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:54:35.267178 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-23c5c413-81b9-4470-a252-20f1838b314a tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:54:35.423791 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-23c5c413-81b9-4470-a252-20f1838b314a tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a792b5b7e6f7461b8d802a5abaaa9518', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e843a3fb49f41dcb376184d7e156528', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:54:35.437284 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-23c5c413-81b9-4470-a252-20f1838b314a tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] 10.222.0.11 "GET /compute/v2.1/servers/15abb40f-daf9-4c4b-ac9c-55f57ee7b938" status: 200 len: 1558 microversion: 2.1 time: 0.185601 Nov 17 03:54:35.438069 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 1496/2786] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:54:35 2021] GET /compute/v2.1/servers/15abb40f-daf9-4c4b-ac9c-55f57ee7b938 => generated 1558 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:54:35.458806 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-576a5d86-9cc7-48e4-b8e4-7d2c2acdfe96 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:54:35.459413 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-576a5d86-9cc7-48e4-b8e4-7d2c2acdfe96 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] [instance: 5d54db85-b991-4890-abaa-952413baa2e7] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:54:35.465658 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-576a5d86-9cc7-48e4-b8e4-7d2c2acdfe96 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:54:35.466106 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-576a5d86-9cc7-48e4-b8e4-7d2c2acdfe96 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:54:35.466909 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-576a5d86-9cc7-48e4-b8e4-7d2c2acdfe96 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:54:35.467345 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-576a5d86-9cc7-48e4-b8e4-7d2c2acdfe96 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:54:35.531082 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-576a5d86-9cc7-48e4-b8e4-7d2c2acdfe96 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37f21d6d15cf40a586edda211219fd08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ebb970305844dccacf48a7d8d47ecf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:54:35.544600 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-576a5d86-9cc7-48e4-b8e4-7d2c2acdfe96 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '37f21d6d15cf40a586edda211219fd08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ebb970305844dccacf48a7d8d47ecf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:54:35.547000 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-576a5d86-9cc7-48e4-b8e4-7d2c2acdfe96 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '37f21d6d15cf40a586edda211219fd08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ebb970305844dccacf48a7d8d47ecf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:54:35.548686 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-576a5d86-9cc7-48e4-b8e4-7d2c2acdfe96 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] 10.222.0.11 "GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7" status: 200 len: 1444 microversion: 2.20 time: 0.093370 Nov 17 03:54:35.549515 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 1497/2787] 10.222.0.11 () {60 vars in 1276 bytes} [Wed Nov 17 03:54:35 2021] GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7 => generated 1444 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 17 03:54:36.462357 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-04a6d4cf-2991-4d60-b895-494de8bdd443 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:54:36.463338 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-04a6d4cf-2991-4d60-b895-494de8bdd443 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] [instance: 15abb40f-daf9-4c4b-ac9c-55f57ee7b938] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:54:36.473988 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-04a6d4cf-2991-4d60-b895-494de8bdd443 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:54:36.474734 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-04a6d4cf-2991-4d60-b895-494de8bdd443 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:54:36.476008 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-04a6d4cf-2991-4d60-b895-494de8bdd443 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:54:36.476721 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-04a6d4cf-2991-4d60-b895-494de8bdd443 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:54:36.631167 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-04a6d4cf-2991-4d60-b895-494de8bdd443 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a792b5b7e6f7461b8d802a5abaaa9518', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e843a3fb49f41dcb376184d7e156528', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:54:36.639165 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-04a6d4cf-2991-4d60-b895-494de8bdd443 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] 10.222.0.11 "GET /compute/v2.1/servers/15abb40f-daf9-4c4b-ac9c-55f57ee7b938" status: 200 len: 1558 microversion: 2.1 time: 0.183212 Nov 17 03:54:36.639734 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 1498/2788] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:54:36 2021] GET /compute/v2.1/servers/15abb40f-daf9-4c4b-ac9c-55f57ee7b938 => generated 1558 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:54:36.643919 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-2da881e7-ae91-4b6e-b58e-4c9f4a100711 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:54:36.644552 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-2da881e7-ae91-4b6e-b58e-4c9f4a100711 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] [instance: 5d54db85-b991-4890-abaa-952413baa2e7] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:54:36.650509 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-2da881e7-ae91-4b6e-b58e-4c9f4a100711 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:54:36.650961 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-2da881e7-ae91-4b6e-b58e-4c9f4a100711 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:54:36.651728 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-2da881e7-ae91-4b6e-b58e-4c9f4a100711 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:54:36.652162 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-2da881e7-ae91-4b6e-b58e-4c9f4a100711 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:54:36.713936 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-2da881e7-ae91-4b6e-b58e-4c9f4a100711 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37f21d6d15cf40a586edda211219fd08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ebb970305844dccacf48a7d8d47ecf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:54:36.725618 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-2da881e7-ae91-4b6e-b58e-4c9f4a100711 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '37f21d6d15cf40a586edda211219fd08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ebb970305844dccacf48a7d8d47ecf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:54:36.727107 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-2da881e7-ae91-4b6e-b58e-4c9f4a100711 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '37f21d6d15cf40a586edda211219fd08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ebb970305844dccacf48a7d8d47ecf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:54:36.728238 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-2da881e7-ae91-4b6e-b58e-4c9f4a100711 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] 10.222.0.11 "GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7" status: 200 len: 1444 microversion: 2.20 time: 0.087597 Nov 17 03:54:36.728801 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 1499/2789] 10.222.0.11 () {60 vars in 1276 bytes} [Wed Nov 17 03:54:36 2021] GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7 => generated 1444 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 17 03:54:37.659252 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-8f979f4c-fb4e-4e37-8c58-221c5f807f4b tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:54:37.660302 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-8f979f4c-fb4e-4e37-8c58-221c5f807f4b tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] [instance: 15abb40f-daf9-4c4b-ac9c-55f57ee7b938] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:54:37.667056 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-8f979f4c-fb4e-4e37-8c58-221c5f807f4b tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:54:37.667655 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-8f979f4c-fb4e-4e37-8c58-221c5f807f4b tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:54:37.668478 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-8f979f4c-fb4e-4e37-8c58-221c5f807f4b tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:54:37.668961 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-8f979f4c-fb4e-4e37-8c58-221c5f807f4b tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:54:37.815153 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-8f979f4c-fb4e-4e37-8c58-221c5f807f4b tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a792b5b7e6f7461b8d802a5abaaa9518', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e843a3fb49f41dcb376184d7e156528', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:54:37.828394 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-8f979f4c-fb4e-4e37-8c58-221c5f807f4b tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] 10.222.0.11 "GET /compute/v2.1/servers/15abb40f-daf9-4c4b-ac9c-55f57ee7b938" status: 200 len: 1558 microversion: 2.1 time: 0.175223 Nov 17 03:54:37.829301 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 1500/2790] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:54:37 2021] GET /compute/v2.1/servers/15abb40f-daf9-4c4b-ac9c-55f57ee7b938 => generated 1558 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:54:37.834659 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-e1d59314-e704-4cff-b71f-a4599fdd815a tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:54:37.835248 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-e1d59314-e704-4cff-b71f-a4599fdd815a tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] [instance: 5d54db85-b991-4890-abaa-952413baa2e7] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:54:37.841109 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-e1d59314-e704-4cff-b71f-a4599fdd815a tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:54:37.841552 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-e1d59314-e704-4cff-b71f-a4599fdd815a tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:54:37.842310 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-e1d59314-e704-4cff-b71f-a4599fdd815a tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:54:37.842733 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-e1d59314-e704-4cff-b71f-a4599fdd815a tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:54:37.907872 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-e1d59314-e704-4cff-b71f-a4599fdd815a tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37f21d6d15cf40a586edda211219fd08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ebb970305844dccacf48a7d8d47ecf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:54:37.916422 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-e1d59314-e704-4cff-b71f-a4599fdd815a tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '37f21d6d15cf40a586edda211219fd08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ebb970305844dccacf48a7d8d47ecf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:54:37.917861 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-e1d59314-e704-4cff-b71f-a4599fdd815a tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '37f21d6d15cf40a586edda211219fd08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ebb970305844dccacf48a7d8d47ecf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:54:37.918977 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-e1d59314-e704-4cff-b71f-a4599fdd815a tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] 10.222.0.11 "GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7" status: 200 len: 1444 microversion: 2.20 time: 0.088630 Nov 17 03:54:37.919550 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 1501/2791] 10.222.0.11 () {60 vars in 1276 bytes} [Wed Nov 17 03:54:37 2021] GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7 => generated 1444 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 17 03:54:38.850784 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-ac2e55e4-2129-402a-bbaa-4ebe70f32eae tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:54:38.851739 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-ac2e55e4-2129-402a-bbaa-4ebe70f32eae tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] [instance: 15abb40f-daf9-4c4b-ac9c-55f57ee7b938] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:54:38.859782 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-ac2e55e4-2129-402a-bbaa-4ebe70f32eae tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:54:38.860368 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-ac2e55e4-2129-402a-bbaa-4ebe70f32eae tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:54:38.861359 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-ac2e55e4-2129-402a-bbaa-4ebe70f32eae tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:54:38.861894 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-ac2e55e4-2129-402a-bbaa-4ebe70f32eae tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:54:39.002680 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-ac2e55e4-2129-402a-bbaa-4ebe70f32eae tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a792b5b7e6f7461b8d802a5abaaa9518', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e843a3fb49f41dcb376184d7e156528', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:54:39.011272 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-ac2e55e4-2129-402a-bbaa-4ebe70f32eae tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] 10.222.0.11 "GET /compute/v2.1/servers/15abb40f-daf9-4c4b-ac9c-55f57ee7b938" status: 200 len: 1558 microversion: 2.1 time: 0.166744 Nov 17 03:54:39.011834 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 1502/2792] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:54:38 2021] GET /compute/v2.1/servers/15abb40f-daf9-4c4b-ac9c-55f57ee7b938 => generated 1558 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:54:39.016045 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-d8a06076-1fdf-4852-ac6a-8ea9531e242d tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:54:39.016669 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-d8a06076-1fdf-4852-ac6a-8ea9531e242d tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] [instance: 5d54db85-b991-4890-abaa-952413baa2e7] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:54:39.022328 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-d8a06076-1fdf-4852-ac6a-8ea9531e242d tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:54:39.022770 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-d8a06076-1fdf-4852-ac6a-8ea9531e242d tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:54:39.023527 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-d8a06076-1fdf-4852-ac6a-8ea9531e242d tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:54:39.023955 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-d8a06076-1fdf-4852-ac6a-8ea9531e242d tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:54:39.082579 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-d8a06076-1fdf-4852-ac6a-8ea9531e242d tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37f21d6d15cf40a586edda211219fd08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ebb970305844dccacf48a7d8d47ecf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:54:39.091075 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-d8a06076-1fdf-4852-ac6a-8ea9531e242d tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '37f21d6d15cf40a586edda211219fd08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ebb970305844dccacf48a7d8d47ecf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:54:39.092545 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-d8a06076-1fdf-4852-ac6a-8ea9531e242d tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '37f21d6d15cf40a586edda211219fd08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ebb970305844dccacf48a7d8d47ecf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:54:39.093694 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-d8a06076-1fdf-4852-ac6a-8ea9531e242d tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] 10.222.0.11 "GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7" status: 200 len: 1444 microversion: 2.20 time: 0.080913 Nov 17 03:54:39.094256 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 1503/2793] 10.222.0.11 () {60 vars in 1276 bytes} [Wed Nov 17 03:54:39 2021] GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7 => generated 1444 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 17 03:54:40.029408 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-48faa1cd-280a-45b5-9ce2-239a6b744aab tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:54:40.030146 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-48faa1cd-280a-45b5-9ce2-239a6b744aab tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] [instance: 15abb40f-daf9-4c4b-ac9c-55f57ee7b938] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:54:40.036686 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-48faa1cd-280a-45b5-9ce2-239a6b744aab tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:54:40.037161 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-48faa1cd-280a-45b5-9ce2-239a6b744aab tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:54:40.037929 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-48faa1cd-280a-45b5-9ce2-239a6b744aab tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:54:40.038359 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-48faa1cd-280a-45b5-9ce2-239a6b744aab tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:54:40.172249 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-48faa1cd-280a-45b5-9ce2-239a6b744aab tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a792b5b7e6f7461b8d802a5abaaa9518', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e843a3fb49f41dcb376184d7e156528', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:54:40.182086 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-48faa1cd-280a-45b5-9ce2-239a6b744aab tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] 10.222.0.11 "GET /compute/v2.1/servers/15abb40f-daf9-4c4b-ac9c-55f57ee7b938" status: 200 len: 1558 microversion: 2.1 time: 0.156433 Nov 17 03:54:40.182675 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 1504/2794] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:54:40 2021] GET /compute/v2.1/servers/15abb40f-daf9-4c4b-ac9c-55f57ee7b938 => generated 1558 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:54:40.187023 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-7d559d9f-c4e0-4714-9cf4-39deedbbc524 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:54:40.187619 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-7d559d9f-c4e0-4714-9cf4-39deedbbc524 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] [instance: 5d54db85-b991-4890-abaa-952413baa2e7] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:54:40.193644 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-7d559d9f-c4e0-4714-9cf4-39deedbbc524 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:54:40.194088 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-7d559d9f-c4e0-4714-9cf4-39deedbbc524 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:54:40.194872 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-7d559d9f-c4e0-4714-9cf4-39deedbbc524 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:54:40.195548 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-7d559d9f-c4e0-4714-9cf4-39deedbbc524 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:54:40.256457 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-7d559d9f-c4e0-4714-9cf4-39deedbbc524 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37f21d6d15cf40a586edda211219fd08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ebb970305844dccacf48a7d8d47ecf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:54:40.265488 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-7d559d9f-c4e0-4714-9cf4-39deedbbc524 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '37f21d6d15cf40a586edda211219fd08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ebb970305844dccacf48a7d8d47ecf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:54:40.266977 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-7d559d9f-c4e0-4714-9cf4-39deedbbc524 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '37f21d6d15cf40a586edda211219fd08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ebb970305844dccacf48a7d8d47ecf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:54:40.268114 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-7d559d9f-c4e0-4714-9cf4-39deedbbc524 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] 10.222.0.11 "GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7" status: 200 len: 1444 microversion: 2.20 time: 0.084587 Nov 17 03:54:40.268670 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 1505/2795] 10.222.0.11 () {60 vars in 1276 bytes} [Wed Nov 17 03:54:40 2021] GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7 => generated 1444 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 17 03:54:41.203976 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-7c22f10d-a86a-420b-899d-1020cfb1cd29 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:54:41.205400 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-7c22f10d-a86a-420b-899d-1020cfb1cd29 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] [instance: 15abb40f-daf9-4c4b-ac9c-55f57ee7b938] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:54:41.216402 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-7c22f10d-a86a-420b-899d-1020cfb1cd29 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:54:41.217220 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-7c22f10d-a86a-420b-899d-1020cfb1cd29 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:54:41.218504 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-7c22f10d-a86a-420b-899d-1020cfb1cd29 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:54:41.219229 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-7c22f10d-a86a-420b-899d-1020cfb1cd29 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:54:41.358475 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-7c22f10d-a86a-420b-899d-1020cfb1cd29 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a792b5b7e6f7461b8d802a5abaaa9518', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e843a3fb49f41dcb376184d7e156528', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:54:41.366785 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-7c22f10d-a86a-420b-899d-1020cfb1cd29 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] 10.222.0.11 "GET /compute/v2.1/servers/15abb40f-daf9-4c4b-ac9c-55f57ee7b938" status: 200 len: 1558 microversion: 2.1 time: 0.169291 Nov 17 03:54:41.367355 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 1506/2796] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:54:41 2021] GET /compute/v2.1/servers/15abb40f-daf9-4c4b-ac9c-55f57ee7b938 => generated 1558 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 17 03:54:41.371580 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-b6ae8b9d-8dc6-4109-a633-d53748db0167 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:54:41.372172 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-b6ae8b9d-8dc6-4109-a633-d53748db0167 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] [instance: 5d54db85-b991-4890-abaa-952413baa2e7] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:54:41.377964 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-b6ae8b9d-8dc6-4109-a633-d53748db0167 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:54:41.378406 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-b6ae8b9d-8dc6-4109-a633-d53748db0167 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:54:41.379158 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-b6ae8b9d-8dc6-4109-a633-d53748db0167 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:54:41.379580 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-b6ae8b9d-8dc6-4109-a633-d53748db0167 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:54:41.440111 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-b6ae8b9d-8dc6-4109-a633-d53748db0167 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37f21d6d15cf40a586edda211219fd08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ebb970305844dccacf48a7d8d47ecf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:54:41.452389 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-b6ae8b9d-8dc6-4109-a633-d53748db0167 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '37f21d6d15cf40a586edda211219fd08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ebb970305844dccacf48a7d8d47ecf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:54:41.454677 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-b6ae8b9d-8dc6-4109-a633-d53748db0167 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '37f21d6d15cf40a586edda211219fd08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ebb970305844dccacf48a7d8d47ecf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:54:41.456117 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-b6ae8b9d-8dc6-4109-a633-d53748db0167 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] 10.222.0.11 "GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7" status: 200 len: 1444 microversion: 2.20 time: 0.087651 Nov 17 03:54:41.456801 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 1507/2797] 10.222.0.11 () {60 vars in 1276 bytes} [Wed Nov 17 03:54:41 2021] GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7 => generated 1444 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 17 03:54:42.388849 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-42481d9b-02bf-4261-aaa9-8bf0fc5f15cd tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:54:42.389921 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-42481d9b-02bf-4261-aaa9-8bf0fc5f15cd tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] [instance: 15abb40f-daf9-4c4b-ac9c-55f57ee7b938] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:54:42.399497 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-42481d9b-02bf-4261-aaa9-8bf0fc5f15cd tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:54:42.399959 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-42481d9b-02bf-4261-aaa9-8bf0fc5f15cd tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:54:42.400726 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-42481d9b-02bf-4261-aaa9-8bf0fc5f15cd tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:54:42.401177 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-42481d9b-02bf-4261-aaa9-8bf0fc5f15cd tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:54:42.541514 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-42481d9b-02bf-4261-aaa9-8bf0fc5f15cd tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a792b5b7e6f7461b8d802a5abaaa9518', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e843a3fb49f41dcb376184d7e156528', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:54:42.550119 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-42481d9b-02bf-4261-aaa9-8bf0fc5f15cd tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] 10.222.0.11 "GET /compute/v2.1/servers/15abb40f-daf9-4c4b-ac9c-55f57ee7b938" status: 200 len: 1558 microversion: 2.1 time: 0.168525 Nov 17 03:54:42.550696 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 1508/2798] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:54:42 2021] GET /compute/v2.1/servers/15abb40f-daf9-4c4b-ac9c-55f57ee7b938 => generated 1558 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:54:42.555455 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-0784ea83-6e26-4428-9935-eb5a7eb84311 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:54:42.556059 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-0784ea83-6e26-4428-9935-eb5a7eb84311 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] [instance: 5d54db85-b991-4890-abaa-952413baa2e7] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:54:42.561739 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-0784ea83-6e26-4428-9935-eb5a7eb84311 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:54:42.562194 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-0784ea83-6e26-4428-9935-eb5a7eb84311 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:54:42.562960 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-0784ea83-6e26-4428-9935-eb5a7eb84311 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:54:42.563402 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-0784ea83-6e26-4428-9935-eb5a7eb84311 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:54:42.625200 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-0784ea83-6e26-4428-9935-eb5a7eb84311 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37f21d6d15cf40a586edda211219fd08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ebb970305844dccacf48a7d8d47ecf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:54:42.633803 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-0784ea83-6e26-4428-9935-eb5a7eb84311 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '37f21d6d15cf40a586edda211219fd08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ebb970305844dccacf48a7d8d47ecf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:54:42.635294 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-0784ea83-6e26-4428-9935-eb5a7eb84311 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '37f21d6d15cf40a586edda211219fd08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ebb970305844dccacf48a7d8d47ecf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:54:42.636438 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-0784ea83-6e26-4428-9935-eb5a7eb84311 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] 10.222.0.11 "GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7" status: 200 len: 1444 microversion: 2.20 time: 0.084782 Nov 17 03:54:42.637025 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 1509/2799] 10.222.0.11 () {60 vars in 1276 bytes} [Wed Nov 17 03:54:42 2021] GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7 => generated 1444 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 17 03:54:43.571167 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-c52fb638-98ba-4ffd-a284-6df2109a2473 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:54:43.571944 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-c52fb638-98ba-4ffd-a284-6df2109a2473 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] [instance: 15abb40f-daf9-4c4b-ac9c-55f57ee7b938] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:54:43.579643 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-c52fb638-98ba-4ffd-a284-6df2109a2473 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:54:43.580171 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-c52fb638-98ba-4ffd-a284-6df2109a2473 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:54:43.581126 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-c52fb638-98ba-4ffd-a284-6df2109a2473 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:54:43.581636 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-c52fb638-98ba-4ffd-a284-6df2109a2473 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:54:43.725144 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-c52fb638-98ba-4ffd-a284-6df2109a2473 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a792b5b7e6f7461b8d802a5abaaa9518', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e843a3fb49f41dcb376184d7e156528', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:54:43.733959 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-c52fb638-98ba-4ffd-a284-6df2109a2473 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] 10.222.0.11 "GET /compute/v2.1/servers/15abb40f-daf9-4c4b-ac9c-55f57ee7b938" status: 200 len: 1558 microversion: 2.1 time: 0.168806 Nov 17 03:54:43.734526 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 1510/2800] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:54:43 2021] GET /compute/v2.1/servers/15abb40f-daf9-4c4b-ac9c-55f57ee7b938 => generated 1558 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:54:43.738740 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-64695691-3c86-4806-9279-d0eb1b27cbb6 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:54:43.739333 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-64695691-3c86-4806-9279-d0eb1b27cbb6 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] [instance: 5d54db85-b991-4890-abaa-952413baa2e7] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:54:43.745297 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-64695691-3c86-4806-9279-d0eb1b27cbb6 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:54:43.745744 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-64695691-3c86-4806-9279-d0eb1b27cbb6 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:54:43.746516 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-64695691-3c86-4806-9279-d0eb1b27cbb6 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:54:43.746943 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-64695691-3c86-4806-9279-d0eb1b27cbb6 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:54:43.815695 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-64695691-3c86-4806-9279-d0eb1b27cbb6 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37f21d6d15cf40a586edda211219fd08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ebb970305844dccacf48a7d8d47ecf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:54:43.825292 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-64695691-3c86-4806-9279-d0eb1b27cbb6 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '37f21d6d15cf40a586edda211219fd08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ebb970305844dccacf48a7d8d47ecf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:54:43.826786 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-64695691-3c86-4806-9279-d0eb1b27cbb6 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '37f21d6d15cf40a586edda211219fd08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ebb970305844dccacf48a7d8d47ecf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:54:43.827914 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-64695691-3c86-4806-9279-d0eb1b27cbb6 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] 10.222.0.11 "GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7" status: 200 len: 1444 microversion: 2.20 time: 0.092469 Nov 17 03:54:43.828465 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 1511/2801] 10.222.0.11 () {60 vars in 1276 bytes} [Wed Nov 17 03:54:43 2021] GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7 => generated 1444 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 17 03:54:44.754247 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-e5f2df8f-6c39-4fb4-98d6-fbb239f9b2b0 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:54:44.755285 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-e5f2df8f-6c39-4fb4-98d6-fbb239f9b2b0 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] [instance: 15abb40f-daf9-4c4b-ac9c-55f57ee7b938] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:54:44.763082 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-e5f2df8f-6c39-4fb4-98d6-fbb239f9b2b0 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:54:44.763531 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-e5f2df8f-6c39-4fb4-98d6-fbb239f9b2b0 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:54:44.764306 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-e5f2df8f-6c39-4fb4-98d6-fbb239f9b2b0 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:54:44.764733 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-e5f2df8f-6c39-4fb4-98d6-fbb239f9b2b0 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:54:44.923961 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-e5f2df8f-6c39-4fb4-98d6-fbb239f9b2b0 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a792b5b7e6f7461b8d802a5abaaa9518', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e843a3fb49f41dcb376184d7e156528', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:54:44.934250 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-e5f2df8f-6c39-4fb4-98d6-fbb239f9b2b0 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] 10.222.0.11 "GET /compute/v2.1/servers/15abb40f-daf9-4c4b-ac9c-55f57ee7b938" status: 200 len: 1558 microversion: 2.1 time: 0.185793 Nov 17 03:54:44.934829 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 1512/2802] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:54:44 2021] GET /compute/v2.1/servers/15abb40f-daf9-4c4b-ac9c-55f57ee7b938 => generated 1558 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:54:44.939211 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-97e8f523-832b-422a-be74-4fa3650e2934 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:54:44.939840 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-97e8f523-832b-422a-be74-4fa3650e2934 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] [instance: 5d54db85-b991-4890-abaa-952413baa2e7] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:54:44.946276 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-97e8f523-832b-422a-be74-4fa3650e2934 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:54:44.946818 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-97e8f523-832b-422a-be74-4fa3650e2934 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:54:44.947745 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-97e8f523-832b-422a-be74-4fa3650e2934 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:54:44.948175 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-97e8f523-832b-422a-be74-4fa3650e2934 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:54:45.013273 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-97e8f523-832b-422a-be74-4fa3650e2934 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37f21d6d15cf40a586edda211219fd08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ebb970305844dccacf48a7d8d47ecf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:54:45.025536 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-97e8f523-832b-422a-be74-4fa3650e2934 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '37f21d6d15cf40a586edda211219fd08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ebb970305844dccacf48a7d8d47ecf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:54:45.027165 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-97e8f523-832b-422a-be74-4fa3650e2934 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '37f21d6d15cf40a586edda211219fd08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ebb970305844dccacf48a7d8d47ecf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:54:45.028512 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-97e8f523-832b-422a-be74-4fa3650e2934 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] 10.222.0.11 "GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7" status: 200 len: 1444 microversion: 2.20 time: 0.092590 Nov 17 03:54:45.029312 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 1513/2803] 10.222.0.11 () {60 vars in 1276 bytes} [Wed Nov 17 03:54:44 2021] GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7 => generated 1444 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 17 03:54:45.959373 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-37692f83-fb5b-43e6-993b-52b640c856a5 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:54:45.960287 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-37692f83-fb5b-43e6-993b-52b640c856a5 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] [instance: 15abb40f-daf9-4c4b-ac9c-55f57ee7b938] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:54:45.970467 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-37692f83-fb5b-43e6-993b-52b640c856a5 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:54:45.971169 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-37692f83-fb5b-43e6-993b-52b640c856a5 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:54:45.972342 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-37692f83-fb5b-43e6-993b-52b640c856a5 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:54:45.973063 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-37692f83-fb5b-43e6-993b-52b640c856a5 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:54:46.108648 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-37692f83-fb5b-43e6-993b-52b640c856a5 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a792b5b7e6f7461b8d802a5abaaa9518', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e843a3fb49f41dcb376184d7e156528', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:54:46.119820 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-37692f83-fb5b-43e6-993b-52b640c856a5 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] 10.222.0.11 "GET /compute/v2.1/servers/15abb40f-daf9-4c4b-ac9c-55f57ee7b938" status: 200 len: 1558 microversion: 2.1 time: 0.165911 Nov 17 03:54:46.120428 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 1514/2804] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:54:45 2021] GET /compute/v2.1/servers/15abb40f-daf9-4c4b-ac9c-55f57ee7b938 => generated 1558 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:54:46.124611 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-4771ae33-35b0-4381-9d0f-7baac10e3ddc tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:54:46.125234 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-4771ae33-35b0-4381-9d0f-7baac10e3ddc tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] [instance: 5d54db85-b991-4890-abaa-952413baa2e7] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:54:46.131387 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-4771ae33-35b0-4381-9d0f-7baac10e3ddc tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:54:46.131942 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-4771ae33-35b0-4381-9d0f-7baac10e3ddc tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:54:46.133017 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-4771ae33-35b0-4381-9d0f-7baac10e3ddc tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:54:46.133584 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-4771ae33-35b0-4381-9d0f-7baac10e3ddc tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:54:46.194042 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-4771ae33-35b0-4381-9d0f-7baac10e3ddc tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37f21d6d15cf40a586edda211219fd08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ebb970305844dccacf48a7d8d47ecf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:54:46.202447 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-4771ae33-35b0-4381-9d0f-7baac10e3ddc tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '37f21d6d15cf40a586edda211219fd08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ebb970305844dccacf48a7d8d47ecf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:54:46.203907 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-4771ae33-35b0-4381-9d0f-7baac10e3ddc tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '37f21d6d15cf40a586edda211219fd08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ebb970305844dccacf48a7d8d47ecf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:54:46.205063 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-4771ae33-35b0-4381-9d0f-7baac10e3ddc tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] 10.222.0.11 "GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7" status: 200 len: 1444 microversion: 2.20 time: 0.083664 Nov 17 03:54:46.205614 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 1515/2805] 10.222.0.11 () {60 vars in 1276 bytes} [Wed Nov 17 03:54:46 2021] GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7 => generated 1444 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 17 03:54:47.141023 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-e7c47ab3-0a75-4097-8ef9-0c326354fa2e tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:54:47.142056 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-e7c47ab3-0a75-4097-8ef9-0c326354fa2e tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] [instance: 15abb40f-daf9-4c4b-ac9c-55f57ee7b938] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:54:47.151996 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-e7c47ab3-0a75-4097-8ef9-0c326354fa2e tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:54:47.152443 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-e7c47ab3-0a75-4097-8ef9-0c326354fa2e tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:54:47.153277 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-e7c47ab3-0a75-4097-8ef9-0c326354fa2e tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:54:47.153707 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-e7c47ab3-0a75-4097-8ef9-0c326354fa2e tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:54:47.312053 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-e7c47ab3-0a75-4097-8ef9-0c326354fa2e tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a792b5b7e6f7461b8d802a5abaaa9518', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e843a3fb49f41dcb376184d7e156528', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:54:47.326420 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-e7c47ab3-0a75-4097-8ef9-0c326354fa2e tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] 10.222.0.11 "GET /compute/v2.1/servers/15abb40f-daf9-4c4b-ac9c-55f57ee7b938" status: 200 len: 1558 microversion: 2.1 time: 0.191268 Nov 17 03:54:47.327152 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 1516/2806] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:54:47 2021] GET /compute/v2.1/servers/15abb40f-daf9-4c4b-ac9c-55f57ee7b938 => generated 1558 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:54:47.331389 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-07fdc370-3ce5-4500-80f6-17d53dd25503 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:54:47.331981 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-07fdc370-3ce5-4500-80f6-17d53dd25503 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] [instance: 5d54db85-b991-4890-abaa-952413baa2e7] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:54:47.338874 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-07fdc370-3ce5-4500-80f6-17d53dd25503 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:54:47.339328 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-07fdc370-3ce5-4500-80f6-17d53dd25503 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:54:47.340106 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-07fdc370-3ce5-4500-80f6-17d53dd25503 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:54:47.340533 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-07fdc370-3ce5-4500-80f6-17d53dd25503 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:54:47.400478 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-07fdc370-3ce5-4500-80f6-17d53dd25503 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37f21d6d15cf40a586edda211219fd08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ebb970305844dccacf48a7d8d47ecf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:54:47.409436 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-07fdc370-3ce5-4500-80f6-17d53dd25503 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '37f21d6d15cf40a586edda211219fd08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ebb970305844dccacf48a7d8d47ecf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:54:47.410923 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-07fdc370-3ce5-4500-80f6-17d53dd25503 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '37f21d6d15cf40a586edda211219fd08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ebb970305844dccacf48a7d8d47ecf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:54:47.412060 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-07fdc370-3ce5-4500-80f6-17d53dd25503 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] 10.222.0.11 "GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7" status: 200 len: 1444 microversion: 2.20 time: 0.083961 Nov 17 03:54:47.412614 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 1517/2807] 10.222.0.11 () {60 vars in 1276 bytes} [Wed Nov 17 03:54:47 2021] GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7 => generated 1444 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 17 03:54:48.347379 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-aaa175f5-5a92-4b85-b005-b1dd1770c6dd tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:54:48.348057 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-aaa175f5-5a92-4b85-b005-b1dd1770c6dd tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] [instance: 15abb40f-daf9-4c4b-ac9c-55f57ee7b938] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:54:48.356476 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-aaa175f5-5a92-4b85-b005-b1dd1770c6dd tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:54:48.356971 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-aaa175f5-5a92-4b85-b005-b1dd1770c6dd tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:54:48.357747 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-aaa175f5-5a92-4b85-b005-b1dd1770c6dd tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:54:48.358184 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-aaa175f5-5a92-4b85-b005-b1dd1770c6dd tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:54:48.500655 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-aaa175f5-5a92-4b85-b005-b1dd1770c6dd tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a792b5b7e6f7461b8d802a5abaaa9518', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e843a3fb49f41dcb376184d7e156528', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:54:48.512986 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-aaa175f5-5a92-4b85-b005-b1dd1770c6dd tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] 10.222.0.11 "GET /compute/v2.1/servers/15abb40f-daf9-4c4b-ac9c-55f57ee7b938" status: 200 len: 1558 microversion: 2.1 time: 0.171550 Nov 17 03:54:48.513780 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 1518/2808] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:54:48 2021] GET /compute/v2.1/servers/15abb40f-daf9-4c4b-ac9c-55f57ee7b938 => generated 1558 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:54:48.517991 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-0bda02b4-dc65-4d2a-be4e-e6ff0e4615e6 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:54:48.518588 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-0bda02b4-dc65-4d2a-be4e-e6ff0e4615e6 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] [instance: 5d54db85-b991-4890-abaa-952413baa2e7] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:54:48.524568 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-0bda02b4-dc65-4d2a-be4e-e6ff0e4615e6 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:54:48.525172 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-0bda02b4-dc65-4d2a-be4e-e6ff0e4615e6 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:54:48.526032 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-0bda02b4-dc65-4d2a-be4e-e6ff0e4615e6 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:54:48.526457 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-0bda02b4-dc65-4d2a-be4e-e6ff0e4615e6 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:54:48.591485 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-0bda02b4-dc65-4d2a-be4e-e6ff0e4615e6 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37f21d6d15cf40a586edda211219fd08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ebb970305844dccacf48a7d8d47ecf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:54:48.603971 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-0bda02b4-dc65-4d2a-be4e-e6ff0e4615e6 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '37f21d6d15cf40a586edda211219fd08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ebb970305844dccacf48a7d8d47ecf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:54:48.606278 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-0bda02b4-dc65-4d2a-be4e-e6ff0e4615e6 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '37f21d6d15cf40a586edda211219fd08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ebb970305844dccacf48a7d8d47ecf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:54:48.608030 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-0bda02b4-dc65-4d2a-be4e-e6ff0e4615e6 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] 10.222.0.11 "GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7" status: 200 len: 1444 microversion: 2.20 time: 0.093027 Nov 17 03:54:48.608825 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 1519/2809] 10.222.0.11 () {60 vars in 1276 bytes} [Wed Nov 17 03:54:48 2021] GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7 => generated 1444 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 17 03:54:49.532532 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-7a9c3c1a-73be-49b2-91b2-7e95b050d9b8 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:54:49.533508 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-7a9c3c1a-73be-49b2-91b2-7e95b050d9b8 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] [instance: 15abb40f-daf9-4c4b-ac9c-55f57ee7b938] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:54:49.542819 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-7a9c3c1a-73be-49b2-91b2-7e95b050d9b8 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:54:49.543451 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-7a9c3c1a-73be-49b2-91b2-7e95b050d9b8 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:54:49.544534 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-7a9c3c1a-73be-49b2-91b2-7e95b050d9b8 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:54:49.545206 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-7a9c3c1a-73be-49b2-91b2-7e95b050d9b8 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:54:49.684086 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-7a9c3c1a-73be-49b2-91b2-7e95b050d9b8 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a792b5b7e6f7461b8d802a5abaaa9518', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e843a3fb49f41dcb376184d7e156528', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:54:49.692225 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-7a9c3c1a-73be-49b2-91b2-7e95b050d9b8 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] 10.222.0.11 "GET /compute/v2.1/servers/15abb40f-daf9-4c4b-ac9c-55f57ee7b938" status: 200 len: 1558 microversion: 2.1 time: 0.164922 Nov 17 03:54:49.692723 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 1520/2810] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:54:49 2021] GET /compute/v2.1/servers/15abb40f-daf9-4c4b-ac9c-55f57ee7b938 => generated 1558 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:54:49.696968 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-6ef1998b-8834-42f4-844e-ea0810563cc2 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:54:49.697556 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-6ef1998b-8834-42f4-844e-ea0810563cc2 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] [instance: 5d54db85-b991-4890-abaa-952413baa2e7] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:54:49.703682 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-6ef1998b-8834-42f4-844e-ea0810563cc2 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:54:49.704127 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-6ef1998b-8834-42f4-844e-ea0810563cc2 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:54:49.704919 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-6ef1998b-8834-42f4-844e-ea0810563cc2 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:54:49.705347 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-6ef1998b-8834-42f4-844e-ea0810563cc2 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:54:49.776682 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-6ef1998b-8834-42f4-844e-ea0810563cc2 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37f21d6d15cf40a586edda211219fd08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ebb970305844dccacf48a7d8d47ecf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:54:49.787839 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-6ef1998b-8834-42f4-844e-ea0810563cc2 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '37f21d6d15cf40a586edda211219fd08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ebb970305844dccacf48a7d8d47ecf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:54:49.789781 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-6ef1998b-8834-42f4-844e-ea0810563cc2 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '37f21d6d15cf40a586edda211219fd08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ebb970305844dccacf48a7d8d47ecf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:54:49.790990 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-6ef1998b-8834-42f4-844e-ea0810563cc2 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] 10.222.0.11 "GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7" status: 200 len: 1444 microversion: 2.20 time: 0.097254 Nov 17 03:54:49.791652 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 1521/2811] 10.222.0.11 () {60 vars in 1276 bytes} [Wed Nov 17 03:54:49 2021] GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7 => generated 1444 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 17 03:54:50.713581 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-1ba2a3e1-8ac9-46b6-bee5-4812d9f56bbb tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:54:50.714762 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-1ba2a3e1-8ac9-46b6-bee5-4812d9f56bbb tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] [instance: 15abb40f-daf9-4c4b-ac9c-55f57ee7b938] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:54:50.721653 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-1ba2a3e1-8ac9-46b6-bee5-4812d9f56bbb tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:54:50.722128 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-1ba2a3e1-8ac9-46b6-bee5-4812d9f56bbb tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:54:50.722909 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-1ba2a3e1-8ac9-46b6-bee5-4812d9f56bbb tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:54:50.723341 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-1ba2a3e1-8ac9-46b6-bee5-4812d9f56bbb tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:54:50.864211 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-1ba2a3e1-8ac9-46b6-bee5-4812d9f56bbb tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a792b5b7e6f7461b8d802a5abaaa9518', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e843a3fb49f41dcb376184d7e156528', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:54:50.872462 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-1ba2a3e1-8ac9-46b6-bee5-4812d9f56bbb tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] 10.222.0.11 "GET /compute/v2.1/servers/15abb40f-daf9-4c4b-ac9c-55f57ee7b938" status: 200 len: 1558 microversion: 2.1 time: 0.165071 Nov 17 03:54:50.873093 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 1522/2812] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:54:50 2021] GET /compute/v2.1/servers/15abb40f-daf9-4c4b-ac9c-55f57ee7b938 => generated 1558 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:54:50.877311 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-1e2ee585-57e5-4e15-9497-7666beb6eb29 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:54:50.877912 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-1e2ee585-57e5-4e15-9497-7666beb6eb29 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] [instance: 5d54db85-b991-4890-abaa-952413baa2e7] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:54:50.883721 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-1e2ee585-57e5-4e15-9497-7666beb6eb29 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:54:50.884307 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-1e2ee585-57e5-4e15-9497-7666beb6eb29 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:54:50.885112 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-1e2ee585-57e5-4e15-9497-7666beb6eb29 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:54:50.885545 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-1e2ee585-57e5-4e15-9497-7666beb6eb29 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:54:50.944658 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-1e2ee585-57e5-4e15-9497-7666beb6eb29 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37f21d6d15cf40a586edda211219fd08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ebb970305844dccacf48a7d8d47ecf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:54:50.953259 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-1e2ee585-57e5-4e15-9497-7666beb6eb29 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '37f21d6d15cf40a586edda211219fd08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ebb970305844dccacf48a7d8d47ecf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:54:50.954782 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-1e2ee585-57e5-4e15-9497-7666beb6eb29 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '37f21d6d15cf40a586edda211219fd08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ebb970305844dccacf48a7d8d47ecf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:54:50.955916 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-1e2ee585-57e5-4e15-9497-7666beb6eb29 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] 10.222.0.11 "GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7" status: 200 len: 1444 microversion: 2.20 time: 0.081908 Nov 17 03:54:50.956476 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 1523/2813] 10.222.0.11 () {60 vars in 1276 bytes} [Wed Nov 17 03:54:50 2021] GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7 => generated 1444 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 17 03:54:51.894244 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-414760b8-5e3c-468d-9f76-f8f2114b5399 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:54:51.895343 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-414760b8-5e3c-468d-9f76-f8f2114b5399 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] [instance: 15abb40f-daf9-4c4b-ac9c-55f57ee7b938] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:54:51.906354 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-414760b8-5e3c-468d-9f76-f8f2114b5399 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:54:51.907134 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-414760b8-5e3c-468d-9f76-f8f2114b5399 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:54:51.908379 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-414760b8-5e3c-468d-9f76-f8f2114b5399 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:54:51.909151 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-414760b8-5e3c-468d-9f76-f8f2114b5399 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:54:52.051749 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-414760b8-5e3c-468d-9f76-f8f2114b5399 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a792b5b7e6f7461b8d802a5abaaa9518', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e843a3fb49f41dcb376184d7e156528', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:54:52.061198 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-414760b8-5e3c-468d-9f76-f8f2114b5399 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] 10.222.0.11 "GET /compute/v2.1/servers/15abb40f-daf9-4c4b-ac9c-55f57ee7b938" status: 200 len: 1558 microversion: 2.1 time: 0.173127 Nov 17 03:54:52.061800 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 1524/2814] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:54:51 2021] GET /compute/v2.1/servers/15abb40f-daf9-4c4b-ac9c-55f57ee7b938 => generated 1558 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:54:52.067848 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-1078375c-2023-48c6-8be9-6903481d46e8 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:54:52.068837 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-1078375c-2023-48c6-8be9-6903481d46e8 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] [instance: 5d54db85-b991-4890-abaa-952413baa2e7] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:54:52.076822 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-1078375c-2023-48c6-8be9-6903481d46e8 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:54:52.077282 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-1078375c-2023-48c6-8be9-6903481d46e8 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:54:52.078048 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-1078375c-2023-48c6-8be9-6903481d46e8 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:54:52.078477 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-1078375c-2023-48c6-8be9-6903481d46e8 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:54:52.146532 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-1078375c-2023-48c6-8be9-6903481d46e8 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37f21d6d15cf40a586edda211219fd08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ebb970305844dccacf48a7d8d47ecf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:54:52.155415 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-1078375c-2023-48c6-8be9-6903481d46e8 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '37f21d6d15cf40a586edda211219fd08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ebb970305844dccacf48a7d8d47ecf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:54:52.156970 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-1078375c-2023-48c6-8be9-6903481d46e8 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '37f21d6d15cf40a586edda211219fd08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ebb970305844dccacf48a7d8d47ecf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:54:52.158104 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-1078375c-2023-48c6-8be9-6903481d46e8 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] 10.222.0.11 "GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7" status: 200 len: 1444 microversion: 2.20 time: 0.095398 Nov 17 03:54:52.158657 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 1525/2815] 10.222.0.11 () {60 vars in 1276 bytes} [Wed Nov 17 03:54:52 2021] GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7 => generated 1444 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 17 03:54:53.083254 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-5d410367-21d6-4941-99a8-27c3efa63b7b tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:54:53.083860 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-5d410367-21d6-4941-99a8-27c3efa63b7b tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] [instance: 15abb40f-daf9-4c4b-ac9c-55f57ee7b938] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:54:53.090966 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-5d410367-21d6-4941-99a8-27c3efa63b7b tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:54:53.091422 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-5d410367-21d6-4941-99a8-27c3efa63b7b tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:54:53.092200 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-5d410367-21d6-4941-99a8-27c3efa63b7b tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:54:53.092643 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-5d410367-21d6-4941-99a8-27c3efa63b7b tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:54:53.238884 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-5d410367-21d6-4941-99a8-27c3efa63b7b tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a792b5b7e6f7461b8d802a5abaaa9518', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e843a3fb49f41dcb376184d7e156528', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:54:53.246856 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-5d410367-21d6-4941-99a8-27c3efa63b7b tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] 10.222.0.11 "GET /compute/v2.1/servers/15abb40f-daf9-4c4b-ac9c-55f57ee7b938" status: 200 len: 1558 microversion: 2.1 time: 0.167363 Nov 17 03:54:53.247436 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 1526/2816] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:54:53 2021] GET /compute/v2.1/servers/15abb40f-daf9-4c4b-ac9c-55f57ee7b938 => generated 1558 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:54:53.251679 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-fafaf776-70e1-48be-a479-b3c1cba87b31 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:54:53.252282 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-fafaf776-70e1-48be-a479-b3c1cba87b31 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] [instance: 5d54db85-b991-4890-abaa-952413baa2e7] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:54:53.258400 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-fafaf776-70e1-48be-a479-b3c1cba87b31 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:54:53.258856 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-fafaf776-70e1-48be-a479-b3c1cba87b31 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:54:53.259629 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-fafaf776-70e1-48be-a479-b3c1cba87b31 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:54:53.260067 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-fafaf776-70e1-48be-a479-b3c1cba87b31 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:54:53.328034 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-fafaf776-70e1-48be-a479-b3c1cba87b31 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37f21d6d15cf40a586edda211219fd08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ebb970305844dccacf48a7d8d47ecf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:54:53.341116 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-fafaf776-70e1-48be-a479-b3c1cba87b31 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '37f21d6d15cf40a586edda211219fd08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ebb970305844dccacf48a7d8d47ecf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:54:53.343611 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-fafaf776-70e1-48be-a479-b3c1cba87b31 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '37f21d6d15cf40a586edda211219fd08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ebb970305844dccacf48a7d8d47ecf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:54:53.345137 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-fafaf776-70e1-48be-a479-b3c1cba87b31 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] 10.222.0.11 "GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7" status: 200 len: 1444 microversion: 2.20 time: 0.096443 Nov 17 03:54:53.346052 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 1527/2817] 10.222.0.11 () {60 vars in 1276 bytes} [Wed Nov 17 03:54:53 2021] GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7 => generated 1444 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 17 03:54:54.267270 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-2f7df4af-7650-4778-bf5b-07bda55f8531 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:54:54.268001 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-2f7df4af-7650-4778-bf5b-07bda55f8531 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] [instance: 15abb40f-daf9-4c4b-ac9c-55f57ee7b938] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:54:54.276560 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-2f7df4af-7650-4778-bf5b-07bda55f8531 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:54:54.277073 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-2f7df4af-7650-4778-bf5b-07bda55f8531 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:54:54.278178 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-2f7df4af-7650-4778-bf5b-07bda55f8531 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:54:54.278753 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-2f7df4af-7650-4778-bf5b-07bda55f8531 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:54:54.434079 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-2f7df4af-7650-4778-bf5b-07bda55f8531 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a792b5b7e6f7461b8d802a5abaaa9518', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e843a3fb49f41dcb376184d7e156528', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:54:54.446918 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-2f7df4af-7650-4778-bf5b-07bda55f8531 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] 10.222.0.11 "GET /compute/v2.1/servers/15abb40f-daf9-4c4b-ac9c-55f57ee7b938" status: 200 len: 1558 microversion: 2.1 time: 0.185652 Nov 17 03:54:54.447694 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 1528/2818] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:54:54 2021] GET /compute/v2.1/servers/15abb40f-daf9-4c4b-ac9c-55f57ee7b938 => generated 1558 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:54:54.452088 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-7550caa9-cc26-42b5-83ad-84ddb5f204c7 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:54:54.452674 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-7550caa9-cc26-42b5-83ad-84ddb5f204c7 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] [instance: 5d54db85-b991-4890-abaa-952413baa2e7] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:54:54.458199 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-7550caa9-cc26-42b5-83ad-84ddb5f204c7 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:54:54.458648 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-7550caa9-cc26-42b5-83ad-84ddb5f204c7 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:54:54.459400 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-7550caa9-cc26-42b5-83ad-84ddb5f204c7 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:54:54.459839 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-7550caa9-cc26-42b5-83ad-84ddb5f204c7 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:54:54.522224 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-7550caa9-cc26-42b5-83ad-84ddb5f204c7 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37f21d6d15cf40a586edda211219fd08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ebb970305844dccacf48a7d8d47ecf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:54:54.530899 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-7550caa9-cc26-42b5-83ad-84ddb5f204c7 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '37f21d6d15cf40a586edda211219fd08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ebb970305844dccacf48a7d8d47ecf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:54:54.532405 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-7550caa9-cc26-42b5-83ad-84ddb5f204c7 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '37f21d6d15cf40a586edda211219fd08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ebb970305844dccacf48a7d8d47ecf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:54:54.533555 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-7550caa9-cc26-42b5-83ad-84ddb5f204c7 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] 10.222.0.11 "GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7" status: 200 len: 1444 microversion: 2.20 time: 0.084915 Nov 17 03:54:54.534115 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 1529/2819] 10.222.0.11 () {60 vars in 1276 bytes} [Wed Nov 17 03:54:54 2021] GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7 => generated 1444 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 17 03:54:55.467147 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-26eb69de-6437-45bf-b368-d3a69987cd75 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:54:55.467930 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-26eb69de-6437-45bf-b368-d3a69987cd75 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] [instance: 15abb40f-daf9-4c4b-ac9c-55f57ee7b938] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:54:55.475136 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-26eb69de-6437-45bf-b368-d3a69987cd75 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:54:55.475640 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-26eb69de-6437-45bf-b368-d3a69987cd75 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:54:55.476485 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-26eb69de-6437-45bf-b368-d3a69987cd75 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:54:55.477006 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-26eb69de-6437-45bf-b368-d3a69987cd75 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:54:55.627046 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-26eb69de-6437-45bf-b368-d3a69987cd75 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a792b5b7e6f7461b8d802a5abaaa9518', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e843a3fb49f41dcb376184d7e156528', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:54:55.637838 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-26eb69de-6437-45bf-b368-d3a69987cd75 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] 10.222.0.11 "GET /compute/v2.1/servers/15abb40f-daf9-4c4b-ac9c-55f57ee7b938" status: 200 len: 1558 microversion: 2.1 time: 0.175669 Nov 17 03:54:55.638418 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 1530/2820] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:54:55 2021] GET /compute/v2.1/servers/15abb40f-daf9-4c4b-ac9c-55f57ee7b938 => generated 1558 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:54:55.642717 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-0b3c80e0-7474-4c7f-8105-b1ef6919e5dc tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:54:55.643314 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-0b3c80e0-7474-4c7f-8105-b1ef6919e5dc tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] [instance: 5d54db85-b991-4890-abaa-952413baa2e7] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:54:55.649428 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-0b3c80e0-7474-4c7f-8105-b1ef6919e5dc tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:54:55.649875 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-0b3c80e0-7474-4c7f-8105-b1ef6919e5dc tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:54:55.650640 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-0b3c80e0-7474-4c7f-8105-b1ef6919e5dc tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:54:55.651070 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-0b3c80e0-7474-4c7f-8105-b1ef6919e5dc tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:54:55.714064 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-0b3c80e0-7474-4c7f-8105-b1ef6919e5dc tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37f21d6d15cf40a586edda211219fd08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ebb970305844dccacf48a7d8d47ecf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:54:55.727368 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-0b3c80e0-7474-4c7f-8105-b1ef6919e5dc tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '37f21d6d15cf40a586edda211219fd08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ebb970305844dccacf48a7d8d47ecf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:54:55.729748 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-0b3c80e0-7474-4c7f-8105-b1ef6919e5dc tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '37f21d6d15cf40a586edda211219fd08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ebb970305844dccacf48a7d8d47ecf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:54:55.731208 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-0b3c80e0-7474-4c7f-8105-b1ef6919e5dc tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] 10.222.0.11 "GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7" status: 200 len: 1444 microversion: 2.20 time: 0.091871 Nov 17 03:54:55.731758 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 1531/2821] 10.222.0.11 () {60 vars in 1276 bytes} [Wed Nov 17 03:54:55 2021] GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7 => generated 1444 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 17 03:54:56.660319 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-f212c419-ae2c-4f39-920e-92836bfacca5 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:54:56.661472 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-f212c419-ae2c-4f39-920e-92836bfacca5 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] [instance: 15abb40f-daf9-4c4b-ac9c-55f57ee7b938] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:54:56.671028 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-f212c419-ae2c-4f39-920e-92836bfacca5 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:54:56.671480 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-f212c419-ae2c-4f39-920e-92836bfacca5 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:54:56.672258 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-f212c419-ae2c-4f39-920e-92836bfacca5 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:54:56.672693 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-f212c419-ae2c-4f39-920e-92836bfacca5 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:54:56.829458 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-f212c419-ae2c-4f39-920e-92836bfacca5 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a792b5b7e6f7461b8d802a5abaaa9518', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e843a3fb49f41dcb376184d7e156528', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:54:56.841523 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-f212c419-ae2c-4f39-920e-92836bfacca5 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] 10.222.0.11 "GET /compute/v2.1/servers/15abb40f-daf9-4c4b-ac9c-55f57ee7b938" status: 200 len: 1558 microversion: 2.1 time: 0.187416 Nov 17 03:54:56.842102 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 1532/2822] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:54:56 2021] GET /compute/v2.1/servers/15abb40f-daf9-4c4b-ac9c-55f57ee7b938 => generated 1558 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:54:56.846310 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-9f7b9e53-ace8-4c19-9c0e-5afb0c17f7cf tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:54:56.846906 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-9f7b9e53-ace8-4c19-9c0e-5afb0c17f7cf tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] [instance: 5d54db85-b991-4890-abaa-952413baa2e7] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:54:56.852386 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-9f7b9e53-ace8-4c19-9c0e-5afb0c17f7cf tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:54:56.852858 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-9f7b9e53-ace8-4c19-9c0e-5afb0c17f7cf tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:54:56.853624 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-9f7b9e53-ace8-4c19-9c0e-5afb0c17f7cf tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:54:56.854053 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-9f7b9e53-ace8-4c19-9c0e-5afb0c17f7cf tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:54:56.918146 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-9f7b9e53-ace8-4c19-9c0e-5afb0c17f7cf tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37f21d6d15cf40a586edda211219fd08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ebb970305844dccacf48a7d8d47ecf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:54:56.926855 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-9f7b9e53-ace8-4c19-9c0e-5afb0c17f7cf tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '37f21d6d15cf40a586edda211219fd08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ebb970305844dccacf48a7d8d47ecf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:54:56.928340 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-9f7b9e53-ace8-4c19-9c0e-5afb0c17f7cf tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '37f21d6d15cf40a586edda211219fd08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ebb970305844dccacf48a7d8d47ecf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:54:56.929499 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-9f7b9e53-ace8-4c19-9c0e-5afb0c17f7cf tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] 10.222.0.11 "GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7" status: 200 len: 1444 microversion: 2.20 time: 0.086487 Nov 17 03:54:56.930062 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 1533/2823] 10.222.0.11 () {60 vars in 1276 bytes} [Wed Nov 17 03:54:56 2021] GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7 => generated 1444 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 17 03:54:57.862820 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-4f0292c2-62fc-48ac-ab3e-e1f3b86100dc tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:54:57.864140 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-4f0292c2-62fc-48ac-ab3e-e1f3b86100dc tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] [instance: 15abb40f-daf9-4c4b-ac9c-55f57ee7b938] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:54:57.874534 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-4f0292c2-62fc-48ac-ab3e-e1f3b86100dc tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:54:57.875273 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-4f0292c2-62fc-48ac-ab3e-e1f3b86100dc tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:54:57.876532 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-4f0292c2-62fc-48ac-ab3e-e1f3b86100dc tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:54:57.877311 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-4f0292c2-62fc-48ac-ab3e-e1f3b86100dc tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:54:58.017894 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-4f0292c2-62fc-48ac-ab3e-e1f3b86100dc tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a792b5b7e6f7461b8d802a5abaaa9518', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e843a3fb49f41dcb376184d7e156528', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:54:58.030165 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-4f0292c2-62fc-48ac-ab3e-e1f3b86100dc tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] 10.222.0.11 "GET /compute/v2.1/servers/15abb40f-daf9-4c4b-ac9c-55f57ee7b938" status: 200 len: 1558 microversion: 2.1 time: 0.173244 Nov 17 03:54:58.030789 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 1534/2824] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:54:57 2021] GET /compute/v2.1/servers/15abb40f-daf9-4c4b-ac9c-55f57ee7b938 => generated 1558 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:54:58.035173 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-c9a2337f-61c0-416d-9155-7291560a9d67 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:54:58.035750 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-c9a2337f-61c0-416d-9155-7291560a9d67 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] [instance: 5d54db85-b991-4890-abaa-952413baa2e7] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:54:58.042249 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-c9a2337f-61c0-416d-9155-7291560a9d67 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:54:58.042967 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-c9a2337f-61c0-416d-9155-7291560a9d67 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:54:58.043829 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-c9a2337f-61c0-416d-9155-7291560a9d67 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:54:58.044275 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-c9a2337f-61c0-416d-9155-7291560a9d67 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:54:58.104040 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-c9a2337f-61c0-416d-9155-7291560a9d67 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37f21d6d15cf40a586edda211219fd08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ebb970305844dccacf48a7d8d47ecf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:54:58.112898 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-c9a2337f-61c0-416d-9155-7291560a9d67 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '37f21d6d15cf40a586edda211219fd08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ebb970305844dccacf48a7d8d47ecf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:54:58.114327 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-c9a2337f-61c0-416d-9155-7291560a9d67 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '37f21d6d15cf40a586edda211219fd08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ebb970305844dccacf48a7d8d47ecf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:54:58.115452 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-c9a2337f-61c0-416d-9155-7291560a9d67 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] 10.222.0.11 "GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7" status: 200 len: 1444 microversion: 2.20 time: 0.083765 Nov 17 03:54:58.116013 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 1535/2825] 10.222.0.11 () {60 vars in 1276 bytes} [Wed Nov 17 03:54:58 2021] GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7 => generated 1444 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 17 03:54:59.051813 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-31c04344-6877-4466-9f00-97c1b003fcc7 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:54:59.052945 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-31c04344-6877-4466-9f00-97c1b003fcc7 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] [instance: 15abb40f-daf9-4c4b-ac9c-55f57ee7b938] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:54:59.061893 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-31c04344-6877-4466-9f00-97c1b003fcc7 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:54:59.062351 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-31c04344-6877-4466-9f00-97c1b003fcc7 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:54:59.063136 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-31c04344-6877-4466-9f00-97c1b003fcc7 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:54:59.063566 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-31c04344-6877-4466-9f00-97c1b003fcc7 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:54:59.198616 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-31c04344-6877-4466-9f00-97c1b003fcc7 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a792b5b7e6f7461b8d802a5abaaa9518', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e843a3fb49f41dcb376184d7e156528', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:54:59.207449 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-31c04344-6877-4466-9f00-97c1b003fcc7 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] 10.222.0.11 "GET /compute/v2.1/servers/15abb40f-daf9-4c4b-ac9c-55f57ee7b938" status: 200 len: 1558 microversion: 2.1 time: 0.162207 Nov 17 03:54:59.208027 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 1536/2826] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:54:59 2021] GET /compute/v2.1/servers/15abb40f-daf9-4c4b-ac9c-55f57ee7b938 => generated 1558 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:54:59.212345 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-4e532fbd-a285-4635-930c-c6914dbaee58 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:54:59.213007 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-4e532fbd-a285-4635-930c-c6914dbaee58 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] [instance: 5d54db85-b991-4890-abaa-952413baa2e7] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:54:59.220111 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-4e532fbd-a285-4635-930c-c6914dbaee58 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:54:59.220829 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-4e532fbd-a285-4635-930c-c6914dbaee58 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:54:59.222076 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-4e532fbd-a285-4635-930c-c6914dbaee58 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:54:59.222734 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-4e532fbd-a285-4635-930c-c6914dbaee58 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:54:59.298376 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-4e532fbd-a285-4635-930c-c6914dbaee58 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37f21d6d15cf40a586edda211219fd08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ebb970305844dccacf48a7d8d47ecf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:54:59.307638 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-4e532fbd-a285-4635-930c-c6914dbaee58 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '37f21d6d15cf40a586edda211219fd08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ebb970305844dccacf48a7d8d47ecf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:54:59.309271 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-4e532fbd-a285-4635-930c-c6914dbaee58 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '37f21d6d15cf40a586edda211219fd08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ebb970305844dccacf48a7d8d47ecf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:54:59.310419 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-4e532fbd-a285-4635-930c-c6914dbaee58 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] 10.222.0.11 "GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7" status: 200 len: 1444 microversion: 2.20 time: 0.101465 Nov 17 03:54:59.311008 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 1537/2827] 10.222.0.11 () {60 vars in 1276 bytes} [Wed Nov 17 03:54:59 2021] GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7 => generated 1444 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 17 03:55:00.226956 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-598c7088-f54e-4296-baa8-cdac102ec80e tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:55:00.227847 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-598c7088-f54e-4296-baa8-cdac102ec80e tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] [instance: 15abb40f-daf9-4c4b-ac9c-55f57ee7b938] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:55:00.235036 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-598c7088-f54e-4296-baa8-cdac102ec80e tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:55:00.235476 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-598c7088-f54e-4296-baa8-cdac102ec80e tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:55:00.236234 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-598c7088-f54e-4296-baa8-cdac102ec80e tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:55:00.236660 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-598c7088-f54e-4296-baa8-cdac102ec80e tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:55:00.370333 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-598c7088-f54e-4296-baa8-cdac102ec80e tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a792b5b7e6f7461b8d802a5abaaa9518', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e843a3fb49f41dcb376184d7e156528', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:55:00.378688 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-598c7088-f54e-4296-baa8-cdac102ec80e tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] 10.222.0.11 "GET /compute/v2.1/servers/15abb40f-daf9-4c4b-ac9c-55f57ee7b938" status: 200 len: 1558 microversion: 2.1 time: 0.156736 Nov 17 03:55:00.379261 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 1538/2828] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:55:00 2021] GET /compute/v2.1/servers/15abb40f-daf9-4c4b-ac9c-55f57ee7b938 => generated 1558 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:55:00.383521 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-0e353b18-bfdc-464f-8d4f-4ad7b7faa516 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:55:00.384236 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-0e353b18-bfdc-464f-8d4f-4ad7b7faa516 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] [instance: 5d54db85-b991-4890-abaa-952413baa2e7] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:55:00.391340 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-0e353b18-bfdc-464f-8d4f-4ad7b7faa516 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:55:00.391855 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-0e353b18-bfdc-464f-8d4f-4ad7b7faa516 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:55:00.392675 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-0e353b18-bfdc-464f-8d4f-4ad7b7faa516 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:55:00.393218 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-0e353b18-bfdc-464f-8d4f-4ad7b7faa516 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:55:00.455862 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-0e353b18-bfdc-464f-8d4f-4ad7b7faa516 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37f21d6d15cf40a586edda211219fd08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ebb970305844dccacf48a7d8d47ecf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:55:00.466066 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-0e353b18-bfdc-464f-8d4f-4ad7b7faa516 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '37f21d6d15cf40a586edda211219fd08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ebb970305844dccacf48a7d8d47ecf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:55:00.468697 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-0e353b18-bfdc-464f-8d4f-4ad7b7faa516 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '37f21d6d15cf40a586edda211219fd08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ebb970305844dccacf48a7d8d47ecf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:55:00.470322 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-0e353b18-bfdc-464f-8d4f-4ad7b7faa516 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] 10.222.0.11 "GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7" status: 200 len: 1444 microversion: 2.20 time: 0.090135 Nov 17 03:55:00.470873 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 1539/2829] 10.222.0.11 () {60 vars in 1276 bytes} [Wed Nov 17 03:55:00 2021] GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7 => generated 1444 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 17 03:55:01.404418 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-1e5fd706-1be2-4b78-ab2e-6c385bf41eaa tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:55:01.405706 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-1e5fd706-1be2-4b78-ab2e-6c385bf41eaa tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] [instance: 15abb40f-daf9-4c4b-ac9c-55f57ee7b938] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:55:01.416241 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-1e5fd706-1be2-4b78-ab2e-6c385bf41eaa tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:55:01.417035 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-1e5fd706-1be2-4b78-ab2e-6c385bf41eaa tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:55:01.418300 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-1e5fd706-1be2-4b78-ab2e-6c385bf41eaa tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:55:01.419012 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-1e5fd706-1be2-4b78-ab2e-6c385bf41eaa tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:55:01.566872 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-1e5fd706-1be2-4b78-ab2e-6c385bf41eaa tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a792b5b7e6f7461b8d802a5abaaa9518', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e843a3fb49f41dcb376184d7e156528', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:55:01.578841 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-1e5fd706-1be2-4b78-ab2e-6c385bf41eaa tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] 10.222.0.11 "GET /compute/v2.1/servers/15abb40f-daf9-4c4b-ac9c-55f57ee7b938" status: 200 len: 1558 microversion: 2.1 time: 0.182873 Nov 17 03:55:01.579380 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 1540/2830] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:55:01 2021] GET /compute/v2.1/servers/15abb40f-daf9-4c4b-ac9c-55f57ee7b938 => generated 1558 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:55:01.583576 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-596c2c80-f99c-4f19-a4c1-bb8d0fa36f5c tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:55:01.584170 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-596c2c80-f99c-4f19-a4c1-bb8d0fa36f5c tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] [instance: 5d54db85-b991-4890-abaa-952413baa2e7] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:55:01.589732 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-596c2c80-f99c-4f19-a4c1-bb8d0fa36f5c tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:55:01.590187 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-596c2c80-f99c-4f19-a4c1-bb8d0fa36f5c tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:55:01.590941 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-596c2c80-f99c-4f19-a4c1-bb8d0fa36f5c tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:55:01.591371 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-596c2c80-f99c-4f19-a4c1-bb8d0fa36f5c tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:55:01.656497 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-596c2c80-f99c-4f19-a4c1-bb8d0fa36f5c tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37f21d6d15cf40a586edda211219fd08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ebb970305844dccacf48a7d8d47ecf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:55:01.664822 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-596c2c80-f99c-4f19-a4c1-bb8d0fa36f5c tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '37f21d6d15cf40a586edda211219fd08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ebb970305844dccacf48a7d8d47ecf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:55:01.666357 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-596c2c80-f99c-4f19-a4c1-bb8d0fa36f5c tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '37f21d6d15cf40a586edda211219fd08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ebb970305844dccacf48a7d8d47ecf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:55:01.667483 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-596c2c80-f99c-4f19-a4c1-bb8d0fa36f5c tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] 10.222.0.11 "GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7" status: 200 len: 1444 microversion: 2.20 time: 0.087168 Nov 17 03:55:01.668042 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 1541/2831] 10.222.0.11 () {60 vars in 1276 bytes} [Wed Nov 17 03:55:01 2021] GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7 => generated 1444 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 17 03:55:02.599327 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-2df4730e-142f-4bdc-9c2d-86a4e3fa3f96 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:55:02.600465 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-2df4730e-142f-4bdc-9c2d-86a4e3fa3f96 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] [instance: 15abb40f-daf9-4c4b-ac9c-55f57ee7b938] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:55:02.610067 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-2df4730e-142f-4bdc-9c2d-86a4e3fa3f96 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:55:02.610520 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-2df4730e-142f-4bdc-9c2d-86a4e3fa3f96 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:55:02.611299 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-2df4730e-142f-4bdc-9c2d-86a4e3fa3f96 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:55:02.611736 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-2df4730e-142f-4bdc-9c2d-86a4e3fa3f96 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:55:02.753675 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-2df4730e-142f-4bdc-9c2d-86a4e3fa3f96 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a792b5b7e6f7461b8d802a5abaaa9518', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e843a3fb49f41dcb376184d7e156528', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:55:02.765218 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-2df4730e-142f-4bdc-9c2d-86a4e3fa3f96 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] 10.222.0.11 "GET /compute/v2.1/servers/15abb40f-daf9-4c4b-ac9c-55f57ee7b938" status: 200 len: 1558 microversion: 2.1 time: 0.171455 Nov 17 03:55:02.766023 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 1542/2832] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:55:02 2021] GET /compute/v2.1/servers/15abb40f-daf9-4c4b-ac9c-55f57ee7b938 => generated 1558 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:55:02.770406 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-811a5f92-057d-4d82-93f0-2e0d96d34082 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:55:02.771004 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-811a5f92-057d-4d82-93f0-2e0d96d34082 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] [instance: 5d54db85-b991-4890-abaa-952413baa2e7] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:55:02.778323 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-811a5f92-057d-4d82-93f0-2e0d96d34082 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:55:02.778912 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-811a5f92-057d-4d82-93f0-2e0d96d34082 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:55:02.780512 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-811a5f92-057d-4d82-93f0-2e0d96d34082 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:55:02.780993 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-811a5f92-057d-4d82-93f0-2e0d96d34082 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:55:02.840481 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-811a5f92-057d-4d82-93f0-2e0d96d34082 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37f21d6d15cf40a586edda211219fd08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ebb970305844dccacf48a7d8d47ecf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:55:02.849181 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-811a5f92-057d-4d82-93f0-2e0d96d34082 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '37f21d6d15cf40a586edda211219fd08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ebb970305844dccacf48a7d8d47ecf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:55:02.850739 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-811a5f92-057d-4d82-93f0-2e0d96d34082 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '37f21d6d15cf40a586edda211219fd08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ebb970305844dccacf48a7d8d47ecf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:55:02.851812 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-811a5f92-057d-4d82-93f0-2e0d96d34082 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] 10.222.0.11 "GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7" status: 200 len: 1444 microversion: 2.20 time: 0.084865 Nov 17 03:55:02.852377 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 1543/2833] 10.222.0.11 () {60 vars in 1276 bytes} [Wed Nov 17 03:55:02 2021] GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7 => generated 1444 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 17 03:55:03.786424 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-0b19abc5-0dbf-4072-a520-4e37448ca6cf tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:55:03.787532 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-0b19abc5-0dbf-4072-a520-4e37448ca6cf tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] [instance: 15abb40f-daf9-4c4b-ac9c-55f57ee7b938] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:55:03.797069 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-0b19abc5-0dbf-4072-a520-4e37448ca6cf tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:55:03.797514 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-0b19abc5-0dbf-4072-a520-4e37448ca6cf tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:55:03.798308 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-0b19abc5-0dbf-4072-a520-4e37448ca6cf tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:55:03.798735 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-0b19abc5-0dbf-4072-a520-4e37448ca6cf tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:55:03.933126 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-0b19abc5-0dbf-4072-a520-4e37448ca6cf tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a792b5b7e6f7461b8d802a5abaaa9518', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e843a3fb49f41dcb376184d7e156528', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:55:03.945395 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-0b19abc5-0dbf-4072-a520-4e37448ca6cf tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] 10.222.0.11 "GET /compute/v2.1/servers/15abb40f-daf9-4c4b-ac9c-55f57ee7b938" status: 200 len: 1558 microversion: 2.1 time: 0.165107 Nov 17 03:55:03.946129 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 1544/2834] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:55:03 2021] GET /compute/v2.1/servers/15abb40f-daf9-4c4b-ac9c-55f57ee7b938 => generated 1558 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:55:03.950340 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-a67fda53-d3f1-4a43-bc55-d35aa822f4dd tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:55:03.950940 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-a67fda53-d3f1-4a43-bc55-d35aa822f4dd tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] [instance: 5d54db85-b991-4890-abaa-952413baa2e7] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:55:03.957269 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-a67fda53-d3f1-4a43-bc55-d35aa822f4dd tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:55:03.957705 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-a67fda53-d3f1-4a43-bc55-d35aa822f4dd tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:55:03.958461 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-a67fda53-d3f1-4a43-bc55-d35aa822f4dd tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:55:03.958891 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-a67fda53-d3f1-4a43-bc55-d35aa822f4dd tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:55:04.016872 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-a67fda53-d3f1-4a43-bc55-d35aa822f4dd tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37f21d6d15cf40a586edda211219fd08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ebb970305844dccacf48a7d8d47ecf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:55:04.025418 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-a67fda53-d3f1-4a43-bc55-d35aa822f4dd tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '37f21d6d15cf40a586edda211219fd08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ebb970305844dccacf48a7d8d47ecf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:55:04.026905 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-a67fda53-d3f1-4a43-bc55-d35aa822f4dd tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '37f21d6d15cf40a586edda211219fd08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ebb970305844dccacf48a7d8d47ecf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:55:04.028018 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-a67fda53-d3f1-4a43-bc55-d35aa822f4dd tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] 10.222.0.11 "GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7" status: 200 len: 1444 microversion: 2.20 time: 0.080971 Nov 17 03:55:04.028586 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 1545/2835] 10.222.0.11 () {60 vars in 1276 bytes} [Wed Nov 17 03:55:03 2021] GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7 => generated 1444 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 17 03:55:04.967186 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-3f317b40-af8b-41f4-8431-eec24da4bf1d tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:55:04.967941 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-3f317b40-af8b-41f4-8431-eec24da4bf1d tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] [instance: 15abb40f-daf9-4c4b-ac9c-55f57ee7b938] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:55:04.979120 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-3f317b40-af8b-41f4-8431-eec24da4bf1d tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:55:04.979530 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-3f317b40-af8b-41f4-8431-eec24da4bf1d tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:55:04.980330 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-3f317b40-af8b-41f4-8431-eec24da4bf1d tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:55:04.980752 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-3f317b40-af8b-41f4-8431-eec24da4bf1d tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:55:05.119369 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-3f317b40-af8b-41f4-8431-eec24da4bf1d tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a792b5b7e6f7461b8d802a5abaaa9518', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e843a3fb49f41dcb376184d7e156528', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:55:05.127950 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-3f317b40-af8b-41f4-8431-eec24da4bf1d tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] 10.222.0.11 "GET /compute/v2.1/servers/15abb40f-daf9-4c4b-ac9c-55f57ee7b938" status: 200 len: 1558 microversion: 2.1 time: 0.167284 Nov 17 03:55:05.128529 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 1546/2836] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:55:04 2021] GET /compute/v2.1/servers/15abb40f-daf9-4c4b-ac9c-55f57ee7b938 => generated 1558 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:55:05.132817 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-c3ebadea-6f2b-402b-8069-2c1dd7c08440 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:55:05.133576 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-c3ebadea-6f2b-402b-8069-2c1dd7c08440 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] [instance: 5d54db85-b991-4890-abaa-952413baa2e7] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:55:05.139595 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-c3ebadea-6f2b-402b-8069-2c1dd7c08440 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:55:05.140086 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-c3ebadea-6f2b-402b-8069-2c1dd7c08440 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:55:05.140901 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-c3ebadea-6f2b-402b-8069-2c1dd7c08440 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:55:05.141341 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-c3ebadea-6f2b-402b-8069-2c1dd7c08440 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:55:05.205719 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-c3ebadea-6f2b-402b-8069-2c1dd7c08440 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37f21d6d15cf40a586edda211219fd08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ebb970305844dccacf48a7d8d47ecf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:55:05.214426 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-c3ebadea-6f2b-402b-8069-2c1dd7c08440 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '37f21d6d15cf40a586edda211219fd08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ebb970305844dccacf48a7d8d47ecf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:55:05.215927 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-c3ebadea-6f2b-402b-8069-2c1dd7c08440 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '37f21d6d15cf40a586edda211219fd08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ebb970305844dccacf48a7d8d47ecf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:55:05.217208 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-c3ebadea-6f2b-402b-8069-2c1dd7c08440 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] 10.222.0.11 "GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7" status: 200 len: 1444 microversion: 2.20 time: 0.087682 Nov 17 03:55:05.217760 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 1547/2837] 10.222.0.11 () {60 vars in 1276 bytes} [Wed Nov 17 03:55:05 2021] GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7 => generated 1444 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 17 03:55:06.149291 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-146cc7f2-5d66-4e91-a681-982ec3925b82 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:55:06.150326 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-146cc7f2-5d66-4e91-a681-982ec3925b82 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] [instance: 15abb40f-daf9-4c4b-ac9c-55f57ee7b938] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:55:06.160972 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-146cc7f2-5d66-4e91-a681-982ec3925b82 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:55:06.161694 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-146cc7f2-5d66-4e91-a681-982ec3925b82 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:55:06.162963 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-146cc7f2-5d66-4e91-a681-982ec3925b82 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:55:06.163674 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-146cc7f2-5d66-4e91-a681-982ec3925b82 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:55:06.308281 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-146cc7f2-5d66-4e91-a681-982ec3925b82 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a792b5b7e6f7461b8d802a5abaaa9518', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e843a3fb49f41dcb376184d7e156528', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:55:06.316604 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-146cc7f2-5d66-4e91-a681-982ec3925b82 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] 10.222.0.11 "GET /compute/v2.1/servers/15abb40f-daf9-4c4b-ac9c-55f57ee7b938" status: 200 len: 1558 microversion: 2.1 time: 0.173541 Nov 17 03:55:06.317211 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 1548/2838] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:55:06 2021] GET /compute/v2.1/servers/15abb40f-daf9-4c4b-ac9c-55f57ee7b938 => generated 1558 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:55:06.321597 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-23bc384e-d24e-4647-a63b-ba42861e03c9 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:55:06.322188 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-23bc384e-d24e-4647-a63b-ba42861e03c9 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] [instance: 5d54db85-b991-4890-abaa-952413baa2e7] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:55:06.328087 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-23bc384e-d24e-4647-a63b-ba42861e03c9 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:55:06.328576 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-23bc384e-d24e-4647-a63b-ba42861e03c9 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:55:06.329371 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-23bc384e-d24e-4647-a63b-ba42861e03c9 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:55:06.329797 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-23bc384e-d24e-4647-a63b-ba42861e03c9 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:55:06.391298 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-23bc384e-d24e-4647-a63b-ba42861e03c9 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37f21d6d15cf40a586edda211219fd08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ebb970305844dccacf48a7d8d47ecf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:55:06.400126 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-23bc384e-d24e-4647-a63b-ba42861e03c9 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '37f21d6d15cf40a586edda211219fd08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ebb970305844dccacf48a7d8d47ecf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:55:06.401634 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-23bc384e-d24e-4647-a63b-ba42861e03c9 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '37f21d6d15cf40a586edda211219fd08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ebb970305844dccacf48a7d8d47ecf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:55:06.402756 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-23bc384e-d24e-4647-a63b-ba42861e03c9 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] 10.222.0.11 "GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7" status: 200 len: 1444 microversion: 2.20 time: 0.084604 Nov 17 03:55:06.403312 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 1549/2839] 10.222.0.11 () {60 vars in 1276 bytes} [Wed Nov 17 03:55:06 2021] GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7 => generated 1444 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 17 03:55:07.337566 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-43d91aeb-e9bc-48bd-b2e9-21809eb2e07a tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:55:07.338662 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-43d91aeb-e9bc-48bd-b2e9-21809eb2e07a tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] [instance: 15abb40f-daf9-4c4b-ac9c-55f57ee7b938] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:55:07.346415 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-43d91aeb-e9bc-48bd-b2e9-21809eb2e07a tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:55:07.346861 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-43d91aeb-e9bc-48bd-b2e9-21809eb2e07a tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:55:07.347628 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-43d91aeb-e9bc-48bd-b2e9-21809eb2e07a tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:55:07.348053 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-43d91aeb-e9bc-48bd-b2e9-21809eb2e07a tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:55:07.485552 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-43d91aeb-e9bc-48bd-b2e9-21809eb2e07a tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a792b5b7e6f7461b8d802a5abaaa9518', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e843a3fb49f41dcb376184d7e156528', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:55:07.497997 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-43d91aeb-e9bc-48bd-b2e9-21809eb2e07a tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] 10.222.0.11 "GET /compute/v2.1/servers/15abb40f-daf9-4c4b-ac9c-55f57ee7b938" status: 200 len: 1558 microversion: 2.1 time: 0.166240 Nov 17 03:55:07.499132 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 1550/2840] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:55:07 2021] GET /compute/v2.1/servers/15abb40f-daf9-4c4b-ac9c-55f57ee7b938 => generated 1558 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:55:07.503327 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-ee44de79-ac20-44eb-8755-36075c6618b8 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:55:07.503920 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-ee44de79-ac20-44eb-8755-36075c6618b8 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] [instance: 5d54db85-b991-4890-abaa-952413baa2e7] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:55:07.509458 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-ee44de79-ac20-44eb-8755-36075c6618b8 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:55:07.509890 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-ee44de79-ac20-44eb-8755-36075c6618b8 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:55:07.510651 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-ee44de79-ac20-44eb-8755-36075c6618b8 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:55:07.511083 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-ee44de79-ac20-44eb-8755-36075c6618b8 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:55:07.574334 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-ee44de79-ac20-44eb-8755-36075c6618b8 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37f21d6d15cf40a586edda211219fd08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ebb970305844dccacf48a7d8d47ecf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:55:07.583268 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-ee44de79-ac20-44eb-8755-36075c6618b8 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '37f21d6d15cf40a586edda211219fd08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ebb970305844dccacf48a7d8d47ecf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:55:07.584797 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-ee44de79-ac20-44eb-8755-36075c6618b8 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '37f21d6d15cf40a586edda211219fd08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ebb970305844dccacf48a7d8d47ecf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:55:07.585954 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-ee44de79-ac20-44eb-8755-36075c6618b8 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] 10.222.0.11 "GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7" status: 200 len: 1444 microversion: 2.20 time: 0.085906 Nov 17 03:55:07.586516 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 1551/2841] 10.222.0.11 () {60 vars in 1276 bytes} [Wed Nov 17 03:55:07 2021] GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7 => generated 1444 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 17 03:55:08.519910 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-5b8dca21-9c88-4784-b7e0-2756a877b7d1 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:55:08.521072 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-5b8dca21-9c88-4784-b7e0-2756a877b7d1 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] [instance: 15abb40f-daf9-4c4b-ac9c-55f57ee7b938] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:55:08.531686 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-5b8dca21-9c88-4784-b7e0-2756a877b7d1 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:55:08.532428 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-5b8dca21-9c88-4784-b7e0-2756a877b7d1 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:55:08.533745 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-5b8dca21-9c88-4784-b7e0-2756a877b7d1 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:55:08.534466 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-5b8dca21-9c88-4784-b7e0-2756a877b7d1 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:55:08.670899 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-5b8dca21-9c88-4784-b7e0-2756a877b7d1 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a792b5b7e6f7461b8d802a5abaaa9518', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e843a3fb49f41dcb376184d7e156528', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:55:08.679101 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-5b8dca21-9c88-4784-b7e0-2756a877b7d1 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] 10.222.0.11 "GET /compute/v2.1/servers/15abb40f-daf9-4c4b-ac9c-55f57ee7b938" status: 200 len: 1558 microversion: 2.1 time: 0.165414 Nov 17 03:55:08.679669 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 1552/2842] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:55:08 2021] GET /compute/v2.1/servers/15abb40f-daf9-4c4b-ac9c-55f57ee7b938 => generated 1558 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:55:08.683987 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-eca5ede3-1abb-448a-8945-cfb44995e921 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:55:08.684547 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-eca5ede3-1abb-448a-8945-cfb44995e921 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] [instance: 5d54db85-b991-4890-abaa-952413baa2e7] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:55:08.690618 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-eca5ede3-1abb-448a-8945-cfb44995e921 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:55:08.691061 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-eca5ede3-1abb-448a-8945-cfb44995e921 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:55:08.691820 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-eca5ede3-1abb-448a-8945-cfb44995e921 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:55:08.692244 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-eca5ede3-1abb-448a-8945-cfb44995e921 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:55:08.750160 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-eca5ede3-1abb-448a-8945-cfb44995e921 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37f21d6d15cf40a586edda211219fd08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ebb970305844dccacf48a7d8d47ecf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:55:08.758790 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-eca5ede3-1abb-448a-8945-cfb44995e921 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '37f21d6d15cf40a586edda211219fd08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ebb970305844dccacf48a7d8d47ecf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:55:08.760266 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-eca5ede3-1abb-448a-8945-cfb44995e921 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '37f21d6d15cf40a586edda211219fd08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ebb970305844dccacf48a7d8d47ecf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:55:08.761431 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-eca5ede3-1abb-448a-8945-cfb44995e921 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] 10.222.0.11 "GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7" status: 200 len: 1444 microversion: 2.20 time: 0.080859 Nov 17 03:55:08.761982 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 1553/2843] 10.222.0.11 () {60 vars in 1276 bytes} [Wed Nov 17 03:55:08 2021] GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7 => generated 1444 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 17 03:55:09.700295 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-e3db66ea-cc30-4898-967f-e6fdd5b826db tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:55:09.701501 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-e3db66ea-cc30-4898-967f-e6fdd5b826db tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] [instance: 15abb40f-daf9-4c4b-ac9c-55f57ee7b938] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:55:09.712255 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-e3db66ea-cc30-4898-967f-e6fdd5b826db tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:55:09.713042 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-e3db66ea-cc30-4898-967f-e6fdd5b826db tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:55:09.714356 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-e3db66ea-cc30-4898-967f-e6fdd5b826db tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:55:09.715028 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-e3db66ea-cc30-4898-967f-e6fdd5b826db tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:55:09.854485 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-e3db66ea-cc30-4898-967f-e6fdd5b826db tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a792b5b7e6f7461b8d802a5abaaa9518', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e843a3fb49f41dcb376184d7e156528', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:55:09.863737 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-e3db66ea-cc30-4898-967f-e6fdd5b826db tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] 10.222.0.11 "GET /compute/v2.1/servers/15abb40f-daf9-4c4b-ac9c-55f57ee7b938" status: 200 len: 1558 microversion: 2.1 time: 0.169808 Nov 17 03:55:09.864539 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 1554/2844] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:55:09 2021] GET /compute/v2.1/servers/15abb40f-daf9-4c4b-ac9c-55f57ee7b938 => generated 1558 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:55:09.868523 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-5cf4f293-9252-489b-a15e-0591f5beaa3b tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:55:09.869138 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-5cf4f293-9252-489b-a15e-0591f5beaa3b tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] [instance: 5d54db85-b991-4890-abaa-952413baa2e7] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:55:09.874606 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-5cf4f293-9252-489b-a15e-0591f5beaa3b tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:55:09.875049 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-5cf4f293-9252-489b-a15e-0591f5beaa3b tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:55:09.875803 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-5cf4f293-9252-489b-a15e-0591f5beaa3b tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:55:09.876234 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-5cf4f293-9252-489b-a15e-0591f5beaa3b tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:55:09.936033 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-5cf4f293-9252-489b-a15e-0591f5beaa3b tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37f21d6d15cf40a586edda211219fd08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ebb970305844dccacf48a7d8d47ecf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:55:09.944448 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-5cf4f293-9252-489b-a15e-0591f5beaa3b tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '37f21d6d15cf40a586edda211219fd08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ebb970305844dccacf48a7d8d47ecf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:55:09.945966 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-5cf4f293-9252-489b-a15e-0591f5beaa3b tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '37f21d6d15cf40a586edda211219fd08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ebb970305844dccacf48a7d8d47ecf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:55:09.947090 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-5cf4f293-9252-489b-a15e-0591f5beaa3b tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] 10.222.0.11 "GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7" status: 200 len: 1444 microversion: 2.20 time: 0.081902 Nov 17 03:55:09.947640 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 1555/2845] 10.222.0.11 () {60 vars in 1276 bytes} [Wed Nov 17 03:55:09 2021] GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7 => generated 1444 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 17 03:55:09.999301 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 17 03:55:09.999301 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: Wed Nov 17 03:55:09 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-volumes/tempest-invalid-1518110631 (ip 10.222.0.11) !!! Nov 17 03:55:10.885380 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-44b854a3-c9fe-41d4-8f90-514ec3d816e5 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:55:10.886273 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-44b854a3-c9fe-41d4-8f90-514ec3d816e5 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] [instance: 15abb40f-daf9-4c4b-ac9c-55f57ee7b938] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:55:10.897174 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-44b854a3-c9fe-41d4-8f90-514ec3d816e5 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:55:10.897909 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-44b854a3-c9fe-41d4-8f90-514ec3d816e5 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:55:10.899169 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-44b854a3-c9fe-41d4-8f90-514ec3d816e5 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:55:10.899895 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-44b854a3-c9fe-41d4-8f90-514ec3d816e5 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:55:11.038901 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-44b854a3-c9fe-41d4-8f90-514ec3d816e5 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a792b5b7e6f7461b8d802a5abaaa9518', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e843a3fb49f41dcb376184d7e156528', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:55:11.046840 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-44b854a3-c9fe-41d4-8f90-514ec3d816e5 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] 10.222.0.11 "GET /compute/v2.1/servers/15abb40f-daf9-4c4b-ac9c-55f57ee7b938" status: 200 len: 1558 microversion: 2.1 time: 0.167866 Nov 17 03:55:11.047405 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 1556/2846] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:55:10 2021] GET /compute/v2.1/servers/15abb40f-daf9-4c4b-ac9c-55f57ee7b938 => generated 1558 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:55:11.052424 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-6787f614-e36a-4470-bcc3-bc93e24c1967 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:55:11.053087 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-6787f614-e36a-4470-bcc3-bc93e24c1967 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] [instance: 5d54db85-b991-4890-abaa-952413baa2e7] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:55:11.059034 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-6787f614-e36a-4470-bcc3-bc93e24c1967 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:55:11.059482 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-6787f614-e36a-4470-bcc3-bc93e24c1967 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:55:11.060263 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-6787f614-e36a-4470-bcc3-bc93e24c1967 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:55:11.060697 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-6787f614-e36a-4470-bcc3-bc93e24c1967 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:55:11.121237 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-6787f614-e36a-4470-bcc3-bc93e24c1967 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37f21d6d15cf40a586edda211219fd08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ebb970305844dccacf48a7d8d47ecf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:55:11.130195 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-6787f614-e36a-4470-bcc3-bc93e24c1967 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '37f21d6d15cf40a586edda211219fd08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ebb970305844dccacf48a7d8d47ecf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:55:11.131687 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-6787f614-e36a-4470-bcc3-bc93e24c1967 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '37f21d6d15cf40a586edda211219fd08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ebb970305844dccacf48a7d8d47ecf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:55:11.132828 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-6787f614-e36a-4470-bcc3-bc93e24c1967 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] 10.222.0.11 "GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7" status: 200 len: 1444 microversion: 2.20 time: 0.084519 Nov 17 03:55:11.133417 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 1557/2847] 10.222.0.11 () {60 vars in 1276 bytes} [Wed Nov 17 03:55:11 2021] GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7 => generated 1444 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 17 03:55:12.068112 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-07650726-19e0-4d1e-81dc-3ead929e778c tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:55:12.069106 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-07650726-19e0-4d1e-81dc-3ead929e778c tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] [instance: 15abb40f-daf9-4c4b-ac9c-55f57ee7b938] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:55:12.078245 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-07650726-19e0-4d1e-81dc-3ead929e778c tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:55:12.078696 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-07650726-19e0-4d1e-81dc-3ead929e778c tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:55:12.079458 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-07650726-19e0-4d1e-81dc-3ead929e778c tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:55:12.079883 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-07650726-19e0-4d1e-81dc-3ead929e778c tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:55:12.229152 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-07650726-19e0-4d1e-81dc-3ead929e778c tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a792b5b7e6f7461b8d802a5abaaa9518', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e843a3fb49f41dcb376184d7e156528', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:55:12.237313 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-07650726-19e0-4d1e-81dc-3ead929e778c tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] 10.222.0.11 "GET /compute/v2.1/servers/15abb40f-daf9-4c4b-ac9c-55f57ee7b938" status: 200 len: 1558 microversion: 2.1 time: 0.174841 Nov 17 03:55:12.237927 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 1558/2848] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:55:12 2021] GET /compute/v2.1/servers/15abb40f-daf9-4c4b-ac9c-55f57ee7b938 => generated 1558 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:55:12.242132 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-97652663-9fc0-4663-ae21-f90ca1696de5 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:55:12.242734 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-97652663-9fc0-4663-ae21-f90ca1696de5 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] [instance: 5d54db85-b991-4890-abaa-952413baa2e7] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:55:12.248227 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-97652663-9fc0-4663-ae21-f90ca1696de5 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:55:12.248708 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-97652663-9fc0-4663-ae21-f90ca1696de5 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:55:12.249505 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-97652663-9fc0-4663-ae21-f90ca1696de5 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:55:12.249941 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-97652663-9fc0-4663-ae21-f90ca1696de5 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:55:12.316064 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-97652663-9fc0-4663-ae21-f90ca1696de5 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37f21d6d15cf40a586edda211219fd08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ebb970305844dccacf48a7d8d47ecf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:55:12.324896 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-97652663-9fc0-4663-ae21-f90ca1696de5 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '37f21d6d15cf40a586edda211219fd08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ebb970305844dccacf48a7d8d47ecf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:55:12.326372 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-97652663-9fc0-4663-ae21-f90ca1696de5 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '37f21d6d15cf40a586edda211219fd08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ebb970305844dccacf48a7d8d47ecf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:55:12.327547 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-97652663-9fc0-4663-ae21-f90ca1696de5 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] 10.222.0.11 "GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7" status: 200 len: 1444 microversion: 2.20 time: 0.088703 Nov 17 03:55:12.328102 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 1559/2849] 10.222.0.11 () {60 vars in 1276 bytes} [Wed Nov 17 03:55:12 2021] GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7 => generated 1444 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 17 03:55:13.258580 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-d8abebec-e119-44f1-9aa7-33781a4ab2d9 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:55:13.259673 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-d8abebec-e119-44f1-9aa7-33781a4ab2d9 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] [instance: 15abb40f-daf9-4c4b-ac9c-55f57ee7b938] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:55:13.270349 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-d8abebec-e119-44f1-9aa7-33781a4ab2d9 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:55:13.271124 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-d8abebec-e119-44f1-9aa7-33781a4ab2d9 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:55:13.272377 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-d8abebec-e119-44f1-9aa7-33781a4ab2d9 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:55:13.273151 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-d8abebec-e119-44f1-9aa7-33781a4ab2d9 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:55:13.408746 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-d8abebec-e119-44f1-9aa7-33781a4ab2d9 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a792b5b7e6f7461b8d802a5abaaa9518', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e843a3fb49f41dcb376184d7e156528', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:55:13.417002 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-d8abebec-e119-44f1-9aa7-33781a4ab2d9 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] 10.222.0.11 "GET /compute/v2.1/servers/15abb40f-daf9-4c4b-ac9c-55f57ee7b938" status: 200 len: 1558 microversion: 2.1 time: 0.164510 Nov 17 03:55:13.417596 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 1560/2850] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:55:13 2021] GET /compute/v2.1/servers/15abb40f-daf9-4c4b-ac9c-55f57ee7b938 => generated 1558 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:55:13.427242 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-3308e5a1-6c2f-4c2f-a067-8f20918a2cdd tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:55:13.427242 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-3308e5a1-6c2f-4c2f-a067-8f20918a2cdd tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] [instance: 5d54db85-b991-4890-abaa-952413baa2e7] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:55:13.429120 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-3308e5a1-6c2f-4c2f-a067-8f20918a2cdd tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:55:13.429570 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-3308e5a1-6c2f-4c2f-a067-8f20918a2cdd tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:55:13.430335 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-3308e5a1-6c2f-4c2f-a067-8f20918a2cdd tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:55:13.430770 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-3308e5a1-6c2f-4c2f-a067-8f20918a2cdd tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:55:13.490589 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-3308e5a1-6c2f-4c2f-a067-8f20918a2cdd tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37f21d6d15cf40a586edda211219fd08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ebb970305844dccacf48a7d8d47ecf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:55:13.500034 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-3308e5a1-6c2f-4c2f-a067-8f20918a2cdd tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '37f21d6d15cf40a586edda211219fd08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ebb970305844dccacf48a7d8d47ecf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:55:13.502192 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-3308e5a1-6c2f-4c2f-a067-8f20918a2cdd tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '37f21d6d15cf40a586edda211219fd08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ebb970305844dccacf48a7d8d47ecf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:55:13.503778 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-3308e5a1-6c2f-4c2f-a067-8f20918a2cdd tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] 10.222.0.11 "GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7" status: 200 len: 1444 microversion: 2.20 time: 0.085150 Nov 17 03:55:13.504456 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 1561/2851] 10.222.0.11 () {60 vars in 1276 bytes} [Wed Nov 17 03:55:13 2021] GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7 => generated 1444 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 17 03:55:14.435879 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-11be7fcb-f526-4c80-96e1-c0be81fb6dab tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:55:14.436669 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-11be7fcb-f526-4c80-96e1-c0be81fb6dab tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] [instance: 15abb40f-daf9-4c4b-ac9c-55f57ee7b938] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:55:14.444432 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-11be7fcb-f526-4c80-96e1-c0be81fb6dab tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:55:14.445087 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-11be7fcb-f526-4c80-96e1-c0be81fb6dab tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:55:14.446020 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-11be7fcb-f526-4c80-96e1-c0be81fb6dab tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:55:14.446519 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-11be7fcb-f526-4c80-96e1-c0be81fb6dab tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:55:14.590897 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-11be7fcb-f526-4c80-96e1-c0be81fb6dab tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a792b5b7e6f7461b8d802a5abaaa9518', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e843a3fb49f41dcb376184d7e156528', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:55:14.599408 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-11be7fcb-f526-4c80-96e1-c0be81fb6dab tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] 10.222.0.11 "GET /compute/v2.1/servers/15abb40f-daf9-4c4b-ac9c-55f57ee7b938" status: 200 len: 1558 microversion: 2.1 time: 0.168035 Nov 17 03:55:14.599976 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 1562/2852] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:55:14 2021] GET /compute/v2.1/servers/15abb40f-daf9-4c4b-ac9c-55f57ee7b938 => generated 1558 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:55:14.604225 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-2e8422e4-7f73-43aa-b60e-bd855948bfe0 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:55:14.604808 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-2e8422e4-7f73-43aa-b60e-bd855948bfe0 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] [instance: 5d54db85-b991-4890-abaa-952413baa2e7] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:55:14.611305 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-2e8422e4-7f73-43aa-b60e-bd855948bfe0 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:55:14.611747 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-2e8422e4-7f73-43aa-b60e-bd855948bfe0 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:55:14.612508 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-2e8422e4-7f73-43aa-b60e-bd855948bfe0 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:55:14.612986 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-2e8422e4-7f73-43aa-b60e-bd855948bfe0 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:55:14.674341 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-2e8422e4-7f73-43aa-b60e-bd855948bfe0 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37f21d6d15cf40a586edda211219fd08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ebb970305844dccacf48a7d8d47ecf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:55:14.682978 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-2e8422e4-7f73-43aa-b60e-bd855948bfe0 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '37f21d6d15cf40a586edda211219fd08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ebb970305844dccacf48a7d8d47ecf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:55:14.684448 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-2e8422e4-7f73-43aa-b60e-bd855948bfe0 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '37f21d6d15cf40a586edda211219fd08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ebb970305844dccacf48a7d8d47ecf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:55:14.685609 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-2e8422e4-7f73-43aa-b60e-bd855948bfe0 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] 10.222.0.11 "GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7" status: 200 len: 1444 microversion: 2.20 time: 0.084711 Nov 17 03:55:14.686454 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 1563/2853] 10.222.0.11 () {60 vars in 1276 bytes} [Wed Nov 17 03:55:14 2021] GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7 => generated 1444 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 17 03:55:15.621087 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-c62cef75-1219-4e7e-9874-c70120a426b2 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:55:15.622212 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-c62cef75-1219-4e7e-9874-c70120a426b2 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] [instance: 15abb40f-daf9-4c4b-ac9c-55f57ee7b938] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:55:15.632958 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-c62cef75-1219-4e7e-9874-c70120a426b2 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:55:15.633704 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-c62cef75-1219-4e7e-9874-c70120a426b2 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:55:15.634958 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-c62cef75-1219-4e7e-9874-c70120a426b2 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:55:15.635679 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-c62cef75-1219-4e7e-9874-c70120a426b2 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:55:15.776995 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-c62cef75-1219-4e7e-9874-c70120a426b2 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a792b5b7e6f7461b8d802a5abaaa9518', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e843a3fb49f41dcb376184d7e156528', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:55:15.785742 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-c62cef75-1219-4e7e-9874-c70120a426b2 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] 10.222.0.11 "GET /compute/v2.1/servers/15abb40f-daf9-4c4b-ac9c-55f57ee7b938" status: 200 len: 1558 microversion: 2.1 time: 0.170872 Nov 17 03:55:15.786292 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 1564/2854] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:55:15 2021] GET /compute/v2.1/servers/15abb40f-daf9-4c4b-ac9c-55f57ee7b938 => generated 1558 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:55:15.790531 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-25c9c6e4-df49-4e04-9ff6-8046c3063ded tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:55:15.791124 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-25c9c6e4-df49-4e04-9ff6-8046c3063ded tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] [instance: 5d54db85-b991-4890-abaa-952413baa2e7] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:55:15.797526 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-25c9c6e4-df49-4e04-9ff6-8046c3063ded tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:55:15.797976 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-25c9c6e4-df49-4e04-9ff6-8046c3063ded tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:55:15.798745 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-25c9c6e4-df49-4e04-9ff6-8046c3063ded tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:55:15.799150 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-25c9c6e4-df49-4e04-9ff6-8046c3063ded tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:55:15.869261 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-25c9c6e4-df49-4e04-9ff6-8046c3063ded tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37f21d6d15cf40a586edda211219fd08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ebb970305844dccacf48a7d8d47ecf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:55:15.880050 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-25c9c6e4-df49-4e04-9ff6-8046c3063ded tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '37f21d6d15cf40a586edda211219fd08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ebb970305844dccacf48a7d8d47ecf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:55:15.881619 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-25c9c6e4-df49-4e04-9ff6-8046c3063ded tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '37f21d6d15cf40a586edda211219fd08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ebb970305844dccacf48a7d8d47ecf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:55:15.882754 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-25c9c6e4-df49-4e04-9ff6-8046c3063ded tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] 10.222.0.11 "GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7" status: 200 len: 1444 microversion: 2.20 time: 0.095549 Nov 17 03:55:15.883312 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 1565/2855] 10.222.0.11 () {60 vars in 1276 bytes} [Wed Nov 17 03:55:15 2021] GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7 => generated 1444 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 17 03:55:16.807656 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-d0ca7fc3-abaa-451f-8b07-9d019dd21ab6 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:55:16.808769 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-d0ca7fc3-abaa-451f-8b07-9d019dd21ab6 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] [instance: 15abb40f-daf9-4c4b-ac9c-55f57ee7b938] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:55:16.816941 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-d0ca7fc3-abaa-451f-8b07-9d019dd21ab6 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:55:16.817446 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-d0ca7fc3-abaa-451f-8b07-9d019dd21ab6 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:55:16.818317 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-d0ca7fc3-abaa-451f-8b07-9d019dd21ab6 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:55:16.818801 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-d0ca7fc3-abaa-451f-8b07-9d019dd21ab6 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:55:16.972300 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-d0ca7fc3-abaa-451f-8b07-9d019dd21ab6 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a792b5b7e6f7461b8d802a5abaaa9518', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e843a3fb49f41dcb376184d7e156528', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:55:16.980695 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-d0ca7fc3-abaa-451f-8b07-9d019dd21ab6 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] 10.222.0.11 "GET /compute/v2.1/servers/15abb40f-daf9-4c4b-ac9c-55f57ee7b938" status: 200 len: 1558 microversion: 2.1 time: 0.179737 Nov 17 03:55:16.981308 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 1566/2856] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:55:16 2021] GET /compute/v2.1/servers/15abb40f-daf9-4c4b-ac9c-55f57ee7b938 => generated 1558 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:55:16.985745 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-83cc3c85-a674-4b27-9cf7-8bc61360d276 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:55:16.986348 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-83cc3c85-a674-4b27-9cf7-8bc61360d276 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] [instance: 5d54db85-b991-4890-abaa-952413baa2e7] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:55:16.992268 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-83cc3c85-a674-4b27-9cf7-8bc61360d276 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:55:16.992719 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-83cc3c85-a674-4b27-9cf7-8bc61360d276 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:55:16.993525 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-83cc3c85-a674-4b27-9cf7-8bc61360d276 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:55:16.993958 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-83cc3c85-a674-4b27-9cf7-8bc61360d276 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:55:17.053841 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-83cc3c85-a674-4b27-9cf7-8bc61360d276 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37f21d6d15cf40a586edda211219fd08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ebb970305844dccacf48a7d8d47ecf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:55:17.062739 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-83cc3c85-a674-4b27-9cf7-8bc61360d276 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '37f21d6d15cf40a586edda211219fd08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ebb970305844dccacf48a7d8d47ecf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:55:17.064165 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-83cc3c85-a674-4b27-9cf7-8bc61360d276 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '37f21d6d15cf40a586edda211219fd08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ebb970305844dccacf48a7d8d47ecf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:55:17.065479 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-83cc3c85-a674-4b27-9cf7-8bc61360d276 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] 10.222.0.11 "GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7" status: 200 len: 1444 microversion: 2.20 time: 0.083246 Nov 17 03:55:17.066039 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 1567/2857] 10.222.0.11 () {60 vars in 1276 bytes} [Wed Nov 17 03:55:16 2021] GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7 => generated 1444 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 17 03:55:17.998271 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-7cef4382-e5b4-4d96-ba44-7d51eb5deacf tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:55:17.999112 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-7cef4382-e5b4-4d96-ba44-7d51eb5deacf tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] [instance: 15abb40f-daf9-4c4b-ac9c-55f57ee7b938] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:55:18.006347 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-7cef4382-e5b4-4d96-ba44-7d51eb5deacf tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:55:18.006786 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-7cef4382-e5b4-4d96-ba44-7d51eb5deacf tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:55:18.007830 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-7cef4382-e5b4-4d96-ba44-7d51eb5deacf tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:55:18.008254 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-7cef4382-e5b4-4d96-ba44-7d51eb5deacf tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:55:18.145638 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-7cef4382-e5b4-4d96-ba44-7d51eb5deacf tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a792b5b7e6f7461b8d802a5abaaa9518', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e843a3fb49f41dcb376184d7e156528', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:55:18.154181 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-7cef4382-e5b4-4d96-ba44-7d51eb5deacf tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] 10.222.0.11 "GET /compute/v2.1/servers/15abb40f-daf9-4c4b-ac9c-55f57ee7b938" status: 200 len: 1558 microversion: 2.1 time: 0.159706 Nov 17 03:55:18.154846 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 1568/2858] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:55:17 2021] GET /compute/v2.1/servers/15abb40f-daf9-4c4b-ac9c-55f57ee7b938 => generated 1558 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 17 03:55:18.159359 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-b60a4f2c-85d7-4b72-b6ab-91f7f48621e0 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:55:18.159954 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-b60a4f2c-85d7-4b72-b6ab-91f7f48621e0 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] [instance: 5d54db85-b991-4890-abaa-952413baa2e7] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:55:18.165935 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-b60a4f2c-85d7-4b72-b6ab-91f7f48621e0 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:55:18.166381 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-b60a4f2c-85d7-4b72-b6ab-91f7f48621e0 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:55:18.167146 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-b60a4f2c-85d7-4b72-b6ab-91f7f48621e0 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:55:18.167570 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-b60a4f2c-85d7-4b72-b6ab-91f7f48621e0 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:55:18.230142 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-b60a4f2c-85d7-4b72-b6ab-91f7f48621e0 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37f21d6d15cf40a586edda211219fd08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ebb970305844dccacf48a7d8d47ecf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:55:18.239049 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-b60a4f2c-85d7-4b72-b6ab-91f7f48621e0 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '37f21d6d15cf40a586edda211219fd08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ebb970305844dccacf48a7d8d47ecf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:55:18.240543 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-b60a4f2c-85d7-4b72-b6ab-91f7f48621e0 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '37f21d6d15cf40a586edda211219fd08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ebb970305844dccacf48a7d8d47ecf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:55:18.241713 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-b60a4f2c-85d7-4b72-b6ab-91f7f48621e0 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] 10.222.0.11 "GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7" status: 200 len: 1444 microversion: 2.20 time: 0.085740 Nov 17 03:55:18.242276 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 1569/2859] 10.222.0.11 () {60 vars in 1276 bytes} [Wed Nov 17 03:55:18 2021] GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7 => generated 1444 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 17 03:55:19.175250 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-e9404677-07f8-4b0d-8b27-bf9bed4810ac tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:55:19.176695 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-e9404677-07f8-4b0d-8b27-bf9bed4810ac tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] [instance: 15abb40f-daf9-4c4b-ac9c-55f57ee7b938] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:55:19.187424 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-e9404677-07f8-4b0d-8b27-bf9bed4810ac tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:55:19.188170 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-e9404677-07f8-4b0d-8b27-bf9bed4810ac tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:55:19.189480 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-e9404677-07f8-4b0d-8b27-bf9bed4810ac tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:55:19.190232 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-e9404677-07f8-4b0d-8b27-bf9bed4810ac tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:55:19.334884 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-e9404677-07f8-4b0d-8b27-bf9bed4810ac tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a792b5b7e6f7461b8d802a5abaaa9518', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e843a3fb49f41dcb376184d7e156528', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:55:19.343717 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-e9404677-07f8-4b0d-8b27-bf9bed4810ac tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] 10.222.0.11 "GET /compute/v2.1/servers/15abb40f-daf9-4c4b-ac9c-55f57ee7b938" status: 200 len: 1558 microversion: 2.1 time: 0.174687 Nov 17 03:55:19.344302 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 1570/2860] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:55:19 2021] GET /compute/v2.1/servers/15abb40f-daf9-4c4b-ac9c-55f57ee7b938 => generated 1558 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:55:19.348588 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-b98dd5bb-97c9-4c91-90b7-e3282117cb14 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:55:19.349218 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-b98dd5bb-97c9-4c91-90b7-e3282117cb14 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] [instance: 5d54db85-b991-4890-abaa-952413baa2e7] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:55:19.355219 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-b98dd5bb-97c9-4c91-90b7-e3282117cb14 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:55:19.355665 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-b98dd5bb-97c9-4c91-90b7-e3282117cb14 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:55:19.356435 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-b98dd5bb-97c9-4c91-90b7-e3282117cb14 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:55:19.356934 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-b98dd5bb-97c9-4c91-90b7-e3282117cb14 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:55:19.418689 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-b98dd5bb-97c9-4c91-90b7-e3282117cb14 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37f21d6d15cf40a586edda211219fd08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ebb970305844dccacf48a7d8d47ecf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:55:19.427844 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-b98dd5bb-97c9-4c91-90b7-e3282117cb14 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '37f21d6d15cf40a586edda211219fd08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ebb970305844dccacf48a7d8d47ecf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:55:19.429393 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-b98dd5bb-97c9-4c91-90b7-e3282117cb14 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '37f21d6d15cf40a586edda211219fd08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ebb970305844dccacf48a7d8d47ecf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:55:19.430538 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-b98dd5bb-97c9-4c91-90b7-e3282117cb14 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] 10.222.0.11 "GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7" status: 200 len: 1444 microversion: 2.20 time: 0.085321 Nov 17 03:55:19.431093 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 1571/2861] 10.222.0.11 () {60 vars in 1276 bytes} [Wed Nov 17 03:55:19 2021] GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7 => generated 1444 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 17 03:55:20.547406 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-a04fe040-ad18-4f4d-ab5b-8af17bbd390a tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:55:20.548022 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-a04fe040-ad18-4f4d-ab5b-8af17bbd390a tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] [instance: 15abb40f-daf9-4c4b-ac9c-55f57ee7b938] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:55:20.554602 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-a04fe040-ad18-4f4d-ab5b-8af17bbd390a tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:55:20.555063 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-a04fe040-ad18-4f4d-ab5b-8af17bbd390a tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:55:20.555825 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-a04fe040-ad18-4f4d-ab5b-8af17bbd390a tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:55:20.556249 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-a04fe040-ad18-4f4d-ab5b-8af17bbd390a tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:55:20.692661 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-a04fe040-ad18-4f4d-ab5b-8af17bbd390a tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a792b5b7e6f7461b8d802a5abaaa9518', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e843a3fb49f41dcb376184d7e156528', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:55:20.701249 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-a04fe040-ad18-4f4d-ab5b-8af17bbd390a tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] 10.222.0.11 "GET /compute/v2.1/servers/15abb40f-daf9-4c4b-ac9c-55f57ee7b938" status: 200 len: 1558 microversion: 2.1 time: 0.343807 Nov 17 03:55:20.701925 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 1572/2862] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:55:20 2021] GET /compute/v2.1/servers/15abb40f-daf9-4c4b-ac9c-55f57ee7b938 => generated 1558 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:55:20.706116 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-2e66865e-82f5-4389-831a-02c160a581cd tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:55:20.706706 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-2e66865e-82f5-4389-831a-02c160a581cd tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] [instance: 5d54db85-b991-4890-abaa-952413baa2e7] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:55:20.712464 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-2e66865e-82f5-4389-831a-02c160a581cd tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:55:20.713036 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-2e66865e-82f5-4389-831a-02c160a581cd tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:55:20.713845 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-2e66865e-82f5-4389-831a-02c160a581cd tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:55:20.714277 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-2e66865e-82f5-4389-831a-02c160a581cd tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:55:20.774062 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-2e66865e-82f5-4389-831a-02c160a581cd tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37f21d6d15cf40a586edda211219fd08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ebb970305844dccacf48a7d8d47ecf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:55:20.783413 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-2e66865e-82f5-4389-831a-02c160a581cd tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '37f21d6d15cf40a586edda211219fd08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ebb970305844dccacf48a7d8d47ecf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:55:20.784949 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-2e66865e-82f5-4389-831a-02c160a581cd tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '37f21d6d15cf40a586edda211219fd08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ebb970305844dccacf48a7d8d47ecf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:55:20.786080 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-2e66865e-82f5-4389-831a-02c160a581cd tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] 10.222.0.11 "GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7" status: 200 len: 1444 microversion: 2.20 time: 0.083207 Nov 17 03:55:20.786646 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 1573/2863] 10.222.0.11 () {60 vars in 1276 bytes} [Wed Nov 17 03:55:20 2021] GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7 => generated 1444 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 17 03:55:21.722750 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-8f53374e-e0ec-45d5-b4f8-2c6dec1ff9a2 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:55:21.723888 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-8f53374e-e0ec-45d5-b4f8-2c6dec1ff9a2 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] [instance: 15abb40f-daf9-4c4b-ac9c-55f57ee7b938] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:55:21.733855 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-8f53374e-e0ec-45d5-b4f8-2c6dec1ff9a2 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:55:21.734299 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-8f53374e-e0ec-45d5-b4f8-2c6dec1ff9a2 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:55:21.735047 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-8f53374e-e0ec-45d5-b4f8-2c6dec1ff9a2 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:55:21.735486 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-8f53374e-e0ec-45d5-b4f8-2c6dec1ff9a2 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:55:21.872420 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-8f53374e-e0ec-45d5-b4f8-2c6dec1ff9a2 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a792b5b7e6f7461b8d802a5abaaa9518', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e843a3fb49f41dcb376184d7e156528', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:55:21.882558 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-8f53374e-e0ec-45d5-b4f8-2c6dec1ff9a2 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] 10.222.0.11 "GET /compute/v2.1/servers/15abb40f-daf9-4c4b-ac9c-55f57ee7b938" status: 200 len: 1558 microversion: 2.1 time: 0.166037 Nov 17 03:55:21.883135 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 1574/2864] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:55:21 2021] GET /compute/v2.1/servers/15abb40f-daf9-4c4b-ac9c-55f57ee7b938 => generated 1558 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:55:21.887405 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-ddb56034-4d83-4bbf-805f-a52df8f915a7 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:55:21.888001 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-ddb56034-4d83-4bbf-805f-a52df8f915a7 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] [instance: 5d54db85-b991-4890-abaa-952413baa2e7] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:55:21.894043 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-ddb56034-4d83-4bbf-805f-a52df8f915a7 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:55:21.894472 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-ddb56034-4d83-4bbf-805f-a52df8f915a7 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:55:21.895224 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-ddb56034-4d83-4bbf-805f-a52df8f915a7 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:55:21.895654 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-ddb56034-4d83-4bbf-805f-a52df8f915a7 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:55:21.956818 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-ddb56034-4d83-4bbf-805f-a52df8f915a7 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37f21d6d15cf40a586edda211219fd08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ebb970305844dccacf48a7d8d47ecf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:55:21.965233 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-ddb56034-4d83-4bbf-805f-a52df8f915a7 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '37f21d6d15cf40a586edda211219fd08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ebb970305844dccacf48a7d8d47ecf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:55:21.966703 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-ddb56034-4d83-4bbf-805f-a52df8f915a7 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '37f21d6d15cf40a586edda211219fd08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ebb970305844dccacf48a7d8d47ecf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:55:21.968037 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-ddb56034-4d83-4bbf-805f-a52df8f915a7 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] 10.222.0.11 "GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7" status: 200 len: 1444 microversion: 2.20 time: 0.083853 Nov 17 03:55:21.968590 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 1575/2865] 10.222.0.11 () {60 vars in 1276 bytes} [Wed Nov 17 03:55:21 2021] GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7 => generated 1444 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 17 03:55:22.903746 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-b99510c7-ca3e-4ef7-abd1-75003a9adb1e tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:55:22.904998 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-b99510c7-ca3e-4ef7-abd1-75003a9adb1e tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] [instance: 15abb40f-daf9-4c4b-ac9c-55f57ee7b938] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:55:22.915662 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-b99510c7-ca3e-4ef7-abd1-75003a9adb1e tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:55:22.916411 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-b99510c7-ca3e-4ef7-abd1-75003a9adb1e tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:55:22.917748 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-b99510c7-ca3e-4ef7-abd1-75003a9adb1e tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:55:22.918464 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-b99510c7-ca3e-4ef7-abd1-75003a9adb1e tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:55:23.062392 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-b99510c7-ca3e-4ef7-abd1-75003a9adb1e tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a792b5b7e6f7461b8d802a5abaaa9518', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e843a3fb49f41dcb376184d7e156528', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:55:23.071192 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-b99510c7-ca3e-4ef7-abd1-75003a9adb1e tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] 10.222.0.11 "GET /compute/v2.1/servers/15abb40f-daf9-4c4b-ac9c-55f57ee7b938" status: 200 len: 1558 microversion: 2.1 time: 0.173630 Nov 17 03:55:23.071764 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 1576/2866] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:55:22 2021] GET /compute/v2.1/servers/15abb40f-daf9-4c4b-ac9c-55f57ee7b938 => generated 1558 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:55:23.075978 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-ce4d4d1c-74ce-487a-938e-2cfb086a346a tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:55:23.076637 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-ce4d4d1c-74ce-487a-938e-2cfb086a346a tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] [instance: 5d54db85-b991-4890-abaa-952413baa2e7] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:55:23.082649 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-ce4d4d1c-74ce-487a-938e-2cfb086a346a tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:55:23.083111 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-ce4d4d1c-74ce-487a-938e-2cfb086a346a tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:55:23.083911 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-ce4d4d1c-74ce-487a-938e-2cfb086a346a tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:55:23.084350 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-ce4d4d1c-74ce-487a-938e-2cfb086a346a tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:55:23.151682 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-ce4d4d1c-74ce-487a-938e-2cfb086a346a tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37f21d6d15cf40a586edda211219fd08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ebb970305844dccacf48a7d8d47ecf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:55:23.160549 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-ce4d4d1c-74ce-487a-938e-2cfb086a346a tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '37f21d6d15cf40a586edda211219fd08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ebb970305844dccacf48a7d8d47ecf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:55:23.161986 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-ce4d4d1c-74ce-487a-938e-2cfb086a346a tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '37f21d6d15cf40a586edda211219fd08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ebb970305844dccacf48a7d8d47ecf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:55:23.163128 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-ce4d4d1c-74ce-487a-938e-2cfb086a346a tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] 10.222.0.11 "GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7" status: 200 len: 1444 microversion: 2.20 time: 0.090449 Nov 17 03:55:23.163688 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 1577/2867] 10.222.0.11 () {60 vars in 1276 bytes} [Wed Nov 17 03:55:23 2021] GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7 => generated 1444 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 17 03:55:24.088828 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-a6a3d9ba-bbd2-4c8c-8be3-3e75c1b01427 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:55:24.089452 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-a6a3d9ba-bbd2-4c8c-8be3-3e75c1b01427 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] [instance: 15abb40f-daf9-4c4b-ac9c-55f57ee7b938] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:55:24.096096 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-a6a3d9ba-bbd2-4c8c-8be3-3e75c1b01427 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:55:24.096551 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-a6a3d9ba-bbd2-4c8c-8be3-3e75c1b01427 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:55:24.097353 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-a6a3d9ba-bbd2-4c8c-8be3-3e75c1b01427 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:55:24.097787 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-a6a3d9ba-bbd2-4c8c-8be3-3e75c1b01427 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:55:24.232998 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-a6a3d9ba-bbd2-4c8c-8be3-3e75c1b01427 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a792b5b7e6f7461b8d802a5abaaa9518', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e843a3fb49f41dcb376184d7e156528', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:55:24.245028 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-a6a3d9ba-bbd2-4c8c-8be3-3e75c1b01427 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] 10.222.0.11 "GET /compute/v2.1/servers/15abb40f-daf9-4c4b-ac9c-55f57ee7b938" status: 200 len: 1558 microversion: 2.1 time: 0.159521 Nov 17 03:55:24.245818 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 1578/2868] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:55:24 2021] GET /compute/v2.1/servers/15abb40f-daf9-4c4b-ac9c-55f57ee7b938 => generated 1558 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:55:24.250940 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-f4753d4d-deb1-4b4d-abb5-1f90b7815268 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:55:24.251538 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-f4753d4d-deb1-4b4d-abb5-1f90b7815268 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] [instance: 5d54db85-b991-4890-abaa-952413baa2e7] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:55:24.257126 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-f4753d4d-deb1-4b4d-abb5-1f90b7815268 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:55:24.257583 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-f4753d4d-deb1-4b4d-abb5-1f90b7815268 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:55:24.258351 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-f4753d4d-deb1-4b4d-abb5-1f90b7815268 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:55:24.258796 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-f4753d4d-deb1-4b4d-abb5-1f90b7815268 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:55:24.325165 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-f4753d4d-deb1-4b4d-abb5-1f90b7815268 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37f21d6d15cf40a586edda211219fd08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ebb970305844dccacf48a7d8d47ecf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:55:24.341087 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-f4753d4d-deb1-4b4d-abb5-1f90b7815268 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '37f21d6d15cf40a586edda211219fd08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ebb970305844dccacf48a7d8d47ecf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:55:24.343643 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-f4753d4d-deb1-4b4d-abb5-1f90b7815268 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '37f21d6d15cf40a586edda211219fd08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ebb970305844dccacf48a7d8d47ecf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:55:24.344770 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-f4753d4d-deb1-4b4d-abb5-1f90b7815268 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] 10.222.0.11 "GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7" status: 200 len: 1444 microversion: 2.20 time: 0.097921 Nov 17 03:55:24.345350 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 1579/2869] 10.222.0.11 () {60 vars in 1276 bytes} [Wed Nov 17 03:55:24 2021] GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7 => generated 1444 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 17 03:55:25.267703 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-cf3f5935-c349-4a08-8c9c-f2d5b42df94c tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:55:25.268760 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-cf3f5935-c349-4a08-8c9c-f2d5b42df94c tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] [instance: 15abb40f-daf9-4c4b-ac9c-55f57ee7b938] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:55:25.279437 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-cf3f5935-c349-4a08-8c9c-f2d5b42df94c tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:55:25.280371 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-cf3f5935-c349-4a08-8c9c-f2d5b42df94c tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:55:25.281218 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-cf3f5935-c349-4a08-8c9c-f2d5b42df94c tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:55:25.281632 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-cf3f5935-c349-4a08-8c9c-f2d5b42df94c tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:55:25.418225 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-cf3f5935-c349-4a08-8c9c-f2d5b42df94c tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a792b5b7e6f7461b8d802a5abaaa9518', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e843a3fb49f41dcb376184d7e156528', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:55:25.431602 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-cf3f5935-c349-4a08-8c9c-f2d5b42df94c tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] 10.222.0.11 "GET /compute/v2.1/servers/15abb40f-daf9-4c4b-ac9c-55f57ee7b938" status: 200 len: 1558 microversion: 2.1 time: 0.170137 Nov 17 03:55:25.432407 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 1580/2870] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:55:25 2021] GET /compute/v2.1/servers/15abb40f-daf9-4c4b-ac9c-55f57ee7b938 => generated 1558 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:55:25.438072 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-e824cad9-bdbf-405d-bd50-0d1bcc16970e tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:55:25.438652 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-e824cad9-bdbf-405d-bd50-0d1bcc16970e tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] [instance: 5d54db85-b991-4890-abaa-952413baa2e7] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:55:25.444141 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-e824cad9-bdbf-405d-bd50-0d1bcc16970e tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:55:25.444588 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-e824cad9-bdbf-405d-bd50-0d1bcc16970e tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:55:25.445388 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-e824cad9-bdbf-405d-bd50-0d1bcc16970e tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:55:25.445820 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-e824cad9-bdbf-405d-bd50-0d1bcc16970e tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:55:25.512487 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-e824cad9-bdbf-405d-bd50-0d1bcc16970e tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37f21d6d15cf40a586edda211219fd08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ebb970305844dccacf48a7d8d47ecf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:55:25.521942 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-e824cad9-bdbf-405d-bd50-0d1bcc16970e tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '37f21d6d15cf40a586edda211219fd08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ebb970305844dccacf48a7d8d47ecf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:55:25.523345 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-e824cad9-bdbf-405d-bd50-0d1bcc16970e tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '37f21d6d15cf40a586edda211219fd08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ebb970305844dccacf48a7d8d47ecf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:55:25.524469 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-e824cad9-bdbf-405d-bd50-0d1bcc16970e tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] 10.222.0.11 "GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7" status: 200 len: 1444 microversion: 2.20 time: 0.090922 Nov 17 03:55:25.525079 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 1581/2871] 10.222.0.11 () {60 vars in 1276 bytes} [Wed Nov 17 03:55:25 2021] GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7 => generated 1444 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 17 03:55:26.450737 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-ac7e5187-b0f0-4848-9d3e-d1e3eb3d02ee tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:55:26.451324 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-ac7e5187-b0f0-4848-9d3e-d1e3eb3d02ee tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] [instance: 15abb40f-daf9-4c4b-ac9c-55f57ee7b938] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:55:26.458081 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-ac7e5187-b0f0-4848-9d3e-d1e3eb3d02ee tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:55:26.458524 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-ac7e5187-b0f0-4848-9d3e-d1e3eb3d02ee tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:55:26.459301 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-ac7e5187-b0f0-4848-9d3e-d1e3eb3d02ee tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:55:26.459746 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-ac7e5187-b0f0-4848-9d3e-d1e3eb3d02ee tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:55:26.596936 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-ac7e5187-b0f0-4848-9d3e-d1e3eb3d02ee tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a792b5b7e6f7461b8d802a5abaaa9518', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e843a3fb49f41dcb376184d7e156528', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:55:26.608277 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-ac7e5187-b0f0-4848-9d3e-d1e3eb3d02ee tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] 10.222.0.11 "GET /compute/v2.1/servers/15abb40f-daf9-4c4b-ac9c-55f57ee7b938" status: 200 len: 1558 microversion: 2.1 time: 0.161091 Nov 17 03:55:26.608941 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 1582/2872] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:55:26 2021] GET /compute/v2.1/servers/15abb40f-daf9-4c4b-ac9c-55f57ee7b938 => generated 1558 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:55:26.613124 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-78be202e-8be5-404a-ad28-cefd6f4fe67c tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:55:26.613713 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-78be202e-8be5-404a-ad28-cefd6f4fe67c tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] [instance: 5d54db85-b991-4890-abaa-952413baa2e7] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:55:26.619536 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-78be202e-8be5-404a-ad28-cefd6f4fe67c tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:55:26.619975 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-78be202e-8be5-404a-ad28-cefd6f4fe67c tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:55:26.620727 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-78be202e-8be5-404a-ad28-cefd6f4fe67c tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:55:26.621179 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-78be202e-8be5-404a-ad28-cefd6f4fe67c tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:55:26.681945 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-78be202e-8be5-404a-ad28-cefd6f4fe67c tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37f21d6d15cf40a586edda211219fd08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ebb970305844dccacf48a7d8d47ecf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:55:26.690389 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-78be202e-8be5-404a-ad28-cefd6f4fe67c tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '37f21d6d15cf40a586edda211219fd08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ebb970305844dccacf48a7d8d47ecf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:55:26.691923 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-78be202e-8be5-404a-ad28-cefd6f4fe67c tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '37f21d6d15cf40a586edda211219fd08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ebb970305844dccacf48a7d8d47ecf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:55:26.693025 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-78be202e-8be5-404a-ad28-cefd6f4fe67c tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] 10.222.0.11 "GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7" status: 200 len: 1444 microversion: 2.20 time: 0.083148 Nov 17 03:55:26.693578 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 1583/2873] 10.222.0.11 () {60 vars in 1276 bytes} [Wed Nov 17 03:55:26 2021] GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7 => generated 1444 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 17 03:55:27.630433 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-b016ddeb-9b69-4148-b74e-c6a2ea5714ab tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:55:27.631485 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-b016ddeb-9b69-4148-b74e-c6a2ea5714ab tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] [instance: 15abb40f-daf9-4c4b-ac9c-55f57ee7b938] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:55:27.641740 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-b016ddeb-9b69-4148-b74e-c6a2ea5714ab tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:55:27.643064 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-b016ddeb-9b69-4148-b74e-c6a2ea5714ab tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:55:27.644534 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-b016ddeb-9b69-4148-b74e-c6a2ea5714ab tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:55:27.645394 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-b016ddeb-9b69-4148-b74e-c6a2ea5714ab tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:55:27.799870 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-b016ddeb-9b69-4148-b74e-c6a2ea5714ab tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a792b5b7e6f7461b8d802a5abaaa9518', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e843a3fb49f41dcb376184d7e156528', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:55:27.813795 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-b016ddeb-9b69-4148-b74e-c6a2ea5714ab tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] 10.222.0.11 "GET /compute/v2.1/servers/15abb40f-daf9-4c4b-ac9c-55f57ee7b938" status: 200 len: 1558 microversion: 2.1 time: 0.190381 Nov 17 03:55:27.814714 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 1584/2874] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:55:27 2021] GET /compute/v2.1/servers/15abb40f-daf9-4c4b-ac9c-55f57ee7b938 => generated 1558 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:55:27.821444 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-880743ff-243a-45f2-8b6c-9e1099f3455c tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:55:27.822397 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-880743ff-243a-45f2-8b6c-9e1099f3455c tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] [instance: 5d54db85-b991-4890-abaa-952413baa2e7] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:55:27.829172 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-880743ff-243a-45f2-8b6c-9e1099f3455c tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:55:27.829632 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-880743ff-243a-45f2-8b6c-9e1099f3455c tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:55:27.830399 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-880743ff-243a-45f2-8b6c-9e1099f3455c tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:55:27.830834 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-880743ff-243a-45f2-8b6c-9e1099f3455c tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:55:27.901854 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-880743ff-243a-45f2-8b6c-9e1099f3455c tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37f21d6d15cf40a586edda211219fd08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ebb970305844dccacf48a7d8d47ecf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:55:27.915795 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-880743ff-243a-45f2-8b6c-9e1099f3455c tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '37f21d6d15cf40a586edda211219fd08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ebb970305844dccacf48a7d8d47ecf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:55:27.918326 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-880743ff-243a-45f2-8b6c-9e1099f3455c tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '37f21d6d15cf40a586edda211219fd08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ebb970305844dccacf48a7d8d47ecf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:55:27.919999 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-880743ff-243a-45f2-8b6c-9e1099f3455c tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] 10.222.0.11 "GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7" status: 200 len: 1444 microversion: 2.20 time: 0.103914 Nov 17 03:55:27.921238 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 1585/2875] 10.222.0.11 () {60 vars in 1276 bytes} [Wed Nov 17 03:55:27 2021] GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7 => generated 1444 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 17 03:55:28.838560 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-57f7e013-079a-41b4-8671-a4feaa6a4dc0 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:55:28.839672 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-57f7e013-079a-41b4-8671-a4feaa6a4dc0 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] [instance: 15abb40f-daf9-4c4b-ac9c-55f57ee7b938] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:55:28.850391 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-57f7e013-079a-41b4-8671-a4feaa6a4dc0 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:55:28.851139 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-57f7e013-079a-41b4-8671-a4feaa6a4dc0 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:55:28.852408 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-57f7e013-079a-41b4-8671-a4feaa6a4dc0 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:55:28.853199 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-57f7e013-079a-41b4-8671-a4feaa6a4dc0 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:55:28.991459 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-57f7e013-079a-41b4-8671-a4feaa6a4dc0 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a792b5b7e6f7461b8d802a5abaaa9518', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e843a3fb49f41dcb376184d7e156528', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:55:29.000051 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-57f7e013-079a-41b4-8671-a4feaa6a4dc0 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] 10.222.0.11 "GET /compute/v2.1/servers/15abb40f-daf9-4c4b-ac9c-55f57ee7b938" status: 200 len: 1558 microversion: 2.1 time: 0.167669 Nov 17 03:55:29.000621 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 1586/2876] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:55:28 2021] GET /compute/v2.1/servers/15abb40f-daf9-4c4b-ac9c-55f57ee7b938 => generated 1558 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:55:29.004808 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-204f61f9-df35-483b-af35-8f4f43f505f0 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:55:29.005426 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-204f61f9-df35-483b-af35-8f4f43f505f0 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] [instance: 5d54db85-b991-4890-abaa-952413baa2e7] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:55:29.011198 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-204f61f9-df35-483b-af35-8f4f43f505f0 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:55:29.011642 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-204f61f9-df35-483b-af35-8f4f43f505f0 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:55:29.012400 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-204f61f9-df35-483b-af35-8f4f43f505f0 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:55:29.012822 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-204f61f9-df35-483b-af35-8f4f43f505f0 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:55:29.072703 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-204f61f9-df35-483b-af35-8f4f43f505f0 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37f21d6d15cf40a586edda211219fd08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ebb970305844dccacf48a7d8d47ecf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:55:29.081651 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-204f61f9-df35-483b-af35-8f4f43f505f0 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '37f21d6d15cf40a586edda211219fd08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ebb970305844dccacf48a7d8d47ecf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:55:29.083292 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-204f61f9-df35-483b-af35-8f4f43f505f0 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '37f21d6d15cf40a586edda211219fd08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ebb970305844dccacf48a7d8d47ecf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:55:29.084423 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-204f61f9-df35-483b-af35-8f4f43f505f0 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] 10.222.0.11 "GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7" status: 200 len: 1444 microversion: 2.20 time: 0.082860 Nov 17 03:55:29.084971 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 1587/2877] 10.222.0.11 () {60 vars in 1276 bytes} [Wed Nov 17 03:55:29 2021] GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7 => generated 1444 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 17 03:55:29.089151 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-6cf0c59b-b04e-4acf-be76-ba27b902a0c2 tempest-VolumesNegativeTest-1679335271 tempest-VolumesNegativeTest-1679335271-project] Calling method '.version_select at 0x7f9e1d0d2310>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:55:32.849173 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 17 03:55:32.850275 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: Wed Nov 17 03:55:32 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-volumes/tempest-invalid-1518110631 (ip 10.222.0.11) !!! Nov 17 03:56:21.852411 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.wsgi [None req-c60953c2-186d-48cf-977e-12c9b75012c6 tempest-VolumesNegativeTest-1679335271 tempest-VolumesNegativeTest-1679335271-project] HTTP exception thrown: Volume tempest-invalid-1518110631 could not be found. Nov 17 03:56:21.853053 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-c60953c2-186d-48cf-977e-12c9b75012c6 tempest-VolumesNegativeTest-1679335271 tempest-VolumesNegativeTest-1679335271-project] Returning 404 to user: Volume tempest-invalid-1518110631 could not be found. {{(pid=115916) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 17 03:56:21.853892 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-c60953c2-186d-48cf-977e-12c9b75012c6 tempest-VolumesNegativeTest-1679335271 tempest-VolumesNegativeTest-1679335271-project] 10.222.0.11 "DELETE /compute/v2.1/os-volumes/tempest-invalid-1518110631" status: 404 len: 99 microversion: 2.1 time: 112.871368 Nov 17 03:56:21.854519 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 1291/2878] 10.222.0.11 () {58 vars in 1217 bytes} [Wed Nov 17 03:54:28 2021] DELETE /compute/v2.1/os-volumes/tempest-invalid-1518110631 => generated 99 bytes in 112872 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Nov 17 03:56:21.860635 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-0ea45ce3-27cf-4c42-a6fb-4af1a6b27bad tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:56:21.861319 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-0ea45ce3-27cf-4c42-a6fb-4af1a6b27bad tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] [instance: 15abb40f-daf9-4c4b-ac9c-55f57ee7b938] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:56:21.868363 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-0ea45ce3-27cf-4c42-a6fb-4af1a6b27bad tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:56:21.868901 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-0ea45ce3-27cf-4c42-a6fb-4af1a6b27bad tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:56:21.869676 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-0ea45ce3-27cf-4c42-a6fb-4af1a6b27bad tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:56:21.870106 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-0ea45ce3-27cf-4c42-a6fb-4af1a6b27bad tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:56:22.004026 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-0ea45ce3-27cf-4c42-a6fb-4af1a6b27bad tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a792b5b7e6f7461b8d802a5abaaa9518', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e843a3fb49f41dcb376184d7e156528', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:56:22.012018 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-0ea45ce3-27cf-4c42-a6fb-4af1a6b27bad tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] 10.222.0.11 "GET /compute/v2.1/servers/15abb40f-daf9-4c4b-ac9c-55f57ee7b938" status: 200 len: 1558 microversion: 2.1 time: 0.156533 Nov 17 03:56:22.012649 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 1292/2879] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:56:21 2021] GET /compute/v2.1/servers/15abb40f-daf9-4c4b-ac9c-55f57ee7b938 => generated 1558 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:56:22.030565 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.wsgi [None req-6cf0c59b-b04e-4acf-be76-ba27b902a0c2 tempest-VolumesNegativeTest-1679335271 tempest-VolumesNegativeTest-1679335271-project] HTTP exception thrown: Volume tempest-invalid-1518110631 could not be found. Nov 17 03:56:22.031243 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-6cf0c59b-b04e-4acf-be76-ba27b902a0c2 tempest-VolumesNegativeTest-1679335271 tempest-VolumesNegativeTest-1679335271-project] Returning 404 to user: Volume tempest-invalid-1518110631 could not be found. {{(pid=115917) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 17 03:56:22.032544 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-6cf0c59b-b04e-4acf-be76-ba27b902a0c2 tempest-VolumesNegativeTest-1679335271 tempest-VolumesNegativeTest-1679335271-project] 10.222.0.11 "DELETE /compute/v2.1/os-volumes/tempest-invalid-1518110631" status: 404 len: 99 microversion: 2.1 time: 52.946533 Nov 17 03:56:22.033891 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 1588/2880] 10.222.0.11 () {58 vars in 1217 bytes} [Wed Nov 17 03:55:29 2021] DELETE /compute/v2.1/os-volumes/tempest-invalid-1518110631 => generated 99 bytes in 52948 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Nov 17 03:56:22.042631 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-b07c82e6-73d7-41fb-a130-de39aa30d975 tempest-VolumesNegativeTest-1679335271 tempest-VolumesNegativeTest-1679335271-project] 10.222.0.11 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.003434 Nov 17 03:56:22.043408 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 1589/2881] 10.222.0.11 () {58 vars in 1139 bytes} [Wed Nov 17 03:56:22 2021] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 5 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Nov 17 03:56:22.051793 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-b2f70f9b-9a8f-4d4a-8671-cd91093d36b1 tempest-VolumesNegativeTest-1679335271 tempest-VolumesNegativeTest-1679335271-project] 10.222.0.11 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.003675 Nov 17 03:56:22.052262 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 1590/2882] 10.222.0.11 () {58 vars in 1136 bytes} [Wed Nov 17 03:56:22 2021] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 5 msecs (HTTP/1.1 404) 5 headers in 228 bytes (2 switches on core 0) Nov 17 03:56:22.065513 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-0c98ad03-1e57-4542-97ff-d7a41b641ec0 tempest-VolumesNegativeTest-1679335271 tempest-VolumesNegativeTest-1679335271-project] Calling method '.version_select at 0x7f9e220e3b80>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:56:22.159433 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-e5ea7af2-b8fb-4d30-b6d4-554e1bb1e462 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:56:22.160036 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-e5ea7af2-b8fb-4d30-b6d4-554e1bb1e462 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] [instance: 5d54db85-b991-4890-abaa-952413baa2e7] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:56:22.166428 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-e5ea7af2-b8fb-4d30-b6d4-554e1bb1e462 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:56:22.166868 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-e5ea7af2-b8fb-4d30-b6d4-554e1bb1e462 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:56:22.167622 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-e5ea7af2-b8fb-4d30-b6d4-554e1bb1e462 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:56:22.168046 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-e5ea7af2-b8fb-4d30-b6d4-554e1bb1e462 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:56:22.242196 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-e5ea7af2-b8fb-4d30-b6d4-554e1bb1e462 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37f21d6d15cf40a586edda211219fd08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ebb970305844dccacf48a7d8d47ecf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:56:22.251107 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-e5ea7af2-b8fb-4d30-b6d4-554e1bb1e462 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '37f21d6d15cf40a586edda211219fd08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ebb970305844dccacf48a7d8d47ecf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:56:22.252587 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-e5ea7af2-b8fb-4d30-b6d4-554e1bb1e462 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '37f21d6d15cf40a586edda211219fd08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ebb970305844dccacf48a7d8d47ecf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:56:22.253831 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-e5ea7af2-b8fb-4d30-b6d4-554e1bb1e462 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] 10.222.0.11 "GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7" status: 200 len: 1444 microversion: 2.20 time: 0.240213 Nov 17 03:56:22.254382 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 1293/2883] 10.222.0.11 () {60 vars in 1276 bytes} [Wed Nov 17 03:56:22 2021] GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7 => generated 1444 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 17 03:56:22.271345 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-8818394e-4764-4d58-8ffb-4b477e6acdfe tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Calling method '.version_select at 0x7f9e1d1fa940>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:56:22.295885 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-8818394e-4764-4d58-8ffb-4b477e6acdfe tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] 10.222.0.11 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-411984522" status: 204 len: 0 microversion: 2.20 time: 0.027850 Nov 17 03:56:22.296410 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 1294/2884] 10.222.0.11 () {60 vars in 1258 bytes} [Wed Nov 17 03:56:22 2021] DELETE /compute/v2.1/os-keypairs/tempest-keypair-411984522 => generated 0 bytes in 29 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Nov 17 03:56:23.030680 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-6624064c-54cd-4cbe-bf21-7b5449805b7b tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:56:23.031349 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-6624064c-54cd-4cbe-bf21-7b5449805b7b tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] [instance: 15abb40f-daf9-4c4b-ac9c-55f57ee7b938] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:56:23.038408 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-6624064c-54cd-4cbe-bf21-7b5449805b7b tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:56:23.038887 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-6624064c-54cd-4cbe-bf21-7b5449805b7b tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:56:23.039650 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-6624064c-54cd-4cbe-bf21-7b5449805b7b tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:56:23.040080 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-6624064c-54cd-4cbe-bf21-7b5449805b7b tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:56:23.179062 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-6624064c-54cd-4cbe-bf21-7b5449805b7b tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a792b5b7e6f7461b8d802a5abaaa9518', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e843a3fb49f41dcb376184d7e156528', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:56:23.189578 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-6624064c-54cd-4cbe-bf21-7b5449805b7b tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] 10.222.0.11 "GET /compute/v2.1/servers/15abb40f-daf9-4c4b-ac9c-55f57ee7b938" status: 200 len: 1558 microversion: 2.1 time: 0.162734 Nov 17 03:56:23.190139 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 1295/2885] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:56:23 2021] GET /compute/v2.1/servers/15abb40f-daf9-4c4b-ac9c-55f57ee7b938 => generated 1558 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:56:23.194431 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-1295abd4-7e23-4b22-9dc4-60bf8ae51d14 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Action: 'create', calling method: .version_select at 0x7f9e22074c10>, body: {"keypair": {"name": "tempest-keypair-1721301701"}} {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 17 03:56:23.209926 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.quota [None req-1295abd4-7e23-4b22-9dc4-60bf8ae51d14 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Getting quotas for project 0ebb970305844dccacf48a7d8d47ecf4. Resources: {'key_pairs'} {{(pid=115916) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 17 03:56:23.214396 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.quota [None req-1295abd4-7e23-4b22-9dc4-60bf8ae51d14 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Getting quotas for user 37f21d6d15cf40a586edda211219fd08 and project 0ebb970305844dccacf48a7d8d47ecf4. Resources: {'key_pairs'} {{(pid=115916) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 17 03:56:23.718306 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.quota [None req-1295abd4-7e23-4b22-9dc4-60bf8ae51d14 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Getting quotas for project 0ebb970305844dccacf48a7d8d47ecf4. Resources: {'key_pairs'} {{(pid=115916) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 17 03:56:23.721960 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.quota [None req-1295abd4-7e23-4b22-9dc4-60bf8ae51d14 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Getting quotas for user 37f21d6d15cf40a586edda211219fd08 and project 0ebb970305844dccacf48a7d8d47ecf4. Resources: {'key_pairs'} {{(pid=115916) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 17 03:56:23.734494 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-1295abd4-7e23-4b22-9dc4-60bf8ae51d14 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] 10.222.0.11 "POST /compute/v2.1/os-keypairs" status: 201 len: 2320 microversion: 2.20 time: 0.543427 Nov 17 03:56:23.735085 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 1296/2886] 10.222.0.11 () {62 vars in 1198 bytes} [Wed Nov 17 03:56:23 2021] POST /compute/v2.1/os-keypairs => generated 2320 bytes in 544 msecs (HTTP/1.1 201) 9 headers in 365 bytes (1 switches on core 0) Nov 17 03:56:24.207695 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-2f6128e9-fbc0-4de9-9832-bc08adb4cab4 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:56:24.208377 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-2f6128e9-fbc0-4de9-9832-bc08adb4cab4 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] [instance: 15abb40f-daf9-4c4b-ac9c-55f57ee7b938] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:56:24.214858 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-2f6128e9-fbc0-4de9-9832-bc08adb4cab4 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:56:24.215302 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-2f6128e9-fbc0-4de9-9832-bc08adb4cab4 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:56:24.216068 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-2f6128e9-fbc0-4de9-9832-bc08adb4cab4 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:56:24.216495 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-2f6128e9-fbc0-4de9-9832-bc08adb4cab4 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:56:24.358034 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-2f6128e9-fbc0-4de9-9832-bc08adb4cab4 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a792b5b7e6f7461b8d802a5abaaa9518', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e843a3fb49f41dcb376184d7e156528', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:56:24.366491 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-2f6128e9-fbc0-4de9-9832-bc08adb4cab4 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] 10.222.0.11 "GET /compute/v2.1/servers/15abb40f-daf9-4c4b-ac9c-55f57ee7b938" status: 200 len: 1558 microversion: 2.1 time: 0.162405 Nov 17 03:56:24.367197 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 1297/2887] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:56:24 2021] GET /compute/v2.1/servers/15abb40f-daf9-4c4b-ac9c-55f57ee7b938 => generated 1558 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:56:25.276832 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-ecab0f01-74d0-4660-bf71-2948aaa224e9 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1945229296", "imageRef": "7281a37a-6b99-49c1-881a-41604d06bae1", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "29f627af-401c-4e3c-a948-adbabbfe7a22"}], "security_groups": [{"name": "tempest-securitygroup--1614532239"}], "key_name": "tempest-keypair-1721301701", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 17 03:56:25.385790 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.network.neutron [None req-ecab0f01-74d0-4660-bf71-2948aaa224e9 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] validate_networks() for [('29f627af-401c-4e3c-a948-adbabbfe7a22', None, None, None, None, None)] {{(pid=115916) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Nov 17 03:56:25.884547 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.virt.hardware [None req-ecab0f01-74d0-4660-bf71-2948aaa224e9 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Flavor limits 0:0:0 {{(pid=115916) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 17 03:56:25.885035 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.virt.hardware [None req-ecab0f01-74d0-4660-bf71-2948aaa224e9 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Image limits 0:0:0 {{(pid=115916) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 17 03:56:25.885509 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.virt.hardware [None req-ecab0f01-74d0-4660-bf71-2948aaa224e9 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Flavor pref 0:0:0 {{(pid=115916) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 17 03:56:25.885917 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.virt.hardware [None req-ecab0f01-74d0-4660-bf71-2948aaa224e9 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Image pref 0:0:0 {{(pid=115916) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 17 03:56:25.886325 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.virt.hardware [None req-ecab0f01-74d0-4660-bf71-2948aaa224e9 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=115916) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 17 03:56:25.895688 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-ecab0f01-74d0-4660-bf71-2948aaa224e9 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:56:25.896138 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-ecab0f01-74d0-4660-bf71-2948aaa224e9 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:56:25.896985 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-ecab0f01-74d0-4660-bf71-2948aaa224e9 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:56:25.897424 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-ecab0f01-74d0-4660-bf71-2948aaa224e9 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:56:25.913993 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.quota [None req-ecab0f01-74d0-4660-bf71-2948aaa224e9 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Getting quotas for project 0ebb970305844dccacf48a7d8d47ecf4. Resources: {'instances', 'ram', 'cores'} {{(pid=115916) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 17 03:56:25.918376 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.quota [None req-ecab0f01-74d0-4660-bf71-2948aaa224e9 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Getting quotas for user 37f21d6d15cf40a586edda211219fd08 and project 0ebb970305844dccacf48a7d8d47ecf4. Resources: {'instances', 'ram', 'cores'} {{(pid=115916) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 17 03:56:25.930600 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-ecab0f01-74d0-4660-bf71-2948aaa224e9 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Going to run 1 instances... {{(pid=115916) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 17 03:56:25.932950 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-ecab0f01-74d0-4660-bf71-2948aaa224e9 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] [instance: c934945b-ff48-414a-8910-b206a86192b9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='7281a37a-6b99-49c1-881a-41604d06bae1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=115916) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 17 03:56:25.978089 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: ERROR oslo.messaging._drivers.impl_rabbit [None req-ecab0f01-74d0-4660-bf71-2948aaa224e9 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] [2ab6d147-ac8d-4d8d-946f-e16cd5fb6d20] AMQP server on 10.222.0.11:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Nov 17 03:56:27.003690 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO oslo.messaging._drivers.impl_rabbit [None req-ecab0f01-74d0-4660-bf71-2948aaa224e9 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] [2ab6d147-ac8d-4d8d-946f-e16cd5fb6d20] Reconnected to AMQP server on 10.222.0.11:5672 via [amqp] client with port 46316. Nov 17 03:56:27.008374 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-ecab0f01-74d0-4660-bf71-2948aaa224e9 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] 10.222.0.11 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 1.735633 Nov 17 03:56:27.009480 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 1298/2888] 10.222.0.11 () {62 vars in 1187 bytes} [Wed Nov 17 03:56:25 2021] POST /compute/v2.1/servers => generated 402 bytes in 1737 msecs (HTTP/1.1 202) 10 headers in 453 bytes (2 switches on core 0) Nov 17 03:56:27.013946 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-07d084ae-8496-4200-98f4-de0af8f52e67 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:56:27.014696 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-07d084ae-8496-4200-98f4-de0af8f52e67 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] [instance: 15abb40f-daf9-4c4b-ac9c-55f57ee7b938] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:56:27.021650 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-07d084ae-8496-4200-98f4-de0af8f52e67 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:56:27.022078 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-07d084ae-8496-4200-98f4-de0af8f52e67 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:56:27.022847 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-07d084ae-8496-4200-98f4-de0af8f52e67 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:56:27.023542 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-07d084ae-8496-4200-98f4-de0af8f52e67 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:56:27.156139 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-07d084ae-8496-4200-98f4-de0af8f52e67 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a792b5b7e6f7461b8d802a5abaaa9518', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e843a3fb49f41dcb376184d7e156528', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:56:27.164464 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-07d084ae-8496-4200-98f4-de0af8f52e67 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] 10.222.0.11 "GET /compute/v2.1/servers/15abb40f-daf9-4c4b-ac9c-55f57ee7b938" status: 200 len: 1558 microversion: 2.1 time: 0.154027 Nov 17 03:56:27.165079 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 1299/2889] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:56:27 2021] GET /compute/v2.1/servers/15abb40f-daf9-4c4b-ac9c-55f57ee7b938 => generated 1558 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:56:27.169453 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-34a69b30-c361-4d0c-a492-0c6572eae578 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:56:27.170164 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-34a69b30-c361-4d0c-a492-0c6572eae578 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] [instance: c934945b-ff48-414a-8910-b206a86192b9] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:56:27.220842 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-34a69b30-c361-4d0c-a492-0c6572eae578 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37f21d6d15cf40a586edda211219fd08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ebb970305844dccacf48a7d8d47ecf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:56:27.227950 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-34a69b30-c361-4d0c-a492-0c6572eae578 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '37f21d6d15cf40a586edda211219fd08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ebb970305844dccacf48a7d8d47ecf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:56:27.229483 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-34a69b30-c361-4d0c-a492-0c6572eae578 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '37f21d6d15cf40a586edda211219fd08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ebb970305844dccacf48a7d8d47ecf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:56:27.230590 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-34a69b30-c361-4d0c-a492-0c6572eae578 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] 10.222.0.11 "GET /compute/v2.1/servers/c934945b-ff48-414a-8910-b206a86192b9" status: 200 len: 1282 microversion: 2.20 time: 0.064524 Nov 17 03:56:27.231147 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 1300/2890] 10.222.0.11 () {60 vars in 1276 bytes} [Wed Nov 17 03:56:27 2021] GET /compute/v2.1/servers/c934945b-ff48-414a-8910-b206a86192b9 => generated 1282 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 17 03:56:28.184339 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-33922fcc-5532-4bc3-a35d-079f9b36ac7a tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:56:28.185161 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-33922fcc-5532-4bc3-a35d-079f9b36ac7a tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] [instance: 15abb40f-daf9-4c4b-ac9c-55f57ee7b938] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:56:28.196840 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-33922fcc-5532-4bc3-a35d-079f9b36ac7a tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:56:28.197314 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-33922fcc-5532-4bc3-a35d-079f9b36ac7a tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:56:28.198096 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-33922fcc-5532-4bc3-a35d-079f9b36ac7a tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:56:28.198528 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-33922fcc-5532-4bc3-a35d-079f9b36ac7a tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:56:28.353063 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-33922fcc-5532-4bc3-a35d-079f9b36ac7a tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a792b5b7e6f7461b8d802a5abaaa9518', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e843a3fb49f41dcb376184d7e156528', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:56:28.361904 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-33922fcc-5532-4bc3-a35d-079f9b36ac7a tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] 10.222.0.11 "GET /compute/v2.1/servers/15abb40f-daf9-4c4b-ac9c-55f57ee7b938" status: 200 len: 1558 microversion: 2.1 time: 0.183458 Nov 17 03:56:28.362480 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 1301/2891] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:56:28 2021] GET /compute/v2.1/servers/15abb40f-daf9-4c4b-ac9c-55f57ee7b938 => generated 1558 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 17 03:56:28.366714 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-055a8432-eafc-48dc-b2ac-97662ebf7784 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:56:28.367311 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-055a8432-eafc-48dc-b2ac-97662ebf7784 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] [instance: c934945b-ff48-414a-8910-b206a86192b9] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:56:28.424148 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-055a8432-eafc-48dc-b2ac-97662ebf7784 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37f21d6d15cf40a586edda211219fd08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ebb970305844dccacf48a7d8d47ecf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:56:28.436100 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-055a8432-eafc-48dc-b2ac-97662ebf7784 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '37f21d6d15cf40a586edda211219fd08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ebb970305844dccacf48a7d8d47ecf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:56:28.437659 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-055a8432-eafc-48dc-b2ac-97662ebf7784 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '37f21d6d15cf40a586edda211219fd08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ebb970305844dccacf48a7d8d47ecf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:56:28.438770 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-055a8432-eafc-48dc-b2ac-97662ebf7784 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] 10.222.0.11 "GET /compute/v2.1/servers/c934945b-ff48-414a-8910-b206a86192b9" status: 200 len: 1282 microversion: 2.20 time: 0.075334 Nov 17 03:56:28.439326 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 1302/2892] 10.222.0.11 () {60 vars in 1276 bytes} [Wed Nov 17 03:56:28 2021] GET /compute/v2.1/servers/c934945b-ff48-414a-8910-b206a86192b9 => generated 1282 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 17 03:56:29.382595 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-e3d58ce1-1974-456e-b3a3-34e035466e6e tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:56:29.383277 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-e3d58ce1-1974-456e-b3a3-34e035466e6e tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] [instance: 15abb40f-daf9-4c4b-ac9c-55f57ee7b938] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:56:29.391853 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-e3d58ce1-1974-456e-b3a3-34e035466e6e tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:56:29.392302 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-e3d58ce1-1974-456e-b3a3-34e035466e6e tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:56:29.393139 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-e3d58ce1-1974-456e-b3a3-34e035466e6e tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:56:29.393593 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-e3d58ce1-1974-456e-b3a3-34e035466e6e tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:56:29.526764 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-e3d58ce1-1974-456e-b3a3-34e035466e6e tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a792b5b7e6f7461b8d802a5abaaa9518', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e843a3fb49f41dcb376184d7e156528', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:56:29.534829 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-e3d58ce1-1974-456e-b3a3-34e035466e6e tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] 10.222.0.11 "GET /compute/v2.1/servers/15abb40f-daf9-4c4b-ac9c-55f57ee7b938" status: 200 len: 1558 microversion: 2.1 time: 0.158420 Nov 17 03:56:29.535369 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 1303/2893] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:56:29 2021] GET /compute/v2.1/servers/15abb40f-daf9-4c4b-ac9c-55f57ee7b938 => generated 1558 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:56:29.539560 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-ddfaa56d-3277-48da-89fc-5693ac733ce0 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:56:29.540161 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-ddfaa56d-3277-48da-89fc-5693ac733ce0 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] [instance: c934945b-ff48-414a-8910-b206a86192b9] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:56:29.600875 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-ddfaa56d-3277-48da-89fc-5693ac733ce0 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37f21d6d15cf40a586edda211219fd08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ebb970305844dccacf48a7d8d47ecf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:56:29.609629 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-ddfaa56d-3277-48da-89fc-5693ac733ce0 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '37f21d6d15cf40a586edda211219fd08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ebb970305844dccacf48a7d8d47ecf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:56:29.611138 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-ddfaa56d-3277-48da-89fc-5693ac733ce0 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '37f21d6d15cf40a586edda211219fd08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ebb970305844dccacf48a7d8d47ecf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:56:29.612232 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-ddfaa56d-3277-48da-89fc-5693ac733ce0 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] 10.222.0.11 "GET /compute/v2.1/servers/c934945b-ff48-414a-8910-b206a86192b9" status: 200 len: 1282 microversion: 2.20 time: 0.075930 Nov 17 03:56:29.612802 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 1304/2894] 10.222.0.11 () {60 vars in 1276 bytes} [Wed Nov 17 03:56:29 2021] GET /compute/v2.1/servers/c934945b-ff48-414a-8910-b206a86192b9 => generated 1282 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 17 03:56:30.551640 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-69b5a1d9-a4da-4c90-9d29-7359b6f38896 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:56:30.552279 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-69b5a1d9-a4da-4c90-9d29-7359b6f38896 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] [instance: 15abb40f-daf9-4c4b-ac9c-55f57ee7b938] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:56:30.559430 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-69b5a1d9-a4da-4c90-9d29-7359b6f38896 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:56:30.559882 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-69b5a1d9-a4da-4c90-9d29-7359b6f38896 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:56:30.560737 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-69b5a1d9-a4da-4c90-9d29-7359b6f38896 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:56:30.561203 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-69b5a1d9-a4da-4c90-9d29-7359b6f38896 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:56:30.699932 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-69b5a1d9-a4da-4c90-9d29-7359b6f38896 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a792b5b7e6f7461b8d802a5abaaa9518', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e843a3fb49f41dcb376184d7e156528', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:56:30.712394 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-69b5a1d9-a4da-4c90-9d29-7359b6f38896 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] 10.222.0.11 "GET /compute/v2.1/servers/15abb40f-daf9-4c4b-ac9c-55f57ee7b938" status: 200 len: 1558 microversion: 2.1 time: 0.164531 Nov 17 03:56:30.713213 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 1305/2895] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:56:30 2021] GET /compute/v2.1/servers/15abb40f-daf9-4c4b-ac9c-55f57ee7b938 => generated 1558 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 17 03:56:30.718710 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-53f78b74-b9c4-4c7c-8849-1039af7eedb4 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:56:30.719304 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-53f78b74-b9c4-4c7c-8849-1039af7eedb4 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] [instance: c934945b-ff48-414a-8910-b206a86192b9] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:56:30.725108 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-53f78b74-b9c4-4c7c-8849-1039af7eedb4 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:56:30.725557 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-53f78b74-b9c4-4c7c-8849-1039af7eedb4 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:56:30.726326 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-53f78b74-b9c4-4c7c-8849-1039af7eedb4 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:56:30.726757 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-53f78b74-b9c4-4c7c-8849-1039af7eedb4 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:56:30.789000 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-53f78b74-b9c4-4c7c-8849-1039af7eedb4 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37f21d6d15cf40a586edda211219fd08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ebb970305844dccacf48a7d8d47ecf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:56:30.800313 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-53f78b74-b9c4-4c7c-8849-1039af7eedb4 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '37f21d6d15cf40a586edda211219fd08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ebb970305844dccacf48a7d8d47ecf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:56:30.802988 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-53f78b74-b9c4-4c7c-8849-1039af7eedb4 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '37f21d6d15cf40a586edda211219fd08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ebb970305844dccacf48a7d8d47ecf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:56:30.804493 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-53f78b74-b9c4-4c7c-8849-1039af7eedb4 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] 10.222.0.11 "GET /compute/v2.1/servers/c934945b-ff48-414a-8910-b206a86192b9" status: 200 len: 1286 microversion: 2.20 time: 0.090125 Nov 17 03:56:30.805334 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 1306/2896] 10.222.0.11 () {60 vars in 1276 bytes} [Wed Nov 17 03:56:30 2021] GET /compute/v2.1/servers/c934945b-ff48-414a-8910-b206a86192b9 => generated 1286 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 17 03:56:31.731205 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-d832cecb-34ae-465f-bcd3-fcb3295e76b1 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:56:31.731896 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-d832cecb-34ae-465f-bcd3-fcb3295e76b1 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] [instance: 15abb40f-daf9-4c4b-ac9c-55f57ee7b938] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:56:31.738899 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-d832cecb-34ae-465f-bcd3-fcb3295e76b1 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:56:31.739480 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-d832cecb-34ae-465f-bcd3-fcb3295e76b1 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:56:31.740199 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-d832cecb-34ae-465f-bcd3-fcb3295e76b1 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:56:31.740722 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-d832cecb-34ae-465f-bcd3-fcb3295e76b1 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:56:31.878547 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-d832cecb-34ae-465f-bcd3-fcb3295e76b1 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a792b5b7e6f7461b8d802a5abaaa9518', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e843a3fb49f41dcb376184d7e156528', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:56:31.891967 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-d832cecb-34ae-465f-bcd3-fcb3295e76b1 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] 10.222.0.11 "GET /compute/v2.1/servers/15abb40f-daf9-4c4b-ac9c-55f57ee7b938" status: 200 len: 1558 microversion: 2.1 time: 0.164261 Nov 17 03:56:31.892804 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 1307/2897] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:56:31 2021] GET /compute/v2.1/servers/15abb40f-daf9-4c4b-ac9c-55f57ee7b938 => generated 1558 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:56:31.897521 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-4e631eb9-f8d7-4c19-962d-70a6ebacdcb1 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:56:31.898225 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-4e631eb9-f8d7-4c19-962d-70a6ebacdcb1 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] [instance: c934945b-ff48-414a-8910-b206a86192b9] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:56:31.903782 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-4e631eb9-f8d7-4c19-962d-70a6ebacdcb1 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:56:31.904376 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-4e631eb9-f8d7-4c19-962d-70a6ebacdcb1 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:56:31.905327 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-4e631eb9-f8d7-4c19-962d-70a6ebacdcb1 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:56:31.905754 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-4e631eb9-f8d7-4c19-962d-70a6ebacdcb1 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:56:31.980738 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-4e631eb9-f8d7-4c19-962d-70a6ebacdcb1 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37f21d6d15cf40a586edda211219fd08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ebb970305844dccacf48a7d8d47ecf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:56:31.992834 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-4e631eb9-f8d7-4c19-962d-70a6ebacdcb1 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '37f21d6d15cf40a586edda211219fd08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ebb970305844dccacf48a7d8d47ecf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:56:31.995123 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-4e631eb9-f8d7-4c19-962d-70a6ebacdcb1 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '37f21d6d15cf40a586edda211219fd08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ebb970305844dccacf48a7d8d47ecf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:56:31.996832 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-4e631eb9-f8d7-4c19-962d-70a6ebacdcb1 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] 10.222.0.11 "GET /compute/v2.1/servers/c934945b-ff48-414a-8910-b206a86192b9" status: 200 len: 1334 microversion: 2.20 time: 0.102814 Nov 17 03:56:31.997633 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 1308/2898] 10.222.0.11 () {60 vars in 1276 bytes} [Wed Nov 17 03:56:31 2021] GET /compute/v2.1/servers/c934945b-ff48-414a-8910-b206a86192b9 => generated 1334 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 17 03:56:32.911007 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-116a8ceb-56a5-4f3b-9b18-6b62c0a2ac1e tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:56:32.914423 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-116a8ceb-56a5-4f3b-9b18-6b62c0a2ac1e tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] [instance: 15abb40f-daf9-4c4b-ac9c-55f57ee7b938] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:56:32.921732 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-116a8ceb-56a5-4f3b-9b18-6b62c0a2ac1e tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:56:32.922407 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-116a8ceb-56a5-4f3b-9b18-6b62c0a2ac1e tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:56:32.923588 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-116a8ceb-56a5-4f3b-9b18-6b62c0a2ac1e tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:56:32.924080 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-116a8ceb-56a5-4f3b-9b18-6b62c0a2ac1e tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:56:33.076349 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-116a8ceb-56a5-4f3b-9b18-6b62c0a2ac1e tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a792b5b7e6f7461b8d802a5abaaa9518', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e843a3fb49f41dcb376184d7e156528', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:56:33.084281 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-116a8ceb-56a5-4f3b-9b18-6b62c0a2ac1e tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] 10.222.0.11 "GET /compute/v2.1/servers/15abb40f-daf9-4c4b-ac9c-55f57ee7b938" status: 200 len: 1558 microversion: 2.1 time: 0.177431 Nov 17 03:56:33.084900 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 1309/2899] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:56:32 2021] GET /compute/v2.1/servers/15abb40f-daf9-4c4b-ac9c-55f57ee7b938 => generated 1558 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 17 03:56:33.089178 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-d1a072b3-d40e-43d9-921a-89010426345e tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:56:33.089775 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-d1a072b3-d40e-43d9-921a-89010426345e tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] [instance: c934945b-ff48-414a-8910-b206a86192b9] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:56:33.096064 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-d1a072b3-d40e-43d9-921a-89010426345e tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:56:33.096510 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-d1a072b3-d40e-43d9-921a-89010426345e tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:56:33.097299 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-d1a072b3-d40e-43d9-921a-89010426345e tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:56:33.097837 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-d1a072b3-d40e-43d9-921a-89010426345e tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:56:33.229708 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-d1a072b3-d40e-43d9-921a-89010426345e tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37f21d6d15cf40a586edda211219fd08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ebb970305844dccacf48a7d8d47ecf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:56:33.237807 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-d1a072b3-d40e-43d9-921a-89010426345e tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '37f21d6d15cf40a586edda211219fd08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ebb970305844dccacf48a7d8d47ecf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:56:33.239277 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-d1a072b3-d40e-43d9-921a-89010426345e tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '37f21d6d15cf40a586edda211219fd08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ebb970305844dccacf48a7d8d47ecf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:56:33.240406 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-d1a072b3-d40e-43d9-921a-89010426345e tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] 10.222.0.11 "GET /compute/v2.1/servers/c934945b-ff48-414a-8910-b206a86192b9" status: 200 len: 1408 microversion: 2.20 time: 0.154600 Nov 17 03:56:33.240990 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 1310/2900] 10.222.0.11 () {60 vars in 1276 bytes} [Wed Nov 17 03:56:33 2021] GET /compute/v2.1/servers/c934945b-ff48-414a-8910-b206a86192b9 => generated 1408 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 17 03:56:33.590197 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [req-12ff52ff-8590-4cf2-8794-b9c4bb44ca26 req-d385dced-2186-46ca-a2f1-35615aca9431 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c934945b-ff48-414a-8910-b206a86192b9", "tag": "6c4379b9-2465-4b23-9d1c-06f2cb7a27c4"}]} {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 17 03:56:33.592246 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 17 03:56:33.592246 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: warnings.warn(msg) Nov 17 03:56:33.600673 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [req-12ff52ff-8590-4cf2-8794-b9c4bb44ca26 req-d385dced-2186-46ca-a2f1-35615aca9431 service nova] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:56:33.601179 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [req-12ff52ff-8590-4cf2-8794-b9c4bb44ca26 req-d385dced-2186-46ca-a2f1-35615aca9431 service nova] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:56:33.613560 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.compute.server_external_events [req-12ff52ff-8590-4cf2-8794-b9c4bb44ca26 req-d385dced-2186-46ca-a2f1-35615aca9431 service nova] Creating event network-changed:6c4379b9-2465-4b23-9d1c-06f2cb7a27c4 for instance c934945b-ff48-414a-8910-b206a86192b9 on hv-cinder-81803 Nov 17 03:56:33.618617 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [req-12ff52ff-8590-4cf2-8794-b9c4bb44ca26 req-d385dced-2186-46ca-a2f1-35615aca9431 service nova] 10.222.0.11 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032903 Nov 17 03:56:33.619805 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 1311/2901] 10.222.0.11 () {64 vars in 1317 bytes} [Wed Nov 17 03:56:33 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 17 03:56:34.102889 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-d3687376-a3d2-4a6f-a430-e79f5157aee1 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:56:34.103601 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-d3687376-a3d2-4a6f-a430-e79f5157aee1 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] [instance: 15abb40f-daf9-4c4b-ac9c-55f57ee7b938] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:56:34.110194 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-d3687376-a3d2-4a6f-a430-e79f5157aee1 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:56:34.110645 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-d3687376-a3d2-4a6f-a430-e79f5157aee1 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:56:34.111421 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-d3687376-a3d2-4a6f-a430-e79f5157aee1 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:56:34.111886 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-d3687376-a3d2-4a6f-a430-e79f5157aee1 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:56:34.252117 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-d3687376-a3d2-4a6f-a430-e79f5157aee1 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a792b5b7e6f7461b8d802a5abaaa9518', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e843a3fb49f41dcb376184d7e156528', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:56:34.260360 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-d3687376-a3d2-4a6f-a430-e79f5157aee1 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] 10.222.0.11 "GET /compute/v2.1/servers/15abb40f-daf9-4c4b-ac9c-55f57ee7b938" status: 200 len: 1558 microversion: 2.1 time: 0.161962 Nov 17 03:56:34.260974 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 1312/2902] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:56:34 2021] GET /compute/v2.1/servers/15abb40f-daf9-4c4b-ac9c-55f57ee7b938 => generated 1558 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 17 03:56:34.265545 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-40abe209-482c-43b4-b215-b885275ed3e2 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:56:34.266155 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-40abe209-482c-43b4-b215-b885275ed3e2 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] [instance: c934945b-ff48-414a-8910-b206a86192b9] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:56:34.272096 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-40abe209-482c-43b4-b215-b885275ed3e2 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:56:34.272549 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-40abe209-482c-43b4-b215-b885275ed3e2 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:56:34.273346 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-40abe209-482c-43b4-b215-b885275ed3e2 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:56:34.273775 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-40abe209-482c-43b4-b215-b885275ed3e2 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:56:34.408968 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-40abe209-482c-43b4-b215-b885275ed3e2 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37f21d6d15cf40a586edda211219fd08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ebb970305844dccacf48a7d8d47ecf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:56:34.416739 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-40abe209-482c-43b4-b215-b885275ed3e2 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '37f21d6d15cf40a586edda211219fd08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ebb970305844dccacf48a7d8d47ecf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:56:34.418228 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-40abe209-482c-43b4-b215-b885275ed3e2 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '37f21d6d15cf40a586edda211219fd08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ebb970305844dccacf48a7d8d47ecf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:56:34.419331 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-40abe209-482c-43b4-b215-b885275ed3e2 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] 10.222.0.11 "GET /compute/v2.1/servers/c934945b-ff48-414a-8910-b206a86192b9" status: 200 len: 1408 microversion: 2.20 time: 0.157475 Nov 17 03:56:34.419892 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 1313/2903] 10.222.0.11 () {60 vars in 1276 bytes} [Wed Nov 17 03:56:34 2021] GET /compute/v2.1/servers/c934945b-ff48-414a-8910-b206a86192b9 => generated 1408 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 17 03:56:35.281428 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-0d1cb381-5665-4b95-9199-8fc9422e82d5 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:56:35.282429 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-0d1cb381-5665-4b95-9199-8fc9422e82d5 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] [instance: 15abb40f-daf9-4c4b-ac9c-55f57ee7b938] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:56:35.293221 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-0d1cb381-5665-4b95-9199-8fc9422e82d5 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:56:35.293978 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-0d1cb381-5665-4b95-9199-8fc9422e82d5 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:56:35.295253 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-0d1cb381-5665-4b95-9199-8fc9422e82d5 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:56:35.296028 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-0d1cb381-5665-4b95-9199-8fc9422e82d5 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:56:35.435692 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-0d1cb381-5665-4b95-9199-8fc9422e82d5 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a792b5b7e6f7461b8d802a5abaaa9518', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e843a3fb49f41dcb376184d7e156528', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:56:35.443645 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-0d1cb381-5665-4b95-9199-8fc9422e82d5 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] 10.222.0.11 "GET /compute/v2.1/servers/15abb40f-daf9-4c4b-ac9c-55f57ee7b938" status: 200 len: 1558 microversion: 2.1 time: 0.168408 Nov 17 03:56:35.444341 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 1314/2904] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:56:35 2021] GET /compute/v2.1/servers/15abb40f-daf9-4c4b-ac9c-55f57ee7b938 => generated 1558 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:56:35.448557 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-bfa5f1cf-a0ae-474a-9572-f8547acd353d tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:56:35.449224 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-bfa5f1cf-a0ae-474a-9572-f8547acd353d tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] [instance: c934945b-ff48-414a-8910-b206a86192b9] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:56:35.455295 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-bfa5f1cf-a0ae-474a-9572-f8547acd353d tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:56:35.455746 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-bfa5f1cf-a0ae-474a-9572-f8547acd353d tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:56:35.456519 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-bfa5f1cf-a0ae-474a-9572-f8547acd353d tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:56:35.456992 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-bfa5f1cf-a0ae-474a-9572-f8547acd353d tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:56:35.596848 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-bfa5f1cf-a0ae-474a-9572-f8547acd353d tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37f21d6d15cf40a586edda211219fd08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ebb970305844dccacf48a7d8d47ecf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:56:35.607316 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-bfa5f1cf-a0ae-474a-9572-f8547acd353d tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '37f21d6d15cf40a586edda211219fd08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ebb970305844dccacf48a7d8d47ecf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:56:35.609028 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-bfa5f1cf-a0ae-474a-9572-f8547acd353d tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '37f21d6d15cf40a586edda211219fd08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ebb970305844dccacf48a7d8d47ecf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:56:35.610139 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-bfa5f1cf-a0ae-474a-9572-f8547acd353d tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] 10.222.0.11 "GET /compute/v2.1/servers/c934945b-ff48-414a-8910-b206a86192b9" status: 200 len: 1408 microversion: 2.20 time: 0.164887 Nov 17 03:56:35.610707 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 1315/2905] 10.222.0.11 () {60 vars in 1276 bytes} [Wed Nov 17 03:56:35 2021] GET /compute/v2.1/servers/c934945b-ff48-414a-8910-b206a86192b9 => generated 1408 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 17 03:56:36.466281 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-e4032564-f81e-4ec1-bfe5-d36279916230 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:56:36.467271 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-e4032564-f81e-4ec1-bfe5-d36279916230 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] [instance: 15abb40f-daf9-4c4b-ac9c-55f57ee7b938] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:56:36.474486 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-e4032564-f81e-4ec1-bfe5-d36279916230 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:56:36.474932 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-e4032564-f81e-4ec1-bfe5-d36279916230 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:56:36.475699 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-e4032564-f81e-4ec1-bfe5-d36279916230 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:56:36.476128 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-e4032564-f81e-4ec1-bfe5-d36279916230 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:56:36.614014 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-e4032564-f81e-4ec1-bfe5-d36279916230 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a792b5b7e6f7461b8d802a5abaaa9518', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e843a3fb49f41dcb376184d7e156528', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:56:36.626032 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-e4032564-f81e-4ec1-bfe5-d36279916230 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] 10.222.0.11 "GET /compute/v2.1/servers/15abb40f-daf9-4c4b-ac9c-55f57ee7b938" status: 200 len: 1558 microversion: 2.1 time: 0.167291 Nov 17 03:56:36.626620 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 1316/2906] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:56:36 2021] GET /compute/v2.1/servers/15abb40f-daf9-4c4b-ac9c-55f57ee7b938 => generated 1558 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:56:36.632338 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-7aba323f-2b57-460a-b3e7-bf083fc72761 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:56:36.632968 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-7aba323f-2b57-460a-b3e7-bf083fc72761 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] [instance: c934945b-ff48-414a-8910-b206a86192b9] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:56:36.638886 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-7aba323f-2b57-460a-b3e7-bf083fc72761 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:56:36.639324 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-7aba323f-2b57-460a-b3e7-bf083fc72761 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:56:36.640104 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-7aba323f-2b57-460a-b3e7-bf083fc72761 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:56:36.640532 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-7aba323f-2b57-460a-b3e7-bf083fc72761 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:56:36.776516 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-7aba323f-2b57-460a-b3e7-bf083fc72761 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37f21d6d15cf40a586edda211219fd08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ebb970305844dccacf48a7d8d47ecf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:56:36.789134 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-7aba323f-2b57-460a-b3e7-bf083fc72761 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '37f21d6d15cf40a586edda211219fd08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ebb970305844dccacf48a7d8d47ecf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:56:36.791641 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-7aba323f-2b57-460a-b3e7-bf083fc72761 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '37f21d6d15cf40a586edda211219fd08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ebb970305844dccacf48a7d8d47ecf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:56:36.793501 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-7aba323f-2b57-460a-b3e7-bf083fc72761 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] 10.222.0.11 "GET /compute/v2.1/servers/c934945b-ff48-414a-8910-b206a86192b9" status: 200 len: 1408 microversion: 2.20 time: 0.164309 Nov 17 03:56:36.794403 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 1317/2907] 10.222.0.11 () {60 vars in 1276 bytes} [Wed Nov 17 03:56:36 2021] GET /compute/v2.1/servers/c934945b-ff48-414a-8910-b206a86192b9 => generated 1408 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 17 03:56:37.644602 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-13cad6e7-8bea-447b-b818-7e64448ee84d tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:56:37.645420 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-13cad6e7-8bea-447b-b818-7e64448ee84d tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] [instance: 15abb40f-daf9-4c4b-ac9c-55f57ee7b938] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:56:37.652245 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-13cad6e7-8bea-447b-b818-7e64448ee84d tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:56:37.652703 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-13cad6e7-8bea-447b-b818-7e64448ee84d tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:56:37.653582 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-13cad6e7-8bea-447b-b818-7e64448ee84d tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:56:37.654032 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-13cad6e7-8bea-447b-b818-7e64448ee84d tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:56:37.794486 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-13cad6e7-8bea-447b-b818-7e64448ee84d tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a792b5b7e6f7461b8d802a5abaaa9518', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e843a3fb49f41dcb376184d7e156528', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:56:37.803448 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-13cad6e7-8bea-447b-b818-7e64448ee84d tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] 10.222.0.11 "GET /compute/v2.1/servers/15abb40f-daf9-4c4b-ac9c-55f57ee7b938" status: 200 len: 1558 microversion: 2.1 time: 0.162648 Nov 17 03:56:37.804230 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 1318/2908] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:56:37 2021] GET /compute/v2.1/servers/15abb40f-daf9-4c4b-ac9c-55f57ee7b938 => generated 1558 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:56:37.813962 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-b056448e-ed47-40e8-a844-d161f44eae1d tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:56:37.814558 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-b056448e-ed47-40e8-a844-d161f44eae1d tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] [instance: c934945b-ff48-414a-8910-b206a86192b9] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:56:37.820704 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-b056448e-ed47-40e8-a844-d161f44eae1d tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:56:37.821303 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-b056448e-ed47-40e8-a844-d161f44eae1d tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:56:37.822048 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-b056448e-ed47-40e8-a844-d161f44eae1d tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:56:37.822475 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-b056448e-ed47-40e8-a844-d161f44eae1d tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:56:37.963238 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-b056448e-ed47-40e8-a844-d161f44eae1d tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37f21d6d15cf40a586edda211219fd08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ebb970305844dccacf48a7d8d47ecf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:56:37.971759 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-b056448e-ed47-40e8-a844-d161f44eae1d tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '37f21d6d15cf40a586edda211219fd08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ebb970305844dccacf48a7d8d47ecf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:56:37.973260 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-b056448e-ed47-40e8-a844-d161f44eae1d tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '37f21d6d15cf40a586edda211219fd08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ebb970305844dccacf48a7d8d47ecf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:56:37.974355 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-b056448e-ed47-40e8-a844-d161f44eae1d tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] 10.222.0.11 "GET /compute/v2.1/servers/c934945b-ff48-414a-8910-b206a86192b9" status: 200 len: 1408 microversion: 2.20 time: 0.164228 Nov 17 03:56:37.974913 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 1319/2909] 10.222.0.11 () {60 vars in 1276 bytes} [Wed Nov 17 03:56:37 2021] GET /compute/v2.1/servers/c934945b-ff48-414a-8910-b206a86192b9 => generated 1408 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 17 03:56:38.820889 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-9a6e372e-c62e-4aee-9267-90e6ec5df67a tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:56:38.821479 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-9a6e372e-c62e-4aee-9267-90e6ec5df67a tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] [instance: 15abb40f-daf9-4c4b-ac9c-55f57ee7b938] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:56:38.828169 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-9a6e372e-c62e-4aee-9267-90e6ec5df67a tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:56:38.828612 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-9a6e372e-c62e-4aee-9267-90e6ec5df67a tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:56:38.829404 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-9a6e372e-c62e-4aee-9267-90e6ec5df67a tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:56:38.829831 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-9a6e372e-c62e-4aee-9267-90e6ec5df67a tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:56:38.965438 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-9a6e372e-c62e-4aee-9267-90e6ec5df67a tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a792b5b7e6f7461b8d802a5abaaa9518', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e843a3fb49f41dcb376184d7e156528', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:56:38.973654 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-9a6e372e-c62e-4aee-9267-90e6ec5df67a tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] 10.222.0.11 "GET /compute/v2.1/servers/15abb40f-daf9-4c4b-ac9c-55f57ee7b938" status: 200 len: 1558 microversion: 2.1 time: 0.156578 Nov 17 03:56:38.974240 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 1320/2910] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:56:38 2021] GET /compute/v2.1/servers/15abb40f-daf9-4c4b-ac9c-55f57ee7b938 => generated 1558 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:56:38.998237 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-5eb1ea47-f381-4b52-81db-421d86ce4c8f tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:56:38.998832 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-5eb1ea47-f381-4b52-81db-421d86ce4c8f tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] [instance: c934945b-ff48-414a-8910-b206a86192b9] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:56:39.005013 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-5eb1ea47-f381-4b52-81db-421d86ce4c8f tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:56:39.005536 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-5eb1ea47-f381-4b52-81db-421d86ce4c8f tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:56:39.006220 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-5eb1ea47-f381-4b52-81db-421d86ce4c8f tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:56:39.006645 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-5eb1ea47-f381-4b52-81db-421d86ce4c8f tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:56:39.159079 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-5eb1ea47-f381-4b52-81db-421d86ce4c8f tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37f21d6d15cf40a586edda211219fd08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ebb970305844dccacf48a7d8d47ecf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:56:39.167041 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-5eb1ea47-f381-4b52-81db-421d86ce4c8f tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '37f21d6d15cf40a586edda211219fd08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ebb970305844dccacf48a7d8d47ecf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:56:39.168533 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-5eb1ea47-f381-4b52-81db-421d86ce4c8f tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '37f21d6d15cf40a586edda211219fd08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ebb970305844dccacf48a7d8d47ecf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:56:39.169702 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-5eb1ea47-f381-4b52-81db-421d86ce4c8f tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] 10.222.0.11 "GET /compute/v2.1/servers/c934945b-ff48-414a-8910-b206a86192b9" status: 200 len: 1408 microversion: 2.20 time: 0.175159 Nov 17 03:56:39.170267 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 1321/2911] 10.222.0.11 () {60 vars in 1276 bytes} [Wed Nov 17 03:56:38 2021] GET /compute/v2.1/servers/c934945b-ff48-414a-8910-b206a86192b9 => generated 1408 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 17 03:56:39.444941 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [req-a3de8fc7-47be-41d8-832e-4416c35b050a req-ebe27e2a-9cea-4663-b0f4-a92f1f58c06c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c934945b-ff48-414a-8910-b206a86192b9", "name": "network-vif-plugged", "status": "completed", "tag": "6c4379b9-2465-4b23-9d1c-06f2cb7a27c4"}]} {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 17 03:56:39.446505 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 17 03:56:39.446505 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: warnings.warn(msg) Nov 17 03:56:39.454588 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [req-a3de8fc7-47be-41d8-832e-4416c35b050a req-ebe27e2a-9cea-4663-b0f4-a92f1f58c06c service nova] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:56:39.455115 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [req-a3de8fc7-47be-41d8-832e-4416c35b050a req-ebe27e2a-9cea-4663-b0f4-a92f1f58c06c service nova] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:56:39.466407 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.compute.server_external_events [req-a3de8fc7-47be-41d8-832e-4416c35b050a req-ebe27e2a-9cea-4663-b0f4-a92f1f58c06c service nova] Creating event network-vif-plugged:6c4379b9-2465-4b23-9d1c-06f2cb7a27c4 for instance c934945b-ff48-414a-8910-b206a86192b9 on hv-cinder-81803 Nov 17 03:56:39.471509 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [req-a3de8fc7-47be-41d8-832e-4416c35b050a req-ebe27e2a-9cea-4663-b0f4-a92f1f58c06c service nova] 10.222.0.11 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.093568 Nov 17 03:56:39.472127 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 1322/2912] 10.222.0.11 () {64 vars in 1317 bytes} [Wed Nov 17 03:56:39 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 17 03:56:39.994044 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-77b5227d-6d68-4bca-aaaf-355e6dbfe8bc tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:56:39.994866 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-77b5227d-6d68-4bca-aaaf-355e6dbfe8bc tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] [instance: 15abb40f-daf9-4c4b-ac9c-55f57ee7b938] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:56:40.003821 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-77b5227d-6d68-4bca-aaaf-355e6dbfe8bc tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:56:40.004426 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-77b5227d-6d68-4bca-aaaf-355e6dbfe8bc tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:56:40.005492 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-77b5227d-6d68-4bca-aaaf-355e6dbfe8bc tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:56:40.006064 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-77b5227d-6d68-4bca-aaaf-355e6dbfe8bc tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:56:40.145615 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-77b5227d-6d68-4bca-aaaf-355e6dbfe8bc tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a792b5b7e6f7461b8d802a5abaaa9518', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e843a3fb49f41dcb376184d7e156528', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:56:40.153860 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-77b5227d-6d68-4bca-aaaf-355e6dbfe8bc tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] 10.222.0.11 "GET /compute/v2.1/servers/15abb40f-daf9-4c4b-ac9c-55f57ee7b938" status: 200 len: 1558 microversion: 2.1 time: 0.165331 Nov 17 03:56:40.154401 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 1323/2913] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:56:39 2021] GET /compute/v2.1/servers/15abb40f-daf9-4c4b-ac9c-55f57ee7b938 => generated 1558 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:56:40.187129 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-7074ea02-a6d9-4584-a3f3-fb033e2e1442 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:56:40.187732 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-7074ea02-a6d9-4584-a3f3-fb033e2e1442 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] [instance: c934945b-ff48-414a-8910-b206a86192b9] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:56:40.193725 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-7074ea02-a6d9-4584-a3f3-fb033e2e1442 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:56:40.194178 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-7074ea02-a6d9-4584-a3f3-fb033e2e1442 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:56:40.194951 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-7074ea02-a6d9-4584-a3f3-fb033e2e1442 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:56:40.195384 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-7074ea02-a6d9-4584-a3f3-fb033e2e1442 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:56:40.329604 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-7074ea02-a6d9-4584-a3f3-fb033e2e1442 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37f21d6d15cf40a586edda211219fd08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ebb970305844dccacf48a7d8d47ecf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:56:40.339722 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-7074ea02-a6d9-4584-a3f3-fb033e2e1442 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '37f21d6d15cf40a586edda211219fd08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ebb970305844dccacf48a7d8d47ecf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:56:40.341230 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-7074ea02-a6d9-4584-a3f3-fb033e2e1442 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '37f21d6d15cf40a586edda211219fd08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ebb970305844dccacf48a7d8d47ecf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:56:40.342364 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-7074ea02-a6d9-4584-a3f3-fb033e2e1442 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] 10.222.0.11 "GET /compute/v2.1/servers/c934945b-ff48-414a-8910-b206a86192b9" status: 200 len: 1408 microversion: 2.20 time: 0.158769 Nov 17 03:56:40.342915 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 1324/2914] 10.222.0.11 () {60 vars in 1276 bytes} [Wed Nov 17 03:56:40 2021] GET /compute/v2.1/servers/c934945b-ff48-414a-8910-b206a86192b9 => generated 1408 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 17 03:56:41.180685 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-1bc17b88-1b6e-40c6-89e7-326a2c421893 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:56:41.182072 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-1bc17b88-1b6e-40c6-89e7-326a2c421893 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] [instance: 15abb40f-daf9-4c4b-ac9c-55f57ee7b938] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:56:41.192510 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-1bc17b88-1b6e-40c6-89e7-326a2c421893 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:56:41.194285 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-1bc17b88-1b6e-40c6-89e7-326a2c421893 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:56:41.195568 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-1bc17b88-1b6e-40c6-89e7-326a2c421893 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:56:41.196293 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-1bc17b88-1b6e-40c6-89e7-326a2c421893 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:56:41.353388 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-1bc17b88-1b6e-40c6-89e7-326a2c421893 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a792b5b7e6f7461b8d802a5abaaa9518', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e843a3fb49f41dcb376184d7e156528', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:56:41.361769 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-1bc17b88-1b6e-40c6-89e7-326a2c421893 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] 10.222.0.11 "GET /compute/v2.1/servers/15abb40f-daf9-4c4b-ac9c-55f57ee7b938" status: 200 len: 1558 microversion: 2.1 time: 0.187694 Nov 17 03:56:41.362345 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 1325/2915] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:56:41 2021] GET /compute/v2.1/servers/15abb40f-daf9-4c4b-ac9c-55f57ee7b938 => generated 1558 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:56:41.366671 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-2285660f-10bc-4307-ad37-85cbb14cdade tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:56:41.367273 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-2285660f-10bc-4307-ad37-85cbb14cdade tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] [instance: c934945b-ff48-414a-8910-b206a86192b9] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:56:41.373361 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-2285660f-10bc-4307-ad37-85cbb14cdade tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:56:41.373853 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-2285660f-10bc-4307-ad37-85cbb14cdade tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:56:41.374623 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-2285660f-10bc-4307-ad37-85cbb14cdade tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:56:41.375052 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-2285660f-10bc-4307-ad37-85cbb14cdade tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:56:41.506937 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-2285660f-10bc-4307-ad37-85cbb14cdade tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37f21d6d15cf40a586edda211219fd08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ebb970305844dccacf48a7d8d47ecf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:56:41.515186 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-2285660f-10bc-4307-ad37-85cbb14cdade tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '37f21d6d15cf40a586edda211219fd08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ebb970305844dccacf48a7d8d47ecf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:56:41.516797 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-2285660f-10bc-4307-ad37-85cbb14cdade tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '37f21d6d15cf40a586edda211219fd08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ebb970305844dccacf48a7d8d47ecf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:56:41.517968 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-2285660f-10bc-4307-ad37-85cbb14cdade tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] 10.222.0.11 "GET /compute/v2.1/servers/c934945b-ff48-414a-8910-b206a86192b9" status: 200 len: 1600 microversion: 2.20 time: 0.154713 Nov 17 03:56:41.518536 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 1326/2916] 10.222.0.11 () {60 vars in 1276 bytes} [Wed Nov 17 03:56:41 2021] GET /compute/v2.1/servers/c934945b-ff48-414a-8910-b206a86192b9 => generated 1600 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 17 03:56:41.535207 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-77a73893-3d6e-44e5-b8de-ab16e23b1da0 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:56:41.535692 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-77a73893-3d6e-44e5-b8de-ab16e23b1da0 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] [instance: c934945b-ff48-414a-8910-b206a86192b9] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:56:41.541699 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-77a73893-3d6e-44e5-b8de-ab16e23b1da0 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:56:41.542113 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-77a73893-3d6e-44e5-b8de-ab16e23b1da0 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:56:41.542905 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-77a73893-3d6e-44e5-b8de-ab16e23b1da0 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:56:41.550186 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-77a73893-3d6e-44e5-b8de-ab16e23b1da0 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:56:41.593300 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.wsgi [None req-0c98ad03-1e57-4542-97ff-d7a41b641ec0 tempest-VolumesNegativeTest-1679335271 tempest-VolumesNegativeTest-1679335271-project] HTTP exception thrown: Volume 9fd9d62c-1a80-46a6-a5a3-f5077f58f2ec could not be found. Nov 17 03:56:41.594298 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-0c98ad03-1e57-4542-97ff-d7a41b641ec0 tempest-VolumesNegativeTest-1679335271 tempest-VolumesNegativeTest-1679335271-project] Returning 404 to user: Volume 9fd9d62c-1a80-46a6-a5a3-f5077f58f2ec could not be found. {{(pid=115917) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 17 03:56:41.595118 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-0c98ad03-1e57-4542-97ff-d7a41b641ec0 tempest-VolumesNegativeTest-1679335271 tempest-VolumesNegativeTest-1679335271-project] 10.222.0.11 "DELETE /compute/v2.1/os-volumes/9fd9d62c-1a80-46a6-a5a3-f5077f58f2ec" status: 404 len: 109 microversion: 2.1 time: 19.536973 Nov 17 03:56:41.595787 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 1591/2917] 10.222.0.11 () {58 vars in 1247 bytes} [Wed Nov 17 03:56:22 2021] DELETE /compute/v2.1/os-volumes/9fd9d62c-1a80-46a6-a5a3-f5077f58f2ec => generated 109 bytes in 19538 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 17 03:56:41.605594 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-20a35f3b-99b8-48ba-8863-73a6192ac113 tempest-VolumesNegativeTest-1679335271 tempest-VolumesNegativeTest-1679335271-project] Calling method '.version_select at 0x7f9e22168ca0>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:56:41.640247 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-77a73893-3d6e-44e5-b8de-ab16e23b1da0 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] 10.222.0.11 "GET /compute/v2.1/servers/c934945b-ff48-414a-8910-b206a86192b9/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.108788 Nov 17 03:56:41.641082 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 1327/2918] 10.222.0.11 () {60 vars in 1315 bytes} [Wed Nov 17 03:56:41 2021] GET /compute/v2.1/servers/c934945b-ff48-414a-8910-b206a86192b9/os-interface => generated 284 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 17 03:56:41.654250 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-87d3da8c-d24d-4172-81a6-b83c9754e6d5 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:56:41.654745 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-87d3da8c-d24d-4172-81a6-b83c9754e6d5 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] [instance: 6dc785d7-bc95-4fee-8206-c2fd3b930e4f] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:56:41.662602 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-87d3da8c-d24d-4172-81a6-b83c9754e6d5 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:56:41.663710 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-87d3da8c-d24d-4172-81a6-b83c9754e6d5 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:56:41.664515 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-87d3da8c-d24d-4172-81a6-b83c9754e6d5 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:56:41.665193 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-87d3da8c-d24d-4172-81a6-b83c9754e6d5 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:56:41.694531 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-87d3da8c-d24d-4172-81a6-b83c9754e6d5 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] [instance: 6dc785d7-bc95-4fee-8206-c2fd3b930e4f] Going to try to terminate instance {{(pid=115916) delete /opt/stack/nova/nova/compute/api.py:2614}} Nov 17 03:56:41.782430 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-87d3da8c-d24d-4172-81a6-b83c9754e6d5 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] 10.222.0.11 "DELETE /compute/v2.1/servers/6dc785d7-bc95-4fee-8206-c2fd3b930e4f" status: 204 len: 0 microversion: 2.1 time: 0.131625 Nov 17 03:56:41.783557 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 1328/2919] 10.222.0.11 () {58 vars in 1238 bytes} [Wed Nov 17 03:56:41 2021] DELETE /compute/v2.1/servers/6dc785d7-bc95-4fee-8206-c2fd3b930e4f => generated 0 bytes in 133 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Nov 17 03:56:41.791989 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-5aacea40-2b3c-4f53-ac27-377681d60641 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:56:41.792992 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-5aacea40-2b3c-4f53-ac27-377681d60641 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] [instance: 6dc785d7-bc95-4fee-8206-c2fd3b930e4f] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:56:41.799962 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-5aacea40-2b3c-4f53-ac27-377681d60641 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:56:41.800464 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-5aacea40-2b3c-4f53-ac27-377681d60641 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:56:41.801597 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-5aacea40-2b3c-4f53-ac27-377681d60641 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:56:41.802201 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-5aacea40-2b3c-4f53-ac27-377681d60641 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:56:41.937078 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-5aacea40-2b3c-4f53-ac27-377681d60641 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f046401c6a04f6495ebe0821120bd72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a58e89ceeea4a9c8a72a1de4bcaf2d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:56:41.944618 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-5aacea40-2b3c-4f53-ac27-377681d60641 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] 10.222.0.11 "GET /compute/v2.1/servers/6dc785d7-bc95-4fee-8206-c2fd3b930e4f" status: 200 len: 1507 microversion: 2.1 time: 0.156706 Nov 17 03:56:41.945220 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 1329/2920] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:56:41 2021] GET /compute/v2.1/servers/6dc785d7-bc95-4fee-8206-c2fd3b930e4f => generated 1507 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 17 03:56:42.385569 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-8598f924-1527-41ba-8f8c-e10d7d9d65d1 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:56:42.386243 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-8598f924-1527-41ba-8f8c-e10d7d9d65d1 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] [instance: 15abb40f-daf9-4c4b-ac9c-55f57ee7b938] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:56:42.392593 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-8598f924-1527-41ba-8f8c-e10d7d9d65d1 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:56:42.393072 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-8598f924-1527-41ba-8f8c-e10d7d9d65d1 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:56:42.393846 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-8598f924-1527-41ba-8f8c-e10d7d9d65d1 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:56:42.394274 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-8598f924-1527-41ba-8f8c-e10d7d9d65d1 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:56:42.526560 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-8598f924-1527-41ba-8f8c-e10d7d9d65d1 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a792b5b7e6f7461b8d802a5abaaa9518', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e843a3fb49f41dcb376184d7e156528', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:56:42.536337 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-8598f924-1527-41ba-8f8c-e10d7d9d65d1 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] 10.222.0.11 "GET /compute/v2.1/servers/15abb40f-daf9-4c4b-ac9c-55f57ee7b938" status: 200 len: 1558 microversion: 2.1 time: 0.160690 Nov 17 03:56:42.537048 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 1330/2921] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:56:42 2021] GET /compute/v2.1/servers/15abb40f-daf9-4c4b-ac9c-55f57ee7b938 => generated 1558 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:56:42.662502 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-9716010d-3532-45bd-b75b-32ceec3f364d tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 17 03:56:42.663490 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-9716010d-3532-45bd-b75b-32ceec3f364d tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] [instance: c934945b-ff48-414a-8910-b206a86192b9] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:56:42.669453 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-9716010d-3532-45bd-b75b-32ceec3f364d tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:56:42.669898 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-9716010d-3532-45bd-b75b-32ceec3f364d tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:56:42.670697 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-9716010d-3532-45bd-b75b-32ceec3f364d tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:56:42.671121 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-9716010d-3532-45bd-b75b-32ceec3f364d tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:56:42.753521 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-9716010d-3532-45bd-b75b-32ceec3f364d tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] 10.222.0.11 "POST /compute/v2.1/servers/c934945b-ff48-414a-8910-b206a86192b9/action" status: 200 len: 14 microversion: 2.20 time: 0.093930 Nov 17 03:56:42.756971 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 1331/2922] 10.222.0.11 () {62 vars in 1318 bytes} [Wed Nov 17 03:56:42 2021] POST /compute/v2.1/servers/c934945b-ff48-414a-8910-b206a86192b9/action => generated 14 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:56:42.760348 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [req-1b76d211-77be-4b6a-bfd5-c5adaabc3822 req-454cdcca-5d44-41e3-aee0-2e2da0864f20 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c934945b-ff48-414a-8910-b206a86192b9", "tag": "6c4379b9-2465-4b23-9d1c-06f2cb7a27c4"}]} {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 17 03:56:42.761865 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 17 03:56:42.761865 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: warnings.warn(msg) Nov 17 03:56:42.769719 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [req-1b76d211-77be-4b6a-bfd5-c5adaabc3822 req-454cdcca-5d44-41e3-aee0-2e2da0864f20 service nova] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:56:42.770155 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [req-1b76d211-77be-4b6a-bfd5-c5adaabc3822 req-454cdcca-5d44-41e3-aee0-2e2da0864f20 service nova] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:56:42.781646 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.compute.server_external_events [req-1b76d211-77be-4b6a-bfd5-c5adaabc3822 req-454cdcca-5d44-41e3-aee0-2e2da0864f20 service nova] Creating event network-changed:6c4379b9-2465-4b23-9d1c-06f2cb7a27c4 for instance c934945b-ff48-414a-8910-b206a86192b9 on hv-cinder-81803 Nov 17 03:56:42.786939 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [req-1b76d211-77be-4b6a-bfd5-c5adaabc3822 req-454cdcca-5d44-41e3-aee0-2e2da0864f20 service nova] 10.222.0.11 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030523 Nov 17 03:56:42.787864 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 1332/2923] 10.222.0.11 () {64 vars in 1317 bytes} [Wed Nov 17 03:56:42 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 17 03:56:42.963522 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-af6dc899-7717-43ea-aee4-5bb044ea14d6 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:56:42.964221 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-af6dc899-7717-43ea-aee4-5bb044ea14d6 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] [instance: 6dc785d7-bc95-4fee-8206-c2fd3b930e4f] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:56:42.971445 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-af6dc899-7717-43ea-aee4-5bb044ea14d6 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:56:42.971445 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-af6dc899-7717-43ea-aee4-5bb044ea14d6 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:56:42.972234 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-af6dc899-7717-43ea-aee4-5bb044ea14d6 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:56:42.972670 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-af6dc899-7717-43ea-aee4-5bb044ea14d6 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:56:43.322239 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-af6dc899-7717-43ea-aee4-5bb044ea14d6 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f046401c6a04f6495ebe0821120bd72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a58e89ceeea4a9c8a72a1de4bcaf2d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:56:43.330911 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-af6dc899-7717-43ea-aee4-5bb044ea14d6 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] 10.222.0.11 "GET /compute/v2.1/servers/6dc785d7-bc95-4fee-8206-c2fd3b930e4f" status: 200 len: 1507 microversion: 2.1 time: 0.371317 Nov 17 03:56:43.336789 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 1333/2924] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:56:42 2021] GET /compute/v2.1/servers/6dc785d7-bc95-4fee-8206-c2fd3b930e4f => generated 1507 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 17 03:56:43.555257 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-7a30d3a0-bd31-4424-9bb1-bbadb160a379 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:56:43.556030 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-7a30d3a0-bd31-4424-9bb1-bbadb160a379 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] [instance: 15abb40f-daf9-4c4b-ac9c-55f57ee7b938] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:56:43.562551 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-7a30d3a0-bd31-4424-9bb1-bbadb160a379 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:56:43.563058 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-7a30d3a0-bd31-4424-9bb1-bbadb160a379 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:56:43.563871 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-7a30d3a0-bd31-4424-9bb1-bbadb160a379 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:56:43.564387 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-7a30d3a0-bd31-4424-9bb1-bbadb160a379 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:56:43.799246 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-7a30d3a0-bd31-4424-9bb1-bbadb160a379 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a792b5b7e6f7461b8d802a5abaaa9518', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e843a3fb49f41dcb376184d7e156528', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:56:43.807892 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-7a30d3a0-bd31-4424-9bb1-bbadb160a379 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] 10.222.0.11 "GET /compute/v2.1/servers/15abb40f-daf9-4c4b-ac9c-55f57ee7b938" status: 200 len: 1558 microversion: 2.1 time: 0.257522 Nov 17 03:56:43.808767 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 1334/2925] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:56:43 2021] GET /compute/v2.1/servers/15abb40f-daf9-4c4b-ac9c-55f57ee7b938 => generated 1558 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:56:43.813808 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-175c6f4f-ee02-4166-b3d9-a58df09ac9ec tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 17 03:56:43.814981 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-175c6f4f-ee02-4166-b3d9-a58df09ac9ec tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] [instance: c934945b-ff48-414a-8910-b206a86192b9] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:56:43.827523 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-175c6f4f-ee02-4166-b3d9-a58df09ac9ec tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:56:43.827523 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-175c6f4f-ee02-4166-b3d9-a58df09ac9ec tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:56:43.828182 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-175c6f4f-ee02-4166-b3d9-a58df09ac9ec tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:56:43.829280 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-175c6f4f-ee02-4166-b3d9-a58df09ac9ec tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:56:43.934862 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-175c6f4f-ee02-4166-b3d9-a58df09ac9ec tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] 10.222.0.11 "POST /compute/v2.1/servers/c934945b-ff48-414a-8910-b206a86192b9/action" status: 200 len: 14 microversion: 2.20 time: 0.124520 Nov 17 03:56:43.935492 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 1335/2926] 10.222.0.11 () {62 vars in 1318 bytes} [Wed Nov 17 03:56:43 2021] POST /compute/v2.1/servers/c934945b-ff48-414a-8910-b206a86192b9/action => generated 14 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:56:44.356891 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-84b4f41f-7c8c-4aca-a1f7-87451ed788e4 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:56:44.357780 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-84b4f41f-7c8c-4aca-a1f7-87451ed788e4 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] [instance: 6dc785d7-bc95-4fee-8206-c2fd3b930e4f] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:56:44.365769 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-84b4f41f-7c8c-4aca-a1f7-87451ed788e4 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:56:44.366229 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-84b4f41f-7c8c-4aca-a1f7-87451ed788e4 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:56:44.366991 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-84b4f41f-7c8c-4aca-a1f7-87451ed788e4 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:56:44.367419 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-84b4f41f-7c8c-4aca-a1f7-87451ed788e4 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:56:44.381081 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.wsgi [None req-84b4f41f-7c8c-4aca-a1f7-87451ed788e4 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] HTTP exception thrown: Instance 6dc785d7-bc95-4fee-8206-c2fd3b930e4f could not be found. Nov 17 03:56:44.381662 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-84b4f41f-7c8c-4aca-a1f7-87451ed788e4 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Returning 404 to user: Instance 6dc785d7-bc95-4fee-8206-c2fd3b930e4f could not be found. {{(pid=115916) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 17 03:56:44.382467 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-84b4f41f-7c8c-4aca-a1f7-87451ed788e4 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] 10.222.0.11 "GET /compute/v2.1/servers/6dc785d7-bc95-4fee-8206-c2fd3b930e4f" status: 404 len: 111 microversion: 2.1 time: 0.031505 Nov 17 03:56:44.382989 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 1336/2927] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:56:44 2021] GET /compute/v2.1/servers/6dc785d7-bc95-4fee-8206-c2fd3b930e4f => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 17 03:56:44.390431 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-1e74646b-51dd-43d6-9a06-a5f32c793276 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:56:44.390918 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-1e74646b-51dd-43d6-9a06-a5f32c793276 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] [instance: a49437df-3059-4528-8328-2f3471d5fb45] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:56:44.404158 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-1e74646b-51dd-43d6-9a06-a5f32c793276 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:56:44.404956 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-1e74646b-51dd-43d6-9a06-a5f32c793276 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:56:44.406240 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-1e74646b-51dd-43d6-9a06-a5f32c793276 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:56:44.406962 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-1e74646b-51dd-43d6-9a06-a5f32c793276 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:56:44.439645 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-1e74646b-51dd-43d6-9a06-a5f32c793276 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] [instance: a49437df-3059-4528-8328-2f3471d5fb45] Going to try to terminate instance {{(pid=115916) delete /opt/stack/nova/nova/compute/api.py:2614}} Nov 17 03:56:44.525767 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-1e74646b-51dd-43d6-9a06-a5f32c793276 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] 10.222.0.11 "DELETE /compute/v2.1/servers/a49437df-3059-4528-8328-2f3471d5fb45" status: 204 len: 0 microversion: 2.1 time: 0.138329 Nov 17 03:56:44.526666 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 1337/2928] 10.222.0.11 () {58 vars in 1238 bytes} [Wed Nov 17 03:56:44 2021] DELETE /compute/v2.1/servers/a49437df-3059-4528-8328-2f3471d5fb45 => generated 0 bytes in 140 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 17 03:56:44.536754 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-2e5cc671-1ce8-4774-829d-c700df643d75 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:56:44.537864 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-2e5cc671-1ce8-4774-829d-c700df643d75 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] [instance: a49437df-3059-4528-8328-2f3471d5fb45] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:56:44.543730 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-2e5cc671-1ce8-4774-829d-c700df643d75 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:56:44.544180 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-2e5cc671-1ce8-4774-829d-c700df643d75 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:56:44.544976 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-2e5cc671-1ce8-4774-829d-c700df643d75 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:56:44.545392 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-2e5cc671-1ce8-4774-829d-c700df643d75 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:56:44.676149 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-2e5cc671-1ce8-4774-829d-c700df643d75 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f046401c6a04f6495ebe0821120bd72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a58e89ceeea4a9c8a72a1de4bcaf2d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:56:44.684010 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-2e5cc671-1ce8-4774-829d-c700df643d75 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] 10.222.0.11 "GET /compute/v2.1/servers/a49437df-3059-4528-8328-2f3471d5fb45" status: 200 len: 1566 microversion: 2.1 time: 0.153023 Nov 17 03:56:44.684573 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 1338/2929] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:56:44 2021] GET /compute/v2.1/servers/a49437df-3059-4528-8328-2f3471d5fb45 => generated 1566 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 17 03:56:44.807899 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [req-a67d308c-3563-4932-a58a-4e4d8c7ac8bf req-0b83ee49-78d2-475e-90eb-00768384140a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6dc785d7-bc95-4fee-8206-c2fd3b930e4f", "name": "network-vif-deleted", "tag": "3bae275b-d629-47b7-b478-95973e33b83e"}]} {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 17 03:56:44.810525 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 17 03:56:44.810525 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: warnings.warn(msg) Nov 17 03:56:44.818850 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [req-a67d308c-3563-4932-a58a-4e4d8c7ac8bf req-0b83ee49-78d2-475e-90eb-00768384140a service nova] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:56:44.819294 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [req-a67d308c-3563-4932-a58a-4e4d8c7ac8bf req-0b83ee49-78d2-475e-90eb-00768384140a service nova] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:56:44.830877 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.compute.server_external_events [req-a67d308c-3563-4932-a58a-4e4d8c7ac8bf req-0b83ee49-78d2-475e-90eb-00768384140a service nova] Creating event network-vif-deleted:3bae275b-d629-47b7-b478-95973e33b83e for instance 6dc785d7-bc95-4fee-8206-c2fd3b930e4f on hv-cinder-81803 Nov 17 03:56:44.835710 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [req-a67d308c-3563-4932-a58a-4e4d8c7ac8bf req-0b83ee49-78d2-475e-90eb-00768384140a service nova] 10.222.0.11 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033768 Nov 17 03:56:44.836312 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 1339/2930] 10.222.0.11 () {64 vars in 1317 bytes} [Wed Nov 17 03:56:44 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 17 03:56:44.841058 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-9b1175ed-e475-4b81-bd69-68c599fda461 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:56:44.841742 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-9b1175ed-e475-4b81-bd69-68c599fda461 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] [instance: 15abb40f-daf9-4c4b-ac9c-55f57ee7b938] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:56:44.848764 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-9b1175ed-e475-4b81-bd69-68c599fda461 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:56:44.849238 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-9b1175ed-e475-4b81-bd69-68c599fda461 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:56:44.849999 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-9b1175ed-e475-4b81-bd69-68c599fda461 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:56:44.850414 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-9b1175ed-e475-4b81-bd69-68c599fda461 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:56:45.001849 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-9b1175ed-e475-4b81-bd69-68c599fda461 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a792b5b7e6f7461b8d802a5abaaa9518', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e843a3fb49f41dcb376184d7e156528', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:56:45.010379 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-9b1175ed-e475-4b81-bd69-68c599fda461 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] 10.222.0.11 "GET /compute/v2.1/servers/15abb40f-daf9-4c4b-ac9c-55f57ee7b938" status: 200 len: 1558 microversion: 2.1 time: 0.172940 Nov 17 03:56:45.011219 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 1340/2931] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:56:44 2021] GET /compute/v2.1/servers/15abb40f-daf9-4c4b-ac9c-55f57ee7b938 => generated 1558 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:56:45.015595 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-0c5d768c-013b-4feb-abd0-5bfd2149a073 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 17 03:56:45.016941 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-0c5d768c-013b-4feb-abd0-5bfd2149a073 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] [instance: c934945b-ff48-414a-8910-b206a86192b9] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:56:45.023212 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-0c5d768c-013b-4feb-abd0-5bfd2149a073 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:56:45.023658 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-0c5d768c-013b-4feb-abd0-5bfd2149a073 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:56:45.024429 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-0c5d768c-013b-4feb-abd0-5bfd2149a073 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:56:45.024886 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-0c5d768c-013b-4feb-abd0-5bfd2149a073 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:56:45.126084 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-0c5d768c-013b-4feb-abd0-5bfd2149a073 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] 10.222.0.11 "POST /compute/v2.1/servers/c934945b-ff48-414a-8910-b206a86192b9/action" status: 200 len: 14 microversion: 2.20 time: 0.113810 Nov 17 03:56:45.126753 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 1341/2932] 10.222.0.11 () {62 vars in 1318 bytes} [Wed Nov 17 03:56:45 2021] POST /compute/v2.1/servers/c934945b-ff48-414a-8910-b206a86192b9/action => generated 14 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:56:45.705005 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-da39237d-d968-4a6e-a19a-c9e7ebc1b24b tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:56:45.705684 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-da39237d-d968-4a6e-a19a-c9e7ebc1b24b tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] [instance: a49437df-3059-4528-8328-2f3471d5fb45] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:56:45.714264 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-da39237d-d968-4a6e-a19a-c9e7ebc1b24b tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:56:45.714688 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-da39237d-d968-4a6e-a19a-c9e7ebc1b24b tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:56:45.715516 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-da39237d-d968-4a6e-a19a-c9e7ebc1b24b tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:56:45.715953 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-da39237d-d968-4a6e-a19a-c9e7ebc1b24b tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:56:45.783929 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-da39237d-d968-4a6e-a19a-c9e7ebc1b24b tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f046401c6a04f6495ebe0821120bd72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a58e89ceeea4a9c8a72a1de4bcaf2d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:56:45.791866 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-da39237d-d968-4a6e-a19a-c9e7ebc1b24b tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] 10.222.0.11 "GET /compute/v2.1/servers/a49437df-3059-4528-8328-2f3471d5fb45" status: 200 len: 1524 microversion: 2.1 time: 0.091990 Nov 17 03:56:45.792433 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 1342/2933] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:56:45 2021] GET /compute/v2.1/servers/a49437df-3059-4528-8328-2f3471d5fb45 => generated 1524 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:56:45.943383 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [req-7295eb4a-2829-4435-a58e-79fc93733082 req-aad8da02-1e5a-4acc-b74c-e30f76169629 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a49437df-3059-4528-8328-2f3471d5fb45", "name": "network-vif-deleted", "tag": "f5a50f15-2a7b-434f-8c53-dafbe11047db"}]} {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 17 03:56:45.944970 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 17 03:56:45.944970 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: warnings.warn(msg) Nov 17 03:56:45.952171 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [req-7295eb4a-2829-4435-a58e-79fc93733082 req-aad8da02-1e5a-4acc-b74c-e30f76169629 service nova] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:56:45.952612 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [req-7295eb4a-2829-4435-a58e-79fc93733082 req-aad8da02-1e5a-4acc-b74c-e30f76169629 service nova] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:56:45.964005 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.compute.server_external_events [req-7295eb4a-2829-4435-a58e-79fc93733082 req-aad8da02-1e5a-4acc-b74c-e30f76169629 service nova] Creating event network-vif-deleted:f5a50f15-2a7b-434f-8c53-dafbe11047db for instance a49437df-3059-4528-8328-2f3471d5fb45 on hv-cinder-81803 Nov 17 03:56:45.968867 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [req-7295eb4a-2829-4435-a58e-79fc93733082 req-aad8da02-1e5a-4acc-b74c-e30f76169629 service nova] 10.222.0.11 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.088535 Nov 17 03:56:45.969500 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 1343/2934] 10.222.0.11 () {64 vars in 1317 bytes} [Wed Nov 17 03:56:45 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 17 03:56:46.032264 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-8f4ac045-4ccc-4fd5-b4a4-7beee942c3a7 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:56:46.033329 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-8f4ac045-4ccc-4fd5-b4a4-7beee942c3a7 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] [instance: 15abb40f-daf9-4c4b-ac9c-55f57ee7b938] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:56:46.040097 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-8f4ac045-4ccc-4fd5-b4a4-7beee942c3a7 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:56:46.040546 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-8f4ac045-4ccc-4fd5-b4a4-7beee942c3a7 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:56:46.041364 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-8f4ac045-4ccc-4fd5-b4a4-7beee942c3a7 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:56:46.041800 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-8f4ac045-4ccc-4fd5-b4a4-7beee942c3a7 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:56:46.176533 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-8f4ac045-4ccc-4fd5-b4a4-7beee942c3a7 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a792b5b7e6f7461b8d802a5abaaa9518', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e843a3fb49f41dcb376184d7e156528', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:56:46.184550 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-8f4ac045-4ccc-4fd5-b4a4-7beee942c3a7 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] 10.222.0.11 "GET /compute/v2.1/servers/15abb40f-daf9-4c4b-ac9c-55f57ee7b938" status: 200 len: 1558 microversion: 2.1 time: 0.159381 Nov 17 03:56:46.185208 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 1344/2935] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:56:46 2021] GET /compute/v2.1/servers/15abb40f-daf9-4c4b-ac9c-55f57ee7b938 => generated 1558 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:56:46.189799 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-f40bb96d-3148-4fd2-b25b-b1668c334176 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 17 03:56:46.190699 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-f40bb96d-3148-4fd2-b25b-b1668c334176 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] [instance: c934945b-ff48-414a-8910-b206a86192b9] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:56:46.196602 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-f40bb96d-3148-4fd2-b25b-b1668c334176 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:56:46.197091 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-f40bb96d-3148-4fd2-b25b-b1668c334176 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:56:46.197926 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-f40bb96d-3148-4fd2-b25b-b1668c334176 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:56:46.198355 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-f40bb96d-3148-4fd2-b25b-b1668c334176 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:56:46.282415 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-f40bb96d-3148-4fd2-b25b-b1668c334176 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] 10.222.0.11 "POST /compute/v2.1/servers/c934945b-ff48-414a-8910-b206a86192b9/action" status: 200 len: 14 microversion: 2.20 time: 0.095998 Nov 17 03:56:46.283032 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 1345/2936] 10.222.0.11 () {62 vars in 1318 bytes} [Wed Nov 17 03:56:46 2021] POST /compute/v2.1/servers/c934945b-ff48-414a-8910-b206a86192b9/action => generated 14 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:56:46.809718 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-2fc7567e-7c31-419e-9a1f-7b1a937db721 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:56:46.810662 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-2fc7567e-7c31-419e-9a1f-7b1a937db721 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] [instance: a49437df-3059-4528-8328-2f3471d5fb45] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:56:46.818912 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-2fc7567e-7c31-419e-9a1f-7b1a937db721 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:56:46.819776 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-2fc7567e-7c31-419e-9a1f-7b1a937db721 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:56:46.820546 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-2fc7567e-7c31-419e-9a1f-7b1a937db721 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:56:46.821049 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-2fc7567e-7c31-419e-9a1f-7b1a937db721 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:56:46.893392 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-2fc7567e-7c31-419e-9a1f-7b1a937db721 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f046401c6a04f6495ebe0821120bd72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a58e89ceeea4a9c8a72a1de4bcaf2d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:56:46.902250 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-2fc7567e-7c31-419e-9a1f-7b1a937db721 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] 10.222.0.11 "GET /compute/v2.1/servers/a49437df-3059-4528-8328-2f3471d5fb45" status: 200 len: 1352 microversion: 2.1 time: 0.096587 Nov 17 03:56:46.902819 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 1346/2937] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:56:46 2021] GET /compute/v2.1/servers/a49437df-3059-4528-8328-2f3471d5fb45 => generated 1352 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:56:47.205159 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-b8cb925a-2d08-40e2-b264-ac42a57a2f35 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:56:47.205677 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-b8cb925a-2d08-40e2-b264-ac42a57a2f35 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] [instance: 15abb40f-daf9-4c4b-ac9c-55f57ee7b938] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:56:47.212978 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-b8cb925a-2d08-40e2-b264-ac42a57a2f35 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:56:47.213429 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-b8cb925a-2d08-40e2-b264-ac42a57a2f35 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:56:47.214541 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-b8cb925a-2d08-40e2-b264-ac42a57a2f35 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:56:47.214975 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-b8cb925a-2d08-40e2-b264-ac42a57a2f35 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:56:47.372299 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-b8cb925a-2d08-40e2-b264-ac42a57a2f35 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a792b5b7e6f7461b8d802a5abaaa9518', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e843a3fb49f41dcb376184d7e156528', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:56:47.386991 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-b8cb925a-2d08-40e2-b264-ac42a57a2f35 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] 10.222.0.11 "GET /compute/v2.1/servers/15abb40f-daf9-4c4b-ac9c-55f57ee7b938" status: 200 len: 1558 microversion: 2.1 time: 0.187016 Nov 17 03:56:47.387771 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 1347/2938] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:56:47 2021] GET /compute/v2.1/servers/15abb40f-daf9-4c4b-ac9c-55f57ee7b938 => generated 1558 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:56:47.392370 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-0a7c3780-45a1-4e96-b092-dfb501d84a01 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 17 03:56:47.393361 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-0a7c3780-45a1-4e96-b092-dfb501d84a01 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] [instance: c934945b-ff48-414a-8910-b206a86192b9] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:56:47.399752 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-0a7c3780-45a1-4e96-b092-dfb501d84a01 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:56:47.400204 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-0a7c3780-45a1-4e96-b092-dfb501d84a01 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:56:47.401023 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-0a7c3780-45a1-4e96-b092-dfb501d84a01 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:56:47.401461 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-0a7c3780-45a1-4e96-b092-dfb501d84a01 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:56:47.483263 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-0a7c3780-45a1-4e96-b092-dfb501d84a01 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] 10.222.0.11 "POST /compute/v2.1/servers/c934945b-ff48-414a-8910-b206a86192b9/action" status: 200 len: 14 microversion: 2.20 time: 0.094071 Nov 17 03:56:47.483807 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 1348/2939] 10.222.0.11 () {62 vars in 1318 bytes} [Wed Nov 17 03:56:47 2021] POST /compute/v2.1/servers/c934945b-ff48-414a-8910-b206a86192b9/action => generated 14 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:56:47.927968 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-8c6ea291-2cd7-4d27-af70-a567a3a59e7e tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:56:47.928699 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-8c6ea291-2cd7-4d27-af70-a567a3a59e7e tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] [instance: a49437df-3059-4528-8328-2f3471d5fb45] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:56:47.936162 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-8c6ea291-2cd7-4d27-af70-a567a3a59e7e tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:56:47.936620 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-8c6ea291-2cd7-4d27-af70-a567a3a59e7e tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:56:47.937424 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-8c6ea291-2cd7-4d27-af70-a567a3a59e7e tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:56:47.937859 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-8c6ea291-2cd7-4d27-af70-a567a3a59e7e tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:56:48.006320 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-8c6ea291-2cd7-4d27-af70-a567a3a59e7e tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f046401c6a04f6495ebe0821120bd72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a58e89ceeea4a9c8a72a1de4bcaf2d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:56:48.016837 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-8c6ea291-2cd7-4d27-af70-a567a3a59e7e tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] 10.222.0.11 "GET /compute/v2.1/servers/a49437df-3059-4528-8328-2f3471d5fb45" status: 200 len: 1352 microversion: 2.1 time: 0.093146 Nov 17 03:56:48.017643 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 1349/2940] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:56:47 2021] GET /compute/v2.1/servers/a49437df-3059-4528-8328-2f3471d5fb45 => generated 1352 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:56:48.407895 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-daca945f-cc17-4b93-90fe-8303da370e8d tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:56:48.409009 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-daca945f-cc17-4b93-90fe-8303da370e8d tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] [instance: 15abb40f-daf9-4c4b-ac9c-55f57ee7b938] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:56:48.416219 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-daca945f-cc17-4b93-90fe-8303da370e8d tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:56:48.416675 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-daca945f-cc17-4b93-90fe-8303da370e8d tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:56:48.417490 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-daca945f-cc17-4b93-90fe-8303da370e8d tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:56:48.417927 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-daca945f-cc17-4b93-90fe-8303da370e8d tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:56:48.558800 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-daca945f-cc17-4b93-90fe-8303da370e8d tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a792b5b7e6f7461b8d802a5abaaa9518', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e843a3fb49f41dcb376184d7e156528', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:56:48.568601 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-daca945f-cc17-4b93-90fe-8303da370e8d tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] 10.222.0.11 "GET /compute/v2.1/servers/15abb40f-daf9-4c4b-ac9c-55f57ee7b938" status: 200 len: 1558 microversion: 2.1 time: 0.166988 Nov 17 03:56:48.569185 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 1350/2941] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:56:48 2021] GET /compute/v2.1/servers/15abb40f-daf9-4c4b-ac9c-55f57ee7b938 => generated 1558 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:56:48.573516 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-8e33595c-f7e7-42fc-b258-f99bd6edef38 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 17 03:56:48.574419 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-8e33595c-f7e7-42fc-b258-f99bd6edef38 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] [instance: c934945b-ff48-414a-8910-b206a86192b9] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:56:48.579991 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-8e33595c-f7e7-42fc-b258-f99bd6edef38 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:56:48.580440 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-8e33595c-f7e7-42fc-b258-f99bd6edef38 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:56:48.581403 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-8e33595c-f7e7-42fc-b258-f99bd6edef38 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:56:48.581843 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-8e33595c-f7e7-42fc-b258-f99bd6edef38 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:56:48.662547 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-8e33595c-f7e7-42fc-b258-f99bd6edef38 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] 10.222.0.11 "POST /compute/v2.1/servers/c934945b-ff48-414a-8910-b206a86192b9/action" status: 200 len: 14 microversion: 2.20 time: 0.091590 Nov 17 03:56:48.663406 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 1351/2942] 10.222.0.11 () {62 vars in 1318 bytes} [Wed Nov 17 03:56:48 2021] POST /compute/v2.1/servers/c934945b-ff48-414a-8910-b206a86192b9/action => generated 14 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:56:49.037421 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-e2022033-8f30-4bf1-bbe5-b1df9539bcfd tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:56:49.038125 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-e2022033-8f30-4bf1-bbe5-b1df9539bcfd tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] [instance: a49437df-3059-4528-8328-2f3471d5fb45] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:56:49.045543 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-e2022033-8f30-4bf1-bbe5-b1df9539bcfd tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:56:49.046020 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-e2022033-8f30-4bf1-bbe5-b1df9539bcfd tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:56:49.046769 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-e2022033-8f30-4bf1-bbe5-b1df9539bcfd tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:56:49.047205 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-e2022033-8f30-4bf1-bbe5-b1df9539bcfd tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:56:49.111535 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-e2022033-8f30-4bf1-bbe5-b1df9539bcfd tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f046401c6a04f6495ebe0821120bd72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a58e89ceeea4a9c8a72a1de4bcaf2d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:56:49.120307 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-e2022033-8f30-4bf1-bbe5-b1df9539bcfd tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] 10.222.0.11 "GET /compute/v2.1/servers/a49437df-3059-4528-8328-2f3471d5fb45" status: 200 len: 1352 microversion: 2.1 time: 0.088531 Nov 17 03:56:49.120897 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 1352/2943] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:56:49 2021] GET /compute/v2.1/servers/a49437df-3059-4528-8328-2f3471d5fb45 => generated 1352 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:56:49.586081 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-783a944a-3659-4e19-98f4-8c850ef55a52 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:56:49.586632 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-783a944a-3659-4e19-98f4-8c850ef55a52 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] [instance: 15abb40f-daf9-4c4b-ac9c-55f57ee7b938] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:56:49.593612 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-783a944a-3659-4e19-98f4-8c850ef55a52 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:56:49.594070 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-783a944a-3659-4e19-98f4-8c850ef55a52 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:56:49.594851 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-783a944a-3659-4e19-98f4-8c850ef55a52 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:56:49.595294 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-783a944a-3659-4e19-98f4-8c850ef55a52 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:56:49.732524 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-783a944a-3659-4e19-98f4-8c850ef55a52 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a792b5b7e6f7461b8d802a5abaaa9518', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e843a3fb49f41dcb376184d7e156528', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:56:49.744690 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-783a944a-3659-4e19-98f4-8c850ef55a52 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] 10.222.0.11 "GET /compute/v2.1/servers/15abb40f-daf9-4c4b-ac9c-55f57ee7b938" status: 200 len: 1558 microversion: 2.1 time: 0.162173 Nov 17 03:56:49.745501 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 1353/2944] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:56:49 2021] GET /compute/v2.1/servers/15abb40f-daf9-4c4b-ac9c-55f57ee7b938 => generated 1558 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:56:49.749882 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-7e1ce024-8a2a-4c95-b4dd-0ba54a0422c4 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 17 03:56:49.750774 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-7e1ce024-8a2a-4c95-b4dd-0ba54a0422c4 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] [instance: c934945b-ff48-414a-8910-b206a86192b9] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:56:49.756668 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-7e1ce024-8a2a-4c95-b4dd-0ba54a0422c4 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:56:49.757151 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-7e1ce024-8a2a-4c95-b4dd-0ba54a0422c4 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:56:49.757953 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-7e1ce024-8a2a-4c95-b4dd-0ba54a0422c4 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:56:49.758395 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-7e1ce024-8a2a-4c95-b4dd-0ba54a0422c4 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:56:49.837279 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-7e1ce024-8a2a-4c95-b4dd-0ba54a0422c4 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] 10.222.0.11 "POST /compute/v2.1/servers/c934945b-ff48-414a-8910-b206a86192b9/action" status: 200 len: 14 microversion: 2.20 time: 0.089946 Nov 17 03:56:49.838096 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 1354/2945] 10.222.0.11 () {62 vars in 1318 bytes} [Wed Nov 17 03:56:49 2021] POST /compute/v2.1/servers/c934945b-ff48-414a-8910-b206a86192b9/action => generated 14 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:56:50.140205 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-82e3be7d-9d3c-448b-a068-b5279e0c05cb tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:56:50.141225 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-82e3be7d-9d3c-448b-a068-b5279e0c05cb tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] [instance: a49437df-3059-4528-8328-2f3471d5fb45] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:56:50.149552 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-82e3be7d-9d3c-448b-a068-b5279e0c05cb tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:56:50.149992 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-82e3be7d-9d3c-448b-a068-b5279e0c05cb tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:56:50.150758 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-82e3be7d-9d3c-448b-a068-b5279e0c05cb tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:56:50.151186 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-82e3be7d-9d3c-448b-a068-b5279e0c05cb tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:56:50.222013 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-82e3be7d-9d3c-448b-a068-b5279e0c05cb tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f046401c6a04f6495ebe0821120bd72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a58e89ceeea4a9c8a72a1de4bcaf2d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:56:50.234257 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-82e3be7d-9d3c-448b-a068-b5279e0c05cb tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] 10.222.0.11 "GET /compute/v2.1/servers/a49437df-3059-4528-8328-2f3471d5fb45" status: 200 len: 1352 microversion: 2.1 time: 0.099221 Nov 17 03:56:50.235045 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 1355/2946] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:56:50 2021] GET /compute/v2.1/servers/a49437df-3059-4528-8328-2f3471d5fb45 => generated 1352 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:56:50.765980 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-c30ebe09-12a9-4994-8aef-c4429d1c8827 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:56:50.766982 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-c30ebe09-12a9-4994-8aef-c4429d1c8827 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] [instance: 15abb40f-daf9-4c4b-ac9c-55f57ee7b938] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:56:50.777657 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-c30ebe09-12a9-4994-8aef-c4429d1c8827 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:56:50.778402 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-c30ebe09-12a9-4994-8aef-c4429d1c8827 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:56:50.779671 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-c30ebe09-12a9-4994-8aef-c4429d1c8827 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:56:50.780384 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-c30ebe09-12a9-4994-8aef-c4429d1c8827 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:56:50.928365 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-c30ebe09-12a9-4994-8aef-c4429d1c8827 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a792b5b7e6f7461b8d802a5abaaa9518', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e843a3fb49f41dcb376184d7e156528', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:56:50.940293 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-c30ebe09-12a9-4994-8aef-c4429d1c8827 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] 10.222.0.11 "GET /compute/v2.1/servers/15abb40f-daf9-4c4b-ac9c-55f57ee7b938" status: 200 len: 1558 microversion: 2.1 time: 0.180327 Nov 17 03:56:50.941069 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 1356/2947] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:56:50 2021] GET /compute/v2.1/servers/15abb40f-daf9-4c4b-ac9c-55f57ee7b938 => generated 1558 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:56:50.945496 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-ea5c4f47-dbd7-4bf3-b6e1-903a5da80125 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 17 03:56:50.946388 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-ea5c4f47-dbd7-4bf3-b6e1-903a5da80125 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] [instance: c934945b-ff48-414a-8910-b206a86192b9] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:56:50.953436 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-ea5c4f47-dbd7-4bf3-b6e1-903a5da80125 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:56:50.954056 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-ea5c4f47-dbd7-4bf3-b6e1-903a5da80125 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:56:50.955036 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-ea5c4f47-dbd7-4bf3-b6e1-903a5da80125 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:56:50.955623 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-ea5c4f47-dbd7-4bf3-b6e1-903a5da80125 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:56:51.042653 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-ea5c4f47-dbd7-4bf3-b6e1-903a5da80125 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] 10.222.0.11 "POST /compute/v2.1/servers/c934945b-ff48-414a-8910-b206a86192b9/action" status: 200 len: 14 microversion: 2.20 time: 0.099877 Nov 17 03:56:51.043448 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 1357/2948] 10.222.0.11 () {62 vars in 1318 bytes} [Wed Nov 17 03:56:50 2021] POST /compute/v2.1/servers/c934945b-ff48-414a-8910-b206a86192b9/action => generated 14 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:56:51.257019 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-335bdf88-8617-4ce6-a4dd-3b735fecf705 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:56:51.257767 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-335bdf88-8617-4ce6-a4dd-3b735fecf705 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] [instance: a49437df-3059-4528-8328-2f3471d5fb45] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:56:51.265025 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-335bdf88-8617-4ce6-a4dd-3b735fecf705 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:56:51.265474 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-335bdf88-8617-4ce6-a4dd-3b735fecf705 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:56:51.266255 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-335bdf88-8617-4ce6-a4dd-3b735fecf705 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:56:51.266689 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-335bdf88-8617-4ce6-a4dd-3b735fecf705 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:56:51.334620 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-335bdf88-8617-4ce6-a4dd-3b735fecf705 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f046401c6a04f6495ebe0821120bd72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a58e89ceeea4a9c8a72a1de4bcaf2d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:56:51.345231 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-335bdf88-8617-4ce6-a4dd-3b735fecf705 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] 10.222.0.11 "GET /compute/v2.1/servers/a49437df-3059-4528-8328-2f3471d5fb45" status: 200 len: 1352 microversion: 2.1 time: 0.093840 Nov 17 03:56:51.346124 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 1358/2949] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:56:51 2021] GET /compute/v2.1/servers/a49437df-3059-4528-8328-2f3471d5fb45 => generated 1352 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:56:51.962383 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-1a0f41dc-0fac-4a28-9afe-5cf1a8a30aa6 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:56:51.963395 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-1a0f41dc-0fac-4a28-9afe-5cf1a8a30aa6 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] [instance: 15abb40f-daf9-4c4b-ac9c-55f57ee7b938] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:56:51.974039 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-1a0f41dc-0fac-4a28-9afe-5cf1a8a30aa6 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:56:51.974467 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-1a0f41dc-0fac-4a28-9afe-5cf1a8a30aa6 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:56:51.975238 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-1a0f41dc-0fac-4a28-9afe-5cf1a8a30aa6 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:56:51.975662 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-1a0f41dc-0fac-4a28-9afe-5cf1a8a30aa6 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:56:52.121031 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-1a0f41dc-0fac-4a28-9afe-5cf1a8a30aa6 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a792b5b7e6f7461b8d802a5abaaa9518', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e843a3fb49f41dcb376184d7e156528', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:56:52.132883 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-1a0f41dc-0fac-4a28-9afe-5cf1a8a30aa6 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] 10.222.0.11 "GET /compute/v2.1/servers/15abb40f-daf9-4c4b-ac9c-55f57ee7b938" status: 200 len: 1558 microversion: 2.1 time: 0.176677 Nov 17 03:56:52.133421 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 1359/2950] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:56:51 2021] GET /compute/v2.1/servers/15abb40f-daf9-4c4b-ac9c-55f57ee7b938 => generated 1558 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:56:52.137787 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-b9ded28c-52c1-4438-ad01-fa89978a9edd tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 17 03:56:52.138763 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-b9ded28c-52c1-4438-ad01-fa89978a9edd tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] [instance: c934945b-ff48-414a-8910-b206a86192b9] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:56:52.144694 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-b9ded28c-52c1-4438-ad01-fa89978a9edd tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:56:52.145240 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-b9ded28c-52c1-4438-ad01-fa89978a9edd tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:56:52.145987 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-b9ded28c-52c1-4438-ad01-fa89978a9edd tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:56:52.146429 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-b9ded28c-52c1-4438-ad01-fa89978a9edd tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:56:52.229390 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-b9ded28c-52c1-4438-ad01-fa89978a9edd tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] 10.222.0.11 "POST /compute/v2.1/servers/c934945b-ff48-414a-8910-b206a86192b9/action" status: 200 len: 14 microversion: 2.20 time: 0.094043 Nov 17 03:56:52.230217 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 1360/2951] 10.222.0.11 () {62 vars in 1318 bytes} [Wed Nov 17 03:56:52 2021] POST /compute/v2.1/servers/c934945b-ff48-414a-8910-b206a86192b9/action => generated 14 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:56:52.365878 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-8f605167-871d-4269-95bf-d9e52db4a0ed tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:56:52.366686 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-8f605167-871d-4269-95bf-d9e52db4a0ed tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] [instance: a49437df-3059-4528-8328-2f3471d5fb45] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:56:52.375018 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-8f605167-871d-4269-95bf-d9e52db4a0ed tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:56:52.375543 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-8f605167-871d-4269-95bf-d9e52db4a0ed tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:56:52.376436 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-8f605167-871d-4269-95bf-d9e52db4a0ed tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:56:52.376977 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-8f605167-871d-4269-95bf-d9e52db4a0ed tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:56:52.445706 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-8f605167-871d-4269-95bf-d9e52db4a0ed tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f046401c6a04f6495ebe0821120bd72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a58e89ceeea4a9c8a72a1de4bcaf2d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:56:52.454384 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-8f605167-871d-4269-95bf-d9e52db4a0ed tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] 10.222.0.11 "GET /compute/v2.1/servers/a49437df-3059-4528-8328-2f3471d5fb45" status: 200 len: 1352 microversion: 2.1 time: 0.094646 Nov 17 03:56:52.455191 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 1361/2952] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:56:52 2021] GET /compute/v2.1/servers/a49437df-3059-4528-8328-2f3471d5fb45 => generated 1352 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:56:53.154063 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-c91c568f-7151-46a0-b89c-d30ab38b9082 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:56:53.155071 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-c91c568f-7151-46a0-b89c-d30ab38b9082 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] [instance: 15abb40f-daf9-4c4b-ac9c-55f57ee7b938] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:56:53.166732 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-c91c568f-7151-46a0-b89c-d30ab38b9082 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:56:53.167474 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-c91c568f-7151-46a0-b89c-d30ab38b9082 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:56:53.168764 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-c91c568f-7151-46a0-b89c-d30ab38b9082 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:56:53.169533 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-c91c568f-7151-46a0-b89c-d30ab38b9082 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:56:53.309709 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-c91c568f-7151-46a0-b89c-d30ab38b9082 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a792b5b7e6f7461b8d802a5abaaa9518', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e843a3fb49f41dcb376184d7e156528', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:56:53.318339 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-c91c568f-7151-46a0-b89c-d30ab38b9082 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] 10.222.0.11 "GET /compute/v2.1/servers/15abb40f-daf9-4c4b-ac9c-55f57ee7b938" status: 200 len: 1558 microversion: 2.1 time: 0.170723 Nov 17 03:56:53.318912 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 1362/2953] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:56:53 2021] GET /compute/v2.1/servers/15abb40f-daf9-4c4b-ac9c-55f57ee7b938 => generated 1558 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:56:53.323259 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-c658d60f-f911-41c8-b64f-cf6acb50bbbe tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 17 03:56:53.324194 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-c658d60f-f911-41c8-b64f-cf6acb50bbbe tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] [instance: c934945b-ff48-414a-8910-b206a86192b9] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:56:53.329656 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-c658d60f-f911-41c8-b64f-cf6acb50bbbe tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:56:53.330112 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-c658d60f-f911-41c8-b64f-cf6acb50bbbe tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:56:53.330921 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-c658d60f-f911-41c8-b64f-cf6acb50bbbe tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:56:53.331357 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-c658d60f-f911-41c8-b64f-cf6acb50bbbe tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:56:53.423086 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-c658d60f-f911-41c8-b64f-cf6acb50bbbe tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] 10.222.0.11 "POST /compute/v2.1/servers/c934945b-ff48-414a-8910-b206a86192b9/action" status: 200 len: 7546 microversion: 2.20 time: 0.102538 Nov 17 03:56:53.424163 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 1363/2954] 10.222.0.11 () {62 vars in 1318 bytes} [Wed Nov 17 03:56:53 2021] POST /compute/v2.1/servers/c934945b-ff48-414a-8910-b206a86192b9/action => generated 7546 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 17 03:56:53.474897 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-657fd76a-d24b-4f25-83b8-90e68d8da865 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:56:53.475697 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-657fd76a-d24b-4f25-83b8-90e68d8da865 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] [instance: a49437df-3059-4528-8328-2f3471d5fb45] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:56:53.483676 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-657fd76a-d24b-4f25-83b8-90e68d8da865 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:56:53.484189 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-657fd76a-d24b-4f25-83b8-90e68d8da865 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:56:53.485135 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-657fd76a-d24b-4f25-83b8-90e68d8da865 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:56:53.485645 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-657fd76a-d24b-4f25-83b8-90e68d8da865 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:56:53.558588 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-657fd76a-d24b-4f25-83b8-90e68d8da865 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f046401c6a04f6495ebe0821120bd72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a58e89ceeea4a9c8a72a1de4bcaf2d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:56:53.570150 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-657fd76a-d24b-4f25-83b8-90e68d8da865 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] 10.222.0.11 "GET /compute/v2.1/servers/a49437df-3059-4528-8328-2f3471d5fb45" status: 200 len: 1352 microversion: 2.1 time: 0.101403 Nov 17 03:56:53.570732 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 1364/2955] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:56:53 2021] GET /compute/v2.1/servers/a49437df-3059-4528-8328-2f3471d5fb45 => generated 1352 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:56:54.338031 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-0f0bd4ba-4e9b-4c46-aad5-f1d26fba0aa5 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:56:54.338693 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-0f0bd4ba-4e9b-4c46-aad5-f1d26fba0aa5 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] [instance: 15abb40f-daf9-4c4b-ac9c-55f57ee7b938] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:56:54.348617 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-0f0bd4ba-4e9b-4c46-aad5-f1d26fba0aa5 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:56:54.349092 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-0f0bd4ba-4e9b-4c46-aad5-f1d26fba0aa5 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:56:54.349906 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-0f0bd4ba-4e9b-4c46-aad5-f1d26fba0aa5 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:56:54.350320 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-0f0bd4ba-4e9b-4c46-aad5-f1d26fba0aa5 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:56:54.490243 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-0f0bd4ba-4e9b-4c46-aad5-f1d26fba0aa5 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a792b5b7e6f7461b8d802a5abaaa9518', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e843a3fb49f41dcb376184d7e156528', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:56:54.502456 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-0f0bd4ba-4e9b-4c46-aad5-f1d26fba0aa5 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] 10.222.0.11 "GET /compute/v2.1/servers/15abb40f-daf9-4c4b-ac9c-55f57ee7b938" status: 200 len: 1558 microversion: 2.1 time: 0.170007 Nov 17 03:56:54.503259 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 1365/2956] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:56:54 2021] GET /compute/v2.1/servers/15abb40f-daf9-4c4b-ac9c-55f57ee7b938 => generated 1558 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:56:54.509183 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-f84ec69a-0848-41dc-b049-8dc1c1b95bdc tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 17 03:56:54.510178 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-f84ec69a-0848-41dc-b049-8dc1c1b95bdc tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] [instance: c934945b-ff48-414a-8910-b206a86192b9] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:56:54.518711 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-f84ec69a-0848-41dc-b049-8dc1c1b95bdc tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:56:54.519358 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-f84ec69a-0848-41dc-b049-8dc1c1b95bdc tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:56:54.520678 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-f84ec69a-0848-41dc-b049-8dc1c1b95bdc tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:56:54.521549 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-f84ec69a-0848-41dc-b049-8dc1c1b95bdc tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:56:54.628065 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-f84ec69a-0848-41dc-b049-8dc1c1b95bdc tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] 10.222.0.11 "POST /compute/v2.1/servers/c934945b-ff48-414a-8910-b206a86192b9/action" status: 200 len: 16678 microversion: 2.20 time: 0.122890 Nov 17 03:56:54.628987 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 1366/2957] 10.222.0.11 () {62 vars in 1318 bytes} [Wed Nov 17 03:56:54 2021] POST /compute/v2.1/servers/c934945b-ff48-414a-8910-b206a86192b9/action => generated 16678 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 17 03:56:54.637481 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-55e880e7-4029-4a32-9c45-5fbd3ed9770f tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:56:54.638623 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-55e880e7-4029-4a32-9c45-5fbd3ed9770f tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] [instance: a49437df-3059-4528-8328-2f3471d5fb45] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:56:54.648411 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-55e880e7-4029-4a32-9c45-5fbd3ed9770f tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:56:54.648899 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-55e880e7-4029-4a32-9c45-5fbd3ed9770f tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:56:54.649671 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-55e880e7-4029-4a32-9c45-5fbd3ed9770f tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:56:54.650102 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-55e880e7-4029-4a32-9c45-5fbd3ed9770f tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:56:54.725819 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-55e880e7-4029-4a32-9c45-5fbd3ed9770f tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f046401c6a04f6495ebe0821120bd72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a58e89ceeea4a9c8a72a1de4bcaf2d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:56:54.738474 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-55e880e7-4029-4a32-9c45-5fbd3ed9770f tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] 10.222.0.11 "GET /compute/v2.1/servers/a49437df-3059-4528-8328-2f3471d5fb45" status: 200 len: 1352 microversion: 2.1 time: 0.106994 Nov 17 03:56:54.739352 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 1367/2958] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:56:54 2021] GET /compute/v2.1/servers/a49437df-3059-4528-8328-2f3471d5fb45 => generated 1352 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:56:55.525779 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-7877c6a8-e2ab-4deb-821e-14e135da01c6 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:56:55.526854 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-7877c6a8-e2ab-4deb-821e-14e135da01c6 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] [instance: 15abb40f-daf9-4c4b-ac9c-55f57ee7b938] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:56:55.538407 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-7877c6a8-e2ab-4deb-821e-14e135da01c6 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:56:55.539198 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-7877c6a8-e2ab-4deb-821e-14e135da01c6 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:56:55.540471 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-7877c6a8-e2ab-4deb-821e-14e135da01c6 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:56:55.541236 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-7877c6a8-e2ab-4deb-821e-14e135da01c6 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:56:55.684618 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-7877c6a8-e2ab-4deb-821e-14e135da01c6 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a792b5b7e6f7461b8d802a5abaaa9518', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e843a3fb49f41dcb376184d7e156528', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:56:55.692562 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-7877c6a8-e2ab-4deb-821e-14e135da01c6 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] 10.222.0.11 "GET /compute/v2.1/servers/15abb40f-daf9-4c4b-ac9c-55f57ee7b938" status: 200 len: 1558 microversion: 2.1 time: 0.174010 Nov 17 03:56:55.693163 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 1368/2959] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:56:55 2021] GET /compute/v2.1/servers/15abb40f-daf9-4c4b-ac9c-55f57ee7b938 => generated 1558 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:56:55.697485 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-da1e8df2-afb7-4644-ab52-7ee9fe99112c tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 17 03:56:55.698397 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-da1e8df2-afb7-4644-ab52-7ee9fe99112c tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] [instance: c934945b-ff48-414a-8910-b206a86192b9] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:56:55.704337 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-da1e8df2-afb7-4644-ab52-7ee9fe99112c tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:56:55.704822 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-da1e8df2-afb7-4644-ab52-7ee9fe99112c tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:56:55.705598 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-da1e8df2-afb7-4644-ab52-7ee9fe99112c tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:56:55.706035 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-da1e8df2-afb7-4644-ab52-7ee9fe99112c tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:56:55.794068 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-da1e8df2-afb7-4644-ab52-7ee9fe99112c tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] 10.222.0.11 "POST /compute/v2.1/servers/c934945b-ff48-414a-8910-b206a86192b9/action" status: 200 len: 18663 microversion: 2.20 time: 0.099068 Nov 17 03:56:55.794949 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 1369/2960] 10.222.0.11 () {62 vars in 1318 bytes} [Wed Nov 17 03:56:55 2021] POST /compute/v2.1/servers/c934945b-ff48-414a-8910-b206a86192b9/action => generated 18663 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 17 03:56:55.803133 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-22958e01-9d17-4cc5-a10d-f88692c318f0 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:56:55.804283 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-22958e01-9d17-4cc5-a10d-f88692c318f0 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] [instance: a49437df-3059-4528-8328-2f3471d5fb45] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:56:55.815455 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-22958e01-9d17-4cc5-a10d-f88692c318f0 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:56:55.816222 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-22958e01-9d17-4cc5-a10d-f88692c318f0 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:56:55.817436 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-22958e01-9d17-4cc5-a10d-f88692c318f0 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:56:55.817898 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-22958e01-9d17-4cc5-a10d-f88692c318f0 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:56:55.879623 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-22958e01-9d17-4cc5-a10d-f88692c318f0 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f046401c6a04f6495ebe0821120bd72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a58e89ceeea4a9c8a72a1de4bcaf2d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:56:55.888075 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-22958e01-9d17-4cc5-a10d-f88692c318f0 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] 10.222.0.11 "GET /compute/v2.1/servers/a49437df-3059-4528-8328-2f3471d5fb45" status: 200 len: 1352 microversion: 2.1 time: 0.091662 Nov 17 03:56:55.888636 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 1370/2961] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:56:55 2021] GET /compute/v2.1/servers/a49437df-3059-4528-8328-2f3471d5fb45 => generated 1352 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:56:56.714029 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-947d93a6-87e3-4751-b95d-6e2aa72fb1b3 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:56:56.715114 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-947d93a6-87e3-4751-b95d-6e2aa72fb1b3 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] [instance: 15abb40f-daf9-4c4b-ac9c-55f57ee7b938] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:56:56.725029 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-947d93a6-87e3-4751-b95d-6e2aa72fb1b3 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:56:56.725475 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-947d93a6-87e3-4751-b95d-6e2aa72fb1b3 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:56:56.726245 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-947d93a6-87e3-4751-b95d-6e2aa72fb1b3 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:56:56.726674 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-947d93a6-87e3-4751-b95d-6e2aa72fb1b3 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:56:56.863985 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-947d93a6-87e3-4751-b95d-6e2aa72fb1b3 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a792b5b7e6f7461b8d802a5abaaa9518', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e843a3fb49f41dcb376184d7e156528', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:56:56.872193 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-947d93a6-87e3-4751-b95d-6e2aa72fb1b3 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] 10.222.0.11 "GET /compute/v2.1/servers/15abb40f-daf9-4c4b-ac9c-55f57ee7b938" status: 200 len: 1558 microversion: 2.1 time: 0.164859 Nov 17 03:56:56.872761 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 1371/2962] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:56:56 2021] GET /compute/v2.1/servers/15abb40f-daf9-4c4b-ac9c-55f57ee7b938 => generated 1558 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:56:56.877073 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-c7ab0f79-d6fb-4de8-a6b0-1dbede432ef5 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 17 03:56:56.877972 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-c7ab0f79-d6fb-4de8-a6b0-1dbede432ef5 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] [instance: c934945b-ff48-414a-8910-b206a86192b9] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:56:56.884100 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-c7ab0f79-d6fb-4de8-a6b0-1dbede432ef5 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:56:56.884552 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-c7ab0f79-d6fb-4de8-a6b0-1dbede432ef5 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:56:56.885381 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-c7ab0f79-d6fb-4de8-a6b0-1dbede432ef5 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:56:56.885790 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-c7ab0f79-d6fb-4de8-a6b0-1dbede432ef5 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:56:56.979443 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-c7ab0f79-d6fb-4de8-a6b0-1dbede432ef5 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] 10.222.0.11 "POST /compute/v2.1/servers/c934945b-ff48-414a-8910-b206a86192b9/action" status: 200 len: 21840 microversion: 2.20 time: 0.104915 Nov 17 03:56:56.980325 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 1372/2963] 10.222.0.11 () {62 vars in 1318 bytes} [Wed Nov 17 03:56:56 2021] POST /compute/v2.1/servers/c934945b-ff48-414a-8910-b206a86192b9/action => generated 21840 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 17 03:56:56.987970 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-694c5766-07a3-42c7-b651-d700ebedae83 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:56:56.989262 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-694c5766-07a3-42c7-b651-d700ebedae83 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] [instance: a49437df-3059-4528-8328-2f3471d5fb45] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:56:56.996265 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-694c5766-07a3-42c7-b651-d700ebedae83 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:56:56.996711 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-694c5766-07a3-42c7-b651-d700ebedae83 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:56:56.997507 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-694c5766-07a3-42c7-b651-d700ebedae83 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:56:56.997936 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-694c5766-07a3-42c7-b651-d700ebedae83 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:56:57.061425 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-694c5766-07a3-42c7-b651-d700ebedae83 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f046401c6a04f6495ebe0821120bd72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a58e89ceeea4a9c8a72a1de4bcaf2d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:56:57.074719 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-694c5766-07a3-42c7-b651-d700ebedae83 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] 10.222.0.11 "GET /compute/v2.1/servers/a49437df-3059-4528-8328-2f3471d5fb45" status: 200 len: 1352 microversion: 2.1 time: 0.092552 Nov 17 03:56:57.075512 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 1373/2964] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:56:56 2021] GET /compute/v2.1/servers/a49437df-3059-4528-8328-2f3471d5fb45 => generated 1352 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:56:57.889645 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-8256f2bd-911c-4a54-a75e-4cd31b740935 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:56:57.890332 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-8256f2bd-911c-4a54-a75e-4cd31b740935 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] [instance: 15abb40f-daf9-4c4b-ac9c-55f57ee7b938] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:56:57.897105 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-8256f2bd-911c-4a54-a75e-4cd31b740935 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:56:57.897563 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-8256f2bd-911c-4a54-a75e-4cd31b740935 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:56:57.898331 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-8256f2bd-911c-4a54-a75e-4cd31b740935 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:56:57.898756 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-8256f2bd-911c-4a54-a75e-4cd31b740935 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:56:58.036994 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-8256f2bd-911c-4a54-a75e-4cd31b740935 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a792b5b7e6f7461b8d802a5abaaa9518', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e843a3fb49f41dcb376184d7e156528', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:56:58.045449 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-8256f2bd-911c-4a54-a75e-4cd31b740935 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] 10.222.0.11 "GET /compute/v2.1/servers/15abb40f-daf9-4c4b-ac9c-55f57ee7b938" status: 200 len: 1558 microversion: 2.1 time: 0.159671 Nov 17 03:56:58.045991 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 1374/2965] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:56:57 2021] GET /compute/v2.1/servers/15abb40f-daf9-4c4b-ac9c-55f57ee7b938 => generated 1558 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:56:58.050522 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-9cdf3661-05b0-42e2-af1f-700fbbe604cb tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 17 03:56:58.051799 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-9cdf3661-05b0-42e2-af1f-700fbbe604cb tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] [instance: c934945b-ff48-414a-8910-b206a86192b9] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:56:58.057860 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-9cdf3661-05b0-42e2-af1f-700fbbe604cb tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:56:58.058310 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-9cdf3661-05b0-42e2-af1f-700fbbe604cb tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:56:58.059097 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-9cdf3661-05b0-42e2-af1f-700fbbe604cb tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:56:58.059522 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-9cdf3661-05b0-42e2-af1f-700fbbe604cb tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:56:58.150641 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-9cdf3661-05b0-42e2-af1f-700fbbe604cb tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] 10.222.0.11 "POST /compute/v2.1/servers/c934945b-ff48-414a-8910-b206a86192b9/action" status: 200 len: 23235 microversion: 2.20 time: 0.102767 Nov 17 03:56:58.151550 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 1375/2966] 10.222.0.11 () {62 vars in 1318 bytes} [Wed Nov 17 03:56:58 2021] POST /compute/v2.1/servers/c934945b-ff48-414a-8910-b206a86192b9/action => generated 23235 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 17 03:56:58.159616 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-e9ad24ac-3c2a-425f-a307-566772164258 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:56:58.160963 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-e9ad24ac-3c2a-425f-a307-566772164258 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] [instance: a49437df-3059-4528-8328-2f3471d5fb45] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:56:58.168190 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-e9ad24ac-3c2a-425f-a307-566772164258 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:56:58.168743 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-e9ad24ac-3c2a-425f-a307-566772164258 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:56:58.169850 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-e9ad24ac-3c2a-425f-a307-566772164258 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:56:58.170454 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-e9ad24ac-3c2a-425f-a307-566772164258 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:56:58.243522 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-e9ad24ac-3c2a-425f-a307-566772164258 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f046401c6a04f6495ebe0821120bd72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a58e89ceeea4a9c8a72a1de4bcaf2d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:56:58.251826 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-e9ad24ac-3c2a-425f-a307-566772164258 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] 10.222.0.11 "GET /compute/v2.1/servers/a49437df-3059-4528-8328-2f3471d5fb45" status: 200 len: 1352 microversion: 2.1 time: 0.098687 Nov 17 03:56:58.252353 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 1376/2967] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:56:58 2021] GET /compute/v2.1/servers/a49437df-3059-4528-8328-2f3471d5fb45 => generated 1352 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:56:59.064089 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-99816065-71b3-4434-959e-86fd04cb0689 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:56:59.064760 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-99816065-71b3-4434-959e-86fd04cb0689 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] [instance: 15abb40f-daf9-4c4b-ac9c-55f57ee7b938] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:56:59.072183 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-99816065-71b3-4434-959e-86fd04cb0689 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:56:59.072629 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-99816065-71b3-4434-959e-86fd04cb0689 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:56:59.073458 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-99816065-71b3-4434-959e-86fd04cb0689 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:56:59.073889 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-99816065-71b3-4434-959e-86fd04cb0689 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:56:59.215900 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-99816065-71b3-4434-959e-86fd04cb0689 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a792b5b7e6f7461b8d802a5abaaa9518', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e843a3fb49f41dcb376184d7e156528', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:56:59.229070 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-99816065-71b3-4434-959e-86fd04cb0689 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] 10.222.0.11 "GET /compute/v2.1/servers/15abb40f-daf9-4c4b-ac9c-55f57ee7b938" status: 200 len: 1558 microversion: 2.1 time: 0.168966 Nov 17 03:56:59.229951 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 1377/2968] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:56:59 2021] GET /compute/v2.1/servers/15abb40f-daf9-4c4b-ac9c-55f57ee7b938 => generated 1558 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:56:59.237842 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-9734b01b-cb70-4b9f-b7ae-f2fd62130eca tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 17 03:56:59.239371 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-9734b01b-cb70-4b9f-b7ae-f2fd62130eca tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] [instance: c934945b-ff48-414a-8910-b206a86192b9] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:56:59.245310 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-9734b01b-cb70-4b9f-b7ae-f2fd62130eca tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:56:59.245763 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-9734b01b-cb70-4b9f-b7ae-f2fd62130eca tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:56:59.246536 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-9734b01b-cb70-4b9f-b7ae-f2fd62130eca tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:56:59.246965 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-9734b01b-cb70-4b9f-b7ae-f2fd62130eca tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:56:59.338494 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-9734b01b-cb70-4b9f-b7ae-f2fd62130eca tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] 10.222.0.11 "POST /compute/v2.1/servers/c934945b-ff48-414a-8910-b206a86192b9/action" status: 200 len: 24930 microversion: 2.20 time: 0.105561 Nov 17 03:56:59.339333 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 1378/2969] 10.222.0.11 () {62 vars in 1318 bytes} [Wed Nov 17 03:56:59 2021] POST /compute/v2.1/servers/c934945b-ff48-414a-8910-b206a86192b9/action => generated 24930 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 17 03:56:59.347005 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-dc82e4d0-d28a-4316-a33c-6439313269f6 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:56:59.348165 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-dc82e4d0-d28a-4316-a33c-6439313269f6 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] [instance: a49437df-3059-4528-8328-2f3471d5fb45] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:56:59.359734 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-dc82e4d0-d28a-4316-a33c-6439313269f6 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:56:59.360480 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-dc82e4d0-d28a-4316-a33c-6439313269f6 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:56:59.361810 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-dc82e4d0-d28a-4316-a33c-6439313269f6 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:56:59.362532 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-dc82e4d0-d28a-4316-a33c-6439313269f6 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:56:59.436400 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-dc82e4d0-d28a-4316-a33c-6439313269f6 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f046401c6a04f6495ebe0821120bd72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a58e89ceeea4a9c8a72a1de4bcaf2d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:56:59.444658 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-dc82e4d0-d28a-4316-a33c-6439313269f6 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] 10.222.0.11 "GET /compute/v2.1/servers/a49437df-3059-4528-8328-2f3471d5fb45" status: 200 len: 1352 microversion: 2.1 time: 0.103878 Nov 17 03:56:59.445261 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 1379/2970] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:56:59 2021] GET /compute/v2.1/servers/a49437df-3059-4528-8328-2f3471d5fb45 => generated 1352 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:57:00.254015 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-23ba2104-dea8-48fd-a3b6-5ebd03d0fe33 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:57:00.255227 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-23ba2104-dea8-48fd-a3b6-5ebd03d0fe33 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] [instance: 15abb40f-daf9-4c4b-ac9c-55f57ee7b938] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:57:00.261966 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-23ba2104-dea8-48fd-a3b6-5ebd03d0fe33 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:57:00.262411 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-23ba2104-dea8-48fd-a3b6-5ebd03d0fe33 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:57:00.263182 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-23ba2104-dea8-48fd-a3b6-5ebd03d0fe33 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:57:00.263615 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-23ba2104-dea8-48fd-a3b6-5ebd03d0fe33 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:57:00.404412 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-23ba2104-dea8-48fd-a3b6-5ebd03d0fe33 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a792b5b7e6f7461b8d802a5abaaa9518', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e843a3fb49f41dcb376184d7e156528', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:57:00.413640 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-23ba2104-dea8-48fd-a3b6-5ebd03d0fe33 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] 10.222.0.11 "GET /compute/v2.1/servers/15abb40f-daf9-4c4b-ac9c-55f57ee7b938" status: 200 len: 1558 microversion: 2.1 time: 0.165773 Nov 17 03:57:00.414203 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 1380/2971] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:57:00 2021] GET /compute/v2.1/servers/15abb40f-daf9-4c4b-ac9c-55f57ee7b938 => generated 1558 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:57:00.419573 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-27a569d0-64cb-4869-abdf-f1a7c964ebb4 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 17 03:57:00.420474 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-27a569d0-64cb-4869-abdf-f1a7c964ebb4 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] [instance: c934945b-ff48-414a-8910-b206a86192b9] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:57:00.427383 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-27a569d0-64cb-4869-abdf-f1a7c964ebb4 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:57:00.427888 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-27a569d0-64cb-4869-abdf-f1a7c964ebb4 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:57:00.428950 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-27a569d0-64cb-4869-abdf-f1a7c964ebb4 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:57:00.429388 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-27a569d0-64cb-4869-abdf-f1a7c964ebb4 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:57:00.524007 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-27a569d0-64cb-4869-abdf-f1a7c964ebb4 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] 10.222.0.11 "POST /compute/v2.1/servers/c934945b-ff48-414a-8910-b206a86192b9/action" status: 200 len: 26724 microversion: 2.20 time: 0.108189 Nov 17 03:57:00.525716 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 1381/2972] 10.222.0.11 () {62 vars in 1318 bytes} [Wed Nov 17 03:57:00 2021] POST /compute/v2.1/servers/c934945b-ff48-414a-8910-b206a86192b9/action => generated 26724 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 17 03:57:00.533041 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-f70d7209-5e39-4a62-813e-1b2c8cd7df36 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:57:00.534113 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-f70d7209-5e39-4a62-813e-1b2c8cd7df36 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] [instance: a49437df-3059-4528-8328-2f3471d5fb45] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:57:00.541946 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-f70d7209-5e39-4a62-813e-1b2c8cd7df36 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:57:00.542378 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-f70d7209-5e39-4a62-813e-1b2c8cd7df36 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:57:00.543168 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-f70d7209-5e39-4a62-813e-1b2c8cd7df36 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:57:00.543604 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-f70d7209-5e39-4a62-813e-1b2c8cd7df36 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:57:00.627133 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-f70d7209-5e39-4a62-813e-1b2c8cd7df36 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f046401c6a04f6495ebe0821120bd72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a58e89ceeea4a9c8a72a1de4bcaf2d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:57:00.639780 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-f70d7209-5e39-4a62-813e-1b2c8cd7df36 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] 10.222.0.11 "GET /compute/v2.1/servers/a49437df-3059-4528-8328-2f3471d5fb45" status: 200 len: 1352 microversion: 2.1 time: 0.112322 Nov 17 03:57:00.640547 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 1382/2973] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:57:00 2021] GET /compute/v2.1/servers/a49437df-3059-4528-8328-2f3471d5fb45 => generated 1352 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:57:01.435589 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-f6bce94c-76f0-4f08-83e3-15b32d49ce82 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:57:01.436644 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-f6bce94c-76f0-4f08-83e3-15b32d49ce82 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] [instance: 15abb40f-daf9-4c4b-ac9c-55f57ee7b938] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:57:01.447054 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-f6bce94c-76f0-4f08-83e3-15b32d49ce82 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:57:01.447810 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-f6bce94c-76f0-4f08-83e3-15b32d49ce82 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:57:01.449147 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-f6bce94c-76f0-4f08-83e3-15b32d49ce82 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:57:01.449882 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-f6bce94c-76f0-4f08-83e3-15b32d49ce82 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:57:01.590977 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-f6bce94c-76f0-4f08-83e3-15b32d49ce82 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a792b5b7e6f7461b8d802a5abaaa9518', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e843a3fb49f41dcb376184d7e156528', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:57:01.604563 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-f6bce94c-76f0-4f08-83e3-15b32d49ce82 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] 10.222.0.11 "GET /compute/v2.1/servers/15abb40f-daf9-4c4b-ac9c-55f57ee7b938" status: 200 len: 1558 microversion: 2.1 time: 0.175149 Nov 17 03:57:01.605487 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 1383/2974] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:57:01 2021] GET /compute/v2.1/servers/15abb40f-daf9-4c4b-ac9c-55f57ee7b938 => generated 1558 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:57:01.609951 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-c604b3e6-4318-48b5-9fa3-74d3e200808a tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 17 03:57:01.610855 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-c604b3e6-4318-48b5-9fa3-74d3e200808a tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] [instance: c934945b-ff48-414a-8910-b206a86192b9] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:57:01.617085 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-c604b3e6-4318-48b5-9fa3-74d3e200808a tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:57:01.617541 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-c604b3e6-4318-48b5-9fa3-74d3e200808a tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:57:01.618316 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-c604b3e6-4318-48b5-9fa3-74d3e200808a tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:57:01.618754 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-c604b3e6-4318-48b5-9fa3-74d3e200808a tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:57:01.712574 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-c604b3e6-4318-48b5-9fa3-74d3e200808a tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] 10.222.0.11 "POST /compute/v2.1/servers/c934945b-ff48-414a-8910-b206a86192b9/action" status: 200 len: 27724 microversion: 2.20 time: 0.105318 Nov 17 03:57:01.713454 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 1384/2975] 10.222.0.11 () {62 vars in 1318 bytes} [Wed Nov 17 03:57:01 2021] POST /compute/v2.1/servers/c934945b-ff48-414a-8910-b206a86192b9/action => generated 27724 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 17 03:57:01.721115 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-38c24a07-25de-464c-9edf-cadd8d384925 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:57:01.722237 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-38c24a07-25de-464c-9edf-cadd8d384925 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] [instance: a49437df-3059-4528-8328-2f3471d5fb45] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:57:01.729820 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-38c24a07-25de-464c-9edf-cadd8d384925 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:57:01.730264 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-38c24a07-25de-464c-9edf-cadd8d384925 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:57:01.731033 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-38c24a07-25de-464c-9edf-cadd8d384925 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:57:01.731465 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-38c24a07-25de-464c-9edf-cadd8d384925 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:57:01.792258 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-38c24a07-25de-464c-9edf-cadd8d384925 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f046401c6a04f6495ebe0821120bd72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a58e89ceeea4a9c8a72a1de4bcaf2d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:57:01.800308 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-38c24a07-25de-464c-9edf-cadd8d384925 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] 10.222.0.11 "GET /compute/v2.1/servers/a49437df-3059-4528-8328-2f3471d5fb45" status: 200 len: 1352 microversion: 2.1 time: 0.085398 Nov 17 03:57:01.801349 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 1385/2976] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:57:01 2021] GET /compute/v2.1/servers/a49437df-3059-4528-8328-2f3471d5fb45 => generated 1352 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:57:02.626758 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-6adcbe10-2308-4257-953e-60f16b9e5095 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:57:02.627851 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-6adcbe10-2308-4257-953e-60f16b9e5095 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] [instance: 15abb40f-daf9-4c4b-ac9c-55f57ee7b938] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:57:02.635717 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-6adcbe10-2308-4257-953e-60f16b9e5095 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:57:02.636161 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-6adcbe10-2308-4257-953e-60f16b9e5095 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:57:02.636964 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-6adcbe10-2308-4257-953e-60f16b9e5095 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:57:02.637396 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-6adcbe10-2308-4257-953e-60f16b9e5095 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:57:02.775487 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-6adcbe10-2308-4257-953e-60f16b9e5095 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a792b5b7e6f7461b8d802a5abaaa9518', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e843a3fb49f41dcb376184d7e156528', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:57:02.783985 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-6adcbe10-2308-4257-953e-60f16b9e5095 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] 10.222.0.11 "GET /compute/v2.1/servers/15abb40f-daf9-4c4b-ac9c-55f57ee7b938" status: 200 len: 1558 microversion: 2.1 time: 0.163681 Nov 17 03:57:02.784556 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 1386/2977] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:57:02 2021] GET /compute/v2.1/servers/15abb40f-daf9-4c4b-ac9c-55f57ee7b938 => generated 1558 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:57:02.789171 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-cc725cfc-c70e-483b-865d-e49c0807a0b2 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 17 03:57:02.790035 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-cc725cfc-c70e-483b-865d-e49c0807a0b2 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] [instance: c934945b-ff48-414a-8910-b206a86192b9] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:57:02.797200 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-cc725cfc-c70e-483b-865d-e49c0807a0b2 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:57:02.797842 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-cc725cfc-c70e-483b-865d-e49c0807a0b2 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:57:02.798913 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-cc725cfc-c70e-483b-865d-e49c0807a0b2 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:57:02.799572 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-cc725cfc-c70e-483b-865d-e49c0807a0b2 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:57:02.894465 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-cc725cfc-c70e-483b-865d-e49c0807a0b2 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] 10.222.0.11 "POST /compute/v2.1/servers/c934945b-ff48-414a-8910-b206a86192b9/action" status: 200 len: 28206 microversion: 2.20 time: 0.108075 Nov 17 03:57:02.895370 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 1387/2978] 10.222.0.11 () {62 vars in 1318 bytes} [Wed Nov 17 03:57:02 2021] POST /compute/v2.1/servers/c934945b-ff48-414a-8910-b206a86192b9/action => generated 28206 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 17 03:57:02.901051 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-dc1ef264-feae-425e-bfc4-7254b8cc5fc1 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:57:02.901748 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-dc1ef264-feae-425e-bfc4-7254b8cc5fc1 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] [instance: a49437df-3059-4528-8328-2f3471d5fb45] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:57:02.908814 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-dc1ef264-feae-425e-bfc4-7254b8cc5fc1 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:57:02.909282 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-dc1ef264-feae-425e-bfc4-7254b8cc5fc1 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:57:02.910055 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-dc1ef264-feae-425e-bfc4-7254b8cc5fc1 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:57:02.910497 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-dc1ef264-feae-425e-bfc4-7254b8cc5fc1 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:57:02.972620 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-dc1ef264-feae-425e-bfc4-7254b8cc5fc1 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f046401c6a04f6495ebe0821120bd72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a58e89ceeea4a9c8a72a1de4bcaf2d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:57:02.980882 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-dc1ef264-feae-425e-bfc4-7254b8cc5fc1 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] 10.222.0.11 "GET /compute/v2.1/servers/a49437df-3059-4528-8328-2f3471d5fb45" status: 200 len: 1352 microversion: 2.1 time: 0.084049 Nov 17 03:57:02.981449 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 1388/2979] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:57:02 2021] GET /compute/v2.1/servers/a49437df-3059-4528-8328-2f3471d5fb45 => generated 1352 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:57:03.806126 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-de4c790f-0c3d-4b57-a872-2711b8a729e7 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:57:03.807282 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-de4c790f-0c3d-4b57-a872-2711b8a729e7 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] [instance: 15abb40f-daf9-4c4b-ac9c-55f57ee7b938] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:57:03.818025 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-de4c790f-0c3d-4b57-a872-2711b8a729e7 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:57:03.818774 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-de4c790f-0c3d-4b57-a872-2711b8a729e7 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:57:03.820348 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-de4c790f-0c3d-4b57-a872-2711b8a729e7 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:57:03.821117 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-de4c790f-0c3d-4b57-a872-2711b8a729e7 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:57:03.978666 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-de4c790f-0c3d-4b57-a872-2711b8a729e7 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a792b5b7e6f7461b8d802a5abaaa9518', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e843a3fb49f41dcb376184d7e156528', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:57:03.986850 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-de4c790f-0c3d-4b57-a872-2711b8a729e7 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] 10.222.0.11 "GET /compute/v2.1/servers/15abb40f-daf9-4c4b-ac9c-55f57ee7b938" status: 200 len: 1558 microversion: 2.1 time: 0.187786 Nov 17 03:57:03.987421 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 1389/2980] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:57:03 2021] GET /compute/v2.1/servers/15abb40f-daf9-4c4b-ac9c-55f57ee7b938 => generated 1558 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:57:03.991729 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-1a4df498-ab0c-46c7-a7d0-5f1a2d95a75d tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 17 03:57:03.992641 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-1a4df498-ab0c-46c7-a7d0-5f1a2d95a75d tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] [instance: c934945b-ff48-414a-8910-b206a86192b9] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:57:03.998646 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-1a4df498-ab0c-46c7-a7d0-5f1a2d95a75d tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:57:03.999103 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-1a4df498-ab0c-46c7-a7d0-5f1a2d95a75d tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:57:03.999914 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-1a4df498-ab0c-46c7-a7d0-5f1a2d95a75d tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:57:04.000347 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-1a4df498-ab0c-46c7-a7d0-5f1a2d95a75d tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:57:04.085659 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-1a4df498-ab0c-46c7-a7d0-5f1a2d95a75d tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] 10.222.0.11 "POST /compute/v2.1/servers/c934945b-ff48-414a-8910-b206a86192b9/action" status: 200 len: 28206 microversion: 2.20 time: 0.096914 Nov 17 03:57:04.086238 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 1390/2981] 10.222.0.11 () {62 vars in 1318 bytes} [Wed Nov 17 03:57:03 2021] POST /compute/v2.1/servers/c934945b-ff48-414a-8910-b206a86192b9/action => generated 28206 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 17 03:57:04.091139 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-a3ac7d54-e40b-4524-b18b-d6df3e3b3396 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:57:04.091832 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-a3ac7d54-e40b-4524-b18b-d6df3e3b3396 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] [instance: a49437df-3059-4528-8328-2f3471d5fb45] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:57:04.099006 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-a3ac7d54-e40b-4524-b18b-d6df3e3b3396 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:57:04.099453 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-a3ac7d54-e40b-4524-b18b-d6df3e3b3396 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:57:04.100495 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-a3ac7d54-e40b-4524-b18b-d6df3e3b3396 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:57:04.100732 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-a3ac7d54-e40b-4524-b18b-d6df3e3b3396 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:57:04.165708 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-a3ac7d54-e40b-4524-b18b-d6df3e3b3396 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f046401c6a04f6495ebe0821120bd72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a58e89ceeea4a9c8a72a1de4bcaf2d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:57:04.178432 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-a3ac7d54-e40b-4524-b18b-d6df3e3b3396 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] 10.222.0.11 "GET /compute/v2.1/servers/a49437df-3059-4528-8328-2f3471d5fb45" status: 200 len: 1352 microversion: 2.1 time: 0.090773 Nov 17 03:57:04.179203 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 1391/2982] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:57:04 2021] GET /compute/v2.1/servers/a49437df-3059-4528-8328-2f3471d5fb45 => generated 1352 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:57:05.008849 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-0e476c48-391c-4f2b-a02d-5632bfed88f8 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:57:05.009880 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-0e476c48-391c-4f2b-a02d-5632bfed88f8 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] [instance: 15abb40f-daf9-4c4b-ac9c-55f57ee7b938] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:57:05.020746 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-0e476c48-391c-4f2b-a02d-5632bfed88f8 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:57:05.021561 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-0e476c48-391c-4f2b-a02d-5632bfed88f8 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:57:05.022984 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-0e476c48-391c-4f2b-a02d-5632bfed88f8 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:57:05.023665 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-0e476c48-391c-4f2b-a02d-5632bfed88f8 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:57:05.161773 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-0e476c48-391c-4f2b-a02d-5632bfed88f8 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a792b5b7e6f7461b8d802a5abaaa9518', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e843a3fb49f41dcb376184d7e156528', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:57:05.170788 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-0e476c48-391c-4f2b-a02d-5632bfed88f8 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] 10.222.0.11 "GET /compute/v2.1/servers/15abb40f-daf9-4c4b-ac9c-55f57ee7b938" status: 200 len: 1558 microversion: 2.1 time: 0.169008 Nov 17 03:57:05.171356 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 1392/2983] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:57:05 2021] GET /compute/v2.1/servers/15abb40f-daf9-4c4b-ac9c-55f57ee7b938 => generated 1558 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:57:05.176019 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-d3adc80b-4953-45ff-8f13-bb32bdf01ef0 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 17 03:57:05.176958 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-d3adc80b-4953-45ff-8f13-bb32bdf01ef0 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] [instance: c934945b-ff48-414a-8910-b206a86192b9] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:57:05.183155 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-d3adc80b-4953-45ff-8f13-bb32bdf01ef0 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:57:05.183605 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-d3adc80b-4953-45ff-8f13-bb32bdf01ef0 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:57:05.184374 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-d3adc80b-4953-45ff-8f13-bb32bdf01ef0 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:57:05.184810 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-d3adc80b-4953-45ff-8f13-bb32bdf01ef0 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:57:05.278013 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-d3adc80b-4953-45ff-8f13-bb32bdf01ef0 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] 10.222.0.11 "POST /compute/v2.1/servers/c934945b-ff48-414a-8910-b206a86192b9/action" status: 200 len: 28496 microversion: 2.20 time: 0.104934 Nov 17 03:57:05.278827 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 1393/2984] 10.222.0.11 () {62 vars in 1318 bytes} [Wed Nov 17 03:57:05 2021] POST /compute/v2.1/servers/c934945b-ff48-414a-8910-b206a86192b9/action => generated 28496 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 17 03:57:05.285931 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-cfca111f-a1b9-41dd-91e6-db3db8f14e35 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:57:05.287060 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-cfca111f-a1b9-41dd-91e6-db3db8f14e35 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] [instance: a49437df-3059-4528-8328-2f3471d5fb45] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:57:05.297987 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-cfca111f-a1b9-41dd-91e6-db3db8f14e35 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:57:05.298670 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-cfca111f-a1b9-41dd-91e6-db3db8f14e35 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:57:05.299836 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-cfca111f-a1b9-41dd-91e6-db3db8f14e35 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:57:05.300499 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-cfca111f-a1b9-41dd-91e6-db3db8f14e35 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:57:05.376028 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-cfca111f-a1b9-41dd-91e6-db3db8f14e35 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f046401c6a04f6495ebe0821120bd72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a58e89ceeea4a9c8a72a1de4bcaf2d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:57:05.386645 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-cfca111f-a1b9-41dd-91e6-db3db8f14e35 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] 10.222.0.11 "GET /compute/v2.1/servers/a49437df-3059-4528-8328-2f3471d5fb45" status: 200 len: 1352 microversion: 2.1 time: 0.106453 Nov 17 03:57:05.387214 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 1394/2985] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:57:05 2021] GET /compute/v2.1/servers/a49437df-3059-4528-8328-2f3471d5fb45 => generated 1352 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:57:06.193163 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-505b8596-3ec9-4be5-8ed9-5b6c3bf86ddb tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:57:06.194226 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-505b8596-3ec9-4be5-8ed9-5b6c3bf86ddb tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] [instance: 15abb40f-daf9-4c4b-ac9c-55f57ee7b938] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:57:06.201029 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-505b8596-3ec9-4be5-8ed9-5b6c3bf86ddb tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:57:06.201483 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-505b8596-3ec9-4be5-8ed9-5b6c3bf86ddb tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:57:06.202239 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-505b8596-3ec9-4be5-8ed9-5b6c3bf86ddb tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:57:06.202668 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-505b8596-3ec9-4be5-8ed9-5b6c3bf86ddb tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:57:06.336170 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-505b8596-3ec9-4be5-8ed9-5b6c3bf86ddb tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a792b5b7e6f7461b8d802a5abaaa9518', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e843a3fb49f41dcb376184d7e156528', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:57:06.344647 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-505b8596-3ec9-4be5-8ed9-5b6c3bf86ddb tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] 10.222.0.11 "GET /compute/v2.1/servers/15abb40f-daf9-4c4b-ac9c-55f57ee7b938" status: 200 len: 1558 microversion: 2.1 time: 0.158254 Nov 17 03:57:06.345221 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 1395/2986] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:57:06 2021] GET /compute/v2.1/servers/15abb40f-daf9-4c4b-ac9c-55f57ee7b938 => generated 1558 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:57:06.349783 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-f16567bd-c953-4d10-b596-b2ced969350c tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 17 03:57:06.350720 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-f16567bd-c953-4d10-b596-b2ced969350c tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] [instance: c934945b-ff48-414a-8910-b206a86192b9] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:57:06.356492 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-f16567bd-c953-4d10-b596-b2ced969350c tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:57:06.356969 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-f16567bd-c953-4d10-b596-b2ced969350c tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:57:06.357731 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-f16567bd-c953-4d10-b596-b2ced969350c tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:57:06.358153 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-f16567bd-c953-4d10-b596-b2ced969350c tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:57:06.451207 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-f16567bd-c953-4d10-b596-b2ced969350c tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] 10.222.0.11 "POST /compute/v2.1/servers/c934945b-ff48-414a-8910-b206a86192b9/action" status: 200 len: 28664 microversion: 2.20 time: 0.104201 Nov 17 03:57:06.452237 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 1396/2987] 10.222.0.11 () {62 vars in 1318 bytes} [Wed Nov 17 03:57:06 2021] POST /compute/v2.1/servers/c934945b-ff48-414a-8910-b206a86192b9/action => generated 28664 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 17 03:57:06.460580 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-844dd7e3-f22d-4ac0-b9aa-641fe07e7eb1 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:57:06.461814 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-844dd7e3-f22d-4ac0-b9aa-641fe07e7eb1 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] [instance: a49437df-3059-4528-8328-2f3471d5fb45] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:57:06.473167 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-844dd7e3-f22d-4ac0-b9aa-641fe07e7eb1 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:57:06.473908 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-844dd7e3-f22d-4ac0-b9aa-641fe07e7eb1 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:57:06.475180 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-844dd7e3-f22d-4ac0-b9aa-641fe07e7eb1 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:57:06.475900 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-844dd7e3-f22d-4ac0-b9aa-641fe07e7eb1 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:57:06.540525 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-844dd7e3-f22d-4ac0-b9aa-641fe07e7eb1 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f046401c6a04f6495ebe0821120bd72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a58e89ceeea4a9c8a72a1de4bcaf2d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:57:06.549182 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-844dd7e3-f22d-4ac0-b9aa-641fe07e7eb1 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] 10.222.0.11 "GET /compute/v2.1/servers/a49437df-3059-4528-8328-2f3471d5fb45" status: 200 len: 1352 microversion: 2.1 time: 0.094967 Nov 17 03:57:06.549755 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 1397/2988] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:57:06 2021] GET /compute/v2.1/servers/a49437df-3059-4528-8328-2f3471d5fb45 => generated 1352 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:57:07.363167 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-43769baf-60e4-4f1b-9e45-a3a652bae8d7 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:57:07.363876 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-43769baf-60e4-4f1b-9e45-a3a652bae8d7 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] [instance: 15abb40f-daf9-4c4b-ac9c-55f57ee7b938] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:57:07.370852 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-43769baf-60e4-4f1b-9e45-a3a652bae8d7 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:57:07.371324 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-43769baf-60e4-4f1b-9e45-a3a652bae8d7 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:57:07.372063 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-43769baf-60e4-4f1b-9e45-a3a652bae8d7 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:57:07.372487 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-43769baf-60e4-4f1b-9e45-a3a652bae8d7 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:57:07.516392 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-43769baf-60e4-4f1b-9e45-a3a652bae8d7 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a792b5b7e6f7461b8d802a5abaaa9518', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e843a3fb49f41dcb376184d7e156528', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:57:07.524879 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-43769baf-60e4-4f1b-9e45-a3a652bae8d7 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] 10.222.0.11 "GET /compute/v2.1/servers/15abb40f-daf9-4c4b-ac9c-55f57ee7b938" status: 200 len: 1558 microversion: 2.1 time: 0.165765 Nov 17 03:57:07.525444 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 1398/2989] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:57:07 2021] GET /compute/v2.1/servers/15abb40f-daf9-4c4b-ac9c-55f57ee7b938 => generated 1558 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:57:07.529892 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-eadf669e-09d9-411a-926c-dfea392ebb2d tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 17 03:57:07.530784 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-eadf669e-09d9-411a-926c-dfea392ebb2d tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] [instance: c934945b-ff48-414a-8910-b206a86192b9] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:57:07.538291 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-eadf669e-09d9-411a-926c-dfea392ebb2d tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:57:07.538873 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-eadf669e-09d9-411a-926c-dfea392ebb2d tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:57:07.540026 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-eadf669e-09d9-411a-926c-dfea392ebb2d tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:57:07.540613 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-eadf669e-09d9-411a-926c-dfea392ebb2d tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:57:07.633475 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-eadf669e-09d9-411a-926c-dfea392ebb2d tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] 10.222.0.11 "POST /compute/v2.1/servers/c934945b-ff48-414a-8910-b206a86192b9/action" status: 200 len: 28664 microversion: 2.20 time: 0.105436 Nov 17 03:57:07.637917 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 1399/2990] 10.222.0.11 () {62 vars in 1318 bytes} [Wed Nov 17 03:57:07 2021] POST /compute/v2.1/servers/c934945b-ff48-414a-8910-b206a86192b9/action => generated 28664 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 17 03:57:07.639840 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-d6843138-a638-407a-ac44-3fa377196641 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:57:07.640700 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-d6843138-a638-407a-ac44-3fa377196641 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] [instance: a49437df-3059-4528-8328-2f3471d5fb45] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:57:07.649480 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-d6843138-a638-407a-ac44-3fa377196641 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:57:07.650043 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-d6843138-a638-407a-ac44-3fa377196641 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:57:07.651008 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-d6843138-a638-407a-ac44-3fa377196641 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:57:07.651559 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-d6843138-a638-407a-ac44-3fa377196641 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:57:07.716502 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-d6843138-a638-407a-ac44-3fa377196641 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f046401c6a04f6495ebe0821120bd72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a58e89ceeea4a9c8a72a1de4bcaf2d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:57:07.724431 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-d6843138-a638-407a-ac44-3fa377196641 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] 10.222.0.11 "GET /compute/v2.1/servers/a49437df-3059-4528-8328-2f3471d5fb45" status: 200 len: 1352 microversion: 2.1 time: 0.089244 Nov 17 03:57:07.725032 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 1400/2991] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:57:07 2021] GET /compute/v2.1/servers/a49437df-3059-4528-8328-2f3471d5fb45 => generated 1352 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:57:08.544721 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-3cee5270-2c00-447a-b0f3-e5cfdb7ed438 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:57:08.545611 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-3cee5270-2c00-447a-b0f3-e5cfdb7ed438 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] [instance: 15abb40f-daf9-4c4b-ac9c-55f57ee7b938] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:57:08.553996 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-3cee5270-2c00-447a-b0f3-e5cfdb7ed438 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:57:08.554548 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-3cee5270-2c00-447a-b0f3-e5cfdb7ed438 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:57:08.555656 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-3cee5270-2c00-447a-b0f3-e5cfdb7ed438 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:57:08.556235 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-3cee5270-2c00-447a-b0f3-e5cfdb7ed438 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:57:08.710869 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-3cee5270-2c00-447a-b0f3-e5cfdb7ed438 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a792b5b7e6f7461b8d802a5abaaa9518', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e843a3fb49f41dcb376184d7e156528', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:57:08.720446 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-3cee5270-2c00-447a-b0f3-e5cfdb7ed438 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] 10.222.0.11 "GET /compute/v2.1/servers/15abb40f-daf9-4c4b-ac9c-55f57ee7b938" status: 200 len: 1558 microversion: 2.1 time: 0.180558 Nov 17 03:57:08.721063 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 1401/2992] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:57:08 2021] GET /compute/v2.1/servers/15abb40f-daf9-4c4b-ac9c-55f57ee7b938 => generated 1558 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:57:08.725400 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-dcd5034a-ca44-4de3-83b1-1d6a59e701f1 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 17 03:57:08.726318 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-dcd5034a-ca44-4de3-83b1-1d6a59e701f1 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] [instance: c934945b-ff48-414a-8910-b206a86192b9] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:57:08.732437 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-dcd5034a-ca44-4de3-83b1-1d6a59e701f1 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:57:08.732928 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-dcd5034a-ca44-4de3-83b1-1d6a59e701f1 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:57:08.733698 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-dcd5034a-ca44-4de3-83b1-1d6a59e701f1 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:57:08.734137 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-dcd5034a-ca44-4de3-83b1-1d6a59e701f1 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:57:08.818510 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-dcd5034a-ca44-4de3-83b1-1d6a59e701f1 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] 10.222.0.11 "POST /compute/v2.1/servers/c934945b-ff48-414a-8910-b206a86192b9/action" status: 200 len: 28664 microversion: 2.20 time: 0.095660 Nov 17 03:57:08.819378 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 1402/2993] 10.222.0.11 () {62 vars in 1318 bytes} [Wed Nov 17 03:57:08 2021] POST /compute/v2.1/servers/c934945b-ff48-414a-8910-b206a86192b9/action => generated 28664 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 17 03:57:08.827806 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-a01be6b7-b2d1-4b0e-b489-6e2badec648c tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:57:08.828986 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-a01be6b7-b2d1-4b0e-b489-6e2badec648c tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] [instance: a49437df-3059-4528-8328-2f3471d5fb45] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:57:08.839319 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-a01be6b7-b2d1-4b0e-b489-6e2badec648c tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:57:08.839760 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-a01be6b7-b2d1-4b0e-b489-6e2badec648c tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:57:08.840522 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-a01be6b7-b2d1-4b0e-b489-6e2badec648c tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:57:08.840988 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-a01be6b7-b2d1-4b0e-b489-6e2badec648c tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:57:08.910237 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-a01be6b7-b2d1-4b0e-b489-6e2badec648c tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f046401c6a04f6495ebe0821120bd72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a58e89ceeea4a9c8a72a1de4bcaf2d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:57:08.918790 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-a01be6b7-b2d1-4b0e-b489-6e2badec648c tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] 10.222.0.11 "GET /compute/v2.1/servers/a49437df-3059-4528-8328-2f3471d5fb45" status: 200 len: 1352 microversion: 2.1 time: 0.097840 Nov 17 03:57:08.919359 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 1403/2994] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:57:08 2021] GET /compute/v2.1/servers/a49437df-3059-4528-8328-2f3471d5fb45 => generated 1352 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:57:09.741768 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-7d5a9340-5577-4a7e-8260-8d31d8acc6a6 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:57:09.742842 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-7d5a9340-5577-4a7e-8260-8d31d8acc6a6 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] [instance: 15abb40f-daf9-4c4b-ac9c-55f57ee7b938] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:57:09.750466 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-7d5a9340-5577-4a7e-8260-8d31d8acc6a6 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:57:09.750979 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-7d5a9340-5577-4a7e-8260-8d31d8acc6a6 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:57:09.751674 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-7d5a9340-5577-4a7e-8260-8d31d8acc6a6 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:57:09.752123 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-7d5a9340-5577-4a7e-8260-8d31d8acc6a6 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:57:09.895130 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-7d5a9340-5577-4a7e-8260-8d31d8acc6a6 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a792b5b7e6f7461b8d802a5abaaa9518', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e843a3fb49f41dcb376184d7e156528', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:57:09.907274 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-7d5a9340-5577-4a7e-8260-8d31d8acc6a6 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] 10.222.0.11 "GET /compute/v2.1/servers/15abb40f-daf9-4c4b-ac9c-55f57ee7b938" status: 200 len: 1558 microversion: 2.1 time: 0.171366 Nov 17 03:57:09.907963 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 1404/2995] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:57:09 2021] GET /compute/v2.1/servers/15abb40f-daf9-4c4b-ac9c-55f57ee7b938 => generated 1558 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:57:09.912405 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-bea910e8-3773-4f43-be7d-3acb326b6046 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 17 03:57:09.913331 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-bea910e8-3773-4f43-be7d-3acb326b6046 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] [instance: c934945b-ff48-414a-8910-b206a86192b9] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:57:09.919328 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-bea910e8-3773-4f43-be7d-3acb326b6046 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:57:09.919779 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-bea910e8-3773-4f43-be7d-3acb326b6046 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:57:09.920550 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-bea910e8-3773-4f43-be7d-3acb326b6046 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:57:09.921014 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-bea910e8-3773-4f43-be7d-3acb326b6046 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:57:10.014114 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-bea910e8-3773-4f43-be7d-3acb326b6046 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] 10.222.0.11 "POST /compute/v2.1/servers/c934945b-ff48-414a-8910-b206a86192b9/action" status: 200 len: 30358 microversion: 2.20 time: 0.104248 Nov 17 03:57:10.015452 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 1405/2996] 10.222.0.11 () {62 vars in 1318 bytes} [Wed Nov 17 03:57:09 2021] POST /compute/v2.1/servers/c934945b-ff48-414a-8910-b206a86192b9/action => generated 30358 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 17 03:57:10.024133 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-7423a1d9-b610-4939-80c3-31cf7ea2e9b9 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:57:10.025544 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-7423a1d9-b610-4939-80c3-31cf7ea2e9b9 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] [instance: a49437df-3059-4528-8328-2f3471d5fb45] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:57:10.037124 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-7423a1d9-b610-4939-80c3-31cf7ea2e9b9 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:57:10.037873 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-7423a1d9-b610-4939-80c3-31cf7ea2e9b9 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:57:10.039163 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-7423a1d9-b610-4939-80c3-31cf7ea2e9b9 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:57:10.039896 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-7423a1d9-b610-4939-80c3-31cf7ea2e9b9 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:57:10.106532 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-7423a1d9-b610-4939-80c3-31cf7ea2e9b9 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f046401c6a04f6495ebe0821120bd72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a58e89ceeea4a9c8a72a1de4bcaf2d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:57:10.115933 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-7423a1d9-b610-4939-80c3-31cf7ea2e9b9 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] 10.222.0.11 "GET /compute/v2.1/servers/a49437df-3059-4528-8328-2f3471d5fb45" status: 200 len: 1352 microversion: 2.1 time: 0.098709 Nov 17 03:57:10.116512 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 1406/2997] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:57:10 2021] GET /compute/v2.1/servers/a49437df-3059-4528-8328-2f3471d5fb45 => generated 1352 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:57:10.929312 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-9dcb926a-966d-44cf-8b23-3db27daa8e88 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:57:10.930436 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-9dcb926a-966d-44cf-8b23-3db27daa8e88 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] [instance: 15abb40f-daf9-4c4b-ac9c-55f57ee7b938] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:57:10.938758 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-9dcb926a-966d-44cf-8b23-3db27daa8e88 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:57:10.939221 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-9dcb926a-966d-44cf-8b23-3db27daa8e88 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:57:10.939972 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-9dcb926a-966d-44cf-8b23-3db27daa8e88 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:57:10.940407 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-9dcb926a-966d-44cf-8b23-3db27daa8e88 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:57:11.083919 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-9dcb926a-966d-44cf-8b23-3db27daa8e88 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a792b5b7e6f7461b8d802a5abaaa9518', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e843a3fb49f41dcb376184d7e156528', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:57:11.092139 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-9dcb926a-966d-44cf-8b23-3db27daa8e88 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] 10.222.0.11 "GET /compute/v2.1/servers/15abb40f-daf9-4c4b-ac9c-55f57ee7b938" status: 200 len: 1558 microversion: 2.1 time: 0.169516 Nov 17 03:57:11.092737 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 1407/2998] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:57:10 2021] GET /compute/v2.1/servers/15abb40f-daf9-4c4b-ac9c-55f57ee7b938 => generated 1558 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:57:11.097273 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-22bbe59a-fb03-409b-bb53-d7d325b1fbb3 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 17 03:57:11.098180 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-22bbe59a-fb03-409b-bb53-d7d325b1fbb3 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] [instance: c934945b-ff48-414a-8910-b206a86192b9] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:57:11.104338 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-22bbe59a-fb03-409b-bb53-d7d325b1fbb3 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:57:11.104813 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-22bbe59a-fb03-409b-bb53-d7d325b1fbb3 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:57:11.105586 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-22bbe59a-fb03-409b-bb53-d7d325b1fbb3 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:57:11.106045 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-22bbe59a-fb03-409b-bb53-d7d325b1fbb3 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:57:11.198174 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-22bbe59a-fb03-409b-bb53-d7d325b1fbb3 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] 10.222.0.11 "POST /compute/v2.1/servers/c934945b-ff48-414a-8910-b206a86192b9/action" status: 200 len: 32642 microversion: 2.20 time: 0.103629 Nov 17 03:57:11.199050 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 1408/2999] 10.222.0.11 () {62 vars in 1318 bytes} [Wed Nov 17 03:57:11 2021] POST /compute/v2.1/servers/c934945b-ff48-414a-8910-b206a86192b9/action => generated 32642 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 17 03:57:11.206611 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-73888f09-3917-4af4-9818-d6850078a45c tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:57:11.207754 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-73888f09-3917-4af4-9818-d6850078a45c tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] [instance: a49437df-3059-4528-8328-2f3471d5fb45] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:57:11.216885 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-73888f09-3917-4af4-9818-d6850078a45c tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:57:11.217337 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-73888f09-3917-4af4-9818-d6850078a45c tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:57:11.218110 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-73888f09-3917-4af4-9818-d6850078a45c tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:57:11.218540 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-73888f09-3917-4af4-9818-d6850078a45c tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:57:11.287484 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-73888f09-3917-4af4-9818-d6850078a45c tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f046401c6a04f6495ebe0821120bd72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a58e89ceeea4a9c8a72a1de4bcaf2d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:57:11.295721 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-73888f09-3917-4af4-9818-d6850078a45c tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] 10.222.0.11 "GET /compute/v2.1/servers/a49437df-3059-4528-8328-2f3471d5fb45" status: 200 len: 1352 microversion: 2.1 time: 0.095225 Nov 17 03:57:11.296289 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 1409/3000] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:57:11 2021] GET /compute/v2.1/servers/a49437df-3059-4528-8328-2f3471d5fb45 => generated 1352 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:57:12.113695 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-b9a206d5-488a-434e-8507-4ad68d9a691c tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:57:12.114827 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-b9a206d5-488a-434e-8507-4ad68d9a691c tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] [instance: 15abb40f-daf9-4c4b-ac9c-55f57ee7b938] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:57:12.126119 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-b9a206d5-488a-434e-8507-4ad68d9a691c tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:57:12.126848 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-b9a206d5-488a-434e-8507-4ad68d9a691c tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:57:12.128279 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-b9a206d5-488a-434e-8507-4ad68d9a691c tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:57:12.129304 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-b9a206d5-488a-434e-8507-4ad68d9a691c tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:57:12.283630 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-b9a206d5-488a-434e-8507-4ad68d9a691c tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a792b5b7e6f7461b8d802a5abaaa9518', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e843a3fb49f41dcb376184d7e156528', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:57:12.292041 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-b9a206d5-488a-434e-8507-4ad68d9a691c tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] 10.222.0.11 "GET /compute/v2.1/servers/15abb40f-daf9-4c4b-ac9c-55f57ee7b938" status: 200 len: 1558 microversion: 2.1 time: 0.184675 Nov 17 03:57:12.292599 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 1410/3001] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:57:12 2021] GET /compute/v2.1/servers/15abb40f-daf9-4c4b-ac9c-55f57ee7b938 => generated 1558 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:57:12.297106 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-9a891af6-c4aa-4a6f-b8d2-b02c583fb53a tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 17 03:57:12.297998 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-9a891af6-c4aa-4a6f-b8d2-b02c583fb53a tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] [instance: c934945b-ff48-414a-8910-b206a86192b9] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:57:12.303953 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-9a891af6-c4aa-4a6f-b8d2-b02c583fb53a tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:57:12.304401 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-9a891af6-c4aa-4a6f-b8d2-b02c583fb53a tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:57:12.305194 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-9a891af6-c4aa-4a6f-b8d2-b02c583fb53a tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:57:12.305618 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-9a891af6-c4aa-4a6f-b8d2-b02c583fb53a tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:57:12.396928 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-9a891af6-c4aa-4a6f-b8d2-b02c583fb53a tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] 10.222.0.11 "POST /compute/v2.1/servers/c934945b-ff48-414a-8910-b206a86192b9/action" status: 200 len: 33838 microversion: 2.20 time: 0.102452 Nov 17 03:57:12.397831 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 1411/3002] 10.222.0.11 () {62 vars in 1318 bytes} [Wed Nov 17 03:57:12 2021] POST /compute/v2.1/servers/c934945b-ff48-414a-8910-b206a86192b9/action => generated 33838 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 17 03:57:12.406032 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-4a8d1fc1-9b73-4505-acc6-c8e98f844dad tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:57:12.407157 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-4a8d1fc1-9b73-4505-acc6-c8e98f844dad tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] [instance: a49437df-3059-4528-8328-2f3471d5fb45] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:57:12.417669 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-4a8d1fc1-9b73-4505-acc6-c8e98f844dad tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:57:12.418113 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-4a8d1fc1-9b73-4505-acc6-c8e98f844dad tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:57:12.418884 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-4a8d1fc1-9b73-4505-acc6-c8e98f844dad tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:57:12.419308 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-4a8d1fc1-9b73-4505-acc6-c8e98f844dad tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:57:12.485714 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-4a8d1fc1-9b73-4505-acc6-c8e98f844dad tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f046401c6a04f6495ebe0821120bd72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a58e89ceeea4a9c8a72a1de4bcaf2d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:57:12.494241 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-4a8d1fc1-9b73-4505-acc6-c8e98f844dad tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] 10.222.0.11 "GET /compute/v2.1/servers/a49437df-3059-4528-8328-2f3471d5fb45" status: 200 len: 1352 microversion: 2.1 time: 0.094491 Nov 17 03:57:12.494814 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 1412/3003] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:57:12 2021] GET /compute/v2.1/servers/a49437df-3059-4528-8328-2f3471d5fb45 => generated 1352 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:57:13.313316 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-a95b8260-075f-4298-b22a-aa9e97899e36 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:57:13.314448 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-a95b8260-075f-4298-b22a-aa9e97899e36 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] [instance: 15abb40f-daf9-4c4b-ac9c-55f57ee7b938] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:57:13.324960 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-a95b8260-075f-4298-b22a-aa9e97899e36 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:57:13.325705 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-a95b8260-075f-4298-b22a-aa9e97899e36 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:57:13.326963 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-a95b8260-075f-4298-b22a-aa9e97899e36 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:57:13.327676 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-a95b8260-075f-4298-b22a-aa9e97899e36 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:57:13.459659 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-a95b8260-075f-4298-b22a-aa9e97899e36 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a792b5b7e6f7461b8d802a5abaaa9518', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e843a3fb49f41dcb376184d7e156528', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:57:13.467747 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-a95b8260-075f-4298-b22a-aa9e97899e36 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] 10.222.0.11 "GET /compute/v2.1/servers/15abb40f-daf9-4c4b-ac9c-55f57ee7b938" status: 200 len: 1558 microversion: 2.1 time: 0.160743 Nov 17 03:57:13.468307 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 1413/3004] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:57:13 2021] GET /compute/v2.1/servers/15abb40f-daf9-4c4b-ac9c-55f57ee7b938 => generated 1558 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:57:13.472739 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-224a5814-61a5-403c-a17a-0f58fbb97e2f tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 17 03:57:13.473670 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-224a5814-61a5-403c-a17a-0f58fbb97e2f tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] [instance: c934945b-ff48-414a-8910-b206a86192b9] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:57:13.479762 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-224a5814-61a5-403c-a17a-0f58fbb97e2f tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:57:13.480213 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-224a5814-61a5-403c-a17a-0f58fbb97e2f tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:57:13.481012 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-224a5814-61a5-403c-a17a-0f58fbb97e2f tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:57:13.481446 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-224a5814-61a5-403c-a17a-0f58fbb97e2f tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:57:13.574676 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-224a5814-61a5-403c-a17a-0f58fbb97e2f tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] 10.222.0.11 "POST /compute/v2.1/servers/c934945b-ff48-414a-8910-b206a86192b9/action" status: 200 len: 35209 microversion: 2.20 time: 0.104943 Nov 17 03:57:13.575204 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 1414/3005] 10.222.0.11 () {62 vars in 1318 bytes} [Wed Nov 17 03:57:13 2021] POST /compute/v2.1/servers/c934945b-ff48-414a-8910-b206a86192b9/action => generated 35209 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 17 03:57:13.580174 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-15427466-267f-403e-b35c-49c68f71d33c tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:57:13.580912 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-15427466-267f-403e-b35c-49c68f71d33c tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] [instance: a49437df-3059-4528-8328-2f3471d5fb45] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:57:13.588039 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-15427466-267f-403e-b35c-49c68f71d33c tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:57:13.588499 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-15427466-267f-403e-b35c-49c68f71d33c tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:57:13.589447 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-15427466-267f-403e-b35c-49c68f71d33c tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:57:13.589882 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-15427466-267f-403e-b35c-49c68f71d33c tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:57:13.652873 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-15427466-267f-403e-b35c-49c68f71d33c tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f046401c6a04f6495ebe0821120bd72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a58e89ceeea4a9c8a72a1de4bcaf2d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:57:13.661449 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-15427466-267f-403e-b35c-49c68f71d33c tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] 10.222.0.11 "GET /compute/v2.1/servers/a49437df-3059-4528-8328-2f3471d5fb45" status: 200 len: 1352 microversion: 2.1 time: 0.084963 Nov 17 03:57:13.662001 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 1415/3006] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:57:13 2021] GET /compute/v2.1/servers/a49437df-3059-4528-8328-2f3471d5fb45 => generated 1352 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:57:14.488921 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-f3b5083f-e1a8-4590-9ef1-2b0071a7df67 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:57:14.489760 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-f3b5083f-e1a8-4590-9ef1-2b0071a7df67 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] [instance: 15abb40f-daf9-4c4b-ac9c-55f57ee7b938] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:57:14.497824 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-f3b5083f-e1a8-4590-9ef1-2b0071a7df67 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:57:14.498379 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-f3b5083f-e1a8-4590-9ef1-2b0071a7df67 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:57:14.499326 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-f3b5083f-e1a8-4590-9ef1-2b0071a7df67 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:57:14.499860 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-f3b5083f-e1a8-4590-9ef1-2b0071a7df67 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:57:14.645673 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-f3b5083f-e1a8-4590-9ef1-2b0071a7df67 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a792b5b7e6f7461b8d802a5abaaa9518', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e843a3fb49f41dcb376184d7e156528', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:57:14.655706 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-f3b5083f-e1a8-4590-9ef1-2b0071a7df67 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] 10.222.0.11 "GET /compute/v2.1/servers/15abb40f-daf9-4c4b-ac9c-55f57ee7b938" status: 200 len: 1558 microversion: 2.1 time: 0.173113 Nov 17 03:57:14.656335 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 1416/3007] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:57:14 2021] GET /compute/v2.1/servers/15abb40f-daf9-4c4b-ac9c-55f57ee7b938 => generated 1558 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 17 03:57:14.660731 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-cbf1b784-d6ca-456d-858a-524cd42d2272 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 17 03:57:14.661649 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-cbf1b784-d6ca-456d-858a-524cd42d2272 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] [instance: c934945b-ff48-414a-8910-b206a86192b9] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:57:14.667853 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-cbf1b784-d6ca-456d-858a-524cd42d2272 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:57:14.668304 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-cbf1b784-d6ca-456d-858a-524cd42d2272 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:57:14.669105 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-cbf1b784-d6ca-456d-858a-524cd42d2272 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:57:14.669546 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-cbf1b784-d6ca-456d-858a-524cd42d2272 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:57:14.763750 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-cbf1b784-d6ca-456d-858a-524cd42d2272 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] 10.222.0.11 "POST /compute/v2.1/servers/c934945b-ff48-414a-8910-b206a86192b9/action" status: 200 len: 36847 microversion: 2.20 time: 0.105724 Nov 17 03:57:14.764819 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 1417/3008] 10.222.0.11 () {62 vars in 1318 bytes} [Wed Nov 17 03:57:14 2021] POST /compute/v2.1/servers/c934945b-ff48-414a-8910-b206a86192b9/action => generated 36847 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 17 03:57:14.772733 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-3b4efc9b-42c6-4a78-945b-2efa71b442c8 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:57:14.773912 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-3b4efc9b-42c6-4a78-945b-2efa71b442c8 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] [instance: a49437df-3059-4528-8328-2f3471d5fb45] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:57:14.782209 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-3b4efc9b-42c6-4a78-945b-2efa71b442c8 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:57:14.782658 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-3b4efc9b-42c6-4a78-945b-2efa71b442c8 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:57:14.783409 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-3b4efc9b-42c6-4a78-945b-2efa71b442c8 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:57:14.783838 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-3b4efc9b-42c6-4a78-945b-2efa71b442c8 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:57:14.853558 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-3b4efc9b-42c6-4a78-945b-2efa71b442c8 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f046401c6a04f6495ebe0821120bd72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a58e89ceeea4a9c8a72a1de4bcaf2d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:57:14.865831 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-3b4efc9b-42c6-4a78-945b-2efa71b442c8 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] 10.222.0.11 "GET /compute/v2.1/servers/a49437df-3059-4528-8328-2f3471d5fb45" status: 200 len: 1352 microversion: 2.1 time: 0.098967 Nov 17 03:57:14.866580 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 1418/3009] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:57:14 2021] GET /compute/v2.1/servers/a49437df-3059-4528-8328-2f3471d5fb45 => generated 1352 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:57:15.677310 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-06eec809-f304-4a4f-8899-50d3d511f730 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:57:15.678436 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-06eec809-f304-4a4f-8899-50d3d511f730 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] [instance: 15abb40f-daf9-4c4b-ac9c-55f57ee7b938] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:57:15.686984 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-06eec809-f304-4a4f-8899-50d3d511f730 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:57:15.687443 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-06eec809-f304-4a4f-8899-50d3d511f730 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:57:15.688214 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-06eec809-f304-4a4f-8899-50d3d511f730 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:57:15.688658 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-06eec809-f304-4a4f-8899-50d3d511f730 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:57:15.832395 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-06eec809-f304-4a4f-8899-50d3d511f730 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a792b5b7e6f7461b8d802a5abaaa9518', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e843a3fb49f41dcb376184d7e156528', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:57:15.840810 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-06eec809-f304-4a4f-8899-50d3d511f730 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] 10.222.0.11 "GET /compute/v2.1/servers/15abb40f-daf9-4c4b-ac9c-55f57ee7b938" status: 200 len: 1558 microversion: 2.1 time: 0.170271 Nov 17 03:57:15.841392 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 1419/3010] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:57:15 2021] GET /compute/v2.1/servers/15abb40f-daf9-4c4b-ac9c-55f57ee7b938 => generated 1558 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:57:15.845799 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-82b49995-eb3d-4da3-bbb1-fa7f60acc1e1 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 17 03:57:15.846699 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-82b49995-eb3d-4da3-bbb1-fa7f60acc1e1 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] [instance: c934945b-ff48-414a-8910-b206a86192b9] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:57:15.852443 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-82b49995-eb3d-4da3-bbb1-fa7f60acc1e1 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:57:15.852899 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-82b49995-eb3d-4da3-bbb1-fa7f60acc1e1 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:57:15.853714 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-82b49995-eb3d-4da3-bbb1-fa7f60acc1e1 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:57:15.854179 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-82b49995-eb3d-4da3-bbb1-fa7f60acc1e1 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:57:15.943356 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-82b49995-eb3d-4da3-bbb1-fa7f60acc1e1 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] 10.222.0.11 "POST /compute/v2.1/servers/c934945b-ff48-414a-8910-b206a86192b9/action" status: 200 len: 38223 microversion: 2.20 time: 0.100669 Nov 17 03:57:15.944144 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 1420/3011] 10.222.0.11 () {62 vars in 1318 bytes} [Wed Nov 17 03:57:15 2021] POST /compute/v2.1/servers/c934945b-ff48-414a-8910-b206a86192b9/action => generated 38223 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 17 03:57:15.949026 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-a7bf6106-c99d-40e7-8fa1-b7ed1b278e2c tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:57:15.949757 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-a7bf6106-c99d-40e7-8fa1-b7ed1b278e2c tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] [instance: a49437df-3059-4528-8328-2f3471d5fb45] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:57:15.956954 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-a7bf6106-c99d-40e7-8fa1-b7ed1b278e2c tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:57:15.957396 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-a7bf6106-c99d-40e7-8fa1-b7ed1b278e2c tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:57:15.958158 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-a7bf6106-c99d-40e7-8fa1-b7ed1b278e2c tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:57:15.958620 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-a7bf6106-c99d-40e7-8fa1-b7ed1b278e2c tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:57:16.024423 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-a7bf6106-c99d-40e7-8fa1-b7ed1b278e2c tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f046401c6a04f6495ebe0821120bd72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a58e89ceeea4a9c8a72a1de4bcaf2d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:57:16.033624 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-a7bf6106-c99d-40e7-8fa1-b7ed1b278e2c tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] 10.222.0.11 "GET /compute/v2.1/servers/a49437df-3059-4528-8328-2f3471d5fb45" status: 200 len: 1352 microversion: 2.1 time: 0.088447 Nov 17 03:57:16.034186 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 1421/3012] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:57:15 2021] GET /compute/v2.1/servers/a49437df-3059-4528-8328-2f3471d5fb45 => generated 1352 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:57:16.862208 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-ca0159da-eff5-461e-8203-3274b34f73f4 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:57:16.863388 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-ca0159da-eff5-461e-8203-3274b34f73f4 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] [instance: 15abb40f-daf9-4c4b-ac9c-55f57ee7b938] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:57:16.873214 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-ca0159da-eff5-461e-8203-3274b34f73f4 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:57:16.873669 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-ca0159da-eff5-461e-8203-3274b34f73f4 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:57:16.874440 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-ca0159da-eff5-461e-8203-3274b34f73f4 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:57:16.874871 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-ca0159da-eff5-461e-8203-3274b34f73f4 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:57:17.017056 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-ca0159da-eff5-461e-8203-3274b34f73f4 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a792b5b7e6f7461b8d802a5abaaa9518', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e843a3fb49f41dcb376184d7e156528', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:57:17.025171 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-ca0159da-eff5-461e-8203-3274b34f73f4 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] 10.222.0.11 "GET /compute/v2.1/servers/15abb40f-daf9-4c4b-ac9c-55f57ee7b938" status: 200 len: 1558 microversion: 2.1 time: 0.169492 Nov 17 03:57:17.026036 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 1422/3013] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:57:16 2021] GET /compute/v2.1/servers/15abb40f-daf9-4c4b-ac9c-55f57ee7b938 => generated 1558 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:57:17.030565 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-70adc2e2-b159-413f-ab81-3e86b0f391e5 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 17 03:57:17.031470 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-70adc2e2-b159-413f-ab81-3e86b0f391e5 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] [instance: c934945b-ff48-414a-8910-b206a86192b9] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:57:17.037255 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-70adc2e2-b159-413f-ab81-3e86b0f391e5 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:57:17.037755 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-70adc2e2-b159-413f-ab81-3e86b0f391e5 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:57:17.038526 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-70adc2e2-b159-413f-ab81-3e86b0f391e5 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:57:17.038959 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-70adc2e2-b159-413f-ab81-3e86b0f391e5 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:57:17.121553 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-70adc2e2-b159-413f-ab81-3e86b0f391e5 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] 10.222.0.11 "POST /compute/v2.1/servers/c934945b-ff48-414a-8910-b206a86192b9/action" status: 200 len: 38223 microversion: 2.20 time: 0.094279 Nov 17 03:57:17.125973 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 1423/3014] 10.222.0.11 () {62 vars in 1318 bytes} [Wed Nov 17 03:57:17 2021] POST /compute/v2.1/servers/c934945b-ff48-414a-8910-b206a86192b9/action => generated 38223 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 17 03:57:17.127132 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-a2c2a764-1217-40a5-98f9-4c8001066b7c tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:57:17.127821 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-a2c2a764-1217-40a5-98f9-4c8001066b7c tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] [instance: a49437df-3059-4528-8328-2f3471d5fb45] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:57:17.134987 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-a2c2a764-1217-40a5-98f9-4c8001066b7c tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:57:17.135440 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-a2c2a764-1217-40a5-98f9-4c8001066b7c tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:57:17.136208 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-a2c2a764-1217-40a5-98f9-4c8001066b7c tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:57:17.136640 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-a2c2a764-1217-40a5-98f9-4c8001066b7c tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:57:17.200069 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-a2c2a764-1217-40a5-98f9-4c8001066b7c tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f046401c6a04f6495ebe0821120bd72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a58e89ceeea4a9c8a72a1de4bcaf2d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:57:17.209128 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-a2c2a764-1217-40a5-98f9-4c8001066b7c tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] 10.222.0.11 "GET /compute/v2.1/servers/a49437df-3059-4528-8328-2f3471d5fb45" status: 200 len: 1352 microversion: 2.1 time: 0.085584 Nov 17 03:57:17.209692 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 1424/3015] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:57:17 2021] GET /compute/v2.1/servers/a49437df-3059-4528-8328-2f3471d5fb45 => generated 1352 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:57:18.045629 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-308c5f6d-282d-414f-8d7c-1be74298f3fb tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:57:18.046298 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-308c5f6d-282d-414f-8d7c-1be74298f3fb tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] [instance: 15abb40f-daf9-4c4b-ac9c-55f57ee7b938] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:57:18.053850 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-308c5f6d-282d-414f-8d7c-1be74298f3fb tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:57:18.054304 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-308c5f6d-282d-414f-8d7c-1be74298f3fb tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:57:18.055091 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-308c5f6d-282d-414f-8d7c-1be74298f3fb tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:57:18.055664 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-308c5f6d-282d-414f-8d7c-1be74298f3fb tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:57:18.204054 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-308c5f6d-282d-414f-8d7c-1be74298f3fb tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a792b5b7e6f7461b8d802a5abaaa9518', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e843a3fb49f41dcb376184d7e156528', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:57:18.212985 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-308c5f6d-282d-414f-8d7c-1be74298f3fb tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] 10.222.0.11 "GET /compute/v2.1/servers/15abb40f-daf9-4c4b-ac9c-55f57ee7b938" status: 200 len: 1558 microversion: 2.1 time: 0.172673 Nov 17 03:57:18.213672 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 1425/3016] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:57:18 2021] GET /compute/v2.1/servers/15abb40f-daf9-4c4b-ac9c-55f57ee7b938 => generated 1558 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:57:18.219806 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-98e57db1-d44e-4fbd-857c-c8bc1d3908cc tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 17 03:57:18.220908 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-98e57db1-d44e-4fbd-857c-c8bc1d3908cc tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] [instance: c934945b-ff48-414a-8910-b206a86192b9] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:57:18.234699 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-98e57db1-d44e-4fbd-857c-c8bc1d3908cc tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:57:18.235242 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-98e57db1-d44e-4fbd-857c-c8bc1d3908cc tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:57:18.236144 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-98e57db1-d44e-4fbd-857c-c8bc1d3908cc tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:57:18.236650 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-98e57db1-d44e-4fbd-857c-c8bc1d3908cc tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:57:18.324937 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-98e57db1-d44e-4fbd-857c-c8bc1d3908cc tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] 10.222.0.11 "POST /compute/v2.1/servers/c934945b-ff48-414a-8910-b206a86192b9/action" status: 200 len: 38223 microversion: 2.20 time: 0.109488 Nov 17 03:57:18.326200 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 1426/3017] 10.222.0.11 () {62 vars in 1318 bytes} [Wed Nov 17 03:57:18 2021] POST /compute/v2.1/servers/c934945b-ff48-414a-8910-b206a86192b9/action => generated 38223 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 17 03:57:18.331116 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-66f4698e-8e8f-467d-948f-dd96e3ace9fc tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:57:18.331810 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-66f4698e-8e8f-467d-948f-dd96e3ace9fc tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] [instance: a49437df-3059-4528-8328-2f3471d5fb45] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:57:18.338716 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-66f4698e-8e8f-467d-948f-dd96e3ace9fc tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:57:18.339169 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-66f4698e-8e8f-467d-948f-dd96e3ace9fc tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:57:18.339931 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-66f4698e-8e8f-467d-948f-dd96e3ace9fc tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:57:18.340396 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-66f4698e-8e8f-467d-948f-dd96e3ace9fc tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:57:18.405224 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-66f4698e-8e8f-467d-948f-dd96e3ace9fc tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f046401c6a04f6495ebe0821120bd72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a58e89ceeea4a9c8a72a1de4bcaf2d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:57:18.413767 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-66f4698e-8e8f-467d-948f-dd96e3ace9fc tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] 10.222.0.11 "GET /compute/v2.1/servers/a49437df-3059-4528-8328-2f3471d5fb45" status: 200 len: 1352 microversion: 2.1 time: 0.086334 Nov 17 03:57:18.414320 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 1427/3018] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:57:18 2021] GET /compute/v2.1/servers/a49437df-3059-4528-8328-2f3471d5fb45 => generated 1352 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:57:19.235437 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-edc8a086-6bff-42f3-b1af-dd46cc771487 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:57:19.236492 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-edc8a086-6bff-42f3-b1af-dd46cc771487 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] [instance: 15abb40f-daf9-4c4b-ac9c-55f57ee7b938] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:57:19.247147 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-edc8a086-6bff-42f3-b1af-dd46cc771487 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:57:19.247759 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-edc8a086-6bff-42f3-b1af-dd46cc771487 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:57:19.248551 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-edc8a086-6bff-42f3-b1af-dd46cc771487 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:57:19.249017 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-edc8a086-6bff-42f3-b1af-dd46cc771487 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:57:19.384444 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-edc8a086-6bff-42f3-b1af-dd46cc771487 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a792b5b7e6f7461b8d802a5abaaa9518', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e843a3fb49f41dcb376184d7e156528', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:57:19.392486 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-edc8a086-6bff-42f3-b1af-dd46cc771487 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] 10.222.0.11 "GET /compute/v2.1/servers/15abb40f-daf9-4c4b-ac9c-55f57ee7b938" status: 200 len: 1558 microversion: 2.1 time: 0.163539 Nov 17 03:57:19.393105 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 1428/3019] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:57:19 2021] GET /compute/v2.1/servers/15abb40f-daf9-4c4b-ac9c-55f57ee7b938 => generated 1558 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:57:19.397437 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-4002fdb4-b01f-4db8-a2de-424a23111d1a tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 17 03:57:19.398345 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-4002fdb4-b01f-4db8-a2de-424a23111d1a tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] [instance: c934945b-ff48-414a-8910-b206a86192b9] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:57:19.404573 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-4002fdb4-b01f-4db8-a2de-424a23111d1a tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:57:19.405024 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-4002fdb4-b01f-4db8-a2de-424a23111d1a tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:57:19.405801 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-4002fdb4-b01f-4db8-a2de-424a23111d1a tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:57:19.406235 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-4002fdb4-b01f-4db8-a2de-424a23111d1a tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:57:19.492681 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-4002fdb4-b01f-4db8-a2de-424a23111d1a tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] 10.222.0.11 "POST /compute/v2.1/servers/c934945b-ff48-414a-8910-b206a86192b9/action" status: 200 len: 38223 microversion: 2.20 time: 0.097851 Nov 17 03:57:19.493743 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 1429/3020] 10.222.0.11 () {62 vars in 1318 bytes} [Wed Nov 17 03:57:19 2021] POST /compute/v2.1/servers/c934945b-ff48-414a-8910-b206a86192b9/action => generated 38223 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 17 03:57:19.501987 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-5dfbcf2c-ee6d-47d0-b155-d183c667cdb3 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:57:19.503200 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-5dfbcf2c-ee6d-47d0-b155-d183c667cdb3 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] [instance: a49437df-3059-4528-8328-2f3471d5fb45] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:57:19.513931 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-5dfbcf2c-ee6d-47d0-b155-d183c667cdb3 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:57:19.514384 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-5dfbcf2c-ee6d-47d0-b155-d183c667cdb3 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:57:19.515208 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-5dfbcf2c-ee6d-47d0-b155-d183c667cdb3 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:57:19.515639 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-5dfbcf2c-ee6d-47d0-b155-d183c667cdb3 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:57:19.577130 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-5dfbcf2c-ee6d-47d0-b155-d183c667cdb3 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f046401c6a04f6495ebe0821120bd72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a58e89ceeea4a9c8a72a1de4bcaf2d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:57:19.585468 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-5dfbcf2c-ee6d-47d0-b155-d183c667cdb3 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] 10.222.0.11 "GET /compute/v2.1/servers/a49437df-3059-4528-8328-2f3471d5fb45" status: 200 len: 1352 microversion: 2.1 time: 0.089872 Nov 17 03:57:19.585961 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 1430/3021] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:57:19 2021] GET /compute/v2.1/servers/a49437df-3059-4528-8328-2f3471d5fb45 => generated 1352 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:57:20.414058 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-7f090355-ed15-4e0d-9935-74cf0ba27df8 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:57:20.415148 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-7f090355-ed15-4e0d-9935-74cf0ba27df8 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] [instance: 15abb40f-daf9-4c4b-ac9c-55f57ee7b938] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:57:20.423709 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-7f090355-ed15-4e0d-9935-74cf0ba27df8 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:57:20.424160 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-7f090355-ed15-4e0d-9935-74cf0ba27df8 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:57:20.424978 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-7f090355-ed15-4e0d-9935-74cf0ba27df8 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:57:20.425410 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-7f090355-ed15-4e0d-9935-74cf0ba27df8 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:57:20.565882 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-7f090355-ed15-4e0d-9935-74cf0ba27df8 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a792b5b7e6f7461b8d802a5abaaa9518', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e843a3fb49f41dcb376184d7e156528', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:57:20.573729 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-7f090355-ed15-4e0d-9935-74cf0ba27df8 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] 10.222.0.11 "GET /compute/v2.1/servers/15abb40f-daf9-4c4b-ac9c-55f57ee7b938" status: 200 len: 1558 microversion: 2.1 time: 0.166067 Nov 17 03:57:20.583833 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 1431/3022] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:57:20 2021] GET /compute/v2.1/servers/15abb40f-daf9-4c4b-ac9c-55f57ee7b938 => generated 1558 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:57:20.583833 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-0fd81e63-3647-45ea-816c-a7bfdfe6c78b tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 17 03:57:20.583833 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-0fd81e63-3647-45ea-816c-a7bfdfe6c78b tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] [instance: c934945b-ff48-414a-8910-b206a86192b9] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:57:20.585743 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-0fd81e63-3647-45ea-816c-a7bfdfe6c78b tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:57:20.586198 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-0fd81e63-3647-45ea-816c-a7bfdfe6c78b tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:57:20.586972 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-0fd81e63-3647-45ea-816c-a7bfdfe6c78b tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:57:20.587409 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-0fd81e63-3647-45ea-816c-a7bfdfe6c78b tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:57:20.678361 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-0fd81e63-3647-45ea-816c-a7bfdfe6c78b tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] 10.222.0.11 "POST /compute/v2.1/servers/c934945b-ff48-414a-8910-b206a86192b9/action" status: 200 len: 38366 microversion: 2.20 time: 0.102213 Nov 17 03:57:20.679133 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 1432/3023] 10.222.0.11 () {62 vars in 1318 bytes} [Wed Nov 17 03:57:20 2021] POST /compute/v2.1/servers/c934945b-ff48-414a-8910-b206a86192b9/action => generated 38366 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 17 03:57:20.686322 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-f6a9e369-3e12-40b0-bf79-a167eed71548 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:57:20.687012 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-f6a9e369-3e12-40b0-bf79-a167eed71548 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] [instance: a49437df-3059-4528-8328-2f3471d5fb45] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:57:20.694200 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-f6a9e369-3e12-40b0-bf79-a167eed71548 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:57:20.694647 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-f6a9e369-3e12-40b0-bf79-a167eed71548 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:57:20.695420 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-f6a9e369-3e12-40b0-bf79-a167eed71548 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:57:20.695842 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-f6a9e369-3e12-40b0-bf79-a167eed71548 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:57:20.758115 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-f6a9e369-3e12-40b0-bf79-a167eed71548 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f046401c6a04f6495ebe0821120bd72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a58e89ceeea4a9c8a72a1de4bcaf2d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:57:20.768262 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-f6a9e369-3e12-40b0-bf79-a167eed71548 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] 10.222.0.11 "GET /compute/v2.1/servers/a49437df-3059-4528-8328-2f3471d5fb45" status: 200 len: 1352 microversion: 2.1 time: 0.087429 Nov 17 03:57:20.769211 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 1433/3024] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:57:20 2021] GET /compute/v2.1/servers/a49437df-3059-4528-8328-2f3471d5fb45 => generated 1352 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:57:20.774015 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-c2f3151e-d43d-438f-8830-9a101379e970 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:57:20.774498 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-c2f3151e-d43d-438f-8830-9a101379e970 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] [instance: c934945b-ff48-414a-8910-b206a86192b9] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:57:20.780677 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-c2f3151e-d43d-438f-8830-9a101379e970 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:57:20.781166 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-c2f3151e-d43d-438f-8830-9a101379e970 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:57:20.781977 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-c2f3151e-d43d-438f-8830-9a101379e970 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:57:20.782403 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-c2f3151e-d43d-438f-8830-9a101379e970 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:57:20.807715 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-c2f3151e-d43d-438f-8830-9a101379e970 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] 10.222.0.11 "GET /compute/v2.1/servers/c934945b-ff48-414a-8910-b206a86192b9/ips" status: 200 len: 152 microversion: 2.20 time: 0.037504 Nov 17 03:57:20.808276 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 1434/3025] 10.222.0.11 () {60 vars in 1288 bytes} [Wed Nov 17 03:57:20 2021] GET /compute/v2.1/servers/c934945b-ff48-414a-8910-b206a86192b9/ips => generated 152 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 17 03:57:21.594568 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-c8e82031-7fd0-4f4f-a040-dae60c76e493 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:57:21.595437 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-c8e82031-7fd0-4f4f-a040-dae60c76e493 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] [instance: 15abb40f-daf9-4c4b-ac9c-55f57ee7b938] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:57:21.604181 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-c8e82031-7fd0-4f4f-a040-dae60c76e493 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:57:21.604825 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-c8e82031-7fd0-4f4f-a040-dae60c76e493 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:57:21.605835 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-c8e82031-7fd0-4f4f-a040-dae60c76e493 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:57:21.606764 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-c8e82031-7fd0-4f4f-a040-dae60c76e493 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:57:21.748042 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-c8e82031-7fd0-4f4f-a040-dae60c76e493 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a792b5b7e6f7461b8d802a5abaaa9518', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e843a3fb49f41dcb376184d7e156528', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:57:21.755899 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-c8e82031-7fd0-4f4f-a040-dae60c76e493 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] 10.222.0.11 "GET /compute/v2.1/servers/15abb40f-daf9-4c4b-ac9c-55f57ee7b938" status: 200 len: 1558 microversion: 2.1 time: 0.167130 Nov 17 03:57:21.756450 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 1435/3026] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:57:21 2021] GET /compute/v2.1/servers/15abb40f-daf9-4c4b-ac9c-55f57ee7b938 => generated 1558 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:57:21.786473 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-ab30c832-89d0-4a46-8268-5b7b9521f486 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:57:21.787068 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-ab30c832-89d0-4a46-8268-5b7b9521f486 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] [instance: a49437df-3059-4528-8328-2f3471d5fb45] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:57:21.792558 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-ab30c832-89d0-4a46-8268-5b7b9521f486 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:57:21.793036 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-ab30c832-89d0-4a46-8268-5b7b9521f486 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:57:21.794028 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-ab30c832-89d0-4a46-8268-5b7b9521f486 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:57:21.794455 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-ab30c832-89d0-4a46-8268-5b7b9521f486 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:57:21.858630 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-ab30c832-89d0-4a46-8268-5b7b9521f486 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f046401c6a04f6495ebe0821120bd72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a58e89ceeea4a9c8a72a1de4bcaf2d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:57:21.870961 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-ab30c832-89d0-4a46-8268-5b7b9521f486 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] 10.222.0.11 "GET /compute/v2.1/servers/a49437df-3059-4528-8328-2f3471d5fb45" status: 200 len: 1352 microversion: 2.1 time: 0.087547 Nov 17 03:57:21.871797 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 1436/3027] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:57:21 2021] GET /compute/v2.1/servers/a49437df-3059-4528-8328-2f3471d5fb45 => generated 1352 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:57:22.777101 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-a8b443d3-5c25-438b-bf67-c6facd27fb5e tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:57:22.778213 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-a8b443d3-5c25-438b-bf67-c6facd27fb5e tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] [instance: 15abb40f-daf9-4c4b-ac9c-55f57ee7b938] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:57:22.791883 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-a8b443d3-5c25-438b-bf67-c6facd27fb5e tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:57:22.792634 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-a8b443d3-5c25-438b-bf67-c6facd27fb5e tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:57:22.794014 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-a8b443d3-5c25-438b-bf67-c6facd27fb5e tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:57:22.794662 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-a8b443d3-5c25-438b-bf67-c6facd27fb5e tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:57:22.939493 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-a8b443d3-5c25-438b-bf67-c6facd27fb5e tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a792b5b7e6f7461b8d802a5abaaa9518', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e843a3fb49f41dcb376184d7e156528', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:57:22.951962 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-a8b443d3-5c25-438b-bf67-c6facd27fb5e tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] 10.222.0.11 "GET /compute/v2.1/servers/15abb40f-daf9-4c4b-ac9c-55f57ee7b938" status: 200 len: 1558 microversion: 2.1 time: 0.180804 Nov 17 03:57:22.952758 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 1437/3028] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:57:22 2021] GET /compute/v2.1/servers/15abb40f-daf9-4c4b-ac9c-55f57ee7b938 => generated 1558 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:57:22.957092 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-decea149-46e2-498d-8e55-375e6e7353be tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:57:22.957680 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-decea149-46e2-498d-8e55-375e6e7353be tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] [instance: a49437df-3059-4528-8328-2f3471d5fb45] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:57:22.963470 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-decea149-46e2-498d-8e55-375e6e7353be tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:57:22.963916 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-decea149-46e2-498d-8e55-375e6e7353be tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:57:22.964677 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-decea149-46e2-498d-8e55-375e6e7353be tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:57:22.965137 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-decea149-46e2-498d-8e55-375e6e7353be tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:57:23.026053 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-decea149-46e2-498d-8e55-375e6e7353be tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f046401c6a04f6495ebe0821120bd72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a58e89ceeea4a9c8a72a1de4bcaf2d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:57:23.034104 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-decea149-46e2-498d-8e55-375e6e7353be tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] 10.222.0.11 "GET /compute/v2.1/servers/a49437df-3059-4528-8328-2f3471d5fb45" status: 200 len: 1352 microversion: 2.1 time: 0.080339 Nov 17 03:57:23.034667 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 1438/3029] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:57:22 2021] GET /compute/v2.1/servers/a49437df-3059-4528-8328-2f3471d5fb45 => generated 1352 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:57:23.973404 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-59d9a631-5121-43cd-a55a-4d04d42cdd55 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:57:23.974572 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-59d9a631-5121-43cd-a55a-4d04d42cdd55 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] [instance: 15abb40f-daf9-4c4b-ac9c-55f57ee7b938] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:57:23.984263 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-59d9a631-5121-43cd-a55a-4d04d42cdd55 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:57:23.984713 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-59d9a631-5121-43cd-a55a-4d04d42cdd55 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:57:23.985533 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-59d9a631-5121-43cd-a55a-4d04d42cdd55 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:57:23.985969 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-59d9a631-5121-43cd-a55a-4d04d42cdd55 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:57:24.129712 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-59d9a631-5121-43cd-a55a-4d04d42cdd55 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a792b5b7e6f7461b8d802a5abaaa9518', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e843a3fb49f41dcb376184d7e156528', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:57:24.140399 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-59d9a631-5121-43cd-a55a-4d04d42cdd55 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] 10.222.0.11 "GET /compute/v2.1/servers/15abb40f-daf9-4c4b-ac9c-55f57ee7b938" status: 200 len: 1558 microversion: 2.1 time: 0.173208 Nov 17 03:57:24.141041 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 1439/3030] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:57:23 2021] GET /compute/v2.1/servers/15abb40f-daf9-4c4b-ac9c-55f57ee7b938 => generated 1558 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:57:24.145283 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-75169c2c-df6c-48c1-aa9d-4837ca8f2a83 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:57:24.145877 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-75169c2c-df6c-48c1-aa9d-4837ca8f2a83 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] [instance: a49437df-3059-4528-8328-2f3471d5fb45] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:57:24.151891 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-75169c2c-df6c-48c1-aa9d-4837ca8f2a83 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:57:24.152339 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-75169c2c-df6c-48c1-aa9d-4837ca8f2a83 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:57:24.153132 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-75169c2c-df6c-48c1-aa9d-4837ca8f2a83 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:57:24.153561 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-75169c2c-df6c-48c1-aa9d-4837ca8f2a83 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:57:24.218811 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-75169c2c-df6c-48c1-aa9d-4837ca8f2a83 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f046401c6a04f6495ebe0821120bd72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a58e89ceeea4a9c8a72a1de4bcaf2d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:57:24.230092 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-75169c2c-df6c-48c1-aa9d-4837ca8f2a83 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] 10.222.0.11 "GET /compute/v2.1/servers/a49437df-3059-4528-8328-2f3471d5fb45" status: 200 len: 1352 microversion: 2.1 time: 0.087694 Nov 17 03:57:24.230838 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 1440/3031] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:57:24 2021] GET /compute/v2.1/servers/a49437df-3059-4528-8328-2f3471d5fb45 => generated 1352 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:57:25.160545 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-db4372a5-566f-45c2-a204-8f8c4316abea tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:57:25.161269 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-db4372a5-566f-45c2-a204-8f8c4316abea tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] [instance: 15abb40f-daf9-4c4b-ac9c-55f57ee7b938] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:57:25.169716 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-db4372a5-566f-45c2-a204-8f8c4316abea tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:57:25.170170 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-db4372a5-566f-45c2-a204-8f8c4316abea tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:57:25.170976 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-db4372a5-566f-45c2-a204-8f8c4316abea tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:57:25.171570 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-db4372a5-566f-45c2-a204-8f8c4316abea tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:57:25.318887 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-db4372a5-566f-45c2-a204-8f8c4316abea tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a792b5b7e6f7461b8d802a5abaaa9518', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e843a3fb49f41dcb376184d7e156528', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:57:25.327134 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-db4372a5-566f-45c2-a204-8f8c4316abea tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] 10.222.0.11 "GET /compute/v2.1/servers/15abb40f-daf9-4c4b-ac9c-55f57ee7b938" status: 200 len: 1558 microversion: 2.1 time: 0.172121 Nov 17 03:57:25.327678 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 1441/3032] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:57:25 2021] GET /compute/v2.1/servers/15abb40f-daf9-4c4b-ac9c-55f57ee7b938 => generated 1558 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:57:25.331949 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-bafb59fe-f1af-43c9-8712-84f15bbfe19d tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:57:25.332549 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-bafb59fe-f1af-43c9-8712-84f15bbfe19d tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] [instance: a49437df-3059-4528-8328-2f3471d5fb45] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:57:25.338512 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-bafb59fe-f1af-43c9-8712-84f15bbfe19d tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:57:25.338960 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-bafb59fe-f1af-43c9-8712-84f15bbfe19d tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:57:25.339729 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-bafb59fe-f1af-43c9-8712-84f15bbfe19d tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:57:25.340159 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-bafb59fe-f1af-43c9-8712-84f15bbfe19d tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:57:25.399225 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-bafb59fe-f1af-43c9-8712-84f15bbfe19d tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f046401c6a04f6495ebe0821120bd72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a58e89ceeea4a9c8a72a1de4bcaf2d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:57:25.407377 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-bafb59fe-f1af-43c9-8712-84f15bbfe19d tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] 10.222.0.11 "GET /compute/v2.1/servers/a49437df-3059-4528-8328-2f3471d5fb45" status: 200 len: 1352 microversion: 2.1 time: 0.078760 Nov 17 03:57:25.407946 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 1442/3033] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:57:25 2021] GET /compute/v2.1/servers/a49437df-3059-4528-8328-2f3471d5fb45 => generated 1352 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:57:26.348388 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-e3fe76e6-d4b9-444a-9d53-e130211c61aa tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:57:26.349530 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-e3fe76e6-d4b9-444a-9d53-e130211c61aa tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] [instance: 15abb40f-daf9-4c4b-ac9c-55f57ee7b938] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:57:26.359858 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-e3fe76e6-d4b9-444a-9d53-e130211c61aa tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:57:26.360537 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-e3fe76e6-d4b9-444a-9d53-e130211c61aa tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:57:26.361334 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-e3fe76e6-d4b9-444a-9d53-e130211c61aa tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:57:26.361762 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-e3fe76e6-d4b9-444a-9d53-e130211c61aa tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:57:26.499677 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-e3fe76e6-d4b9-444a-9d53-e130211c61aa tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a792b5b7e6f7461b8d802a5abaaa9518', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e843a3fb49f41dcb376184d7e156528', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:57:26.510249 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-e3fe76e6-d4b9-444a-9d53-e130211c61aa tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] 10.222.0.11 "GET /compute/v2.1/servers/15abb40f-daf9-4c4b-ac9c-55f57ee7b938" status: 200 len: 1558 microversion: 2.1 time: 0.168339 Nov 17 03:57:26.510829 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 1443/3034] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:57:26 2021] GET /compute/v2.1/servers/15abb40f-daf9-4c4b-ac9c-55f57ee7b938 => generated 1558 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:57:26.515211 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-cf149f37-aa7b-4a9a-8fd3-fff44b3555b5 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:57:26.515805 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-cf149f37-aa7b-4a9a-8fd3-fff44b3555b5 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] [instance: a49437df-3059-4528-8328-2f3471d5fb45] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:57:26.522346 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-cf149f37-aa7b-4a9a-8fd3-fff44b3555b5 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:57:26.522962 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-cf149f37-aa7b-4a9a-8fd3-fff44b3555b5 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:57:26.524008 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-cf149f37-aa7b-4a9a-8fd3-fff44b3555b5 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:57:26.524614 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-cf149f37-aa7b-4a9a-8fd3-fff44b3555b5 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:57:26.588310 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-cf149f37-aa7b-4a9a-8fd3-fff44b3555b5 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f046401c6a04f6495ebe0821120bd72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a58e89ceeea4a9c8a72a1de4bcaf2d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:57:26.596691 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-cf149f37-aa7b-4a9a-8fd3-fff44b3555b5 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] 10.222.0.11 "GET /compute/v2.1/servers/a49437df-3059-4528-8328-2f3471d5fb45" status: 200 len: 1352 microversion: 2.1 time: 0.084905 Nov 17 03:57:26.597308 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 1444/3035] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:57:26 2021] GET /compute/v2.1/servers/a49437df-3059-4528-8328-2f3471d5fb45 => generated 1352 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:57:26.678285 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 17 03:57:26.679149 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: Wed Nov 17 03:57:26 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-volumes/6d7eac56-10b2-4b1b-b575-bc4b537e13c0 (ip 10.222.0.11) !!! Nov 17 03:57:27.530042 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-d1819d3e-056c-4caa-8c84-5372f7eb0860 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:57:27.530650 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-d1819d3e-056c-4caa-8c84-5372f7eb0860 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] [instance: 15abb40f-daf9-4c4b-ac9c-55f57ee7b938] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:57:27.537507 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-d1819d3e-056c-4caa-8c84-5372f7eb0860 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:57:27.537952 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-d1819d3e-056c-4caa-8c84-5372f7eb0860 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:57:27.538751 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-d1819d3e-056c-4caa-8c84-5372f7eb0860 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:57:27.539175 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-d1819d3e-056c-4caa-8c84-5372f7eb0860 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:57:27.676512 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-d1819d3e-056c-4caa-8c84-5372f7eb0860 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a792b5b7e6f7461b8d802a5abaaa9518', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e843a3fb49f41dcb376184d7e156528', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:57:27.689639 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-d1819d3e-056c-4caa-8c84-5372f7eb0860 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] 10.222.0.11 "GET /compute/v2.1/servers/15abb40f-daf9-4c4b-ac9c-55f57ee7b938" status: 200 len: 1558 microversion: 2.1 time: 0.162916 Nov 17 03:57:27.690567 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 1445/3036] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:57:27 2021] GET /compute/v2.1/servers/15abb40f-daf9-4c4b-ac9c-55f57ee7b938 => generated 1558 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:57:27.694814 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-28474000-2de8-41bc-a58f-890a6d5c3ee4 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:57:27.695609 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-28474000-2de8-41bc-a58f-890a6d5c3ee4 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] [instance: a49437df-3059-4528-8328-2f3471d5fb45] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:57:27.702810 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-28474000-2de8-41bc-a58f-890a6d5c3ee4 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:57:27.703562 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-28474000-2de8-41bc-a58f-890a6d5c3ee4 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:57:27.704594 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-28474000-2de8-41bc-a58f-890a6d5c3ee4 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:57:27.705065 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-28474000-2de8-41bc-a58f-890a6d5c3ee4 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:57:27.779047 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-28474000-2de8-41bc-a58f-890a6d5c3ee4 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f046401c6a04f6495ebe0821120bd72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a58e89ceeea4a9c8a72a1de4bcaf2d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:57:27.789747 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-28474000-2de8-41bc-a58f-890a6d5c3ee4 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] 10.222.0.11 "GET /compute/v2.1/servers/a49437df-3059-4528-8328-2f3471d5fb45" status: 200 len: 1352 microversion: 2.1 time: 0.098140 Nov 17 03:57:27.790301 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 1446/3037] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:57:27 2021] GET /compute/v2.1/servers/a49437df-3059-4528-8328-2f3471d5fb45 => generated 1352 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:57:28.712191 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-df8b12bb-1604-4ab7-93ff-b13a3493e2fc tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:57:28.713344 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-df8b12bb-1604-4ab7-93ff-b13a3493e2fc tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] [instance: 15abb40f-daf9-4c4b-ac9c-55f57ee7b938] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:57:28.724127 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-df8b12bb-1604-4ab7-93ff-b13a3493e2fc tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:57:28.724924 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-df8b12bb-1604-4ab7-93ff-b13a3493e2fc tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:57:28.726168 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-df8b12bb-1604-4ab7-93ff-b13a3493e2fc tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:57:28.726877 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-df8b12bb-1604-4ab7-93ff-b13a3493e2fc tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:57:28.882187 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-df8b12bb-1604-4ab7-93ff-b13a3493e2fc tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a792b5b7e6f7461b8d802a5abaaa9518', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e843a3fb49f41dcb376184d7e156528', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:57:28.890125 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-df8b12bb-1604-4ab7-93ff-b13a3493e2fc tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] 10.222.0.11 "GET /compute/v2.1/servers/15abb40f-daf9-4c4b-ac9c-55f57ee7b938" status: 200 len: 1558 microversion: 2.1 time: 0.184710 Nov 17 03:57:28.890689 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 1447/3038] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:57:28 2021] GET /compute/v2.1/servers/15abb40f-daf9-4c4b-ac9c-55f57ee7b938 => generated 1558 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:57:28.894999 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-b6677916-67e1-4309-942b-ecacf350b469 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:57:28.895589 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-b6677916-67e1-4309-942b-ecacf350b469 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] [instance: a49437df-3059-4528-8328-2f3471d5fb45] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:57:28.900893 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-b6677916-67e1-4309-942b-ecacf350b469 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:57:28.901332 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-b6677916-67e1-4309-942b-ecacf350b469 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:57:28.902084 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-b6677916-67e1-4309-942b-ecacf350b469 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:57:28.902509 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-b6677916-67e1-4309-942b-ecacf350b469 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:57:28.962066 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-b6677916-67e1-4309-942b-ecacf350b469 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f046401c6a04f6495ebe0821120bd72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a58e89ceeea4a9c8a72a1de4bcaf2d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:57:28.970181 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-b6677916-67e1-4309-942b-ecacf350b469 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] 10.222.0.11 "GET /compute/v2.1/servers/a49437df-3059-4528-8328-2f3471d5fb45" status: 200 len: 1352 microversion: 2.1 time: 0.078337 Nov 17 03:57:28.970736 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 1448/3039] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:57:28 2021] GET /compute/v2.1/servers/a49437df-3059-4528-8328-2f3471d5fb45 => generated 1352 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:57:29.909701 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-61ea5cde-83a8-4d36-8993-858ae6df68bc tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:57:29.910712 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-61ea5cde-83a8-4d36-8993-858ae6df68bc tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] [instance: 15abb40f-daf9-4c4b-ac9c-55f57ee7b938] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:57:29.919977 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-61ea5cde-83a8-4d36-8993-858ae6df68bc tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:57:29.920721 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-61ea5cde-83a8-4d36-8993-858ae6df68bc tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:57:29.921944 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-61ea5cde-83a8-4d36-8993-858ae6df68bc tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:57:29.922498 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-61ea5cde-83a8-4d36-8993-858ae6df68bc tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:57:30.065925 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-61ea5cde-83a8-4d36-8993-858ae6df68bc tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a792b5b7e6f7461b8d802a5abaaa9518', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e843a3fb49f41dcb376184d7e156528', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:57:30.078531 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-61ea5cde-83a8-4d36-8993-858ae6df68bc tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] 10.222.0.11 "GET /compute/v2.1/servers/15abb40f-daf9-4c4b-ac9c-55f57ee7b938" status: 200 len: 1558 microversion: 2.1 time: 0.173801 Nov 17 03:57:30.079371 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 1449/3040] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:57:29 2021] GET /compute/v2.1/servers/15abb40f-daf9-4c4b-ac9c-55f57ee7b938 => generated 1558 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:57:30.083977 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-ed84bbe2-d5ab-4448-bcc6-570946c66ff6 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:57:30.084571 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-ed84bbe2-d5ab-4448-bcc6-570946c66ff6 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] [instance: a49437df-3059-4528-8328-2f3471d5fb45] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:57:30.090301 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-ed84bbe2-d5ab-4448-bcc6-570946c66ff6 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:57:30.090747 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-ed84bbe2-d5ab-4448-bcc6-570946c66ff6 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:57:30.091506 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-ed84bbe2-d5ab-4448-bcc6-570946c66ff6 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:57:30.091943 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-ed84bbe2-d5ab-4448-bcc6-570946c66ff6 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:57:30.400247 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-ed84bbe2-d5ab-4448-bcc6-570946c66ff6 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f046401c6a04f6495ebe0821120bd72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a58e89ceeea4a9c8a72a1de4bcaf2d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:57:30.409782 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-ed84bbe2-d5ab-4448-bcc6-570946c66ff6 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] 10.222.0.11 "GET /compute/v2.1/servers/a49437df-3059-4528-8328-2f3471d5fb45" status: 200 len: 1352 microversion: 2.1 time: 0.329010 Nov 17 03:57:30.410382 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 1450/3041] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:57:30 2021] GET /compute/v2.1/servers/a49437df-3059-4528-8328-2f3471d5fb45 => generated 1352 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:57:31.097673 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-e5405bdf-1e5f-4c57-a319-699b930763f2 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:57:31.098279 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-e5405bdf-1e5f-4c57-a319-699b930763f2 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] [instance: 15abb40f-daf9-4c4b-ac9c-55f57ee7b938] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:57:31.105483 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-e5405bdf-1e5f-4c57-a319-699b930763f2 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:57:31.105975 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-e5405bdf-1e5f-4c57-a319-699b930763f2 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:57:31.106851 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-e5405bdf-1e5f-4c57-a319-699b930763f2 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:57:31.107304 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-e5405bdf-1e5f-4c57-a319-699b930763f2 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:57:31.245330 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-e5405bdf-1e5f-4c57-a319-699b930763f2 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a792b5b7e6f7461b8d802a5abaaa9518', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e843a3fb49f41dcb376184d7e156528', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:57:31.254300 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-e5405bdf-1e5f-4c57-a319-699b930763f2 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] 10.222.0.11 "GET /compute/v2.1/servers/15abb40f-daf9-4c4b-ac9c-55f57ee7b938" status: 200 len: 1558 microversion: 2.1 time: 0.162194 Nov 17 03:57:31.254863 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 1451/3042] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:57:31 2021] GET /compute/v2.1/servers/15abb40f-daf9-4c4b-ac9c-55f57ee7b938 => generated 1558 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:57:31.429110 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-de2bd682-6e83-43a7-a514-3ce367613ca2 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:57:31.429753 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-de2bd682-6e83-43a7-a514-3ce367613ca2 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] [instance: a49437df-3059-4528-8328-2f3471d5fb45] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:57:31.437643 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-de2bd682-6e83-43a7-a514-3ce367613ca2 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:57:31.438201 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-de2bd682-6e83-43a7-a514-3ce367613ca2 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:57:31.439152 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-de2bd682-6e83-43a7-a514-3ce367613ca2 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:57:31.439965 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-de2bd682-6e83-43a7-a514-3ce367613ca2 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:57:31.502252 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-de2bd682-6e83-43a7-a514-3ce367613ca2 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f046401c6a04f6495ebe0821120bd72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a58e89ceeea4a9c8a72a1de4bcaf2d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:57:31.510169 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-de2bd682-6e83-43a7-a514-3ce367613ca2 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] 10.222.0.11 "GET /compute/v2.1/servers/a49437df-3059-4528-8328-2f3471d5fb45" status: 200 len: 1352 microversion: 2.1 time: 0.086600 Nov 17 03:57:31.510734 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 1452/3043] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:57:31 2021] GET /compute/v2.1/servers/a49437df-3059-4528-8328-2f3471d5fb45 => generated 1352 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:57:32.275916 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-1a1e845f-72ce-4131-b5b9-546086022f2a tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:57:32.276951 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-1a1e845f-72ce-4131-b5b9-546086022f2a tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] [instance: 15abb40f-daf9-4c4b-ac9c-55f57ee7b938] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:57:32.287825 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-1a1e845f-72ce-4131-b5b9-546086022f2a tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:57:32.288564 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-1a1e845f-72ce-4131-b5b9-546086022f2a tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:57:32.289873 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-1a1e845f-72ce-4131-b5b9-546086022f2a tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:57:32.290585 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-1a1e845f-72ce-4131-b5b9-546086022f2a tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:57:32.435809 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-1a1e845f-72ce-4131-b5b9-546086022f2a tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a792b5b7e6f7461b8d802a5abaaa9518', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e843a3fb49f41dcb376184d7e156528', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:57:32.443760 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-1a1e845f-72ce-4131-b5b9-546086022f2a tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] 10.222.0.11 "GET /compute/v2.1/servers/15abb40f-daf9-4c4b-ac9c-55f57ee7b938" status: 200 len: 1558 microversion: 2.1 time: 0.173979 Nov 17 03:57:32.444335 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 1453/3044] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:57:32 2021] GET /compute/v2.1/servers/15abb40f-daf9-4c4b-ac9c-55f57ee7b938 => generated 1558 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:57:32.530359 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-6887bae2-85f7-45fe-848b-c3e6a7e3ed88 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:57:32.531362 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-6887bae2-85f7-45fe-848b-c3e6a7e3ed88 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] [instance: a49437df-3059-4528-8328-2f3471d5fb45] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:57:32.538611 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-6887bae2-85f7-45fe-848b-c3e6a7e3ed88 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:57:32.539063 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-6887bae2-85f7-45fe-848b-c3e6a7e3ed88 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:57:32.539831 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-6887bae2-85f7-45fe-848b-c3e6a7e3ed88 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:57:32.540296 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-6887bae2-85f7-45fe-848b-c3e6a7e3ed88 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:57:32.602743 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-6887bae2-85f7-45fe-848b-c3e6a7e3ed88 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f046401c6a04f6495ebe0821120bd72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a58e89ceeea4a9c8a72a1de4bcaf2d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:57:32.610864 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-6887bae2-85f7-45fe-848b-c3e6a7e3ed88 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] 10.222.0.11 "GET /compute/v2.1/servers/a49437df-3059-4528-8328-2f3471d5fb45" status: 200 len: 1352 microversion: 2.1 time: 0.086565 Nov 17 03:57:32.611428 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 1454/3045] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:57:32 2021] GET /compute/v2.1/servers/a49437df-3059-4528-8328-2f3471d5fb45 => generated 1352 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:57:33.468350 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-188852fb-1aa8-4df2-b1b6-e5e4ea08c8d0 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:57:33.469494 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-188852fb-1aa8-4df2-b1b6-e5e4ea08c8d0 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] [instance: 15abb40f-daf9-4c4b-ac9c-55f57ee7b938] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:57:33.476812 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-188852fb-1aa8-4df2-b1b6-e5e4ea08c8d0 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:57:33.477300 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-188852fb-1aa8-4df2-b1b6-e5e4ea08c8d0 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:57:33.478070 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-188852fb-1aa8-4df2-b1b6-e5e4ea08c8d0 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:57:33.478509 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-188852fb-1aa8-4df2-b1b6-e5e4ea08c8d0 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:57:33.628870 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-188852fb-1aa8-4df2-b1b6-e5e4ea08c8d0 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a792b5b7e6f7461b8d802a5abaaa9518', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e843a3fb49f41dcb376184d7e156528', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:57:33.641417 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-188852fb-1aa8-4df2-b1b6-e5e4ea08c8d0 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] 10.222.0.11 "GET /compute/v2.1/servers/15abb40f-daf9-4c4b-ac9c-55f57ee7b938" status: 200 len: 1558 microversion: 2.1 time: 0.179169 Nov 17 03:57:33.642230 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 1455/3046] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:57:33 2021] GET /compute/v2.1/servers/15abb40f-daf9-4c4b-ac9c-55f57ee7b938 => generated 1558 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:57:33.646676 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-065ecf39-a0f2-4b4f-8a51-9969aab90954 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:57:33.647265 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-065ecf39-a0f2-4b4f-8a51-9969aab90954 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] [instance: a49437df-3059-4528-8328-2f3471d5fb45] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:57:33.652820 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-065ecf39-a0f2-4b4f-8a51-9969aab90954 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:57:33.653279 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-065ecf39-a0f2-4b4f-8a51-9969aab90954 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:57:33.654031 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-065ecf39-a0f2-4b4f-8a51-9969aab90954 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:57:33.654432 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-065ecf39-a0f2-4b4f-8a51-9969aab90954 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:57:33.724293 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-065ecf39-a0f2-4b4f-8a51-9969aab90954 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f046401c6a04f6495ebe0821120bd72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a58e89ceeea4a9c8a72a1de4bcaf2d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:57:33.735524 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-065ecf39-a0f2-4b4f-8a51-9969aab90954 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] 10.222.0.11 "GET /compute/v2.1/servers/a49437df-3059-4528-8328-2f3471d5fb45" status: 200 len: 1352 microversion: 2.1 time: 0.091784 Nov 17 03:57:33.736316 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 1456/3047] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:57:33 2021] GET /compute/v2.1/servers/a49437df-3059-4528-8328-2f3471d5fb45 => generated 1352 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:57:34.580943 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 17 03:57:34.581895 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: Wed Nov 17 03:57:34 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-volumes/6d7eac56-10b2-4b1b-b575-bc4b537e13c0 (ip 10.222.0.11) !!! Nov 17 03:57:34.662832 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-c7a385c5-085c-447e-b9e4-c5a68b4a274d tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:57:34.663891 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-c7a385c5-085c-447e-b9e4-c5a68b4a274d tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] [instance: 15abb40f-daf9-4c4b-ac9c-55f57ee7b938] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:57:34.674367 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-c7a385c5-085c-447e-b9e4-c5a68b4a274d tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:57:34.675122 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-c7a385c5-085c-447e-b9e4-c5a68b4a274d tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:57:34.676443 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-c7a385c5-085c-447e-b9e4-c5a68b4a274d tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:57:34.676892 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-c7a385c5-085c-447e-b9e4-c5a68b4a274d tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:57:34.815610 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-c7a385c5-085c-447e-b9e4-c5a68b4a274d tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a792b5b7e6f7461b8d802a5abaaa9518', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e843a3fb49f41dcb376184d7e156528', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:57:34.824288 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-c7a385c5-085c-447e-b9e4-c5a68b4a274d tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] 10.222.0.11 "GET /compute/v2.1/servers/15abb40f-daf9-4c4b-ac9c-55f57ee7b938" status: 200 len: 1558 microversion: 2.1 time: 0.167695 Nov 17 03:57:34.824894 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 1457/3048] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:57:34 2021] GET /compute/v2.1/servers/15abb40f-daf9-4c4b-ac9c-55f57ee7b938 => generated 1558 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:57:34.829130 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-89bf7efa-a83d-46db-a755-92ddebe66cf6 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:57:34.829693 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-89bf7efa-a83d-46db-a755-92ddebe66cf6 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] [instance: a49437df-3059-4528-8328-2f3471d5fb45] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:57:34.835549 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-89bf7efa-a83d-46db-a755-92ddebe66cf6 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:57:34.835931 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-89bf7efa-a83d-46db-a755-92ddebe66cf6 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:57:34.836688 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-89bf7efa-a83d-46db-a755-92ddebe66cf6 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:57:34.837146 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-89bf7efa-a83d-46db-a755-92ddebe66cf6 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:57:34.909013 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-89bf7efa-a83d-46db-a755-92ddebe66cf6 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f046401c6a04f6495ebe0821120bd72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a58e89ceeea4a9c8a72a1de4bcaf2d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:57:34.917222 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-89bf7efa-a83d-46db-a755-92ddebe66cf6 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] 10.222.0.11 "GET /compute/v2.1/servers/a49437df-3059-4528-8328-2f3471d5fb45" status: 200 len: 1352 microversion: 2.1 time: 0.091383 Nov 17 03:57:34.917810 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 1458/3049] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:57:34 2021] GET /compute/v2.1/servers/a49437df-3059-4528-8328-2f3471d5fb45 => generated 1352 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:57:35.845528 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-5f0b47de-d845-4574-8dc5-964663260328 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:57:35.846611 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-5f0b47de-d845-4574-8dc5-964663260328 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] [instance: 15abb40f-daf9-4c4b-ac9c-55f57ee7b938] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:57:35.857305 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-5f0b47de-d845-4574-8dc5-964663260328 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:57:35.858067 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-5f0b47de-d845-4574-8dc5-964663260328 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:57:35.859350 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-5f0b47de-d845-4574-8dc5-964663260328 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:57:35.860076 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-5f0b47de-d845-4574-8dc5-964663260328 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:57:36.005265 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-5f0b47de-d845-4574-8dc5-964663260328 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a792b5b7e6f7461b8d802a5abaaa9518', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e843a3fb49f41dcb376184d7e156528', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:57:36.015278 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-5f0b47de-d845-4574-8dc5-964663260328 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] 10.222.0.11 "GET /compute/v2.1/servers/15abb40f-daf9-4c4b-ac9c-55f57ee7b938" status: 200 len: 1558 microversion: 2.1 time: 0.175720 Nov 17 03:57:36.016124 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 1459/3050] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:57:35 2021] GET /compute/v2.1/servers/15abb40f-daf9-4c4b-ac9c-55f57ee7b938 => generated 1558 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:57:36.022359 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-5ce61c77-f68b-43a0-9aca-5f866a5d795e tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:57:36.022950 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-5ce61c77-f68b-43a0-9aca-5f866a5d795e tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] [instance: a49437df-3059-4528-8328-2f3471d5fb45] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:57:36.030277 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-5ce61c77-f68b-43a0-9aca-5f866a5d795e tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:57:36.030764 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-5ce61c77-f68b-43a0-9aca-5f866a5d795e tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:57:36.035246 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-5ce61c77-f68b-43a0-9aca-5f866a5d795e tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:57:36.035246 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-5ce61c77-f68b-43a0-9aca-5f866a5d795e tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:57:36.099911 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-5ce61c77-f68b-43a0-9aca-5f866a5d795e tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f046401c6a04f6495ebe0821120bd72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a58e89ceeea4a9c8a72a1de4bcaf2d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:57:36.108168 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-5ce61c77-f68b-43a0-9aca-5f866a5d795e tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] 10.222.0.11 "GET /compute/v2.1/servers/a49437df-3059-4528-8328-2f3471d5fb45" status: 200 len: 1352 microversion: 2.1 time: 0.090672 Nov 17 03:57:36.108749 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 1460/3051] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:57:36 2021] GET /compute/v2.1/servers/a49437df-3059-4528-8328-2f3471d5fb45 => generated 1352 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:57:37.037686 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-7695018b-a92b-4575-bd84-9716d7828e7b tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:57:37.038329 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-7695018b-a92b-4575-bd84-9716d7828e7b tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] [instance: 15abb40f-daf9-4c4b-ac9c-55f57ee7b938] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:57:37.044850 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-7695018b-a92b-4575-bd84-9716d7828e7b tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:57:37.045338 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-7695018b-a92b-4575-bd84-9716d7828e7b tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:57:37.046110 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-7695018b-a92b-4575-bd84-9716d7828e7b tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:57:37.046549 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-7695018b-a92b-4575-bd84-9716d7828e7b tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:57:37.185821 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-7695018b-a92b-4575-bd84-9716d7828e7b tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a792b5b7e6f7461b8d802a5abaaa9518', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e843a3fb49f41dcb376184d7e156528', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:57:37.196285 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-7695018b-a92b-4575-bd84-9716d7828e7b tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] 10.222.0.11 "GET /compute/v2.1/servers/15abb40f-daf9-4c4b-ac9c-55f57ee7b938" status: 200 len: 1558 microversion: 2.1 time: 0.163013 Nov 17 03:57:37.197179 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 1461/3052] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:57:37 2021] GET /compute/v2.1/servers/15abb40f-daf9-4c4b-ac9c-55f57ee7b938 => generated 1558 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:57:37.201315 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-14c63a8f-a771-4e39-8e5d-4e3b619bc7e9 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:57:37.201885 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-14c63a8f-a771-4e39-8e5d-4e3b619bc7e9 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] [instance: a49437df-3059-4528-8328-2f3471d5fb45] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:57:37.207883 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-14c63a8f-a771-4e39-8e5d-4e3b619bc7e9 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:57:37.208341 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-14c63a8f-a771-4e39-8e5d-4e3b619bc7e9 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:57:37.209148 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-14c63a8f-a771-4e39-8e5d-4e3b619bc7e9 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:57:37.209583 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-14c63a8f-a771-4e39-8e5d-4e3b619bc7e9 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:57:37.269211 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-14c63a8f-a771-4e39-8e5d-4e3b619bc7e9 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f046401c6a04f6495ebe0821120bd72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a58e89ceeea4a9c8a72a1de4bcaf2d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:57:37.279922 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-14c63a8f-a771-4e39-8e5d-4e3b619bc7e9 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] 10.222.0.11 "GET /compute/v2.1/servers/a49437df-3059-4528-8328-2f3471d5fb45" status: 200 len: 1352 microversion: 2.1 time: 0.081593 Nov 17 03:57:37.280735 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 1462/3053] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:57:37 2021] GET /compute/v2.1/servers/a49437df-3059-4528-8328-2f3471d5fb45 => generated 1352 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:57:38.213322 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-e2742e49-3c68-4d43-9a54-b7f3d3e69908 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:57:38.213990 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-e2742e49-3c68-4d43-9a54-b7f3d3e69908 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] [instance: 15abb40f-daf9-4c4b-ac9c-55f57ee7b938] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:57:38.220697 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-e2742e49-3c68-4d43-9a54-b7f3d3e69908 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:57:38.221181 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-e2742e49-3c68-4d43-9a54-b7f3d3e69908 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:57:38.221952 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-e2742e49-3c68-4d43-9a54-b7f3d3e69908 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:57:38.222364 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-e2742e49-3c68-4d43-9a54-b7f3d3e69908 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:57:38.366817 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-e2742e49-3c68-4d43-9a54-b7f3d3e69908 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a792b5b7e6f7461b8d802a5abaaa9518', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e843a3fb49f41dcb376184d7e156528', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:57:38.375483 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-e2742e49-3c68-4d43-9a54-b7f3d3e69908 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] 10.222.0.11 "GET /compute/v2.1/servers/15abb40f-daf9-4c4b-ac9c-55f57ee7b938" status: 200 len: 1558 microversion: 2.1 time: 0.165875 Nov 17 03:57:38.376057 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 1463/3054] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:57:38 2021] GET /compute/v2.1/servers/15abb40f-daf9-4c4b-ac9c-55f57ee7b938 => generated 1558 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:57:38.381507 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-00551359-2165-46d3-8ef3-2aa7cc3b4620 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:57:38.382110 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-00551359-2165-46d3-8ef3-2aa7cc3b4620 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] [instance: a49437df-3059-4528-8328-2f3471d5fb45] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:57:38.389240 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-00551359-2165-46d3-8ef3-2aa7cc3b4620 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:57:38.389858 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-00551359-2165-46d3-8ef3-2aa7cc3b4620 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:57:38.390925 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-00551359-2165-46d3-8ef3-2aa7cc3b4620 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:57:38.391422 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-00551359-2165-46d3-8ef3-2aa7cc3b4620 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:57:38.452821 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-00551359-2165-46d3-8ef3-2aa7cc3b4620 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f046401c6a04f6495ebe0821120bd72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a58e89ceeea4a9c8a72a1de4bcaf2d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:57:38.464833 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-00551359-2165-46d3-8ef3-2aa7cc3b4620 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] 10.222.0.11 "GET /compute/v2.1/servers/a49437df-3059-4528-8328-2f3471d5fb45" status: 200 len: 1352 microversion: 2.1 time: 0.087365 Nov 17 03:57:38.465552 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 1464/3055] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:57:38 2021] GET /compute/v2.1/servers/a49437df-3059-4528-8328-2f3471d5fb45 => generated 1352 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:57:39.397111 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-be144566-ee2d-44cf-ba25-8e1a375812f9 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:57:39.398147 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-be144566-ee2d-44cf-ba25-8e1a375812f9 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] [instance: 15abb40f-daf9-4c4b-ac9c-55f57ee7b938] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:57:39.408479 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-be144566-ee2d-44cf-ba25-8e1a375812f9 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:57:39.409264 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-be144566-ee2d-44cf-ba25-8e1a375812f9 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:57:39.410231 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-be144566-ee2d-44cf-ba25-8e1a375812f9 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:57:39.410658 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-be144566-ee2d-44cf-ba25-8e1a375812f9 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:57:39.598680 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-be144566-ee2d-44cf-ba25-8e1a375812f9 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a792b5b7e6f7461b8d802a5abaaa9518', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e843a3fb49f41dcb376184d7e156528', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:57:39.606620 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-be144566-ee2d-44cf-ba25-8e1a375812f9 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] 10.222.0.11 "GET /compute/v2.1/servers/15abb40f-daf9-4c4b-ac9c-55f57ee7b938" status: 200 len: 1558 microversion: 2.1 time: 0.215922 Nov 17 03:57:39.607171 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 1465/3056] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:57:39 2021] GET /compute/v2.1/servers/15abb40f-daf9-4c4b-ac9c-55f57ee7b938 => generated 1558 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:57:39.611342 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-7c964b67-90f1-440b-afd7-1b338734a464 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:57:39.611930 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-7c964b67-90f1-440b-afd7-1b338734a464 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] [instance: a49437df-3059-4528-8328-2f3471d5fb45] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:57:39.617812 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-7c964b67-90f1-440b-afd7-1b338734a464 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:57:39.618261 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-7c964b67-90f1-440b-afd7-1b338734a464 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:57:39.619028 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-7c964b67-90f1-440b-afd7-1b338734a464 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:57:39.619462 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-7c964b67-90f1-440b-afd7-1b338734a464 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:57:39.681865 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-7c964b67-90f1-440b-afd7-1b338734a464 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f046401c6a04f6495ebe0821120bd72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a58e89ceeea4a9c8a72a1de4bcaf2d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:57:39.689697 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-7c964b67-90f1-440b-afd7-1b338734a464 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] 10.222.0.11 "GET /compute/v2.1/servers/a49437df-3059-4528-8328-2f3471d5fb45" status: 200 len: 1352 microversion: 2.1 time: 0.081569 Nov 17 03:57:39.690270 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 1466/3057] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:57:39 2021] GET /compute/v2.1/servers/a49437df-3059-4528-8328-2f3471d5fb45 => generated 1352 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:57:40.627156 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-248f7332-fbba-4404-bf35-1e08d68c4497 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:57:40.628008 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-248f7332-fbba-4404-bf35-1e08d68c4497 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] [instance: 15abb40f-daf9-4c4b-ac9c-55f57ee7b938] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:57:40.637236 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-248f7332-fbba-4404-bf35-1e08d68c4497 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:57:40.637839 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-248f7332-fbba-4404-bf35-1e08d68c4497 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:57:40.638852 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-248f7332-fbba-4404-bf35-1e08d68c4497 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:57:40.639429 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-248f7332-fbba-4404-bf35-1e08d68c4497 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:57:40.780925 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-248f7332-fbba-4404-bf35-1e08d68c4497 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a792b5b7e6f7461b8d802a5abaaa9518', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e843a3fb49f41dcb376184d7e156528', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:57:40.790066 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-248f7332-fbba-4404-bf35-1e08d68c4497 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] 10.222.0.11 "GET /compute/v2.1/servers/15abb40f-daf9-4c4b-ac9c-55f57ee7b938" status: 200 len: 1558 microversion: 2.1 time: 0.167847 Nov 17 03:57:40.790637 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 1467/3058] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:57:40 2021] GET /compute/v2.1/servers/15abb40f-daf9-4c4b-ac9c-55f57ee7b938 => generated 1558 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:57:40.794846 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-23d374b1-ba93-416c-a663-9f5428435072 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:57:40.795446 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-23d374b1-ba93-416c-a663-9f5428435072 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] [instance: a49437df-3059-4528-8328-2f3471d5fb45] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:57:40.802226 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-23d374b1-ba93-416c-a663-9f5428435072 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:57:40.802669 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-23d374b1-ba93-416c-a663-9f5428435072 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:57:40.803473 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-23d374b1-ba93-416c-a663-9f5428435072 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:57:40.803904 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-23d374b1-ba93-416c-a663-9f5428435072 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:57:40.869727 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-23d374b1-ba93-416c-a663-9f5428435072 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f046401c6a04f6495ebe0821120bd72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a58e89ceeea4a9c8a72a1de4bcaf2d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:57:40.877551 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-23d374b1-ba93-416c-a663-9f5428435072 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] 10.222.0.11 "GET /compute/v2.1/servers/a49437df-3059-4528-8328-2f3471d5fb45" status: 200 len: 1352 microversion: 2.1 time: 0.085903 Nov 17 03:57:40.878061 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 1468/3059] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:57:40 2021] GET /compute/v2.1/servers/a49437df-3059-4528-8328-2f3471d5fb45 => generated 1352 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:57:41.667868 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-de1b0b58-4346-4bfe-b49a-40b3a1cb77ba tempest-VolumesNegativeTest-1679335271 tempest-VolumesNegativeTest-1679335271-project] Calling method '.version_select at 0x7f9e1d334940>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:58:22.122254 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.wsgi [None req-20a35f3b-99b8-48ba-8863-73a6192ac113 tempest-VolumesNegativeTest-1679335271 tempest-VolumesNegativeTest-1679335271-project] HTTP exception thrown: Volume 6d7eac56-10b2-4b1b-b575-bc4b537e13c0 could not be found. Nov 17 03:58:22.122882 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-20a35f3b-99b8-48ba-8863-73a6192ac113 tempest-VolumesNegativeTest-1679335271 tempest-VolumesNegativeTest-1679335271-project] Returning 404 to user: Volume 6d7eac56-10b2-4b1b-b575-bc4b537e13c0 could not be found. {{(pid=115917) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 17 03:58:22.123745 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-20a35f3b-99b8-48ba-8863-73a6192ac113 tempest-VolumesNegativeTest-1679335271 tempest-VolumesNegativeTest-1679335271-project] 10.222.0.11 "GET /compute/v2.1/os-volumes/6d7eac56-10b2-4b1b-b575-bc4b537e13c0" status: 404 len: 109 microversion: 2.1 time: 100.522617 Nov 17 03:58:22.124295 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 1592/3060] 10.222.0.11 () {58 vars in 1244 bytes} [Wed Nov 17 03:56:41 2021] GET /compute/v2.1/os-volumes/6d7eac56-10b2-4b1b-b575-bc4b537e13c0 => generated 109 bytes in 100524 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Nov 17 03:58:22.129231 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-b00d6707-135f-4334-8d98-bc1c7b8d4ad0 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:58:22.129861 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-b00d6707-135f-4334-8d98-bc1c7b8d4ad0 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] [instance: 15abb40f-daf9-4c4b-ac9c-55f57ee7b938] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:58:22.136932 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-b00d6707-135f-4334-8d98-bc1c7b8d4ad0 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:58:22.137481 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-b00d6707-135f-4334-8d98-bc1c7b8d4ad0 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:58:22.138249 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-b00d6707-135f-4334-8d98-bc1c7b8d4ad0 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:58:22.138680 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-b00d6707-135f-4334-8d98-bc1c7b8d4ad0 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:58:22.273967 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-b00d6707-135f-4334-8d98-bc1c7b8d4ad0 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a792b5b7e6f7461b8d802a5abaaa9518', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e843a3fb49f41dcb376184d7e156528', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:58:22.285460 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-b00d6707-135f-4334-8d98-bc1c7b8d4ad0 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] 10.222.0.11 "GET /compute/v2.1/servers/15abb40f-daf9-4c4b-ac9c-55f57ee7b938" status: 200 len: 1558 microversion: 2.1 time: 0.159862 Nov 17 03:58:22.286281 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 1593/3061] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:58:22 2021] GET /compute/v2.1/servers/15abb40f-daf9-4c4b-ac9c-55f57ee7b938 => generated 1558 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:58:22.290471 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-1a99cf83-9a89-4c47-80de-849d671c9a00 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:58:22.291065 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-1a99cf83-9a89-4c47-80de-849d671c9a00 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] [instance: a49437df-3059-4528-8328-2f3471d5fb45] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:58:22.297041 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-1a99cf83-9a89-4c47-80de-849d671c9a00 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:58:22.297356 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-1a99cf83-9a89-4c47-80de-849d671c9a00 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:58:22.298116 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-1a99cf83-9a89-4c47-80de-849d671c9a00 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:58:22.298550 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-1a99cf83-9a89-4c47-80de-849d671c9a00 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:58:22.357449 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-1a99cf83-9a89-4c47-80de-849d671c9a00 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f046401c6a04f6495ebe0821120bd72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a58e89ceeea4a9c8a72a1de4bcaf2d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:58:22.368156 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-1a99cf83-9a89-4c47-80de-849d671c9a00 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] 10.222.0.11 "GET /compute/v2.1/servers/a49437df-3059-4528-8328-2f3471d5fb45" status: 200 len: 1352 microversion: 2.1 time: 0.080921 Nov 17 03:58:22.368762 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 1594/3062] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:58:22 2021] GET /compute/v2.1/servers/a49437df-3059-4528-8328-2f3471d5fb45 => generated 1352 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:58:22.376297 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-79d131fa-17f3-46a9-89e5-60b8de182445 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:58:22.376866 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-79d131fa-17f3-46a9-89e5-60b8de182445 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] [instance: c934945b-ff48-414a-8910-b206a86192b9] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:58:22.383116 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-79d131fa-17f3-46a9-89e5-60b8de182445 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:58:22.383561 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-79d131fa-17f3-46a9-89e5-60b8de182445 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:58:22.384345 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-79d131fa-17f3-46a9-89e5-60b8de182445 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:58:22.384864 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-79d131fa-17f3-46a9-89e5-60b8de182445 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:58:22.410638 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-79d131fa-17f3-46a9-89e5-60b8de182445 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] [instance: c934945b-ff48-414a-8910-b206a86192b9] Going to try to terminate instance {{(pid=115917) delete /opt/stack/nova/nova/compute/api.py:2614}} Nov 17 03:58:22.498140 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-79d131fa-17f3-46a9-89e5-60b8de182445 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] 10.222.0.11 "DELETE /compute/v2.1/servers/c934945b-ff48-414a-8910-b206a86192b9" status: 204 len: 0 microversion: 2.20 time: 0.127893 Nov 17 03:58:22.498843 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 1595/3063] 10.222.0.11 () {60 vars in 1279 bytes} [Wed Nov 17 03:58:22 2021] DELETE /compute/v2.1/servers/c934945b-ff48-414a-8910-b206a86192b9 => generated 0 bytes in 129 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Nov 17 03:58:22.509728 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-003e826c-9887-4da1-acc7-59fe707c5387 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:58:22.510762 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-003e826c-9887-4da1-acc7-59fe707c5387 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] [instance: c934945b-ff48-414a-8910-b206a86192b9] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:58:22.520435 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-003e826c-9887-4da1-acc7-59fe707c5387 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:58:22.521177 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-003e826c-9887-4da1-acc7-59fe707c5387 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:58:22.522351 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-003e826c-9887-4da1-acc7-59fe707c5387 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:58:22.523008 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-003e826c-9887-4da1-acc7-59fe707c5387 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:58:22.668012 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-003e826c-9887-4da1-acc7-59fe707c5387 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37f21d6d15cf40a586edda211219fd08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ebb970305844dccacf48a7d8d47ecf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:58:22.677050 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-003e826c-9887-4da1-acc7-59fe707c5387 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '37f21d6d15cf40a586edda211219fd08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ebb970305844dccacf48a7d8d47ecf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:58:22.678536 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-003e826c-9887-4da1-acc7-59fe707c5387 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '37f21d6d15cf40a586edda211219fd08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ebb970305844dccacf48a7d8d47ecf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:58:22.679723 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-003e826c-9887-4da1-acc7-59fe707c5387 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] 10.222.0.11 "GET /compute/v2.1/servers/c934945b-ff48-414a-8910-b206a86192b9" status: 200 len: 1725 microversion: 2.20 time: 0.176309 Nov 17 03:58:22.680273 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 1596/3064] 10.222.0.11 () {60 vars in 1276 bytes} [Wed Nov 17 03:58:22 2021] GET /compute/v2.1/servers/c934945b-ff48-414a-8910-b206a86192b9 => generated 1725 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 17 03:58:23.389960 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-79190603-5d07-4bd1-8f0f-0ca741c9ca77 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:58:23.391002 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-79190603-5d07-4bd1-8f0f-0ca741c9ca77 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] [instance: a49437df-3059-4528-8328-2f3471d5fb45] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:58:23.400959 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-79190603-5d07-4bd1-8f0f-0ca741c9ca77 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:58:23.401698 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-79190603-5d07-4bd1-8f0f-0ca741c9ca77 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:58:23.402970 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-79190603-5d07-4bd1-8f0f-0ca741c9ca77 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:58:23.403673 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-79190603-5d07-4bd1-8f0f-0ca741c9ca77 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:58:23.476607 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-79190603-5d07-4bd1-8f0f-0ca741c9ca77 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f046401c6a04f6495ebe0821120bd72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a58e89ceeea4a9c8a72a1de4bcaf2d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:58:23.489486 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-79190603-5d07-4bd1-8f0f-0ca741c9ca77 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] 10.222.0.11 "GET /compute/v2.1/servers/a49437df-3059-4528-8328-2f3471d5fb45" status: 200 len: 1352 microversion: 2.1 time: 0.105928 Nov 17 03:58:23.490350 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 1597/3065] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:58:23 2021] GET /compute/v2.1/servers/a49437df-3059-4528-8328-2f3471d5fb45 => generated 1352 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:58:23.701866 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-2794f585-d204-4565-abe6-bdab9a2ff899 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:58:23.702428 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-2794f585-d204-4565-abe6-bdab9a2ff899 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] [instance: c934945b-ff48-414a-8910-b206a86192b9] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:58:23.709337 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-2794f585-d204-4565-abe6-bdab9a2ff899 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:58:23.709832 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-2794f585-d204-4565-abe6-bdab9a2ff899 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:58:23.710683 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-2794f585-d204-4565-abe6-bdab9a2ff899 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:58:23.711147 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-2794f585-d204-4565-abe6-bdab9a2ff899 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:58:23.845669 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-2794f585-d204-4565-abe6-bdab9a2ff899 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37f21d6d15cf40a586edda211219fd08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ebb970305844dccacf48a7d8d47ecf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:58:23.853730 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-2794f585-d204-4565-abe6-bdab9a2ff899 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '37f21d6d15cf40a586edda211219fd08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ebb970305844dccacf48a7d8d47ecf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:58:23.855490 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-2794f585-d204-4565-abe6-bdab9a2ff899 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '37f21d6d15cf40a586edda211219fd08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ebb970305844dccacf48a7d8d47ecf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:58:23.856944 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-2794f585-d204-4565-abe6-bdab9a2ff899 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] 10.222.0.11 "GET /compute/v2.1/servers/c934945b-ff48-414a-8910-b206a86192b9" status: 200 len: 1725 microversion: 2.20 time: 0.160732 Nov 17 03:58:23.857641 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 1598/3066] 10.222.0.11 () {60 vars in 1276 bytes} [Wed Nov 17 03:58:23 2021] GET /compute/v2.1/servers/c934945b-ff48-414a-8910-b206a86192b9 => generated 1725 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 17 03:58:24.516737 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-3c64466c-0293-4174-997d-96776df3b575 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:58:24.517852 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-3c64466c-0293-4174-997d-96776df3b575 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] [instance: a49437df-3059-4528-8328-2f3471d5fb45] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:58:24.528922 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-3c64466c-0293-4174-997d-96776df3b575 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:58:24.529753 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-3c64466c-0293-4174-997d-96776df3b575 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:58:24.531087 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-3c64466c-0293-4174-997d-96776df3b575 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:58:24.531807 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-3c64466c-0293-4174-997d-96776df3b575 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:58:24.605530 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-3c64466c-0293-4174-997d-96776df3b575 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f046401c6a04f6495ebe0821120bd72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a58e89ceeea4a9c8a72a1de4bcaf2d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:58:24.613394 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-3c64466c-0293-4174-997d-96776df3b575 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] 10.222.0.11 "GET /compute/v2.1/servers/a49437df-3059-4528-8328-2f3471d5fb45" status: 200 len: 1352 microversion: 2.1 time: 0.105728 Nov 17 03:58:24.613962 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 1599/3067] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:58:24 2021] GET /compute/v2.1/servers/a49437df-3059-4528-8328-2f3471d5fb45 => generated 1352 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:58:24.875573 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-f943327c-f703-43d9-a0a1-15fb2569d882 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:58:24.876189 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-f943327c-f703-43d9-a0a1-15fb2569d882 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] [instance: c934945b-ff48-414a-8910-b206a86192b9] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:58:24.883230 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-f943327c-f703-43d9-a0a1-15fb2569d882 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:58:24.883673 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-f943327c-f703-43d9-a0a1-15fb2569d882 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:58:24.884448 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-f943327c-f703-43d9-a0a1-15fb2569d882 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:58:24.884907 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-f943327c-f703-43d9-a0a1-15fb2569d882 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:58:24.954415 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-f943327c-f703-43d9-a0a1-15fb2569d882 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37f21d6d15cf40a586edda211219fd08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ebb970305844dccacf48a7d8d47ecf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:58:24.963967 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-f943327c-f703-43d9-a0a1-15fb2569d882 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '37f21d6d15cf40a586edda211219fd08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ebb970305844dccacf48a7d8d47ecf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:58:24.965514 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-f943327c-f703-43d9-a0a1-15fb2569d882 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '37f21d6d15cf40a586edda211219fd08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ebb970305844dccacf48a7d8d47ecf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:58:24.966830 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-f943327c-f703-43d9-a0a1-15fb2569d882 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] 10.222.0.11 "GET /compute/v2.1/servers/c934945b-ff48-414a-8910-b206a86192b9" status: 200 len: 1657 microversion: 2.20 time: 0.095043 Nov 17 03:58:24.967390 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 1600/3068] 10.222.0.11 () {60 vars in 1276 bytes} [Wed Nov 17 03:58:24 2021] GET /compute/v2.1/servers/c934945b-ff48-414a-8910-b206a86192b9 => generated 1657 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 17 03:58:24.982820 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [req-0062c948-5a80-4c27-8383-acc7b86c7cb0 req-2b268bf4-27f8-4ed7-a2c1-b135837c9034 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c934945b-ff48-414a-8910-b206a86192b9", "name": "network-vif-deleted", "tag": "6c4379b9-2465-4b23-9d1c-06f2cb7a27c4"}]} {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 17 03:58:24.984395 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 17 03:58:24.984395 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: warnings.warn(msg) Nov 17 03:58:24.992249 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [req-0062c948-5a80-4c27-8383-acc7b86c7cb0 req-2b268bf4-27f8-4ed7-a2c1-b135837c9034 service nova] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:58:24.992679 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [req-0062c948-5a80-4c27-8383-acc7b86c7cb0 req-2b268bf4-27f8-4ed7-a2c1-b135837c9034 service nova] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:58:25.005801 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.compute.server_external_events [req-0062c948-5a80-4c27-8383-acc7b86c7cb0 req-2b268bf4-27f8-4ed7-a2c1-b135837c9034 service nova] Creating event network-vif-deleted:6c4379b9-2465-4b23-9d1c-06f2cb7a27c4 for instance c934945b-ff48-414a-8910-b206a86192b9 on hv-cinder-81803 Nov 17 03:58:25.011306 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [req-0062c948-5a80-4c27-8383-acc7b86c7cb0 req-2b268bf4-27f8-4ed7-a2c1-b135837c9034 service nova] 10.222.0.11 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032108 Nov 17 03:58:25.012265 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 1601/3069] 10.222.0.11 () {64 vars in 1317 bytes} [Wed Nov 17 03:58:24 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 17 03:58:25.632105 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-4dce0f8a-4995-4908-b036-76c533975cc7 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:58:25.632845 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-4dce0f8a-4995-4908-b036-76c533975cc7 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] [instance: a49437df-3059-4528-8328-2f3471d5fb45] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:58:25.639853 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-4dce0f8a-4995-4908-b036-76c533975cc7 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:58:25.640270 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-4dce0f8a-4995-4908-b036-76c533975cc7 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:58:25.641143 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-4dce0f8a-4995-4908-b036-76c533975cc7 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:58:25.641580 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-4dce0f8a-4995-4908-b036-76c533975cc7 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:58:25.704132 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-4dce0f8a-4995-4908-b036-76c533975cc7 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f046401c6a04f6495ebe0821120bd72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a58e89ceeea4a9c8a72a1de4bcaf2d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:58:25.712578 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-4dce0f8a-4995-4908-b036-76c533975cc7 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] 10.222.0.11 "GET /compute/v2.1/servers/a49437df-3059-4528-8328-2f3471d5fb45" status: 200 len: 1352 microversion: 2.1 time: 0.085214 Nov 17 03:58:25.713468 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 1602/3070] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:58:25 2021] GET /compute/v2.1/servers/a49437df-3059-4528-8328-2f3471d5fb45 => generated 1352 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:58:25.984954 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-19762537-ac0a-470e-9e5d-6a126657fda9 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:58:25.985649 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-19762537-ac0a-470e-9e5d-6a126657fda9 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] [instance: c934945b-ff48-414a-8910-b206a86192b9] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:58:25.992061 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-19762537-ac0a-470e-9e5d-6a126657fda9 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:58:25.992575 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-19762537-ac0a-470e-9e5d-6a126657fda9 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:58:25.993382 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-19762537-ac0a-470e-9e5d-6a126657fda9 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:58:25.993810 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-19762537-ac0a-470e-9e5d-6a126657fda9 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:58:26.007131 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.wsgi [None req-19762537-ac0a-470e-9e5d-6a126657fda9 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] HTTP exception thrown: Instance c934945b-ff48-414a-8910-b206a86192b9 could not be found. Nov 17 03:58:26.007721 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-19762537-ac0a-470e-9e5d-6a126657fda9 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Returning 404 to user: Instance c934945b-ff48-414a-8910-b206a86192b9 could not be found. {{(pid=115917) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 17 03:58:26.008859 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-19762537-ac0a-470e-9e5d-6a126657fda9 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] 10.222.0.11 "GET /compute/v2.1/servers/c934945b-ff48-414a-8910-b206a86192b9" status: 404 len: 111 microversion: 2.20 time: 0.027589 Nov 17 03:58:26.009132 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 1603/3071] 10.222.0.11 () {60 vars in 1276 bytes} [Wed Nov 17 03:58:25 2021] GET /compute/v2.1/servers/c934945b-ff48-414a-8910-b206a86192b9 => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Nov 17 03:58:26.017245 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-d1597105-dc63-4beb-a67c-242729a41884 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Calling method '.version_select at 0x7f9e1d023040>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:58:26.040529 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-d1597105-dc63-4beb-a67c-242729a41884 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] 10.222.0.11 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1721301701" status: 204 len: 0 microversion: 2.20 time: 0.026657 Nov 17 03:58:26.041146 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 1604/3072] 10.222.0.11 () {60 vars in 1261 bytes} [Wed Nov 17 03:58:26 2021] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1721301701 => generated 0 bytes in 28 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Nov 17 03:58:26.703663 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-2cf90429-d636-415e-bb06-76afcf2f8aed tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:58:26.704335 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-2cf90429-d636-415e-bb06-76afcf2f8aed tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] [instance: c934945b-ff48-414a-8910-b206a86192b9] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:58:26.710764 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-2cf90429-d636-415e-bb06-76afcf2f8aed tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:58:26.711213 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-2cf90429-d636-415e-bb06-76afcf2f8aed tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:58:26.711985 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-2cf90429-d636-415e-bb06-76afcf2f8aed tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:58:26.712407 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-2cf90429-d636-415e-bb06-76afcf2f8aed tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:58:26.725257 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.wsgi [None req-2cf90429-d636-415e-bb06-76afcf2f8aed tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] HTTP exception thrown: Instance c934945b-ff48-414a-8910-b206a86192b9 could not be found. Nov 17 03:58:26.725864 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-2cf90429-d636-415e-bb06-76afcf2f8aed tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Returning 404 to user: Instance c934945b-ff48-414a-8910-b206a86192b9 could not be found. {{(pid=115917) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 17 03:58:26.726684 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-2cf90429-d636-415e-bb06-76afcf2f8aed tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] 10.222.0.11 "DELETE /compute/v2.1/servers/c934945b-ff48-414a-8910-b206a86192b9" status: 404 len: 111 microversion: 2.1 time: 0.028943 Nov 17 03:58:26.727191 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 1605/3073] 10.222.0.11 () {58 vars in 1238 bytes} [Wed Nov 17 03:58:26 2021] DELETE /compute/v2.1/servers/c934945b-ff48-414a-8910-b206a86192b9 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 17 03:58:26.731657 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-c7847044-7963-4524-9446-184fec38457a tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:58:26.732476 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-c7847044-7963-4524-9446-184fec38457a tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] [instance: a49437df-3059-4528-8328-2f3471d5fb45] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:58:26.738505 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-c7847044-7963-4524-9446-184fec38457a tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:58:26.738952 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-c7847044-7963-4524-9446-184fec38457a tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:58:26.739724 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-c7847044-7963-4524-9446-184fec38457a tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:58:26.740156 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-c7847044-7963-4524-9446-184fec38457a tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:58:26.802948 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-c7847044-7963-4524-9446-184fec38457a tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f046401c6a04f6495ebe0821120bd72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a58e89ceeea4a9c8a72a1de4bcaf2d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:58:26.811453 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-c7847044-7963-4524-9446-184fec38457a tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] 10.222.0.11 "GET /compute/v2.1/servers/a49437df-3059-4528-8328-2f3471d5fb45" status: 200 len: 1352 microversion: 2.1 time: 0.083324 Nov 17 03:58:26.812027 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 1606/3074] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:58:26 2021] GET /compute/v2.1/servers/a49437df-3059-4528-8328-2f3471d5fb45 => generated 1352 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:58:26.816131 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-44f43995-cf01-4a01-9ff8-e1b32ac1b1cc tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:58:26.816720 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-44f43995-cf01-4a01-9ff8-e1b32ac1b1cc tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] [instance: c934945b-ff48-414a-8910-b206a86192b9] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:58:26.822920 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-44f43995-cf01-4a01-9ff8-e1b32ac1b1cc tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:58:26.823360 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-44f43995-cf01-4a01-9ff8-e1b32ac1b1cc tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:58:26.824122 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-44f43995-cf01-4a01-9ff8-e1b32ac1b1cc tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:58:26.824574 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-44f43995-cf01-4a01-9ff8-e1b32ac1b1cc tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:58:26.838046 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.wsgi [None req-44f43995-cf01-4a01-9ff8-e1b32ac1b1cc tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] HTTP exception thrown: Instance c934945b-ff48-414a-8910-b206a86192b9 could not be found. Nov 17 03:58:26.838625 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-44f43995-cf01-4a01-9ff8-e1b32ac1b1cc tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Returning 404 to user: Instance c934945b-ff48-414a-8910-b206a86192b9 could not be found. {{(pid=115917) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 17 03:58:26.839428 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-44f43995-cf01-4a01-9ff8-e1b32ac1b1cc tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] 10.222.0.11 "GET /compute/v2.1/servers/c934945b-ff48-414a-8910-b206a86192b9" status: 404 len: 111 microversion: 2.1 time: 0.026516 Nov 17 03:58:26.839946 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 1607/3075] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:58:26 2021] GET /compute/v2.1/servers/c934945b-ff48-414a-8910-b206a86192b9 => generated 111 bytes in 27 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 17 03:58:27.832732 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-87c9b576-e066-4aa5-9ccb-18dd32af1fed tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:58:27.833780 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-87c9b576-e066-4aa5-9ccb-18dd32af1fed tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] [instance: a49437df-3059-4528-8328-2f3471d5fb45] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:58:27.843039 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-87c9b576-e066-4aa5-9ccb-18dd32af1fed tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:58:27.843489 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-87c9b576-e066-4aa5-9ccb-18dd32af1fed tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:58:27.844263 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-87c9b576-e066-4aa5-9ccb-18dd32af1fed tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:58:27.844705 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-87c9b576-e066-4aa5-9ccb-18dd32af1fed tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:58:27.912421 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-87c9b576-e066-4aa5-9ccb-18dd32af1fed tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f046401c6a04f6495ebe0821120bd72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a58e89ceeea4a9c8a72a1de4bcaf2d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:58:27.920754 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-87c9b576-e066-4aa5-9ccb-18dd32af1fed tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] 10.222.0.11 "GET /compute/v2.1/servers/a49437df-3059-4528-8328-2f3471d5fb45" status: 200 len: 1352 microversion: 2.1 time: 0.094632 Nov 17 03:58:27.921355 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 1608/3076] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:58:27 2021] GET /compute/v2.1/servers/a49437df-3059-4528-8328-2f3471d5fb45 => generated 1352 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:58:28.942049 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-27b15075-305d-4429-b9a1-a69676a05361 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:58:28.943184 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-27b15075-305d-4429-b9a1-a69676a05361 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] [instance: a49437df-3059-4528-8328-2f3471d5fb45] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:58:28.952868 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-27b15075-305d-4429-b9a1-a69676a05361 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:58:28.953403 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-27b15075-305d-4429-b9a1-a69676a05361 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:58:28.954173 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-27b15075-305d-4429-b9a1-a69676a05361 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:58:28.954609 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-27b15075-305d-4429-b9a1-a69676a05361 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:58:29.020827 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-27b15075-305d-4429-b9a1-a69676a05361 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f046401c6a04f6495ebe0821120bd72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a58e89ceeea4a9c8a72a1de4bcaf2d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:58:29.028832 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-27b15075-305d-4429-b9a1-a69676a05361 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] 10.222.0.11 "GET /compute/v2.1/servers/a49437df-3059-4528-8328-2f3471d5fb45" status: 200 len: 1352 microversion: 2.1 time: 0.093261 Nov 17 03:58:29.029473 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 1609/3077] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:58:28 2021] GET /compute/v2.1/servers/a49437df-3059-4528-8328-2f3471d5fb45 => generated 1352 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:58:30.053933 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-e6d48be0-b86f-48ac-a523-5f6fb8945581 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:58:30.054845 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-e6d48be0-b86f-48ac-a523-5f6fb8945581 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] [instance: a49437df-3059-4528-8328-2f3471d5fb45] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:58:30.063248 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-e6d48be0-b86f-48ac-a523-5f6fb8945581 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:58:30.063693 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-e6d48be0-b86f-48ac-a523-5f6fb8945581 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:58:30.064463 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-e6d48be0-b86f-48ac-a523-5f6fb8945581 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:58:30.064899 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-e6d48be0-b86f-48ac-a523-5f6fb8945581 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:58:30.135351 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-e6d48be0-b86f-48ac-a523-5f6fb8945581 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f046401c6a04f6495ebe0821120bd72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a58e89ceeea4a9c8a72a1de4bcaf2d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:58:30.143356 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-e6d48be0-b86f-48ac-a523-5f6fb8945581 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] 10.222.0.11 "GET /compute/v2.1/servers/a49437df-3059-4528-8328-2f3471d5fb45" status: 200 len: 1352 microversion: 2.1 time: 0.097420 Nov 17 03:58:30.143913 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 1610/3078] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:58:30 2021] GET /compute/v2.1/servers/a49437df-3059-4528-8328-2f3471d5fb45 => generated 1352 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:58:31.164397 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-46095229-fc01-49d7-b241-4f9420d2ac0f tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:58:31.165468 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-46095229-fc01-49d7-b241-4f9420d2ac0f tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] [instance: a49437df-3059-4528-8328-2f3471d5fb45] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:58:31.173993 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-46095229-fc01-49d7-b241-4f9420d2ac0f tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:58:31.174443 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-46095229-fc01-49d7-b241-4f9420d2ac0f tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:58:31.175208 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-46095229-fc01-49d7-b241-4f9420d2ac0f tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:58:31.175998 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-46095229-fc01-49d7-b241-4f9420d2ac0f tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:58:31.245333 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-46095229-fc01-49d7-b241-4f9420d2ac0f tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f046401c6a04f6495ebe0821120bd72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a58e89ceeea4a9c8a72a1de4bcaf2d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:58:31.253398 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-46095229-fc01-49d7-b241-4f9420d2ac0f tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] 10.222.0.11 "GET /compute/v2.1/servers/a49437df-3059-4528-8328-2f3471d5fb45" status: 200 len: 1352 microversion: 2.1 time: 0.095130 Nov 17 03:58:31.253934 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 1611/3079] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:58:31 2021] GET /compute/v2.1/servers/a49437df-3059-4528-8328-2f3471d5fb45 => generated 1352 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:58:32.271168 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-fa2e62db-ae0b-43db-8511-e9850a3fca62 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:58:32.272031 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-fa2e62db-ae0b-43db-8511-e9850a3fca62 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] [instance: a49437df-3059-4528-8328-2f3471d5fb45] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:58:32.280156 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-fa2e62db-ae0b-43db-8511-e9850a3fca62 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:58:32.280721 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-fa2e62db-ae0b-43db-8511-e9850a3fca62 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:58:32.281667 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-fa2e62db-ae0b-43db-8511-e9850a3fca62 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:58:32.282098 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-fa2e62db-ae0b-43db-8511-e9850a3fca62 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:58:32.353772 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-fa2e62db-ae0b-43db-8511-e9850a3fca62 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f046401c6a04f6495ebe0821120bd72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a58e89ceeea4a9c8a72a1de4bcaf2d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:58:32.364273 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-fa2e62db-ae0b-43db-8511-e9850a3fca62 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] 10.222.0.11 "GET /compute/v2.1/servers/a49437df-3059-4528-8328-2f3471d5fb45" status: 200 len: 1352 microversion: 2.1 time: 0.097757 Nov 17 03:58:32.364833 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 1612/3080] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:58:32 2021] GET /compute/v2.1/servers/a49437df-3059-4528-8328-2f3471d5fb45 => generated 1352 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:58:33.385925 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-11e5177e-1520-4b4c-bdc4-6967fbb875df tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:58:33.386930 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-11e5177e-1520-4b4c-bdc4-6967fbb875df tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] [instance: a49437df-3059-4528-8328-2f3471d5fb45] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:58:33.394974 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-11e5177e-1520-4b4c-bdc4-6967fbb875df tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:58:33.395428 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-11e5177e-1520-4b4c-bdc4-6967fbb875df tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:58:33.396199 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-11e5177e-1520-4b4c-bdc4-6967fbb875df tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:58:33.396636 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-11e5177e-1520-4b4c-bdc4-6967fbb875df tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:58:33.474467 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-11e5177e-1520-4b4c-bdc4-6967fbb875df tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f046401c6a04f6495ebe0821120bd72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a58e89ceeea4a9c8a72a1de4bcaf2d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:58:33.486265 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-11e5177e-1520-4b4c-bdc4-6967fbb875df tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] 10.222.0.11 "GET /compute/v2.1/servers/a49437df-3059-4528-8328-2f3471d5fb45" status: 200 len: 1352 microversion: 2.1 time: 0.106775 Nov 17 03:58:33.486829 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 1613/3081] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:58:33 2021] GET /compute/v2.1/servers/a49437df-3059-4528-8328-2f3471d5fb45 => generated 1352 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:58:34.507535 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-22a6dc2f-8bb7-4ff4-acc6-573e263a4ea3 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:58:34.508601 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-22a6dc2f-8bb7-4ff4-acc6-573e263a4ea3 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] [instance: a49437df-3059-4528-8328-2f3471d5fb45] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:58:34.519219 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-22a6dc2f-8bb7-4ff4-acc6-573e263a4ea3 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:58:34.519968 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-22a6dc2f-8bb7-4ff4-acc6-573e263a4ea3 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:58:34.521306 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-22a6dc2f-8bb7-4ff4-acc6-573e263a4ea3 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:58:34.522033 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-22a6dc2f-8bb7-4ff4-acc6-573e263a4ea3 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:58:34.587701 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-22a6dc2f-8bb7-4ff4-acc6-573e263a4ea3 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f046401c6a04f6495ebe0821120bd72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a58e89ceeea4a9c8a72a1de4bcaf2d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:58:34.597490 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-22a6dc2f-8bb7-4ff4-acc6-573e263a4ea3 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] 10.222.0.11 "GET /compute/v2.1/servers/a49437df-3059-4528-8328-2f3471d5fb45" status: 200 len: 1352 microversion: 2.1 time: 0.096343 Nov 17 03:58:34.598061 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 1614/3082] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:58:34 2021] GET /compute/v2.1/servers/a49437df-3059-4528-8328-2f3471d5fb45 => generated 1352 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 17 03:58:35.618649 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-30b5d82c-7ecf-4532-9c56-6917336cc762 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:58:35.619776 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-30b5d82c-7ecf-4532-9c56-6917336cc762 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] [instance: a49437df-3059-4528-8328-2f3471d5fb45] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:58:35.630275 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-30b5d82c-7ecf-4532-9c56-6917336cc762 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:58:35.631020 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-30b5d82c-7ecf-4532-9c56-6917336cc762 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:58:35.632295 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-30b5d82c-7ecf-4532-9c56-6917336cc762 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:58:35.633074 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-30b5d82c-7ecf-4532-9c56-6917336cc762 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:58:35.696902 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-30b5d82c-7ecf-4532-9c56-6917336cc762 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f046401c6a04f6495ebe0821120bd72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a58e89ceeea4a9c8a72a1de4bcaf2d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:58:35.705303 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-30b5d82c-7ecf-4532-9c56-6917336cc762 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] 10.222.0.11 "GET /compute/v2.1/servers/a49437df-3059-4528-8328-2f3471d5fb45" status: 200 len: 1352 microversion: 2.1 time: 0.092897 Nov 17 03:58:35.705866 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 1615/3083] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:58:35 2021] GET /compute/v2.1/servers/a49437df-3059-4528-8328-2f3471d5fb45 => generated 1352 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:58:36.723602 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-fe9b6e33-9e34-4192-b93c-fbab5a450038 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:58:36.724287 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-fe9b6e33-9e34-4192-b93c-fbab5a450038 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] [instance: a49437df-3059-4528-8328-2f3471d5fb45] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:58:36.730793 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-fe9b6e33-9e34-4192-b93c-fbab5a450038 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:58:36.731254 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-fe9b6e33-9e34-4192-b93c-fbab5a450038 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:58:36.732027 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-fe9b6e33-9e34-4192-b93c-fbab5a450038 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:58:36.732473 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-fe9b6e33-9e34-4192-b93c-fbab5a450038 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:58:36.793180 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-fe9b6e33-9e34-4192-b93c-fbab5a450038 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f046401c6a04f6495ebe0821120bd72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a58e89ceeea4a9c8a72a1de4bcaf2d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:58:36.801608 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-fe9b6e33-9e34-4192-b93c-fbab5a450038 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] 10.222.0.11 "GET /compute/v2.1/servers/a49437df-3059-4528-8328-2f3471d5fb45" status: 200 len: 1352 microversion: 2.1 time: 0.081804 Nov 17 03:58:36.802192 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 1616/3084] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:58:36 2021] GET /compute/v2.1/servers/a49437df-3059-4528-8328-2f3471d5fb45 => generated 1352 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:58:37.831829 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-46642f68-ca4d-4d28-a422-315b4b731b77 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:58:37.832729 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-46642f68-ca4d-4d28-a422-315b4b731b77 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] [instance: a49437df-3059-4528-8328-2f3471d5fb45] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:58:37.841348 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-46642f68-ca4d-4d28-a422-315b4b731b77 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:58:37.841955 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-46642f68-ca4d-4d28-a422-315b4b731b77 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:58:37.842991 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-46642f68-ca4d-4d28-a422-315b4b731b77 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:58:37.843614 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-46642f68-ca4d-4d28-a422-315b4b731b77 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:58:37.907233 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-46642f68-ca4d-4d28-a422-315b4b731b77 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f046401c6a04f6495ebe0821120bd72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a58e89ceeea4a9c8a72a1de4bcaf2d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:58:37.916065 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-46642f68-ca4d-4d28-a422-315b4b731b77 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] 10.222.0.11 "GET /compute/v2.1/servers/a49437df-3059-4528-8328-2f3471d5fb45" status: 200 len: 1352 microversion: 2.1 time: 0.096108 Nov 17 03:58:37.916768 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 1617/3085] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:58:37 2021] GET /compute/v2.1/servers/a49437df-3059-4528-8328-2f3471d5fb45 => generated 1352 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 17 03:58:38.937782 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-543315fa-7ac6-46ef-9279-1933ef03d52b tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:58:38.938551 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-543315fa-7ac6-46ef-9279-1933ef03d52b tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] [instance: a49437df-3059-4528-8328-2f3471d5fb45] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:58:38.945708 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-543315fa-7ac6-46ef-9279-1933ef03d52b tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:58:38.946179 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-543315fa-7ac6-46ef-9279-1933ef03d52b tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:58:38.946985 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-543315fa-7ac6-46ef-9279-1933ef03d52b tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:58:38.947439 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-543315fa-7ac6-46ef-9279-1933ef03d52b tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:58:39.016671 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-543315fa-7ac6-46ef-9279-1933ef03d52b tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f046401c6a04f6495ebe0821120bd72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a58e89ceeea4a9c8a72a1de4bcaf2d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:58:39.025256 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-543315fa-7ac6-46ef-9279-1933ef03d52b tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] 10.222.0.11 "GET /compute/v2.1/servers/a49437df-3059-4528-8328-2f3471d5fb45" status: 200 len: 1352 microversion: 2.1 time: 0.093437 Nov 17 03:58:39.025838 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 1618/3086] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:58:38 2021] GET /compute/v2.1/servers/a49437df-3059-4528-8328-2f3471d5fb45 => generated 1352 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:58:40.042341 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-01853cd7-704c-4e2e-812a-14ae94d8e0ce tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:58:40.042906 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-01853cd7-704c-4e2e-812a-14ae94d8e0ce tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] [instance: a49437df-3059-4528-8328-2f3471d5fb45] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:58:40.049417 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-01853cd7-704c-4e2e-812a-14ae94d8e0ce tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:58:40.049873 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-01853cd7-704c-4e2e-812a-14ae94d8e0ce tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:58:40.051018 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-01853cd7-704c-4e2e-812a-14ae94d8e0ce tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:58:40.051452 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-01853cd7-704c-4e2e-812a-14ae94d8e0ce tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:58:40.115723 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-01853cd7-704c-4e2e-812a-14ae94d8e0ce tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f046401c6a04f6495ebe0821120bd72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a58e89ceeea4a9c8a72a1de4bcaf2d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:58:40.124940 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-01853cd7-704c-4e2e-812a-14ae94d8e0ce tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] 10.222.0.11 "GET /compute/v2.1/servers/a49437df-3059-4528-8328-2f3471d5fb45" status: 200 len: 1352 microversion: 2.1 time: 0.086243 Nov 17 03:58:40.125795 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 1619/3087] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:58:40 2021] GET /compute/v2.1/servers/a49437df-3059-4528-8328-2f3471d5fb45 => generated 1352 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:58:41.146243 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-48f8c2d7-29c8-4786-8d59-5669523b3b86 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:58:41.147207 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-48f8c2d7-29c8-4786-8d59-5669523b3b86 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] [instance: a49437df-3059-4528-8328-2f3471d5fb45] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:58:41.157310 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-48f8c2d7-29c8-4786-8d59-5669523b3b86 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:58:41.157749 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-48f8c2d7-29c8-4786-8d59-5669523b3b86 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:58:41.158514 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-48f8c2d7-29c8-4786-8d59-5669523b3b86 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:58:41.158950 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-48f8c2d7-29c8-4786-8d59-5669523b3b86 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:58:41.219569 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-48f8c2d7-29c8-4786-8d59-5669523b3b86 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f046401c6a04f6495ebe0821120bd72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a58e89ceeea4a9c8a72a1de4bcaf2d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:58:41.227474 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-48f8c2d7-29c8-4786-8d59-5669523b3b86 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] 10.222.0.11 "GET /compute/v2.1/servers/a49437df-3059-4528-8328-2f3471d5fb45" status: 200 len: 1352 microversion: 2.1 time: 0.087934 Nov 17 03:58:41.228040 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 1620/3088] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:58:41 2021] GET /compute/v2.1/servers/a49437df-3059-4528-8328-2f3471d5fb45 => generated 1352 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:58:41.727396 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-c13ea38b-68eb-48a9-8f04-285ba8d7f5fa tempest-VolumesNegativeTest-1679335271 tempest-VolumesNegativeTest-1679335271-project] Calling method '.version_select at 0x7f9e1d98c430>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:58:41.945593 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.wsgi [None req-de1b0b58-4346-4bfe-b49a-40b3a1cb77ba tempest-VolumesNegativeTest-1679335271 tempest-VolumesNegativeTest-1679335271-project] HTTP exception thrown: Volume 6d7eac56-10b2-4b1b-b575-bc4b537e13c0 could not be found. Nov 17 03:58:41.946358 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-de1b0b58-4346-4bfe-b49a-40b3a1cb77ba tempest-VolumesNegativeTest-1679335271 tempest-VolumesNegativeTest-1679335271-project] Returning 404 to user: Volume 6d7eac56-10b2-4b1b-b575-bc4b537e13c0 could not be found. {{(pid=115916) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 17 03:58:41.947588 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-de1b0b58-4346-4bfe-b49a-40b3a1cb77ba tempest-VolumesNegativeTest-1679335271 tempest-VolumesNegativeTest-1679335271-project] 10.222.0.11 "GET /compute/v2.1/os-volumes/6d7eac56-10b2-4b1b-b575-bc4b537e13c0" status: 404 len: 109 microversion: 2.1 time: 60.285639 Nov 17 03:58:41.948314 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 1469/3089] 10.222.0.11 () {58 vars in 1244 bytes} [Wed Nov 17 03:57:41 2021] GET /compute/v2.1/os-volumes/6d7eac56-10b2-4b1b-b575-bc4b537e13c0 => generated 109 bytes in 60288 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 17 03:58:42.249433 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-995f944a-7be1-4179-b171-0222fdaaa54d tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:58:42.250557 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-995f944a-7be1-4179-b171-0222fdaaa54d tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] [instance: a49437df-3059-4528-8328-2f3471d5fb45] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:58:42.257524 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-995f944a-7be1-4179-b171-0222fdaaa54d tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:58:42.258026 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-995f944a-7be1-4179-b171-0222fdaaa54d tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:58:42.258883 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-995f944a-7be1-4179-b171-0222fdaaa54d tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:58:42.259362 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-995f944a-7be1-4179-b171-0222fdaaa54d tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:58:42.322589 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-995f944a-7be1-4179-b171-0222fdaaa54d tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f046401c6a04f6495ebe0821120bd72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a58e89ceeea4a9c8a72a1de4bcaf2d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:58:42.330654 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-995f944a-7be1-4179-b171-0222fdaaa54d tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] 10.222.0.11 "GET /compute/v2.1/servers/a49437df-3059-4528-8328-2f3471d5fb45" status: 200 len: 1352 microversion: 2.1 time: 0.088694 Nov 17 03:58:42.331211 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 1470/3090] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:58:42 2021] GET /compute/v2.1/servers/a49437df-3059-4528-8328-2f3471d5fb45 => generated 1352 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:58:43.350902 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-063f5dbe-2c63-4fad-a431-19cb92fb1516 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:58:43.353118 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-063f5dbe-2c63-4fad-a431-19cb92fb1516 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] [instance: a49437df-3059-4528-8328-2f3471d5fb45] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:58:43.362468 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-063f5dbe-2c63-4fad-a431-19cb92fb1516 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:58:43.362923 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-063f5dbe-2c63-4fad-a431-19cb92fb1516 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:58:43.363706 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-063f5dbe-2c63-4fad-a431-19cb92fb1516 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:58:43.364139 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-063f5dbe-2c63-4fad-a431-19cb92fb1516 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:58:43.430819 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-063f5dbe-2c63-4fad-a431-19cb92fb1516 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f046401c6a04f6495ebe0821120bd72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a58e89ceeea4a9c8a72a1de4bcaf2d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:58:43.439637 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-063f5dbe-2c63-4fad-a431-19cb92fb1516 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] 10.222.0.11 "GET /compute/v2.1/servers/a49437df-3059-4528-8328-2f3471d5fb45" status: 200 len: 1352 microversion: 2.1 time: 0.094877 Nov 17 03:58:43.440203 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 1471/3091] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:58:43 2021] GET /compute/v2.1/servers/a49437df-3059-4528-8328-2f3471d5fb45 => generated 1352 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:58:44.460371 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-e69099c5-f46e-45a3-b1b0-b6fa1d96cb58 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:58:44.461450 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-e69099c5-f46e-45a3-b1b0-b6fa1d96cb58 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] [instance: a49437df-3059-4528-8328-2f3471d5fb45] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:58:44.470551 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-e69099c5-f46e-45a3-b1b0-b6fa1d96cb58 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:58:44.471008 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-e69099c5-f46e-45a3-b1b0-b6fa1d96cb58 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:58:44.471788 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-e69099c5-f46e-45a3-b1b0-b6fa1d96cb58 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:58:44.472225 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-e69099c5-f46e-45a3-b1b0-b6fa1d96cb58 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:58:44.536877 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-e69099c5-f46e-45a3-b1b0-b6fa1d96cb58 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f046401c6a04f6495ebe0821120bd72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a58e89ceeea4a9c8a72a1de4bcaf2d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:58:44.545785 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-e69099c5-f46e-45a3-b1b0-b6fa1d96cb58 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] 10.222.0.11 "GET /compute/v2.1/servers/a49437df-3059-4528-8328-2f3471d5fb45" status: 200 len: 1352 microversion: 2.1 time: 0.091529 Nov 17 03:58:44.546366 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 1472/3092] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:58:44 2021] GET /compute/v2.1/servers/a49437df-3059-4528-8328-2f3471d5fb45 => generated 1352 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:58:45.567261 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-4b0f4f10-a1ca-4020-90cc-431b48a0293d tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:58:45.568353 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-4b0f4f10-a1ca-4020-90cc-431b48a0293d tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] [instance: a49437df-3059-4528-8328-2f3471d5fb45] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:58:45.578901 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-4b0f4f10-a1ca-4020-90cc-431b48a0293d tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:58:45.579355 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-4b0f4f10-a1ca-4020-90cc-431b48a0293d tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:58:45.580179 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-4b0f4f10-a1ca-4020-90cc-431b48a0293d tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:58:45.580614 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-4b0f4f10-a1ca-4020-90cc-431b48a0293d tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:58:45.650722 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-4b0f4f10-a1ca-4020-90cc-431b48a0293d tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f046401c6a04f6495ebe0821120bd72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a58e89ceeea4a9c8a72a1de4bcaf2d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:58:45.659182 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-4b0f4f10-a1ca-4020-90cc-431b48a0293d tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] 10.222.0.11 "GET /compute/v2.1/servers/a49437df-3059-4528-8328-2f3471d5fb45" status: 200 len: 1352 microversion: 2.1 time: 0.098040 Nov 17 03:58:45.659973 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 1473/3093] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:58:45 2021] GET /compute/v2.1/servers/a49437df-3059-4528-8328-2f3471d5fb45 => generated 1352 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:58:46.679586 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-10030c9a-7f0a-4743-b6c1-beeb77c13cd3 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:58:46.680667 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-10030c9a-7f0a-4743-b6c1-beeb77c13cd3 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] [instance: a49437df-3059-4528-8328-2f3471d5fb45] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:58:46.690009 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-10030c9a-7f0a-4743-b6c1-beeb77c13cd3 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:58:46.690460 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-10030c9a-7f0a-4743-b6c1-beeb77c13cd3 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:58:46.691234 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-10030c9a-7f0a-4743-b6c1-beeb77c13cd3 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:58:46.691675 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-10030c9a-7f0a-4743-b6c1-beeb77c13cd3 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:58:46.751157 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-10030c9a-7f0a-4743-b6c1-beeb77c13cd3 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f046401c6a04f6495ebe0821120bd72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a58e89ceeea4a9c8a72a1de4bcaf2d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:58:46.759654 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-10030c9a-7f0a-4743-b6c1-beeb77c13cd3 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] 10.222.0.11 "GET /compute/v2.1/servers/a49437df-3059-4528-8328-2f3471d5fb45" status: 200 len: 1352 microversion: 2.1 time: 0.086706 Nov 17 03:58:46.760264 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 1474/3094] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:58:46 2021] GET /compute/v2.1/servers/a49437df-3059-4528-8328-2f3471d5fb45 => generated 1352 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:58:47.782981 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-31a53d9f-6f32-4dfc-9d3d-961432e09e5b tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:58:47.783725 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-31a53d9f-6f32-4dfc-9d3d-961432e09e5b tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] [instance: a49437df-3059-4528-8328-2f3471d5fb45] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:58:47.792020 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-31a53d9f-6f32-4dfc-9d3d-961432e09e5b tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:58:47.792466 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-31a53d9f-6f32-4dfc-9d3d-961432e09e5b tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:58:47.793282 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-31a53d9f-6f32-4dfc-9d3d-961432e09e5b tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:58:47.793745 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-31a53d9f-6f32-4dfc-9d3d-961432e09e5b tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:58:47.871491 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-31a53d9f-6f32-4dfc-9d3d-961432e09e5b tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f046401c6a04f6495ebe0821120bd72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a58e89ceeea4a9c8a72a1de4bcaf2d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:58:47.882115 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-31a53d9f-6f32-4dfc-9d3d-961432e09e5b tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] 10.222.0.11 "GET /compute/v2.1/servers/a49437df-3059-4528-8328-2f3471d5fb45" status: 200 len: 1352 microversion: 2.1 time: 0.104187 Nov 17 03:58:47.883111 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 1475/3095] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:58:47 2021] GET /compute/v2.1/servers/a49437df-3059-4528-8328-2f3471d5fb45 => generated 1352 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:58:48.904256 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-ecaf7b70-6879-4b27-9f3e-b7a35b66856f tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:58:48.905447 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-ecaf7b70-6879-4b27-9f3e-b7a35b66856f tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] [instance: a49437df-3059-4528-8328-2f3471d5fb45] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:58:48.912963 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-ecaf7b70-6879-4b27-9f3e-b7a35b66856f tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:58:48.913441 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-ecaf7b70-6879-4b27-9f3e-b7a35b66856f tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:58:48.914245 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-ecaf7b70-6879-4b27-9f3e-b7a35b66856f tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:58:48.914700 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-ecaf7b70-6879-4b27-9f3e-b7a35b66856f tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:58:48.976570 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-ecaf7b70-6879-4b27-9f3e-b7a35b66856f tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f046401c6a04f6495ebe0821120bd72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a58e89ceeea4a9c8a72a1de4bcaf2d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:58:48.984931 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-ecaf7b70-6879-4b27-9f3e-b7a35b66856f tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] 10.222.0.11 "GET /compute/v2.1/servers/a49437df-3059-4528-8328-2f3471d5fb45" status: 200 len: 1352 microversion: 2.1 time: 0.086909 Nov 17 03:58:48.985463 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 1476/3096] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:58:48 2021] GET /compute/v2.1/servers/a49437df-3059-4528-8328-2f3471d5fb45 => generated 1352 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:58:50.006047 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-4dca41b9-6fce-4481-b35f-b305ea18d71e tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:58:50.007175 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-4dca41b9-6fce-4481-b35f-b305ea18d71e tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] [instance: a49437df-3059-4528-8328-2f3471d5fb45] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:58:50.017563 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-4dca41b9-6fce-4481-b35f-b305ea18d71e tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:58:50.018013 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-4dca41b9-6fce-4481-b35f-b305ea18d71e tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:58:50.018787 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-4dca41b9-6fce-4481-b35f-b305ea18d71e tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:58:50.019221 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-4dca41b9-6fce-4481-b35f-b305ea18d71e tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:58:50.087633 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-4dca41b9-6fce-4481-b35f-b305ea18d71e tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f046401c6a04f6495ebe0821120bd72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a58e89ceeea4a9c8a72a1de4bcaf2d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:58:50.096556 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-4dca41b9-6fce-4481-b35f-b305ea18d71e tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] 10.222.0.11 "GET /compute/v2.1/servers/a49437df-3059-4528-8328-2f3471d5fb45" status: 200 len: 1352 microversion: 2.1 time: 0.097253 Nov 17 03:58:50.097166 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 1477/3097] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:58:49 2021] GET /compute/v2.1/servers/a49437df-3059-4528-8328-2f3471d5fb45 => generated 1352 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:58:51.113654 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-15fb9f54-bd51-4576-8beb-92e4881bb7e0 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:58:51.114323 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-15fb9f54-bd51-4576-8beb-92e4881bb7e0 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] [instance: a49437df-3059-4528-8328-2f3471d5fb45] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:58:51.121035 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-15fb9f54-bd51-4576-8beb-92e4881bb7e0 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:58:51.121492 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-15fb9f54-bd51-4576-8beb-92e4881bb7e0 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:58:51.122259 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-15fb9f54-bd51-4576-8beb-92e4881bb7e0 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:58:51.122689 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-15fb9f54-bd51-4576-8beb-92e4881bb7e0 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:58:51.183245 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-15fb9f54-bd51-4576-8beb-92e4881bb7e0 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f046401c6a04f6495ebe0821120bd72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a58e89ceeea4a9c8a72a1de4bcaf2d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:58:51.191276 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-15fb9f54-bd51-4576-8beb-92e4881bb7e0 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] 10.222.0.11 "GET /compute/v2.1/servers/a49437df-3059-4528-8328-2f3471d5fb45" status: 200 len: 1352 microversion: 2.1 time: 0.081496 Nov 17 03:58:51.191845 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 1478/3098] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:58:51 2021] GET /compute/v2.1/servers/a49437df-3059-4528-8328-2f3471d5fb45 => generated 1352 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:58:52.211440 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-a28d39d6-dd92-42c4-bb52-d0afc08d1254 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:58:52.212570 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-a28d39d6-dd92-42c4-bb52-d0afc08d1254 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] [instance: a49437df-3059-4528-8328-2f3471d5fb45] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:58:52.222861 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-a28d39d6-dd92-42c4-bb52-d0afc08d1254 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:58:52.223608 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-a28d39d6-dd92-42c4-bb52-d0afc08d1254 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:58:52.224876 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-a28d39d6-dd92-42c4-bb52-d0afc08d1254 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:58:52.225631 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-a28d39d6-dd92-42c4-bb52-d0afc08d1254 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:58:52.294822 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-a28d39d6-dd92-42c4-bb52-d0afc08d1254 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f046401c6a04f6495ebe0821120bd72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a58e89ceeea4a9c8a72a1de4bcaf2d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:58:52.308198 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-a28d39d6-dd92-42c4-bb52-d0afc08d1254 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] 10.222.0.11 "GET /compute/v2.1/servers/a49437df-3059-4528-8328-2f3471d5fb45" status: 200 len: 1352 microversion: 2.1 time: 0.102754 Nov 17 03:58:52.308696 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 1479/3099] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:58:52 2021] GET /compute/v2.1/servers/a49437df-3059-4528-8328-2f3471d5fb45 => generated 1352 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:58:53.328766 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-22b9fa93-f06f-4dbb-bd63-eaae4f1f9fb5 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:58:53.329913 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-22b9fa93-f06f-4dbb-bd63-eaae4f1f9fb5 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] [instance: a49437df-3059-4528-8328-2f3471d5fb45] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:58:53.340379 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-22b9fa93-f06f-4dbb-bd63-eaae4f1f9fb5 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:58:53.341189 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-22b9fa93-f06f-4dbb-bd63-eaae4f1f9fb5 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:58:53.342465 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-22b9fa93-f06f-4dbb-bd63-eaae4f1f9fb5 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:58:53.343189 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-22b9fa93-f06f-4dbb-bd63-eaae4f1f9fb5 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:58:53.403316 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-22b9fa93-f06f-4dbb-bd63-eaae4f1f9fb5 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f046401c6a04f6495ebe0821120bd72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a58e89ceeea4a9c8a72a1de4bcaf2d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:58:53.411927 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-22b9fa93-f06f-4dbb-bd63-eaae4f1f9fb5 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] 10.222.0.11 "GET /compute/v2.1/servers/a49437df-3059-4528-8328-2f3471d5fb45" status: 200 len: 1352 microversion: 2.1 time: 0.089454 Nov 17 03:58:53.412495 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 1480/3100] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:58:53 2021] GET /compute/v2.1/servers/a49437df-3059-4528-8328-2f3471d5fb45 => generated 1352 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:58:54.432197 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-065ddb62-dbff-403b-a6c9-7c7259192381 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:58:54.432889 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-065ddb62-dbff-403b-a6c9-7c7259192381 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] [instance: a49437df-3059-4528-8328-2f3471d5fb45] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:58:54.442418 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-065ddb62-dbff-403b-a6c9-7c7259192381 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:58:54.443094 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-065ddb62-dbff-403b-a6c9-7c7259192381 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:58:54.444262 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-065ddb62-dbff-403b-a6c9-7c7259192381 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:58:54.444918 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-065ddb62-dbff-403b-a6c9-7c7259192381 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:58:54.511827 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-065ddb62-dbff-403b-a6c9-7c7259192381 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f046401c6a04f6495ebe0821120bd72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a58e89ceeea4a9c8a72a1de4bcaf2d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:58:54.520657 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-065ddb62-dbff-403b-a6c9-7c7259192381 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] 10.222.0.11 "GET /compute/v2.1/servers/a49437df-3059-4528-8328-2f3471d5fb45" status: 200 len: 1352 microversion: 2.1 time: 0.094556 Nov 17 03:58:54.521275 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 1481/3101] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:58:54 2021] GET /compute/v2.1/servers/a49437df-3059-4528-8328-2f3471d5fb45 => generated 1352 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:58:55.541254 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-9c4e558b-33f0-4463-ad48-505225765c62 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:58:55.542332 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-9c4e558b-33f0-4463-ad48-505225765c62 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] [instance: a49437df-3059-4528-8328-2f3471d5fb45] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:58:55.553023 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-9c4e558b-33f0-4463-ad48-505225765c62 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:58:55.553807 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-9c4e558b-33f0-4463-ad48-505225765c62 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:58:55.555074 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-9c4e558b-33f0-4463-ad48-505225765c62 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:58:55.555776 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-9c4e558b-33f0-4463-ad48-505225765c62 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:58:55.623841 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-9c4e558b-33f0-4463-ad48-505225765c62 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f046401c6a04f6495ebe0821120bd72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a58e89ceeea4a9c8a72a1de4bcaf2d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:58:55.632422 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-9c4e558b-33f0-4463-ad48-505225765c62 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] 10.222.0.11 "GET /compute/v2.1/servers/a49437df-3059-4528-8328-2f3471d5fb45" status: 200 len: 1352 microversion: 2.1 time: 0.097474 Nov 17 03:58:55.633030 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 1482/3102] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:58:55 2021] GET /compute/v2.1/servers/a49437df-3059-4528-8328-2f3471d5fb45 => generated 1352 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:58:56.653114 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-1afdda83-9885-44f3-803c-1b59a51e0be3 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:58:56.654174 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-1afdda83-9885-44f3-803c-1b59a51e0be3 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] [instance: a49437df-3059-4528-8328-2f3471d5fb45] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:58:56.665228 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-1afdda83-9885-44f3-803c-1b59a51e0be3 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:58:56.665964 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-1afdda83-9885-44f3-803c-1b59a51e0be3 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:58:56.667272 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-1afdda83-9885-44f3-803c-1b59a51e0be3 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:58:56.667947 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-1afdda83-9885-44f3-803c-1b59a51e0be3 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:58:56.731523 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-1afdda83-9885-44f3-803c-1b59a51e0be3 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f046401c6a04f6495ebe0821120bd72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a58e89ceeea4a9c8a72a1de4bcaf2d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:58:56.740118 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-1afdda83-9885-44f3-803c-1b59a51e0be3 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] 10.222.0.11 "GET /compute/v2.1/servers/a49437df-3059-4528-8328-2f3471d5fb45" status: 200 len: 1352 microversion: 2.1 time: 0.093187 Nov 17 03:58:56.740697 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 1483/3103] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:58:56 2021] GET /compute/v2.1/servers/a49437df-3059-4528-8328-2f3471d5fb45 => generated 1352 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:58:57.760973 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-e3b73aee-2a50-4c21-a7a3-30ed6c5a3009 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:58:57.762059 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-e3b73aee-2a50-4c21-a7a3-30ed6c5a3009 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] [instance: a49437df-3059-4528-8328-2f3471d5fb45] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:58:57.772589 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-e3b73aee-2a50-4c21-a7a3-30ed6c5a3009 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:58:57.773377 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-e3b73aee-2a50-4c21-a7a3-30ed6c5a3009 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:58:57.774630 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-e3b73aee-2a50-4c21-a7a3-30ed6c5a3009 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:58:57.775333 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-e3b73aee-2a50-4c21-a7a3-30ed6c5a3009 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:58:57.839583 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-e3b73aee-2a50-4c21-a7a3-30ed6c5a3009 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f046401c6a04f6495ebe0821120bd72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a58e89ceeea4a9c8a72a1de4bcaf2d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:58:57.848066 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-e3b73aee-2a50-4c21-a7a3-30ed6c5a3009 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] 10.222.0.11 "GET /compute/v2.1/servers/a49437df-3059-4528-8328-2f3471d5fb45" status: 200 len: 1352 microversion: 2.1 time: 0.093293 Nov 17 03:58:57.848664 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 1484/3104] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:58:57 2021] GET /compute/v2.1/servers/a49437df-3059-4528-8328-2f3471d5fb45 => generated 1352 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:58:58.868757 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-091a0f14-3c0a-4053-81f8-70b8536f3585 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:58:58.869570 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-091a0f14-3c0a-4053-81f8-70b8536f3585 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] [instance: a49437df-3059-4528-8328-2f3471d5fb45] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:58:58.879343 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-091a0f14-3c0a-4053-81f8-70b8536f3585 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:58:58.880019 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-091a0f14-3c0a-4053-81f8-70b8536f3585 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:58:58.881248 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-091a0f14-3c0a-4053-81f8-70b8536f3585 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:58:58.881966 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-091a0f14-3c0a-4053-81f8-70b8536f3585 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:58:58.946612 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-091a0f14-3c0a-4053-81f8-70b8536f3585 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f046401c6a04f6495ebe0821120bd72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a58e89ceeea4a9c8a72a1de4bcaf2d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:58:58.954993 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-091a0f14-3c0a-4053-81f8-70b8536f3585 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] 10.222.0.11 "GET /compute/v2.1/servers/a49437df-3059-4528-8328-2f3471d5fb45" status: 200 len: 1352 microversion: 2.1 time: 0.092435 Nov 17 03:58:58.955575 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 1485/3105] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:58:58 2021] GET /compute/v2.1/servers/a49437df-3059-4528-8328-2f3471d5fb45 => generated 1352 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:58:59.975693 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-23aa53ff-876c-466e-aaa9-d5eb86f88706 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:58:59.976932 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-23aa53ff-876c-466e-aaa9-d5eb86f88706 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] [instance: a49437df-3059-4528-8328-2f3471d5fb45] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:58:59.987482 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-23aa53ff-876c-466e-aaa9-d5eb86f88706 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:58:59.988221 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-23aa53ff-876c-466e-aaa9-d5eb86f88706 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:58:59.989542 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-23aa53ff-876c-466e-aaa9-d5eb86f88706 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:58:59.990266 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-23aa53ff-876c-466e-aaa9-d5eb86f88706 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:59:00.053989 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-23aa53ff-876c-466e-aaa9-d5eb86f88706 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f046401c6a04f6495ebe0821120bd72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a58e89ceeea4a9c8a72a1de4bcaf2d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:59:00.062169 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-23aa53ff-876c-466e-aaa9-d5eb86f88706 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] 10.222.0.11 "GET /compute/v2.1/servers/a49437df-3059-4528-8328-2f3471d5fb45" status: 200 len: 1352 microversion: 2.1 time: 0.093174 Nov 17 03:59:00.062720 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 1486/3106] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:58:59 2021] GET /compute/v2.1/servers/a49437df-3059-4528-8328-2f3471d5fb45 => generated 1352 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:59:01.079783 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-e5f31e73-287e-400d-8749-200dc68fc5ec tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:59:01.080408 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-e5f31e73-287e-400d-8749-200dc68fc5ec tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] [instance: a49437df-3059-4528-8328-2f3471d5fb45] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:59:01.087709 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-e5f31e73-287e-400d-8749-200dc68fc5ec tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:59:01.087709 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-e5f31e73-287e-400d-8749-200dc68fc5ec tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:59:01.088321 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-e5f31e73-287e-400d-8749-200dc68fc5ec tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:59:01.088758 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-e5f31e73-287e-400d-8749-200dc68fc5ec tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:59:01.153926 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-e5f31e73-287e-400d-8749-200dc68fc5ec tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f046401c6a04f6495ebe0821120bd72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a58e89ceeea4a9c8a72a1de4bcaf2d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:59:01.161696 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-e5f31e73-287e-400d-8749-200dc68fc5ec tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] 10.222.0.11 "GET /compute/v2.1/servers/a49437df-3059-4528-8328-2f3471d5fb45" status: 200 len: 1352 microversion: 2.1 time: 0.086120 Nov 17 03:59:01.162257 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 1487/3107] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:59:01 2021] GET /compute/v2.1/servers/a49437df-3059-4528-8328-2f3471d5fb45 => generated 1352 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:59:02.182516 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-1f7c0d8b-45b0-4d13-8a90-879323b519b2 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:59:02.184300 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-1f7c0d8b-45b0-4d13-8a90-879323b519b2 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] [instance: a49437df-3059-4528-8328-2f3471d5fb45] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:59:02.193056 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-1f7c0d8b-45b0-4d13-8a90-879323b519b2 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:59:02.193502 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-1f7c0d8b-45b0-4d13-8a90-879323b519b2 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:59:02.194269 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-1f7c0d8b-45b0-4d13-8a90-879323b519b2 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:59:02.194697 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-1f7c0d8b-45b0-4d13-8a90-879323b519b2 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:59:02.266283 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-1f7c0d8b-45b0-4d13-8a90-879323b519b2 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f046401c6a04f6495ebe0821120bd72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a58e89ceeea4a9c8a72a1de4bcaf2d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:59:02.274414 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-1f7c0d8b-45b0-4d13-8a90-879323b519b2 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] 10.222.0.11 "GET /compute/v2.1/servers/a49437df-3059-4528-8328-2f3471d5fb45" status: 200 len: 1352 microversion: 2.1 time: 0.098111 Nov 17 03:59:02.274967 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 1488/3108] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:59:02 2021] GET /compute/v2.1/servers/a49437df-3059-4528-8328-2f3471d5fb45 => generated 1352 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:59:03.299820 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-b5312dab-d486-4597-9c57-a85e947d0951 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:59:03.301084 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-b5312dab-d486-4597-9c57-a85e947d0951 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] [instance: a49437df-3059-4528-8328-2f3471d5fb45] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:59:03.309268 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-b5312dab-d486-4597-9c57-a85e947d0951 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:59:03.309737 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-b5312dab-d486-4597-9c57-a85e947d0951 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:59:03.310693 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-b5312dab-d486-4597-9c57-a85e947d0951 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:59:03.311225 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-b5312dab-d486-4597-9c57-a85e947d0951 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:59:03.374358 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-b5312dab-d486-4597-9c57-a85e947d0951 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f046401c6a04f6495ebe0821120bd72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a58e89ceeea4a9c8a72a1de4bcaf2d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:59:03.387104 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-b5312dab-d486-4597-9c57-a85e947d0951 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] 10.222.0.11 "GET /compute/v2.1/servers/a49437df-3059-4528-8328-2f3471d5fb45" status: 200 len: 1352 microversion: 2.1 time: 0.095408 Nov 17 03:59:03.387918 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 1489/3109] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:59:03 2021] GET /compute/v2.1/servers/a49437df-3059-4528-8328-2f3471d5fb45 => generated 1352 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:59:04.408332 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-c87532ee-4a11-4a1a-8d55-75886a3d2ae1 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:59:04.409067 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-c87532ee-4a11-4a1a-8d55-75886a3d2ae1 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] [instance: a49437df-3059-4528-8328-2f3471d5fb45] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:59:04.415993 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-c87532ee-4a11-4a1a-8d55-75886a3d2ae1 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:59:04.416446 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-c87532ee-4a11-4a1a-8d55-75886a3d2ae1 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:59:04.417251 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-c87532ee-4a11-4a1a-8d55-75886a3d2ae1 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:59:04.417687 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-c87532ee-4a11-4a1a-8d55-75886a3d2ae1 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:59:04.486102 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-c87532ee-4a11-4a1a-8d55-75886a3d2ae1 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f046401c6a04f6495ebe0821120bd72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a58e89ceeea4a9c8a72a1de4bcaf2d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:59:04.499529 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-c87532ee-4a11-4a1a-8d55-75886a3d2ae1 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] 10.222.0.11 "GET /compute/v2.1/servers/a49437df-3059-4528-8328-2f3471d5fb45" status: 200 len: 1352 microversion: 2.1 time: 0.096828 Nov 17 03:59:04.500369 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 1490/3110] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:59:04 2021] GET /compute/v2.1/servers/a49437df-3059-4528-8328-2f3471d5fb45 => generated 1352 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:59:05.520707 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-55399f09-07e7-4e60-82c9-f3b55b334d40 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:59:05.521461 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-55399f09-07e7-4e60-82c9-f3b55b334d40 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] [instance: a49437df-3059-4528-8328-2f3471d5fb45] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:59:05.527822 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-55399f09-07e7-4e60-82c9-f3b55b334d40 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:59:05.528275 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-55399f09-07e7-4e60-82c9-f3b55b334d40 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:59:05.529072 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-55399f09-07e7-4e60-82c9-f3b55b334d40 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:59:05.529507 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-55399f09-07e7-4e60-82c9-f3b55b334d40 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:59:05.590494 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-55399f09-07e7-4e60-82c9-f3b55b334d40 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f046401c6a04f6495ebe0821120bd72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a58e89ceeea4a9c8a72a1de4bcaf2d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:59:05.599388 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-55399f09-07e7-4e60-82c9-f3b55b334d40 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] 10.222.0.11 "GET /compute/v2.1/servers/a49437df-3059-4528-8328-2f3471d5fb45" status: 200 len: 1352 microversion: 2.1 time: 0.084965 Nov 17 03:59:05.599962 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 1491/3111] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:59:05 2021] GET /compute/v2.1/servers/a49437df-3059-4528-8328-2f3471d5fb45 => generated 1352 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:59:06.617142 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-6901c04c-8227-4f4b-b881-6536bb8cb2dc tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:59:06.618752 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-6901c04c-8227-4f4b-b881-6536bb8cb2dc tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] [instance: a49437df-3059-4528-8328-2f3471d5fb45] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:59:06.625720 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-6901c04c-8227-4f4b-b881-6536bb8cb2dc tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:59:06.626188 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-6901c04c-8227-4f4b-b881-6536bb8cb2dc tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:59:06.626961 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-6901c04c-8227-4f4b-b881-6536bb8cb2dc tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:59:06.627394 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-6901c04c-8227-4f4b-b881-6536bb8cb2dc tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:59:06.697877 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-6901c04c-8227-4f4b-b881-6536bb8cb2dc tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f046401c6a04f6495ebe0821120bd72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a58e89ceeea4a9c8a72a1de4bcaf2d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:59:06.706655 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-6901c04c-8227-4f4b-b881-6536bb8cb2dc tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] 10.222.0.11 "GET /compute/v2.1/servers/a49437df-3059-4528-8328-2f3471d5fb45" status: 200 len: 1352 microversion: 2.1 time: 0.093990 Nov 17 03:59:06.707229 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 1492/3112] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:59:06 2021] GET /compute/v2.1/servers/a49437df-3059-4528-8328-2f3471d5fb45 => generated 1352 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:59:07.725983 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-270e1716-a6d2-40ce-b754-e4b70f78fd99 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:59:07.726683 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-270e1716-a6d2-40ce-b754-e4b70f78fd99 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] [instance: a49437df-3059-4528-8328-2f3471d5fb45] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:59:07.736133 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-270e1716-a6d2-40ce-b754-e4b70f78fd99 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:59:07.736569 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-270e1716-a6d2-40ce-b754-e4b70f78fd99 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:59:07.737364 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-270e1716-a6d2-40ce-b754-e4b70f78fd99 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:59:07.737790 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-270e1716-a6d2-40ce-b754-e4b70f78fd99 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:59:07.812982 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-270e1716-a6d2-40ce-b754-e4b70f78fd99 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f046401c6a04f6495ebe0821120bd72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a58e89ceeea4a9c8a72a1de4bcaf2d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:59:07.821474 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-270e1716-a6d2-40ce-b754-e4b70f78fd99 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] 10.222.0.11 "GET /compute/v2.1/servers/a49437df-3059-4528-8328-2f3471d5fb45" status: 200 len: 1352 microversion: 2.1 time: 0.101358 Nov 17 03:59:07.822130 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 1493/3113] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:59:07 2021] GET /compute/v2.1/servers/a49437df-3059-4528-8328-2f3471d5fb45 => generated 1352 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:59:08.839382 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-8780f453-5b1a-463d-af87-57af1e9c87e1 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:59:08.840113 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-8780f453-5b1a-463d-af87-57af1e9c87e1 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] [instance: a49437df-3059-4528-8328-2f3471d5fb45] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:59:08.847876 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-8780f453-5b1a-463d-af87-57af1e9c87e1 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:59:08.848634 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-8780f453-5b1a-463d-af87-57af1e9c87e1 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:59:08.849946 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-8780f453-5b1a-463d-af87-57af1e9c87e1 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:59:08.850667 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-8780f453-5b1a-463d-af87-57af1e9c87e1 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:59:08.921847 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-8780f453-5b1a-463d-af87-57af1e9c87e1 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f046401c6a04f6495ebe0821120bd72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a58e89ceeea4a9c8a72a1de4bcaf2d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:59:08.930611 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-8780f453-5b1a-463d-af87-57af1e9c87e1 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] 10.222.0.11 "GET /compute/v2.1/servers/a49437df-3059-4528-8328-2f3471d5fb45" status: 200 len: 1352 microversion: 2.1 time: 0.095064 Nov 17 03:59:08.931226 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 1494/3114] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:59:08 2021] GET /compute/v2.1/servers/a49437df-3059-4528-8328-2f3471d5fb45 => generated 1352 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:59:09.951309 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-e014fc48-be4f-45bc-aa23-18a293719aa1 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:59:09.952325 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-e014fc48-be4f-45bc-aa23-18a293719aa1 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] [instance: a49437df-3059-4528-8328-2f3471d5fb45] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:59:09.963646 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-e014fc48-be4f-45bc-aa23-18a293719aa1 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:59:09.964455 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-e014fc48-be4f-45bc-aa23-18a293719aa1 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:59:09.965836 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-e014fc48-be4f-45bc-aa23-18a293719aa1 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:59:09.966561 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-e014fc48-be4f-45bc-aa23-18a293719aa1 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:59:10.040626 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-e014fc48-be4f-45bc-aa23-18a293719aa1 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f046401c6a04f6495ebe0821120bd72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a58e89ceeea4a9c8a72a1de4bcaf2d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:59:10.051407 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-e014fc48-be4f-45bc-aa23-18a293719aa1 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] 10.222.0.11 "GET /compute/v2.1/servers/a49437df-3059-4528-8328-2f3471d5fb45" status: 200 len: 1352 microversion: 2.1 time: 0.106244 Nov 17 03:59:10.051986 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 1495/3115] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:59:09 2021] GET /compute/v2.1/servers/a49437df-3059-4528-8328-2f3471d5fb45 => generated 1352 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:59:11.071935 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-440f54fc-f2de-48b7-a99e-6f3ca0119d09 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:59:11.072900 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-440f54fc-f2de-48b7-a99e-6f3ca0119d09 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] [instance: a49437df-3059-4528-8328-2f3471d5fb45] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:59:11.081527 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-440f54fc-f2de-48b7-a99e-6f3ca0119d09 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:59:11.081978 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-440f54fc-f2de-48b7-a99e-6f3ca0119d09 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:59:11.082755 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-440f54fc-f2de-48b7-a99e-6f3ca0119d09 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:59:11.083190 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-440f54fc-f2de-48b7-a99e-6f3ca0119d09 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:59:11.143036 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-440f54fc-f2de-48b7-a99e-6f3ca0119d09 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f046401c6a04f6495ebe0821120bd72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a58e89ceeea4a9c8a72a1de4bcaf2d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:59:11.151390 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-440f54fc-f2de-48b7-a99e-6f3ca0119d09 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] 10.222.0.11 "GET /compute/v2.1/servers/a49437df-3059-4528-8328-2f3471d5fb45" status: 200 len: 1352 microversion: 2.1 time: 0.085950 Nov 17 03:59:11.151957 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 1496/3116] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:59:11 2021] GET /compute/v2.1/servers/a49437df-3059-4528-8328-2f3471d5fb45 => generated 1352 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:59:12.172401 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-4e03333a-539d-4f81-8b85-6b6cde68f5b9 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:59:12.173634 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-4e03333a-539d-4f81-8b85-6b6cde68f5b9 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] [instance: a49437df-3059-4528-8328-2f3471d5fb45] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:59:12.184744 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-4e03333a-539d-4f81-8b85-6b6cde68f5b9 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:59:12.185540 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-4e03333a-539d-4f81-8b85-6b6cde68f5b9 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:59:12.186806 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-4e03333a-539d-4f81-8b85-6b6cde68f5b9 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:59:12.187522 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-4e03333a-539d-4f81-8b85-6b6cde68f5b9 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:59:12.252515 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-4e03333a-539d-4f81-8b85-6b6cde68f5b9 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f046401c6a04f6495ebe0821120bd72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a58e89ceeea4a9c8a72a1de4bcaf2d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:59:12.261211 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-4e03333a-539d-4f81-8b85-6b6cde68f5b9 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] 10.222.0.11 "GET /compute/v2.1/servers/a49437df-3059-4528-8328-2f3471d5fb45" status: 200 len: 1352 microversion: 2.1 time: 0.094967 Nov 17 03:59:12.261789 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 1497/3117] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:59:12 2021] GET /compute/v2.1/servers/a49437df-3059-4528-8328-2f3471d5fb45 => generated 1352 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:59:13.281993 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-bbae0d6e-2c00-4922-904d-e4db922e769c tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:59:13.283178 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-bbae0d6e-2c00-4922-904d-e4db922e769c tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] [instance: a49437df-3059-4528-8328-2f3471d5fb45] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:59:13.294220 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-bbae0d6e-2c00-4922-904d-e4db922e769c tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:59:13.294971 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-bbae0d6e-2c00-4922-904d-e4db922e769c tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:59:13.296216 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-bbae0d6e-2c00-4922-904d-e4db922e769c tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:59:13.297016 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-bbae0d6e-2c00-4922-904d-e4db922e769c tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:59:13.357900 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-bbae0d6e-2c00-4922-904d-e4db922e769c tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f046401c6a04f6495ebe0821120bd72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a58e89ceeea4a9c8a72a1de4bcaf2d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:59:13.366442 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-bbae0d6e-2c00-4922-904d-e4db922e769c tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] 10.222.0.11 "GET /compute/v2.1/servers/a49437df-3059-4528-8328-2f3471d5fb45" status: 200 len: 1352 microversion: 2.1 time: 0.090706 Nov 17 03:59:13.367005 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 1498/3118] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:59:13 2021] GET /compute/v2.1/servers/a49437df-3059-4528-8328-2f3471d5fb45 => generated 1352 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:59:14.387496 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-dd7c7749-5417-43ef-84c3-3a789d35aebd tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:59:14.388520 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-dd7c7749-5417-43ef-84c3-3a789d35aebd tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] [instance: a49437df-3059-4528-8328-2f3471d5fb45] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:59:14.398899 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-dd7c7749-5417-43ef-84c3-3a789d35aebd tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:59:14.399636 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-dd7c7749-5417-43ef-84c3-3a789d35aebd tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:59:14.400937 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-dd7c7749-5417-43ef-84c3-3a789d35aebd tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:59:14.401612 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-dd7c7749-5417-43ef-84c3-3a789d35aebd tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:59:14.470766 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-dd7c7749-5417-43ef-84c3-3a789d35aebd tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f046401c6a04f6495ebe0821120bd72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a58e89ceeea4a9c8a72a1de4bcaf2d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:59:14.483489 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-dd7c7749-5417-43ef-84c3-3a789d35aebd tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] 10.222.0.11 "GET /compute/v2.1/servers/a49437df-3059-4528-8328-2f3471d5fb45" status: 200 len: 1352 microversion: 2.1 time: 0.102001 Nov 17 03:59:14.484306 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 1499/3119] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:59:14 2021] GET /compute/v2.1/servers/a49437df-3059-4528-8328-2f3471d5fb45 => generated 1352 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 17 03:59:15.504099 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-ac0564a0-bb57-4938-a885-2d7f58fe82c9 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:59:15.505238 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-ac0564a0-bb57-4938-a885-2d7f58fe82c9 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] [instance: a49437df-3059-4528-8328-2f3471d5fb45] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:59:15.515752 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-ac0564a0-bb57-4938-a885-2d7f58fe82c9 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:59:15.516499 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-ac0564a0-bb57-4938-a885-2d7f58fe82c9 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:59:15.518306 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-ac0564a0-bb57-4938-a885-2d7f58fe82c9 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:59:15.518748 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-ac0564a0-bb57-4938-a885-2d7f58fe82c9 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:59:15.580253 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-ac0564a0-bb57-4938-a885-2d7f58fe82c9 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f046401c6a04f6495ebe0821120bd72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a58e89ceeea4a9c8a72a1de4bcaf2d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:59:15.589009 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-ac0564a0-bb57-4938-a885-2d7f58fe82c9 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] 10.222.0.11 "GET /compute/v2.1/servers/a49437df-3059-4528-8328-2f3471d5fb45" status: 200 len: 1352 microversion: 2.1 time: 0.090876 Nov 17 03:59:15.589582 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 1500/3120] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:59:15 2021] GET /compute/v2.1/servers/a49437df-3059-4528-8328-2f3471d5fb45 => generated 1352 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:59:16.608648 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-faffdb7f-a89b-4ae3-ab57-0fde5a1f5a9d tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:59:16.609515 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-faffdb7f-a89b-4ae3-ab57-0fde5a1f5a9d tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] [instance: a49437df-3059-4528-8328-2f3471d5fb45] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:59:16.617482 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-faffdb7f-a89b-4ae3-ab57-0fde5a1f5a9d tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:59:16.618009 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-faffdb7f-a89b-4ae3-ab57-0fde5a1f5a9d tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:59:16.618945 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-faffdb7f-a89b-4ae3-ab57-0fde5a1f5a9d tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:59:16.619447 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-faffdb7f-a89b-4ae3-ab57-0fde5a1f5a9d tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:59:16.690218 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-faffdb7f-a89b-4ae3-ab57-0fde5a1f5a9d tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f046401c6a04f6495ebe0821120bd72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a58e89ceeea4a9c8a72a1de4bcaf2d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:59:16.698278 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-faffdb7f-a89b-4ae3-ab57-0fde5a1f5a9d tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] 10.222.0.11 "GET /compute/v2.1/servers/a49437df-3059-4528-8328-2f3471d5fb45" status: 200 len: 1352 microversion: 2.1 time: 0.094083 Nov 17 03:59:16.698850 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 1501/3121] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:59:16 2021] GET /compute/v2.1/servers/a49437df-3059-4528-8328-2f3471d5fb45 => generated 1352 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:59:17.719323 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-4a593711-bf98-4c71-a76b-6c3e74938b56 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:59:17.720491 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-4a593711-bf98-4c71-a76b-6c3e74938b56 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] [instance: a49437df-3059-4528-8328-2f3471d5fb45] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:59:17.730945 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-4a593711-bf98-4c71-a76b-6c3e74938b56 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:59:17.731694 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-4a593711-bf98-4c71-a76b-6c3e74938b56 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:59:17.733138 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-4a593711-bf98-4c71-a76b-6c3e74938b56 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:59:17.733776 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-4a593711-bf98-4c71-a76b-6c3e74938b56 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:59:17.797709 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-4a593711-bf98-4c71-a76b-6c3e74938b56 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f046401c6a04f6495ebe0821120bd72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a58e89ceeea4a9c8a72a1de4bcaf2d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:59:17.806876 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-4a593711-bf98-4c71-a76b-6c3e74938b56 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] 10.222.0.11 "GET /compute/v2.1/servers/a49437df-3059-4528-8328-2f3471d5fb45" status: 200 len: 1352 microversion: 2.1 time: 0.093812 Nov 17 03:59:17.807784 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 1502/3122] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:59:17 2021] GET /compute/v2.1/servers/a49437df-3059-4528-8328-2f3471d5fb45 => generated 1352 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:59:18.823573 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-0c757e03-e688-4d40-a632-a51af6559152 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:59:18.824972 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-0c757e03-e688-4d40-a632-a51af6559152 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] [instance: a49437df-3059-4528-8328-2f3471d5fb45] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:59:18.831629 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-0c757e03-e688-4d40-a632-a51af6559152 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:59:18.832089 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-0c757e03-e688-4d40-a632-a51af6559152 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:59:18.832897 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-0c757e03-e688-4d40-a632-a51af6559152 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:59:18.833333 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-0c757e03-e688-4d40-a632-a51af6559152 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:59:18.893609 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-0c757e03-e688-4d40-a632-a51af6559152 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f046401c6a04f6495ebe0821120bd72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a58e89ceeea4a9c8a72a1de4bcaf2d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:59:18.901767 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-0c757e03-e688-4d40-a632-a51af6559152 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] 10.222.0.11 "GET /compute/v2.1/servers/a49437df-3059-4528-8328-2f3471d5fb45" status: 200 len: 1352 microversion: 2.1 time: 0.081923 Nov 17 03:59:18.902549 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 1503/3123] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:59:18 2021] GET /compute/v2.1/servers/a49437df-3059-4528-8328-2f3471d5fb45 => generated 1352 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:59:19.923156 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-16675773-2e72-4514-b854-0d7aa0fe1764 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:59:19.924200 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-16675773-2e72-4514-b854-0d7aa0fe1764 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] [instance: a49437df-3059-4528-8328-2f3471d5fb45] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:59:19.932211 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-16675773-2e72-4514-b854-0d7aa0fe1764 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:59:19.932725 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-16675773-2e72-4514-b854-0d7aa0fe1764 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:59:19.933656 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-16675773-2e72-4514-b854-0d7aa0fe1764 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:59:19.934159 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-16675773-2e72-4514-b854-0d7aa0fe1764 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:59:19.997058 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-16675773-2e72-4514-b854-0d7aa0fe1764 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f046401c6a04f6495ebe0821120bd72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a58e89ceeea4a9c8a72a1de4bcaf2d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:59:20.005660 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-16675773-2e72-4514-b854-0d7aa0fe1764 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] 10.222.0.11 "GET /compute/v2.1/servers/a49437df-3059-4528-8328-2f3471d5fb45" status: 200 len: 1352 microversion: 2.1 time: 0.088726 Nov 17 03:59:20.006234 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 1504/3124] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:59:19 2021] GET /compute/v2.1/servers/a49437df-3059-4528-8328-2f3471d5fb45 => generated 1352 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:59:21.220645 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-94067ea9-15c4-4ecb-9006-0bea5d00567d tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:59:21.221488 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-94067ea9-15c4-4ecb-9006-0bea5d00567d tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] [instance: a49437df-3059-4528-8328-2f3471d5fb45] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:59:21.227878 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-94067ea9-15c4-4ecb-9006-0bea5d00567d tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:59:21.228322 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-94067ea9-15c4-4ecb-9006-0bea5d00567d tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:59:21.229194 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-94067ea9-15c4-4ecb-9006-0bea5d00567d tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:59:21.229630 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-94067ea9-15c4-4ecb-9006-0bea5d00567d tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:59:21.292326 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-94067ea9-15c4-4ecb-9006-0bea5d00567d tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f046401c6a04f6495ebe0821120bd72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a58e89ceeea4a9c8a72a1de4bcaf2d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:59:21.301143 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-94067ea9-15c4-4ecb-9006-0bea5d00567d tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] 10.222.0.11 "GET /compute/v2.1/servers/a49437df-3059-4528-8328-2f3471d5fb45" status: 200 len: 1352 microversion: 2.1 time: 0.281128 Nov 17 03:59:21.301704 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 1505/3125] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:59:21 2021] GET /compute/v2.1/servers/a49437df-3059-4528-8328-2f3471d5fb45 => generated 1352 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:59:22.320953 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-462508c1-b1d7-4077-b513-033b156163ff tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:59:22.321629 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-462508c1-b1d7-4077-b513-033b156163ff tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] [instance: a49437df-3059-4528-8328-2f3471d5fb45] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:59:22.331073 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-462508c1-b1d7-4077-b513-033b156163ff tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:59:22.331518 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-462508c1-b1d7-4077-b513-033b156163ff tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:59:22.332285 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-462508c1-b1d7-4077-b513-033b156163ff tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:59:22.332719 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-462508c1-b1d7-4077-b513-033b156163ff tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:59:22.407953 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-462508c1-b1d7-4077-b513-033b156163ff tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f046401c6a04f6495ebe0821120bd72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a58e89ceeea4a9c8a72a1de4bcaf2d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:59:22.415894 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-462508c1-b1d7-4077-b513-033b156163ff tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] 10.222.0.11 "GET /compute/v2.1/servers/a49437df-3059-4528-8328-2f3471d5fb45" status: 200 len: 1352 microversion: 2.1 time: 0.100671 Nov 17 03:59:22.416457 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 1506/3126] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:59:22 2021] GET /compute/v2.1/servers/a49437df-3059-4528-8328-2f3471d5fb45 => generated 1352 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:59:23.435502 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-8cbb9fdc-b9a7-49ba-aa38-c7890e8ea3e9 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:59:23.436373 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-8cbb9fdc-b9a7-49ba-aa38-c7890e8ea3e9 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] [instance: a49437df-3059-4528-8328-2f3471d5fb45] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:59:23.443767 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-8cbb9fdc-b9a7-49ba-aa38-c7890e8ea3e9 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:59:23.444240 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-8cbb9fdc-b9a7-49ba-aa38-c7890e8ea3e9 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:59:23.445119 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-8cbb9fdc-b9a7-49ba-aa38-c7890e8ea3e9 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:59:23.445560 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-8cbb9fdc-b9a7-49ba-aa38-c7890e8ea3e9 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:59:23.504543 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-8cbb9fdc-b9a7-49ba-aa38-c7890e8ea3e9 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f046401c6a04f6495ebe0821120bd72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a58e89ceeea4a9c8a72a1de4bcaf2d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:59:23.512675 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-8cbb9fdc-b9a7-49ba-aa38-c7890e8ea3e9 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] 10.222.0.11 "GET /compute/v2.1/servers/a49437df-3059-4528-8328-2f3471d5fb45" status: 200 len: 1352 microversion: 2.1 time: 0.082336 Nov 17 03:59:23.513278 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 1507/3127] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:59:23 2021] GET /compute/v2.1/servers/a49437df-3059-4528-8328-2f3471d5fb45 => generated 1352 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:59:24.533341 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-d46a1f81-d9f4-421a-b295-949a7b4856b0 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:59:24.534284 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-d46a1f81-d9f4-421a-b295-949a7b4856b0 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] [instance: a49437df-3059-4528-8328-2f3471d5fb45] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:59:24.542947 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-d46a1f81-d9f4-421a-b295-949a7b4856b0 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:59:24.543528 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-d46a1f81-d9f4-421a-b295-949a7b4856b0 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:59:24.544743 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-d46a1f81-d9f4-421a-b295-949a7b4856b0 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:59:24.545401 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-d46a1f81-d9f4-421a-b295-949a7b4856b0 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:59:24.608125 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-d46a1f81-d9f4-421a-b295-949a7b4856b0 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f046401c6a04f6495ebe0821120bd72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a58e89ceeea4a9c8a72a1de4bcaf2d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:59:24.616277 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-d46a1f81-d9f4-421a-b295-949a7b4856b0 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] 10.222.0.11 "GET /compute/v2.1/servers/a49437df-3059-4528-8328-2f3471d5fb45" status: 200 len: 1352 microversion: 2.1 time: 0.088399 Nov 17 03:59:24.616867 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 1508/3128] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:59:24 2021] GET /compute/v2.1/servers/a49437df-3059-4528-8328-2f3471d5fb45 => generated 1352 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:59:25.633724 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-fa64189b-6bbf-4d0f-b376-dcd1ab4ec826 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:59:25.634441 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-fa64189b-6bbf-4d0f-b376-dcd1ab4ec826 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] [instance: a49437df-3059-4528-8328-2f3471d5fb45] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:59:25.640920 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-fa64189b-6bbf-4d0f-b376-dcd1ab4ec826 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:59:25.641306 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-fa64189b-6bbf-4d0f-b376-dcd1ab4ec826 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:59:25.642094 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-fa64189b-6bbf-4d0f-b376-dcd1ab4ec826 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:59:25.642698 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-fa64189b-6bbf-4d0f-b376-dcd1ab4ec826 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:59:25.713231 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-fa64189b-6bbf-4d0f-b376-dcd1ab4ec826 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f046401c6a04f6495ebe0821120bd72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a58e89ceeea4a9c8a72a1de4bcaf2d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:59:25.723161 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-fa64189b-6bbf-4d0f-b376-dcd1ab4ec826 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] 10.222.0.11 "GET /compute/v2.1/servers/a49437df-3059-4528-8328-2f3471d5fb45" status: 200 len: 1352 microversion: 2.1 time: 0.092643 Nov 17 03:59:25.723854 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 1509/3129] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:59:25 2021] GET /compute/v2.1/servers/a49437df-3059-4528-8328-2f3471d5fb45 => generated 1352 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 17 03:59:25.826532 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.wsgi [None req-c13ea38b-68eb-48a9-8f04-285ba8d7f5fa tempest-VolumesNegativeTest-1679335271 tempest-VolumesNegativeTest-1679335271-project] HTTP exception thrown: Volume 6d7eac56-10b2-4b1b-b575-bc4b537e13c0 could not be found. Nov 17 03:59:25.827196 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-c13ea38b-68eb-48a9-8f04-285ba8d7f5fa tempest-VolumesNegativeTest-1679335271 tempest-VolumesNegativeTest-1679335271-project] Returning 404 to user: Volume 6d7eac56-10b2-4b1b-b575-bc4b537e13c0 could not be found. {{(pid=115917) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 17 03:59:25.828072 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-c13ea38b-68eb-48a9-8f04-285ba8d7f5fa tempest-VolumesNegativeTest-1679335271 tempest-VolumesNegativeTest-1679335271-project] 10.222.0.11 "GET /compute/v2.1/os-volumes/6d7eac56-10b2-4b1b-b575-bc4b537e13c0" status: 404 len: 109 microversion: 2.1 time: 44.107115 Nov 17 03:59:25.828623 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 1621/3130] 10.222.0.11 () {58 vars in 1244 bytes} [Wed Nov 17 03:58:41 2021] GET /compute/v2.1/os-volumes/6d7eac56-10b2-4b1b-b575-bc4b537e13c0 => generated 109 bytes in 44109 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Nov 17 03:59:26.739861 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-bfc1d00b-4317-4bab-ad37-57621223fe10 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:59:26.740607 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-bfc1d00b-4317-4bab-ad37-57621223fe10 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] [instance: a49437df-3059-4528-8328-2f3471d5fb45] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:59:26.746875 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-bfc1d00b-4317-4bab-ad37-57621223fe10 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:59:26.747323 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-bfc1d00b-4317-4bab-ad37-57621223fe10 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:59:26.748099 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-bfc1d00b-4317-4bab-ad37-57621223fe10 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:59:26.748725 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-bfc1d00b-4317-4bab-ad37-57621223fe10 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:59:26.762262 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.wsgi [None req-bfc1d00b-4317-4bab-ad37-57621223fe10 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] HTTP exception thrown: Instance a49437df-3059-4528-8328-2f3471d5fb45 could not be found. Nov 17 03:59:26.762860 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-bfc1d00b-4317-4bab-ad37-57621223fe10 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] Returning 404 to user: Instance a49437df-3059-4528-8328-2f3471d5fb45 could not be found. {{(pid=115916) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 17 03:59:26.763684 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-bfc1d00b-4317-4bab-ad37-57621223fe10 tempest-ServerRescueNegativeTestJSON-205595779 tempest-ServerRescueNegativeTestJSON-205595779-project] 10.222.0.11 "GET /compute/v2.1/servers/a49437df-3059-4528-8328-2f3471d5fb45" status: 404 len: 111 microversion: 2.1 time: 0.027746 Nov 17 03:59:26.764411 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 1510/3131] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:59:26 2021] GET /compute/v2.1/servers/a49437df-3059-4528-8328-2f3471d5fb45 => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 17 03:59:30.402578 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [req-ad0a5d8b-9089-4149-b0ff-fc6a1245f1b0 req-7767a088-505b-4cea-a90b-7f98accf35ab service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "15abb40f-daf9-4c4b-ac9c-55f57ee7b938", "name": "network-vif-deleted", "tag": "b4c43900-e1e8-426d-b98e-b87ad7f920f6"}]} {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 17 03:59:30.404201 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 17 03:59:30.404201 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: warnings.warn(msg) Nov 17 03:59:30.416142 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [req-ad0a5d8b-9089-4149-b0ff-fc6a1245f1b0 req-7767a088-505b-4cea-a90b-7f98accf35ab service nova] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:59:30.416585 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [req-ad0a5d8b-9089-4149-b0ff-fc6a1245f1b0 req-7767a088-505b-4cea-a90b-7f98accf35ab service nova] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:59:30.428324 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.compute.server_external_events [req-ad0a5d8b-9089-4149-b0ff-fc6a1245f1b0 req-7767a088-505b-4cea-a90b-7f98accf35ab service nova] Creating event network-vif-deleted:b4c43900-e1e8-426d-b98e-b87ad7f920f6 for instance 15abb40f-daf9-4c4b-ac9c-55f57ee7b938 on hv-cinder-81803 Nov 17 03:59:30.433493 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [req-ad0a5d8b-9089-4149-b0ff-fc6a1245f1b0 req-7767a088-505b-4cea-a90b-7f98accf35ab service nova] 10.222.0.11 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034690 Nov 17 03:59:30.434566 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 1622/3132] 10.222.0.11 () {64 vars in 1317 bytes} [Wed Nov 17 03:59:30 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 17 03:59:33.579342 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-969d414a-51ed-4545-9f45-b4d268cede84 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-425207531", "imageRef": "7281a37a-6b99-49c1-881a-41604d06bae1", "flavorRef": "452", "networks": [{"uuid": "eb5a5499-be89-4de3-a9a9-0707395984da"}]}} {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 17 03:59:33.645455 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.network.neutron [None req-969d414a-51ed-4545-9f45-b4d268cede84 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] validate_networks() for [('eb5a5499-be89-4de3-a9a9-0707395984da', None, None, None, None, None)] {{(pid=115916) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Nov 17 03:59:34.046092 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.virt.hardware [None req-969d414a-51ed-4545-9f45-b4d268cede84 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Flavor limits 0:0:0 {{(pid=115916) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 17 03:59:34.046519 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.virt.hardware [None req-969d414a-51ed-4545-9f45-b4d268cede84 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Image limits 0:0:0 {{(pid=115916) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 17 03:59:34.047222 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.virt.hardware [None req-969d414a-51ed-4545-9f45-b4d268cede84 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Flavor pref 0:0:0 {{(pid=115916) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 17 03:59:34.047635 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.virt.hardware [None req-969d414a-51ed-4545-9f45-b4d268cede84 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Image pref 0:0:0 {{(pid=115916) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 17 03:59:34.048049 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.virt.hardware [None req-969d414a-51ed-4545-9f45-b4d268cede84 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=115916) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 17 03:59:34.058714 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-969d414a-51ed-4545-9f45-b4d268cede84 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:59:34.059524 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-969d414a-51ed-4545-9f45-b4d268cede84 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:59:34.060547 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-969d414a-51ed-4545-9f45-b4d268cede84 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:59:34.062826 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-969d414a-51ed-4545-9f45-b4d268cede84 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:59:34.082020 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.quota [None req-969d414a-51ed-4545-9f45-b4d268cede84 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Getting quotas for project 1e843a3fb49f41dcb376184d7e156528. Resources: {'instances', 'ram', 'cores'} {{(pid=115916) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 17 03:59:34.086904 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.quota [None req-969d414a-51ed-4545-9f45-b4d268cede84 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Getting quotas for user a792b5b7e6f7461b8d802a5abaaa9518 and project 1e843a3fb49f41dcb376184d7e156528. Resources: {'instances', 'ram', 'cores'} {{(pid=115916) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 17 03:59:34.098546 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-969d414a-51ed-4545-9f45-b4d268cede84 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Going to run 1 instances... {{(pid=115916) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 17 03:59:34.101127 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-969d414a-51ed-4545-9f45-b4d268cede84 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] [instance: 9658f2c6-3d5b-46e8-95c3-7fdde8299cff] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='7281a37a-6b99-49c1-881a-41604d06bae1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=115916) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 17 03:59:34.147594 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: ERROR oslo.messaging._drivers.impl_rabbit [None req-969d414a-51ed-4545-9f45-b4d268cede84 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] [2ab6d147-ac8d-4d8d-946f-e16cd5fb6d20] AMQP server on 10.222.0.11:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Nov 17 03:59:35.167017 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO oslo.messaging._drivers.impl_rabbit [None req-969d414a-51ed-4545-9f45-b4d268cede84 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] [2ab6d147-ac8d-4d8d-946f-e16cd5fb6d20] Reconnected to AMQP server on 10.222.0.11:5672 via [amqp] client with port 47294. Nov 17 03:59:35.171832 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-969d414a-51ed-4545-9f45-b4d268cede84 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] 10.222.0.11 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.597359 Nov 17 03:59:35.172765 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 1511/3133] 10.222.0.11 () {60 vars in 1146 bytes} [Wed Nov 17 03:59:33 2021] POST /compute/v2.1/servers => generated 380 bytes in 1599 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 17 03:59:35.185685 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-cd994462-904b-4ef0-b07b-d8219b9d8fb5 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:59:35.187391 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-cd994462-904b-4ef0-b07b-d8219b9d8fb5 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] [instance: 9658f2c6-3d5b-46e8-95c3-7fdde8299cff] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:59:35.250933 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-cd994462-904b-4ef0-b07b-d8219b9d8fb5 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a792b5b7e6f7461b8d802a5abaaa9518', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e843a3fb49f41dcb376184d7e156528', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:59:35.260897 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-cd994462-904b-4ef0-b07b-d8219b9d8fb5 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] 10.222.0.11 "GET /compute/v2.1/servers/9658f2c6-3d5b-46e8-95c3-7fdde8299cff" status: 200 len: 1218 microversion: 2.1 time: 0.079594 Nov 17 03:59:35.262189 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 1623/3134] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:59:35 2021] GET /compute/v2.1/servers/9658f2c6-3d5b-46e8-95c3-7fdde8299cff => generated 1218 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:59:36.279066 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-c21b61da-7fc9-4c3a-8787-c3914dc93f39 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:59:36.279684 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-c21b61da-7fc9-4c3a-8787-c3914dc93f39 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] [instance: 9658f2c6-3d5b-46e8-95c3-7fdde8299cff] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:59:36.287538 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-c21b61da-7fc9-4c3a-8787-c3914dc93f39 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:59:36.288248 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-c21b61da-7fc9-4c3a-8787-c3914dc93f39 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:59:36.289113 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-c21b61da-7fc9-4c3a-8787-c3914dc93f39 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:59:36.290465 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-c21b61da-7fc9-4c3a-8787-c3914dc93f39 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:59:36.416699 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-c21b61da-7fc9-4c3a-8787-c3914dc93f39 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a792b5b7e6f7461b8d802a5abaaa9518', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e843a3fb49f41dcb376184d7e156528', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:59:36.427830 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-c21b61da-7fc9-4c3a-8787-c3914dc93f39 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] 10.222.0.11 "GET /compute/v2.1/servers/9658f2c6-3d5b-46e8-95c3-7fdde8299cff" status: 200 len: 1270 microversion: 2.1 time: 0.152921 Nov 17 03:59:36.428527 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 1512/3135] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:59:36 2021] GET /compute/v2.1/servers/9658f2c6-3d5b-46e8-95c3-7fdde8299cff => generated 1270 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:59:37.446896 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-38a2d51c-fb30-4cfe-a948-c578aec299f3 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:59:37.447524 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-38a2d51c-fb30-4cfe-a948-c578aec299f3 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] [instance: 9658f2c6-3d5b-46e8-95c3-7fdde8299cff] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:59:37.461017 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-38a2d51c-fb30-4cfe-a948-c578aec299f3 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:59:37.461477 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-38a2d51c-fb30-4cfe-a948-c578aec299f3 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:59:37.464610 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-38a2d51c-fb30-4cfe-a948-c578aec299f3 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:59:37.465099 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-38a2d51c-fb30-4cfe-a948-c578aec299f3 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:59:37.627171 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-38a2d51c-fb30-4cfe-a948-c578aec299f3 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a792b5b7e6f7461b8d802a5abaaa9518', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e843a3fb49f41dcb376184d7e156528', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:59:37.639436 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-38a2d51c-fb30-4cfe-a948-c578aec299f3 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] 10.222.0.11 "GET /compute/v2.1/servers/9658f2c6-3d5b-46e8-95c3-7fdde8299cff" status: 200 len: 1318 microversion: 2.1 time: 0.197573 Nov 17 03:59:37.640526 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 1624/3136] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:59:37 2021] GET /compute/v2.1/servers/9658f2c6-3d5b-46e8-95c3-7fdde8299cff => generated 1318 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 17 03:59:38.420103 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [req-d9dd4658-5054-4088-9737-d15b88a9930d req-796bfeab-e686-4371-8a97-a2b4eaa05553 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9658f2c6-3d5b-46e8-95c3-7fdde8299cff", "tag": "3e230f19-511e-47a4-837e-112f58bfba7a"}]} {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 17 03:59:38.421910 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 17 03:59:38.421910 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: warnings.warn(msg) Nov 17 03:59:38.434778 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [req-d9dd4658-5054-4088-9737-d15b88a9930d req-796bfeab-e686-4371-8a97-a2b4eaa05553 service nova] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:59:38.435082 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [req-d9dd4658-5054-4088-9737-d15b88a9930d req-796bfeab-e686-4371-8a97-a2b4eaa05553 service nova] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:59:38.447782 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.compute.server_external_events [req-d9dd4658-5054-4088-9737-d15b88a9930d req-796bfeab-e686-4371-8a97-a2b4eaa05553 service nova] Creating event network-changed:3e230f19-511e-47a4-837e-112f58bfba7a for instance 9658f2c6-3d5b-46e8-95c3-7fdde8299cff on hv-cinder-81803 Nov 17 03:59:38.451346 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: ERROR oslo.messaging._drivers.impl_rabbit [req-d9dd4658-5054-4088-9737-d15b88a9930d req-796bfeab-e686-4371-8a97-a2b4eaa05553 service nova] [201d3e2d-67a7-4ecf-8825-2618ae09d16b] AMQP server on 10.222.0.11:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Nov 17 03:59:38.657813 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-1f4f5e5f-e62c-43d4-a047-d688870d5e2d tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:59:38.658428 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-1f4f5e5f-e62c-43d4-a047-d688870d5e2d tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] [instance: 9658f2c6-3d5b-46e8-95c3-7fdde8299cff] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:59:38.664943 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-1f4f5e5f-e62c-43d4-a047-d688870d5e2d tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:59:38.665393 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-1f4f5e5f-e62c-43d4-a047-d688870d5e2d tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:59:38.666167 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-1f4f5e5f-e62c-43d4-a047-d688870d5e2d tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:59:38.666605 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-1f4f5e5f-e62c-43d4-a047-d688870d5e2d tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:59:38.826103 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-1f4f5e5f-e62c-43d4-a047-d688870d5e2d tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a792b5b7e6f7461b8d802a5abaaa9518', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e843a3fb49f41dcb376184d7e156528', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:59:38.837165 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-1f4f5e5f-e62c-43d4-a047-d688870d5e2d tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] 10.222.0.11 "GET /compute/v2.1/servers/9658f2c6-3d5b-46e8-95c3-7fdde8299cff" status: 200 len: 1318 microversion: 2.1 time: 0.183113 Nov 17 03:59:38.837847 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 1625/3137] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:59:38 2021] GET /compute/v2.1/servers/9658f2c6-3d5b-46e8-95c3-7fdde8299cff => generated 1318 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:59:39.469931 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO oslo.messaging._drivers.impl_rabbit [req-d9dd4658-5054-4088-9737-d15b88a9930d req-796bfeab-e686-4371-8a97-a2b4eaa05553 service nova] [201d3e2d-67a7-4ecf-8825-2618ae09d16b] Reconnected to AMQP server on 10.222.0.11:5672 via [amqp] client with port 47470. Nov 17 03:59:39.474456 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [req-d9dd4658-5054-4088-9737-d15b88a9930d req-796bfeab-e686-4371-8a97-a2b4eaa05553 service nova] 10.222.0.11 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 1.058395 Nov 17 03:59:39.475082 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 1513/3138] 10.222.0.11 () {64 vars in 1317 bytes} [Wed Nov 17 03:59:38 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 1060 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 17 03:59:39.861218 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-bf66e4df-90c6-4f61-8170-32b3b9de1c23 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:59:39.861218 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-bf66e4df-90c6-4f61-8170-32b3b9de1c23 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] [instance: 9658f2c6-3d5b-46e8-95c3-7fdde8299cff] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:59:39.862691 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-bf66e4df-90c6-4f61-8170-32b3b9de1c23 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:59:39.863411 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-bf66e4df-90c6-4f61-8170-32b3b9de1c23 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:59:39.864407 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-bf66e4df-90c6-4f61-8170-32b3b9de1c23 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:59:39.864997 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-bf66e4df-90c6-4f61-8170-32b3b9de1c23 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:59:40.049047 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-bf66e4df-90c6-4f61-8170-32b3b9de1c23 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a792b5b7e6f7461b8d802a5abaaa9518', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e843a3fb49f41dcb376184d7e156528', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:59:40.063050 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-bf66e4df-90c6-4f61-8170-32b3b9de1c23 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] 10.222.0.11 "GET /compute/v2.1/servers/9658f2c6-3d5b-46e8-95c3-7fdde8299cff" status: 200 len: 1318 microversion: 2.1 time: 0.213507 Nov 17 03:59:40.063726 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 1626/3139] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:59:39 2021] GET /compute/v2.1/servers/9658f2c6-3d5b-46e8-95c3-7fdde8299cff => generated 1318 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:59:41.083431 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-e196051d-7781-4aec-8dde-92c5febc8431 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:59:41.084143 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-e196051d-7781-4aec-8dde-92c5febc8431 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] [instance: 9658f2c6-3d5b-46e8-95c3-7fdde8299cff] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:59:41.090697 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-e196051d-7781-4aec-8dde-92c5febc8431 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:59:41.091141 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-e196051d-7781-4aec-8dde-92c5febc8431 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:59:41.091914 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-e196051d-7781-4aec-8dde-92c5febc8431 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:59:41.092340 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-e196051d-7781-4aec-8dde-92c5febc8431 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:59:41.235212 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-e196051d-7781-4aec-8dde-92c5febc8431 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a792b5b7e6f7461b8d802a5abaaa9518', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e843a3fb49f41dcb376184d7e156528', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:59:41.242535 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-e196051d-7781-4aec-8dde-92c5febc8431 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] 10.222.0.11 "GET /compute/v2.1/servers/9658f2c6-3d5b-46e8-95c3-7fdde8299cff" status: 200 len: 1318 microversion: 2.1 time: 0.164505 Nov 17 03:59:41.243103 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 1514/3140] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:59:41 2021] GET /compute/v2.1/servers/9658f2c6-3d5b-46e8-95c3-7fdde8299cff => generated 1318 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:59:42.260551 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-9f0fb200-5305-4ed4-84e3-f3faa0d1aa1b tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:59:42.261770 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-9f0fb200-5305-4ed4-84e3-f3faa0d1aa1b tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] [instance: 9658f2c6-3d5b-46e8-95c3-7fdde8299cff] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:59:42.268356 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-9f0fb200-5305-4ed4-84e3-f3faa0d1aa1b tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:59:42.268905 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-9f0fb200-5305-4ed4-84e3-f3faa0d1aa1b tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:59:42.269797 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-9f0fb200-5305-4ed4-84e3-f3faa0d1aa1b tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:59:42.270300 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-9f0fb200-5305-4ed4-84e3-f3faa0d1aa1b tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:59:42.417664 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-9f0fb200-5305-4ed4-84e3-f3faa0d1aa1b tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a792b5b7e6f7461b8d802a5abaaa9518', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e843a3fb49f41dcb376184d7e156528', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:59:42.426831 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-9f0fb200-5305-4ed4-84e3-f3faa0d1aa1b tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] 10.222.0.11 "GET /compute/v2.1/servers/9658f2c6-3d5b-46e8-95c3-7fdde8299cff" status: 200 len: 1318 microversion: 2.1 time: 0.170916 Nov 17 03:59:42.427460 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 1627/3141] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:59:42 2021] GET /compute/v2.1/servers/9658f2c6-3d5b-46e8-95c3-7fdde8299cff => generated 1318 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:59:43.447264 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-81c226ec-f8b5-4e7a-997e-1ed2c0642485 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:59:43.447974 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-81c226ec-f8b5-4e7a-997e-1ed2c0642485 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] [instance: 9658f2c6-3d5b-46e8-95c3-7fdde8299cff] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:59:43.457072 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-81c226ec-f8b5-4e7a-997e-1ed2c0642485 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:59:43.457612 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-81c226ec-f8b5-4e7a-997e-1ed2c0642485 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:59:43.458460 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-81c226ec-f8b5-4e7a-997e-1ed2c0642485 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:59:43.459476 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-81c226ec-f8b5-4e7a-997e-1ed2c0642485 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:59:43.606078 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-81c226ec-f8b5-4e7a-997e-1ed2c0642485 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a792b5b7e6f7461b8d802a5abaaa9518', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e843a3fb49f41dcb376184d7e156528', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:59:43.618039 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-81c226ec-f8b5-4e7a-997e-1ed2c0642485 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] 10.222.0.11 "GET /compute/v2.1/servers/9658f2c6-3d5b-46e8-95c3-7fdde8299cff" status: 200 len: 1318 microversion: 2.1 time: 0.173136 Nov 17 03:59:43.618039 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 1515/3142] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:59:43 2021] GET /compute/v2.1/servers/9658f2c6-3d5b-46e8-95c3-7fdde8299cff => generated 1318 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:59:43.645223 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [req-47f446bb-f2d4-49c9-b97b-3665c90235cc req-4f49dc91-85a3-48c4-960e-dbd6cf094a0d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9658f2c6-3d5b-46e8-95c3-7fdde8299cff", "name": "network-vif-plugged", "status": "completed", "tag": "3e230f19-511e-47a4-837e-112f58bfba7a"}]} {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 17 03:59:43.646821 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 17 03:59:43.646821 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: warnings.warn(msg) Nov 17 03:59:43.654635 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [req-47f446bb-f2d4-49c9-b97b-3665c90235cc req-4f49dc91-85a3-48c4-960e-dbd6cf094a0d service nova] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:59:43.655468 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [req-47f446bb-f2d4-49c9-b97b-3665c90235cc req-4f49dc91-85a3-48c4-960e-dbd6cf094a0d service nova] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:59:43.668916 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.compute.server_external_events [req-47f446bb-f2d4-49c9-b97b-3665c90235cc req-4f49dc91-85a3-48c4-960e-dbd6cf094a0d service nova] Creating event network-vif-plugged:3e230f19-511e-47a4-837e-112f58bfba7a for instance 9658f2c6-3d5b-46e8-95c3-7fdde8299cff on hv-cinder-81803 Nov 17 03:59:43.674136 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [req-47f446bb-f2d4-49c9-b97b-3665c90235cc req-4f49dc91-85a3-48c4-960e-dbd6cf094a0d service nova] 10.222.0.11 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033005 Nov 17 03:59:43.674759 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 1628/3143] 10.222.0.11 () {64 vars in 1317 bytes} [Wed Nov 17 03:59:43 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 17 03:59:44.633393 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-5bbc88e3-0bb6-4c23-8e48-d3230f6bda95 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:59:44.634314 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-5bbc88e3-0bb6-4c23-8e48-d3230f6bda95 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] [instance: 9658f2c6-3d5b-46e8-95c3-7fdde8299cff] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:59:44.643275 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-5bbc88e3-0bb6-4c23-8e48-d3230f6bda95 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:59:44.643725 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-5bbc88e3-0bb6-4c23-8e48-d3230f6bda95 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:59:44.644481 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-5bbc88e3-0bb6-4c23-8e48-d3230f6bda95 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:59:44.644942 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-5bbc88e3-0bb6-4c23-8e48-d3230f6bda95 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:59:44.796144 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-5bbc88e3-0bb6-4c23-8e48-d3230f6bda95 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a792b5b7e6f7461b8d802a5abaaa9518', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e843a3fb49f41dcb376184d7e156528', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:59:44.804235 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-5bbc88e3-0bb6-4c23-8e48-d3230f6bda95 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] 10.222.0.11 "GET /compute/v2.1/servers/9658f2c6-3d5b-46e8-95c3-7fdde8299cff" status: 200 len: 1318 microversion: 2.1 time: 0.175960 Nov 17 03:59:44.804869 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 1516/3144] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:59:44 2021] GET /compute/v2.1/servers/9658f2c6-3d5b-46e8-95c3-7fdde8299cff => generated 1318 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:59:45.826775 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-e9b2b96d-7ced-4e89-94e4-4105afc93c0f tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:59:45.827917 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-e9b2b96d-7ced-4e89-94e4-4105afc93c0f tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] [instance: 9658f2c6-3d5b-46e8-95c3-7fdde8299cff] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:59:45.840615 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-e9b2b96d-7ced-4e89-94e4-4105afc93c0f tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:59:45.841397 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-e9b2b96d-7ced-4e89-94e4-4105afc93c0f tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:59:45.842671 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-e9b2b96d-7ced-4e89-94e4-4105afc93c0f tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:59:45.843376 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-e9b2b96d-7ced-4e89-94e4-4105afc93c0f tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:59:45.979450 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-e9b2b96d-7ced-4e89-94e4-4105afc93c0f tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a792b5b7e6f7461b8d802a5abaaa9518', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e843a3fb49f41dcb376184d7e156528', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:59:45.987834 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-e9b2b96d-7ced-4e89-94e4-4105afc93c0f tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] 10.222.0.11 "GET /compute/v2.1/servers/9658f2c6-3d5b-46e8-95c3-7fdde8299cff" status: 200 len: 1318 microversion: 2.1 time: 0.168536 Nov 17 03:59:45.988439 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 1629/3145] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:59:45 2021] GET /compute/v2.1/servers/9658f2c6-3d5b-46e8-95c3-7fdde8299cff => generated 1318 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:59:47.014451 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-557a3ff8-4156-416a-baf0-ccb44fce59be tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:59:47.015377 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-557a3ff8-4156-416a-baf0-ccb44fce59be tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] [instance: 9658f2c6-3d5b-46e8-95c3-7fdde8299cff] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:59:47.024161 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-557a3ff8-4156-416a-baf0-ccb44fce59be tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:59:47.024613 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-557a3ff8-4156-416a-baf0-ccb44fce59be tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:59:47.025500 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-557a3ff8-4156-416a-baf0-ccb44fce59be tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:59:47.025908 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-557a3ff8-4156-416a-baf0-ccb44fce59be tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:59:47.165316 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-557a3ff8-4156-416a-baf0-ccb44fce59be tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a792b5b7e6f7461b8d802a5abaaa9518', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e843a3fb49f41dcb376184d7e156528', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:59:47.173317 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-557a3ff8-4156-416a-baf0-ccb44fce59be tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] 10.222.0.11 "GET /compute/v2.1/servers/9658f2c6-3d5b-46e8-95c3-7fdde8299cff" status: 200 len: 1318 microversion: 2.1 time: 0.165012 Nov 17 03:59:47.173853 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 1517/3146] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:59:47 2021] GET /compute/v2.1/servers/9658f2c6-3d5b-46e8-95c3-7fdde8299cff => generated 1318 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:59:48.196438 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-5bed34da-3052-4119-8dc0-0c37220abee3 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:59:48.197043 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-5bed34da-3052-4119-8dc0-0c37220abee3 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] [instance: 9658f2c6-3d5b-46e8-95c3-7fdde8299cff] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:59:48.204207 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-5bed34da-3052-4119-8dc0-0c37220abee3 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:59:48.204649 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-5bed34da-3052-4119-8dc0-0c37220abee3 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:59:48.205495 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-5bed34da-3052-4119-8dc0-0c37220abee3 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:59:48.206004 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-5bed34da-3052-4119-8dc0-0c37220abee3 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:59:48.352223 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-5bed34da-3052-4119-8dc0-0c37220abee3 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a792b5b7e6f7461b8d802a5abaaa9518', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e843a3fb49f41dcb376184d7e156528', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:59:48.359683 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-5bed34da-3052-4119-8dc0-0c37220abee3 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] 10.222.0.11 "GET /compute/v2.1/servers/9658f2c6-3d5b-46e8-95c3-7fdde8299cff" status: 200 len: 1318 microversion: 2.1 time: 0.167611 Nov 17 03:59:48.360452 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 1630/3147] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:59:48 2021] GET /compute/v2.1/servers/9658f2c6-3d5b-46e8-95c3-7fdde8299cff => generated 1318 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:59:49.376916 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-5c1e429e-092b-4d53-aca3-d81bc1c009ed tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 03:59:49.377749 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-5c1e429e-092b-4d53-aca3-d81bc1c009ed tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] [instance: 9658f2c6-3d5b-46e8-95c3-7fdde8299cff] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:59:49.384496 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-5c1e429e-092b-4d53-aca3-d81bc1c009ed tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:59:49.384986 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-5c1e429e-092b-4d53-aca3-d81bc1c009ed tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:59:49.385755 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-5c1e429e-092b-4d53-aca3-d81bc1c009ed tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:59:49.386186 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-5c1e429e-092b-4d53-aca3-d81bc1c009ed tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:59:49.532487 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-5c1e429e-092b-4d53-aca3-d81bc1c009ed tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a792b5b7e6f7461b8d802a5abaaa9518', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e843a3fb49f41dcb376184d7e156528', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 03:59:49.540208 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-5c1e429e-092b-4d53-aca3-d81bc1c009ed tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] 10.222.0.11 "GET /compute/v2.1/servers/9658f2c6-3d5b-46e8-95c3-7fdde8299cff" status: 200 len: 1506 microversion: 2.1 time: 0.166989 Nov 17 03:59:49.540927 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 1518/3148] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 03:59:49 2021] GET /compute/v2.1/servers/9658f2c6-3d5b-46e8-95c3-7fdde8299cff => generated 1506 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 03:59:49.557752 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-87b1c29e-592e-4790-86ae-93a2b0af585f tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "9983a6d1-c5a0-4f96-8a08-5b4c0361756f", "device": "/dev/sdb"}} {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 17 03:59:49.560097 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-87b1c29e-592e-4790-86ae-93a2b0af585f tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] [instance: 9658f2c6-3d5b-46e8-95c3-7fdde8299cff] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 03:59:49.566623 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-87b1c29e-592e-4790-86ae-93a2b0af585f tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:59:49.567061 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-87b1c29e-592e-4790-86ae-93a2b0af585f tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:59:49.567871 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-87b1c29e-592e-4790-86ae-93a2b0af585f tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 03:59:49.568294 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-87b1c29e-592e-4790-86ae-93a2b0af585f tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 03:59:49.840039 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-87b1c29e-592e-4790-86ae-93a2b0af585f tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] 10.222.0.11 "POST /compute/v2.1/servers/9658f2c6-3d5b-46e8-95c3-7fdde8299cff/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.285640 Nov 17 03:59:49.840660 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 1631/3149] 10.222.0.11 () {60 vars in 1322 bytes} [Wed Nov 17 03:59:49 2021] POST /compute/v2.1/servers/9658f2c6-3d5b-46e8-95c3-7fdde8299cff/os-volume_attachments => generated 194 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 17 04:00:10.020878 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 17 04:00:10.021397 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: Wed Nov 17 04:00:10 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Nov 17 04:00:15.377197 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-07c2dc44-35b3-41b1-9395-72b582a8de98 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 04:00:15.377866 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-07c2dc44-35b3-41b1-9395-72b582a8de98 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] [instance: 9658f2c6-3d5b-46e8-95c3-7fdde8299cff] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 04:00:15.384415 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-07c2dc44-35b3-41b1-9395-72b582a8de98 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 04:00:15.384902 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-07c2dc44-35b3-41b1-9395-72b582a8de98 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 04:00:15.385678 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-07c2dc44-35b3-41b1-9395-72b582a8de98 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 04:00:15.386250 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-07c2dc44-35b3-41b1-9395-72b582a8de98 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 04:00:15.475880 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.objects.instance [None req-07c2dc44-35b3-41b1-9395-72b582a8de98 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Lazy-loading 'services' on Instance uuid 9658f2c6-3d5b-46e8-95c3-7fdde8299cff {{(pid=115916) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Nov 17 04:00:15.550347 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-07c2dc44-35b3-41b1-9395-72b582a8de98 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] 10.222.0.11 "DELETE /compute/v2.1/servers/9658f2c6-3d5b-46e8-95c3-7fdde8299cff/os-volume_attachments/9983a6d1-c5a0-4f96-8a08-5b4c0361756f" status: 202 len: 0 microversion: 2.1 time: 0.176427 Nov 17 04:00:15.551072 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 1519/3150] 10.222.0.11 () {58 vars in 1415 bytes} [Wed Nov 17 04:00:15 2021] DELETE /compute/v2.1/servers/9658f2c6-3d5b-46e8-95c3-7fdde8299cff/os-volume_attachments/9983a6d1-c5a0-4f96-8a08-5b4c0361756f => generated 0 bytes in 178 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 17 04:00:16.675247 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-ee235627-72af-467d-a30b-efb0d13a6064 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 04:00:16.676516 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-ee235627-72af-467d-a30b-efb0d13a6064 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] [instance: 9658f2c6-3d5b-46e8-95c3-7fdde8299cff] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 04:00:16.683675 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-ee235627-72af-467d-a30b-efb0d13a6064 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 04:00:16.684411 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-ee235627-72af-467d-a30b-efb0d13a6064 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 04:00:16.685482 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-ee235627-72af-467d-a30b-efb0d13a6064 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 04:00:16.686087 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-ee235627-72af-467d-a30b-efb0d13a6064 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 04:00:16.719588 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-ee235627-72af-467d-a30b-efb0d13a6064 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] [instance: 9658f2c6-3d5b-46e8-95c3-7fdde8299cff] Going to try to terminate instance {{(pid=115917) delete /opt/stack/nova/nova/compute/api.py:2614}} Nov 17 04:00:16.797436 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-ee235627-72af-467d-a30b-efb0d13a6064 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] 10.222.0.11 "DELETE /compute/v2.1/servers/9658f2c6-3d5b-46e8-95c3-7fdde8299cff" status: 204 len: 0 microversion: 2.1 time: 0.126651 Nov 17 04:00:16.798106 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 1632/3151] 10.222.0.11 () {58 vars in 1238 bytes} [Wed Nov 17 04:00:16 2021] DELETE /compute/v2.1/servers/9658f2c6-3d5b-46e8-95c3-7fdde8299cff => generated 0 bytes in 128 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 17 04:00:16.808726 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-d71d7b40-a054-4296-a93f-bd58d8cd3168 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 04:00:16.809464 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-d71d7b40-a054-4296-a93f-bd58d8cd3168 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] [instance: 9658f2c6-3d5b-46e8-95c3-7fdde8299cff] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 04:00:16.815835 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-d71d7b40-a054-4296-a93f-bd58d8cd3168 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 04:00:16.816344 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-d71d7b40-a054-4296-a93f-bd58d8cd3168 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 04:00:16.817180 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-d71d7b40-a054-4296-a93f-bd58d8cd3168 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 04:00:16.817612 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-d71d7b40-a054-4296-a93f-bd58d8cd3168 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 04:00:16.951962 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-d71d7b40-a054-4296-a93f-bd58d8cd3168 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a792b5b7e6f7461b8d802a5abaaa9518', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e843a3fb49f41dcb376184d7e156528', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 04:00:16.959968 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-d71d7b40-a054-4296-a93f-bd58d8cd3168 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] 10.222.0.11 "GET /compute/v2.1/servers/9658f2c6-3d5b-46e8-95c3-7fdde8299cff" status: 200 len: 1512 microversion: 2.1 time: 0.156147 Nov 17 04:00:16.960656 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 1520/3152] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 04:00:16 2021] GET /compute/v2.1/servers/9658f2c6-3d5b-46e8-95c3-7fdde8299cff => generated 1512 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 04:00:17.978596 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-8837cca3-00e8-45d7-ba3b-a6d521103b2c tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 04:00:17.979465 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-8837cca3-00e8-45d7-ba3b-a6d521103b2c tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] [instance: 9658f2c6-3d5b-46e8-95c3-7fdde8299cff] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 04:00:17.986394 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-8837cca3-00e8-45d7-ba3b-a6d521103b2c tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 04:00:17.987107 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-8837cca3-00e8-45d7-ba3b-a6d521103b2c tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 04:00:17.988105 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-8837cca3-00e8-45d7-ba3b-a6d521103b2c tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 04:00:17.988688 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-8837cca3-00e8-45d7-ba3b-a6d521103b2c tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 04:00:18.130900 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-8837cca3-00e8-45d7-ba3b-a6d521103b2c tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a792b5b7e6f7461b8d802a5abaaa9518', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e843a3fb49f41dcb376184d7e156528', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 04:00:18.141789 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-8837cca3-00e8-45d7-ba3b-a6d521103b2c tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] 10.222.0.11 "GET /compute/v2.1/servers/9658f2c6-3d5b-46e8-95c3-7fdde8299cff" status: 200 len: 1512 microversion: 2.1 time: 0.167536 Nov 17 04:00:18.142464 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 1633/3153] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 04:00:17 2021] GET /compute/v2.1/servers/9658f2c6-3d5b-46e8-95c3-7fdde8299cff => generated 1512 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 17 04:00:19.160701 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-73798688-983d-4474-8c9a-092b75566cee tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 04:00:19.161342 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-73798688-983d-4474-8c9a-092b75566cee tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] [instance: 9658f2c6-3d5b-46e8-95c3-7fdde8299cff] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 04:00:19.167995 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-73798688-983d-4474-8c9a-092b75566cee tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 04:00:19.168460 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-73798688-983d-4474-8c9a-092b75566cee tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 04:00:19.169278 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-73798688-983d-4474-8c9a-092b75566cee tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 04:00:19.169711 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-73798688-983d-4474-8c9a-092b75566cee tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 04:00:19.301770 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-73798688-983d-4474-8c9a-092b75566cee tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a792b5b7e6f7461b8d802a5abaaa9518', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e843a3fb49f41dcb376184d7e156528', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 04:00:19.309474 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-73798688-983d-4474-8c9a-092b75566cee tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] 10.222.0.11 "GET /compute/v2.1/servers/9658f2c6-3d5b-46e8-95c3-7fdde8299cff" status: 200 len: 1512 microversion: 2.1 time: 0.152536 Nov 17 04:00:19.310050 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 1521/3154] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 04:00:19 2021] GET /compute/v2.1/servers/9658f2c6-3d5b-46e8-95c3-7fdde8299cff => generated 1512 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 04:00:20.560736 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-2273be8c-e932-49cd-84a9-a46ee96b7c92 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 04:00:20.561385 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-2273be8c-e932-49cd-84a9-a46ee96b7c92 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] [instance: 9658f2c6-3d5b-46e8-95c3-7fdde8299cff] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 04:00:20.567680 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-2273be8c-e932-49cd-84a9-a46ee96b7c92 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 04:00:20.568125 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-2273be8c-e932-49cd-84a9-a46ee96b7c92 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 04:00:20.568928 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-2273be8c-e932-49cd-84a9-a46ee96b7c92 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 04:00:20.569353 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-2273be8c-e932-49cd-84a9-a46ee96b7c92 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 04:00:20.702266 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-2273be8c-e932-49cd-84a9-a46ee96b7c92 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a792b5b7e6f7461b8d802a5abaaa9518', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e843a3fb49f41dcb376184d7e156528', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 04:00:20.714112 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-2273be8c-e932-49cd-84a9-a46ee96b7c92 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] 10.222.0.11 "GET /compute/v2.1/servers/9658f2c6-3d5b-46e8-95c3-7fdde8299cff" status: 200 len: 1512 microversion: 2.1 time: 0.391469 Nov 17 04:00:20.714866 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 1634/3155] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 04:00:20 2021] GET /compute/v2.1/servers/9658f2c6-3d5b-46e8-95c3-7fdde8299cff => generated 1512 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 04:00:21.732007 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-a6e563ee-b598-466d-afda-8f755531dd6a tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 04:00:21.732605 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-a6e563ee-b598-466d-afda-8f755531dd6a tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] [instance: 9658f2c6-3d5b-46e8-95c3-7fdde8299cff] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 04:00:21.743788 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-a6e563ee-b598-466d-afda-8f755531dd6a tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 04:00:21.743788 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-a6e563ee-b598-466d-afda-8f755531dd6a tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 04:00:21.743788 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-a6e563ee-b598-466d-afda-8f755531dd6a tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 04:00:21.743788 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-a6e563ee-b598-466d-afda-8f755531dd6a tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 04:00:21.806386 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [req-263c18cf-2c02-42bd-b804-5bf15a110a04 req-3a38fbb4-ad5a-480b-b829-03c626f5297a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9658f2c6-3d5b-46e8-95c3-7fdde8299cff", "name": "network-vif-deleted", "tag": "3e230f19-511e-47a4-837e-112f58bfba7a"}]} {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 17 04:00:21.810291 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 17 04:00:21.810291 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: warnings.warn(msg) Nov 17 04:00:21.817654 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [req-263c18cf-2c02-42bd-b804-5bf15a110a04 req-3a38fbb4-ad5a-480b-b829-03c626f5297a service nova] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 04:00:21.818179 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [req-263c18cf-2c02-42bd-b804-5bf15a110a04 req-3a38fbb4-ad5a-480b-b829-03c626f5297a service nova] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 04:00:21.821482 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-a6e563ee-b598-466d-afda-8f755531dd6a tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a792b5b7e6f7461b8d802a5abaaa9518', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e843a3fb49f41dcb376184d7e156528', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 04:00:21.829210 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-a6e563ee-b598-466d-afda-8f755531dd6a tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] 10.222.0.11 "GET /compute/v2.1/servers/9658f2c6-3d5b-46e8-95c3-7fdde8299cff" status: 200 len: 1470 microversion: 2.1 time: 0.101424 Nov 17 04:00:21.829463 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.compute.server_external_events [req-263c18cf-2c02-42bd-b804-5bf15a110a04 req-3a38fbb4-ad5a-480b-b829-03c626f5297a service nova] Creating event network-vif-deleted:3e230f19-511e-47a4-837e-112f58bfba7a for instance 9658f2c6-3d5b-46e8-95c3-7fdde8299cff on hv-cinder-81803 Nov 17 04:00:21.829791 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 1522/3156] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 04:00:21 2021] GET /compute/v2.1/servers/9658f2c6-3d5b-46e8-95c3-7fdde8299cff => generated 1470 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 04:00:21.841200 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [req-263c18cf-2c02-42bd-b804-5bf15a110a04 req-3a38fbb4-ad5a-480b-b829-03c626f5297a service nova] 10.222.0.11 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039583 Nov 17 04:00:21.841777 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 1635/3157] 10.222.0.11 () {64 vars in 1317 bytes} [Wed Nov 17 04:00:21 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 17 04:00:22.849811 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-fd12e3ff-9cee-4438-9dd1-6510cb1a194e tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 04:00:22.850396 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-fd12e3ff-9cee-4438-9dd1-6510cb1a194e tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] [instance: 9658f2c6-3d5b-46e8-95c3-7fdde8299cff] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 04:00:22.858170 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-fd12e3ff-9cee-4438-9dd1-6510cb1a194e tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 04:00:22.858617 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-fd12e3ff-9cee-4438-9dd1-6510cb1a194e tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 04:00:22.859377 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-fd12e3ff-9cee-4438-9dd1-6510cb1a194e tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 04:00:22.859802 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-fd12e3ff-9cee-4438-9dd1-6510cb1a194e tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 04:00:22.921896 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-fd12e3ff-9cee-4438-9dd1-6510cb1a194e tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a792b5b7e6f7461b8d802a5abaaa9518', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e843a3fb49f41dcb376184d7e156528', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 04:00:22.934114 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-fd12e3ff-9cee-4438-9dd1-6510cb1a194e tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] 10.222.0.11 "GET /compute/v2.1/servers/9658f2c6-3d5b-46e8-95c3-7fdde8299cff" status: 200 len: 1470 microversion: 2.1 time: 0.089809 Nov 17 04:00:22.934848 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 1523/3158] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 04:00:22 2021] GET /compute/v2.1/servers/9658f2c6-3d5b-46e8-95c3-7fdde8299cff => generated 1470 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 04:00:23.961053 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-723c646a-63b5-4503-bc57-8c190cad4e47 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 04:00:23.962187 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-723c646a-63b5-4503-bc57-8c190cad4e47 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] [instance: 9658f2c6-3d5b-46e8-95c3-7fdde8299cff] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 04:00:23.969160 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-723c646a-63b5-4503-bc57-8c190cad4e47 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 04:00:23.969600 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-723c646a-63b5-4503-bc57-8c190cad4e47 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 04:00:23.970363 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-723c646a-63b5-4503-bc57-8c190cad4e47 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 04:00:23.970785 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-723c646a-63b5-4503-bc57-8c190cad4e47 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 04:00:24.043242 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-723c646a-63b5-4503-bc57-8c190cad4e47 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a792b5b7e6f7461b8d802a5abaaa9518', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e843a3fb49f41dcb376184d7e156528', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 04:00:24.051561 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-723c646a-63b5-4503-bc57-8c190cad4e47 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] 10.222.0.11 "GET /compute/v2.1/servers/9658f2c6-3d5b-46e8-95c3-7fdde8299cff" status: 200 len: 1303 microversion: 2.1 time: 0.097967 Nov 17 04:00:24.052134 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 1636/3159] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 04:00:23 2021] GET /compute/v2.1/servers/9658f2c6-3d5b-46e8-95c3-7fdde8299cff => generated 1303 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 04:00:25.068959 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-1725e82e-3a43-405c-9bc2-3211633643b0 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 04:00:25.069579 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-1725e82e-3a43-405c-9bc2-3211633643b0 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] [instance: 9658f2c6-3d5b-46e8-95c3-7fdde8299cff] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 04:00:25.076321 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-1725e82e-3a43-405c-9bc2-3211633643b0 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 04:00:25.076765 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-1725e82e-3a43-405c-9bc2-3211633643b0 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 04:00:25.077594 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-1725e82e-3a43-405c-9bc2-3211633643b0 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 04:00:25.078025 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-1725e82e-3a43-405c-9bc2-3211633643b0 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 04:00:25.091389 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.wsgi [None req-1725e82e-3a43-405c-9bc2-3211633643b0 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] HTTP exception thrown: Instance 9658f2c6-3d5b-46e8-95c3-7fdde8299cff could not be found. Nov 17 04:00:25.092096 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-1725e82e-3a43-405c-9bc2-3211633643b0 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] Returning 404 to user: Instance 9658f2c6-3d5b-46e8-95c3-7fdde8299cff could not be found. {{(pid=115916) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 17 04:00:25.093043 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-1725e82e-3a43-405c-9bc2-3211633643b0 tempest-VolumesSnapshotTestJSON-191378920 tempest-VolumesSnapshotTestJSON-191378920-project] 10.222.0.11 "GET /compute/v2.1/servers/9658f2c6-3d5b-46e8-95c3-7fdde8299cff" status: 404 len: 111 microversion: 2.1 time: 0.027904 Nov 17 04:00:25.093543 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 1524/3160] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 04:00:25 2021] GET /compute/v2.1/servers/9658f2c6-3d5b-46e8-95c3-7fdde8299cff => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 17 04:00:51.182768 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-df5e1049-d16d-483b-a1bf-c4fc3dd8c89e tempest-TestMinimumBasicScenario-510804398 tempest-TestMinimumBasicScenario-510804398-project] Action: 'create', calling method: .version_select at 0x7f9e1d023a60>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-1353225738"}} {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 17 04:00:51.200163 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.quota [None req-df5e1049-d16d-483b-a1bf-c4fc3dd8c89e tempest-TestMinimumBasicScenario-510804398 tempest-TestMinimumBasicScenario-510804398-project] Getting quotas for project d4f4f943c957446b9fc9792385c53394. Resources: {'key_pairs'} {{(pid=115917) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 17 04:00:51.204669 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.quota [None req-df5e1049-d16d-483b-a1bf-c4fc3dd8c89e tempest-TestMinimumBasicScenario-510804398 tempest-TestMinimumBasicScenario-510804398-project] Getting quotas for user 220aa0d3d6494952b53d8d44265c4895 and project d4f4f943c957446b9fc9792385c53394. Resources: {'key_pairs'} {{(pid=115917) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 17 04:00:51.217834 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: ERROR oslo.messaging._drivers.impl_rabbit [None req-df5e1049-d16d-483b-a1bf-c4fc3dd8c89e tempest-TestMinimumBasicScenario-510804398 tempest-TestMinimumBasicScenario-510804398-project] [20b4dd9d-de6d-4c7f-bcd6-2a862e657b39] AMQP server on 10.222.0.11:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Nov 17 04:00:52.240641 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO oslo.messaging._drivers.impl_rabbit [None req-df5e1049-d16d-483b-a1bf-c4fc3dd8c89e tempest-TestMinimumBasicScenario-510804398 tempest-TestMinimumBasicScenario-510804398-project] [20b4dd9d-de6d-4c7f-bcd6-2a862e657b39] Reconnected to AMQP server on 10.222.0.11:5672 via [amqp] client with port 49178. Nov 17 04:00:52.536296 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.quota [None req-df5e1049-d16d-483b-a1bf-c4fc3dd8c89e tempest-TestMinimumBasicScenario-510804398 tempest-TestMinimumBasicScenario-510804398-project] Getting quotas for project d4f4f943c957446b9fc9792385c53394. Resources: {'key_pairs'} {{(pid=115917) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 17 04:00:52.539961 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.quota [None req-df5e1049-d16d-483b-a1bf-c4fc3dd8c89e tempest-TestMinimumBasicScenario-510804398 tempest-TestMinimumBasicScenario-510804398-project] Getting quotas for user 220aa0d3d6494952b53d8d44265c4895 and project d4f4f943c957446b9fc9792385c53394. Resources: {'key_pairs'} {{(pid=115917) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 17 04:00:52.553399 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-df5e1049-d16d-483b-a1bf-c4fc3dd8c89e tempest-TestMinimumBasicScenario-510804398 tempest-TestMinimumBasicScenario-510804398-project] 10.222.0.11 "POST /compute/v2.1/os-keypairs" status: 200 len: 2322 microversion: 2.1 time: 1.374489 Nov 17 04:00:52.553990 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 1637/3161] 10.222.0.11 () {60 vars in 1157 bytes} [Wed Nov 17 04:00:51 2021] POST /compute/v2.1/os-keypairs => generated 2322 bytes in 1376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 04:00:52.651159 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-ce2c2df3-ef12-4d2f-bbc7-88117d50e084 tempest-TestMinimumBasicScenario-510804398 tempest-TestMinimumBasicScenario-510804398-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-245602207", "imageRef": "69ad1ead-5389-4053-b039-ed019b633ed3", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-1353225738", "networks": [{"uuid": "e22cd94a-75d8-4f7b-8d7b-54d2b1b7b6f7"}]}} {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 17 04:00:52.709834 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.network.neutron [None req-ce2c2df3-ef12-4d2f-bbc7-88117d50e084 tempest-TestMinimumBasicScenario-510804398 tempest-TestMinimumBasicScenario-510804398-project] validate_networks() for [('e22cd94a-75d8-4f7b-8d7b-54d2b1b7b6f7', None, None, None, None, None)] {{(pid=115916) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Nov 17 04:00:53.124118 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.virt.hardware [None req-ce2c2df3-ef12-4d2f-bbc7-88117d50e084 tempest-TestMinimumBasicScenario-510804398 tempest-TestMinimumBasicScenario-510804398-project] Flavor limits 0:0:0 {{(pid=115916) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 17 04:00:53.124542 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.virt.hardware [None req-ce2c2df3-ef12-4d2f-bbc7-88117d50e084 tempest-TestMinimumBasicScenario-510804398 tempest-TestMinimumBasicScenario-510804398-project] Image limits 0:0:0 {{(pid=115916) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 17 04:00:53.125046 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.virt.hardware [None req-ce2c2df3-ef12-4d2f-bbc7-88117d50e084 tempest-TestMinimumBasicScenario-510804398 tempest-TestMinimumBasicScenario-510804398-project] Flavor pref 0:0:0 {{(pid=115916) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 17 04:00:53.125581 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.virt.hardware [None req-ce2c2df3-ef12-4d2f-bbc7-88117d50e084 tempest-TestMinimumBasicScenario-510804398 tempest-TestMinimumBasicScenario-510804398-project] Image pref 0:0:0 {{(pid=115916) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 17 04:00:53.125854 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.virt.hardware [None req-ce2c2df3-ef12-4d2f-bbc7-88117d50e084 tempest-TestMinimumBasicScenario-510804398 tempest-TestMinimumBasicScenario-510804398-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=115916) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 17 04:00:53.134629 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-ce2c2df3-ef12-4d2f-bbc7-88117d50e084 tempest-TestMinimumBasicScenario-510804398 tempest-TestMinimumBasicScenario-510804398-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 04:00:53.135084 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-ce2c2df3-ef12-4d2f-bbc7-88117d50e084 tempest-TestMinimumBasicScenario-510804398 tempest-TestMinimumBasicScenario-510804398-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 04:00:53.135889 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-ce2c2df3-ef12-4d2f-bbc7-88117d50e084 tempest-TestMinimumBasicScenario-510804398 tempest-TestMinimumBasicScenario-510804398-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 04:00:53.136567 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-ce2c2df3-ef12-4d2f-bbc7-88117d50e084 tempest-TestMinimumBasicScenario-510804398 tempest-TestMinimumBasicScenario-510804398-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 04:00:53.153507 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.quota [None req-ce2c2df3-ef12-4d2f-bbc7-88117d50e084 tempest-TestMinimumBasicScenario-510804398 tempest-TestMinimumBasicScenario-510804398-project] Getting quotas for project d4f4f943c957446b9fc9792385c53394. Resources: {'instances', 'ram', 'cores'} {{(pid=115916) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 17 04:00:53.158821 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.quota [None req-ce2c2df3-ef12-4d2f-bbc7-88117d50e084 tempest-TestMinimumBasicScenario-510804398 tempest-TestMinimumBasicScenario-510804398-project] Getting quotas for user 220aa0d3d6494952b53d8d44265c4895 and project d4f4f943c957446b9fc9792385c53394. Resources: {'instances', 'ram', 'cores'} {{(pid=115916) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 17 04:00:53.176729 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-ce2c2df3-ef12-4d2f-bbc7-88117d50e084 tempest-TestMinimumBasicScenario-510804398 tempest-TestMinimumBasicScenario-510804398-project] Going to run 1 instances... {{(pid=115916) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 17 04:00:53.179132 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-ce2c2df3-ef12-4d2f-bbc7-88117d50e084 tempest-TestMinimumBasicScenario-510804398 tempest-TestMinimumBasicScenario-510804398-project] [instance: a2378ac5-4b2c-4512-a437-b7737fba0204] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='69ad1ead-5389-4053-b039-ed019b633ed3',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=115916) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 17 04:00:53.224738 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-ce2c2df3-ef12-4d2f-bbc7-88117d50e084 tempest-TestMinimumBasicScenario-510804398 tempest-TestMinimumBasicScenario-510804398-project] 10.222.0.11 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.577351 Nov 17 04:00:53.225423 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 1525/3162] 10.222.0.11 () {60 vars in 1146 bytes} [Wed Nov 17 04:00:52 2021] POST /compute/v2.1/servers => generated 380 bytes in 579 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 17 04:00:53.235522 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-e71f96c6-929e-46cf-b93b-4dfca014653e tempest-TestMinimumBasicScenario-510804398 tempest-TestMinimumBasicScenario-510804398-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 04:00:53.236160 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-e71f96c6-929e-46cf-b93b-4dfca014653e tempest-TestMinimumBasicScenario-510804398 tempest-TestMinimumBasicScenario-510804398-project] [instance: a2378ac5-4b2c-4512-a437-b7737fba0204] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 04:00:53.290940 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-e71f96c6-929e-46cf-b93b-4dfca014653e tempest-TestMinimumBasicScenario-510804398 tempest-TestMinimumBasicScenario-510804398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '220aa0d3d6494952b53d8d44265c4895', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4f4f943c957446b9fc9792385c53394', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 04:00:53.297802 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-e71f96c6-929e-46cf-b93b-4dfca014653e tempest-TestMinimumBasicScenario-510804398 tempest-TestMinimumBasicScenario-510804398-project] 10.222.0.11 "GET /compute/v2.1/servers/a2378ac5-4b2c-4512-a437-b7737fba0204" status: 200 len: 1258 microversion: 2.1 time: 0.065919 Nov 17 04:00:53.298371 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 1638/3163] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 04:00:53 2021] GET /compute/v2.1/servers/a2378ac5-4b2c-4512-a437-b7737fba0204 => generated 1258 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 04:00:54.315801 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-96928285-f52c-45ad-b618-d748e417876b tempest-TestMinimumBasicScenario-510804398 tempest-TestMinimumBasicScenario-510804398-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 04:00:54.316670 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-96928285-f52c-45ad-b618-d748e417876b tempest-TestMinimumBasicScenario-510804398 tempest-TestMinimumBasicScenario-510804398-project] [instance: a2378ac5-4b2c-4512-a437-b7737fba0204] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 04:00:54.323090 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-96928285-f52c-45ad-b618-d748e417876b tempest-TestMinimumBasicScenario-510804398 tempest-TestMinimumBasicScenario-510804398-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 04:00:54.323612 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-96928285-f52c-45ad-b618-d748e417876b tempest-TestMinimumBasicScenario-510804398 tempest-TestMinimumBasicScenario-510804398-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 04:00:54.324715 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-96928285-f52c-45ad-b618-d748e417876b tempest-TestMinimumBasicScenario-510804398 tempest-TestMinimumBasicScenario-510804398-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 04:00:54.325314 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-96928285-f52c-45ad-b618-d748e417876b tempest-TestMinimumBasicScenario-510804398 tempest-TestMinimumBasicScenario-510804398-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 04:00:54.421721 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-96928285-f52c-45ad-b618-d748e417876b tempest-TestMinimumBasicScenario-510804398 tempest-TestMinimumBasicScenario-510804398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '220aa0d3d6494952b53d8d44265c4895', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4f4f943c957446b9fc9792385c53394', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 04:00:54.429623 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-96928285-f52c-45ad-b618-d748e417876b tempest-TestMinimumBasicScenario-510804398 tempest-TestMinimumBasicScenario-510804398-project] 10.222.0.11 "GET /compute/v2.1/servers/a2378ac5-4b2c-4512-a437-b7737fba0204" status: 200 len: 1328 microversion: 2.1 time: 0.118092 Nov 17 04:00:54.430288 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 1526/3164] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 04:00:54 2021] GET /compute/v2.1/servers/a2378ac5-4b2c-4512-a437-b7737fba0204 => generated 1328 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 04:00:55.449273 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-b5ddc184-4c2e-4da7-b97e-dd4541dae2e8 tempest-TestMinimumBasicScenario-510804398 tempest-TestMinimumBasicScenario-510804398-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 04:00:55.450670 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-b5ddc184-4c2e-4da7-b97e-dd4541dae2e8 tempest-TestMinimumBasicScenario-510804398 tempest-TestMinimumBasicScenario-510804398-project] [instance: a2378ac5-4b2c-4512-a437-b7737fba0204] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 04:00:55.465854 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-b5ddc184-4c2e-4da7-b97e-dd4541dae2e8 tempest-TestMinimumBasicScenario-510804398 tempest-TestMinimumBasicScenario-510804398-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 04:00:55.466822 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-b5ddc184-4c2e-4da7-b97e-dd4541dae2e8 tempest-TestMinimumBasicScenario-510804398 tempest-TestMinimumBasicScenario-510804398-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 04:00:55.469970 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-b5ddc184-4c2e-4da7-b97e-dd4541dae2e8 tempest-TestMinimumBasicScenario-510804398 tempest-TestMinimumBasicScenario-510804398-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 04:00:55.473138 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-b5ddc184-4c2e-4da7-b97e-dd4541dae2e8 tempest-TestMinimumBasicScenario-510804398 tempest-TestMinimumBasicScenario-510804398-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 04:00:55.700467 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-b5ddc184-4c2e-4da7-b97e-dd4541dae2e8 tempest-TestMinimumBasicScenario-510804398 tempest-TestMinimumBasicScenario-510804398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '220aa0d3d6494952b53d8d44265c4895', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4f4f943c957446b9fc9792385c53394', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 04:00:55.710167 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-b5ddc184-4c2e-4da7-b97e-dd4541dae2e8 tempest-TestMinimumBasicScenario-510804398 tempest-TestMinimumBasicScenario-510804398-project] 10.222.0.11 "GET /compute/v2.1/servers/a2378ac5-4b2c-4512-a437-b7737fba0204" status: 200 len: 1358 microversion: 2.1 time: 0.265745 Nov 17 04:00:55.711372 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 1639/3165] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 04:00:55 2021] GET /compute/v2.1/servers/a2378ac5-4b2c-4512-a437-b7737fba0204 => generated 1358 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 04:00:56.727602 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-be5a48e1-adc5-4f10-8c85-8f1559b04397 tempest-TestMinimumBasicScenario-510804398 tempest-TestMinimumBasicScenario-510804398-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 04:00:56.729024 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-be5a48e1-adc5-4f10-8c85-8f1559b04397 tempest-TestMinimumBasicScenario-510804398 tempest-TestMinimumBasicScenario-510804398-project] [instance: a2378ac5-4b2c-4512-a437-b7737fba0204] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 04:00:56.744264 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-be5a48e1-adc5-4f10-8c85-8f1559b04397 tempest-TestMinimumBasicScenario-510804398 tempest-TestMinimumBasicScenario-510804398-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 04:00:56.744822 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-be5a48e1-adc5-4f10-8c85-8f1559b04397 tempest-TestMinimumBasicScenario-510804398 tempest-TestMinimumBasicScenario-510804398-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 04:00:56.745745 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-be5a48e1-adc5-4f10-8c85-8f1559b04397 tempest-TestMinimumBasicScenario-510804398 tempest-TestMinimumBasicScenario-510804398-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 04:00:56.746245 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-be5a48e1-adc5-4f10-8c85-8f1559b04397 tempest-TestMinimumBasicScenario-510804398 tempest-TestMinimumBasicScenario-510804398-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 04:00:56.953749 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-be5a48e1-adc5-4f10-8c85-8f1559b04397 tempest-TestMinimumBasicScenario-510804398 tempest-TestMinimumBasicScenario-510804398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '220aa0d3d6494952b53d8d44265c4895', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4f4f943c957446b9fc9792385c53394', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 04:00:56.962500 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-be5a48e1-adc5-4f10-8c85-8f1559b04397 tempest-TestMinimumBasicScenario-510804398 tempest-TestMinimumBasicScenario-510804398-project] 10.222.0.11 "GET /compute/v2.1/servers/a2378ac5-4b2c-4512-a437-b7737fba0204" status: 200 len: 1358 microversion: 2.1 time: 0.238554 Nov 17 04:00:56.963091 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 1527/3166] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 04:00:56 2021] GET /compute/v2.1/servers/a2378ac5-4b2c-4512-a437-b7737fba0204 => generated 1358 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 04:00:57.979525 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-935331f5-7881-4410-a40d-94a7cf3e7097 tempest-TestMinimumBasicScenario-510804398 tempest-TestMinimumBasicScenario-510804398-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 04:00:57.980765 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-935331f5-7881-4410-a40d-94a7cf3e7097 tempest-TestMinimumBasicScenario-510804398 tempest-TestMinimumBasicScenario-510804398-project] [instance: a2378ac5-4b2c-4512-a437-b7737fba0204] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 04:00:57.989999 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-935331f5-7881-4410-a40d-94a7cf3e7097 tempest-TestMinimumBasicScenario-510804398 tempest-TestMinimumBasicScenario-510804398-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 04:00:57.992129 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-935331f5-7881-4410-a40d-94a7cf3e7097 tempest-TestMinimumBasicScenario-510804398 tempest-TestMinimumBasicScenario-510804398-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 04:00:57.994902 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-935331f5-7881-4410-a40d-94a7cf3e7097 tempest-TestMinimumBasicScenario-510804398 tempest-TestMinimumBasicScenario-510804398-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 04:00:57.995633 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-935331f5-7881-4410-a40d-94a7cf3e7097 tempest-TestMinimumBasicScenario-510804398 tempest-TestMinimumBasicScenario-510804398-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 04:00:58.163262 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-935331f5-7881-4410-a40d-94a7cf3e7097 tempest-TestMinimumBasicScenario-510804398 tempest-TestMinimumBasicScenario-510804398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '220aa0d3d6494952b53d8d44265c4895', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4f4f943c957446b9fc9792385c53394', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 04:00:58.171339 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-935331f5-7881-4410-a40d-94a7cf3e7097 tempest-TestMinimumBasicScenario-510804398 tempest-TestMinimumBasicScenario-510804398-project] 10.222.0.11 "GET /compute/v2.1/servers/a2378ac5-4b2c-4512-a437-b7737fba0204" status: 200 len: 1358 microversion: 2.1 time: 0.195765 Nov 17 04:00:58.172518 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 1640/3167] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 04:00:57 2021] GET /compute/v2.1/servers/a2378ac5-4b2c-4512-a437-b7737fba0204 => generated 1358 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 04:00:59.189023 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-9aa66bda-84da-4c3f-bacb-1fa78084b531 tempest-TestMinimumBasicScenario-510804398 tempest-TestMinimumBasicScenario-510804398-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 04:00:59.189676 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-9aa66bda-84da-4c3f-bacb-1fa78084b531 tempest-TestMinimumBasicScenario-510804398 tempest-TestMinimumBasicScenario-510804398-project] [instance: a2378ac5-4b2c-4512-a437-b7737fba0204] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 04:00:59.196864 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-9aa66bda-84da-4c3f-bacb-1fa78084b531 tempest-TestMinimumBasicScenario-510804398 tempest-TestMinimumBasicScenario-510804398-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 04:00:59.197315 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-9aa66bda-84da-4c3f-bacb-1fa78084b531 tempest-TestMinimumBasicScenario-510804398 tempest-TestMinimumBasicScenario-510804398-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 04:00:59.198188 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-9aa66bda-84da-4c3f-bacb-1fa78084b531 tempest-TestMinimumBasicScenario-510804398 tempest-TestMinimumBasicScenario-510804398-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 04:00:59.198613 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-9aa66bda-84da-4c3f-bacb-1fa78084b531 tempest-TestMinimumBasicScenario-510804398 tempest-TestMinimumBasicScenario-510804398-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 04:00:59.336721 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-9aa66bda-84da-4c3f-bacb-1fa78084b531 tempest-TestMinimumBasicScenario-510804398 tempest-TestMinimumBasicScenario-510804398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '220aa0d3d6494952b53d8d44265c4895', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4f4f943c957446b9fc9792385c53394', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 04:00:59.344051 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-9aa66bda-84da-4c3f-bacb-1fa78084b531 tempest-TestMinimumBasicScenario-510804398 tempest-TestMinimumBasicScenario-510804398-project] 10.222.0.11 "GET /compute/v2.1/servers/a2378ac5-4b2c-4512-a437-b7737fba0204" status: 200 len: 1358 microversion: 2.1 time: 0.159111 Nov 17 04:00:59.344961 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 1528/3168] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 04:00:59 2021] GET /compute/v2.1/servers/a2378ac5-4b2c-4512-a437-b7737fba0204 => generated 1358 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 04:01:00.365496 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-2805f18c-5634-48d9-8838-b5db384f50c2 tempest-TestMinimumBasicScenario-510804398 tempest-TestMinimumBasicScenario-510804398-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 04:01:00.366418 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-2805f18c-5634-48d9-8838-b5db384f50c2 tempest-TestMinimumBasicScenario-510804398 tempest-TestMinimumBasicScenario-510804398-project] [instance: a2378ac5-4b2c-4512-a437-b7737fba0204] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 04:01:00.376332 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-2805f18c-5634-48d9-8838-b5db384f50c2 tempest-TestMinimumBasicScenario-510804398 tempest-TestMinimumBasicScenario-510804398-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 04:01:00.376811 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-2805f18c-5634-48d9-8838-b5db384f50c2 tempest-TestMinimumBasicScenario-510804398 tempest-TestMinimumBasicScenario-510804398-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 04:01:00.377600 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-2805f18c-5634-48d9-8838-b5db384f50c2 tempest-TestMinimumBasicScenario-510804398 tempest-TestMinimumBasicScenario-510804398-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 04:01:00.378048 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-2805f18c-5634-48d9-8838-b5db384f50c2 tempest-TestMinimumBasicScenario-510804398 tempest-TestMinimumBasicScenario-510804398-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 04:01:00.562051 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-2805f18c-5634-48d9-8838-b5db384f50c2 tempest-TestMinimumBasicScenario-510804398 tempest-TestMinimumBasicScenario-510804398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '220aa0d3d6494952b53d8d44265c4895', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4f4f943c957446b9fc9792385c53394', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 04:01:00.569644 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-2805f18c-5634-48d9-8838-b5db384f50c2 tempest-TestMinimumBasicScenario-510804398 tempest-TestMinimumBasicScenario-510804398-project] 10.222.0.11 "GET /compute/v2.1/servers/a2378ac5-4b2c-4512-a437-b7737fba0204" status: 200 len: 1358 microversion: 2.1 time: 0.210871 Nov 17 04:01:00.570326 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 1641/3169] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 04:01:00 2021] GET /compute/v2.1/servers/a2378ac5-4b2c-4512-a437-b7737fba0204 => generated 1358 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 04:01:01.586013 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-7d1284ae-9899-4e4f-ae12-4c8cdbe832fc tempest-TestMinimumBasicScenario-510804398 tempest-TestMinimumBasicScenario-510804398-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 04:01:01.586635 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-7d1284ae-9899-4e4f-ae12-4c8cdbe832fc tempest-TestMinimumBasicScenario-510804398 tempest-TestMinimumBasicScenario-510804398-project] [instance: a2378ac5-4b2c-4512-a437-b7737fba0204] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 04:01:01.593050 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-7d1284ae-9899-4e4f-ae12-4c8cdbe832fc tempest-TestMinimumBasicScenario-510804398 tempest-TestMinimumBasicScenario-510804398-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 04:01:01.593497 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-7d1284ae-9899-4e4f-ae12-4c8cdbe832fc tempest-TestMinimumBasicScenario-510804398 tempest-TestMinimumBasicScenario-510804398-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 04:01:01.594268 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-7d1284ae-9899-4e4f-ae12-4c8cdbe832fc tempest-TestMinimumBasicScenario-510804398 tempest-TestMinimumBasicScenario-510804398-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 04:01:01.594698 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-7d1284ae-9899-4e4f-ae12-4c8cdbe832fc tempest-TestMinimumBasicScenario-510804398 tempest-TestMinimumBasicScenario-510804398-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 04:01:01.735895 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-7d1284ae-9899-4e4f-ae12-4c8cdbe832fc tempest-TestMinimumBasicScenario-510804398 tempest-TestMinimumBasicScenario-510804398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '220aa0d3d6494952b53d8d44265c4895', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4f4f943c957446b9fc9792385c53394', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 04:01:01.744473 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-7d1284ae-9899-4e4f-ae12-4c8cdbe832fc tempest-TestMinimumBasicScenario-510804398 tempest-TestMinimumBasicScenario-510804398-project] 10.222.0.11 "GET /compute/v2.1/servers/a2378ac5-4b2c-4512-a437-b7737fba0204" status: 200 len: 1358 microversion: 2.1 time: 0.162004 Nov 17 04:01:01.754161 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 1529/3170] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 04:01:01 2021] GET /compute/v2.1/servers/a2378ac5-4b2c-4512-a437-b7737fba0204 => generated 1358 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 04:01:02.761649 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-adf97fca-41ab-4cbd-bbdf-1cd636becc0b tempest-TestMinimumBasicScenario-510804398 tempest-TestMinimumBasicScenario-510804398-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 04:01:02.762285 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-adf97fca-41ab-4cbd-bbdf-1cd636becc0b tempest-TestMinimumBasicScenario-510804398 tempest-TestMinimumBasicScenario-510804398-project] [instance: a2378ac5-4b2c-4512-a437-b7737fba0204] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 04:01:02.768744 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-adf97fca-41ab-4cbd-bbdf-1cd636becc0b tempest-TestMinimumBasicScenario-510804398 tempest-TestMinimumBasicScenario-510804398-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 04:01:02.769220 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-adf97fca-41ab-4cbd-bbdf-1cd636becc0b tempest-TestMinimumBasicScenario-510804398 tempest-TestMinimumBasicScenario-510804398-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 04:01:02.769980 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-adf97fca-41ab-4cbd-bbdf-1cd636becc0b tempest-TestMinimumBasicScenario-510804398 tempest-TestMinimumBasicScenario-510804398-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 04:01:02.770402 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-adf97fca-41ab-4cbd-bbdf-1cd636becc0b tempest-TestMinimumBasicScenario-510804398 tempest-TestMinimumBasicScenario-510804398-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 04:01:02.904989 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-adf97fca-41ab-4cbd-bbdf-1cd636becc0b tempest-TestMinimumBasicScenario-510804398 tempest-TestMinimumBasicScenario-510804398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '220aa0d3d6494952b53d8d44265c4895', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4f4f943c957446b9fc9792385c53394', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 04:01:02.912817 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-adf97fca-41ab-4cbd-bbdf-1cd636becc0b tempest-TestMinimumBasicScenario-510804398 tempest-TestMinimumBasicScenario-510804398-project] 10.222.0.11 "GET /compute/v2.1/servers/a2378ac5-4b2c-4512-a437-b7737fba0204" status: 200 len: 1358 microversion: 2.1 time: 0.154770 Nov 17 04:01:02.913395 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 1642/3171] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 04:01:02 2021] GET /compute/v2.1/servers/a2378ac5-4b2c-4512-a437-b7737fba0204 => generated 1358 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 04:01:03.934621 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-7ba6650f-0c61-43fb-9f8c-eec30867164e tempest-TestMinimumBasicScenario-510804398 tempest-TestMinimumBasicScenario-510804398-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 04:01:03.935570 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-7ba6650f-0c61-43fb-9f8c-eec30867164e tempest-TestMinimumBasicScenario-510804398 tempest-TestMinimumBasicScenario-510804398-project] [instance: a2378ac5-4b2c-4512-a437-b7737fba0204] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 04:01:03.943290 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-7ba6650f-0c61-43fb-9f8c-eec30867164e tempest-TestMinimumBasicScenario-510804398 tempest-TestMinimumBasicScenario-510804398-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 04:01:03.943762 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-7ba6650f-0c61-43fb-9f8c-eec30867164e tempest-TestMinimumBasicScenario-510804398 tempest-TestMinimumBasicScenario-510804398-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 04:01:03.944568 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-7ba6650f-0c61-43fb-9f8c-eec30867164e tempest-TestMinimumBasicScenario-510804398 tempest-TestMinimumBasicScenario-510804398-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 04:01:03.945134 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-7ba6650f-0c61-43fb-9f8c-eec30867164e tempest-TestMinimumBasicScenario-510804398 tempest-TestMinimumBasicScenario-510804398-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 04:01:04.101198 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-7ba6650f-0c61-43fb-9f8c-eec30867164e tempest-TestMinimumBasicScenario-510804398 tempest-TestMinimumBasicScenario-510804398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '220aa0d3d6494952b53d8d44265c4895', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4f4f943c957446b9fc9792385c53394', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 04:01:04.111090 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-7ba6650f-0c61-43fb-9f8c-eec30867164e tempest-TestMinimumBasicScenario-510804398 tempest-TestMinimumBasicScenario-510804398-project] 10.222.0.11 "GET /compute/v2.1/servers/a2378ac5-4b2c-4512-a437-b7737fba0204" status: 200 len: 1358 microversion: 2.1 time: 0.182803 Nov 17 04:01:04.111653 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 1530/3172] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 04:01:03 2021] GET /compute/v2.1/servers/a2378ac5-4b2c-4512-a437-b7737fba0204 => generated 1358 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 04:01:05.127818 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-9b87a642-b3d7-47e1-967e-ab818d2d46cd tempest-TestMinimumBasicScenario-510804398 tempest-TestMinimumBasicScenario-510804398-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 04:01:05.128539 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-9b87a642-b3d7-47e1-967e-ab818d2d46cd tempest-TestMinimumBasicScenario-510804398 tempest-TestMinimumBasicScenario-510804398-project] [instance: a2378ac5-4b2c-4512-a437-b7737fba0204] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 04:01:05.135249 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-9b87a642-b3d7-47e1-967e-ab818d2d46cd tempest-TestMinimumBasicScenario-510804398 tempest-TestMinimumBasicScenario-510804398-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 04:01:05.135701 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-9b87a642-b3d7-47e1-967e-ab818d2d46cd tempest-TestMinimumBasicScenario-510804398 tempest-TestMinimumBasicScenario-510804398-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 04:01:05.136513 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-9b87a642-b3d7-47e1-967e-ab818d2d46cd tempest-TestMinimumBasicScenario-510804398 tempest-TestMinimumBasicScenario-510804398-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 04:01:05.136992 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-9b87a642-b3d7-47e1-967e-ab818d2d46cd tempest-TestMinimumBasicScenario-510804398 tempest-TestMinimumBasicScenario-510804398-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 04:01:05.303021 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-9b87a642-b3d7-47e1-967e-ab818d2d46cd tempest-TestMinimumBasicScenario-510804398 tempest-TestMinimumBasicScenario-510804398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '220aa0d3d6494952b53d8d44265c4895', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4f4f943c957446b9fc9792385c53394', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 04:01:05.312349 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-9b87a642-b3d7-47e1-967e-ab818d2d46cd tempest-TestMinimumBasicScenario-510804398 tempest-TestMinimumBasicScenario-510804398-project] 10.222.0.11 "GET /compute/v2.1/servers/a2378ac5-4b2c-4512-a437-b7737fba0204" status: 200 len: 1358 microversion: 2.1 time: 0.187876 Nov 17 04:01:05.324668 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 1643/3173] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 04:01:05 2021] GET /compute/v2.1/servers/a2378ac5-4b2c-4512-a437-b7737fba0204 => generated 1358 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 04:01:06.331682 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-890831b3-0abb-45a8-9f10-4a586d84fee8 tempest-TestMinimumBasicScenario-510804398 tempest-TestMinimumBasicScenario-510804398-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 04:01:06.332322 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-890831b3-0abb-45a8-9f10-4a586d84fee8 tempest-TestMinimumBasicScenario-510804398 tempest-TestMinimumBasicScenario-510804398-project] [instance: a2378ac5-4b2c-4512-a437-b7737fba0204] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 04:01:06.339191 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-890831b3-0abb-45a8-9f10-4a586d84fee8 tempest-TestMinimumBasicScenario-510804398 tempest-TestMinimumBasicScenario-510804398-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 04:01:06.339639 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-890831b3-0abb-45a8-9f10-4a586d84fee8 tempest-TestMinimumBasicScenario-510804398 tempest-TestMinimumBasicScenario-510804398-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 04:01:06.340430 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-890831b3-0abb-45a8-9f10-4a586d84fee8 tempest-TestMinimumBasicScenario-510804398 tempest-TestMinimumBasicScenario-510804398-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 04:01:06.340894 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-890831b3-0abb-45a8-9f10-4a586d84fee8 tempest-TestMinimumBasicScenario-510804398 tempest-TestMinimumBasicScenario-510804398-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 04:01:06.485056 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-890831b3-0abb-45a8-9f10-4a586d84fee8 tempest-TestMinimumBasicScenario-510804398 tempest-TestMinimumBasicScenario-510804398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '220aa0d3d6494952b53d8d44265c4895', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4f4f943c957446b9fc9792385c53394', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 04:01:06.492535 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-890831b3-0abb-45a8-9f10-4a586d84fee8 tempest-TestMinimumBasicScenario-510804398 tempest-TestMinimumBasicScenario-510804398-project] 10.222.0.11 "GET /compute/v2.1/servers/a2378ac5-4b2c-4512-a437-b7737fba0204" status: 200 len: 1358 microversion: 2.1 time: 0.164684 Nov 17 04:01:06.493118 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 1531/3174] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 04:01:06 2021] GET /compute/v2.1/servers/a2378ac5-4b2c-4512-a437-b7737fba0204 => generated 1358 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 04:01:07.508950 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-b3982ea5-2ec8-4a86-9d75-46726b72bbab tempest-TestMinimumBasicScenario-510804398 tempest-TestMinimumBasicScenario-510804398-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 04:01:07.509677 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-b3982ea5-2ec8-4a86-9d75-46726b72bbab tempest-TestMinimumBasicScenario-510804398 tempest-TestMinimumBasicScenario-510804398-project] [instance: a2378ac5-4b2c-4512-a437-b7737fba0204] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 04:01:07.516859 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-b3982ea5-2ec8-4a86-9d75-46726b72bbab tempest-TestMinimumBasicScenario-510804398 tempest-TestMinimumBasicScenario-510804398-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 04:01:07.517929 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-b3982ea5-2ec8-4a86-9d75-46726b72bbab tempest-TestMinimumBasicScenario-510804398 tempest-TestMinimumBasicScenario-510804398-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 04:01:07.519186 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-b3982ea5-2ec8-4a86-9d75-46726b72bbab tempest-TestMinimumBasicScenario-510804398 tempest-TestMinimumBasicScenario-510804398-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 04:01:07.519405 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-b3982ea5-2ec8-4a86-9d75-46726b72bbab tempest-TestMinimumBasicScenario-510804398 tempest-TestMinimumBasicScenario-510804398-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 04:01:07.686576 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-b3982ea5-2ec8-4a86-9d75-46726b72bbab tempest-TestMinimumBasicScenario-510804398 tempest-TestMinimumBasicScenario-510804398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '220aa0d3d6494952b53d8d44265c4895', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4f4f943c957446b9fc9792385c53394', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 04:01:07.705690 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-b3982ea5-2ec8-4a86-9d75-46726b72bbab tempest-TestMinimumBasicScenario-510804398 tempest-TestMinimumBasicScenario-510804398-project] 10.222.0.11 "GET /compute/v2.1/servers/a2378ac5-4b2c-4512-a437-b7737fba0204" status: 200 len: 1358 microversion: 2.1 time: 0.200267 Nov 17 04:01:07.706712 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 1644/3175] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 04:01:07 2021] GET /compute/v2.1/servers/a2378ac5-4b2c-4512-a437-b7737fba0204 => generated 1358 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 04:01:07.762858 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [req-3ab6291b-1988-4a81-9a51-fecef5738b64 req-2726a02f-f749-4c6f-9b3f-b8eae115eaa3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a2378ac5-4b2c-4512-a437-b7737fba0204", "tag": "76b2a23a-990f-47e8-b961-ce6daae261f1"}]} {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 17 04:01:07.764418 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 17 04:01:07.764418 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: warnings.warn(msg) Nov 17 04:01:07.785024 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [req-3ab6291b-1988-4a81-9a51-fecef5738b64 req-2726a02f-f749-4c6f-9b3f-b8eae115eaa3 service nova] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 04:01:07.785599 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [req-3ab6291b-1988-4a81-9a51-fecef5738b64 req-2726a02f-f749-4c6f-9b3f-b8eae115eaa3 service nova] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 04:01:07.797295 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.compute.server_external_events [req-3ab6291b-1988-4a81-9a51-fecef5738b64 req-2726a02f-f749-4c6f-9b3f-b8eae115eaa3 service nova] Creating event network-changed:76b2a23a-990f-47e8-b961-ce6daae261f1 for instance a2378ac5-4b2c-4512-a437-b7737fba0204 on hv-cinder-81803 Nov 17 04:01:07.804329 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [req-3ab6291b-1988-4a81-9a51-fecef5738b64 req-2726a02f-f749-4c6f-9b3f-b8eae115eaa3 service nova] 10.222.0.11 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045248 Nov 17 04:01:07.804976 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 1532/3176] 10.222.0.11 () {64 vars in 1317 bytes} [Wed Nov 17 04:01:07 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 17 04:01:08.723686 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-ca071e2e-35a1-416c-a1a9-fd36b4f31ca6 tempest-TestMinimumBasicScenario-510804398 tempest-TestMinimumBasicScenario-510804398-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 04:01:08.724382 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-ca071e2e-35a1-416c-a1a9-fd36b4f31ca6 tempest-TestMinimumBasicScenario-510804398 tempest-TestMinimumBasicScenario-510804398-project] [instance: a2378ac5-4b2c-4512-a437-b7737fba0204] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 04:01:08.731729 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-ca071e2e-35a1-416c-a1a9-fd36b4f31ca6 tempest-TestMinimumBasicScenario-510804398 tempest-TestMinimumBasicScenario-510804398-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 04:01:08.732247 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-ca071e2e-35a1-416c-a1a9-fd36b4f31ca6 tempest-TestMinimumBasicScenario-510804398 tempest-TestMinimumBasicScenario-510804398-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 04:01:08.733085 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-ca071e2e-35a1-416c-a1a9-fd36b4f31ca6 tempest-TestMinimumBasicScenario-510804398 tempest-TestMinimumBasicScenario-510804398-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 04:01:08.733548 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-ca071e2e-35a1-416c-a1a9-fd36b4f31ca6 tempest-TestMinimumBasicScenario-510804398 tempest-TestMinimumBasicScenario-510804398-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 04:01:08.873746 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-ca071e2e-35a1-416c-a1a9-fd36b4f31ca6 tempest-TestMinimumBasicScenario-510804398 tempest-TestMinimumBasicScenario-510804398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '220aa0d3d6494952b53d8d44265c4895', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4f4f943c957446b9fc9792385c53394', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 04:01:08.884847 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-ca071e2e-35a1-416c-a1a9-fd36b4f31ca6 tempest-TestMinimumBasicScenario-510804398 tempest-TestMinimumBasicScenario-510804398-project] 10.222.0.11 "GET /compute/v2.1/servers/a2378ac5-4b2c-4512-a437-b7737fba0204" status: 200 len: 1358 microversion: 2.1 time: 0.164624 Nov 17 04:01:08.891603 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 1645/3177] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 04:01:08 2021] GET /compute/v2.1/servers/a2378ac5-4b2c-4512-a437-b7737fba0204 => generated 1358 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 04:01:09.903276 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-2b94d22b-aaf6-40e6-81a6-1429a5dedd36 tempest-TestMinimumBasicScenario-510804398 tempest-TestMinimumBasicScenario-510804398-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 04:01:09.903974 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-2b94d22b-aaf6-40e6-81a6-1429a5dedd36 tempest-TestMinimumBasicScenario-510804398 tempest-TestMinimumBasicScenario-510804398-project] [instance: a2378ac5-4b2c-4512-a437-b7737fba0204] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 04:01:09.911165 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-2b94d22b-aaf6-40e6-81a6-1429a5dedd36 tempest-TestMinimumBasicScenario-510804398 tempest-TestMinimumBasicScenario-510804398-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 04:01:09.911622 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-2b94d22b-aaf6-40e6-81a6-1429a5dedd36 tempest-TestMinimumBasicScenario-510804398 tempest-TestMinimumBasicScenario-510804398-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 04:01:09.912516 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-2b94d22b-aaf6-40e6-81a6-1429a5dedd36 tempest-TestMinimumBasicScenario-510804398 tempest-TestMinimumBasicScenario-510804398-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 04:01:09.912980 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-2b94d22b-aaf6-40e6-81a6-1429a5dedd36 tempest-TestMinimumBasicScenario-510804398 tempest-TestMinimumBasicScenario-510804398-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 04:01:10.047019 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-2b94d22b-aaf6-40e6-81a6-1429a5dedd36 tempest-TestMinimumBasicScenario-510804398 tempest-TestMinimumBasicScenario-510804398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '220aa0d3d6494952b53d8d44265c4895', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4f4f943c957446b9fc9792385c53394', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 04:01:10.058250 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-2b94d22b-aaf6-40e6-81a6-1429a5dedd36 tempest-TestMinimumBasicScenario-510804398 tempest-TestMinimumBasicScenario-510804398-project] 10.222.0.11 "GET /compute/v2.1/servers/a2378ac5-4b2c-4512-a437-b7737fba0204" status: 200 len: 1358 microversion: 2.1 time: 0.159172 Nov 17 04:01:10.059057 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 1533/3178] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 04:01:09 2021] GET /compute/v2.1/servers/a2378ac5-4b2c-4512-a437-b7737fba0204 => generated 1358 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 04:01:11.078330 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-aa3d7da0-f0f4-49dd-8bc2-49d83f1cedea tempest-TestMinimumBasicScenario-510804398 tempest-TestMinimumBasicScenario-510804398-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 04:01:11.079181 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-aa3d7da0-f0f4-49dd-8bc2-49d83f1cedea tempest-TestMinimumBasicScenario-510804398 tempest-TestMinimumBasicScenario-510804398-project] [instance: a2378ac5-4b2c-4512-a437-b7737fba0204] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 04:01:11.086785 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-aa3d7da0-f0f4-49dd-8bc2-49d83f1cedea tempest-TestMinimumBasicScenario-510804398 tempest-TestMinimumBasicScenario-510804398-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 04:01:11.087580 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-aa3d7da0-f0f4-49dd-8bc2-49d83f1cedea tempest-TestMinimumBasicScenario-510804398 tempest-TestMinimumBasicScenario-510804398-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 04:01:11.088854 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-aa3d7da0-f0f4-49dd-8bc2-49d83f1cedea tempest-TestMinimumBasicScenario-510804398 tempest-TestMinimumBasicScenario-510804398-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 04:01:11.089479 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-aa3d7da0-f0f4-49dd-8bc2-49d83f1cedea tempest-TestMinimumBasicScenario-510804398 tempest-TestMinimumBasicScenario-510804398-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 04:01:11.226280 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-aa3d7da0-f0f4-49dd-8bc2-49d83f1cedea tempest-TestMinimumBasicScenario-510804398 tempest-TestMinimumBasicScenario-510804398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '220aa0d3d6494952b53d8d44265c4895', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4f4f943c957446b9fc9792385c53394', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 04:01:11.233549 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-aa3d7da0-f0f4-49dd-8bc2-49d83f1cedea tempest-TestMinimumBasicScenario-510804398 tempest-TestMinimumBasicScenario-510804398-project] 10.222.0.11 "GET /compute/v2.1/servers/a2378ac5-4b2c-4512-a437-b7737fba0204" status: 200 len: 1358 microversion: 2.1 time: 0.161606 Nov 17 04:01:11.234122 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 1646/3179] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 04:01:11 2021] GET /compute/v2.1/servers/a2378ac5-4b2c-4512-a437-b7737fba0204 => generated 1358 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 04:01:12.254864 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-70deabae-f704-48ae-8a52-edd2564f3a8b tempest-TestMinimumBasicScenario-510804398 tempest-TestMinimumBasicScenario-510804398-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 04:01:12.255544 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-70deabae-f704-48ae-8a52-edd2564f3a8b tempest-TestMinimumBasicScenario-510804398 tempest-TestMinimumBasicScenario-510804398-project] [instance: a2378ac5-4b2c-4512-a437-b7737fba0204] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 04:01:12.262008 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-70deabae-f704-48ae-8a52-edd2564f3a8b tempest-TestMinimumBasicScenario-510804398 tempest-TestMinimumBasicScenario-510804398-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 04:01:12.262463 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-70deabae-f704-48ae-8a52-edd2564f3a8b tempest-TestMinimumBasicScenario-510804398 tempest-TestMinimumBasicScenario-510804398-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 04:01:12.263268 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-70deabae-f704-48ae-8a52-edd2564f3a8b tempest-TestMinimumBasicScenario-510804398 tempest-TestMinimumBasicScenario-510804398-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 04:01:12.263729 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-70deabae-f704-48ae-8a52-edd2564f3a8b tempest-TestMinimumBasicScenario-510804398 tempest-TestMinimumBasicScenario-510804398-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 04:01:12.407582 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-70deabae-f704-48ae-8a52-edd2564f3a8b tempest-TestMinimumBasicScenario-510804398 tempest-TestMinimumBasicScenario-510804398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '220aa0d3d6494952b53d8d44265c4895', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4f4f943c957446b9fc9792385c53394', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 04:01:12.416017 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-70deabae-f704-48ae-8a52-edd2564f3a8b tempest-TestMinimumBasicScenario-510804398 tempest-TestMinimumBasicScenario-510804398-project] 10.222.0.11 "GET /compute/v2.1/servers/a2378ac5-4b2c-4512-a437-b7737fba0204" status: 200 len: 1358 microversion: 2.1 time: 0.167041 Nov 17 04:01:12.416582 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 1534/3180] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 04:01:12 2021] GET /compute/v2.1/servers/a2378ac5-4b2c-4512-a437-b7737fba0204 => generated 1358 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 04:01:12.780985 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [req-d7cf304e-1f14-4023-9ad4-2952820f7418 req-8c4a9cca-b90f-4ffe-b650-283417684a4d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a2378ac5-4b2c-4512-a437-b7737fba0204", "name": "network-vif-plugged", "status": "completed", "tag": "76b2a23a-990f-47e8-b961-ce6daae261f1"}]} {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 17 04:01:12.782748 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 17 04:01:12.782748 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: warnings.warn(msg) Nov 17 04:01:12.791240 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [req-d7cf304e-1f14-4023-9ad4-2952820f7418 req-8c4a9cca-b90f-4ffe-b650-283417684a4d service nova] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 04:01:12.791817 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [req-d7cf304e-1f14-4023-9ad4-2952820f7418 req-8c4a9cca-b90f-4ffe-b650-283417684a4d service nova] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 04:01:12.804263 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.compute.server_external_events [req-d7cf304e-1f14-4023-9ad4-2952820f7418 req-8c4a9cca-b90f-4ffe-b650-283417684a4d service nova] Creating event network-vif-plugged:76b2a23a-990f-47e8-b961-ce6daae261f1 for instance a2378ac5-4b2c-4512-a437-b7737fba0204 on hv-cinder-81803 Nov 17 04:01:12.809334 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [req-d7cf304e-1f14-4023-9ad4-2952820f7418 req-8c4a9cca-b90f-4ffe-b650-283417684a4d service nova] 10.222.0.11 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033376 Nov 17 04:01:12.809953 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 1647/3181] 10.222.0.11 () {64 vars in 1317 bytes} [Wed Nov 17 04:01:12 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 17 04:01:13.434206 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-ebd3d5b8-cad4-47e4-9083-1f48a90c8b01 tempest-TestMinimumBasicScenario-510804398 tempest-TestMinimumBasicScenario-510804398-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 04:01:13.435102 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-ebd3d5b8-cad4-47e4-9083-1f48a90c8b01 tempest-TestMinimumBasicScenario-510804398 tempest-TestMinimumBasicScenario-510804398-project] [instance: a2378ac5-4b2c-4512-a437-b7737fba0204] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 04:01:13.443627 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-ebd3d5b8-cad4-47e4-9083-1f48a90c8b01 tempest-TestMinimumBasicScenario-510804398 tempest-TestMinimumBasicScenario-510804398-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 04:01:13.444037 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-ebd3d5b8-cad4-47e4-9083-1f48a90c8b01 tempest-TestMinimumBasicScenario-510804398 tempest-TestMinimumBasicScenario-510804398-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 04:01:13.445017 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-ebd3d5b8-cad4-47e4-9083-1f48a90c8b01 tempest-TestMinimumBasicScenario-510804398 tempest-TestMinimumBasicScenario-510804398-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 04:01:13.445532 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-ebd3d5b8-cad4-47e4-9083-1f48a90c8b01 tempest-TestMinimumBasicScenario-510804398 tempest-TestMinimumBasicScenario-510804398-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 04:01:13.586221 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-ebd3d5b8-cad4-47e4-9083-1f48a90c8b01 tempest-TestMinimumBasicScenario-510804398 tempest-TestMinimumBasicScenario-510804398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '220aa0d3d6494952b53d8d44265c4895', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4f4f943c957446b9fc9792385c53394', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 04:01:13.594979 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-ebd3d5b8-cad4-47e4-9083-1f48a90c8b01 tempest-TestMinimumBasicScenario-510804398 tempest-TestMinimumBasicScenario-510804398-project] 10.222.0.11 "GET /compute/v2.1/servers/a2378ac5-4b2c-4512-a437-b7737fba0204" status: 200 len: 1358 microversion: 2.1 time: 0.165059 Nov 17 04:01:13.595837 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 1535/3182] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 04:01:13 2021] GET /compute/v2.1/servers/a2378ac5-4b2c-4512-a437-b7737fba0204 => generated 1358 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 04:01:14.622716 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-b5ede9a7-86ed-48ec-857b-cf1dd470906e tempest-TestMinimumBasicScenario-510804398 tempest-TestMinimumBasicScenario-510804398-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 04:01:14.623807 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-b5ede9a7-86ed-48ec-857b-cf1dd470906e tempest-TestMinimumBasicScenario-510804398 tempest-TestMinimumBasicScenario-510804398-project] [instance: a2378ac5-4b2c-4512-a437-b7737fba0204] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 04:01:14.633101 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-b5ede9a7-86ed-48ec-857b-cf1dd470906e tempest-TestMinimumBasicScenario-510804398 tempest-TestMinimumBasicScenario-510804398-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 04:01:14.633545 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-b5ede9a7-86ed-48ec-857b-cf1dd470906e tempest-TestMinimumBasicScenario-510804398 tempest-TestMinimumBasicScenario-510804398-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 04:01:14.634301 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-b5ede9a7-86ed-48ec-857b-cf1dd470906e tempest-TestMinimumBasicScenario-510804398 tempest-TestMinimumBasicScenario-510804398-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 04:01:14.634727 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-b5ede9a7-86ed-48ec-857b-cf1dd470906e tempest-TestMinimumBasicScenario-510804398 tempest-TestMinimumBasicScenario-510804398-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 04:01:14.778443 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-b5ede9a7-86ed-48ec-857b-cf1dd470906e tempest-TestMinimumBasicScenario-510804398 tempest-TestMinimumBasicScenario-510804398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '220aa0d3d6494952b53d8d44265c4895', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4f4f943c957446b9fc9792385c53394', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 04:01:14.790280 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-b5ede9a7-86ed-48ec-857b-cf1dd470906e tempest-TestMinimumBasicScenario-510804398 tempest-TestMinimumBasicScenario-510804398-project] 10.222.0.11 "GET /compute/v2.1/servers/a2378ac5-4b2c-4512-a437-b7737fba0204" status: 200 len: 1547 microversion: 2.1 time: 0.175023 Nov 17 04:01:14.791169 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 1648/3183] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 04:01:14 2021] GET /compute/v2.1/servers/a2378ac5-4b2c-4512-a437-b7737fba0204 => generated 1547 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 04:01:14.808754 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-bb7bdab7-6dab-4617-b91f-7fe2936b918d tempest-TestMinimumBasicScenario-510804398 tempest-TestMinimumBasicScenario-510804398-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 04:01:14.809426 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-bb7bdab7-6dab-4617-b91f-7fe2936b918d tempest-TestMinimumBasicScenario-510804398 tempest-TestMinimumBasicScenario-510804398-project] [instance: a2378ac5-4b2c-4512-a437-b7737fba0204] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 04:01:14.815793 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-bb7bdab7-6dab-4617-b91f-7fe2936b918d tempest-TestMinimumBasicScenario-510804398 tempest-TestMinimumBasicScenario-510804398-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 04:01:14.816239 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-bb7bdab7-6dab-4617-b91f-7fe2936b918d tempest-TestMinimumBasicScenario-510804398 tempest-TestMinimumBasicScenario-510804398-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 04:01:14.817035 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-bb7bdab7-6dab-4617-b91f-7fe2936b918d tempest-TestMinimumBasicScenario-510804398 tempest-TestMinimumBasicScenario-510804398-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 04:01:14.817526 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-bb7bdab7-6dab-4617-b91f-7fe2936b918d tempest-TestMinimumBasicScenario-510804398 tempest-TestMinimumBasicScenario-510804398-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 04:01:14.952634 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-bb7bdab7-6dab-4617-b91f-7fe2936b918d tempest-TestMinimumBasicScenario-510804398 tempest-TestMinimumBasicScenario-510804398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '220aa0d3d6494952b53d8d44265c4895', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4f4f943c957446b9fc9792385c53394', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 04:01:14.961134 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-bb7bdab7-6dab-4617-b91f-7fe2936b918d tempest-TestMinimumBasicScenario-510804398 tempest-TestMinimumBasicScenario-510804398-project] 10.222.0.11 "GET /compute/v2.1/servers/a2378ac5-4b2c-4512-a437-b7737fba0204" status: 200 len: 1547 microversion: 2.1 time: 0.156233 Nov 17 04:01:14.961710 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 1536/3184] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 04:01:14 2021] GET /compute/v2.1/servers/a2378ac5-4b2c-4512-a437-b7737fba0204 => generated 1547 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 04:01:14.977066 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-0bd31eab-ced0-4a6f-b0c6-af53f34c8cad tempest-TestMinimumBasicScenario-510804398 tempest-TestMinimumBasicScenario-510804398-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 04:01:14.980335 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:servers:allow_all_filters failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 17 04:01:14.980335 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: warnings.warn(msg) Nov 17 04:01:14.981342 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-0bd31eab-ced0-4a6f-b0c6-af53f34c8cad tempest-TestMinimumBasicScenario-510804398 tempest-TestMinimumBasicScenario-510804398-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '220aa0d3d6494952b53d8d44265c4895', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4f4f943c957446b9fc9792385c53394', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 04:01:14.982092 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-0bd31eab-ced0-4a6f-b0c6-af53f34c8cad tempest-TestMinimumBasicScenario-510804398 tempest-TestMinimumBasicScenario-510804398-project] Searching by: {'deleted': False, 'project_id': 'd4f4f943c957446b9fc9792385c53394'} {{(pid=115917) get_all /opt/stack/nova/nova/compute/api.py:2907}} Nov 17 04:01:14.989209 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-0bd31eab-ced0-4a6f-b0c6-af53f34c8cad tempest-TestMinimumBasicScenario-510804398 tempest-TestMinimumBasicScenario-510804398-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 04:01:14.989650 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-0bd31eab-ced0-4a6f-b0c6-af53f34c8cad tempest-TestMinimumBasicScenario-510804398 tempest-TestMinimumBasicScenario-510804398-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 04:01:14.990453 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-0bd31eab-ced0-4a6f-b0c6-af53f34c8cad tempest-TestMinimumBasicScenario-510804398 tempest-TestMinimumBasicScenario-510804398-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 04:01:14.991135 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-0bd31eab-ced0-4a6f-b0c6-af53f34c8cad tempest-TestMinimumBasicScenario-510804398 tempest-TestMinimumBasicScenario-510804398-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 04:01:15.090214 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.multi_cell_list [None req-0bd31eab-ced0-4a6f-b0c6-af53f34c8cad tempest-TestMinimumBasicScenario-510804398 tempest-TestMinimumBasicScenario-510804398-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=115917) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Nov 17 04:01:15.183844 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-0bd31eab-ced0-4a6f-b0c6-af53f34c8cad tempest-TestMinimumBasicScenario-510804398 tempest-TestMinimumBasicScenario-510804398-project] 10.222.0.11 "GET /compute/v2.1/servers" status: 200 len: 342 microversion: 2.1 time: 0.210579 Nov 17 04:01:15.184319 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 1649/3185] 10.222.0.11 () {58 vars in 1124 bytes} [Wed Nov 17 04:01:14 2021] GET /compute/v2.1/servers => generated 342 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 17 04:01:15.194628 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-d9e43dd0-9118-4ac9-9b74-51007c1adc1a tempest-TestMinimumBasicScenario-510804398 tempest-TestMinimumBasicScenario-510804398-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 04:01:15.195256 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-d9e43dd0-9118-4ac9-9b74-51007c1adc1a tempest-TestMinimumBasicScenario-510804398 tempest-TestMinimumBasicScenario-510804398-project] [instance: a2378ac5-4b2c-4512-a437-b7737fba0204] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 04:01:15.201724 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-d9e43dd0-9118-4ac9-9b74-51007c1adc1a tempest-TestMinimumBasicScenario-510804398 tempest-TestMinimumBasicScenario-510804398-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 04:01:15.202168 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-d9e43dd0-9118-4ac9-9b74-51007c1adc1a tempest-TestMinimumBasicScenario-510804398 tempest-TestMinimumBasicScenario-510804398-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 04:01:15.203448 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-d9e43dd0-9118-4ac9-9b74-51007c1adc1a tempest-TestMinimumBasicScenario-510804398 tempest-TestMinimumBasicScenario-510804398-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 04:01:15.203448 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-d9e43dd0-9118-4ac9-9b74-51007c1adc1a tempest-TestMinimumBasicScenario-510804398 tempest-TestMinimumBasicScenario-510804398-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 04:01:15.344279 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-d9e43dd0-9118-4ac9-9b74-51007c1adc1a tempest-TestMinimumBasicScenario-510804398 tempest-TestMinimumBasicScenario-510804398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '220aa0d3d6494952b53d8d44265c4895', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4f4f943c957446b9fc9792385c53394', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 04:01:15.353746 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-d9e43dd0-9118-4ac9-9b74-51007c1adc1a tempest-TestMinimumBasicScenario-510804398 tempest-TestMinimumBasicScenario-510804398-project] 10.222.0.11 "GET /compute/v2.1/servers/a2378ac5-4b2c-4512-a437-b7737fba0204" status: 200 len: 1547 microversion: 2.1 time: 0.162851 Nov 17 04:01:15.354322 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 1537/3186] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 04:01:15 2021] GET /compute/v2.1/servers/a2378ac5-4b2c-4512-a437-b7737fba0204 => generated 1547 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 04:01:16.887631 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-97e2b334-6164-4d1c-9be0-ddf1495620f1 tempest-TestMinimumBasicScenario-510804398 tempest-TestMinimumBasicScenario-510804398-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "e0b9ff5c-3695-41f4-9063-2c4b0fa0ebbe"}} {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 17 04:01:16.888681 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-97e2b334-6164-4d1c-9be0-ddf1495620f1 tempest-TestMinimumBasicScenario-510804398 tempest-TestMinimumBasicScenario-510804398-project] [instance: a2378ac5-4b2c-4512-a437-b7737fba0204] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 04:01:16.895072 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-97e2b334-6164-4d1c-9be0-ddf1495620f1 tempest-TestMinimumBasicScenario-510804398 tempest-TestMinimumBasicScenario-510804398-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 04:01:16.895518 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-97e2b334-6164-4d1c-9be0-ddf1495620f1 tempest-TestMinimumBasicScenario-510804398 tempest-TestMinimumBasicScenario-510804398-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 04:01:16.896274 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-97e2b334-6164-4d1c-9be0-ddf1495620f1 tempest-TestMinimumBasicScenario-510804398 tempest-TestMinimumBasicScenario-510804398-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 04:01:16.896702 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-97e2b334-6164-4d1c-9be0-ddf1495620f1 tempest-TestMinimumBasicScenario-510804398 tempest-TestMinimumBasicScenario-510804398-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 04:01:17.176792 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-97e2b334-6164-4d1c-9be0-ddf1495620f1 tempest-TestMinimumBasicScenario-510804398 tempest-TestMinimumBasicScenario-510804398-project] 10.222.0.11 "POST /compute/v2.1/servers/a2378ac5-4b2c-4512-a437-b7737fba0204/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.292725 Nov 17 04:01:17.177514 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 1650/3187] 10.222.0.11 () {60 vars in 1322 bytes} [Wed Nov 17 04:01:16 2021] POST /compute/v2.1/servers/a2378ac5-4b2c-4512-a437-b7737fba0204/os-volume_attachments => generated 194 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 17 04:01:24.776751 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-b7760ddf-c0af-44e8-a668-9d9aa11d6e33 tempest-TestMinimumBasicScenario-510804398 tempest-TestMinimumBasicScenario-510804398-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 04:01:24.777392 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-b7760ddf-c0af-44e8-a668-9d9aa11d6e33 tempest-TestMinimumBasicScenario-510804398 tempest-TestMinimumBasicScenario-510804398-project] [instance: a2378ac5-4b2c-4512-a437-b7737fba0204] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 04:01:24.784052 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-b7760ddf-c0af-44e8-a668-9d9aa11d6e33 tempest-TestMinimumBasicScenario-510804398 tempest-TestMinimumBasicScenario-510804398-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 04:01:24.784498 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-b7760ddf-c0af-44e8-a668-9d9aa11d6e33 tempest-TestMinimumBasicScenario-510804398 tempest-TestMinimumBasicScenario-510804398-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 04:01:24.785315 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-b7760ddf-c0af-44e8-a668-9d9aa11d6e33 tempest-TestMinimumBasicScenario-510804398 tempest-TestMinimumBasicScenario-510804398-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 04:01:24.785745 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-b7760ddf-c0af-44e8-a668-9d9aa11d6e33 tempest-TestMinimumBasicScenario-510804398 tempest-TestMinimumBasicScenario-510804398-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 04:01:24.919469 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-b7760ddf-c0af-44e8-a668-9d9aa11d6e33 tempest-TestMinimumBasicScenario-510804398 tempest-TestMinimumBasicScenario-510804398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '220aa0d3d6494952b53d8d44265c4895', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4f4f943c957446b9fc9792385c53394', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 04:01:24.927720 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-b7760ddf-c0af-44e8-a668-9d9aa11d6e33 tempest-TestMinimumBasicScenario-510804398 tempest-TestMinimumBasicScenario-510804398-project] 10.222.0.11 "GET /compute/v2.1/servers/a2378ac5-4b2c-4512-a437-b7737fba0204" status: 200 len: 1593 microversion: 2.1 time: 0.154845 Nov 17 04:01:24.928293 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 1538/3188] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 04:01:24 2021] GET /compute/v2.1/servers/a2378ac5-4b2c-4512-a437-b7737fba0204 => generated 1593 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 04:01:27.104913 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [req-9f4bdf35-3923-408b-a080-6ba87a70c353 req-75308b20-2331-4b75-90a1-54b297cbc4a9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a2378ac5-4b2c-4512-a437-b7737fba0204", "tag": "76b2a23a-990f-47e8-b961-ce6daae261f1"}]} {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 17 04:01:27.107050 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 17 04:01:27.107050 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: warnings.warn(msg) Nov 17 04:01:27.114647 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [req-9f4bdf35-3923-408b-a080-6ba87a70c353 req-75308b20-2331-4b75-90a1-54b297cbc4a9 service nova] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 04:01:27.115309 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [req-9f4bdf35-3923-408b-a080-6ba87a70c353 req-75308b20-2331-4b75-90a1-54b297cbc4a9 service nova] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 04:01:27.126977 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.compute.server_external_events [req-9f4bdf35-3923-408b-a080-6ba87a70c353 req-75308b20-2331-4b75-90a1-54b297cbc4a9 service nova] Creating event network-changed:76b2a23a-990f-47e8-b961-ce6daae261f1 for instance a2378ac5-4b2c-4512-a437-b7737fba0204 on hv-cinder-81803 Nov 17 04:01:27.133996 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [req-9f4bdf35-3923-408b-a080-6ba87a70c353 req-75308b20-2331-4b75-90a1-54b297cbc4a9 service nova] 10.222.0.11 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.170615 Nov 17 04:01:27.135936 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 1651/3189] 10.222.0.11 () {64 vars in 1317 bytes} [Wed Nov 17 04:01:26 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 17 04:01:28.008423 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-db9af889-eb62-4b80-9b7f-c9bc5ac8cba9 tempest-TestMinimumBasicScenario-510804398 tempest-TestMinimumBasicScenario-510804398-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-216664721"}} {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 17 04:01:28.009089 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-db9af889-eb62-4b80-9b7f-c9bc5ac8cba9 tempest-TestMinimumBasicScenario-510804398 tempest-TestMinimumBasicScenario-510804398-project] [instance: a2378ac5-4b2c-4512-a437-b7737fba0204] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 04:01:28.015223 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-db9af889-eb62-4b80-9b7f-c9bc5ac8cba9 tempest-TestMinimumBasicScenario-510804398 tempest-TestMinimumBasicScenario-510804398-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 04:01:28.015666 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-db9af889-eb62-4b80-9b7f-c9bc5ac8cba9 tempest-TestMinimumBasicScenario-510804398 tempest-TestMinimumBasicScenario-510804398-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 04:01:28.016497 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-db9af889-eb62-4b80-9b7f-c9bc5ac8cba9 tempest-TestMinimumBasicScenario-510804398 tempest-TestMinimumBasicScenario-510804398-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 04:01:28.016969 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-db9af889-eb62-4b80-9b7f-c9bc5ac8cba9 tempest-TestMinimumBasicScenario-510804398 tempest-TestMinimumBasicScenario-510804398-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 04:01:28.156450 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.network.security_group_api [None req-db9af889-eb62-4b80-9b7f-c9bc5ac8cba9 tempest-TestMinimumBasicScenario-510804398 tempest-TestMinimumBasicScenario-510804398-project] Adding security group 0bb97cb1-e2ba-4104-9f2b-ffb5aa520938 to port 76b2a23a-990f-47e8-b961-ce6daae261f1 Nov 17 04:01:28.495524 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-db9af889-eb62-4b80-9b7f-c9bc5ac8cba9 tempest-TestMinimumBasicScenario-510804398 tempest-TestMinimumBasicScenario-510804398-project] 10.222.0.11 "POST /compute/v2.1/servers/a2378ac5-4b2c-4512-a437-b7737fba0204/action" status: 202 len: 0 microversion: 2.1 time: 0.495981 Nov 17 04:01:28.496904 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 1539/3190] 10.222.0.11 () {60 vars in 1277 bytes} [Wed Nov 17 04:01:27 2021] POST /compute/v2.1/servers/a2378ac5-4b2c-4512-a437-b7737fba0204/action => generated 0 bytes in 498 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Nov 17 04:01:28.509316 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [req-345abd2b-332d-4f8e-ba4d-a745e8b5d471 req-4184d1a3-a037-44e4-9c01-02b407164517 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a2378ac5-4b2c-4512-a437-b7737fba0204", "tag": "76b2a23a-990f-47e8-b961-ce6daae261f1"}]} {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 17 04:01:28.510858 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 17 04:01:28.510858 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: warnings.warn(msg) Nov 17 04:01:28.514750 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-fac51f4f-718c-4b70-9dd3-a01cbe575196 tempest-TestMinimumBasicScenario-510804398 tempest-TestMinimumBasicScenario-510804398-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 04:01:28.515456 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-fac51f4f-718c-4b70-9dd3-a01cbe575196 tempest-TestMinimumBasicScenario-510804398 tempest-TestMinimumBasicScenario-510804398-project] [instance: a2378ac5-4b2c-4512-a437-b7737fba0204] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 04:01:28.530402 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-fac51f4f-718c-4b70-9dd3-a01cbe575196 tempest-TestMinimumBasicScenario-510804398 tempest-TestMinimumBasicScenario-510804398-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 04:01:28.530984 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-fac51f4f-718c-4b70-9dd3-a01cbe575196 tempest-TestMinimumBasicScenario-510804398 tempest-TestMinimumBasicScenario-510804398-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 04:01:28.532089 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-fac51f4f-718c-4b70-9dd3-a01cbe575196 tempest-TestMinimumBasicScenario-510804398 tempest-TestMinimumBasicScenario-510804398-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 04:01:28.532217 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-fac51f4f-718c-4b70-9dd3-a01cbe575196 tempest-TestMinimumBasicScenario-510804398 tempest-TestMinimumBasicScenario-510804398-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 04:01:28.541105 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [req-345abd2b-332d-4f8e-ba4d-a745e8b5d471 req-4184d1a3-a037-44e4-9c01-02b407164517 service nova] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 04:01:28.549017 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [req-345abd2b-332d-4f8e-ba4d-a745e8b5d471 req-4184d1a3-a037-44e4-9c01-02b407164517 service nova] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 04:01:28.568466 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.compute.server_external_events [req-345abd2b-332d-4f8e-ba4d-a745e8b5d471 req-4184d1a3-a037-44e4-9c01-02b407164517 service nova] Creating event network-changed:76b2a23a-990f-47e8-b961-ce6daae261f1 for instance a2378ac5-4b2c-4512-a437-b7737fba0204 on hv-cinder-81803 Nov 17 04:01:28.574821 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [req-345abd2b-332d-4f8e-ba4d-a745e8b5d471 req-4184d1a3-a037-44e4-9c01-02b407164517 service nova] 10.222.0.11 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.069075 Nov 17 04:01:28.575450 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 1540/3191] 10.222.0.11 () {64 vars in 1317 bytes} [Wed Nov 17 04:01:28 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 17 04:01:28.801805 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-fac51f4f-718c-4b70-9dd3-a01cbe575196 tempest-TestMinimumBasicScenario-510804398 tempest-TestMinimumBasicScenario-510804398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '220aa0d3d6494952b53d8d44265c4895', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4f4f943c957446b9fc9792385c53394', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 04:01:28.809973 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-fac51f4f-718c-4b70-9dd3-a01cbe575196 tempest-TestMinimumBasicScenario-510804398 tempest-TestMinimumBasicScenario-510804398-project] 10.222.0.11 "GET /compute/v2.1/servers/a2378ac5-4b2c-4512-a437-b7737fba0204" status: 200 len: 1758 microversion: 2.1 time: 0.308873 Nov 17 04:01:28.811129 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 1652/3192] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 04:01:28 2021] GET /compute/v2.1/servers/a2378ac5-4b2c-4512-a437-b7737fba0204 => generated 1758 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 04:01:51.193577 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-034aee4e-20e0-493e-90bb-83033ded21a5 tempest-TestMinimumBasicScenario-510804398 tempest-TestMinimumBasicScenario-510804398-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 17 04:01:51.195794 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-034aee4e-20e0-493e-90bb-83033ded21a5 tempest-TestMinimumBasicScenario-510804398 tempest-TestMinimumBasicScenario-510804398-project] [instance: a2378ac5-4b2c-4512-a437-b7737fba0204] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 04:01:51.205566 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-034aee4e-20e0-493e-90bb-83033ded21a5 tempest-TestMinimumBasicScenario-510804398 tempest-TestMinimumBasicScenario-510804398-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 04:01:51.206046 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-034aee4e-20e0-493e-90bb-83033ded21a5 tempest-TestMinimumBasicScenario-510804398 tempest-TestMinimumBasicScenario-510804398-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 04:01:51.207025 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-034aee4e-20e0-493e-90bb-83033ded21a5 tempest-TestMinimumBasicScenario-510804398 tempest-TestMinimumBasicScenario-510804398-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 04:01:51.207214 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-034aee4e-20e0-493e-90bb-83033ded21a5 tempest-TestMinimumBasicScenario-510804398 tempest-TestMinimumBasicScenario-510804398-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 04:01:51.289904 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-034aee4e-20e0-493e-90bb-83033ded21a5 tempest-TestMinimumBasicScenario-510804398 tempest-TestMinimumBasicScenario-510804398-project] 10.222.0.11 "POST /compute/v2.1/servers/a2378ac5-4b2c-4512-a437-b7737fba0204/action" status: 202 len: 0 microversion: 2.1 time: 0.105026 Nov 17 04:01:51.293526 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 1541/3193] 10.222.0.11 () {60 vars in 1277 bytes} [Wed Nov 17 04:01:51 2021] POST /compute/v2.1/servers/a2378ac5-4b2c-4512-a437-b7737fba0204/action => generated 0 bytes in 107 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 17 04:01:51.298809 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-80d500cb-e2f5-4a28-8610-a0920f025978 tempest-TestMinimumBasicScenario-510804398 tempest-TestMinimumBasicScenario-510804398-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 04:01:51.299958 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-80d500cb-e2f5-4a28-8610-a0920f025978 tempest-TestMinimumBasicScenario-510804398 tempest-TestMinimumBasicScenario-510804398-project] [instance: a2378ac5-4b2c-4512-a437-b7737fba0204] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 04:01:51.306534 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-80d500cb-e2f5-4a28-8610-a0920f025978 tempest-TestMinimumBasicScenario-510804398 tempest-TestMinimumBasicScenario-510804398-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 04:01:51.306948 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-80d500cb-e2f5-4a28-8610-a0920f025978 tempest-TestMinimumBasicScenario-510804398 tempest-TestMinimumBasicScenario-510804398-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 04:01:51.307722 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-80d500cb-e2f5-4a28-8610-a0920f025978 tempest-TestMinimumBasicScenario-510804398 tempest-TestMinimumBasicScenario-510804398-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 04:01:51.308677 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-80d500cb-e2f5-4a28-8610-a0920f025978 tempest-TestMinimumBasicScenario-510804398 tempest-TestMinimumBasicScenario-510804398-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 04:01:51.457319 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-80d500cb-e2f5-4a28-8610-a0920f025978 tempest-TestMinimumBasicScenario-510804398 tempest-TestMinimumBasicScenario-510804398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '220aa0d3d6494952b53d8d44265c4895', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4f4f943c957446b9fc9792385c53394', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 04:01:51.465266 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-80d500cb-e2f5-4a28-8610-a0920f025978 tempest-TestMinimumBasicScenario-510804398 tempest-TestMinimumBasicScenario-510804398-project] 10.222.0.11 "GET /compute/v2.1/servers/a2378ac5-4b2c-4512-a437-b7737fba0204" status: 200 len: 1750 microversion: 2.1 time: 0.170038 Nov 17 04:01:51.465917 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 1653/3194] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 04:01:51 2021] GET /compute/v2.1/servers/a2378ac5-4b2c-4512-a437-b7737fba0204 => generated 1750 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 17 04:01:52.484880 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-85acdafc-f217-42e7-b1dd-c260daec9308 tempest-TestMinimumBasicScenario-510804398 tempest-TestMinimumBasicScenario-510804398-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 04:01:52.485578 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-85acdafc-f217-42e7-b1dd-c260daec9308 tempest-TestMinimumBasicScenario-510804398 tempest-TestMinimumBasicScenario-510804398-project] [instance: a2378ac5-4b2c-4512-a437-b7737fba0204] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 04:01:52.492418 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-85acdafc-f217-42e7-b1dd-c260daec9308 tempest-TestMinimumBasicScenario-510804398 tempest-TestMinimumBasicScenario-510804398-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 04:01:52.492897 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-85acdafc-f217-42e7-b1dd-c260daec9308 tempest-TestMinimumBasicScenario-510804398 tempest-TestMinimumBasicScenario-510804398-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 04:01:52.493681 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-85acdafc-f217-42e7-b1dd-c260daec9308 tempest-TestMinimumBasicScenario-510804398 tempest-TestMinimumBasicScenario-510804398-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 04:01:52.494111 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-85acdafc-f217-42e7-b1dd-c260daec9308 tempest-TestMinimumBasicScenario-510804398 tempest-TestMinimumBasicScenario-510804398-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 04:01:52.654439 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-85acdafc-f217-42e7-b1dd-c260daec9308 tempest-TestMinimumBasicScenario-510804398 tempest-TestMinimumBasicScenario-510804398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '220aa0d3d6494952b53d8d44265c4895', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4f4f943c957446b9fc9792385c53394', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 04:01:52.662662 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-85acdafc-f217-42e7-b1dd-c260daec9308 tempest-TestMinimumBasicScenario-510804398 tempest-TestMinimumBasicScenario-510804398-project] 10.222.0.11 "GET /compute/v2.1/servers/a2378ac5-4b2c-4512-a437-b7737fba0204" status: 200 len: 1755 microversion: 2.1 time: 0.182622 Nov 17 04:01:52.663232 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 1542/3195] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 04:01:52 2021] GET /compute/v2.1/servers/a2378ac5-4b2c-4512-a437-b7737fba0204 => generated 1755 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 04:01:53.685157 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-ec1a28e5-42e7-43a2-9506-80852f06f8b5 tempest-TestMinimumBasicScenario-510804398 tempest-TestMinimumBasicScenario-510804398-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 04:01:53.685879 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-ec1a28e5-42e7-43a2-9506-80852f06f8b5 tempest-TestMinimumBasicScenario-510804398 tempest-TestMinimumBasicScenario-510804398-project] [instance: a2378ac5-4b2c-4512-a437-b7737fba0204] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 04:01:53.693610 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-ec1a28e5-42e7-43a2-9506-80852f06f8b5 tempest-TestMinimumBasicScenario-510804398 tempest-TestMinimumBasicScenario-510804398-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 04:01:53.694173 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-ec1a28e5-42e7-43a2-9506-80852f06f8b5 tempest-TestMinimumBasicScenario-510804398 tempest-TestMinimumBasicScenario-510804398-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 04:01:53.695130 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-ec1a28e5-42e7-43a2-9506-80852f06f8b5 tempest-TestMinimumBasicScenario-510804398 tempest-TestMinimumBasicScenario-510804398-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 04:01:53.695684 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-ec1a28e5-42e7-43a2-9506-80852f06f8b5 tempest-TestMinimumBasicScenario-510804398 tempest-TestMinimumBasicScenario-510804398-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 04:01:53.852857 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-ec1a28e5-42e7-43a2-9506-80852f06f8b5 tempest-TestMinimumBasicScenario-510804398 tempest-TestMinimumBasicScenario-510804398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '220aa0d3d6494952b53d8d44265c4895', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4f4f943c957446b9fc9792385c53394', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 04:01:53.864388 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-ec1a28e5-42e7-43a2-9506-80852f06f8b5 tempest-TestMinimumBasicScenario-510804398 tempest-TestMinimumBasicScenario-510804398-project] 10.222.0.11 "GET /compute/v2.1/servers/a2378ac5-4b2c-4512-a437-b7737fba0204" status: 200 len: 1755 microversion: 2.1 time: 0.185345 Nov 17 04:01:53.865279 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 1654/3196] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 04:01:53 2021] GET /compute/v2.1/servers/a2378ac5-4b2c-4512-a437-b7737fba0204 => generated 1755 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 04:01:54.882218 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-db71bd2c-40dc-46cb-951d-5437159d312b tempest-TestMinimumBasicScenario-510804398 tempest-TestMinimumBasicScenario-510804398-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 04:01:54.882821 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-db71bd2c-40dc-46cb-951d-5437159d312b tempest-TestMinimumBasicScenario-510804398 tempest-TestMinimumBasicScenario-510804398-project] [instance: a2378ac5-4b2c-4512-a437-b7737fba0204] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 04:01:54.890597 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-db71bd2c-40dc-46cb-951d-5437159d312b tempest-TestMinimumBasicScenario-510804398 tempest-TestMinimumBasicScenario-510804398-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 04:01:54.891050 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-db71bd2c-40dc-46cb-951d-5437159d312b tempest-TestMinimumBasicScenario-510804398 tempest-TestMinimumBasicScenario-510804398-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 04:01:54.891832 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-db71bd2c-40dc-46cb-951d-5437159d312b tempest-TestMinimumBasicScenario-510804398 tempest-TestMinimumBasicScenario-510804398-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 04:01:54.892263 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-db71bd2c-40dc-46cb-951d-5437159d312b tempest-TestMinimumBasicScenario-510804398 tempest-TestMinimumBasicScenario-510804398-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 04:01:55.042426 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-db71bd2c-40dc-46cb-951d-5437159d312b tempest-TestMinimumBasicScenario-510804398 tempest-TestMinimumBasicScenario-510804398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '220aa0d3d6494952b53d8d44265c4895', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4f4f943c957446b9fc9792385c53394', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 04:01:55.050925 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-db71bd2c-40dc-46cb-951d-5437159d312b tempest-TestMinimumBasicScenario-510804398 tempest-TestMinimumBasicScenario-510804398-project] 10.222.0.11 "GET /compute/v2.1/servers/a2378ac5-4b2c-4512-a437-b7737fba0204" status: 200 len: 1755 microversion: 2.1 time: 0.172447 Nov 17 04:01:55.051507 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 1543/3197] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 04:01:54 2021] GET /compute/v2.1/servers/a2378ac5-4b2c-4512-a437-b7737fba0204 => generated 1755 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 04:01:56.067983 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-3eb3b873-aa8e-44d7-9859-38347e457164 tempest-TestMinimumBasicScenario-510804398 tempest-TestMinimumBasicScenario-510804398-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 04:01:56.068591 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-3eb3b873-aa8e-44d7-9859-38347e457164 tempest-TestMinimumBasicScenario-510804398 tempest-TestMinimumBasicScenario-510804398-project] [instance: a2378ac5-4b2c-4512-a437-b7737fba0204] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 04:01:56.075184 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-3eb3b873-aa8e-44d7-9859-38347e457164 tempest-TestMinimumBasicScenario-510804398 tempest-TestMinimumBasicScenario-510804398-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 04:01:56.075949 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-3eb3b873-aa8e-44d7-9859-38347e457164 tempest-TestMinimumBasicScenario-510804398 tempest-TestMinimumBasicScenario-510804398-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 04:01:56.076729 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-3eb3b873-aa8e-44d7-9859-38347e457164 tempest-TestMinimumBasicScenario-510804398 tempest-TestMinimumBasicScenario-510804398-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 04:01:56.077197 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-3eb3b873-aa8e-44d7-9859-38347e457164 tempest-TestMinimumBasicScenario-510804398 tempest-TestMinimumBasicScenario-510804398-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 04:01:56.235035 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-3eb3b873-aa8e-44d7-9859-38347e457164 tempest-TestMinimumBasicScenario-510804398 tempest-TestMinimumBasicScenario-510804398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '220aa0d3d6494952b53d8d44265c4895', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4f4f943c957446b9fc9792385c53394', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 04:01:56.243621 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-3eb3b873-aa8e-44d7-9859-38347e457164 tempest-TestMinimumBasicScenario-510804398 tempest-TestMinimumBasicScenario-510804398-project] 10.222.0.11 "GET /compute/v2.1/servers/a2378ac5-4b2c-4512-a437-b7737fba0204" status: 200 len: 1755 microversion: 2.1 time: 0.179339 Nov 17 04:01:56.244191 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 1655/3198] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 04:01:56 2021] GET /compute/v2.1/servers/a2378ac5-4b2c-4512-a437-b7737fba0204 => generated 1755 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 04:01:57.261294 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-526ab18c-0c74-4cfd-8ee7-ee17c918305f tempest-TestMinimumBasicScenario-510804398 tempest-TestMinimumBasicScenario-510804398-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 04:01:57.261919 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-526ab18c-0c74-4cfd-8ee7-ee17c918305f tempest-TestMinimumBasicScenario-510804398 tempest-TestMinimumBasicScenario-510804398-project] [instance: a2378ac5-4b2c-4512-a437-b7737fba0204] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 04:01:57.268669 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-526ab18c-0c74-4cfd-8ee7-ee17c918305f tempest-TestMinimumBasicScenario-510804398 tempest-TestMinimumBasicScenario-510804398-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 04:01:57.269141 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-526ab18c-0c74-4cfd-8ee7-ee17c918305f tempest-TestMinimumBasicScenario-510804398 tempest-TestMinimumBasicScenario-510804398-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 04:01:57.269899 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-526ab18c-0c74-4cfd-8ee7-ee17c918305f tempest-TestMinimumBasicScenario-510804398 tempest-TestMinimumBasicScenario-510804398-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 04:01:57.270330 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-526ab18c-0c74-4cfd-8ee7-ee17c918305f tempest-TestMinimumBasicScenario-510804398 tempest-TestMinimumBasicScenario-510804398-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 04:01:57.432001 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-526ab18c-0c74-4cfd-8ee7-ee17c918305f tempest-TestMinimumBasicScenario-510804398 tempest-TestMinimumBasicScenario-510804398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '220aa0d3d6494952b53d8d44265c4895', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4f4f943c957446b9fc9792385c53394', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 04:01:57.440806 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-526ab18c-0c74-4cfd-8ee7-ee17c918305f tempest-TestMinimumBasicScenario-510804398 tempest-TestMinimumBasicScenario-510804398-project] 10.222.0.11 "GET /compute/v2.1/servers/a2378ac5-4b2c-4512-a437-b7737fba0204" status: 200 len: 1755 microversion: 2.1 time: 0.183226 Nov 17 04:01:57.441388 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 1544/3199] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 04:01:57 2021] GET /compute/v2.1/servers/a2378ac5-4b2c-4512-a437-b7737fba0204 => generated 1755 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 04:01:58.467389 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-b542dbb6-e71b-44c6-b7aa-d19111d09c1a tempest-TestMinimumBasicScenario-510804398 tempest-TestMinimumBasicScenario-510804398-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 04:01:58.469198 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-b542dbb6-e71b-44c6-b7aa-d19111d09c1a tempest-TestMinimumBasicScenario-510804398 tempest-TestMinimumBasicScenario-510804398-project] [instance: a2378ac5-4b2c-4512-a437-b7737fba0204] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 04:01:58.479129 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-b542dbb6-e71b-44c6-b7aa-d19111d09c1a tempest-TestMinimumBasicScenario-510804398 tempest-TestMinimumBasicScenario-510804398-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 04:01:58.479866 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-b542dbb6-e71b-44c6-b7aa-d19111d09c1a tempest-TestMinimumBasicScenario-510804398 tempest-TestMinimumBasicScenario-510804398-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 04:01:58.481196 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-b542dbb6-e71b-44c6-b7aa-d19111d09c1a tempest-TestMinimumBasicScenario-510804398 tempest-TestMinimumBasicScenario-510804398-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 04:01:58.481901 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-b542dbb6-e71b-44c6-b7aa-d19111d09c1a tempest-TestMinimumBasicScenario-510804398 tempest-TestMinimumBasicScenario-510804398-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 04:01:58.625002 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-b542dbb6-e71b-44c6-b7aa-d19111d09c1a tempest-TestMinimumBasicScenario-510804398 tempest-TestMinimumBasicScenario-510804398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '220aa0d3d6494952b53d8d44265c4895', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4f4f943c957446b9fc9792385c53394', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 04:01:58.633591 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-b542dbb6-e71b-44c6-b7aa-d19111d09c1a tempest-TestMinimumBasicScenario-510804398 tempest-TestMinimumBasicScenario-510804398-project] 10.222.0.11 "GET /compute/v2.1/servers/a2378ac5-4b2c-4512-a437-b7737fba0204" status: 200 len: 1755 microversion: 2.1 time: 0.172479 Nov 17 04:01:58.634164 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 1656/3200] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 04:01:58 2021] GET /compute/v2.1/servers/a2378ac5-4b2c-4512-a437-b7737fba0204 => generated 1755 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 04:01:59.654444 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-d0806945-3e97-4e0a-81a7-2f57e700546e tempest-TestMinimumBasicScenario-510804398 tempest-TestMinimumBasicScenario-510804398-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 04:01:59.656002 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-d0806945-3e97-4e0a-81a7-2f57e700546e tempest-TestMinimumBasicScenario-510804398 tempest-TestMinimumBasicScenario-510804398-project] [instance: a2378ac5-4b2c-4512-a437-b7737fba0204] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 04:01:59.662388 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-d0806945-3e97-4e0a-81a7-2f57e700546e tempest-TestMinimumBasicScenario-510804398 tempest-TestMinimumBasicScenario-510804398-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 04:01:59.662831 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-d0806945-3e97-4e0a-81a7-2f57e700546e tempest-TestMinimumBasicScenario-510804398 tempest-TestMinimumBasicScenario-510804398-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 04:01:59.663588 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-d0806945-3e97-4e0a-81a7-2f57e700546e tempest-TestMinimumBasicScenario-510804398 tempest-TestMinimumBasicScenario-510804398-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 04:01:59.664014 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-d0806945-3e97-4e0a-81a7-2f57e700546e tempest-TestMinimumBasicScenario-510804398 tempest-TestMinimumBasicScenario-510804398-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 04:01:59.821130 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-d0806945-3e97-4e0a-81a7-2f57e700546e tempest-TestMinimumBasicScenario-510804398 tempest-TestMinimumBasicScenario-510804398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '220aa0d3d6494952b53d8d44265c4895', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4f4f943c957446b9fc9792385c53394', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 04:01:59.833535 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-d0806945-3e97-4e0a-81a7-2f57e700546e tempest-TestMinimumBasicScenario-510804398 tempest-TestMinimumBasicScenario-510804398-project] 10.222.0.11 "GET /compute/v2.1/servers/a2378ac5-4b2c-4512-a437-b7737fba0204" status: 200 len: 1755 microversion: 2.1 time: 0.185020 Nov 17 04:01:59.834382 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 1545/3201] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 04:01:59 2021] GET /compute/v2.1/servers/a2378ac5-4b2c-4512-a437-b7737fba0204 => generated 1755 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 04:02:00.854169 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-a2c7a59c-78a6-46e7-a95e-e9ab8e586e20 tempest-TestMinimumBasicScenario-510804398 tempest-TestMinimumBasicScenario-510804398-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 04:02:00.854734 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-a2c7a59c-78a6-46e7-a95e-e9ab8e586e20 tempest-TestMinimumBasicScenario-510804398 tempest-TestMinimumBasicScenario-510804398-project] [instance: a2378ac5-4b2c-4512-a437-b7737fba0204] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 04:02:00.861304 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-a2c7a59c-78a6-46e7-a95e-e9ab8e586e20 tempest-TestMinimumBasicScenario-510804398 tempest-TestMinimumBasicScenario-510804398-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 04:02:00.861740 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-a2c7a59c-78a6-46e7-a95e-e9ab8e586e20 tempest-TestMinimumBasicScenario-510804398 tempest-TestMinimumBasicScenario-510804398-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 04:02:00.862505 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-a2c7a59c-78a6-46e7-a95e-e9ab8e586e20 tempest-TestMinimumBasicScenario-510804398 tempest-TestMinimumBasicScenario-510804398-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 04:02:00.862941 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-a2c7a59c-78a6-46e7-a95e-e9ab8e586e20 tempest-TestMinimumBasicScenario-510804398 tempest-TestMinimumBasicScenario-510804398-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 04:02:01.027476 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-a2c7a59c-78a6-46e7-a95e-e9ab8e586e20 tempest-TestMinimumBasicScenario-510804398 tempest-TestMinimumBasicScenario-510804398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '220aa0d3d6494952b53d8d44265c4895', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4f4f943c957446b9fc9792385c53394', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 04:02:01.036595 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-a2c7a59c-78a6-46e7-a95e-e9ab8e586e20 tempest-TestMinimumBasicScenario-510804398 tempest-TestMinimumBasicScenario-510804398-project] 10.222.0.11 "GET /compute/v2.1/servers/a2378ac5-4b2c-4512-a437-b7737fba0204" status: 200 len: 1755 microversion: 2.1 time: 0.186099 Nov 17 04:02:01.037186 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 1657/3202] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 04:02:00 2021] GET /compute/v2.1/servers/a2378ac5-4b2c-4512-a437-b7737fba0204 => generated 1755 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 04:02:02.060871 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-e42ead2b-a96b-49ba-a182-5023952774cf tempest-TestMinimumBasicScenario-510804398 tempest-TestMinimumBasicScenario-510804398-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 04:02:02.062010 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-e42ead2b-a96b-49ba-a182-5023952774cf tempest-TestMinimumBasicScenario-510804398 tempest-TestMinimumBasicScenario-510804398-project] [instance: a2378ac5-4b2c-4512-a437-b7737fba0204] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 04:02:02.068956 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-e42ead2b-a96b-49ba-a182-5023952774cf tempest-TestMinimumBasicScenario-510804398 tempest-TestMinimumBasicScenario-510804398-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 04:02:02.069393 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-e42ead2b-a96b-49ba-a182-5023952774cf tempest-TestMinimumBasicScenario-510804398 tempest-TestMinimumBasicScenario-510804398-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 04:02:02.070176 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-e42ead2b-a96b-49ba-a182-5023952774cf tempest-TestMinimumBasicScenario-510804398 tempest-TestMinimumBasicScenario-510804398-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 04:02:02.070616 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-e42ead2b-a96b-49ba-a182-5023952774cf tempest-TestMinimumBasicScenario-510804398 tempest-TestMinimumBasicScenario-510804398-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 04:02:02.218246 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-e42ead2b-a96b-49ba-a182-5023952774cf tempest-TestMinimumBasicScenario-510804398 tempest-TestMinimumBasicScenario-510804398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '220aa0d3d6494952b53d8d44265c4895', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4f4f943c957446b9fc9792385c53394', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 04:02:02.226911 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-e42ead2b-a96b-49ba-a182-5023952774cf tempest-TestMinimumBasicScenario-510804398 tempest-TestMinimumBasicScenario-510804398-project] 10.222.0.11 "GET /compute/v2.1/servers/a2378ac5-4b2c-4512-a437-b7737fba0204" status: 200 len: 1755 microversion: 2.1 time: 0.175026 Nov 17 04:02:02.227488 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 1546/3203] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 04:02:02 2021] GET /compute/v2.1/servers/a2378ac5-4b2c-4512-a437-b7737fba0204 => generated 1755 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 04:02:03.243885 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-a8a32ed1-66f2-40ca-a369-c552db7ffbf5 tempest-TestMinimumBasicScenario-510804398 tempest-TestMinimumBasicScenario-510804398-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 04:02:03.244586 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-a8a32ed1-66f2-40ca-a369-c552db7ffbf5 tempest-TestMinimumBasicScenario-510804398 tempest-TestMinimumBasicScenario-510804398-project] [instance: a2378ac5-4b2c-4512-a437-b7737fba0204] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 04:02:03.252143 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-a8a32ed1-66f2-40ca-a369-c552db7ffbf5 tempest-TestMinimumBasicScenario-510804398 tempest-TestMinimumBasicScenario-510804398-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 04:02:03.252691 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-a8a32ed1-66f2-40ca-a369-c552db7ffbf5 tempest-TestMinimumBasicScenario-510804398 tempest-TestMinimumBasicScenario-510804398-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 04:02:03.253850 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-a8a32ed1-66f2-40ca-a369-c552db7ffbf5 tempest-TestMinimumBasicScenario-510804398 tempest-TestMinimumBasicScenario-510804398-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 04:02:03.254424 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-a8a32ed1-66f2-40ca-a369-c552db7ffbf5 tempest-TestMinimumBasicScenario-510804398 tempest-TestMinimumBasicScenario-510804398-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 04:02:03.416102 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-a8a32ed1-66f2-40ca-a369-c552db7ffbf5 tempest-TestMinimumBasicScenario-510804398 tempest-TestMinimumBasicScenario-510804398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '220aa0d3d6494952b53d8d44265c4895', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4f4f943c957446b9fc9792385c53394', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 04:02:03.432138 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-a8a32ed1-66f2-40ca-a369-c552db7ffbf5 tempest-TestMinimumBasicScenario-510804398 tempest-TestMinimumBasicScenario-510804398-project] 10.222.0.11 "GET /compute/v2.1/servers/a2378ac5-4b2c-4512-a437-b7737fba0204" status: 200 len: 1755 microversion: 2.1 time: 0.191271 Nov 17 04:02:03.433761 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 1658/3204] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 04:02:03 2021] GET /compute/v2.1/servers/a2378ac5-4b2c-4512-a437-b7737fba0204 => generated 1755 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 04:02:04.455059 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-53704ba8-11fa-4a70-9734-d5d2a180689c tempest-TestMinimumBasicScenario-510804398 tempest-TestMinimumBasicScenario-510804398-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 04:02:04.455808 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-53704ba8-11fa-4a70-9734-d5d2a180689c tempest-TestMinimumBasicScenario-510804398 tempest-TestMinimumBasicScenario-510804398-project] [instance: a2378ac5-4b2c-4512-a437-b7737fba0204] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 04:02:04.463960 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-53704ba8-11fa-4a70-9734-d5d2a180689c tempest-TestMinimumBasicScenario-510804398 tempest-TestMinimumBasicScenario-510804398-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 04:02:04.464525 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-53704ba8-11fa-4a70-9734-d5d2a180689c tempest-TestMinimumBasicScenario-510804398 tempest-TestMinimumBasicScenario-510804398-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 04:02:04.465968 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-53704ba8-11fa-4a70-9734-d5d2a180689c tempest-TestMinimumBasicScenario-510804398 tempest-TestMinimumBasicScenario-510804398-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 04:02:04.466509 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-53704ba8-11fa-4a70-9734-d5d2a180689c tempest-TestMinimumBasicScenario-510804398 tempest-TestMinimumBasicScenario-510804398-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 04:02:04.620211 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-53704ba8-11fa-4a70-9734-d5d2a180689c tempest-TestMinimumBasicScenario-510804398 tempest-TestMinimumBasicScenario-510804398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '220aa0d3d6494952b53d8d44265c4895', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4f4f943c957446b9fc9792385c53394', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 04:02:04.629730 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-53704ba8-11fa-4a70-9734-d5d2a180689c tempest-TestMinimumBasicScenario-510804398 tempest-TestMinimumBasicScenario-510804398-project] 10.222.0.11 "GET /compute/v2.1/servers/a2378ac5-4b2c-4512-a437-b7737fba0204" status: 200 len: 1755 microversion: 2.1 time: 0.180776 Nov 17 04:02:04.630315 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 1547/3205] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 04:02:04 2021] GET /compute/v2.1/servers/a2378ac5-4b2c-4512-a437-b7737fba0204 => generated 1755 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 04:02:05.655131 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-24e312ef-0c3b-4c79-a0be-5a28f5e9b986 tempest-TestMinimumBasicScenario-510804398 tempest-TestMinimumBasicScenario-510804398-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 04:02:05.656093 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-24e312ef-0c3b-4c79-a0be-5a28f5e9b986 tempest-TestMinimumBasicScenario-510804398 tempest-TestMinimumBasicScenario-510804398-project] [instance: a2378ac5-4b2c-4512-a437-b7737fba0204] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 04:02:05.663455 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-24e312ef-0c3b-4c79-a0be-5a28f5e9b986 tempest-TestMinimumBasicScenario-510804398 tempest-TestMinimumBasicScenario-510804398-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 04:02:05.663904 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-24e312ef-0c3b-4c79-a0be-5a28f5e9b986 tempest-TestMinimumBasicScenario-510804398 tempest-TestMinimumBasicScenario-510804398-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 04:02:05.664672 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-24e312ef-0c3b-4c79-a0be-5a28f5e9b986 tempest-TestMinimumBasicScenario-510804398 tempest-TestMinimumBasicScenario-510804398-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 04:02:05.665130 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-24e312ef-0c3b-4c79-a0be-5a28f5e9b986 tempest-TestMinimumBasicScenario-510804398 tempest-TestMinimumBasicScenario-510804398-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 04:02:05.823310 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-24e312ef-0c3b-4c79-a0be-5a28f5e9b986 tempest-TestMinimumBasicScenario-510804398 tempest-TestMinimumBasicScenario-510804398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '220aa0d3d6494952b53d8d44265c4895', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4f4f943c957446b9fc9792385c53394', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 04:02:05.833430 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-24e312ef-0c3b-4c79-a0be-5a28f5e9b986 tempest-TestMinimumBasicScenario-510804398 tempest-TestMinimumBasicScenario-510804398-project] 10.222.0.11 "GET /compute/v2.1/servers/a2378ac5-4b2c-4512-a437-b7737fba0204" status: 200 len: 1755 microversion: 2.1 time: 0.184417 Nov 17 04:02:05.834007 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 1659/3206] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 04:02:05 2021] GET /compute/v2.1/servers/a2378ac5-4b2c-4512-a437-b7737fba0204 => generated 1755 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 04:02:06.854767 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-7ece0294-9021-4566-aecc-32a3800a6955 tempest-TestMinimumBasicScenario-510804398 tempest-TestMinimumBasicScenario-510804398-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 04:02:06.855746 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-7ece0294-9021-4566-aecc-32a3800a6955 tempest-TestMinimumBasicScenario-510804398 tempest-TestMinimumBasicScenario-510804398-project] [instance: a2378ac5-4b2c-4512-a437-b7737fba0204] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 04:02:06.865252 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-7ece0294-9021-4566-aecc-32a3800a6955 tempest-TestMinimumBasicScenario-510804398 tempest-TestMinimumBasicScenario-510804398-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 04:02:06.865707 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-7ece0294-9021-4566-aecc-32a3800a6955 tempest-TestMinimumBasicScenario-510804398 tempest-TestMinimumBasicScenario-510804398-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 04:02:06.866483 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-7ece0294-9021-4566-aecc-32a3800a6955 tempest-TestMinimumBasicScenario-510804398 tempest-TestMinimumBasicScenario-510804398-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 04:02:06.866919 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-7ece0294-9021-4566-aecc-32a3800a6955 tempest-TestMinimumBasicScenario-510804398 tempest-TestMinimumBasicScenario-510804398-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 04:02:07.026827 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-7ece0294-9021-4566-aecc-32a3800a6955 tempest-TestMinimumBasicScenario-510804398 tempest-TestMinimumBasicScenario-510804398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '220aa0d3d6494952b53d8d44265c4895', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4f4f943c957446b9fc9792385c53394', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 04:02:07.035141 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-7ece0294-9021-4566-aecc-32a3800a6955 tempest-TestMinimumBasicScenario-510804398 tempest-TestMinimumBasicScenario-510804398-project] 10.222.0.11 "GET /compute/v2.1/servers/a2378ac5-4b2c-4512-a437-b7737fba0204" status: 200 len: 1755 microversion: 2.1 time: 0.186933 Nov 17 04:02:07.035720 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 1548/3207] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 04:02:06 2021] GET /compute/v2.1/servers/a2378ac5-4b2c-4512-a437-b7737fba0204 => generated 1755 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 04:02:08.054245 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-ebfb3055-edc6-45d9-b749-08274978aca1 tempest-TestMinimumBasicScenario-510804398 tempest-TestMinimumBasicScenario-510804398-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 04:02:08.054982 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-ebfb3055-edc6-45d9-b749-08274978aca1 tempest-TestMinimumBasicScenario-510804398 tempest-TestMinimumBasicScenario-510804398-project] [instance: a2378ac5-4b2c-4512-a437-b7737fba0204] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 04:02:08.062530 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-ebfb3055-edc6-45d9-b749-08274978aca1 tempest-TestMinimumBasicScenario-510804398 tempest-TestMinimumBasicScenario-510804398-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 04:02:08.063077 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-ebfb3055-edc6-45d9-b749-08274978aca1 tempest-TestMinimumBasicScenario-510804398 tempest-TestMinimumBasicScenario-510804398-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 04:02:08.063965 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-ebfb3055-edc6-45d9-b749-08274978aca1 tempest-TestMinimumBasicScenario-510804398 tempest-TestMinimumBasicScenario-510804398-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 04:02:08.064474 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-ebfb3055-edc6-45d9-b749-08274978aca1 tempest-TestMinimumBasicScenario-510804398 tempest-TestMinimumBasicScenario-510804398-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 04:02:08.212381 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-ebfb3055-edc6-45d9-b749-08274978aca1 tempest-TestMinimumBasicScenario-510804398 tempest-TestMinimumBasicScenario-510804398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '220aa0d3d6494952b53d8d44265c4895', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4f4f943c957446b9fc9792385c53394', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 04:02:08.220218 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-ebfb3055-edc6-45d9-b749-08274978aca1 tempest-TestMinimumBasicScenario-510804398 tempest-TestMinimumBasicScenario-510804398-project] 10.222.0.11 "GET /compute/v2.1/servers/a2378ac5-4b2c-4512-a437-b7737fba0204" status: 200 len: 1758 microversion: 2.1 time: 0.171239 Nov 17 04:02:08.220805 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 1660/3208] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 04:02:08 2021] GET /compute/v2.1/servers/a2378ac5-4b2c-4512-a437-b7737fba0204 => generated 1758 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 04:02:34.609606 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 17 04:02:34.610304 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: Wed Nov 17 04:02:34 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Nov 17 04:02:40.574692 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-876e67d9-a349-4060-9184-871e44609fe2 tempest-TestMinimumBasicScenario-510804398 tempest-TestMinimumBasicScenario-510804398-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-216664721"}} {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 17 04:02:40.575365 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-876e67d9-a349-4060-9184-871e44609fe2 tempest-TestMinimumBasicScenario-510804398 tempest-TestMinimumBasicScenario-510804398-project] [instance: a2378ac5-4b2c-4512-a437-b7737fba0204] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 04:02:40.582617 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-876e67d9-a349-4060-9184-871e44609fe2 tempest-TestMinimumBasicScenario-510804398 tempest-TestMinimumBasicScenario-510804398-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 04:02:40.583369 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-876e67d9-a349-4060-9184-871e44609fe2 tempest-TestMinimumBasicScenario-510804398 tempest-TestMinimumBasicScenario-510804398-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 04:02:40.584637 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-876e67d9-a349-4060-9184-871e44609fe2 tempest-TestMinimumBasicScenario-510804398 tempest-TestMinimumBasicScenario-510804398-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 04:02:40.585376 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-876e67d9-a349-4060-9184-871e44609fe2 tempest-TestMinimumBasicScenario-510804398 tempest-TestMinimumBasicScenario-510804398-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 04:02:40.864272 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.network.security_group_api [None req-876e67d9-a349-4060-9184-871e44609fe2 tempest-TestMinimumBasicScenario-510804398 tempest-TestMinimumBasicScenario-510804398-project] Removing security group 0bb97cb1-e2ba-4104-9f2b-ffb5aa520938 from port 76b2a23a-990f-47e8-b961-ce6daae261f1 Nov 17 04:02:41.214377 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-876e67d9-a349-4060-9184-871e44609fe2 tempest-TestMinimumBasicScenario-510804398 tempest-TestMinimumBasicScenario-510804398-project] 10.222.0.11 "POST /compute/v2.1/servers/a2378ac5-4b2c-4512-a437-b7737fba0204/action" status: 202 len: 0 microversion: 2.1 time: 0.645021 Nov 17 04:02:41.219392 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 1549/3209] 10.222.0.11 () {60 vars in 1277 bytes} [Wed Nov 17 04:02:40 2021] POST /compute/v2.1/servers/a2378ac5-4b2c-4512-a437-b7737fba0204/action => generated 0 bytes in 650 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 17 04:02:41.330609 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [req-75856af7-a2e9-487e-a986-cc88c625662d req-52c3e599-b366-4771-94a2-f3815fb451bf service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a2378ac5-4b2c-4512-a437-b7737fba0204", "tag": "76b2a23a-990f-47e8-b961-ce6daae261f1"}]} {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 17 04:02:41.333397 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 17 04:02:41.333397 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: warnings.warn(msg) Nov 17 04:02:41.342002 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [req-75856af7-a2e9-487e-a986-cc88c625662d req-52c3e599-b366-4771-94a2-f3815fb451bf service nova] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 04:02:41.342839 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [req-75856af7-a2e9-487e-a986-cc88c625662d req-52c3e599-b366-4771-94a2-f3815fb451bf service nova] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 04:02:41.361712 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.compute.server_external_events [req-75856af7-a2e9-487e-a986-cc88c625662d req-52c3e599-b366-4771-94a2-f3815fb451bf service nova] Creating event network-changed:76b2a23a-990f-47e8-b961-ce6daae261f1 for instance a2378ac5-4b2c-4512-a437-b7737fba0204 on hv-cinder-81803 Nov 17 04:02:41.370340 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [req-75856af7-a2e9-487e-a986-cc88c625662d req-52c3e599-b366-4771-94a2-f3815fb451bf service nova] 10.222.0.11 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.136925 Nov 17 04:02:41.371355 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 1661/3210] 10.222.0.11 () {64 vars in 1317 bytes} [Wed Nov 17 04:02:41 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 17 04:02:43.080591 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-fc6e0113-8f2c-449f-bfe5-e500e24671d9 tempest-TestMinimumBasicScenario-510804398 tempest-TestMinimumBasicScenario-510804398-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 04:02:43.081163 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-fc6e0113-8f2c-449f-bfe5-e500e24671d9 tempest-TestMinimumBasicScenario-510804398 tempest-TestMinimumBasicScenario-510804398-project] [instance: a2378ac5-4b2c-4512-a437-b7737fba0204] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 04:02:43.086968 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-fc6e0113-8f2c-449f-bfe5-e500e24671d9 tempest-TestMinimumBasicScenario-510804398 tempest-TestMinimumBasicScenario-510804398-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 04:02:43.087409 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-fc6e0113-8f2c-449f-bfe5-e500e24671d9 tempest-TestMinimumBasicScenario-510804398 tempest-TestMinimumBasicScenario-510804398-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 04:02:43.088388 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-fc6e0113-8f2c-449f-bfe5-e500e24671d9 tempest-TestMinimumBasicScenario-510804398 tempest-TestMinimumBasicScenario-510804398-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 04:02:43.088845 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-fc6e0113-8f2c-449f-bfe5-e500e24671d9 tempest-TestMinimumBasicScenario-510804398 tempest-TestMinimumBasicScenario-510804398-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 04:02:43.171359 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.objects.instance [None req-fc6e0113-8f2c-449f-bfe5-e500e24671d9 tempest-TestMinimumBasicScenario-510804398 tempest-TestMinimumBasicScenario-510804398-project] Lazy-loading 'services' on Instance uuid a2378ac5-4b2c-4512-a437-b7737fba0204 {{(pid=115916) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Nov 17 04:02:43.256694 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-fc6e0113-8f2c-449f-bfe5-e500e24671d9 tempest-TestMinimumBasicScenario-510804398 tempest-TestMinimumBasicScenario-510804398-project] 10.222.0.11 "DELETE /compute/v2.1/servers/a2378ac5-4b2c-4512-a437-b7737fba0204/os-volume_attachments/e0b9ff5c-3695-41f4-9063-2c4b0fa0ebbe" status: 202 len: 0 microversion: 2.1 time: 0.180144 Nov 17 04:02:43.261167 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 1550/3211] 10.222.0.11 () {58 vars in 1415 bytes} [Wed Nov 17 04:02:43 2021] DELETE /compute/v2.1/servers/a2378ac5-4b2c-4512-a437-b7737fba0204/os-volume_attachments/e0b9ff5c-3695-41f4-9063-2c4b0fa0ebbe => generated 0 bytes in 185 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 17 04:02:43.268483 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-6af9e0d1-999d-4c9c-9cf3-bfe72f0473e4 tempest-TestMinimumBasicScenario-510804398 tempest-TestMinimumBasicScenario-510804398-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 04:02:43.270013 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-6af9e0d1-999d-4c9c-9cf3-bfe72f0473e4 tempest-TestMinimumBasicScenario-510804398 tempest-TestMinimumBasicScenario-510804398-project] [instance: a2378ac5-4b2c-4512-a437-b7737fba0204] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 04:02:43.279210 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-6af9e0d1-999d-4c9c-9cf3-bfe72f0473e4 tempest-TestMinimumBasicScenario-510804398 tempest-TestMinimumBasicScenario-510804398-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 04:02:43.280673 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-6af9e0d1-999d-4c9c-9cf3-bfe72f0473e4 tempest-TestMinimumBasicScenario-510804398 tempest-TestMinimumBasicScenario-510804398-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 04:02:43.282022 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-6af9e0d1-999d-4c9c-9cf3-bfe72f0473e4 tempest-TestMinimumBasicScenario-510804398 tempest-TestMinimumBasicScenario-510804398-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 04:02:43.282808 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-6af9e0d1-999d-4c9c-9cf3-bfe72f0473e4 tempest-TestMinimumBasicScenario-510804398 tempest-TestMinimumBasicScenario-510804398-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 04:02:43.316767 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-6af9e0d1-999d-4c9c-9cf3-bfe72f0473e4 tempest-TestMinimumBasicScenario-510804398 tempest-TestMinimumBasicScenario-510804398-project] 10.222.0.11 "GET /compute/v2.1/servers/a2378ac5-4b2c-4512-a437-b7737fba0204/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053059 Nov 17 04:02:43.317543 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 1662/3212] 10.222.0.11 () {58 vars in 1301 bytes} [Wed Nov 17 04:02:43 2021] GET /compute/v2.1/servers/a2378ac5-4b2c-4512-a437-b7737fba0204/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 17 04:02:43.389067 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [req-38748e28-98ac-44d6-a44f-a92cb19544c2 req-c41d5d2a-23d4-494d-8560-4bc50c914d85 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a2378ac5-4b2c-4512-a437-b7737fba0204", "tag": "76b2a23a-990f-47e8-b961-ce6daae261f1"}]} {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 17 04:02:43.390571 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 17 04:02:43.390571 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: warnings.warn(msg) Nov 17 04:02:43.397640 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [req-38748e28-98ac-44d6-a44f-a92cb19544c2 req-c41d5d2a-23d4-494d-8560-4bc50c914d85 service nova] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 04:02:43.398068 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [req-38748e28-98ac-44d6-a44f-a92cb19544c2 req-c41d5d2a-23d4-494d-8560-4bc50c914d85 service nova] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 04:02:43.408986 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.compute.server_external_events [req-38748e28-98ac-44d6-a44f-a92cb19544c2 req-c41d5d2a-23d4-494d-8560-4bc50c914d85 service nova] Creating event network-changed:76b2a23a-990f-47e8-b961-ce6daae261f1 for instance a2378ac5-4b2c-4512-a437-b7737fba0204 on hv-cinder-81803 Nov 17 04:02:43.413908 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [req-38748e28-98ac-44d6-a44f-a92cb19544c2 req-c41d5d2a-23d4-494d-8560-4bc50c914d85 service nova] 10.222.0.11 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.028866 Nov 17 04:02:43.414461 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 1551/3213] 10.222.0.11 () {64 vars in 1317 bytes} [Wed Nov 17 04:02:43 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 17 04:02:44.333155 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-bb31a9e6-80ad-4f1f-b9a6-b891c42d36ee tempest-TestMinimumBasicScenario-510804398 tempest-TestMinimumBasicScenario-510804398-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 04:02:44.334606 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-bb31a9e6-80ad-4f1f-b9a6-b891c42d36ee tempest-TestMinimumBasicScenario-510804398 tempest-TestMinimumBasicScenario-510804398-project] [instance: a2378ac5-4b2c-4512-a437-b7737fba0204] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 04:02:44.345226 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-bb31a9e6-80ad-4f1f-b9a6-b891c42d36ee tempest-TestMinimumBasicScenario-510804398 tempest-TestMinimumBasicScenario-510804398-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 04:02:44.345973 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-bb31a9e6-80ad-4f1f-b9a6-b891c42d36ee tempest-TestMinimumBasicScenario-510804398 tempest-TestMinimumBasicScenario-510804398-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 04:02:44.347329 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-bb31a9e6-80ad-4f1f-b9a6-b891c42d36ee tempest-TestMinimumBasicScenario-510804398 tempest-TestMinimumBasicScenario-510804398-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 04:02:44.348032 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-bb31a9e6-80ad-4f1f-b9a6-b891c42d36ee tempest-TestMinimumBasicScenario-510804398 tempest-TestMinimumBasicScenario-510804398-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 04:02:44.379776 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-bb31a9e6-80ad-4f1f-b9a6-b891c42d36ee tempest-TestMinimumBasicScenario-510804398 tempest-TestMinimumBasicScenario-510804398-project] 10.222.0.11 "GET /compute/v2.1/servers/a2378ac5-4b2c-4512-a437-b7737fba0204/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.053264 Nov 17 04:02:44.381629 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 1663/3214] 10.222.0.11 () {58 vars in 1301 bytes} [Wed Nov 17 04:02:44 2021] GET /compute/v2.1/servers/a2378ac5-4b2c-4512-a437-b7737fba0204/os-volume_attachments => generated 25 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 17 04:02:44.394527 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-2c214340-463f-4532-9801-7dd9070779f2 tempest-TestMinimumBasicScenario-510804398 tempest-TestMinimumBasicScenario-510804398-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 04:02:44.395078 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-2c214340-463f-4532-9801-7dd9070779f2 tempest-TestMinimumBasicScenario-510804398 tempest-TestMinimumBasicScenario-510804398-project] [instance: a2378ac5-4b2c-4512-a437-b7737fba0204] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 04:02:44.403958 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-2c214340-463f-4532-9801-7dd9070779f2 tempest-TestMinimumBasicScenario-510804398 tempest-TestMinimumBasicScenario-510804398-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 04:02:44.404505 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-2c214340-463f-4532-9801-7dd9070779f2 tempest-TestMinimumBasicScenario-510804398 tempest-TestMinimumBasicScenario-510804398-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 04:02:44.405667 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-2c214340-463f-4532-9801-7dd9070779f2 tempest-TestMinimumBasicScenario-510804398 tempest-TestMinimumBasicScenario-510804398-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 04:02:44.406236 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-2c214340-463f-4532-9801-7dd9070779f2 tempest-TestMinimumBasicScenario-510804398 tempest-TestMinimumBasicScenario-510804398-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 04:02:44.482690 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.wsgi [None req-2c214340-463f-4532-9801-7dd9070779f2 tempest-TestMinimumBasicScenario-510804398 tempest-TestMinimumBasicScenario-510804398-project] HTTP exception thrown: Instance a2378ac5-4b2c-4512-a437-b7737fba0204 is not attached to volume e0b9ff5c-3695-41f4-9063-2c4b0fa0ebbe Nov 17 04:02:44.483299 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-2c214340-463f-4532-9801-7dd9070779f2 tempest-TestMinimumBasicScenario-510804398 tempest-TestMinimumBasicScenario-510804398-project] Returning 404 to user: Instance a2378ac5-4b2c-4512-a437-b7737fba0204 is not attached to volume e0b9ff5c-3695-41f4-9063-2c4b0fa0ebbe {{(pid=115916) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 17 04:02:44.484149 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-2c214340-463f-4532-9801-7dd9070779f2 tempest-TestMinimumBasicScenario-510804398 tempest-TestMinimumBasicScenario-510804398-project] 10.222.0.11 "DELETE /compute/v2.1/servers/a2378ac5-4b2c-4512-a437-b7737fba0204/os-volume_attachments/e0b9ff5c-3695-41f4-9063-2c4b0fa0ebbe" status: 404 len: 154 microversion: 2.1 time: 0.096889 Nov 17 04:02:44.484702 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 1552/3215] 10.222.0.11 () {58 vars in 1415 bytes} [Wed Nov 17 04:02:44 2021] DELETE /compute/v2.1/servers/a2378ac5-4b2c-4512-a437-b7737fba0204/os-volume_attachments/e0b9ff5c-3695-41f4-9063-2c4b0fa0ebbe => generated 154 bytes in 98 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 17 04:02:45.627296 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-f0f059d6-e920-47d7-ae0c-91c7438f1719 tempest-TestMinimumBasicScenario-510804398 tempest-TestMinimumBasicScenario-510804398-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 04:02:45.627859 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-f0f059d6-e920-47d7-ae0c-91c7438f1719 tempest-TestMinimumBasicScenario-510804398 tempest-TestMinimumBasicScenario-510804398-project] [instance: a2378ac5-4b2c-4512-a437-b7737fba0204] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 04:02:45.634386 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-f0f059d6-e920-47d7-ae0c-91c7438f1719 tempest-TestMinimumBasicScenario-510804398 tempest-TestMinimumBasicScenario-510804398-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 04:02:45.634832 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-f0f059d6-e920-47d7-ae0c-91c7438f1719 tempest-TestMinimumBasicScenario-510804398 tempest-TestMinimumBasicScenario-510804398-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 04:02:45.635592 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-f0f059d6-e920-47d7-ae0c-91c7438f1719 tempest-TestMinimumBasicScenario-510804398 tempest-TestMinimumBasicScenario-510804398-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 04:02:45.636016 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-f0f059d6-e920-47d7-ae0c-91c7438f1719 tempest-TestMinimumBasicScenario-510804398 tempest-TestMinimumBasicScenario-510804398-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 04:02:45.661598 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-f0f059d6-e920-47d7-ae0c-91c7438f1719 tempest-TestMinimumBasicScenario-510804398 tempest-TestMinimumBasicScenario-510804398-project] [instance: a2378ac5-4b2c-4512-a437-b7737fba0204] Going to try to terminate instance {{(pid=115917) delete /opt/stack/nova/nova/compute/api.py:2614}} Nov 17 04:02:45.752732 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-f0f059d6-e920-47d7-ae0c-91c7438f1719 tempest-TestMinimumBasicScenario-510804398 tempest-TestMinimumBasicScenario-510804398-project] 10.222.0.11 "DELETE /compute/v2.1/servers/a2378ac5-4b2c-4512-a437-b7737fba0204" status: 204 len: 0 microversion: 2.1 time: 0.128495 Nov 17 04:02:45.753545 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 1664/3216] 10.222.0.11 () {58 vars in 1238 bytes} [Wed Nov 17 04:02:45 2021] DELETE /compute/v2.1/servers/a2378ac5-4b2c-4512-a437-b7737fba0204 => generated 0 bytes in 130 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 17 04:02:45.764210 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-1aaa0313-41fb-4eea-bf73-0d1011ef79f7 tempest-TestMinimumBasicScenario-510804398 tempest-TestMinimumBasicScenario-510804398-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 04:02:45.764855 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-1aaa0313-41fb-4eea-bf73-0d1011ef79f7 tempest-TestMinimumBasicScenario-510804398 tempest-TestMinimumBasicScenario-510804398-project] [instance: a2378ac5-4b2c-4512-a437-b7737fba0204] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 04:02:45.771139 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-1aaa0313-41fb-4eea-bf73-0d1011ef79f7 tempest-TestMinimumBasicScenario-510804398 tempest-TestMinimumBasicScenario-510804398-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 04:02:45.771584 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-1aaa0313-41fb-4eea-bf73-0d1011ef79f7 tempest-TestMinimumBasicScenario-510804398 tempest-TestMinimumBasicScenario-510804398-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 04:02:45.772351 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-1aaa0313-41fb-4eea-bf73-0d1011ef79f7 tempest-TestMinimumBasicScenario-510804398 tempest-TestMinimumBasicScenario-510804398-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 04:02:45.772805 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-1aaa0313-41fb-4eea-bf73-0d1011ef79f7 tempest-TestMinimumBasicScenario-510804398 tempest-TestMinimumBasicScenario-510804398-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 04:02:45.910890 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-1aaa0313-41fb-4eea-bf73-0d1011ef79f7 tempest-TestMinimumBasicScenario-510804398 tempest-TestMinimumBasicScenario-510804398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '220aa0d3d6494952b53d8d44265c4895', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4f4f943c957446b9fc9792385c53394', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 04:02:45.919126 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-1aaa0313-41fb-4eea-bf73-0d1011ef79f7 tempest-TestMinimumBasicScenario-510804398 tempest-TestMinimumBasicScenario-510804398-project] 10.222.0.11 "GET /compute/v2.1/servers/a2378ac5-4b2c-4512-a437-b7737fba0204" status: 200 len: 1553 microversion: 2.1 time: 0.159534 Nov 17 04:02:45.919770 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 1553/3217] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 04:02:45 2021] GET /compute/v2.1/servers/a2378ac5-4b2c-4512-a437-b7737fba0204 => generated 1553 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 04:02:46.942945 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-424ecba4-8073-4bf7-aa80-fcb87cd23e37 tempest-TestMinimumBasicScenario-510804398 tempest-TestMinimumBasicScenario-510804398-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 04:02:46.944093 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-424ecba4-8073-4bf7-aa80-fcb87cd23e37 tempest-TestMinimumBasicScenario-510804398 tempest-TestMinimumBasicScenario-510804398-project] [instance: a2378ac5-4b2c-4512-a437-b7737fba0204] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 04:02:46.954938 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-424ecba4-8073-4bf7-aa80-fcb87cd23e37 tempest-TestMinimumBasicScenario-510804398 tempest-TestMinimumBasicScenario-510804398-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 04:02:46.955625 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-424ecba4-8073-4bf7-aa80-fcb87cd23e37 tempest-TestMinimumBasicScenario-510804398 tempest-TestMinimumBasicScenario-510804398-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 04:02:46.956989 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-424ecba4-8073-4bf7-aa80-fcb87cd23e37 tempest-TestMinimumBasicScenario-510804398 tempest-TestMinimumBasicScenario-510804398-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 04:02:46.957678 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-424ecba4-8073-4bf7-aa80-fcb87cd23e37 tempest-TestMinimumBasicScenario-510804398 tempest-TestMinimumBasicScenario-510804398-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 04:02:47.095403 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-424ecba4-8073-4bf7-aa80-fcb87cd23e37 tempest-TestMinimumBasicScenario-510804398 tempest-TestMinimumBasicScenario-510804398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '220aa0d3d6494952b53d8d44265c4895', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4f4f943c957446b9fc9792385c53394', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 04:02:47.103135 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-424ecba4-8073-4bf7-aa80-fcb87cd23e37 tempest-TestMinimumBasicScenario-510804398 tempest-TestMinimumBasicScenario-510804398-project] 10.222.0.11 "GET /compute/v2.1/servers/a2378ac5-4b2c-4512-a437-b7737fba0204" status: 200 len: 1553 microversion: 2.1 time: 0.166948 Nov 17 04:02:47.103699 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 1665/3218] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 04:02:46 2021] GET /compute/v2.1/servers/a2378ac5-4b2c-4512-a437-b7737fba0204 => generated 1553 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 04:02:48.119033 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [req-9c80aae5-774d-498a-8c84-da28b0cfdad1 req-25cd3647-b443-4e13-83b9-5f17efa8e7a7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a2378ac5-4b2c-4512-a437-b7737fba0204", "name": "network-vif-deleted", "tag": "76b2a23a-990f-47e8-b961-ce6daae261f1"}]} {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 17 04:02:48.119647 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-d1088446-c98e-493f-b191-3b7ce88dae78 tempest-TestMinimumBasicScenario-510804398 tempest-TestMinimumBasicScenario-510804398-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 04:02:48.119647 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-d1088446-c98e-493f-b191-3b7ce88dae78 tempest-TestMinimumBasicScenario-510804398 tempest-TestMinimumBasicScenario-510804398-project] [instance: a2378ac5-4b2c-4512-a437-b7737fba0204] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 04:02:48.120677 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 17 04:02:48.120677 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: warnings.warn(msg) Nov 17 04:02:48.126630 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-d1088446-c98e-493f-b191-3b7ce88dae78 tempest-TestMinimumBasicScenario-510804398 tempest-TestMinimumBasicScenario-510804398-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 04:02:48.127075 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-d1088446-c98e-493f-b191-3b7ce88dae78 tempest-TestMinimumBasicScenario-510804398 tempest-TestMinimumBasicScenario-510804398-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 04:02:48.127840 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-d1088446-c98e-493f-b191-3b7ce88dae78 tempest-TestMinimumBasicScenario-510804398 tempest-TestMinimumBasicScenario-510804398-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 04:02:48.128320 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-d1088446-c98e-493f-b191-3b7ce88dae78 tempest-TestMinimumBasicScenario-510804398 tempest-TestMinimumBasicScenario-510804398-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 04:02:48.129597 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [req-9c80aae5-774d-498a-8c84-da28b0cfdad1 req-25cd3647-b443-4e13-83b9-5f17efa8e7a7 service nova] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 04:02:48.130042 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [req-9c80aae5-774d-498a-8c84-da28b0cfdad1 req-25cd3647-b443-4e13-83b9-5f17efa8e7a7 service nova] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 04:02:48.142144 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.compute.server_external_events [req-9c80aae5-774d-498a-8c84-da28b0cfdad1 req-25cd3647-b443-4e13-83b9-5f17efa8e7a7 service nova] Creating event network-vif-deleted:76b2a23a-990f-47e8-b961-ce6daae261f1 for instance a2378ac5-4b2c-4512-a437-b7737fba0204 on hv-cinder-81803 Nov 17 04:02:48.148467 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [req-9c80aae5-774d-498a-8c84-da28b0cfdad1 req-25cd3647-b443-4e13-83b9-5f17efa8e7a7 service nova] 10.222.0.11 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033001 Nov 17 04:02:48.149389 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 1554/3219] 10.222.0.11 () {64 vars in 1317 bytes} [Wed Nov 17 04:02:48 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 17 04:02:48.191724 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-d1088446-c98e-493f-b191-3b7ce88dae78 tempest-TestMinimumBasicScenario-510804398 tempest-TestMinimumBasicScenario-510804398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '220aa0d3d6494952b53d8d44265c4895', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4f4f943c957446b9fc9792385c53394', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 04:02:48.200163 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-d1088446-c98e-493f-b191-3b7ce88dae78 tempest-TestMinimumBasicScenario-510804398 tempest-TestMinimumBasicScenario-510804398-project] 10.222.0.11 "GET /compute/v2.1/servers/a2378ac5-4b2c-4512-a437-b7737fba0204" status: 200 len: 1511 microversion: 2.1 time: 0.084628 Nov 17 04:02:48.200750 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 1666/3220] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 04:02:48 2021] GET /compute/v2.1/servers/a2378ac5-4b2c-4512-a437-b7737fba0204 => generated 1511 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 17 04:02:49.222785 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-6924d587-f640-4936-ae38-f17107739cc6 tempest-TestMinimumBasicScenario-510804398 tempest-TestMinimumBasicScenario-510804398-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 04:02:49.224074 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-6924d587-f640-4936-ae38-f17107739cc6 tempest-TestMinimumBasicScenario-510804398 tempest-TestMinimumBasicScenario-510804398-project] [instance: a2378ac5-4b2c-4512-a437-b7737fba0204] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 04:02:49.235420 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-6924d587-f640-4936-ae38-f17107739cc6 tempest-TestMinimumBasicScenario-510804398 tempest-TestMinimumBasicScenario-510804398-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 04:02:49.235977 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-6924d587-f640-4936-ae38-f17107739cc6 tempest-TestMinimumBasicScenario-510804398 tempest-TestMinimumBasicScenario-510804398-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 04:02:49.237123 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-6924d587-f640-4936-ae38-f17107739cc6 tempest-TestMinimumBasicScenario-510804398 tempest-TestMinimumBasicScenario-510804398-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 04:02:49.237836 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-6924d587-f640-4936-ae38-f17107739cc6 tempest-TestMinimumBasicScenario-510804398 tempest-TestMinimumBasicScenario-510804398-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 04:02:49.255124 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.wsgi [None req-6924d587-f640-4936-ae38-f17107739cc6 tempest-TestMinimumBasicScenario-510804398 tempest-TestMinimumBasicScenario-510804398-project] HTTP exception thrown: Instance a2378ac5-4b2c-4512-a437-b7737fba0204 could not be found. Nov 17 04:02:49.255755 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-6924d587-f640-4936-ae38-f17107739cc6 tempest-TestMinimumBasicScenario-510804398 tempest-TestMinimumBasicScenario-510804398-project] Returning 404 to user: Instance a2378ac5-4b2c-4512-a437-b7737fba0204 could not be found. {{(pid=115916) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 17 04:02:49.256593 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-6924d587-f640-4936-ae38-f17107739cc6 tempest-TestMinimumBasicScenario-510804398 tempest-TestMinimumBasicScenario-510804398-project] 10.222.0.11 "GET /compute/v2.1/servers/a2378ac5-4b2c-4512-a437-b7737fba0204" status: 404 len: 111 microversion: 2.1 time: 0.041571 Nov 17 04:02:49.260559 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 1555/3221] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 04:02:49 2021] GET /compute/v2.1/servers/a2378ac5-4b2c-4512-a437-b7737fba0204 => generated 111 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 17 04:02:49.265586 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-83fe3f5a-ff8b-4f82-952e-26374546c9be tempest-TestMinimumBasicScenario-510804398 tempest-TestMinimumBasicScenario-510804398-project] Calling method '.version_select at 0x7f9e1db52940>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 04:02:49.286354 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-83fe3f5a-ff8b-4f82-952e-26374546c9be tempest-TestMinimumBasicScenario-510804398 tempest-TestMinimumBasicScenario-510804398-project] 10.222.0.11 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1353225738" status: 202 len: 0 microversion: 2.1 time: 0.024499 Nov 17 04:02:49.286956 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 1667/3222] 10.222.0.11 () {58 vars in 1271 bytes} [Wed Nov 17 04:02:49 2021] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1353225738 => generated 0 bytes in 26 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 17 04:04:56.704864 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Nov 17 04:04:56.706171 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: Wed Nov 17 04:04:56 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Nov 17 04:05:04.789504 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 17 04:05:04.790500 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: Wed Nov 17 04:05:04 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Nov 17 04:05:10.044350 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 17 04:05:10.045416 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: Wed Nov 17 04:05:10 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Nov 17 04:05:25.420129 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: ERROR oslo.messaging._drivers.impl_rabbit [-] [c58524cf-077e-4019-a8a0-9f14dc18e2b3] AMQP server on 10.222.0.11:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Nov 17 04:05:25.423814 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-196c2c5e-f3ed-4211-909b-6c8cd8c0adb4 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 04:05:25.424302 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-196c2c5e-f3ed-4211-909b-6c8cd8c0adb4 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] [instance: 5d54db85-b991-4890-abaa-952413baa2e7] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 04:05:25.430763 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-196c2c5e-f3ed-4211-909b-6c8cd8c0adb4 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 04:05:25.431205 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-196c2c5e-f3ed-4211-909b-6c8cd8c0adb4 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 04:05:25.431960 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-196c2c5e-f3ed-4211-909b-6c8cd8c0adb4 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 04:05:25.432418 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-196c2c5e-f3ed-4211-909b-6c8cd8c0adb4 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 04:05:25.446323 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.wsgi [None req-196c2c5e-f3ed-4211-909b-6c8cd8c0adb4 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] HTTP exception thrown: Instance 5d54db85-b991-4890-abaa-952413baa2e7 could not be found. Nov 17 04:05:25.446894 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-196c2c5e-f3ed-4211-909b-6c8cd8c0adb4 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Returning 404 to user: Instance 5d54db85-b991-4890-abaa-952413baa2e7 could not be found. {{(pid=115916) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 17 04:05:25.447744 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-196c2c5e-f3ed-4211-909b-6c8cd8c0adb4 tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] 10.222.0.11 "DELETE /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7" status: 404 len: 111 microversion: 2.1 time: 0.029603 Nov 17 04:05:25.448388 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 1556/3223] 10.222.0.11 () {58 vars in 1238 bytes} [Wed Nov 17 04:05:25 2021] DELETE /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 17 04:05:25.456189 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: ERROR oslo.messaging._drivers.impl_rabbit [-] [083e547a-b3a0-4398-8f13-ed2961e3fec4] AMQP server on 10.222.0.11:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Nov 17 04:05:25.461384 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-989f852a-1bb2-463c-88e7-77224d3ef2eb tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 04:05:25.462017 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-989f852a-1bb2-463c-88e7-77224d3ef2eb tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] [instance: 5d54db85-b991-4890-abaa-952413baa2e7] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 04:05:25.468935 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-989f852a-1bb2-463c-88e7-77224d3ef2eb tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 04:05:25.469382 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-989f852a-1bb2-463c-88e7-77224d3ef2eb tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 04:05:25.470158 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-989f852a-1bb2-463c-88e7-77224d3ef2eb tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 04:05:25.470580 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-989f852a-1bb2-463c-88e7-77224d3ef2eb tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 04:05:25.483493 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.wsgi [None req-989f852a-1bb2-463c-88e7-77224d3ef2eb tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] HTTP exception thrown: Instance 5d54db85-b991-4890-abaa-952413baa2e7 could not be found. Nov 17 04:05:25.484073 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-989f852a-1bb2-463c-88e7-77224d3ef2eb tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] Returning 404 to user: Instance 5d54db85-b991-4890-abaa-952413baa2e7 could not be found. {{(pid=115917) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 17 04:05:25.484927 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-989f852a-1bb2-463c-88e7-77224d3ef2eb tempest-AttachVolumeShelveTestJSON-1612074522 tempest-AttachVolumeShelveTestJSON-1612074522-project] 10.222.0.11 "GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7" status: 404 len: 111 microversion: 2.1 time: 0.031560 Nov 17 04:05:25.485417 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 1668/3224] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 04:05:25 2021] GET /compute/v2.1/servers/5d54db85-b991-4890-abaa-952413baa2e7 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 17 04:05:30.724661 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Too many heartbeats missed Nov 17 04:05:32.883961 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 17 04:05:32.884579 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: Wed Nov 17 04:05:32 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Nov 17 04:05:55.637782 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-d03775c9-8658-4f84-abad-323240c5818d tempest-VolumesActionsTest-532309110 tempest-VolumesActionsTest-532309110-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1324141096", "imageRef": "7281a37a-6b99-49c1-881a-41604d06bae1", "flavorRef": "452", "networks": [{"uuid": "eb0d9638-5cee-4b8d-97b7-e3908ead4285"}]}} {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 17 04:05:55.670804 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO oslo.messaging._drivers.impl_rabbit [-] [c58524cf-077e-4019-a8a0-9f14dc18e2b3] Reconnected to AMQP server on 10.222.0.11:5672 via [amqp] client with port 50846. Nov 17 04:05:55.706338 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.network.neutron [None req-d03775c9-8658-4f84-abad-323240c5818d tempest-VolumesActionsTest-532309110 tempest-VolumesActionsTest-532309110-project] validate_networks() for [('eb0d9638-5cee-4b8d-97b7-e3908ead4285', None, None, None, None, None)] {{(pid=115916) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Nov 17 04:05:56.180123 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.virt.hardware [None req-d03775c9-8658-4f84-abad-323240c5818d tempest-VolumesActionsTest-532309110 tempest-VolumesActionsTest-532309110-project] Flavor limits 0:0:0 {{(pid=115916) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 17 04:05:56.180928 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.virt.hardware [None req-d03775c9-8658-4f84-abad-323240c5818d tempest-VolumesActionsTest-532309110 tempest-VolumesActionsTest-532309110-project] Image limits 0:0:0 {{(pid=115916) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 17 04:05:56.181407 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.virt.hardware [None req-d03775c9-8658-4f84-abad-323240c5818d tempest-VolumesActionsTest-532309110 tempest-VolumesActionsTest-532309110-project] Flavor pref 0:0:0 {{(pid=115916) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 17 04:05:56.181810 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.virt.hardware [None req-d03775c9-8658-4f84-abad-323240c5818d tempest-VolumesActionsTest-532309110 tempest-VolumesActionsTest-532309110-project] Image pref 0:0:0 {{(pid=115916) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 17 04:05:56.182248 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.virt.hardware [None req-d03775c9-8658-4f84-abad-323240c5818d tempest-VolumesActionsTest-532309110 tempest-VolumesActionsTest-532309110-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=115916) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 17 04:05:56.193164 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-d03775c9-8658-4f84-abad-323240c5818d tempest-VolumesActionsTest-532309110 tempest-VolumesActionsTest-532309110-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 04:05:56.193602 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-d03775c9-8658-4f84-abad-323240c5818d tempest-VolumesActionsTest-532309110 tempest-VolumesActionsTest-532309110-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 04:05:56.194426 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-d03775c9-8658-4f84-abad-323240c5818d tempest-VolumesActionsTest-532309110 tempest-VolumesActionsTest-532309110-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 04:05:56.194855 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-d03775c9-8658-4f84-abad-323240c5818d tempest-VolumesActionsTest-532309110 tempest-VolumesActionsTest-532309110-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 04:05:56.211462 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.quota [None req-d03775c9-8658-4f84-abad-323240c5818d tempest-VolumesActionsTest-532309110 tempest-VolumesActionsTest-532309110-project] Getting quotas for project a1d5fd11a821458d866a1e9e61e10da4. Resources: {'instances', 'ram', 'cores'} {{(pid=115916) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 17 04:05:56.215408 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.quota [None req-d03775c9-8658-4f84-abad-323240c5818d tempest-VolumesActionsTest-532309110 tempest-VolumesActionsTest-532309110-project] Getting quotas for user 8422c9211af341ec805b9174c540708e and project a1d5fd11a821458d866a1e9e61e10da4. Resources: {'instances', 'ram', 'cores'} {{(pid=115916) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 17 04:05:56.226556 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-d03775c9-8658-4f84-abad-323240c5818d tempest-VolumesActionsTest-532309110 tempest-VolumesActionsTest-532309110-project] Going to run 1 instances... {{(pid=115916) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 17 04:05:56.228948 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-d03775c9-8658-4f84-abad-323240c5818d tempest-VolumesActionsTest-532309110 tempest-VolumesActionsTest-532309110-project] [instance: 7bf3be5f-7305-4b9e-8b8d-d586530cf08d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='7281a37a-6b99-49c1-881a-41604d06bae1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=115916) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 17 04:05:56.276525 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-d03775c9-8658-4f84-abad-323240c5818d tempest-VolumesActionsTest-532309110 tempest-VolumesActionsTest-532309110-project] 10.222.0.11 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.642501 Nov 17 04:05:56.277206 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 1557/3225] 10.222.0.11 () {60 vars in 1146 bytes} [Wed Nov 17 04:05:55 2021] POST /compute/v2.1/servers => generated 380 bytes in 644 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 17 04:05:56.287375 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-7d88c6cd-1e07-4bfa-a673-58f5acbcab11 tempest-VolumesActionsTest-532309110 tempest-VolumesActionsTest-532309110-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 04:05:56.288088 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-7d88c6cd-1e07-4bfa-a673-58f5acbcab11 tempest-VolumesActionsTest-532309110 tempest-VolumesActionsTest-532309110-project] [instance: 7bf3be5f-7305-4b9e-8b8d-d586530cf08d] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 04:05:56.309441 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO oslo.messaging._drivers.impl_rabbit [-] [083e547a-b3a0-4398-8f13-ed2961e3fec4] Reconnected to AMQP server on 10.222.0.11:5672 via [amqp] client with port 50864. Nov 17 04:05:56.360975 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-7d88c6cd-1e07-4bfa-a673-58f5acbcab11 tempest-VolumesActionsTest-532309110 tempest-VolumesActionsTest-532309110-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8422c9211af341ec805b9174c540708e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1d5fd11a821458d866a1e9e61e10da4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 04:05:56.368942 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-7d88c6cd-1e07-4bfa-a673-58f5acbcab11 tempest-VolumesActionsTest-532309110 tempest-VolumesActionsTest-532309110-project] 10.222.0.11 "GET /compute/v2.1/servers/7bf3be5f-7305-4b9e-8b8d-d586530cf08d" status: 200 len: 1214 microversion: 2.1 time: 0.085427 Nov 17 04:05:56.369490 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 1669/3226] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 04:05:56 2021] GET /compute/v2.1/servers/7bf3be5f-7305-4b9e-8b8d-d586530cf08d => generated 1214 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 04:05:57.385985 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-068ee43c-b6ed-49c7-9209-f045300dc8db tempest-VolumesActionsTest-532309110 tempest-VolumesActionsTest-532309110-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 04:05:57.386924 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-068ee43c-b6ed-49c7-9209-f045300dc8db tempest-VolumesActionsTest-532309110 tempest-VolumesActionsTest-532309110-project] [instance: 7bf3be5f-7305-4b9e-8b8d-d586530cf08d] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 04:05:57.453630 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-068ee43c-b6ed-49c7-9209-f045300dc8db tempest-VolumesActionsTest-532309110 tempest-VolumesActionsTest-532309110-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8422c9211af341ec805b9174c540708e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1d5fd11a821458d866a1e9e61e10da4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 04:05:57.460240 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-068ee43c-b6ed-49c7-9209-f045300dc8db tempest-VolumesActionsTest-532309110 tempest-VolumesActionsTest-532309110-project] 10.222.0.11 "GET /compute/v2.1/servers/7bf3be5f-7305-4b9e-8b8d-d586530cf08d" status: 200 len: 1214 microversion: 2.1 time: 0.077865 Nov 17 04:05:57.461125 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 1558/3227] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 04:05:57 2021] GET /compute/v2.1/servers/7bf3be5f-7305-4b9e-8b8d-d586530cf08d => generated 1214 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 04:05:58.481772 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-a4be2208-c437-4e1c-b3e7-16111319ec6c tempest-VolumesActionsTest-532309110 tempest-VolumesActionsTest-532309110-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 04:05:58.482671 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-a4be2208-c437-4e1c-b3e7-16111319ec6c tempest-VolumesActionsTest-532309110 tempest-VolumesActionsTest-532309110-project] [instance: 7bf3be5f-7305-4b9e-8b8d-d586530cf08d] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 04:05:58.542921 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-a4be2208-c437-4e1c-b3e7-16111319ec6c tempest-VolumesActionsTest-532309110 tempest-VolumesActionsTest-532309110-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8422c9211af341ec805b9174c540708e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1d5fd11a821458d866a1e9e61e10da4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 04:05:58.550543 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-a4be2208-c437-4e1c-b3e7-16111319ec6c tempest-VolumesActionsTest-532309110 tempest-VolumesActionsTest-532309110-project] 10.222.0.11 "GET /compute/v2.1/servers/7bf3be5f-7305-4b9e-8b8d-d586530cf08d" status: 200 len: 1214 microversion: 2.1 time: 0.075096 Nov 17 04:05:58.551120 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 1670/3228] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 04:05:58 2021] GET /compute/v2.1/servers/7bf3be5f-7305-4b9e-8b8d-d586530cf08d => generated 1214 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 04:05:59.570942 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-b58711df-fe98-425f-918f-e167a7ec25b3 tempest-VolumesActionsTest-532309110 tempest-VolumesActionsTest-532309110-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 04:05:59.571693 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-b58711df-fe98-425f-918f-e167a7ec25b3 tempest-VolumesActionsTest-532309110 tempest-VolumesActionsTest-532309110-project] [instance: 7bf3be5f-7305-4b9e-8b8d-d586530cf08d] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 04:05:59.632011 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-b58711df-fe98-425f-918f-e167a7ec25b3 tempest-VolumesActionsTest-532309110 tempest-VolumesActionsTest-532309110-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8422c9211af341ec805b9174c540708e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1d5fd11a821458d866a1e9e61e10da4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 04:05:59.642260 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-b58711df-fe98-425f-918f-e167a7ec25b3 tempest-VolumesActionsTest-532309110 tempest-VolumesActionsTest-532309110-project] 10.222.0.11 "GET /compute/v2.1/servers/7bf3be5f-7305-4b9e-8b8d-d586530cf08d" status: 200 len: 1214 microversion: 2.1 time: 0.077713 Nov 17 04:05:59.643168 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 1559/3229] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 04:05:59 2021] GET /compute/v2.1/servers/7bf3be5f-7305-4b9e-8b8d-d586530cf08d => generated 1214 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 04:06:00.664561 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-8b81c5d9-5f5f-42f8-84dc-355f32172fb0 tempest-VolumesActionsTest-532309110 tempest-VolumesActionsTest-532309110-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 04:06:00.667476 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-8b81c5d9-5f5f-42f8-84dc-355f32172fb0 tempest-VolumesActionsTest-532309110 tempest-VolumesActionsTest-532309110-project] [instance: 7bf3be5f-7305-4b9e-8b8d-d586530cf08d] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 04:06:00.679446 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-8b81c5d9-5f5f-42f8-84dc-355f32172fb0 tempest-VolumesActionsTest-532309110 tempest-VolumesActionsTest-532309110-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 04:06:00.679885 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-8b81c5d9-5f5f-42f8-84dc-355f32172fb0 tempest-VolumesActionsTest-532309110 tempest-VolumesActionsTest-532309110-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 04:06:00.680653 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-8b81c5d9-5f5f-42f8-84dc-355f32172fb0 tempest-VolumesActionsTest-532309110 tempest-VolumesActionsTest-532309110-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 04:06:00.681122 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-8b81c5d9-5f5f-42f8-84dc-355f32172fb0 tempest-VolumesActionsTest-532309110 tempest-VolumesActionsTest-532309110-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 04:06:00.753204 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-8b81c5d9-5f5f-42f8-84dc-355f32172fb0 tempest-VolumesActionsTest-532309110 tempest-VolumesActionsTest-532309110-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8422c9211af341ec805b9174c540708e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1d5fd11a821458d866a1e9e61e10da4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 04:06:00.761020 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-8b81c5d9-5f5f-42f8-84dc-355f32172fb0 tempest-VolumesActionsTest-532309110 tempest-VolumesActionsTest-532309110-project] 10.222.0.11 "GET /compute/v2.1/servers/7bf3be5f-7305-4b9e-8b8d-d586530cf08d" status: 200 len: 1218 microversion: 2.1 time: 0.102811 Nov 17 04:06:00.761576 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 1671/3230] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 04:06:00 2021] GET /compute/v2.1/servers/7bf3be5f-7305-4b9e-8b8d-d586530cf08d => generated 1218 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 04:06:01.782616 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-f230078e-2762-4a93-a11a-3040bf13a3e4 tempest-VolumesActionsTest-532309110 tempest-VolumesActionsTest-532309110-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 04:06:01.783220 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-f230078e-2762-4a93-a11a-3040bf13a3e4 tempest-VolumesActionsTest-532309110 tempest-VolumesActionsTest-532309110-project] [instance: 7bf3be5f-7305-4b9e-8b8d-d586530cf08d] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 04:06:01.790606 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-f230078e-2762-4a93-a11a-3040bf13a3e4 tempest-VolumesActionsTest-532309110 tempest-VolumesActionsTest-532309110-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 04:06:01.791053 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-f230078e-2762-4a93-a11a-3040bf13a3e4 tempest-VolumesActionsTest-532309110 tempest-VolumesActionsTest-532309110-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 04:06:01.791835 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-f230078e-2762-4a93-a11a-3040bf13a3e4 tempest-VolumesActionsTest-532309110 tempest-VolumesActionsTest-532309110-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 04:06:01.792271 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-f230078e-2762-4a93-a11a-3040bf13a3e4 tempest-VolumesActionsTest-532309110 tempest-VolumesActionsTest-532309110-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 04:06:01.867053 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-f230078e-2762-4a93-a11a-3040bf13a3e4 tempest-VolumesActionsTest-532309110 tempest-VolumesActionsTest-532309110-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8422c9211af341ec805b9174c540708e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1d5fd11a821458d866a1e9e61e10da4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 04:06:01.874695 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-f230078e-2762-4a93-a11a-3040bf13a3e4 tempest-VolumesActionsTest-532309110 tempest-VolumesActionsTest-532309110-project] 10.222.0.11 "GET /compute/v2.1/servers/7bf3be5f-7305-4b9e-8b8d-d586530cf08d" status: 200 len: 1272 microversion: 2.1 time: 0.095774 Nov 17 04:06:01.875263 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 1560/3231] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 04:06:01 2021] GET /compute/v2.1/servers/7bf3be5f-7305-4b9e-8b8d-d586530cf08d => generated 1272 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 04:06:02.847998 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [req-20eabd45-0b07-4e35-ba4e-675fb293eced req-acc4f05a-ec2c-45b6-b157-7d5891057b27 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7bf3be5f-7305-4b9e-8b8d-d586530cf08d", "tag": "9ee8e4e5-4c15-42f9-a508-533f445a03e9"}]} {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 17 04:06:02.850255 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 17 04:06:02.850255 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: warnings.warn(msg) Nov 17 04:06:02.859306 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [req-20eabd45-0b07-4e35-ba4e-675fb293eced req-acc4f05a-ec2c-45b6-b157-7d5891057b27 service nova] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 04:06:02.859748 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [req-20eabd45-0b07-4e35-ba4e-675fb293eced req-acc4f05a-ec2c-45b6-b157-7d5891057b27 service nova] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 04:06:02.871785 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.compute.server_external_events [req-20eabd45-0b07-4e35-ba4e-675fb293eced req-acc4f05a-ec2c-45b6-b157-7d5891057b27 service nova] Creating event network-changed:9ee8e4e5-4c15-42f9-a508-533f445a03e9 for instance 7bf3be5f-7305-4b9e-8b8d-d586530cf08d on hv-cinder-81803 Nov 17 04:06:02.878400 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [req-20eabd45-0b07-4e35-ba4e-675fb293eced req-acc4f05a-ec2c-45b6-b157-7d5891057b27 service nova] 10.222.0.11 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035112 Nov 17 04:06:02.879143 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 1672/3232] 10.222.0.11 () {64 vars in 1317 bytes} [Wed Nov 17 04:06:02 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 17 04:06:02.891218 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-ed285b23-ab02-4826-9743-b6cdf7c2b755 tempest-VolumesActionsTest-532309110 tempest-VolumesActionsTest-532309110-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 04:06:02.891894 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-ed285b23-ab02-4826-9743-b6cdf7c2b755 tempest-VolumesActionsTest-532309110 tempest-VolumesActionsTest-532309110-project] [instance: 7bf3be5f-7305-4b9e-8b8d-d586530cf08d] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 04:06:02.898631 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-ed285b23-ab02-4826-9743-b6cdf7c2b755 tempest-VolumesActionsTest-532309110 tempest-VolumesActionsTest-532309110-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 04:06:02.899081 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-ed285b23-ab02-4826-9743-b6cdf7c2b755 tempest-VolumesActionsTest-532309110 tempest-VolumesActionsTest-532309110-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 04:06:02.899840 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-ed285b23-ab02-4826-9743-b6cdf7c2b755 tempest-VolumesActionsTest-532309110 tempest-VolumesActionsTest-532309110-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 04:06:02.900288 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-ed285b23-ab02-4826-9743-b6cdf7c2b755 tempest-VolumesActionsTest-532309110 tempest-VolumesActionsTest-532309110-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 04:06:03.102839 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-ed285b23-ab02-4826-9743-b6cdf7c2b755 tempest-VolumesActionsTest-532309110 tempest-VolumesActionsTest-532309110-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8422c9211af341ec805b9174c540708e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1d5fd11a821458d866a1e9e61e10da4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 04:06:03.112371 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-ed285b23-ab02-4826-9743-b6cdf7c2b755 tempest-VolumesActionsTest-532309110 tempest-VolumesActionsTest-532309110-project] 10.222.0.11 "GET /compute/v2.1/servers/7bf3be5f-7305-4b9e-8b8d-d586530cf08d" status: 200 len: 1314 microversion: 2.1 time: 0.224822 Nov 17 04:06:03.112967 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 1561/3233] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 04:06:02 2021] GET /compute/v2.1/servers/7bf3be5f-7305-4b9e-8b8d-d586530cf08d => generated 1314 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 04:06:04.134398 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-fbfcae00-8afc-4b71-a0c0-46df13e8c3c4 tempest-VolumesActionsTest-532309110 tempest-VolumesActionsTest-532309110-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 04:06:04.135530 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-fbfcae00-8afc-4b71-a0c0-46df13e8c3c4 tempest-VolumesActionsTest-532309110 tempest-VolumesActionsTest-532309110-project] [instance: 7bf3be5f-7305-4b9e-8b8d-d586530cf08d] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 04:06:04.146243 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-fbfcae00-8afc-4b71-a0c0-46df13e8c3c4 tempest-VolumesActionsTest-532309110 tempest-VolumesActionsTest-532309110-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 04:06:04.147314 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-fbfcae00-8afc-4b71-a0c0-46df13e8c3c4 tempest-VolumesActionsTest-532309110 tempest-VolumesActionsTest-532309110-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 04:06:04.148418 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-fbfcae00-8afc-4b71-a0c0-46df13e8c3c4 tempest-VolumesActionsTest-532309110 tempest-VolumesActionsTest-532309110-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 04:06:04.148888 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-fbfcae00-8afc-4b71-a0c0-46df13e8c3c4 tempest-VolumesActionsTest-532309110 tempest-VolumesActionsTest-532309110-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 04:06:04.291654 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-fbfcae00-8afc-4b71-a0c0-46df13e8c3c4 tempest-VolumesActionsTest-532309110 tempest-VolumesActionsTest-532309110-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8422c9211af341ec805b9174c540708e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1d5fd11a821458d866a1e9e61e10da4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 04:06:04.299963 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-fbfcae00-8afc-4b71-a0c0-46df13e8c3c4 tempest-VolumesActionsTest-532309110 tempest-VolumesActionsTest-532309110-project] 10.222.0.11 "GET /compute/v2.1/servers/7bf3be5f-7305-4b9e-8b8d-d586530cf08d" status: 200 len: 1314 microversion: 2.1 time: 0.173396 Nov 17 04:06:04.300531 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 1673/3234] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 04:06:04 2021] GET /compute/v2.1/servers/7bf3be5f-7305-4b9e-8b8d-d586530cf08d => generated 1314 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 04:06:05.320598 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-724410d6-3015-46ea-8809-5f568fdb2786 tempest-VolumesActionsTest-532309110 tempest-VolumesActionsTest-532309110-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 04:06:05.321295 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-724410d6-3015-46ea-8809-5f568fdb2786 tempest-VolumesActionsTest-532309110 tempest-VolumesActionsTest-532309110-project] [instance: 7bf3be5f-7305-4b9e-8b8d-d586530cf08d] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 04:06:05.328941 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-724410d6-3015-46ea-8809-5f568fdb2786 tempest-VolumesActionsTest-532309110 tempest-VolumesActionsTest-532309110-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 04:06:05.329470 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-724410d6-3015-46ea-8809-5f568fdb2786 tempest-VolumesActionsTest-532309110 tempest-VolumesActionsTest-532309110-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 04:06:05.330371 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-724410d6-3015-46ea-8809-5f568fdb2786 tempest-VolumesActionsTest-532309110 tempest-VolumesActionsTest-532309110-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 04:06:05.330881 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-724410d6-3015-46ea-8809-5f568fdb2786 tempest-VolumesActionsTest-532309110 tempest-VolumesActionsTest-532309110-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 04:06:05.467701 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-724410d6-3015-46ea-8809-5f568fdb2786 tempest-VolumesActionsTest-532309110 tempest-VolumesActionsTest-532309110-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8422c9211af341ec805b9174c540708e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1d5fd11a821458d866a1e9e61e10da4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 04:06:05.475517 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-724410d6-3015-46ea-8809-5f568fdb2786 tempest-VolumesActionsTest-532309110 tempest-VolumesActionsTest-532309110-project] 10.222.0.11 "GET /compute/v2.1/servers/7bf3be5f-7305-4b9e-8b8d-d586530cf08d" status: 200 len: 1314 microversion: 2.1 time: 0.161060 Nov 17 04:06:05.476423 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 1562/3235] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 04:06:05 2021] GET /compute/v2.1/servers/7bf3be5f-7305-4b9e-8b8d-d586530cf08d => generated 1314 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 04:06:06.492597 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-fb3e69e4-6056-4c6f-9735-094e579b6681 tempest-VolumesActionsTest-532309110 tempest-VolumesActionsTest-532309110-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 04:06:06.493253 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-fb3e69e4-6056-4c6f-9735-094e579b6681 tempest-VolumesActionsTest-532309110 tempest-VolumesActionsTest-532309110-project] [instance: 7bf3be5f-7305-4b9e-8b8d-d586530cf08d] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 04:06:06.499768 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-fb3e69e4-6056-4c6f-9735-094e579b6681 tempest-VolumesActionsTest-532309110 tempest-VolumesActionsTest-532309110-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 04:06:06.500218 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-fb3e69e4-6056-4c6f-9735-094e579b6681 tempest-VolumesActionsTest-532309110 tempest-VolumesActionsTest-532309110-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 04:06:06.501017 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-fb3e69e4-6056-4c6f-9735-094e579b6681 tempest-VolumesActionsTest-532309110 tempest-VolumesActionsTest-532309110-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 04:06:06.501442 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-fb3e69e4-6056-4c6f-9735-094e579b6681 tempest-VolumesActionsTest-532309110 tempest-VolumesActionsTest-532309110-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 04:06:06.655951 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-fb3e69e4-6056-4c6f-9735-094e579b6681 tempest-VolumesActionsTest-532309110 tempest-VolumesActionsTest-532309110-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8422c9211af341ec805b9174c540708e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1d5fd11a821458d866a1e9e61e10da4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 04:06:06.667213 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-fb3e69e4-6056-4c6f-9735-094e579b6681 tempest-VolumesActionsTest-532309110 tempest-VolumesActionsTest-532309110-project] 10.222.0.11 "GET /compute/v2.1/servers/7bf3be5f-7305-4b9e-8b8d-d586530cf08d" status: 200 len: 1314 microversion: 2.1 time: 0.178153 Nov 17 04:06:06.668024 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 1674/3236] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 04:06:06 2021] GET /compute/v2.1/servers/7bf3be5f-7305-4b9e-8b8d-d586530cf08d => generated 1314 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 04:06:07.688962 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-ed35309c-f209-466c-84c0-3e91e226853d tempest-VolumesActionsTest-532309110 tempest-VolumesActionsTest-532309110-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 04:06:07.689576 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-ed35309c-f209-466c-84c0-3e91e226853d tempest-VolumesActionsTest-532309110 tempest-VolumesActionsTest-532309110-project] [instance: 7bf3be5f-7305-4b9e-8b8d-d586530cf08d] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 04:06:07.696240 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-ed35309c-f209-466c-84c0-3e91e226853d tempest-VolumesActionsTest-532309110 tempest-VolumesActionsTest-532309110-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 04:06:07.696697 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-ed35309c-f209-466c-84c0-3e91e226853d tempest-VolumesActionsTest-532309110 tempest-VolumesActionsTest-532309110-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 04:06:07.697497 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-ed35309c-f209-466c-84c0-3e91e226853d tempest-VolumesActionsTest-532309110 tempest-VolumesActionsTest-532309110-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 04:06:07.697930 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-ed35309c-f209-466c-84c0-3e91e226853d tempest-VolumesActionsTest-532309110 tempest-VolumesActionsTest-532309110-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 04:06:07.835235 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-ed35309c-f209-466c-84c0-3e91e226853d tempest-VolumesActionsTest-532309110 tempest-VolumesActionsTest-532309110-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8422c9211af341ec805b9174c540708e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1d5fd11a821458d866a1e9e61e10da4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 04:06:07.847923 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-ed35309c-f209-466c-84c0-3e91e226853d tempest-VolumesActionsTest-532309110 tempest-VolumesActionsTest-532309110-project] 10.222.0.11 "GET /compute/v2.1/servers/7bf3be5f-7305-4b9e-8b8d-d586530cf08d" status: 200 len: 1314 microversion: 2.1 time: 0.162538 Nov 17 04:06:07.848809 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 1563/3237] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 04:06:07 2021] GET /compute/v2.1/servers/7bf3be5f-7305-4b9e-8b8d-d586530cf08d => generated 1314 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 04:06:08.189319 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [req-2011dc94-89fd-4474-a268-fa308bc3d6cc req-f11ce50a-1766-4359-bf83-3c5c3eafc5e8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7bf3be5f-7305-4b9e-8b8d-d586530cf08d", "name": "network-vif-plugged", "status": "completed", "tag": "9ee8e4e5-4c15-42f9-a508-533f445a03e9"}]} {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 17 04:06:08.190859 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 17 04:06:08.190859 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: warnings.warn(msg) Nov 17 04:06:08.197921 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [req-2011dc94-89fd-4474-a268-fa308bc3d6cc req-f11ce50a-1766-4359-bf83-3c5c3eafc5e8 service nova] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 04:06:08.198352 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [req-2011dc94-89fd-4474-a268-fa308bc3d6cc req-f11ce50a-1766-4359-bf83-3c5c3eafc5e8 service nova] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 04:06:08.208932 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.compute.server_external_events [req-2011dc94-89fd-4474-a268-fa308bc3d6cc req-f11ce50a-1766-4359-bf83-3c5c3eafc5e8 service nova] Creating event network-vif-plugged:9ee8e4e5-4c15-42f9-a508-533f445a03e9 for instance 7bf3be5f-7305-4b9e-8b8d-d586530cf08d on hv-cinder-81803 Nov 17 04:06:08.214288 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [req-2011dc94-89fd-4474-a268-fa308bc3d6cc req-f11ce50a-1766-4359-bf83-3c5c3eafc5e8 service nova] 10.222.0.11 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.146103 Nov 17 04:06:08.214864 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 1675/3238] 10.222.0.11 () {64 vars in 1317 bytes} [Wed Nov 17 04:06:08 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 17 04:06:08.869760 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-0a61afbb-d792-4f84-82db-f1a188057b8c tempest-VolumesActionsTest-532309110 tempest-VolumesActionsTest-532309110-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 04:06:08.870447 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-0a61afbb-d792-4f84-82db-f1a188057b8c tempest-VolumesActionsTest-532309110 tempest-VolumesActionsTest-532309110-project] [instance: 7bf3be5f-7305-4b9e-8b8d-d586530cf08d] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 04:06:08.877804 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-0a61afbb-d792-4f84-82db-f1a188057b8c tempest-VolumesActionsTest-532309110 tempest-VolumesActionsTest-532309110-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 04:06:08.878302 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-0a61afbb-d792-4f84-82db-f1a188057b8c tempest-VolumesActionsTest-532309110 tempest-VolumesActionsTest-532309110-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 04:06:08.879152 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-0a61afbb-d792-4f84-82db-f1a188057b8c tempest-VolumesActionsTest-532309110 tempest-VolumesActionsTest-532309110-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 04:06:08.879627 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-0a61afbb-d792-4f84-82db-f1a188057b8c tempest-VolumesActionsTest-532309110 tempest-VolumesActionsTest-532309110-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 04:06:09.015995 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-0a61afbb-d792-4f84-82db-f1a188057b8c tempest-VolumesActionsTest-532309110 tempest-VolumesActionsTest-532309110-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8422c9211af341ec805b9174c540708e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1d5fd11a821458d866a1e9e61e10da4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 04:06:09.026544 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-0a61afbb-d792-4f84-82db-f1a188057b8c tempest-VolumesActionsTest-532309110 tempest-VolumesActionsTest-532309110-project] 10.222.0.11 "GET /compute/v2.1/servers/7bf3be5f-7305-4b9e-8b8d-d586530cf08d" status: 200 len: 1314 microversion: 2.1 time: 0.162659 Nov 17 04:06:09.027305 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 1564/3239] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 04:06:08 2021] GET /compute/v2.1/servers/7bf3be5f-7305-4b9e-8b8d-d586530cf08d => generated 1314 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 04:06:10.053923 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-f11a31ff-0611-459c-8878-1835c9d50033 tempest-VolumesActionsTest-532309110 tempest-VolumesActionsTest-532309110-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 04:06:10.054978 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-f11a31ff-0611-459c-8878-1835c9d50033 tempest-VolumesActionsTest-532309110 tempest-VolumesActionsTest-532309110-project] [instance: 7bf3be5f-7305-4b9e-8b8d-d586530cf08d] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 04:06:10.065893 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-f11a31ff-0611-459c-8878-1835c9d50033 tempest-VolumesActionsTest-532309110 tempest-VolumesActionsTest-532309110-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 04:06:10.066648 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-f11a31ff-0611-459c-8878-1835c9d50033 tempest-VolumesActionsTest-532309110 tempest-VolumesActionsTest-532309110-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 04:06:10.067929 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-f11a31ff-0611-459c-8878-1835c9d50033 tempest-VolumesActionsTest-532309110 tempest-VolumesActionsTest-532309110-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 04:06:10.068654 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-f11a31ff-0611-459c-8878-1835c9d50033 tempest-VolumesActionsTest-532309110 tempest-VolumesActionsTest-532309110-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 04:06:10.209905 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-f11a31ff-0611-459c-8878-1835c9d50033 tempest-VolumesActionsTest-532309110 tempest-VolumesActionsTest-532309110-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8422c9211af341ec805b9174c540708e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1d5fd11a821458d866a1e9e61e10da4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 04:06:10.217522 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-f11a31ff-0611-459c-8878-1835c9d50033 tempest-VolumesActionsTest-532309110 tempest-VolumesActionsTest-532309110-project] 10.222.0.11 "GET /compute/v2.1/servers/7bf3be5f-7305-4b9e-8b8d-d586530cf08d" status: 200 len: 1497 microversion: 2.1 time: 0.171705 Nov 17 04:06:10.218085 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 1676/3240] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 04:06:10 2021] GET /compute/v2.1/servers/7bf3be5f-7305-4b9e-8b8d-d586530cf08d => generated 1497 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 04:06:10.708247 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-7a63252d-8206-4bd1-ae76-488d2faeae23 tempest-VolumesActionsTest-532309110 tempest-VolumesActionsTest-532309110-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 04:06:10.708808 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-7a63252d-8206-4bd1-ae76-488d2faeae23 tempest-VolumesActionsTest-532309110 tempest-VolumesActionsTest-532309110-project] [instance: 7bf3be5f-7305-4b9e-8b8d-d586530cf08d] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 04:06:10.715669 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-7a63252d-8206-4bd1-ae76-488d2faeae23 tempest-VolumesActionsTest-532309110 tempest-VolumesActionsTest-532309110-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 04:06:10.716093 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-7a63252d-8206-4bd1-ae76-488d2faeae23 tempest-VolumesActionsTest-532309110 tempest-VolumesActionsTest-532309110-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 04:06:10.716892 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-7a63252d-8206-4bd1-ae76-488d2faeae23 tempest-VolumesActionsTest-532309110 tempest-VolumesActionsTest-532309110-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 04:06:10.717327 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-7a63252d-8206-4bd1-ae76-488d2faeae23 tempest-VolumesActionsTest-532309110 tempest-VolumesActionsTest-532309110-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 04:06:10.742873 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-7a63252d-8206-4bd1-ae76-488d2faeae23 tempest-VolumesActionsTest-532309110 tempest-VolumesActionsTest-532309110-project] [instance: 7bf3be5f-7305-4b9e-8b8d-d586530cf08d] Going to try to terminate instance {{(pid=115916) delete /opt/stack/nova/nova/compute/api.py:2614}} Nov 17 04:06:10.820638 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-7a63252d-8206-4bd1-ae76-488d2faeae23 tempest-VolumesActionsTest-532309110 tempest-VolumesActionsTest-532309110-project] 10.222.0.11 "DELETE /compute/v2.1/servers/7bf3be5f-7305-4b9e-8b8d-d586530cf08d" status: 204 len: 0 microversion: 2.1 time: 0.115740 Nov 17 04:06:10.821299 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 1565/3241] 10.222.0.11 () {58 vars in 1238 bytes} [Wed Nov 17 04:06:10 2021] DELETE /compute/v2.1/servers/7bf3be5f-7305-4b9e-8b8d-d586530cf08d => generated 0 bytes in 117 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 17 04:06:10.830397 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-c9fd931c-4bc4-4261-bc98-31375b05647c tempest-VolumesActionsTest-532309110 tempest-VolumesActionsTest-532309110-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 04:06:10.831009 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-c9fd931c-4bc4-4261-bc98-31375b05647c tempest-VolumesActionsTest-532309110 tempest-VolumesActionsTest-532309110-project] [instance: 7bf3be5f-7305-4b9e-8b8d-d586530cf08d] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 04:06:10.837093 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-c9fd931c-4bc4-4261-bc98-31375b05647c tempest-VolumesActionsTest-532309110 tempest-VolumesActionsTest-532309110-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 04:06:10.837538 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-c9fd931c-4bc4-4261-bc98-31375b05647c tempest-VolumesActionsTest-532309110 tempest-VolumesActionsTest-532309110-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 04:06:10.838297 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-c9fd931c-4bc4-4261-bc98-31375b05647c tempest-VolumesActionsTest-532309110 tempest-VolumesActionsTest-532309110-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 04:06:10.838716 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-c9fd931c-4bc4-4261-bc98-31375b05647c tempest-VolumesActionsTest-532309110 tempest-VolumesActionsTest-532309110-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 04:06:10.983688 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-c9fd931c-4bc4-4261-bc98-31375b05647c tempest-VolumesActionsTest-532309110 tempest-VolumesActionsTest-532309110-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8422c9211af341ec805b9174c540708e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1d5fd11a821458d866a1e9e61e10da4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 04:06:10.991703 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-c9fd931c-4bc4-4261-bc98-31375b05647c tempest-VolumesActionsTest-532309110 tempest-VolumesActionsTest-532309110-project] 10.222.0.11 "GET /compute/v2.1/servers/7bf3be5f-7305-4b9e-8b8d-d586530cf08d" status: 200 len: 1503 microversion: 2.1 time: 0.165354 Nov 17 04:06:10.992343 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 1677/3242] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 04:06:10 2021] GET /compute/v2.1/servers/7bf3be5f-7305-4b9e-8b8d-d586530cf08d => generated 1503 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 04:06:12.011629 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-949663a2-0cba-42cc-b596-f431fa9746c7 tempest-VolumesActionsTest-532309110 tempest-VolumesActionsTest-532309110-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 04:06:12.012320 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-949663a2-0cba-42cc-b596-f431fa9746c7 tempest-VolumesActionsTest-532309110 tempest-VolumesActionsTest-532309110-project] [instance: 7bf3be5f-7305-4b9e-8b8d-d586530cf08d] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 04:06:12.019481 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-949663a2-0cba-42cc-b596-f431fa9746c7 tempest-VolumesActionsTest-532309110 tempest-VolumesActionsTest-532309110-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 04:06:12.019957 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-949663a2-0cba-42cc-b596-f431fa9746c7 tempest-VolumesActionsTest-532309110 tempest-VolumesActionsTest-532309110-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 04:06:12.020728 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-949663a2-0cba-42cc-b596-f431fa9746c7 tempest-VolumesActionsTest-532309110 tempest-VolumesActionsTest-532309110-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 04:06:12.021171 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-949663a2-0cba-42cc-b596-f431fa9746c7 tempest-VolumesActionsTest-532309110 tempest-VolumesActionsTest-532309110-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 04:06:12.161849 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-949663a2-0cba-42cc-b596-f431fa9746c7 tempest-VolumesActionsTest-532309110 tempest-VolumesActionsTest-532309110-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8422c9211af341ec805b9174c540708e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1d5fd11a821458d866a1e9e61e10da4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 04:06:12.170829 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-949663a2-0cba-42cc-b596-f431fa9746c7 tempest-VolumesActionsTest-532309110 tempest-VolumesActionsTest-532309110-project] 10.222.0.11 "GET /compute/v2.1/servers/7bf3be5f-7305-4b9e-8b8d-d586530cf08d" status: 200 len: 1503 microversion: 2.1 time: 0.164543 Nov 17 04:06:12.171410 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 1566/3243] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 04:06:12 2021] GET /compute/v2.1/servers/7bf3be5f-7305-4b9e-8b8d-d586530cf08d => generated 1503 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 04:06:12.811804 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [req-1217eacb-1704-427c-ae5e-5869461bd5a1 req-146f5cdb-36e8-4409-840f-a4cdd5242c2a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7bf3be5f-7305-4b9e-8b8d-d586530cf08d", "name": "network-vif-deleted", "tag": "9ee8e4e5-4c15-42f9-a508-533f445a03e9"}]} {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 17 04:06:12.813428 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 17 04:06:12.813428 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: warnings.warn(msg) Nov 17 04:06:12.820985 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [req-1217eacb-1704-427c-ae5e-5869461bd5a1 req-146f5cdb-36e8-4409-840f-a4cdd5242c2a service nova] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 04:06:12.821419 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [req-1217eacb-1704-427c-ae5e-5869461bd5a1 req-146f5cdb-36e8-4409-840f-a4cdd5242c2a service nova] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 04:06:12.832450 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.compute.server_external_events [req-1217eacb-1704-427c-ae5e-5869461bd5a1 req-146f5cdb-36e8-4409-840f-a4cdd5242c2a service nova] Creating event network-vif-deleted:9ee8e4e5-4c15-42f9-a508-533f445a03e9 for instance 7bf3be5f-7305-4b9e-8b8d-d586530cf08d on hv-cinder-81803 Nov 17 04:06:12.837588 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [req-1217eacb-1704-427c-ae5e-5869461bd5a1 req-146f5cdb-36e8-4409-840f-a4cdd5242c2a service nova] 10.222.0.11 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029502 Nov 17 04:06:12.838226 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 1678/3244] 10.222.0.11 () {64 vars in 1317 bytes} [Wed Nov 17 04:06:12 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 17 04:06:13.192301 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-a8640852-da00-4eca-8ae2-449953f726ef tempest-VolumesActionsTest-532309110 tempest-VolumesActionsTest-532309110-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 04:06:13.193358 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-a8640852-da00-4eca-8ae2-449953f726ef tempest-VolumesActionsTest-532309110 tempest-VolumesActionsTest-532309110-project] [instance: 7bf3be5f-7305-4b9e-8b8d-d586530cf08d] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 04:06:13.203663 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-a8640852-da00-4eca-8ae2-449953f726ef tempest-VolumesActionsTest-532309110 tempest-VolumesActionsTest-532309110-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 04:06:13.204541 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-a8640852-da00-4eca-8ae2-449953f726ef tempest-VolumesActionsTest-532309110 tempest-VolumesActionsTest-532309110-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 04:06:13.205864 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-a8640852-da00-4eca-8ae2-449953f726ef tempest-VolumesActionsTest-532309110 tempest-VolumesActionsTest-532309110-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 04:06:13.206624 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-a8640852-da00-4eca-8ae2-449953f726ef tempest-VolumesActionsTest-532309110 tempest-VolumesActionsTest-532309110-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 04:06:13.240474 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-a8640852-da00-4eca-8ae2-449953f726ef tempest-VolumesActionsTest-532309110 tempest-VolumesActionsTest-532309110-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 04:06:13.241078 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-a8640852-da00-4eca-8ae2-449953f726ef tempest-VolumesActionsTest-532309110 tempest-VolumesActionsTest-532309110-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 04:06:13.241537 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.objects.instance [None req-a8640852-da00-4eca-8ae2-449953f726ef tempest-VolumesActionsTest-532309110 tempest-VolumesActionsTest-532309110-project] Lazy-loading 'fault' on Instance uuid 7bf3be5f-7305-4b9e-8b8d-d586530cf08d {{(pid=115916) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Nov 17 04:06:13.285807 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-a8640852-da00-4eca-8ae2-449953f726ef tempest-VolumesActionsTest-532309110 tempest-VolumesActionsTest-532309110-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8422c9211af341ec805b9174c540708e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1d5fd11a821458d866a1e9e61e10da4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 04:06:13.293769 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-a8640852-da00-4eca-8ae2-449953f726ef tempest-VolumesActionsTest-532309110 tempest-VolumesActionsTest-532309110-project] 10.222.0.11 "GET /compute/v2.1/servers/7bf3be5f-7305-4b9e-8b8d-d586530cf08d" status: 200 len: 1304 microversion: 2.1 time: 0.107622 Nov 17 04:06:13.294723 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 1567/3245] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 04:06:13 2021] GET /compute/v2.1/servers/7bf3be5f-7305-4b9e-8b8d-d586530cf08d => generated 1304 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 04:06:14.316726 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-67c1e78e-7fff-40cf-bce9-909d6946fc2f tempest-VolumesActionsTest-532309110 tempest-VolumesActionsTest-532309110-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 04:06:14.317823 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-67c1e78e-7fff-40cf-bce9-909d6946fc2f tempest-VolumesActionsTest-532309110 tempest-VolumesActionsTest-532309110-project] [instance: 7bf3be5f-7305-4b9e-8b8d-d586530cf08d] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 04:06:14.325590 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-67c1e78e-7fff-40cf-bce9-909d6946fc2f tempest-VolumesActionsTest-532309110 tempest-VolumesActionsTest-532309110-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 04:06:14.326028 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-67c1e78e-7fff-40cf-bce9-909d6946fc2f tempest-VolumesActionsTest-532309110 tempest-VolumesActionsTest-532309110-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 04:06:14.326789 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-67c1e78e-7fff-40cf-bce9-909d6946fc2f tempest-VolumesActionsTest-532309110 tempest-VolumesActionsTest-532309110-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 04:06:14.327251 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-67c1e78e-7fff-40cf-bce9-909d6946fc2f tempest-VolumesActionsTest-532309110 tempest-VolumesActionsTest-532309110-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 04:06:14.340659 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.wsgi [None req-67c1e78e-7fff-40cf-bce9-909d6946fc2f tempest-VolumesActionsTest-532309110 tempest-VolumesActionsTest-532309110-project] HTTP exception thrown: Instance 7bf3be5f-7305-4b9e-8b8d-d586530cf08d could not be found. Nov 17 04:06:14.341282 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-67c1e78e-7fff-40cf-bce9-909d6946fc2f tempest-VolumesActionsTest-532309110 tempest-VolumesActionsTest-532309110-project] Returning 404 to user: Instance 7bf3be5f-7305-4b9e-8b8d-d586530cf08d could not be found. {{(pid=115917) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 17 04:06:14.342085 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-67c1e78e-7fff-40cf-bce9-909d6946fc2f tempest-VolumesActionsTest-532309110 tempest-VolumesActionsTest-532309110-project] 10.222.0.11 "GET /compute/v2.1/servers/7bf3be5f-7305-4b9e-8b8d-d586530cf08d" status: 404 len: 111 microversion: 2.1 time: 0.033010 Nov 17 04:06:14.342609 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 1679/3246] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 04:06:14 2021] GET /compute/v2.1/servers/7bf3be5f-7305-4b9e-8b8d-d586530cf08d => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 17 04:06:14.393350 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-718936db-028b-4416-90ca-6a6aea84f76f tempest-VolumesActionsTest-532309110 tempest-VolumesActionsTest-532309110-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1300815231", "imageRef": "7281a37a-6b99-49c1-881a-41604d06bae1", "flavorRef": "452", "networks": [{"uuid": "eb0d9638-5cee-4b8d-97b7-e3908ead4285"}]}} {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 17 04:06:14.453996 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.network.neutron [None req-718936db-028b-4416-90ca-6a6aea84f76f tempest-VolumesActionsTest-532309110 tempest-VolumesActionsTest-532309110-project] validate_networks() for [('eb0d9638-5cee-4b8d-97b7-e3908ead4285', None, None, None, None, None)] {{(pid=115916) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Nov 17 04:06:14.792106 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.virt.hardware [None req-718936db-028b-4416-90ca-6a6aea84f76f tempest-VolumesActionsTest-532309110 tempest-VolumesActionsTest-532309110-project] Flavor limits 0:0:0 {{(pid=115916) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 17 04:06:14.792532 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.virt.hardware [None req-718936db-028b-4416-90ca-6a6aea84f76f tempest-VolumesActionsTest-532309110 tempest-VolumesActionsTest-532309110-project] Image limits 0:0:0 {{(pid=115916) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 17 04:06:14.793038 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.virt.hardware [None req-718936db-028b-4416-90ca-6a6aea84f76f tempest-VolumesActionsTest-532309110 tempest-VolumesActionsTest-532309110-project] Flavor pref 0:0:0 {{(pid=115916) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 17 04:06:14.793443 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.virt.hardware [None req-718936db-028b-4416-90ca-6a6aea84f76f tempest-VolumesActionsTest-532309110 tempest-VolumesActionsTest-532309110-project] Image pref 0:0:0 {{(pid=115916) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 17 04:06:14.793854 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.virt.hardware [None req-718936db-028b-4416-90ca-6a6aea84f76f tempest-VolumesActionsTest-532309110 tempest-VolumesActionsTest-532309110-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=115916) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 17 04:06:14.806296 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-718936db-028b-4416-90ca-6a6aea84f76f tempest-VolumesActionsTest-532309110 tempest-VolumesActionsTest-532309110-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 04:06:14.806746 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-718936db-028b-4416-90ca-6a6aea84f76f tempest-VolumesActionsTest-532309110 tempest-VolumesActionsTest-532309110-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 04:06:14.807550 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-718936db-028b-4416-90ca-6a6aea84f76f tempest-VolumesActionsTest-532309110 tempest-VolumesActionsTest-532309110-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 04:06:14.807989 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-718936db-028b-4416-90ca-6a6aea84f76f tempest-VolumesActionsTest-532309110 tempest-VolumesActionsTest-532309110-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 04:06:14.824527 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.quota [None req-718936db-028b-4416-90ca-6a6aea84f76f tempest-VolumesActionsTest-532309110 tempest-VolumesActionsTest-532309110-project] Getting quotas for project a1d5fd11a821458d866a1e9e61e10da4. Resources: {'instances', 'ram', 'cores'} {{(pid=115916) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 17 04:06:14.828680 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.quota [None req-718936db-028b-4416-90ca-6a6aea84f76f tempest-VolumesActionsTest-532309110 tempest-VolumesActionsTest-532309110-project] Getting quotas for user 8422c9211af341ec805b9174c540708e and project a1d5fd11a821458d866a1e9e61e10da4. Resources: {'instances', 'ram', 'cores'} {{(pid=115916) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 17 04:06:14.839638 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-718936db-028b-4416-90ca-6a6aea84f76f tempest-VolumesActionsTest-532309110 tempest-VolumesActionsTest-532309110-project] Going to run 1 instances... {{(pid=115916) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 17 04:06:14.841930 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-718936db-028b-4416-90ca-6a6aea84f76f tempest-VolumesActionsTest-532309110 tempest-VolumesActionsTest-532309110-project] [instance: 083c7990-add1-490b-94c8-ac58e5749e4b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='7281a37a-6b99-49c1-881a-41604d06bae1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=115916) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 17 04:06:14.891533 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-718936db-028b-4416-90ca-6a6aea84f76f tempest-VolumesActionsTest-532309110 tempest-VolumesActionsTest-532309110-project] 10.222.0.11 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.503338 Nov 17 04:06:14.892347 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 1568/3247] 10.222.0.11 () {60 vars in 1146 bytes} [Wed Nov 17 04:06:14 2021] POST /compute/v2.1/servers => generated 380 bytes in 505 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 17 04:06:14.902221 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-9f7c49c1-43d2-4fd8-83a7-a7aac0f4d6a0 tempest-VolumesActionsTest-532309110 tempest-VolumesActionsTest-532309110-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 04:06:14.902864 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-9f7c49c1-43d2-4fd8-83a7-a7aac0f4d6a0 tempest-VolumesActionsTest-532309110 tempest-VolumesActionsTest-532309110-project] [instance: 083c7990-add1-490b-94c8-ac58e5749e4b] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 04:06:14.955470 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-9f7c49c1-43d2-4fd8-83a7-a7aac0f4d6a0 tempest-VolumesActionsTest-532309110 tempest-VolumesActionsTest-532309110-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8422c9211af341ec805b9174c540708e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1d5fd11a821458d866a1e9e61e10da4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 04:06:14.962120 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-9f7c49c1-43d2-4fd8-83a7-a7aac0f4d6a0 tempest-VolumesActionsTest-532309110 tempest-VolumesActionsTest-532309110-project] 10.222.0.11 "GET /compute/v2.1/servers/083c7990-add1-490b-94c8-ac58e5749e4b" status: 200 len: 1214 microversion: 2.1 time: 0.063811 Nov 17 04:06:14.962687 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 1680/3248] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 04:06:14 2021] GET /compute/v2.1/servers/083c7990-add1-490b-94c8-ac58e5749e4b => generated 1214 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 04:06:15.979387 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-ef5ff1b1-6ec2-4f9c-b76a-9e477017057b tempest-VolumesActionsTest-532309110 tempest-VolumesActionsTest-532309110-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 04:06:15.980094 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-ef5ff1b1-6ec2-4f9c-b76a-9e477017057b tempest-VolumesActionsTest-532309110 tempest-VolumesActionsTest-532309110-project] [instance: 083c7990-add1-490b-94c8-ac58e5749e4b] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 04:06:15.987627 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-ef5ff1b1-6ec2-4f9c-b76a-9e477017057b tempest-VolumesActionsTest-532309110 tempest-VolumesActionsTest-532309110-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 04:06:15.988189 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-ef5ff1b1-6ec2-4f9c-b76a-9e477017057b tempest-VolumesActionsTest-532309110 tempest-VolumesActionsTest-532309110-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 04:06:15.989109 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-ef5ff1b1-6ec2-4f9c-b76a-9e477017057b tempest-VolumesActionsTest-532309110 tempest-VolumesActionsTest-532309110-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 04:06:15.989545 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-ef5ff1b1-6ec2-4f9c-b76a-9e477017057b tempest-VolumesActionsTest-532309110 tempest-VolumesActionsTest-532309110-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 04:06:16.103940 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-ef5ff1b1-6ec2-4f9c-b76a-9e477017057b tempest-VolumesActionsTest-532309110 tempest-VolumesActionsTest-532309110-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8422c9211af341ec805b9174c540708e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1d5fd11a821458d866a1e9e61e10da4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 04:06:16.113989 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-ef5ff1b1-6ec2-4f9c-b76a-9e477017057b tempest-VolumesActionsTest-532309110 tempest-VolumesActionsTest-532309110-project] 10.222.0.11 "GET /compute/v2.1/servers/083c7990-add1-490b-94c8-ac58e5749e4b" status: 200 len: 1274 microversion: 2.1 time: 0.138117 Nov 17 04:06:16.114806 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 1569/3249] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 04:06:15 2021] GET /compute/v2.1/servers/083c7990-add1-490b-94c8-ac58e5749e4b => generated 1274 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 04:06:17.131106 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-c483056b-a7d0-400e-94f7-161a9aab2e3b tempest-VolumesActionsTest-532309110 tempest-VolumesActionsTest-532309110-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 04:06:17.131771 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-c483056b-a7d0-400e-94f7-161a9aab2e3b tempest-VolumesActionsTest-532309110 tempest-VolumesActionsTest-532309110-project] [instance: 083c7990-add1-490b-94c8-ac58e5749e4b] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 04:06:17.139628 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-c483056b-a7d0-400e-94f7-161a9aab2e3b tempest-VolumesActionsTest-532309110 tempest-VolumesActionsTest-532309110-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 04:06:17.140068 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-c483056b-a7d0-400e-94f7-161a9aab2e3b tempest-VolumesActionsTest-532309110 tempest-VolumesActionsTest-532309110-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 04:06:17.140882 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-c483056b-a7d0-400e-94f7-161a9aab2e3b tempest-VolumesActionsTest-532309110 tempest-VolumesActionsTest-532309110-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 04:06:17.141314 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-c483056b-a7d0-400e-94f7-161a9aab2e3b tempest-VolumesActionsTest-532309110 tempest-VolumesActionsTest-532309110-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 04:06:17.270784 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-c483056b-a7d0-400e-94f7-161a9aab2e3b tempest-VolumesActionsTest-532309110 tempest-VolumesActionsTest-532309110-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8422c9211af341ec805b9174c540708e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1d5fd11a821458d866a1e9e61e10da4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 04:06:17.278295 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-c483056b-a7d0-400e-94f7-161a9aab2e3b tempest-VolumesActionsTest-532309110 tempest-VolumesActionsTest-532309110-project] 10.222.0.11 "GET /compute/v2.1/servers/083c7990-add1-490b-94c8-ac58e5749e4b" status: 200 len: 1314 microversion: 2.1 time: 0.151018 Nov 17 04:06:17.278931 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 1681/3250] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 04:06:17 2021] GET /compute/v2.1/servers/083c7990-add1-490b-94c8-ac58e5749e4b => generated 1314 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 04:06:17.394152 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [req-f31dce40-1613-4a60-8f87-c97367becfd7 req-38231ce1-b912-4b2d-a501-47d97f43c279 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "083c7990-add1-490b-94c8-ac58e5749e4b", "tag": "63a8f3a8-a232-4226-a7e6-a5085f800126"}]} {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 17 04:06:17.396638 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 17 04:06:17.396638 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: warnings.warn(msg) Nov 17 04:06:17.406417 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [req-f31dce40-1613-4a60-8f87-c97367becfd7 req-38231ce1-b912-4b2d-a501-47d97f43c279 service nova] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 04:06:17.406924 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [req-f31dce40-1613-4a60-8f87-c97367becfd7 req-38231ce1-b912-4b2d-a501-47d97f43c279 service nova] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 04:06:17.418709 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.compute.server_external_events [req-f31dce40-1613-4a60-8f87-c97367becfd7 req-38231ce1-b912-4b2d-a501-47d97f43c279 service nova] Creating event network-changed:63a8f3a8-a232-4226-a7e6-a5085f800126 for instance 083c7990-add1-490b-94c8-ac58e5749e4b on hv-cinder-81803 Nov 17 04:06:17.423924 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [req-f31dce40-1613-4a60-8f87-c97367becfd7 req-38231ce1-b912-4b2d-a501-47d97f43c279 service nova] 10.222.0.11 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039558 Nov 17 04:06:17.424484 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 1570/3251] 10.222.0.11 () {64 vars in 1317 bytes} [Wed Nov 17 04:06:17 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 17 04:06:18.295526 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-c3a3ac2b-d1f9-4b7e-9b77-7c638feb2563 tempest-VolumesActionsTest-532309110 tempest-VolumesActionsTest-532309110-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 04:06:18.296115 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-c3a3ac2b-d1f9-4b7e-9b77-7c638feb2563 tempest-VolumesActionsTest-532309110 tempest-VolumesActionsTest-532309110-project] [instance: 083c7990-add1-490b-94c8-ac58e5749e4b] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 04:06:18.303039 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-c3a3ac2b-d1f9-4b7e-9b77-7c638feb2563 tempest-VolumesActionsTest-532309110 tempest-VolumesActionsTest-532309110-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 04:06:18.303513 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-c3a3ac2b-d1f9-4b7e-9b77-7c638feb2563 tempest-VolumesActionsTest-532309110 tempest-VolumesActionsTest-532309110-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 04:06:18.304298 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-c3a3ac2b-d1f9-4b7e-9b77-7c638feb2563 tempest-VolumesActionsTest-532309110 tempest-VolumesActionsTest-532309110-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 04:06:18.304728 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-c3a3ac2b-d1f9-4b7e-9b77-7c638feb2563 tempest-VolumesActionsTest-532309110 tempest-VolumesActionsTest-532309110-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 04:06:18.444404 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-c3a3ac2b-d1f9-4b7e-9b77-7c638feb2563 tempest-VolumesActionsTest-532309110 tempest-VolumesActionsTest-532309110-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8422c9211af341ec805b9174c540708e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1d5fd11a821458d866a1e9e61e10da4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 04:06:18.452064 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-c3a3ac2b-d1f9-4b7e-9b77-7c638feb2563 tempest-VolumesActionsTest-532309110 tempest-VolumesActionsTest-532309110-project] 10.222.0.11 "GET /compute/v2.1/servers/083c7990-add1-490b-94c8-ac58e5749e4b" status: 200 len: 1314 microversion: 2.1 time: 0.160253 Nov 17 04:06:18.452637 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 1682/3252] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 04:06:18 2021] GET /compute/v2.1/servers/083c7990-add1-490b-94c8-ac58e5749e4b => generated 1314 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 04:06:19.473908 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-6a6dad69-d26b-4ac8-b0e7-4d4bc2a37392 tempest-VolumesActionsTest-532309110 tempest-VolumesActionsTest-532309110-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 04:06:19.475041 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-6a6dad69-d26b-4ac8-b0e7-4d4bc2a37392 tempest-VolumesActionsTest-532309110 tempest-VolumesActionsTest-532309110-project] [instance: 083c7990-add1-490b-94c8-ac58e5749e4b] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 04:06:19.483296 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-6a6dad69-d26b-4ac8-b0e7-4d4bc2a37392 tempest-VolumesActionsTest-532309110 tempest-VolumesActionsTest-532309110-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 04:06:19.483750 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-6a6dad69-d26b-4ac8-b0e7-4d4bc2a37392 tempest-VolumesActionsTest-532309110 tempest-VolumesActionsTest-532309110-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 04:06:19.484504 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-6a6dad69-d26b-4ac8-b0e7-4d4bc2a37392 tempest-VolumesActionsTest-532309110 tempest-VolumesActionsTest-532309110-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 04:06:19.484977 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-6a6dad69-d26b-4ac8-b0e7-4d4bc2a37392 tempest-VolumesActionsTest-532309110 tempest-VolumesActionsTest-532309110-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 04:06:19.630175 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-6a6dad69-d26b-4ac8-b0e7-4d4bc2a37392 tempest-VolumesActionsTest-532309110 tempest-VolumesActionsTest-532309110-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8422c9211af341ec805b9174c540708e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1d5fd11a821458d866a1e9e61e10da4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 04:06:19.638398 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-6a6dad69-d26b-4ac8-b0e7-4d4bc2a37392 tempest-VolumesActionsTest-532309110 tempest-VolumesActionsTest-532309110-project] 10.222.0.11 "GET /compute/v2.1/servers/083c7990-add1-490b-94c8-ac58e5749e4b" status: 200 len: 1314 microversion: 2.1 time: 0.171302 Nov 17 04:06:19.638988 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 1571/3253] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 04:06:19 2021] GET /compute/v2.1/servers/083c7990-add1-490b-94c8-ac58e5749e4b => generated 1314 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 04:06:20.654924 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-bc504460-fef2-4d46-93d9-bdd4c67c026c tempest-VolumesActionsTest-532309110 tempest-VolumesActionsTest-532309110-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 04:06:20.655561 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-bc504460-fef2-4d46-93d9-bdd4c67c026c tempest-VolumesActionsTest-532309110 tempest-VolumesActionsTest-532309110-project] [instance: 083c7990-add1-490b-94c8-ac58e5749e4b] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 04:06:20.662201 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-bc504460-fef2-4d46-93d9-bdd4c67c026c tempest-VolumesActionsTest-532309110 tempest-VolumesActionsTest-532309110-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 04:06:20.662657 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-bc504460-fef2-4d46-93d9-bdd4c67c026c tempest-VolumesActionsTest-532309110 tempest-VolumesActionsTest-532309110-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 04:06:20.663462 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-bc504460-fef2-4d46-93d9-bdd4c67c026c tempest-VolumesActionsTest-532309110 tempest-VolumesActionsTest-532309110-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 04:06:20.663932 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-bc504460-fef2-4d46-93d9-bdd4c67c026c tempest-VolumesActionsTest-532309110 tempest-VolumesActionsTest-532309110-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 04:06:20.803349 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-bc504460-fef2-4d46-93d9-bdd4c67c026c tempest-VolumesActionsTest-532309110 tempest-VolumesActionsTest-532309110-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8422c9211af341ec805b9174c540708e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1d5fd11a821458d866a1e9e61e10da4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 04:06:20.812075 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-bc504460-fef2-4d46-93d9-bdd4c67c026c tempest-VolumesActionsTest-532309110 tempest-VolumesActionsTest-532309110-project] 10.222.0.11 "GET /compute/v2.1/servers/083c7990-add1-490b-94c8-ac58e5749e4b" status: 200 len: 1314 microversion: 2.1 time: 0.160986 Nov 17 04:06:20.812634 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 1683/3254] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 04:06:20 2021] GET /compute/v2.1/servers/083c7990-add1-490b-94c8-ac58e5749e4b => generated 1314 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 04:06:21.829768 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-b0b0bcd6-cfe4-4646-b1a7-e771bd1db22c tempest-VolumesActionsTest-532309110 tempest-VolumesActionsTest-532309110-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 04:06:21.830469 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-b0b0bcd6-cfe4-4646-b1a7-e771bd1db22c tempest-VolumesActionsTest-532309110 tempest-VolumesActionsTest-532309110-project] [instance: 083c7990-add1-490b-94c8-ac58e5749e4b] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 04:06:21.837322 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-b0b0bcd6-cfe4-4646-b1a7-e771bd1db22c tempest-VolumesActionsTest-532309110 tempest-VolumesActionsTest-532309110-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 04:06:21.837812 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-b0b0bcd6-cfe4-4646-b1a7-e771bd1db22c tempest-VolumesActionsTest-532309110 tempest-VolumesActionsTest-532309110-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 04:06:21.838644 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-b0b0bcd6-cfe4-4646-b1a7-e771bd1db22c tempest-VolumesActionsTest-532309110 tempest-VolumesActionsTest-532309110-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 04:06:21.839101 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-b0b0bcd6-cfe4-4646-b1a7-e771bd1db22c tempest-VolumesActionsTest-532309110 tempest-VolumesActionsTest-532309110-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 04:06:21.984770 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-b0b0bcd6-cfe4-4646-b1a7-e771bd1db22c tempest-VolumesActionsTest-532309110 tempest-VolumesActionsTest-532309110-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8422c9211af341ec805b9174c540708e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1d5fd11a821458d866a1e9e61e10da4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 04:06:21.997167 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-b0b0bcd6-cfe4-4646-b1a7-e771bd1db22c tempest-VolumesActionsTest-532309110 tempest-VolumesActionsTest-532309110-project] 10.222.0.11 "GET /compute/v2.1/servers/083c7990-add1-490b-94c8-ac58e5749e4b" status: 200 len: 1314 microversion: 2.1 time: 0.171290 Nov 17 04:06:21.998020 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 1572/3255] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 04:06:21 2021] GET /compute/v2.1/servers/083c7990-add1-490b-94c8-ac58e5749e4b => generated 1314 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 04:06:22.176978 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [req-1f472d36-bb64-4bf8-b9f7-2e44a702c0bd req-02365326-27ff-4801-9bb5-eb8038bda615 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "083c7990-add1-490b-94c8-ac58e5749e4b", "name": "network-vif-plugged", "status": "completed", "tag": "63a8f3a8-a232-4226-a7e6-a5085f800126"}]} {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 17 04:06:22.178615 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 17 04:06:22.178615 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: warnings.warn(msg) Nov 17 04:06:22.186267 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [req-1f472d36-bb64-4bf8-b9f7-2e44a702c0bd req-02365326-27ff-4801-9bb5-eb8038bda615 service nova] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 04:06:22.186872 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [req-1f472d36-bb64-4bf8-b9f7-2e44a702c0bd req-02365326-27ff-4801-9bb5-eb8038bda615 service nova] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 04:06:22.199296 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.compute.server_external_events [req-1f472d36-bb64-4bf8-b9f7-2e44a702c0bd req-02365326-27ff-4801-9bb5-eb8038bda615 service nova] Creating event network-vif-plugged:63a8f3a8-a232-4226-a7e6-a5085f800126 for instance 083c7990-add1-490b-94c8-ac58e5749e4b on hv-cinder-81803 Nov 17 04:06:22.204277 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [req-1f472d36-bb64-4bf8-b9f7-2e44a702c0bd req-02365326-27ff-4801-9bb5-eb8038bda615 service nova] 10.222.0.11 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031342 Nov 17 04:06:22.204879 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 1684/3256] 10.222.0.11 () {64 vars in 1317 bytes} [Wed Nov 17 04:06:22 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 17 04:06:23.018851 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-1160a0c1-9a38-461b-9698-490fd8b9c3eb tempest-VolumesActionsTest-532309110 tempest-VolumesActionsTest-532309110-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 04:06:23.020237 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-1160a0c1-9a38-461b-9698-490fd8b9c3eb tempest-VolumesActionsTest-532309110 tempest-VolumesActionsTest-532309110-project] [instance: 083c7990-add1-490b-94c8-ac58e5749e4b] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 04:06:23.028929 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-1160a0c1-9a38-461b-9698-490fd8b9c3eb tempest-VolumesActionsTest-532309110 tempest-VolumesActionsTest-532309110-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 04:06:23.029375 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-1160a0c1-9a38-461b-9698-490fd8b9c3eb tempest-VolumesActionsTest-532309110 tempest-VolumesActionsTest-532309110-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 04:06:23.030139 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-1160a0c1-9a38-461b-9698-490fd8b9c3eb tempest-VolumesActionsTest-532309110 tempest-VolumesActionsTest-532309110-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 04:06:23.030564 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-1160a0c1-9a38-461b-9698-490fd8b9c3eb tempest-VolumesActionsTest-532309110 tempest-VolumesActionsTest-532309110-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 04:06:23.164141 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-1160a0c1-9a38-461b-9698-490fd8b9c3eb tempest-VolumesActionsTest-532309110 tempest-VolumesActionsTest-532309110-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8422c9211af341ec805b9174c540708e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1d5fd11a821458d866a1e9e61e10da4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 04:06:23.171588 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-1160a0c1-9a38-461b-9698-490fd8b9c3eb tempest-VolumesActionsTest-532309110 tempest-VolumesActionsTest-532309110-project] 10.222.0.11 "GET /compute/v2.1/servers/083c7990-add1-490b-94c8-ac58e5749e4b" status: 200 len: 1314 microversion: 2.1 time: 0.159559 Nov 17 04:06:23.172155 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 1573/3257] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 04:06:23 2021] GET /compute/v2.1/servers/083c7990-add1-490b-94c8-ac58e5749e4b => generated 1314 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 04:06:24.193865 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-72be98dc-7b92-43e0-80b2-3c6daf1588cc tempest-VolumesActionsTest-532309110 tempest-VolumesActionsTest-532309110-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 04:06:24.194985 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-72be98dc-7b92-43e0-80b2-3c6daf1588cc tempest-VolumesActionsTest-532309110 tempest-VolumesActionsTest-532309110-project] [instance: 083c7990-add1-490b-94c8-ac58e5749e4b] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 04:06:24.202941 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-72be98dc-7b92-43e0-80b2-3c6daf1588cc tempest-VolumesActionsTest-532309110 tempest-VolumesActionsTest-532309110-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 04:06:24.203389 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-72be98dc-7b92-43e0-80b2-3c6daf1588cc tempest-VolumesActionsTest-532309110 tempest-VolumesActionsTest-532309110-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 04:06:24.204162 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-72be98dc-7b92-43e0-80b2-3c6daf1588cc tempest-VolumesActionsTest-532309110 tempest-VolumesActionsTest-532309110-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 04:06:24.204595 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-72be98dc-7b92-43e0-80b2-3c6daf1588cc tempest-VolumesActionsTest-532309110 tempest-VolumesActionsTest-532309110-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 04:06:24.343805 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-72be98dc-7b92-43e0-80b2-3c6daf1588cc tempest-VolumesActionsTest-532309110 tempest-VolumesActionsTest-532309110-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8422c9211af341ec805b9174c540708e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1d5fd11a821458d866a1e9e61e10da4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 04:06:24.355917 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-72be98dc-7b92-43e0-80b2-3c6daf1588cc tempest-VolumesActionsTest-532309110 tempest-VolumesActionsTest-532309110-project] 10.222.0.11 "GET /compute/v2.1/servers/083c7990-add1-490b-94c8-ac58e5749e4b" status: 200 len: 1497 microversion: 2.1 time: 0.168655 Nov 17 04:06:24.356732 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 1685/3258] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 04:06:24 2021] GET /compute/v2.1/servers/083c7990-add1-490b-94c8-ac58e5749e4b => generated 1497 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 04:06:24.863606 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-be65d359-46f2-4c0e-bb88-40e8f47d91bf tempest-VolumesActionsTest-532309110 tempest-VolumesActionsTest-532309110-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 04:06:24.864201 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-be65d359-46f2-4c0e-bb88-40e8f47d91bf tempest-VolumesActionsTest-532309110 tempest-VolumesActionsTest-532309110-project] [instance: 083c7990-add1-490b-94c8-ac58e5749e4b] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 04:06:24.871779 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-be65d359-46f2-4c0e-bb88-40e8f47d91bf tempest-VolumesActionsTest-532309110 tempest-VolumesActionsTest-532309110-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 04:06:24.872231 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-be65d359-46f2-4c0e-bb88-40e8f47d91bf tempest-VolumesActionsTest-532309110 tempest-VolumesActionsTest-532309110-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 04:06:24.873066 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-be65d359-46f2-4c0e-bb88-40e8f47d91bf tempest-VolumesActionsTest-532309110 tempest-VolumesActionsTest-532309110-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 04:06:24.873498 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-be65d359-46f2-4c0e-bb88-40e8f47d91bf tempest-VolumesActionsTest-532309110 tempest-VolumesActionsTest-532309110-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 04:06:24.899024 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-be65d359-46f2-4c0e-bb88-40e8f47d91bf tempest-VolumesActionsTest-532309110 tempest-VolumesActionsTest-532309110-project] [instance: 083c7990-add1-490b-94c8-ac58e5749e4b] Going to try to terminate instance {{(pid=115916) delete /opt/stack/nova/nova/compute/api.py:2614}} Nov 17 04:06:24.980936 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-be65d359-46f2-4c0e-bb88-40e8f47d91bf tempest-VolumesActionsTest-532309110 tempest-VolumesActionsTest-532309110-project] 10.222.0.11 "DELETE /compute/v2.1/servers/083c7990-add1-490b-94c8-ac58e5749e4b" status: 204 len: 0 microversion: 2.1 time: 0.120735 Nov 17 04:06:24.981604 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 1574/3259] 10.222.0.11 () {58 vars in 1238 bytes} [Wed Nov 17 04:06:24 2021] DELETE /compute/v2.1/servers/083c7990-add1-490b-94c8-ac58e5749e4b => generated 0 bytes in 122 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 17 04:06:24.990042 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-551e0a03-19c6-4202-a505-90889260c00c tempest-VolumesActionsTest-532309110 tempest-VolumesActionsTest-532309110-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 04:06:24.990648 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-551e0a03-19c6-4202-a505-90889260c00c tempest-VolumesActionsTest-532309110 tempest-VolumesActionsTest-532309110-project] [instance: 083c7990-add1-490b-94c8-ac58e5749e4b] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 04:06:24.996676 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-551e0a03-19c6-4202-a505-90889260c00c tempest-VolumesActionsTest-532309110 tempest-VolumesActionsTest-532309110-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 04:06:24.997149 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-551e0a03-19c6-4202-a505-90889260c00c tempest-VolumesActionsTest-532309110 tempest-VolumesActionsTest-532309110-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 04:06:24.997912 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-551e0a03-19c6-4202-a505-90889260c00c tempest-VolumesActionsTest-532309110 tempest-VolumesActionsTest-532309110-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 04:06:24.998344 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-551e0a03-19c6-4202-a505-90889260c00c tempest-VolumesActionsTest-532309110 tempest-VolumesActionsTest-532309110-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 04:06:25.142509 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.policy [None req-551e0a03-19c6-4202-a505-90889260c00c tempest-VolumesActionsTest-532309110 tempest-VolumesActionsTest-532309110-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8422c9211af341ec805b9174c540708e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1d5fd11a821458d866a1e9e61e10da4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115917) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 04:06:25.150373 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-551e0a03-19c6-4202-a505-90889260c00c tempest-VolumesActionsTest-532309110 tempest-VolumesActionsTest-532309110-project] 10.222.0.11 "GET /compute/v2.1/servers/083c7990-add1-490b-94c8-ac58e5749e4b" status: 200 len: 1503 microversion: 2.1 time: 0.164042 Nov 17 04:06:25.151020 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 1686/3260] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 04:06:24 2021] GET /compute/v2.1/servers/083c7990-add1-490b-94c8-ac58e5749e4b => generated 1503 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 04:06:26.171606 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-2b695b6c-f111-44b6-9809-9de0532f3e31 tempest-VolumesActionsTest-532309110 tempest-VolumesActionsTest-532309110-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 04:06:26.172517 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-2b695b6c-f111-44b6-9809-9de0532f3e31 tempest-VolumesActionsTest-532309110 tempest-VolumesActionsTest-532309110-project] [instance: 083c7990-add1-490b-94c8-ac58e5749e4b] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 04:06:26.181371 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-2b695b6c-f111-44b6-9809-9de0532f3e31 tempest-VolumesActionsTest-532309110 tempest-VolumesActionsTest-532309110-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 04:06:26.181964 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-2b695b6c-f111-44b6-9809-9de0532f3e31 tempest-VolumesActionsTest-532309110 tempest-VolumesActionsTest-532309110-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 04:06:26.183060 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-2b695b6c-f111-44b6-9809-9de0532f3e31 tempest-VolumesActionsTest-532309110 tempest-VolumesActionsTest-532309110-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 04:06:26.183724 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-2b695b6c-f111-44b6-9809-9de0532f3e31 tempest-VolumesActionsTest-532309110 tempest-VolumesActionsTest-532309110-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 04:06:26.337630 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-2b695b6c-f111-44b6-9809-9de0532f3e31 tempest-VolumesActionsTest-532309110 tempest-VolumesActionsTest-532309110-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8422c9211af341ec805b9174c540708e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1d5fd11a821458d866a1e9e61e10da4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 04:06:26.349823 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-2b695b6c-f111-44b6-9809-9de0532f3e31 tempest-VolumesActionsTest-532309110 tempest-VolumesActionsTest-532309110-project] 10.222.0.11 "GET /compute/v2.1/servers/083c7990-add1-490b-94c8-ac58e5749e4b" status: 200 len: 1503 microversion: 2.1 time: 0.183923 Nov 17 04:06:26.350640 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 1575/3261] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 04:06:26 2021] GET /compute/v2.1/servers/083c7990-add1-490b-94c8-ac58e5749e4b => generated 1503 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 04:06:26.979392 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [req-3b894da9-c0c7-4fc5-898c-4589b2ef4094 req-b34c3ef5-ec4a-4438-ae1e-69f39d7cdc44 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "083c7990-add1-490b-94c8-ac58e5749e4b", "name": "network-vif-deleted", "tag": "63a8f3a8-a232-4226-a7e6-a5085f800126"}]} {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 17 04:06:26.981314 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 17 04:06:26.981314 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: warnings.warn(msg) Nov 17 04:06:26.988502 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [req-3b894da9-c0c7-4fc5-898c-4589b2ef4094 req-b34c3ef5-ec4a-4438-ae1e-69f39d7cdc44 service nova] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 04:06:26.988972 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [req-3b894da9-c0c7-4fc5-898c-4589b2ef4094 req-b34c3ef5-ec4a-4438-ae1e-69f39d7cdc44 service nova] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 04:06:27.000609 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.compute.server_external_events [req-3b894da9-c0c7-4fc5-898c-4589b2ef4094 req-b34c3ef5-ec4a-4438-ae1e-69f39d7cdc44 service nova] Creating event network-vif-deleted:63a8f3a8-a232-4226-a7e6-a5085f800126 for instance 083c7990-add1-490b-94c8-ac58e5749e4b on hv-cinder-81803 Nov 17 04:06:27.005412 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [req-3b894da9-c0c7-4fc5-898c-4589b2ef4094 req-b34c3ef5-ec4a-4438-ae1e-69f39d7cdc44 service nova] 10.222.0.11 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029725 Nov 17 04:06:27.006313 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 1687/3262] 10.222.0.11 () {64 vars in 1317 bytes} [Wed Nov 17 04:06:26 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 17 04:06:27.371516 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.api.openstack.wsgi [None req-b0a5c515-e8a8-4927-b381-efbf545cc952 tempest-VolumesActionsTest-532309110 tempest-VolumesActionsTest-532309110-project] Calling method '>' {{(pid=115916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 04:06:27.372209 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.compute.api [None req-b0a5c515-e8a8-4927-b381-efbf545cc952 tempest-VolumesActionsTest-532309110 tempest-VolumesActionsTest-532309110-project] [instance: 083c7990-add1-490b-94c8-ac58e5749e4b] Fetching instance by UUID {{(pid=115916) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 04:06:27.379686 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-b0a5c515-e8a8-4927-b381-efbf545cc952 tempest-VolumesActionsTest-532309110 tempest-VolumesActionsTest-532309110-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 04:06:27.380138 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-b0a5c515-e8a8-4927-b381-efbf545cc952 tempest-VolumesActionsTest-532309110 tempest-VolumesActionsTest-532309110-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 04:06:27.380961 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-b0a5c515-e8a8-4927-b381-efbf545cc952 tempest-VolumesActionsTest-532309110 tempest-VolumesActionsTest-532309110-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 04:06:27.381382 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-b0a5c515-e8a8-4927-b381-efbf545cc952 tempest-VolumesActionsTest-532309110 tempest-VolumesActionsTest-532309110-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 04:06:27.412898 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-b0a5c515-e8a8-4927-b381-efbf545cc952 tempest-VolumesActionsTest-532309110 tempest-VolumesActionsTest-532309110-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 04:06:27.413348 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG oslo_concurrency.lockutils [None req-b0a5c515-e8a8-4927-b381-efbf545cc952 tempest-VolumesActionsTest-532309110 tempest-VolumesActionsTest-532309110-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 04:06:27.413796 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.objects.instance [None req-b0a5c515-e8a8-4927-b381-efbf545cc952 tempest-VolumesActionsTest-532309110 tempest-VolumesActionsTest-532309110-project] Lazy-loading 'fault' on Instance uuid 083c7990-add1-490b-94c8-ac58e5749e4b {{(pid=115916) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Nov 17 04:06:27.456516 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: DEBUG nova.policy [None req-b0a5c515-e8a8-4927-b381-efbf545cc952 tempest-VolumesActionsTest-532309110 tempest-VolumesActionsTest-532309110-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8422c9211af341ec805b9174c540708e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1d5fd11a821458d866a1e9e61e10da4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115916) authorize /opt/stack/nova/nova/policy.py:199}} Nov 17 04:06:27.463911 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO nova.api.openstack.requestlog [None req-b0a5c515-e8a8-4927-b381-efbf545cc952 tempest-VolumesActionsTest-532309110 tempest-VolumesActionsTest-532309110-project] 10.222.0.11 "GET /compute/v2.1/servers/083c7990-add1-490b-94c8-ac58e5749e4b" status: 200 len: 1304 microversion: 2.1 time: 0.098667 Nov 17 04:06:27.464583 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: [pid: 115916|app: 0|req: 1576/3263] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 04:06:27 2021] GET /compute/v2.1/servers/083c7990-add1-490b-94c8-ac58e5749e4b => generated 1304 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 17 04:06:28.487537 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-417370d0-61f5-4b53-8718-b287fe5a2369 tempest-VolumesActionsTest-532309110 tempest-VolumesActionsTest-532309110-project] Calling method '>' {{(pid=115917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 17 04:06:28.488572 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.compute.api [None req-417370d0-61f5-4b53-8718-b287fe5a2369 tempest-VolumesActionsTest-532309110 tempest-VolumesActionsTest-532309110-project] [instance: 083c7990-add1-490b-94c8-ac58e5749e4b] Fetching instance by UUID {{(pid=115917) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 17 04:06:28.499301 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-417370d0-61f5-4b53-8718-b287fe5a2369 tempest-VolumesActionsTest-532309110 tempest-VolumesActionsTest-532309110-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 04:06:28.500092 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-417370d0-61f5-4b53-8718-b287fe5a2369 tempest-VolumesActionsTest-532309110 tempest-VolumesActionsTest-532309110-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 04:06:28.501422 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-417370d0-61f5-4b53-8718-b287fe5a2369 tempest-VolumesActionsTest-532309110 tempest-VolumesActionsTest-532309110-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 17 04:06:28.502157 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG oslo_concurrency.lockutils [None req-417370d0-61f5-4b53-8718-b287fe5a2369 tempest-VolumesActionsTest-532309110 tempest-VolumesActionsTest-532309110-project] Lock "8d6d2374-cf51-40eb-9f65-96e5f5e4c457" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 17 04:06:28.519685 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.wsgi [None req-417370d0-61f5-4b53-8718-b287fe5a2369 tempest-VolumesActionsTest-532309110 tempest-VolumesActionsTest-532309110-project] HTTP exception thrown: Instance 083c7990-add1-490b-94c8-ac58e5749e4b could not be found. Nov 17 04:06:28.520280 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: DEBUG nova.api.openstack.wsgi [None req-417370d0-61f5-4b53-8718-b287fe5a2369 tempest-VolumesActionsTest-532309110 tempest-VolumesActionsTest-532309110-project] Returning 404 to user: Instance 083c7990-add1-490b-94c8-ac58e5749e4b could not be found. {{(pid=115917) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 17 04:06:28.521275 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO nova.api.openstack.requestlog [None req-417370d0-61f5-4b53-8718-b287fe5a2369 tempest-VolumesActionsTest-532309110 tempest-VolumesActionsTest-532309110-project] 10.222.0.11 "GET /compute/v2.1/servers/083c7990-add1-490b-94c8-ac58e5749e4b" status: 404 len: 111 microversion: 2.1 time: 0.041930 Nov 17 04:06:28.521810 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: [pid: 115917|app: 0|req: 1688/3264] 10.222.0.11 () {58 vars in 1235 bytes} [Wed Nov 17 04:06:28 2021] GET /compute/v2.1/servers/083c7990-add1-490b-94c8-ac58e5749e4b => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 17 04:07:34.629087 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 17 04:07:34.630257 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: Wed Nov 17 04:07:34 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Nov 17 04:09:56.730136 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 17 04:09:56.731366 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: Wed Nov 17 04:09:56 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Nov 17 04:10:04.812244 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 17 04:10:04.813008 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: Wed Nov 17 04:10:04 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Nov 17 04:10:10.066299 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 17 04:10:10.067011 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: Wed Nov 17 04:10:10 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Nov 17 04:10:30.730555 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 17 04:10:30.731819 dv-cinder-818037-2-iscsi devstack@n-api.service[115916]: Wed Nov 17 04:10:30 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Nov 17 04:10:32.902145 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 17 04:10:32.903116 dv-cinder-818037-2-iscsi devstack@n-api.service[115917]: Wed Nov 17 04:10:32 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!!